Testlio announced today it is adding fuzz testing capability to its application testing platform; Testlio is used by IT organizations to manage application testing consisting of internal employees and external contractors vetted by Testlio.
Fuzz testing describes the combination of automated and manual testing IT organizations use to improve overall productivity. The automated process involves feeding invalid, unexpected or random data as inputs to an application and then monitoring it for exceptions such as crashes, failing built-in code assertions or potential memory leaks. Fuzz testing strikes a balance between tests that can be automated and those that still need to be performed by a human.
To achieve that goal, Testlio has partnered with Applitools, BrowserStack, Headspin, Mapl and Sauce Labs. Failure signals and session artifacts from these tools can be pushed to the Testlio platform to streamline the triage of test results. Testlio is making six device slots and 100 hours per month of automated testing processing time available at no additional cost.
Finally, Testlio has set up an automated testing center of excellence (CoE) as part of an implementation of expansion of its professional consulting services it provides to help organizations testing best practices.
Testlio CEO Steve Semelsberger said those integrations will make it simpler to augment human testers and increase the rate at which applications can be tested as many organizations are accelerating the rate at which those applications are being built and
As organizations seek to continuous implement testing within the context of a DevOps workflow it’s apparent there will need to be more reliance on automation to keep pace with application development, he added.
Through its platform, Testlio provides organizations with access to more than 10,000 freelance application testers on demand. That network of testing professionals can create, run, optimize and diagnose automated tests using Appium and Selenium frameworks written in programming languages such as Python, Java and Node.js. Only 3% of the freelance application testers that apply to join the Testlio network have been accepted, noted Semelsberger.
The degree to which organizations prefer to rely on internal employees versus contractors to test applications will naturally vary. However, it’s difficult to predict what volume of tests will need to be performed—and when they should be performed—to preserve application development timetables. Contractors provide IT organizations with a degree of testing flexibility that is becoming an absolute requirement given the current challenges of hiring and retaining professional application testers, said Semelsberger.
Application testing is, of course, difficult to apply uniformly no matter how many testers are available. In addition to providing access to experienced freelance testers, Testlio also provides a platform for managing the overall testing process. The challenge is then aligning those testing tasks with the various application development projects the organization has launched.
Regardless of the approach to testing, the need for it has never been more critical. As organizations embrace a wide range of digital business transformation initiatives, a much higher percentage of the applications are now externally facing. The tolerance for suboptimal application experiences among customers and partners is much lower than that of internal employees. As such, first impressions, like it or not, are going to determine the success and failure of most of those application initiatives.