19_SDT040.qxp_Layout 1 9/21/20 11:26 AM Page 19
SOFTWARE TESTING SHOWCASE
Testing in a Complex Digital World
A
bout a decade ago, application testing was fairly straightforward, albeit a manual effort and somewhat of a drag on delivery. Tests cases were written, functional and UI tests were done, regression, pen and load testing would happen, and the application was deemed ‘good to go.’ Today's digital world of APIs, open-source components, mobile devices, IoT endpoints, DevOps pipelines and containers — not to mention the squeezed timelines for application delivery — render manual testing almost completely ineffective.
Yes, the testing world has evolved. We're seeing automated testing, continuous testing and security testing emerge, as well as non-traditional testing such as feature experimentation and chaos engineering advancing to keep pace with organizational demands in the digital age. This showcase is a guide to some of the companies that provide testing tools, and each comes at the issue from a different perspective. We hope you find it useful, and encourage you to reach out to these solution providers to learn more.
Full Page Ads_SDT040.qxp_Layout 1 9/18/20 3:47 PM Page 20
ULTRAFAST TEST CLOUD 18x Faster End-to-End Testing
Visual AI provides 99.9999% accurate test coverage
Render across all web & mobile screens in seconds
GET YOUR COPY OF MODERN CROSS BROWSER TESTING THROUGH VISUAL AI
appl i t ools.com/ultra f a s t
Eliminate slow & flakey tests to speed up CI/CD workflows
021_SDT040.qxp_Layout 1 9/21/20 11:48 AM Page 21
SOFTWARE TESTING
The Future of Testing is AI: Visual AI
A
pplications and the environments they live in continue to become more complex. While shift-left testing helps improve app quality, alone it’s not enough to ensure quality as new frameworks and tools emerge. With Applitools’ AI-powered visual testing and monitoring platform, leading companies are improving app quality, accelerating delivery cycles and reducing the time it takes to test. “Application changes occur several times a day now. These changes need to work on many browsers, devices, operating systems and different environments, so you need to do far more work in far less time,” said Gil Sever, CEO and cofounder of Applitools. “You can’t manually write and maintain all the scripts needed, so you need Visual AI to take over these rote aspects of the work.” A recent survey of 400 of Fortune 1,000 companies reveals that those organizations use an average of 30 different applications that include 94 pages which need to display correctly on six to 10 different screen sizes in six to eight different human languages. “The number of nuances ranges from 100,000 to 700,000, and the number of applications is growing 30% to 50% per year,” said Sever. “Salesforce runs 100,000 tests per day so a 10 percent false positive rate would be 10,000 instances that humans would have to analyze. Using AI, we reduce the false positive rate to 1 in a million, so it’s 99.9999% accurate.” Applitools also accelerates testing by 30 to 70 times using containers. The faster testing cycles and higher levels of testing accuracy enables UI testing to keep pace with CI/CD. Importantly, Applitools integrates with existing tools in a team’s DevOps tool chain, ensuring app quality throughout the SDLC. Examples include CI and CD servers, test automation platforms, deployment tools, monitoring tools and repositories. That way, when code is pushed to the repository, it can be tested and automatically deployed if it passes.
and visually compare them to the results with the baseline.” Applitools automatically surfaces UI issues and their root cause so they can be resolved faster. Specifically, it provides side-by-side screenshots showing the expected result and the actual result so testers don’t have to recreate the errors themselves. The baseline comparisons can be a previous version compared to the new version, such as what a page looks like on one browser or device versus another. It also reveals how a page appears given different screen resolutions.
“Application changes occur several times a day now... You can’t manually write and maintain all the scripts needed...” —Gil Sever
“We use automatic maintenance which saves a lot of time. It also keeps the [test] coverage high,” said Sever. “When you’re manually maintaining and fixing thousands of scripts, test coverage drops.” Applitools boasts nearly 100 of the Fortune Global 500 as customers including Amazon, Salesforce, Capital One, McKesson, and Sony. Four of the top seven pharmaceutical giants use Applitools to ensure that drug warnings render properly irrespective of devices and also use Applitools UI version control results as evidence of regulatory compliance. Other Applitools customers include nine of the 10 largest software companies and half of the largest U.S. banks. As more software development and testing frameworks emerge, Applitools supports them via APIs so customers can connect to them quickly and easily. Applitools also supports content management systems (CMSs) such as Adobe Experience Manager so data can flow seamlessly from the CMS to an app. Applitools users simply write the navigation script and the validation or assertion in the Applitools’ chat window.
Visual AI Manages the Rote, Error Prone Aspects of Software Testing
Attend Applitools Online Automation University, Free
Applitools proprietary Visual AI comprises a set of algorithms that analyze computer screens, including desktop and web applications, mobile apps, games and more. “Traditionally, you’d use Selenium or Appium test automation scripts to mimic a human interaction with the UI. Then, the results would be compared to the expected results to make sure everything is appearing in the right place,” said Sever. “This is what we automate with Visual AI so instead of writing hundreds of lines of code to assert and validate that everything works, you can use Applitools to test all the screen interactions
Applitools is on a mission to deliver a Next Generation Test Automation Platform through Visual AI and Ultrafast Grid. The company enables engineering teams to release high quality web and mobile apps at incredible speed at a reduced cost. Applitools also created Test Automation University, the largest educational entity of its kind, with more than 60 online courses available for free. Today more than 60,000 engineers are enrolled taking courses covering major test frameworks and languages. Learn more at Applitools.com. 3
022_SDT040.qxp_Layout 1 9/21/20 11:47 AM Page 22
SOFTWARE TESTING
Parasoft Leads Testing Innovation
T
he COVID-19 pandemic has caused organizations to accelerate their digital transformation strategies. Two of the major trends are supporting a remote workforce and engaging customers primarily, if not exclusively, through digital channels. Critical to employee productivity and customer experience is adequate software testing that requires a high level of automation. “Organizations are figuring out how to enable the digital side of their business to both protect existing markets and take advantage of new ones,” said Mark Lambert, VP of strategic initiatives at Parasoft. “A lot of them are leveraging lowcode platforms like Salesforce Lightning to accelerate digital transformation and their movement into the cloud.” Faced with rapidly evolving circumstances, businesses need to ensure that the software they develop, customize and deliver provides the needed functionality and meets all compliance requirements.
Low-Code Use Is Increasing Many developers originally dismissed low code as simple tools built for those who are unable to code. However, as software development and delivery cycles continued to shrink with the 2020 COVID-19 pandemic, more organizations are now using low code to become more Agile than they were before. “As organizations mature in their adoption of low code, they’re creating teams that include both citizen developers and professional developers to support the increasing scope of functionality, which tends to increase pretty quickly.” said Lambert. “It’s the job of the technical team to create building blocks that enable the less technical business developers across the organization.”
The Pandemic Is Driving Greater Test Automation Since entire white-collar workforces are now working remotely, more teams are containerizing their DevOps pipelines and pushing them into the cloud. “Test automation is the only way you can efficiently verify functionality and ensure compliance. It’s the key to unlocking Agile and DevOps,” said Lambert. “You need a robust delivery pipeline and process. Quality needs to be built into that pipeline to accelerate delivery with confidence.” Since one small code change can have a negative cascading effect across an application, other applications and use cases, organizations are figuring out how they can create a scalable test automation strategy that integrates with their ecosystem. Parasoft covers everything from code analysis and auto-
mated unit testing to automated API and UI testing. By leveraging AI and machine learning across these quality practices, Parasoft’s suite of test automation products assist developers and testers with the underlying activities.
Service Virtualization Speeds Development and Testing “When you’re connecting across different services and providers, the level of interconnectedness explodes the complexity of your test environment. You need a way to control that environment,” said Lambert. “Test automation is the only way you can efficiently verify functionality and ensure compliance.” —Mark Lambert
Service virtualization decreases the time and cost required to test due to constrained dependencies. With today’s remote work mandates, more organizations want to emulate backend system dependencies and control their functional behavior. With Parasoft service virtualization, developers and testers can create synthetic data and virtual services that behave like their real counterparts. “Like many others, one of our Canadian partners now has fully remote software development teams. Their challenge is giving teams access to systems without leveraging on-network devices,” said Lambert. “They’re rolling out service virtualization now to address this and unblock the teams.”
Why Customers Love Parasoft Parasoft continues to be recognized by industry analysts and customers as the platform of choice for testing throughout the development pipeline—from code analysis that ensures security compliance and reliability to automated unit, API, UI and load and performance testing. Parasoft integrates with open source testing frameworks like Selenium, TestNG and JUnit, providing complementary functionality that assists with the difficult tasks of creation and maintenance. “We’re recognized as a leader and visionary by Forrester and Gartner, respectively. We pride ourselves on delivering innovations that go beyond continuous testing to help clients achieve continuous quality. We’re also honored to have received the Gartner Peer Insights Customer Choice award in both 2019 and 2020, validating that we’re building products that make teams more effective,” said Lambert. Learn more at www.parasoft.com. 3
Full Page Ads_SDT040.qxp_Layout 1 9/18/20 3:47 PM Page 23
!!#*#0 2# -$25 0# 3 *'27 '2& -+.0#&#,1'4# #12',% )# 130# 7-30 ..*'! 2'-,1 +##2 !312-+#0 #6.#!2 2'-,1ล !-+.*' ,!# 0#%3* 2'-,1ล ," 31',#11 %- *1ล m|;]u-|; -u-vo=| 1om|bmย oย v |;v|bm] voัดย |bomv |o bm1ourou-|; =ย m1|bom-ัด -m7 momล =ย m1|bom-ัด |;v|bm] ย b|_bm ย oย u ;ย rv ย ouh=ัดoย ฤบ
โ ข ย |ol-|; v;1ย ub|ย ฤท u;ัดb-0bัดb|ย ฤท -m7 1olrัดb-m1; -v 1o7; bv ย ub||;mฤบ โ ข 1_b;ย ; 1o7; 1oย ;u-]; |-u];|v ย b|_ ล roย ;u;7 ย mb|ฤท ฤท -m7 & |;v|bm]ฤบ โ ข !;ย v; =ย m1|bom-ัด |;v|v |o v_b=| ัด;=| ัดo-7 -m7 r;u=oul-m1; |;v|bm]ฤบ โ ข m-0ัด; 1om|bmย oย v ;m7ล |oล ;m7 -m7 bm|;]u-|bom |;v|bm] ย b|_ v;uย b1; ย bu|ย -ัดbย -|bomฤบ โ ข m|;]u-|; tย -ัดb|ย bm|o ย oย u ล rbr;ัดbm; |o vblrัดb=ย -m7 -ย |ol-|; 7;ัดbย ;uย 7;1bvbomvฤบ
PA R A S O F T.C O M | I N F O @ PA R A S O F T.C O M | 8 8 8 . 3 0 5 . 0 0 41
Full Page Ads_SDT040.qxp_Layout 1 9/18/20 3:48 PM Page 24
025_SDT040.qxp_Layout 1 9/21/20 11:49 AM Page 25
SOFTWARE TESTING
Supercharge Testing with Mobile Labs
E
ffective mobile app testing is even more important today than it was before COVID-19 hit. These days, mobile app experiences impact which brands and services customers choose and how productive work-from-home employees can be. To ensure the highest performance and scalability of apps ranging from enterprise productivity to games, teams serious about product quality choose Mobile Labs. “COVID-19 has accelerated the digitalization of businesses in every industry because it’s the only way for them to engage with their customers. Instead of going into physical businesses, consumers are using mobile apps to check their bank balance, apply for loan or to order fast food for curbside pickup,” said Dan McFall, president and CEO of Mobile Labs. “Before the pandemic, a lot of mobile testers were relying on the few physical devices they kept in a drawer at work. Now, they’re realizing they need access to a device cloud that provides the same interactive capabilities desktop and web developers get using virtual machines.”
Improve Mobile Test Coverage and Automation While testing an app on a wider range of devices, operating system versions and browser versions helps ensure better app experiences across more customers, most developers, testers and QA engineers say they still need to improve test coverage and the velocity of testing. While many have adopted the Appium open source automation tool, Appium can be difficult to scale and manage because, as an open source project, it’s not clear when updates will occur and the documentation leaves much to be desired. To help customers get more from their automation efforts, Mobile Labs created its own Appium server that benefits customers irrespective of whether they’re using Appium yet or not. Current Appium users benefit from improved Appium performance and reliability. They also discover it’s easier to manage and support their automation infrastructure. Those without Appium find they can start scripting immediately without downloading, installing or configuring Appium. A surprising benefit of Mobile Labs’ Appium server is the 4X or greater scalability it provides. “One of the challenges with Appium is if you try to run more than 8, 10, 12 concurrent tests, you’re going to need a lot of hardware,” said McFall. “We can increase that to 40, 48 concurrent tests running against a single server, making it easier to scale. Since it’s hard for people to go into the office and set up new hardware now, the more they can get out of what they have, the better.” What’s more, Appium users don’t have to wait for commu-
nity fixes because Mobile Labs handles them proactively. Customers facing script automation issues, which commonly arise as the result of internal skills shortages, can find intelligent scripting solutions in Mobile Labs’ partner network. Like robust software development IDEs that pinpoint coding errors, intelligent scripting solutions rapidly identify test automation script errors. “Since it’s hard for people to go into the office and set up new hardware now, the more they can get out of what they have, the better.” —Dan McFall
Test Your Way Many enterprises have Mobile Labs running on-premises behind a firewall. However, with COVID-19 remote work trends, Mobile Labs’ hosting has mushroomed. “We’ve been getting rave reviews on our hosting, so more people are starting to realize we’re not just the on-premises people,” said McFall. “In fact, we’ve seen a lot of growth in the gaming sector because of the device performance we provide.” Customers who choose Mobile Labs hosting can always move their environment on-premises at any time without fear of vendor lock-in. Teams that want to tame the chaos of testing multiple apps across multiple platforms, operating systems, and device types behind a firewall tend to choose Mobile Labs’ GigaFox Red mobile device testing cloud. Teams that need access to more devices or enhanced graphics features behind a firewall or hosted choose GigaFox Silver. Small teams or teams that are just getting started with mobile app testing can jumpstart their journey with GigaFox StarterKit. All GigaFox versions help accelerate development and continuous testing because they provide developers, testers and QA with access to the same devices. Moreover, those devices are the actual devices customers use. Another benefit of Mobile Labs is future-proof testing. Instead of purchasing new equipment because Apple just released its latest versions of iPhone, for example, customers can simply subscribe to the Mobile Labs Device Refresh Program, which allows them to swap old devices for new ones. When paired with GigaFox Red or GigaFox Silver mobile device clouds, teams can be sure they always have the devices they need to ensure the best quality user experiences. Learn more at www.mobilelabsinc.com. 3
026_SDT040.qxp_Layout 1 9/22/20 3:59 PM Page 26
SOFTWARE TESTING
Automate Mobile Testing with Kobiton
O
rganizations are automating more types of tests to keep pace with DevOps and CI/CD, but they all face a common challenge which is automating mobile testing. “Getting to automation is a big challenge with mobile,” said Frank Moyer, CTO at Kobiton. “It’s painful, because unlike the web world where there’s a W3C specification for HTML, in the mobile world, all of the manufacturers can render the XML however they choose. Each generates the DOM in a unique way which makes it impossible for automation engineers who need to navigate through an application to use a single selector that fits all devices.” To navigate through an app effectively, one needs to write a test automation script that can execute across the multitude of devices customers actually use. Then, hours must be spent combing through the tests to detect problems identified on the different devices. End-to-end mobile testing platform Kobiton speeds and simplifies the process so businesses can get to market faster with better quality mobile apps. “We use machine learning so manual testers and automation engineers can accomplish more in less time,” said Moyer. “All you do is run a manual session and we can automate that test across hundreds of devices. It will tell you that these two devices crashed, these three devices have performance issues or if the text on the screen wraps off the edge incorrectly on these four devices so you need to address those issues.” With Kobiton, test automation scripts can be created and executed orders of magnitude faster, which speeds value delivery, improves product quality and boosts ROI. For example, one Kobiton customer spent 18 months automating mobile tests. The same scope of work can now be completed in just three weeks. Kobiton Intelligent Test Automation integrates with defect tracking systems so defects can be created in context. Best of all, the entire flow is seamless from manual test creation to test automation to defect identification and remediation. Kobiton remembers all of it so customers can benefit from regressions between one release and the next.
Kobiton Alleviates Pain Points A recent Kobiton survey of 350+ mobile developers and software testers reveals that although 55% said automation would improve software quality, 76% are automating fewer than half of all software tests. About half (51%) are releasing software updates daily or weekly, but 73% are running at least 100 manual tests before each software release. Although test automation is a mature concept, 58% said
their automation programs are either new or at least six months away from beginning. The biggest barriers to achieving automation are evaluating and choosing test automation tools (20%) and training and acquiring skilled automation engineers (17%). Seven in 10 said they recognize mobile is strategic or critical to their business. With Kobiton Intelligent Test Automation, those same professionals could create functional test scripts that provide the quickest path to mobile automation at scale. Because Kobiton fully supports a variety of assertions, test scripts can be as simple as checking an app’s layout or as complicated as performing complex functional logic tests. “In the mobile world, all of the manufacturers can render the XML however they choose.” —Frank Moyer
Importantly, organizations can deliver better mobile experiences by testing on real devices, in the cloud or on premises, while leveraging the latest in Appium test automation for seamless test script creation. As the first and only mobile scriptless test automation platform, Kobiton accelerates testing and delivery. And, instead of choosing between on-premises devices or devices in a test lab, Kobiton allows customers to take advantage of both to achieve truly hybrid mobile testing.
Mobile Test Automation Just Got Simpler Kobiton recently announced it is taking mobile test automation to an entirely new level. As of the latest release, Kobiton Intelligent Test Automation generates 100% open standard Appium code which can be customized, run on a competing device testing platform or integrated into a DevOps process. Manual testers and automation engineers are able to run a manual session on a specific device, such as an iPhone X, and within 20 minutes export the fully-functioning Appium script which is capable of running on more than 350 different devices. Companies using other device clouds, such as SauceLabs, BrowserStack, and Perfecto, can simply point Kobiton at those environments. The result is higher levels of test automation with minimal time and effort. “Organizations want to accelerate their digital app initiatives. To do that, they need a complete mobile experience platform that’s flexible and easy to use,” said Moyer. Learn more at www.kobiton.com. 3
Full Page Ads_SDT040.qxp_Layout 1 9/18/20 3:48 PM Page 27
Full Page Ads_SDT040.qxp_Layout 1 9/21/20 4:41 PM Page 28
A Faster Pentest that integrates with your devops workflow Cobalt offers on-demand Pentest as a Service for agile software development. Be up and running in 24 hours. Get real-time visibility into tester findings. Use Slack and Jira for easy communication.
029_SDT040.qxp_Layout 1 9/21/20 12:11 PM Page 29
SOFTWARE TESTING
Fix Penetration Testing Finds Faster
I
f you want to know whether your code is truly secure, it needs to be penetration (pen) tested. White hat pentesters can identify application vulnerabilities before bad actors exploit them, leaving you to remediate bugs proactively. Traditionally, developers and pentesters have both suffered from a lack of direct communication because, among things, pentesting is too slow for the fast-moving world of DevOps. Cybersecurity startup Cobalt bridges the gap with a “pentesting as a service” (PtaaS) platform and talent community that connects developers directly with pentesters. And, the platform integrates seamlessly with Jira, Github and Slack so developers can get the information from familiar tools. “Penetration testing is used as a gate by Waterfall teams. With DevOps, gating doesn’t work because it would disrupt the delivery cycle when delivery cycles are accelerating,” said Caroline Wong, chief strategy officer at Cobalt. “You need to integrate pentesting into the DevOps workflow.” Although today’s organizations are automating as much security testing as possible, there are entire classes of security vulnerabilities that go undetected when using automated methods alone, such as business logic bypasses, race conditions and change exploits. With Cobalt, pentesting becomes part of the DevOps pipeline. Better still, highly skilled pentesters are available on demand.
Cobalt Helps Secure Code Traditionally, when a pentest is completed, the testers provide a PDF report. The security team forwards the PDF to the engineering teams, usually without providing guidance or prioritizing the findings. “If developers are just getting a piece of paper with a bunch of problems and told to go fix them, you can’t blame them for ignoring the email altogether,” said Wong. “Security teams haven’t attempted to learn about the engineering workflows, let alone integrate security requests with those workflows. So, there’s no obvious channel for developers to ask security or pentesters how to resolve issues or even to clarify what the issues are.” Also, in a traditional workflow, pentests tend to be a oneoff engagement with little-to-no collaboration between developers and testers. In today’s increasingly digital world, DevOps and DevSecOps teams can’t afford to sacrifice security for application delivery speed. “DevOps and DevSecOps both rely on collaboration and communication. Developers should be able to collaborate with security and pentesters as easily as they communicate
with IT ops,” said Wong. “When that happens, pentesters can better understand the context, such as the application’s use cases. Conversely, developers can ask questions about the found vulnerabilities.” With Cobalt, developers can engage pentesters directly, on demand. That way, developers can ensure the timely retesting of their code and they deliver the code into production with a higher level of confidence because they know that the vulner-
“What might look like a high-severity risk to a pentester may be a lower priority to the business.” —Caroline Wong
abilities have been remediated. Similarly, developers can use Cobalt to get guidance from the security team about how the vulnerabilities should be prioritized.
A Dynamic PtaaS Approach Jira, Github and Slack are staples for Agile and DevOps teams. Cobalt integrates with all three so developers can get the information they need without launching yet another environment or application. Cobalt now also includes data analytics, which provide additional insights about what’s causing vulnerabilities and whether they were successfully remediated. “If you’re still relying on PDFs, there’s no way to bring the metadata together to gain insights and learnings,” said Wong. “With Cobalt, you can compare your approach and results with what others have done or see how one pentest compares to the other tests in your pentest program.” The Cobalt platform includes a SaaS-enabled global marketplace that connects pentest talent with DevOps and DevSecOps teams on demand. That way, more vulnerabilities can be identified, prioritized and remediated faster. “Pentesters and developers don’t always have the full picture, so what might look like a high-severity risk to a pentester may be a lower priority to the business because they lack context,” said Wong. “By communicating with security and engineering teams, pentesters are able to assign a more appropriate risk rating and level of criticality.” DevOps and DevSecOps teams can leverage Cobalt and its marketplace using a single account simply by sharing credits. Yet each team can get access to pentesters as needed without waiting for an intermediary. Learn more at Cobalt.io. 3
030-31_SDT040.qxp_Layout 1 9/21/20 1:58 PM Page 30
SOFTWARE TESTING
Featured Companies n Applitools is on a mission to help test automation, DevOps, and software engineering teams release mobile and web apps that are visually perfect. The company provides the only commercial-grade, visual AI-based test cloud that instantly validates any application’s user interface in a fully automated manner, across all customer engagement points and digital platforms – using its groundbreaking image-processing stack, developed from scratch in-house. n Cobalt.io offers a modern application security plat-
form as a service that supports a complete find-to-fix workflow for all your pentesting and vulnerability assessments throughout your organization. Cobalt Pentests are on-demand hacker-powered penetration tests performed by a certified pentester. When a program is launched you will receive vulnerability reports on Cobalt Central, your own application security inbox. Assign reports to your team members via your preferred workflow, such as Jira or Github. Clear up questions quickly by asking pentesters directly on Cobalt Central, and ensure that your security is hardened as efficiently as possible. n Kobiton is a powerful mobile device cloud that allows companies to manage the devices they own and access real public cloud devices for efficient, comprehensive test coverage. Simple to use, easy to access from anywhere, and highly flexible, Kobiton minimizes costs while increasing productivity, so businesses can get apps to market sooner.
n Applause is the worldwide leader in digital quality and crowdtesting. Software is
at the heart of how all brands engage users, and digital experiences must work flawlessly everywhere. With highly-vetted testers available on-demand around the globe, Applause provides brands with a full suite of testing and feedback capabilities.
n AutonomIQ can discover, ingest, and transform English language artifacts into
immediately executable, shareable and manageable Test Scripts. Using deep-learning and AI algorithms, AutonomIQ detects natural language documents and changes, automates and enables self-healing, and provides advanced diagnostics. In real world situations, AutonomIQ has been shown to provide ~90% improvement in speed and quality compared to existing tools and techniques.
n CA, a Broadcom Company: CA offers next-generation, integrated continu-
ous testing solutions that automate the most difficult testing activities – from requirements engineering through test design automation, service virtualization and intelligent orchestration. Built on end-to-end integrations and open source, Broadcom’s comprehensive solutions help organizations eliminate testing bottlenecks impacting their DevOps and continuous delivery practices to test at the speed of agile, and build better apps, faster.
n Eggplant helps organizations put users at the center of software testing to cre-
ate amazing digital experiences that drive user adoption, conversion, and retention. Its Digital Automation Intelligence Suite interacts with software exactly like a real user to test the true user experience, and auto-generates tests at the UI and API level for greater productivity. Eggplant solutions enable customers to test the full user experience, including performance and usability, managing the test environment and orchestrating large-scale test execution, and generating predictive analytics to understand the impact of a change on users across a wide range of operating systems and platforms.
n Froglogic is well-known for its automated testing suite Squish with its flagship product Squish GUI Tester, the market- leading automated testing tool for GUI applications based on a wide variety of languages, operating systems and web browsers. In addition, froglogic offers the professional, crossplatform C, C++, C# and Tcl code analysis tool Coco Code Coverage.
n Mobile Labs remains the leading supplier of in-
n Functionalize is a cloud-based autonomous testing solution uses AI and ML to
house mobile device clouds that connect remote, shared devices to Global 2000 mobile web, gaming, and app engineering teams. Its patented GigaFox is offered onpremises or hosted, and solves mobile device sharing and management challenges during development, debugging, manual testing, and automated testing. A pre-installed and pre-configured Appium server provides “instant on” Appium test automation.
n HPE Software’s automated testing solutions simplify software testing within
n Parasoft’s software testing tool suite automates
time-consuming testing tasks for developers and testers, and helps managers and team leaders pinpoint priorities. With solutions that are easy to use, adopt, and scale, Parasoft’s software testing tools fit right into your existing toolchain and shrink testing time with next-level efficiency, augmented with AI. Parasoft users are able to succeed in today’s most strategic development initiatives, to capture new growth opportunities and meet the growing expectations of consumer demands.
provide intelligent test automation. Its Adaptive Language Processing (ALP) converts test plans written in plain English into fully functional test scripts. It can even use the output of your test management system. With autonomous testing, you now have an intelligent test agent (ITA) supercharging the work of your test and DevOps teams. This ITA is the perfect regression tester – focused, tireless, and driven, but still intelligent. Functionalize turns testing into a competitive advantage when it matters the most – getting to market faster while ensuring higher customer satisfaction.
fast-moving agile teams and for Continuous Integration scenarios. Integrated with DevOps tools and ALM solutions, HPE automated testing solutions keep quality at the center of today’s modern applications and hybrid infrastructures.
n IBM: Quality is essential and the combination of automated testing and service vir-
tualization from IBM Rational Test Workbench allows teams to assess their software throughout their delivery lifecycle. IBM has a market leading solution for the continuous testing of end-toend scenarios covering mobile, cloud, cognitive, mainframe and more.
n mabl is the most reliable codeless UI testing service available. mabl enables con-
tinuous testing with an auto-healing automation framework and maintenance-free test infrastructure. mabl advances traditional UI testing using proprietary machine learning models to automatically identify application issues, including JavaScript
030-31_SDT040.qxp_Layout 1 9/21/20 2:02 PM Page 31
errors, visual regressions, broken links, increased latency, and more.
n Micro Focus is a leading global enterprise software company with a world-class testing portfolio that helps customers accelerate their application delivery and ensure quality and security at every stage of the application lifecycle – from the first backlog item to the user experience in production. Simplifying functional, mobile, performance and application security within fast-moving Agile teams and for DevOps, Micro Focus testing solutions keep quality at the center of today’s modern applications and hybrid infrastructures with an integrated end-toend application lifecycle management solution that is built for any methodology, technology and delivery model. n Microsoft provides a specialized tool set for
testers that delivers an integrated experience starting from agile planning to test and release management, on-premises or in the cloud.
n NowSecure is the mobile app security soft-
ware company trusted by the world’s most demanding organizations. Only the NowSecure Platform delivers fully automated mobile app security and privacy testing with the speed, accuracy, and efficiency necessary for Agile and DevSecOps environments. Through the industry’s most advanced static, dynamic, behavioral and interactive mobile app security testing on real Android and iOS devices, NowSecure identifies the broadest array of security threats, compliance gaps and privacy issues in custom-developed, commercial, and business-critical mobile apps. NowSecure customers can choose automated software on-premises or in the cloud, expert professional penetration testing and managed services, or a combination of all as needed. NowSecure offers the fastest path to deeper mobile app security and privacy testing and certification.
n Orasi is a leading provider of software testing
services, utilizing test management, test automation, enterprise testing, Continuous Delivery, monitoring, and mobile testing technology.
n Perfecto offers a cloud-based continuous
testing platform that takes mobile and web testing to the next level. It features a continuous quality lab with smart self-healing capabilities; test authoring, management, validations and debugging of even advanced and hard-to-test businesses scenarios; text execution simulations; and smart analysis. For mobile testing, users can test against more than 3,000 real devices, and web developers
can boost their test portfolio with crossbrowser testing in the cloud.
n ProdPerfect fully automates the development and maintenance of browser-level testing using live user data. ProdPerfect analyzes your web traffic to create aggregated flows of common user behavior, which is built into an end-to-end testing suite that is maintained and expanded over time, which kicks off automatically from CI.
n Progress: Telerik Test Studio is a test automation solution that helps teams be more efficient in functional, performance and load testing, improving test coverage and reducing the number of bugs that slip into production. n QASymphony’s qTest is a Test Case
Management solution that integrates with popular development tools. QASymphony offers qTest eXplorer for teams doing exploratory testing.
n QMetry is a leader in test management, test
automation, and test analytics products. QMetry Intelligent Digital Quality Platform is designed for Agile & DevOps teams to build, manage & deploy quality software faster & better. QMetry has the complete agile testing solution with test management, automation, & powerful quality analytics for digital enterprises.
n Rogue Wave is the largest independent provider of cross-platform software development tools and embedded components in the world. Rogue Wave Software’s Klocwork boosts software security and creates more reliable software. With Klocwork, analyze static code on-the-fly, simplify peer code reviews, and extend the life of complex software. Thousands of customers, including the biggest brands in the automotive, mobile device, consumer electronics, medical technologies, telecom, military and aerospace sectors, make Klocwork part of their software development process. n Sauce Labs provides the world’s largest
cloud-based platform for the continuous testing of web and mobile applications. Founded by the original creator of Selenium, Sauce Labs helps companies accelerate software development cycles, improve application quality, and deploy with confidence across hundreds of browser / OS platforms, including Windows, Linux, iOS, Android & Mac OS X. Optimized for Continuous integration (CI), Continuous delivery (CD), and DevOps, the Sauce Labs platform is built to handle the most secure data from its customers.
n SmartBear provides a range of frictionless
tools to help testers and developers deliver robust test automation strategies. With powerful test planning, test creation, test data management, test execution, and test environment solutions, SmartBear is paving the way for teams to deliver automated quality at both the UI and API layer. SmartBear automation tools ensure functional, performance, and security correctness within your deployment process, integrating with tools like Jenkins, TeamCity, and more.
n SOASTA’s Digital Performance Management (DPM) Platform enables measurement, testing and improvement of digital performance. It includes five technologies: mPulse real user monitoring (RUM); the CloudTest platform for continuous load testing; TouchTest mobile functional test automation; Digital Operation Center (DOC) for a unified view of contextual intelligence accessible from any device; and Data Science Workbench, simplifying analysis of current and historical web and mobile user performance data. n Synopsys: Through its Software Integrity platform, Synopsys provides a comprehensive suite of testing solutions for rapidly finding and fixing critical security vulnerabilities, quality defects, and compliance issues throughout the SDLC.
n TechExcel: DevTest is a sophisticated quali-
ty-management solution used by development and QA teams of all sizes to manage every aspect of their testing processes.
n TestRigor is an automated regression testing tool that allows VPs of Engineering and Directors of QA improve test coverage to 100%, speed up testing schedules by at least four weeks, and increase team productivity by up to 210% – all for less than their entire outsourced QA department.
n Tricentis is recognized by both Forrester and Gartner as a leader in software test automation, functional testing, and continuous testing. Our integrated software testing solution, Tricentis Tosca, provides a unique Model-based Test Automation and Test Case Design approach to functional test automation – encompassing risk-based testing, test data management and provisioning, service virtualization, API testing and more. 3