Skip to content

Elevate Streamlines Mobile Testing

Elevate

For Elevate, a Texas-based online credit solutions company, the mobile web user experience has become increasingly critical to business success. Traffic to the Elevate website—where borrowers can apply for online credit solutions through two different products, Rise (a state-licensed installment loan) or Elastic (a bank issued line of credit)—has grown year-over-year, with mobile web traffic outpacing desktop web traffic. Currently, 60% of Elevate’s traffic comes from a mobile device – 80% from iOS devices and 18% from Samsung (Android) devices.

By adopting Perfecto, Elevate realized optional and cost benefits, including :

  • 60% of test cases on mobile devices became automated
  • Same-day mobile device certification
  • Labor cost savings by moving from manual testing to automated testing
  • Better team alignment because they transitioned to a mobile-led test strategy across the business
  • Improved customer satisfaction and customer ratings for their Rise and Elastic products

With these changes, Elevate was now ready to launch great digital experiences and achieve faster time to market.

Read the Full Case Study (PDF)

Elevate Saves Time and Money using Test Automation with Perfecto

The Challenges

Elevate’s QA strategy for mobile was a manual process, until 2015. The company utilized an outsourced team of five full-time testers. While this was an adequate short-term solution, outsourcing presented some challenges:

  • Security Compliance – Testers operated outside the company’s firewall, raising security concerns and complicating the ability to test early release candidates. In addition, the Development, QA, and Product teams utilized their own devices, adding to the security team’s workload.
  • Time Constraints - Manually testing on real devices was time intensive and created a roadblock to increasing digital test coverage across mobile devices.
  • Tracking Quality and Collaboration Issues – Testing teams did not have access to the same devices as their counterparts and lacked real-time visibility into team test status. Internal teams relied on emails containing screenshots of test results, with no way to validate and ensure accuracy.
  • Reactive Approach – Mobile OS updates triggered test failures that were reported as defects, causing the company to re-run certification tests late into the release cycle.

The company was also in the process of adopting a DevTest platform supporting both waterfall and agile processes during this timeframe. Elevate chose Microsoft’s DevOps platform due to the flexibility in supporting both approaches while offering the ability to support real-time insights throughout the SDLC.

The Solution

Darrell Kennedy, Director of QA at Elevate, evaluated several mobile testing solutions, from local on-premise solutions to cloud-based solutions.

“We decided on Perfecto for three main reasons: security, integration to Microsoft Visual Studio, and the direct support of Selenium for mobile devices,” says Kennedy. “Only Perfecto provided the security assurances we require as a regulated financial firm. Perfecto was also the only vendor that integrated with both Visual Studio and Selenium.”

Microsoft integration was key in bringing mobile into Elevate’s evolving agile processes. The company made great strides automating desktop web testing using Microsoft Test Manager for test execution and Selenium for test authoring. Perfecto’s support for Selenium Remote WebDriver allowed Kennedy’s team to apply the same desktop scripts to mobile devices.

In addition, real-time reporting improved collaboration not only between development and QA, but across business development, product teams and management. “Reports with video recordings are giving us an invaluable tool to communicate and share findings,” said Kennedy. “The reports allowed teams to visualize the flow before and after the test, giving us a better understanding of user experience.”

"Perfecto has helped us think differently. It has enabled us to align delivery of a great desktop web experience while also ensuring a great mobile browser experience, with little automation code change."

– Darrell Kennedy, Director of QA, Elevate

Perfecto has enabled the company to proactively address mobile market changes by verifying websites on browser/OS changes as they happen, or even before release. Release enhancements are now easily added to the existing regression test suite and new mobile devices can be accessed instantly.

The Results

Perfecto has helped us think differently,” Kennedy says. “It has enabled us to align delivery of a great desktop web experience while also ensuring a great mobile browser experience, with little automation code change. Mobile is now at the forefront.”

In addition to improved customer satisfaction and internal efficiencies, the company has realized operational and cost benefits, including:

  • Test Automation – Sixty percent of test cases on mobile devices became automated and 100% of Rise and Elastic Certification Tests used to verify OS and browser updates were automated within six months. All critical application processing is now fully automated and 80% of functionality testing is automated, with a goal of reaching 100%.
  • Same-day Device Certification – With access to Perfecto’s private cloud, the company can certify applications work on new devices and OSes within two hours of release.
  • Cost Reduction – The company has experienced labor cost savings by moving from manual to automated testing.
  • Organizational Alignment – Elevate has transitioned to a mobile-led strategy across the organization, focusing on certification (device and browser) and mobile user experience (certifying consistent experience across desktop and mobile)
  • Customer satisfaction – Customer ratings for Rise and Elastic have improved concurrently with increasing mobile traffic, resulting in more loans being processed in shorter time periods.

Your Success Is Important To Us

Investing in digital experience? Interested in quality best practices? Here are some helpful resources.

Best Practices for Expanding Quality into the Build Cycle

Read E-book

E-book

Factors Magazine #7 - The Reference Guide for Planning, Building & Releasing Apps

Get It!

Report

Why Apps Succeed - Four Ways You Can Overcome Testing Challenges

Read Paper

White Paper

The Ultimate Test Coverage Guide

Get E-book

E-book

How to Create the Right Web and Mobile Test Strategy

Get the Replay

On-demand Webinar

See who's leading the way! The Forrester Wave: Mobile Front-End Test Automation Tools

Get Your Copy

Report

It's New. It's Free. Digital Test Coverage Optimizer

Check it Out!

Online Tools

Executing Selenium Test Automation Across All Digital Platforms

Get the Replay

On-demand Webinar

The Complete Guide to Building a Responsive Web Testing Strategy

Get Guide

White Paper

The Digital Experience: Why Quality Is Job One - An Interview with Roi Carmel

Hear Full Podcast

Podcast

Find Additional Digital Quality Assets by Visiting the Perfecto Resource Center

Show Me More

White Paper

Why Perfecto?

It's simple. We're the best cloud-based digital quality test lab for enterprises that need secure access to real devices, but that's not all. Below are just some of the benefits of our Continuous Quality Lab.

  • Instant-on, Always-on Lab

    Cloud-based access gives you and your team the ability to perform functional testing anytime, from anywhere, which means increasing velocity and releasing better mobile apps.

  • Become Agile and Get Feedback Faster

    Become Agile

    Increase test automation coverage and benefit from earlier detection of functional and user experience issues. Extend testing across the entire SDLC – reduce release time from 3 weeks to 2 days.

  • Enterprise Grade Device Maintenance

    Get Enterprise Grade Service

    All devices, whether hosted privately or publicly, are managed in highly secure global data centers located worldwide. Our customers also benefit from dedicated on-boarding and support services.

  • Great Partnerships

    Leverage Existing Tools

    We integrate with the IDEs, test automation frameworks, and other tools you already use to develop apps, including Eclipse, UFT / QTP, Visual Studio, Jenkins, Appium and Selenium.

  • Real-user Mobile Testing

    Test Every Digital Experience

    Test web and mobile apps on multiple devices, browsers, networks, locations and OSs in the cloud. No emulators. No waiting. Test real-user conditions based on your user personas using Wind Tunnel.

  • Benefit from Hybrid Cloud Deployment

    Benefit from The Only Hybrid Cloud

    Build your own centrally managed CQ Lab based on your requirements and budget. Private cloud, public cloud, device-in-hand, or private data center – the choice is yours.

  • Rabobank
  • "To us, being agile means responding to the market demand. With Perfecto we’ve been able to quickly respond to what the market and our users demand, and deliver better quality apps and services."

    Hardy Seinhorst, Digital Program Manager, Rabobank

  • Reuters
  • "Perfecto's tools and support are an important parts of our mobile quality arsenal -- helping us to deliver a superior user experience to our customers."

    Ron Kozoman, Head of Mobile Operations, Thomson Reuters

  • PayPal
  • "Perfecto’s CQ Lab helps us expand our mobile test automation coverage. By using their Open API, we wrote a simple plug-in for NEMO - our existing node.js open-source framework - enabling our mobile and web teams to run test automation on real devices, utilizing dev languages they already know."

    Matt Edelman, Software Framework Architect, PayPal

  • Tangerine
  • "Perfecto not only delivered great testing and automation tools that integrate with our environment, but they’ve been a valued partner that truly understands our mobile vision and expectations."

    Charaka Kithulegoda, CIO, Tangerine

  • AccuWeather
  • "Perfecto is an indispensable part of our digital QA effort. We understand that finding and fixing defects quickly in this highly competitive environment is a massive key to our success. The CQ Lab lets us drill down to specific device-OS-browser combinations that we couldn't find elsewhere."

    Martin Schrick, QA Team Lead, AccuWeather

  • "Device management was a huge benefit of the solution. We want to test on the actual devices customers are using. We are simply unwilling to put customers at risk. Adding devices through Perfecto Mobile was more efficient than acquiring them internally."

    Sharon Chamberlain, Test Automation Manager, Paychex

  • Rabobank
  • "To us, being agile means responding to the market demand. With Perfecto we’ve been able to quickly respond to what the market and our users demand, and deliver better quality apps and services."

    Hardy Seinhorst, Digital Program Manager, Rabobank

  • TASSQ
  • "Perfecto's Continuous Quality Lab enables dev/test teams to continuously test the functionality and performance of their mobile apps. Teams are able to execute test scripts simultaneously across iOS, Android and Blackberry platforms in their own private cloud."

    Joe Larrizza, President, TASSQ

  • "R+V decided a cloud-based environment that offered real devices for testing was a must to deliver a high-quality user experience."

    Dierk Jordan, Test Manager, R+V Insurance

  • T-Mobile
  • "Our customers depend on us to deliver the best quality services. Perfecto’s testing solutions bring automation and innovation to T-Mobile labs and are a perfect complement to our testing efforts."

    Grant Castle, VP Engineering Services, T-Mobile

  • Virgin Media
  • "Working with Perfecto has allowed us to expand and improve multiple layers of our app quality strategy. We have been able to extend our test automation platform to real devices rather than emulators, which lets us test usability and performance on the devices our customers are using."

    Robert Randall, Test Technology Innovation Manager, Virgin Media

    Feedback