Skip to content

About the Test Coverage Optimizer

Maximize Your Digital Test Coverage

"Are We Testing On the Right Platforms?"

This is the question that app developers, testers and product managers ask themselves and their team members every day. Well, help has arrived.

The Digital Test Coverage Optimizer™ is designed to help organizations optimize their market and digital test coverage on an ongoing basis. It helps you prioritize which smartphones, tablets, and operating systems, you should develop and test your mobile apps and websites on - across your specific target geographies. The Optimizer will help you keep up with the ever-changing digital landscape, minimize untested "blind-spots" and achieve your marketing coverage goals.

The Optimizer collects data from multiple sources and is regularly updated to make sure you stay ahead of the curve and continuously deliver perfect user experiences across every digital platform your customers are using.

How Do You Use the Optimizer?

It’s super simple!

  1. Define the parameters that best define your app. The questions aren't mandatory, however, for more accurate results, we do recommend that you fill in all the fields.
  2. Click GET FULL RESULTS to see your recommended devices. Device/OS combinations are sorted by priority. Check out our Infographic to learn more about Coverage Tiers and the Perfecto Coverage Score.
  3. Spread the word! Share your results via email or social networks with colleagues and friends. Download a PDF to share with your team.

Watch Demo!

Test Optimizer - How it works!

Check it out...
if you haven't already.

What the results tell you.

Our list of 32 total devices is based on our Perfecto Coverage Score and is divided into three tiers. The more tiers you cover, the less risk of poor test coverage.

Reading the results from the Digital Test Coverage Optimizer

Coverage Tiers

  • Essential: The top 10 most used device/OS combinations that you absolutely must test on.
  • Enhanced: Includes 15 device/OS combinations that are still widely used.
  • Extensive: A mix of seven nice-to-have older devices and brand new releases.

If your testing covers all three tiers, you’ll have the most complete recommended test coverage and the least risk.

Are you testing on the right digital platforms? App Annie and Perfecto have teamed up to help!

Download our quarterly Digital Test Coverage Index and create a comprehensive test strategy that focuses on the most relevant digital platforms..

I Want The Latest Edition

Perfecto Coverage Score

Perfecto’s proprietary scoring index rates how a specific device/OS combination will improve your test coverage and reduce risk. The Perfecto Coverage Score™ is based on the following attributes:

  1. Device and OS popularity (Market Share)
  2. Screen Sizes and Resolution
  3. Device Age (Launch Date)
  4. New and Trending Devices and Platforms
  5. Operating System Version Update Rate (e.g. Reference Devices Like Android Nexus Get a Higher Score)
  6. Unique Device Properties Important for Testing Purposes – Chipset, CPU, Memory
  7. Operating System Version Diversity (Latest, Popular, Legacy)
  8. Audience Demographics

Frequently Asked Questions

  • What data is the Optimizer based on?

    No single data source tells the full story so we’ve combined a few:

    1. Exclusive customer usage data from our Perfecto CQ Lab.
    2. Best-in-class market usage and sales data from our partners at IHS.
    3. Industry and market data retrieved from analyst forecasts in the respective geographies.
  • How are the devices prioritized? By Market Share?

    No. The results you'll get from the Optimizer are not sorted by market share. We use our own proprietary score that we call the Perfecto Coverage Score™.

  • What is the Perfecto Coverage Score?

    Perfecto’s proprietary scoring index rates how a specific device/OS combination will improve your test coverage and reduce risk. The Perfecto Coverage Score™ is based on the following attributes:

    1. Device and OS popularity (Market Share)
    2. Screen Sizes and Resolution
    3. Device Age (Launch Date)
    4. New and Trending Devices and Platforms
    5. Operating System Version Update Rate (e.g. Reference Devices Like Android Nexus Get a Higher Score)
    6. Unique Device Properties Important for Testing Purposes – Chipset, CPU, Memory
    7. Operating System Version Diversity (Latest, Popular, Legacy)
    8. Audience Demographics
  • Should I consider using my own web/app analytics data?

    If you have access to web/app traffic and user behavior analytics (e.g. Google Analytics or Adobe Analytics), we highly recommend that you merge this data with the Digital Test Coverage Optimizer™ results. Your own data best represents your current users’ devices/platforms, but the Optimizer adds more considerations such as new and trending devices (that still won’t show in your data) and reference devices (such as Google Nexus) which are important to include in your test mix regardless of their popularity. The combination of your analytics and our data will get you the optimal text coverage mix for your business. If you’re interested in exploring this further, we have workshops designed just for that. Contact us to learn more.

  • How is this different from Perfecto’s quarterly Digital Test Coverage Index?

    The Optimizer is based on the same methodology we use to build the Digital Test Coverage Index. However, unlike the Index, which is published quarterly, the Optimizer is updated continuously and allows you to define your own characteristics and get customized results.

  • What do the 30%, 50%, 80% tiers stand for?

    We segmented the recommended device/OS list into three tiers -- 30%, 50% and 80% -- all representing their accumulated Perfecto Coverage Score. 30% can usually be covered with 10 devices, 50% with 25 devices, and 80% with 32 devices, running the recommended OS.

Feedback