This is a guest post by Natalia Yakavenka from SplitMetrics
Ask any mobile marketer what is the best way to optimize conversion rates for your app page and you’ll most likely get A/B testing as a response. While A/B testing is still most often associated with the web, the concept of a/b testing for mobile app pages is not new. The very first solutions growth hackers used were custom coded landings, but such approach requires time and effort. However, app page conversion optimization only became popular when self-service platforms like SplitMetrics and Storemaven emerged. These platforms brought a completely new level of A/B testing for mobile pages as they provided insights on top of showing the winning variation. Later on, the introduction of Google Play Experiments in 2015, brought A/B testing of app landing pages into the “must have” category for app marketers. Since that time, plenty of new solutions have emerged but we recommend sticking to the 4 most popular tools presented here.
Google Play Experiments
When it comes to selecting the best A/B testing tool, the most common question is why go elsewhere if you have the free Google Play Experiments. Indeed, it allows mobile publishers to run free experiments on their app pages, but it comes with significant limitations. The most serious ones are that you can’t test unpublished apps and you’ll never find exactly what worked due to the lack of on-page analytics. Still, Google Play is the perfect solution for those who are not familiar with paid traffic and user acquisition as it doesn’t require driving traffic to the experiment from ad resources. The other three tools require sending traffic to their experiments and are usually for more advanced marketers.
Distinctive features: absolutely free + requires no additional traffic
Founded in 2014, SplitMetrics was among the first ones to provide every marketer with an easy-to-use, unlimited, and flexible A/B testing tool. In addition to the regular icon/screenshot testing, it offers pre-launch experiments for unpublished apps and Search, Category and App Store Search Ads testing. Unlike the Google Play service, it offers a multi-armed bandit approach which helps reach significant results fast. But it’s not as ideal as it seems to be — you have to pay for it. Though the price is very reasonable and you have a 30-day trial, you will need to pay a monthly fee for your subscription.
Distinctive feature: pre-launch experiments and App Store Search Ads testing
StoreMaven provides easy-to-use A/B testing for the entire app store landing page experience. One of their advantages is offering benchmarks based and best practices based on their broad client base in each of the app store categories. On top of that, StoreMaven clients benefit from their money saving algorithm, StoreIQ. This algorithm helps conclude tests with fewer samples and lower costs by leveraging historical data to quickly determine the winning creatives. StoreMaven provides a fully dedicated Account Manager to make sure clients make the most of their testing budgets. This tool is also a paid tool that is offered as a monthly subscription.
Distinctive feature: Professional Services
TUNE’s A/B Testing
4) Tune offers many services for app marketers. They are mostly known for their attribution service — measuring paid app installs. However, they also offer A/B testing and optimization tool for the app landing page. Launched in spring 2016, it already provides solid functionality, offering the basic functions of testing different types of assets and showing all measurements and stats collection. While Tune offering is more complete compared to the other testing tools, it’s biggest limitation is that it doesn’t work with other attribution providers. The tool is also limited with regards non-US regions and only supports a small list of regions. In terms of pricing, Tune’s A/B testing tool is not available as a stand alone and so customers have to buy it as part of a suite of services.
Distinctive feature: works very well with other Tune capabilities
A/B testing can be easy with the right tools and is recommended for any app marketer as part of a data-centric growth strategy. Feel free to also try our quiz — test yourself to see how data-driven your game is.