Go back to all articles

Manual App Testing for Tech Startup

Jun 24, 2019
4 min read

Our client is a portable workout device and mobile app that coaches its users through low impact, isometric workouts in as little as five minutes per day. It measures and tracks the performance of its clients and offers various fun games you can play while exercising.

Why Was Testing Needed?

Our client approached us at the point when their popularity grew, the app was undergoing constant changes, new functions and additional features were added, new workout games developed. In order to widen its audience and make sure every user stuck to the app, developers had to pay special attention to the quality and usability of its product.

The application needed to be:

  • user-friendly;
  • intuitive;
  • work flawlessly anytime and anywhere on the Globe.

The client asked us to perform manual functional testing as well as test automation on iOS apps.

Have a Project in Mind?​
We have been working on performance testing projects since 2008.
Drop us a line to find out what our team can do for you.
Get a quote You’ll hear back from our tech account manager in one day if not sooner

How Did We Start?

We started our project with manual testing, as the quickest way to ensure the quality of the product in the beginning.

Goals:

  • 01
    As an application’s functionality grew, developers needed to broaden the regular functionality testing in a limited amount of time.
  • 02
    Cut down the cost of testing by improving the efficiency of the QA work.

Through the course of our work, we used Charles Proxy for API testing, Xcode and Android Studio for recording all logs. We were distributing test builds via Testflight, Crashlytics, and Google Alpha.

Work Process

  • 20
    performed testing on 20 different devices;
  • 300
    performed 300 manual tests for both Android and iOS apps per day for each regression;
  • 150
    performed 150 tests per day for smoke testing.
Mobile Application testing work process

Testing Automation for iOS and Reasons for Choosing Appium

In addition to functional testing we realized Test Automation for iOS apps. When choosing our approach to automation, we were considering two main options: Appium and XCUTest. We have decided to use Appium, which is a test framework based on Selenium and JsonWireProtocol.[DM1] When choosing from a multitude of tools and frameworks we have opted to go with Appium as it helped us significantly reduce the cost of test automation for our client.

Advice
The main advantage of Appium was the lack of need to rewrite the tests for Android in the future; all that would have to be done is adding new locators and new settings for Appium server.

Testing the Interaction Between the App and the Device

One of the key features of this project was the fact that this is not a simple app, it is an application for a portable fitness device connected via Bluetooth; therefore, we had to test the interaction between the app and the device itself. In addition to typical Functional Testing and Test Automation app testing of the main functionality, we had to include mobile phones Bluetooth compatibility and stress tests into this project and use specific programs like BLE.

Important
To get the information about app stability in the quickest way, you can integrate your app with Crashlytics services; this way you can always have access to analytics and react to any problems immediately.
Mobile Application testing interaction 1

Mobile Application interaction testing 1

Key Challenges of This Project

One of the challenges of this project had to do with the initial submission to the App Store. One of the cases on those guidelines was that the App should work in Ipv6 only networks. In order to properly test for compliance with all App Store Review Guidelines, we had to test the behavior of the app in the IPv6 network.

  • Problem: Since the share of IPv6 network traffic is only about 1 percent, we had to jump quite a few hoops in order to quickly obtain decent IPv6 coverage in our office.
  • Solution: Running a very tight deadline, we ended up renting the VPN server in the United States in order to tunnel iPV6 network into our office. This enabled us to timely complete all testing required before the Store release.

Another issue we came across was working on a multinational team across different time zones. Android, iOS and Game applications were developed by three separate teams located on three different continents. At the onset of the project, it was rather a challenge trying to link them up. However, using Agile methodology, we managed to successfully integrate our QA team into developers’ regular sprints.

Result
You managed to use the difference in the time zones to our advantage. Our team has shifted its schedule so that the majority of testing began right when the developers’ workday was over. This way when the client returned to work the next morning, all tests were executed and all bugs were submitted in the bug tracking tool. This helped cut the release time significantly.

Feedback

Our client approached us at the point when their popularity grew, the app was undergoing constant changes, new functions and additional features were added, new workout games developed. In order to widen its audience and make sure every user stuck to the app, developers had to pay special attention to the quality and usability of its product.

Key Project Results

  • Helped our client reduce the QA costs by almost 30 percent.
  • Significantly improved the time-to-market metric thanks to the 24-hr work shifts.
  • Improved the app itself – the app was gaining more popularity and was receiving more positive reviews among its users in the AppStore and GooglePlay.

This is partially due to the fact that in addition to normal functional and regression testing and regular test model optimization, our team constantly analyzed user reports, thus ensuring good experience by all end users.

Key Success Factors

  • Constant clear written test processes;
  • Having a project manager close to the team in order to make sure the response time is never more than one hour;
  • Having testers available for urgent testing, especially during the release deadlines;
  • Using a single tool for test management and bug tracking;
  • Working under Agile methodology.
Table of contents
Let us know about your needs
We can provide multiple performance testing services and a lot more than that if the situation needs a far more complex approach.
Get a quote You’ll hear back from our tech account manager in one day if not sooner

Related insights in case studies

Explore what we’ve learned from these experiences
7 min read

From Hundreds to Thousands: Scaling MEFA Pathway Software for Mass Student Registration

how load testing helped e learning services provider preview
Jul 12, 2024

FolderWave, Inc. is a leading digital services provider in the Massachusetts e-learning sector. It aids millions of students in researching and planning a job-oriented education. The company delivers IT solutions, platforms, and services in partnership with notable non-profit organizations like MEFA Pathway and College Board, which connect a vast network of colleges, schools, and universities […]

8 min read

How Load Testing Helped Texans Survive Power Outages During a Storm

how pflb helped texans survive power outages during a storm preview
Jun 13, 2024

Background The largest electric distribution cooperative in Texas and the United States, Pedernales Electric Cooperative (PEC), had to test its new software systems, the Storm Center and the OR&S (Outage Reporting & Status), before the release to ensure their adequate performance under peak load. Challenge PEC had a strict release deadline and needed to test […]

4 min read

Tynor Prepared the New Website for High Sales in Four Days

tynor prepared the new website for high sales in four days preview
Dec 12, 2022

Tynor Orthotics is India’s largest manufacturer and exporter of orthopedic and fracture aids established in the 90s to deliver quality healthcare products. Committed to a significant expansion in the next three years, Tynor crafted a new e-commerce website focused on excellent customer experience to support this growth. To be confident at launch, the engineering team of Tynor decided to run pre-go-live stress testing for the website. The tight deadline felt challenging, the customer was relieved to hear we provide a quick load testing solution. Quick Load Testing solution includes a four-day load testing project performed by engineers of PFLB and a 1-month subscription to the innovative load testing PFLB platform.

5 min read

Bank Increases Load Capacity by 450% to Deal with Business Growth

bank increases load capacity by 450 to deal with business growth preview
Oct 3, 2022

Our client's bank was absorbing other banks, and the number of individual clients was growing. The system was not ready for expansion or integration. The owners started to suspect bottlenecks when problems with paying salaries to corporate clients’ employees arose. As a result, in the next pay period, the load on the system increased dramatically, and the system got overloaded. People did not get their salaries in time, as the system crashed.

  • Be the first one to know

    We’ll send you a monthly e-mail with all the useful insights that we will have found and analyzed

  • People love to read

    Explore the most popular articles we’ve written so far