Accelerating Growth Through Software Test Automation for EdTech SaaS

Passion.io is a SaaS platform empowering creators, coaches, and trainers to effortlessly build personalized mobile apps. Based in Texas, USA, the company has quickly scaled, empowering thousands of users to monetize their expertise. Rapid growth, however, came with challenges—specifically, maintaining app quality without exhausting their QA team.

• 2 Software Development Engineers in Test (SDET)
• 1 Project Manager

We began by thoroughly analyzing Passion.io’s manual regression testing process, identifying frequent issues and inefficiencies. Collaborating closely with their Test Lead, we created a prioritized list of critical regression testing automations. Our team then developed a robust, scalable test automation framework—integrating essential libraries, clearly defining the app’s structure, and setting up advanced reporting and Slack integration for immediate visibility.
We crafted cross-platform tests prioritizing a seamless experience on both Android and iOS. By integrating automation into the CI/CD pipeline, tests were executed automatically with each new app build, providing instant and clear reports to all stakeholders.

• Test Cases Automation: Created detailed BDD scenarios enabling the client’s Test Lead to independently extend regression test suites in the future.
• Advanced Reporting: Integrated test reporting directly with Slack, providing metrics such as total tests run, number of failed tests, and pass rate.
• Rapid Smoke Testing: Implemented a quick, 5-minute smoke test suite to verify build stability immediately after deployment, ensuring readiness for deeper testing.
• Priority Test Automation: Automated essential regression tests covering high and medium-priority scenarios (over 160 tests total across both platforms), significantly increasing trust in automated results and eliminating the need for manual verification.
• Parallel Execution: Enabled simultaneous execution of tests, supporting up to 5 concurrent test runs.
• Jira Integration: Set up API-based integration where any test failure automatically creates and assigns a Jira ticket to the responsible team member.

We worked hand-in-hand with Passion.io’s Delivery Manager and QA team, ensuring full alignment through structured and transparent communication. Weekly syncs, daily Slack updates, ad-hoc calls, and task tracking in Jira kept everyone on the same page. Following Scrum methodology, we held bi-weekly sprint planning sessions, carefully estimated testing efforts, and set clear, achievable goals—ensuring consistent momentum and smooth project execution from start to finish.

• 160+ high- and medium-priority regression tests automated (80+ per platform: Android and iOS).
• Test execution time dramatically decreased by enabling up to 5 parallel test executions.
• Smoke tests reduced preliminary build verification to less than 5 minutes per run.
• Achieved consistently high test pass rates, typically exceeding 95%, greatly reducing manual retesting effort.
• Automated test integration with Jira reduced issue-reporting time from hours to mere seconds, significantly increasing issue resolution velocity.

• Enabled Passion.io’s QA team to shift from repetitive manual regression to strategic, high-value QA tasks, accelerating innovation and feature releases.
• Improved product stability and customer satisfaction due to faster and more reliable QA processes.
• Conducted comprehensive knowledge-sharing sessions with Passion.io’s internal test team, thoroughly explaining the automation infrastructure, our test-writing methodologies, and detailed analysis techniques.
• Provided a comprehensive guide and customized tools empowering the internal QA team to independently maintain, expand, and enhance automated test suites, fostering long-term operational independence and confidence.