About project
Solution
Manual testing, Automated testing, Cloud migration testing
Technologies
Fabric, Firebase, Postman, XCode
Country
United States
Industry
Client
The client is a US-based global leader in print-on-demand services, enabling large corporations and individual users to create customized products effortlessly. With over 10 million users worldwide and more than 26 million annual orders, their platform offers 1,000+ physical products and over 1 million design options. Our client required reliable performance and scalability across web, mobile, and AI-powered personalization features.
Project overview
Need seamless, scalable QA for complex platforms? We’re here to help.
Before
- Limited test coverage across expanding product lines
- Performance issues during high-volume periods
- Inconsistent cross-platform experience
- Manual testing bottlenecks
After
- 80% test automation coverage
- 25% reduction in manual QA effort
- 15% decrease in build failures
- Seamless performance during 47% traffic spikes
Project Duration
3+ years (ongoing)
Team Composition
1 Team Lead
20+ QA Engineers
Challenge
The client faced a complex testing ecosystem with multiple intersecting challenges. Their platform offered over 1,000 physical products with 1M+ design variations, requiring testing across iOS, Android, and web platforms. The system needed to handle millions of annual orders while maintaining performance during peak periods.
Additional complexity came from new AI-powered personalization features, ongoing cloud migration, and multiple software acquisitions. The QA team needed to scale rapidly while ensuring consistent quality across all platforms and features.
Solutions
Comprehensive manual and automated testing
Our QA team was dedicated to covering a vast array of testing needs, scaling from 3 to over 20 QA engineers as the project expanded. Our strategy included:
- Cross-platform and cross-browser verification to maintain consistency across devices
- Regression and ad-hoc testing for reliable functionality after each update
- AI testing for the new personalization features, focusing on accuracy and user satisfaction
Advanced automation setup
We developed a mobile automation framework from scratch, integrated CI/CD pipelines, and expanded automated test cases to enhance coverage without slowing down releases. Key achievements included:
- 180 end-to-end mobile tests with Appium and XCUITest
- Automated report generation for quick insights on test results
- Video recording for failed tests to improve debugging
Real device testing for comprehensive coverage
To ensure consistent quality, we used 40+ physical devices, from iOS to Android and desktops, capturing any device-specific issues that virtual emulators might miss.
AI and cloud migration support
Our team managed continuous testing while supporting the client’s shift to cloud infrastructure and integrating new AI features, maintaining stability throughout.
Technologies
Our tech stack focused on robust testing frameworks and tools for comprehensive coverage:
- Fabric
- Firebase
- Postman
- XCode
- Jenkins
- TestRail
- Appium
- Selenium
Types of testing
Regression testing
Confirmed that updates didn’t disrupt existing features.
Exploratory testing
Discovered edge cases and unique scenarios.
Accessibility testing
Ensured usability for users with disabilities.
Cross-platform testing
Verified app performance across iOS, Android, and web.
AI validation testing
Tested AI-driven personalization for accuracy.
Results
Our testing efforts delivered significant improvements across all metrics:
400
end-to-end iOS test coverage achieved
15%
reduction in build failures
20%
decrease in testing costs
25%
reduction in manual QA effort
47%
traffic spike handled without issues
60%
faster test creation through AI-driven scenarios
Successful cloud migration with minimal disruption
25%
increase in customer satisfaction scores
Struggling with complex, multi-layered e-commerce testing?
Let’s optimize your QA strategy.
Bruce Mason
Delivery Director
