From 0 to 100% Test Automation in Six Months : A Case Study

Sony
by Sony 

A few months back, Gurzu QA team accepted a challenge of automating tests for one of our clients’ products: Wicket. We knew this project was crucial for boosting the reliability of the product and making our testing process smoother. This case study outlines how we not only met our goals, but absolutely crushed them! 

Wicket is an AI software company specializing in computer vision solutions that aims to transform access control and ticketing processes in various facilities, including stadiums, event venues, and high-traffic locations. Wicket enables guests to easily access facilities simply by presenting their faces.

Wicket is committed to delivering a quality product, and the primary goal was to ensure its product consistently met the highest standards.

Project Details

Applied Technologies and Tools

  • Cypress
  • Javascript
  • Node.js
  • Mocha as Test Runner
  • BitBucket as Code Repository Management
  • Git as Version Control System

Team Size

  • 2 QA Engineers

Duration

  • 6 Months

Why did the client approach us?

As the project evolved and new features were added, manual regression testing became time-consuming, error-prone, and resource intensive. 

Wicket approached Gurzu to implement automation testing. They realized the need for a more efficient and reliable approach to identify and resolve issues during regression testing, particularly in finding bugs in existing features. By embracing automation, Wicket aimed to streamline its testing process, improve bug detection, optimize resource allocation, and enhance the overall quality of its software.

*It’s more about what does the technology open you up towards in the future. Facial Recognization for purchasing of food and beverage and merchandise. FR for wayfinding, FR for haptics and update on your phone, There’s lots it opens things up for that goes beyond just ticketing.” -Mark Brubaker, CTO, New York Mets*

Business Challenges

Wicket recognized the need for automation testing as they faced issues during the regression testing, primarily concerning their existing features.

Our challenge was to implement end-to-end automation testing in access to improve the overall quality and efficiency of the testing process, and we had to complete it within a strict time frame of 6 months.

Some of the goals we were looking to achieve include:

  • Increase Testing Efficiency
  • Enhance Test Accuracy and Reliability
  • Achieve Comprehensive Test Coverage
  • Ensure the regression testing effectiveness
  • Facilitate Continuous Integration and Delivery

How we solved it

We assigned two experienced QA engineers for the task in our Nepal office. They consistently kept in touch with the wicket team to understand requirements, implement it and get feedback. 

We covered an extensive range of test scenarios, encompassing 500 plus test cases within six months. By covering those test cases, we provided thorough test coverage, identified defects, and ensured high-quality products for Wicket’s end users.

Our automation workflow looked quite like this:

  • Understand the Project: We gained a comprehensive understanding of the product, its functionalities, and the overall project objectives. Then we prepare a test scenario for each feature, and prepared test case document based on those test scenarios.
  • Define Automation Strategy: We determined the scope and the goals of automation testing, including the areas to be automated and the level of the test coverage. The selection of test cases which are suitable for automation is based on the factors such as complexity, repeatability, and importance. Then we prioritized the test cases which are time-consuming and frequent execution during the regression testing.
  • Design Test Architecture: We selected the automation tool Cypress based on the application’s technology and platform requirements. Then we managed the test data including approaches for creating, maintaining, and utilizing test data sets. We set up a test environment and configurations required for automation testing which includes selecting the appropriate browsers, devices, operating systems, and screen resolutions.
  • Develop Automation TestScripts: We started to write automation test scripts based on the identified test cases and used different libraries to maximize the code reusability and maintainability. We conducted code reviews, followed best practices to ensure quality and consistency. Then we analyzed our test results and debug any issues or failures encountered during test execution. We refined our test scripts as needed to improve their accuracy and reliability.
  • Integrate with CI/CD Pipeline: To integrate our automation testing into Wicket’s CI/CD pipeline, we prepared the docker image of our test and provided it to the Infrastructure team to set it up in their CI/CD.
  • Reporting and Metrics: We generated test reports that include test coverage, pass/fail status, test execution time, and defect trends.
  • Maintenance and Updates: We continuously updated the automation test suites as the product evolves and refine the test scripts to ensure they remain accurate and aligned with the product’s functionality.
  • Training and Knowledge Transfer: We provided knowledge transfer to the Wicket team on utilizing and maintaining the automation testing framework.

Results

Wicket platform has experienced these results as a result of test automation:

  • 100% Automation Test Coverage: Achieved complete coverage of all critical functionalities, ensuring no area was left untested.
  • Significant Bug Reduction: The number of bugs was reduced by 90%, drastically improving the product’s reliability.
  • Seamless CI Integration: Ensured that all new codebase pushes and deployments automatically triggered the automation tests, providing immediate feedback to the development team.
  • Client Satisfaction: The client expressed high satisfaction with the quality of the automation tests and the ultimate quality of the product. We believe it has made the user experience much better.

Final Words

Gurzu is a software development company passionate about building software that solves real-life problems. Explore some of our awesome projects in our success stories.

Need help with automating your software tests? Gurzu engineers can help you! Drop us a message.

Have a tech idea that you need help turning into reality? Book a free consulting session with us!

You Might Also Like