On
Off
Reduced test execution time by 50% and manual efforts by 60% by leveraging automated test data creation, data automation, TDM (Test Data Management) solution, and DIA (Data Intelligence Automation) framework
About the Client
The client is one of the world’s largest e-vapor technology company located in the UK.
Key Challenges
- The client was facing challenges in their data process with heterogeneous complex data sets
- The client wanted to migrate their source data from legacy sources to the Azure cloud platform
Solution
- Mindtree successfully built the end-to-end automation for client’s data migration to the Azure cloud platform
- The main objective of the migration was to overcome the challenge of manual data validation between the source and the target post transformations and automate the end-to-end validation
- Validated the data between Azure Databricks tables and MS SQL server tables
- Performed customization where data is displayed (saved to local folder) over the screen, which is to be compared and validated
- The volume of batch data tested is ≈10K records, with each table including data quality validations and transformation rules
Benefits
- Achieved high productivity improvement in data quality checks with test time reduction by more than 50%
- The early automation drastically helped to identify several defects at early stages
- Achieved significant reduction in manual efforts by 60% with automated test data creation solution
- Directly connecting to Databricks and SQL Server avoided the intermediate landing of data out of premises
- Easy navigation provided to connect defects and mismatches for defect debugging
- Detailed validation report generated by RDC helped to visualize the findings effectively with visual tabular graphs