Home » Case Study »
Objective: Performance And Cost Optimization with Cloud Modernization
A US-based global solution and software provider, recognized as a pioneer in insurance automation. The client wanted to modernize its existing on-premise data warehouse to leverage the scalability and performance of the cloud and facilitate its growth and improved service offerings.
Challenges: Performance, Infrastructure scalability and maintenance
The client started facing challenges with its data warehouse complexity and performance with the increase of data and business, This, in turn, increased the infrastructure cost, operations effort and maintenance. The client wanted to make use of modern cloud services to mitigate these challenges and focus on innovation and reporting services.
Solution:
Datametica assisted the client with the full migration of the current MSSQL to GCP BigQuery.
- Discovery, analysis and assessment of the current environment.
- Understanding the current data model, ETL logic, associated workloads, pipelines and deliverables.
- Designing Technical architecture and GCP future state solution.
- One-time Historical Migration from SQL server to BigQuery using Ingestion Framework developed by Datametica Team.
- The ingestion framework is also used to Load the data from File systems.
- Conversion of MS-SQL code and DDLs to BigQuery using Datametica’s Automated code (SQL, Script) and ETL conversion Service – Raven.
- Conversion of stored procedures to GCP native BigQuery stored procedures.
- Setup Orchestration and Scheduling of converted workloads using Cloud Composer.
- Performed Data Validation using Datametica’s Automated data validation tool – Pelican tool between MS-SQL and BigQuery.
- Leveraging the Data studio service of GCP for creating reports and dashboards.
Client benefits:
- Faster and simplified migration to GCP using Datametica’s Migration automation tools.
- Migrating to GCP gave the client a much-improved system performance of the data processing and reporting layer with reduced operational complexity and cost.
- Managing resources and security on GCP with access control using IAM.
- Leveraging services of the cloud for regular data load and process monitoring.
- Ease of Infrastructure scalability, on-demand.
GCP Products Used
Datametica Products Used
