Modernize Your ETL Processes Into the Cloud

5

Extensive data models

10x

Quicker data analysis

200

Data Quality Tests

Background

Company specialized in providing private mortgage insurance solutions, helping lenders protect against risk while enabling borrowers to achieve homeownership. With a focus on innovation and customer-centric services, they support the housing market by offering financial products that ensure more accessible and sustainable home financing.

Challenge

The company struggled with fragmented data access, complex and inefficient on-premise data storage, poorly maintained documentation, and inconsistent data quality checks, making it difficult for analysts to generate reliable insights in an outdated SAS platform. The lack of standardization and data duplication across sources adds to the confusion and inefficiencies in data management. This often led to challenges for Data Scientists in aggregating data to run various Machine Learning models. Additionally, unclear ownership and responsibilities hinder effective data governance, leading to high costs and complexity in maintaining data integrity.

Approach

The client enlisted Keyrus to provide a proof of value engagement for Talend and Snowflake. The successful POV led to Keyrus working with the client on their ~10-year data migration roadmap. Keyrus applied its expertise in Data Modernization and ETL solutions to build and model a centralized modernized Data Warehouse hosted on the cloud. We implemented a dynamic ELT framework utilizing Talend, Snowflake, and AWS technologies to satisfy the client’s requirements. Leveraged Talend to ingest all the client's internal data sources (Oracle, VSAM, Salesforce, CSV files, etc..) and external data sources (Third-party data, Moody's, Optimal Blue).

Key results

Successfully migrated the existing SAS and Informatica pipelines to the new Talend/Snowflake/AWS framework; created highly scalable ELT framework that allowed for easy ingestion of new data, complex transformations and business logic, customizable Data Quality rules, and enhanced monitoring and logging

Centralized the data in a cloud Data Warehouse that allows data to be transformed, standardized, and securely shared with different teams (Business, Data Science, etc.)

Integrated a metadata management tool (Talend Data Catalog) to provide a centralized platform for data discovery, data governance, and metadata management. Generated a glossary of terms and enhanced Data Lineage

Benefits

The work done by Keyrus resulted in several key benefits: consolidated data sources and improved documentation made data easier to access and understand. Automated data quality checks and standardized naming conventions enhanced reliability. These improvements led to faster, more accurate insights and a more secure, organized data environment. Migrated 5 extensive data models to a Cloud Data Warehouse which cut analysis for Data Scientists from 3 days pre-migration to less than 3 hours post-migration Optimized data access and data profiling for ~20 business analysts across 4 business units Enhanced Data Governance capabilities through accessible data catalog tool and generated ~200 impactful Data Quality tests "

Technology partners

AWS

Amazon Web Services (AWS) is a global leader in cloud-computing services that offers over 200 fully featured services from data centers worldwide. AWS provides services to organizations of all sizes to help lower costs, become more agile, and innovate faster.

Advanced Tier Partner

with a Data & Analytics Competency

30+

General Certifications

Speciality and Professional Certifications