Building data transfer pipelines from MongoDB
For a Collections Fintech Company.
CLIENT & PROBLEM STATEMENT
- Collections Fintech company requires reports on collections data for improved insights.
- Need for efficient data processing and visualisation from MongoDB to BI tool.
APPROACH
- Utilised MongoDB hosted on AWS as the primary database for collections data.
- Implemented G-Square’s proprietary ETL process using Python for data extraction and transformation.
- Transformed data stored in MonetDB for optimised querying and analysis.
- Integrated processed data with Narrator BI tool, hosted on AWS Cloud for scalability.
- The reports handled included data for 100,000 borrowers,supporting 50 users and producing 25 detailed and actionable reports.
SOLUTION & OUTPUT
- ETL process transformed MongoDB data to MonetDB.
- This process led to significant enhancement of the query performance.
- Generated insightful collections reports via Narrator tool on AWS Cloud.