Building scalable cloud-native data platforms for Analytics, Reporting, and Business Intelligence.
- 💼 Data Engineer with ~4 years of experience designing and building scalable cloud-based data engineering solutions across AWS and Azure.
- 🚀 Currently at Biz2Credit, on the Data Engineering & Reporting team, building AWS-based ETL/ELT pipelines for fintech analytics.
- 🏦 Previously built real-time and batch pipelines for HDFC Digital Banking (Net/Mobile Banking) at NexGen Tech Solutions — Azure Databricks, Delta Lake, Kafka, Google Cloud Pub/Sub.
- 📊 Earlier delivered enterprise analytics for Microsoft Bing Analytics at HCLTech, progressing from Graduate Engineering Trainee → Software Engineer → Data Engineer.
- ☁️ Strong expertise in ETL/ELT pipeline design, Data Modeling, Data Warehousing, Streaming Ingestion, Performance Optimization, Data Quality, CI/CD, and Power BI Reporting.
- 🌱 Currently preparing for Databricks Certified Data Engineer Associate.
- 🎓 B.E. in Information Technology, Panjab University, Chandigarh.
- 📍 Based in Noida, Uttar Pradesh, India.
| Company | Role | Duration |
|---|---|---|
| Biz2Credit | Data Engineer | Feb 2026 – Present |
| NexGen Tech Solutions | Data Engineer | Feb 2025 – Feb 2026 |
| HCLTech | Data Engineer | Jan 2024 – Jan 2025 |
| HCLTech | Software Engineer | Mar 2023 – Dec 2023 |
| HCLTech | Graduate Engineering Trainee | Oct 2022 – Mar 2023 |
- Built real-time ingestion pipelines using Kafka & Google Cloud Pub/Sub for high-volume banking transactions.
- Enhanced a 3-layer Delta Lakehouse (Staging–Curated–Service) in Azure Databricks for scalability and analytics readiness.
- Implemented PySpark transformations for Net Banking & Mobile Banking analytics.
- Applied data governance, security, and compliance standards for financial data pipelines.
- Developed Azure-based ETL pipelines and analytical datasets for enterprise reporting.
- Built scalable data transformation workflows using Azure Data Factory and Databricks.
- Delivered business-ready datasets for Power BI dashboards.
- Designed a multi-view Power BI dashboard across 6 departments (sales, finance, supply chain, executive, marketing, products).
- Loaded 1M+ records from MySQL and Excel with full data modeling.
- Optimized with DAX Studio — 30% storage savings, 10% performance improvement.
Cloud-native Data Engineering project built using:
- Azure Data Factory
- Azure Data Lake Gen2
- Azure Databricks
- Azure Synapse Analytics
- Apache Spark
- Power BI
- ✅ AWS Certified Cloud Practitioner
- ✅ Google Data Analytics Professional Certificate
- ✅ Data Engineering (Azure) – Skillsoft
- ✅ Power BI Data Analytics – Codebasics
- ✅ SQL Bootcamp – Udemy
- ✅ Python Bootcamp – Udemy
- 🚀 Databricks Certified Data Engineer Associate (In Progress)
📧 Email rahulpatelue188076@gmail.com
💼 LinkedIn https://www.linkedin.com/in/rahul-patel-data-engineer/
🌐 Portfolio https://codebasics.io/portfolio/RAHUL-PATEL
⭐ Thanks for visiting my GitHub profile! Feel free to explore my repositories and connect with me.