Data engineering professional experienced in building SQL-based data solutions, ETL pipelines, data transformations, and analytics solutions.
My current focus is building scalable data engineering solutions using SQL, Python, AWS, and PySpark, with an emphasis on ETL/ELT pipelines, data processing, data quality, and cloud-based analytics.
- SQL / PL/SQL β Advanced SQL, CTEs, Window Functions, Joins, Data Analysis & ETL
- Python β Data Processing, Pandas, Automation & ETL
- AWS β Amazon S3, AWS Glue, Amazon Redshift, AWS Lambda
- PySpark β Data Transformation & Distributed Data Processing
- Databases β Oracle, Amazon Redshift
- Data Engineering β ETL/ELT, Data Pipelines, Data Transformation & Data Quality
- Git & GitHub β Version Control
- Google Cloud Professional Data Engineer
- Tableau Desktop Specialist
- Alteryx Designer Core
- SAFe 5 Practitioner
SQL-based data engineering project simulating a telecom network environment and demonstrating:
- Relational data modeling across sites, devices, and circuits
- Complex SQL joins and aggregations
- CTEs and subqueries
- Window functions (
ROW_NUMBER,DENSE_RANK) - CASE-based business rules
- Device and circuit utilization analysis
- Decommissioning logic
- Data validation and quality checks
- Analytical SQL queries
SQL-based healthcare claims analysis project demonstrating:
- Complex SQL joins
- CTEs
- Aggregations
- Window functions
- Claims and payment analysis
- Provider-level analysis
- Data quality validation
Python-based data engineering project demonstrating an end-to-end ETL workflow:
- Extracting source data
- Data cleansing using Python and Pandas
- Handling nulls and duplicates
- Data transformation
- Data validation
- Loading processed datasets
- Logging and error handling
Technologies: Python | Pandas | SQL
End-to-end AWS data engineering pipeline designed to process raw datasets and prepare them for analytical workloads.
Pipeline Architecture:
Source Data β Amazon S3 β AWS Glue β Amazon Redshift β SQL Analytics
Project demonstrates:
- Raw data ingestion into Amazon S3
- AWS Glue ETL processing
- Python-based transformations
- Data cleansing and validation
- Loading transformed data into Amazon Redshift
- SQL-based analytical queries
- Cloud-based ETL architecture
Technologies: AWS S3 | AWS Glue | Amazon Redshift | Python | SQL
Data engineering project demonstrating large-scale data transformation using Python and PySpark.
Project covers:
- Reading structured datasets
- Data cleansing
- Handling missing values
- Removing duplicates
- DataFrame transformations
- Joins
- Aggregations
- Window functions
- Data quality checks
- Partitioned data processing
Technologies: Python | PySpark | SQL
LinkedIn: Sai Naren Burgula