About
Highly accomplished Microsoft-certified Azure and Databricks Data Engineer with 3+ years of experience in designing, optimizing, and orchestrating end-to-end data pipelines. Proven ability to enhance data quality, reduce deployment times by 40%, and improve query performance by 30% through expertise in Azure Data Factory, Microsoft Fabric, Python, and SQL, driving data-driven decision-making and operational efficiency.
Work
Indore, Madhya Pradesh, India
→
Summary
Led the design and execution of robust ETL pipelines and comprehensive data warehousing solutions, significantly enhancing data quality and system efficiency for critical business decision-making.
Highlights
Designed and executed robust ETL pipelines in Azure Data Factory, integrating diverse data sources to create reliable ground truth for strategic decision-making.
Implemented and maintained over 100 SQL Objects, significantly optimizing data storage, retrieval, and supporting complex analytical queries.
Streamlined data quality checks and validation processes, reducing data errors by 15% and enhancing overall system efficiency.
Increased code quality and reliability by implementing automated CI/CD pipelines in Azure DevOps, leading to a 40% reduction in deployment time.
Engineered a comprehensive data warehousing solution in Microsoft Fabric for a shipping client, transferring data from API to Lakehouse, achieving seamless data flow and improving query performance by 30% using complex stored procedures.
Hyderabad, Telangana, India
→
Summary
Orchestrated end-to-end data warehousing solutions for a retail client, focusing on efficient data ingestion, transformation, and accurate hierarchical data modeling.
Highlights
Orchestrated data ingestion for a retail client's data warehousing solution, integrating Logic Apps with APIs to retrieve and store paginated datasets in ADLS Gen 2.
Leveraged seamless Azure Data Factory pipelines to channel data into SQL Database with precise mapping, ensuring data integrity for downstream analytics.
Configured complex Dataflows for efficient transformations of paginated data into Azure SQL Server, enhancing data processing capabilities.
Developed and implemented robust upsert logic and incremental loading using advanced stored procedures and recursive CTEs, ensuring accurate hierarchical data relationships for enhanced views.
Education
Skills
Azure Data Factory
ETL, Data Pipelines, Cloud Data Integration, Azure.
Databricks
Spark, Data Engineering, Lakehouse, Cloud Analytics.
Azure Synapse Analytics
Data Warehousing, Big Data Analytics, Azure.
Microsoft Fabric
Data Warehousing, Data Analytics, Microsoft Ecosystem.
Lakehouse
Data Architecture, Data Storage, Data Management.
Azure DevOps
CI/CD, Version Control, Deployment Automation, Azure.
Microsoft SQL Server
SQL, Database Management, T-SQL, Performance Tuning.
SSMS
SQL Server Management Studio, Database Tools.
Logic Apps
Integration, Workflow Automation, Azure.
Key-Vault
Security, Credential Management, Azure.
Azure Function
Serverless Computing, Python, Azure.
Python
Scripting, Data Processing, Automation.
Power BI
Data Visualization, Business Intelligence, Reporting.
SSIS
SQL Server Integration Services, ETL, Data Migration.
Postman
API Testing, API Development, Web Services.
Data Modelling
Database Design, Schema Design, Data Architecture.
ETL
Extract Transform Load, Data Integration, Data Pipelines.
Data Warehousing
Data Architecture, Data Storage, Data Management, Cloud Data Warehousing.
Data Quality
Data Validation, Data Governance, Data Accuracy.
CI/CD
Continuous Integration, Continuous Deployment, DevOps.
API Integration
REST API, Data Connectors, System Integration.
Cloud Computing
Azure, Cloud Services, Distributed Systems.