MNARESH
MNARESH
SUMMARY
• Azure Data Engineer with 6+ years of experience in designing and implementing efficient ETL processes.
• Expertise in Azure Data Factory, Azure Synapse Analytics, Azure Data Lake Storage, and Databricks.
• Proficient in SQL, PySpark, and cloud-based data platforms for scalable data solutions.
• Skilled in building and optimizing data pipelines to streamline data workflows and enhance performance.
• Proven ability to collaborate with cross-functional teams to deliver high-quality, impactful solutions.
• Strong track record of reducing project costs by approximately 20% through optimized data strategies.
• Adept at integrating cloud-based technologies to support data storage, processing, and transformation needs.
• Focused on delivering solutions that align with business objectives and drive efficiency.
SKILLS
• Azure Data Factory • Spark SQL • Pyspark
• Azure Data Lake Storage • Python • Azure SQL
• Databricks • Logic Apps • PowerBI
• Pyspark • Synapse Analytics • Unity Catalog
• Delta Lake • Microsoft Fabric
WORK EXPERIENCE
IT Monk Inc., Hyderabad July 2018 – Till Now
As a Data Engineer August 2020 – Present
Project #1: EBM | Client: Trust Mark Health benefits
Tools & Technologies: Azure Data Factory, Azure DataBricks, Python, PySpark, Azure SQL, Logic Apps,Keyvaults, Azure
Synapse and Microsoft Fabric.
• Created ETL pipeline with Azure Ecosystem like Azure Data Factory. Building simple to complex pipelines, activities, Datasets
& data flows.
• Developed and maintained data ingestion and processing systems using Azure Data Factory, Databricks, Pyspark, Python,
Logic Apps, and SQL.
• Ensured data consistency and accuracy through data validation and cleansing techniques.
• Implemented scalable ETL pipelines using Azure Data Factory and Databricks.
• Performed different kind of transformations based on the requirements using Python, Pyspark and Spark SQL.
• Designed Metadata Driven Framework to load the hundreds of tables from On Prem system to Cloud using Azure Data Factory
activities like Get Metadata, Lookup, Stored Procedure, IF activity, Copy activity, Switch Activity and Validation activity.
• Created Dynamic Pipelines, Data Sets, Linked servers in Azure Data Factory for data movement and data transformations.
• Worked on migration of data from On-prem SQL server to Cloud databases (Azure Synapse Analytics (DW) & Azure SQL
DB).
• Implemented Data Ingestion, Data Processing (Transformations, enrichment and aggregations) and Reporting.
• Achieved proficiency in Azure Data Factory, Databricks, ADLS Gen2, Delta Lake and other Azure services.
• Led and managed data migration projects using Microsoft Fabric.
• Extracted, transformed, and analysed data from Azure Data Lake using Microsoft Fabric.
• Migrated data from multiple on-premises systems to Azure cloud using Azure Data Factory, Azure Synapse, Microsoft Fabric,
Azure Data Lake, and SQL.
• Set up Microsoft Fabric Data Gateway to securely connect on-premises data sources with cloud services, enabling seamless
data integration and real-time analytics.
• Successfully implemented scalable data pipelines within Microsoft Fabric for seamless integration and data processing across
Microsoft services.
• Implemented Microsoft Fabric Dataflow Gen2 for transformation, leveraging advanced tools for scalable processing and
seamless data movement across multiple sources.
• Integrated data lake and warehouse capabilities with Microsoft Fabric Lakehouse, enabling unified storage and high-
performance analytics across structured and unstructured data.
EDUCATION
• B-Tech from Jawaharlal Nehru Technological University | 2009
CERTIFICATIONS
• Certified Microsoft Azure Data Engineer Associate
• Google Professional Cloud Architect Certification
https://www.credly.com/badges/ccc1eb65-85be-483d-bcf6-dd42fea36d3a/linked_in_profile