Scribd
Upload
17 views

ShubhamChatterjee-DataEngineer

Uploaded by

22metadata
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
17 views

ShubhamChatterjee-DataEngineer

Uploaded by

22metadata
Copyright
© © All Rights Reserved
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 1

Shubham Chatterjee

+91 7275642314 [email protected] shubham-chatterjee-0ba7841aa


NOIDA , UTTAR PRADESH, INDIA

As a Microsoft-certified data professional with around 2 years of experience, I specialize in Azure cloud and Power BI &
Snowflake to develop data automation, warehousing, and BI reporting systems. My expertise in cloud integration and
migrations empowers organizations and clients to unlock valuable business intelligence from their data.

SKILLS
Scripting : SQL , Python Automation : Azure Logic Apps
Visualization : Power BI & DAX Big data : Azure Databricks , Spark
Orchestration : Azure Data Factory Data Warehouse : Snowflake
Version Control : GIT

PROFESSIONAL EXPERIENCE
HCL Tech , Noida Aug-2024 to Present
Software Engineer
Developing a CDC using Delta lakes Change data feed for capturing real-time changes for implementing in existing batch loads for
delta loading (near real-time loading)
Debugging and Developing requirements in Existing batch Spark Pipelines as per requirement on daily basis
Developed POC for Snowpipe for Realtime data ingestion from ADLS to Snowflake.
Stack [Azure Databricks , Delta live tables, Spark, Snowflake]

Veratas , Noida Jul-2022 to Oct -2023


BI Developer
Developed & optimized PySpark ETL job scripts on Azure Databricks :
Developed Spark-SQL scripts for modules like Dim_Date , Dim_Products ,Dim_Inventory and Fact_AR_Transactions
SQL scripts helped to structure ,validate and format the data in SQL Data warehouse for the reporting . saves the data transformation
time in Power query for reporting by +30% efficiency. Stack [ADLS , Databricks ]

Data Ingestion Automations :


Fully automated Vendors invoice processing using Azure logic apps , Azure functions and Azure AI(Document intelligence) for data
export to D365 F&O ERP .
Automated data from D365 using Azure Logic app and Azure function
These automation reduces the manual process by 95 % (only validation is done by human)for uploading data in ERP.
Stack [Azure Logic Apps , D365F&O , Azure functions]

Developed Log analytics Power BI Dashboard :


Reduced manual Monitoring of Azure Data factory pipelines by 100% by building log analytics dashboard on Power BI by ingesting
data from Log folders of ADF from ADLS (Pre-processed in Azure data explorer using KQL ).
Developed the Data model and DAX measures for KPI like Total pipelines , Total pipeline executed ,Total failed ,Time consumed by
each pipelines ,this saves monitoring time by 70% Stack [ADF logs ,Azure data explorer , Power-BI]

CERTIFICATIONS
1. Microsoft certified Azure DP 900
2. Microsoft certified Azure AI 900
3. Databricks fundamentals certification
4. Linkedin learn Power BI essentials

EDUCATION
Dr APJ Abdul Kalam Technical University,Lucknow (2017 -21) Bachelor of technology in
Automobile engineering

73.4 % overall

You might also like