Badges
Certifications
Work Experience
SDE III Data Engineering
MPL•  July 2021 - Present
I work as SDE III Data Engineering at MPL. Passionate about Data Engineering and software engineering. • Help conceptualize and build enterprise grade Datawarehouse solution at MPL. • Based on Data Vault 2.0 and Dimensional Modeling concepts designed the multilayered DWH infrastructure. • Worked on PySpark, SparkSQL, Hive,Python, Databricks and AWS S3, EC2 to deliver a robust solution. • Delivered end to end solution from designing to implementing, historical load,daily ETL scheduling to Metrics creation for business consumption.
Senior Data Engineer
Coforge •  September 2018 - July 2021
A data enthusiast with the skills in Hadoop, Azure, Spark, Python, R, PowerBI, SQL, Tableau. • Built Sanlaid- a REST based webservice architecture to extract data. • Built real time data ingestion into PySpark using Kafka for large scale streaming data for real time processing and transformation. • Implemented FASTApi and Nameko architecture to built the mi- croservices framework of webservices in python3. • Implemented PostgresSQL and MongoDB for different DB re- quirement. SEI • Developing different Data Mart specific to different analytical solution. • Analysis of complete data set of approx size 2 TB for Data Qual- ity and other Business use cases such as customer penetration, expansion possibility , Branch performance, Sales channel analy- sis, loan performance. • Created automated pipeline for ETL data ingestion. • Created Sanity checks to validating the Data Quality in the Data Pipeline.
Software Engineer
IBM India Pvt Ltd•  July 2013 - September 2018
• Build Datawarehousing solution with keeping the core analytical solu- tion at the centre of design. • Created various Data Mart and different Data Solution specifically cater- ing to different analytical use cases and as a feed to Machine Learning Models. • Build ETL pipeline for automated ingestion of data from different data sources to the Data Warehouse. • Kept the Data Quality checked with automated sanity test.
Education
NIIT University, Alwar
Data Science, MBA•  July 2018 - July 2020
National Institute of Technology
Software Engineering, B.Tech•  May 2009 - May 2013
Links
Skills
ArpitShukla1 has not updated skills details yet.