Vipul Singh

Data Engineer

CES Limited•  January 2022 - March 2023•  Hyderabad

● Developed, maintained and optimized ETL workflows using Python, extracting raw data from multiple sources and transforming it for storage in SQL Server. ● Maintained comprehensive documentation of ETL processes and shared them with the team members. Also assisted in training new team members. ● Revamped an existing ETL pipeline, improving its performance from a 24-48 hour runtime to just 3-4 hours resulting in a 75% reduction in processing time and enabling more timely data availability for analytics. ● Collaborated with cross-functional teams to troubleshoot and resolve data integration-related problems. ● Created and maintained complex SQL objects such as stored procedures, triggers, and views. ● Skills: Python, SQL, Database Management, ETL, Jenkins, Github, Control-M

Data Engineer

CES Limited•  June 2021 - December 2021•  Chennai

● Executed a Data migration project for a US client, successfully migrating data from Oracle databases to Azure SQL while ensuring data accuracy and integrity throughout the process. ● Developed and maintained ETL workflows Azure Data Factory (ADF) pipelines using Python and JSON, automating data integration and transformation processes. ● Implemented data validation checks and quality controls to ensure data accuracy. ● Created multiple tables, stored procedures, and views in SQL, optimizing data storage and retrieval performance. ● Automated the Power BI incremental refresh data collection process by developing a Python-based parser, eliminating manual data collection and reducing a 2-hour task to just 1 minute. ● Skills: Python, SQL, Database Management, ADF, Power BI, Azure Repos.

Machine Learning Intern

Olcademy•  December 2020 - March 2021•  Remote

● Used Python libraries like Numpy and Pandas to build an algorithm for user recommendation page and connection recommendation page. And collaborated with the other teams to deploy the algorithms. ● Skills: Python, Matplotlib, Numpy, Pandas, MongoDB.