Shubham Deshmukh

Data Engineer

Perficient•  November 2021 - Present•  Nagpur

Outlined a new data warehouse and designed a data ingestion pipeline using AWS Glue and Pyspark, enabling the DWH team to process millions of records efficiently and meet business requirements. Migrated 500+ Datawarehouse objects from Snowflake to Redshift. Improved existing ETL design, reducing overall data refresh run time by 80%. Developed the generic SQL stored procedure which reduces the overall Provisioning time of new tables by 40%. Ensured data integrity through comprehensive Stored procedures developed in AWS Redshift, automated business processes using AWS Step functions, and incorporated event-based services with AWS Event Bridge. Collaborated with stakeholders, including Architect, Product, Data, and Design teams to support their data infrastructure needs, address data-related technical issues, and design high-level data architecture.