RIYA GUPTA

Business Technological Solutions Associate

ZS Associates•  January 2022 - July 2024•  Gurgaon,Haryana

Managed the ETL development project for Ex-Factory data, successfully transitioning from Informatica to AWS by leveraging SQL, PySpark, and Python. Designed and developed efficient data pipelines in AWS, achieving seamless integration and optimized performance. Proficient in AWS services, cloud technologies, and Snowflake data warehouse, with hands-on expertise in cloud-based data solutions. Applied expert-level Python and PySpark in AWS Glue and Databricks to streamline ETL processes, reducing overall runtime by 53%. Migrated and transformed Alteryx workflows into Databricks notebooks using Python, PySpark, and SQL, while designing and optimizing workflows for improved performance. Implemented UKI Adjustments for Ex-Factory Subject Area, optimizing data handling processes through advanced Python and Spark techniques. Conducted rigorous testing and debugging to ensure reliability and accuracy in production environments. Played a pivotal role in leading global projects in an onshore-offshore delivery model, fostering smooth coordination and effective communication. Contributed to a data engineering team of 15 engineers while leading and mentoring a team of 4 members to deliver project objectives successfully. Experienced in delivering projects using the batch data processing pattern for scalable and efficient data workflows. Familiar with RDBMS systems, including MySQL Workbench, for structured data storage and management.