Ashwini Chougule

Business Technology Solutions Associates

ZS Associates•  January 2021 - Present

● Working extensively on Amazon EMR, PySpark, Lambda, SNS, S3 and CloudWatch to make the legacy codes and configurations compatible to run on Amazon EMR. ● Developing PySpark applications to fetch data from client’s on premise data centres and storing the data in S3 in csv or parquet formats as a part of data lake formation. ● Experience in building EMR framework from scratch to spin up transient EMR clusters based upon job requirements and terminate upon completion as a part of cost-optimization. ● Building Glue Crawlers to catalog the S3 data and query in Athena. ● Developing pyspark scripts for data quality management and data restatements. ● Interacting with the client to cater the business use cases and delivering on time as per Agile methodology.

Senior Software Engineer

capgemini•  June 2018 - January 2021

● Experience in building large data pipelines using PySpark and Python libraries in AWS cloud native environment. ● Experience in developing big data sqoop, hive, spark batch jobs leveraging AWS serverless fan out architecture using Lambda, SQS, SNS and transient EMR. ● Interaction with the Arch team, plan and resolve the issues by deploying code fixes/hotfix/release based on business requirements. ● Working as a SPOC for various operating teams, by automating their BAU stuff and any new requirement related to compliance/regulatory, vulnerabilities and performance monitoring.