Badges
Certifications
desaiparth2000 has not earned any certificates yet.
Work Experience
Data Engineer
accenture•  January 2022 - June 2023
- Led a digital transformation project by **migrating 39 AWS-backed Tableau Dashboards to GCP**, replicating dashboards using complex SQL queries. - Designed and built an encryption component for the platform using Scala and Spark, providing encryption and hashing functionalities. - Developed a user-friendly web application's backend that automates the generation of Python Airflow DAGs, eliminating the need for manual code writing. - Seamlessly integrated the Airflow REST API into the application, facilitating efficient communication and interaction with Airflow. - Implemented comprehensive support for performing CRUD operations on DAGs across multiple environments, including local setups, Amazon MWAA, and Google Cloud Composer. - Conducted extensive research and created multiple Python scripts for comparing and migrating RDS and Redshift databases, generating SQL statements for database creation, updates, and deletions. - Demonstrated meticulousness in handling database transformations by ensuring coverage of all possible cases for ALTER queries. - Developed and automated ETL pipelines for clients, meeting predefined KPIs. - Skills: AWS Identity and Access Management (AWS IAM) · Amazon Elastic MapReduce (EMR) · Amazon S3 · Azure Data Factory · Java · Apache Kafka · Python · Apache Spark · SQL · Google Cloud Platform (GCP) · Amazon Web Services (AWS) · Scala · Apache Airflow · Data Engineering · Data Analytics
Education
San Francisco State University
Data Science, MS•  July 2023 - Present
Nirma Institute Of Technology, Ahmedabad
Computer Science & Engineering, B.Tech•  August 2018 - July 2022
Links
Skills
desaiparth2000 has not updated skills details yet.