yash chaudhari

Data Engineer

Tata Consultancy Services•  October 2023 - Present•  Pune

Designed and developed data solutions for data generation, collection, and processing. Created and maintained data pipelines using Apache Airflow and Google Cloud Data Services to ensure efficient data flow. Implemented ETL processes to migrate and deploy data across systems. Ensured data quality and integrity through data validation and cleansing techniques. Optimized data infrastructure for improved performance and scalability. Collaborated with cross-functional teams to define data requirements and provide technical expertise. Troubleshot and resolved data-related issues to ensure seamless operations.

Software Engineer

WIPRO•  March 2021 - October 2023•  Banglore

Developed data pipeline solutions using Python and SQL for scalable data processing. Designed and implemented APIs using Django and SQL, improving system reliability and scalability by 25%. Engaged in data transformation, cleansing, and validation processes to ensure accuracy. Optimized database queries using advanced SQL functions like Aggregate, Conditional, Mathematical, and Windowing Functions.