Pradeep Kumar Chokkahalli Prabhakar

Data Engineer

iTrending Solutions•  August 2022 - Present

Designed and built a scalable data engineering solution on GCP, leveraging Python, PySpark, and SQL to develop ETL pipelines, optimizing queries and managing data dependencies, resulting in a 40% improvement in data processing efficiency. • Implemented automation and orchestration tools like Apache Airflow and Kubernetes in the data engineering pipeline for a healthcare provider, enhancing processing efficiency by 20% and reducing manual intervention by 60% • Improved data warehouse architecture for an insurance company, enhancing infrastructure components and implementing reporting tools, reducing data latency by 30% and increasing reporting accuracy. • Scheduled and orchestrated all the pipelines using ADF through Kafka improving data ingestion rate by 20%. • Developed code for Data Transformations & Aggregations using Spark/Scala a in Azure Databricks Notebook & Scheduled Data Factory pipelines to execute over 100 spark jobs on Azure Databricks. • Developed ADF Dataflows to merge the Incremental data from ADLS to Synapse tables using SCD1 approach. • Developed a scalable and maintainable microservices-based API solution for an insurance company, utilizing knowledge of microservice patterns and cloud networking, leading to a 35% increase in application performance

Data Analyst

accenture•  March 2018 - November 2021

• Reconciliated 15 days backlog data from Hybris through Snaplogic to EAP using a Oozie Workflow and Coordinator for Qlik reports. • Programmed OOPS ABAP to develop Business Applications and 90% of ALV reports using Development Workbench to process Sales Orders streaming from S4 system. • Scrutinized and visualized large datasets using tableau, integrating powerful models and algorithms into operational solutions for pattern recognition which succor reduced incidents by 30%. • Optimizing data flow using SQL scripting and enhancing Business performance by finding RCA of SOLMAN (Solution Manager) errors and effectively reducing Problem Records from 10 to 4 a month. • Lead as Agile Scrum Lead for change management, deploying Business Intelligence Applications 100% on time.