Divya Chahal

Senior Data Engineer

Sourcedogg•  July 2023 - Present

Developed a templated project approach, reducing setup time from 2 weeks to 2 days, significantly boosting operational efficiency. Implemented stored procedures and CTEs, cutting data processing time from 8 hours to 2 seconds, showcasing advanced database optimisation skills. Integrated various APIs to incorporate credit data and other insights, enhancing customer data analysis value. Utilized OpenAI API to create demo data, demonstrating diverse dashboard use cases to stakeholders. Automated repetitive workloads using Power Automate and Logic Apps, freeing up resources for higher-value tasks. Developed a robust logging framework for pipeline monitoring, facilitating rapid identification and resolution of pipeline failures. Designed and developed data pipelines using Azure Data Factory/Azure Synapse Analytics for customer dashboards. Integrated, stored, and processed large-scale data sets using Azure Synapse Analytics, enhancing business intelligence capabilities. Employed Inmon and Kimball data modeling techniques to create a datamart, speeding up customer reports and data access. Implemented SCD I and II to manage and track historical data effectively.

Data Engineer

Infonics Technology•  January 2023 - April 2023

Designed and implemented an end-to-end data analytics platform, enabling deep insights into customer purchase patterns. Leveraged AWS services (Amazon Redshift, AWS Glue, and Amazon QuickSight) to architect a scalable and robust data infrastructure. Collaborated closely with cross-functional teams to design data models and deliver actionable insights that drove informed decision-making. Implemented robust security measures, employing AWS IAM roles and policies, encryption, and access controls to protect sensitive data. Optimized costs and performance using AWS tools such as Cost Explorer and Auto Scaling, resulting in a cost-effective data analytics platform.

Data Engineer

SAP•  July 2022 - December 2022

Implemented SAP SLT for real-time data synchronisation, enhancing data accuracy and timeliness. Streamlined business processes using SAP SLT, reducing manual effort and boosting efficiency. Managed change and trained 8 end-users, ensuring a smooth transition and high satisfaction. Led workshops on data replication, effectively guiding teams to completion. Migrated financial data from SAP FICO to Azure SQL, ensuring seamless transition and improved data access. Developed strategies to extract and transform data, reducing inconsistencies by 95% and ensuring data quality.

Software Engineer

Accenture•  August 2019 - January 2022

Built a React-based training site with Azure SQL integration, boosting employee knowledge retention by 40% and cutting data retrieval time by 25%. Optimized Azure SQL for real-time access to warehouse data, enhancing operational efficiency and SAP EWM performance. Reduced deployment time by 30% using Docker and set up an automated CI/CD pipeline with Jenkins, cutting deployment errors by 50%. Led SAP EWM rollout, improving warehouse efficiency by 40% and cutting inventory costs by 20%. Configured SAP EWM for clients, conducted training sessions, and achieved a 95% user adoption rate. Maintained SAP EWM post-implementation, reducing system downtime by 20% and ensuring smooth operations.

Software Engineer Intern

National Informatics Center•  January 2019 - July 2019

Collaborated with developers to implement new features and improve functionalities, increasing overall application performance by 30%. Conducted comprehensive testing and debugging to ensure a high-quality and reliable product. Participated in code reviews, providing constructive feedback and implementing best practices for code quality.