Rahul Khatkar

Data Engineer

Xcaliber Infotech•  July 2021 - Present•  Pune

Successfully designed and optimized scalable data pipelines, enhancing data movement efficiency. Proficient in Python for scripting and data processing; developed and maintained Python scripts for routine data tasks and ETL processes. Executed ETL processes using Python and SQL, including data extraction, cleansing, and transformation. Demonstrated proficiency in creating impactful visualizations with Tableau dashboards and integrating them seamlessly. Ensured smooth handling of various file types (CSV,XML,XLSX,DAT) by developing and maintaining Python scripts for routine data tasks. Implemented data storage solutions using Azure Data Lake Storage (ADLS) and Amazon S3. Improved data quality through cleaning and preparation techniques. Utilized Apache Kafka for real-time data processing for consumers. Enhanced data acquisition strategies through web scraping techniques, including Beautiful Soup. Used Windows Graph API to handle daily email files. Developed comprehensive documentation for data engineering processes, workflows, and configurations. Ensured data governance and compliance, maintaining data privacy and security. Transformed complex data sets into actionable insights using Tableau. Oversaw data lake development and integration with existing infrastructure. Collaborated effectively with data scientists, analysts, and stakeholders to understand and fulfill diverse data requirements. Technologies:- Python,My Sql, Tableau, Pandas Profiling, Numpy, Pandas, Beautiful Soup,Kafka