Badges
Certifications
Work Experience
Data Engineer
Anblicks•  May 2023 - Present
Integrated Twitter API using Python and specialized libraries, optimizing real-time tweet collection for a responsive and data-rich digital presence. •Configured Apache Airflow with Python scripts to enhance task scheduling and orchestrate automated data workflows, ensuring efficiency in handling large-scale datasets. •Applied Directed Acyclic Graphs (DAGs) with Python to streamline real-time Twitter data retrieval and task scheduling, enabling an adaptive workflow synced with social media trends. •Pioneered secure storage practices on AWS S3, implementing robust Python code for real-time tweet storage, ensuring data integrity and user privacy. •Leveraged Python, Google Analytics, and SQL for in-depth data analysis, extracting valuable insights. Utilized Power BI and MS Excel for visualization, transforming raw data into compelling narratives. •Integrated Python programming seamlessly with visualization tools, offering a comprehensive approach to data engineering that transforms diverse datasets into actionable insights for stakeholders.
Data Engineer
Genpact•  August 2020 - December 2021
•Spearheaded the design and optimization of data pipelines using Python and its libraries, achieving a 30% reduction in processing time and a 25% boost in ETL efficiency. •Facilitated collaboration across interdisciplinary teams, ensuring strict adherence to data governance policies and utilizing SQL for seamless data integration. •Implemented advanced cloud-based solutions with AWS and GCP, rchestrating workflows with Apache Airflow, and employing Docker for efficient containerization. •Applied strategic performance tuning, resulting in a commendable 15% reduction in infrastructure costs, while leveraging Python for systematic optimizations. •Pioneered proactive monitoring systems, fortifying the framework for swift issue resolution, and proficiently used MS Excel for data analysis and reporting. •Demonstrated visionary leadership in translating complex business requirements into robust data solutions, integrating Power BI for impactful visualizations and insights.
Education
University of Texas at Arlington
Computer Science, MS
Links
Skills
tammadevikarani has not updated skills details yet.