Liju Thomas
@lijuthomas1509
Data Engineer
Personal Information
Badges
Certifications
Work Experience
Big Data Developer
Citi•  February 2023 - Present•  Pune, India
Migrated complex data workflows from Cloudera clusters using Hive to Azure, leading to a performance improvement of over 40%. Developed and optimized data pipelines in Delta Lake for transformation and staging, integrated with Snowflake using Databricks Spark connector. Maintained CI/CD using Azure Devops, performed workflow orchestration using Azure Data Factory(ADF), and conducted code reviews.
Analyst
Ernst & Young•  October 2020 - January 2023•  Trivandrum, India
Fetched data using API call in Databricks and stored in delta lake. Performed data transformation from a remote database using Azure Data factory(ADF), and POC on AWS services - Glue, EMR, and Kinesis. Utilized BigQuery for data transformation and Power Bi for visualizations.
Education
Birla Institute of Technology and Science
Data Science, M.Tech in Data Science and Engineering•  January 2022 - Present
Sree Chitra Thirunal College of Engineering Trivandrum
Computer Science & Engineering, B.Tech in Computer Science & Engineering•  January 2016 - January 2020•  GPA: 8.29
