Purusottam Swain

Data Engineer

Tata Consultancy Services Ltd.•  August 2021 - Present•  Bhubaneswar, Odisha, India

Over 3 years of experience as a Data Engineer on the Microsoft Azure platform, leveraging services such as Azure Data Factory, Azure Databricks, and Azure Synapse Analytics for efficient data processing. Expertise in managing large-scale datasets using Azure Data Lake and Delta Lake, including Azure Blob Storage, ADLS Gen 2, and Azure SQL Database, to ensure optimal data storage and management. Proficient in Python, PySpark and SQL for developing scalable data workflows and performing complex data transformations across various sources through ETL/ELT operations. Skilled in utilizing Dedicated SQL pools and Apache Spark pools for high-performance data processing, analytics, and the orchestration of data movement with pipelines using linked services and datasets. Well-versed in dimensional modeling, including the design and implementation of fact and dimension tables, star and snowflake schemas, and Slowly Changing Dimensions (SCD) to support data warehousing. Familiar with data architectures for OLAP and OLTP systems, along with experience in file formats such as CSV, Parquet, and Delta; competent in data partitioning, indexing strategies, and using GIT for version control in collaborative projects.