Aranyak Panigrahi

Software Engineer

Tata Consultancy Services•  July 2021 - Present

Data Warehouse Project • Incrementally Extracted, Processed and Stored GBs of data from AWS S3 to Teradata for Analytics. • Developed and automated ELT pipelines with AWS Glue, Lambda, SNS, Python,SQL and Airflow. • Developed unit test cases and created mapping documents for source-to-target dataset relationships. • This Warehouse powers multiple Dashboards, ML Models and Management Reports. Data Analytics and Ingestion Project • Ingested data from various databases like Oracle,Mysql,DB2 to Hadoop using Sqoop. • Utilized Apache Hive, PySpark and SparkSQL for data processing, analysis and generating reports. • Automated and scheduled end-to-end data pipelines using CA Workload Automation. • Transferred data from Hadoop to AWS S3,subsequently used by other teams for advanced analytics. Insurance Reconciliation Project • A web app designed to enable stakeholders to seamlessly update and monitor claims-related data. • Developed multiple Django APIs, utilizing SQL queries to execute CRUD operations on the database. • Designed and implemented the frontend of the application using Angular, HTML and CSS. • Features include data tables, filtering, pagination, export functionality and data validation. • Successfully delivered the Dashboard, achieving a 90% improvement over existing process.