Maithreyi Pagar

Senior Data Engineer

LTIMindtree•  November 2021 - Present

Spearheaded end-to-end setup for password retrieval of 6 databases from the cyber-ark vault using tokens instead of static files. Designed 5 alert workflows for data migration from oracle to hive incorporating analysis and optimization for business needs. Presented to groups of 30+ clients every 2 weeks for final Production deployment on behalf of the ETL team for oracle package. Developed an ETL pipeline in Spark for enrichment of data from Kafka to Gemfire handling ~22M near-real time data each day. Implemented Intraday deduplication logic for unique records in spark SQL based on primary key to generate an instantaneous report for end of day (EOD) data within 1 hour of live-incoming streaming dataflow which earlier required 24+ hours to be generated.

Graduate Engineer Trainee

LTIMindtree•  July 2021 - October 2021

Automated record count and email trigger mechanism for report generation which earlier required few hours daily, thus saving time. Implemented hive to create tables and carried out root cause analysis for missing records and retrieved 100% data from HBase. Devised and scheduled archival jobs in Autosys which ran every weekend ensuring data cleanup for disk space and clear cluster cache. Efficiently managed the data inflow from RIO and WebSocket in real time and regulate the storage across various regional clusters.

Full stack developer

Cognizant Technology Solutions•  January 2021 - July 2021

Worked on React Framework (MERN stack), HTML, Bootstrap, JavaScript and created a website for online bookstore management. Application featured purchasing and lending of books to the customers/subscribers and navigating to 10+ secured payment gateways.

Software Tester

Trust Systems and Technologies•  May 2019 - June 2019

Performed testing of ‘Trust Bank CBS’ Project and identified various bugs and fixes, increasing overall customer satisfaction by 25%. Undertook regression tests after code change cycle to fix defects and report defects, define severity and priority for each defect.