Niharika R Kadamba

Senior Developer (Data and Analytics)

AbilityStack Techsolutions Pvt Ltd•  February 2023 - September 2024•  Udupi, Karnataka

Developed and maintained PySpark pipelines on AWS, optimizing performance to process millions of records. Implemented Iceberg OpenTable for scalable data management and retrieval. Led data deduplication and merging processes, enriching datasets with PySpark. Used OpenAI solutions to generate content and ensure consistent structured data output. Automated web scraping, addressing CAPTCHA and two-factor authentication challenges. Conducted POC projects with machine learning techniques for advanced analytics. Experienced in Elasticsearch and MongoDB, handling large datasets with complex queries.

Data Engineer

Beckman Coulter India Pvt Ltd•  May 2019 - February 2023•  Bangalore, Karnataka

Conducted exploratory data analysis on data from 12,000 instruments using Spotfire. Migrated data from RDBMS to Hadoop with Sqoop and created Hive schemas. Designed and managed ETL pipelines on Amazon EMR, automating tasks with OOZIE. Enhanced code security by addressing vulnerabilities like SQL injection and improving cookie security. Developed APIs and automation frameworks to enhance customer onboarding and efficiency.