Subhadeep Chatterjee

Senior Software Engineer

PwC SDC•  August 2019 - Present

Transformation of a legacy on-premise based system into a Cloud based Solution. As a Senior Developer and individual contributor, I have worked on ● Implement various microservices, build and deploy AWS cloud services, ● Responsible for building reactive Java microservices using Spring webflux, developing functionalities such as user search applications with Elasticsearch as the search engine, user authentication management using Spring Security and JWT token leveraging Redis cache, ● Build API gateway using Spring cloud, ● Write AWS Lambda in Python to automate the process of sending real-time feeds to kafka, and several other business use cases. ● Set programming standards for the other development teams to write optimised and secure code using AWS SDK. ● Leverage Spring Cloud Gateway to route the backend APIs via an unified entry point and restrict the exposure of the APIs to unauthorized users.

Software Engineer

Cognizant Technology Solutions•  June 2018 - August 2019

• Responsible for Requirement analysis, Design, Coding, Unit Testing and other SDLC activities • Build a framework with Spark coding on Change Data Capture to automate the processing of data by using metadata driven approach • Design and model table structures in Hive to maintain data abstraction and handle transformational logics • Create Hive tables following the best practices applying concepts such as partitioning and bucketing wherever applicable • Provide technical expertise to write efficient code and solve technical challenges • Built micro service using Java Spring boot to enable downstream access to APIs • Learn and explore options to deal with real-time data processing using Kafka with Spark • Collaborate with Clients over one to one meetups or through SCRUM meets and keep up to date with the business requirements and provide recommendations with respect to technological stacks

Software Engineer

TCS•  November 2016 - June 2018

• Write Spark code to implement transformation logics in order to migrate the Pig and Talend code • Bring data from various source systems such as RDBMS, Flat files, MBOX files and form a data lake in AWS S3 • Built data model to store data on REDSHIFT and SPECTRUM • Write Sqoop scripts to pull data from external RDBMS • Orchestration of the workflows using CAWA • Work in Agile Software Development • Build Java based application using Spring Framework to automate the process of responding to store dashboard tickets faced by the support team and nullify the effort with zero errors.

Software Engineer

Infosys Ltd•  February 2014 - October 2016

• Work in Agile Software Development • Create Ingestion and Integration pipelines using Talend to streamline the data available from various sources into single platform to form the data warehouse • Build Data Quality Framework with Talend Joblets ensuring reusability and uniformity across the environment • Work as per the development life cycle and ensure bug free releases • Implement fast and efficient data acquisition using Big Data processing techniques and tools • Used Talend reusable components like routines, context variable and global Map variables. • Responsible to tune ETL mappings, Workflows and underlying data model to optimize load and query performance. • Troubleshoot data integration issues and bugs, analyse reasons for failure, implement optimal solutions, and revise procedures and documentation as needed • Perform data manipulations using various Talend components • Perform technical analysis, ETL design, development, testing, and deployment of IT solutions as needed by business or IT. • Monitor and support the Talend jobs scheduled through Talend Admin Center (TAC)