Nilesh Patil

Data Engineer

Tata Consultancy Services•  January 2022 - Present•  Pune

As a Data Engineer in TCS, I work for a client in Finance Account/Capital Market and I am a part of very talented and enthusiastic Data Engineering team. >> Since I joined, I worked on multiple technologies starting from on-prem Informatica Power Center to cloud hosted Snowflake. My major work consists of creating new data flow/data pipeline for new requirements from BUs and end users, I also engaged in enhancement requests to existing system to add new features. While developing the pipelines, first step of mine is that of requirement gathering and giving the ETA of POC to the users, testing, getting sign-off and production deployment though out the past years, I have build many robust, scalable data pipelines which helped grow the business. >> New requirements often came with Extracting data different kind of sources such as API's, kdb, DB2, Sybase etc. also the middle stage of ETL pipeline that is transformation involved technologies like Python, SQL, Informatica etc which I worked on are scalable, fast and efficient. For Destination of data I majorly involved, for On-Prem side its DB2, Postgres, Greenplum and for Cloud side its Snowflake. I also developed stored procedure and views to provide the data to downstream systems which only gives access of data to permitted users. >> I also provided the Production support to existing Data Pipelines and newly created one. The production support helped me understand the existing system and learn from it, and while developing new data flow I can avoided the know failure points and create a reliable data Pipeline. Since the Production supports is very critical to the business it also helped me how to effectively deliver work in very narrow time window. >> I was also part of a migration project from legacy DB2 system to Greenplum System. >> I also many resolved DQ(Data Quality) queries came from downstream team/users by debugging the pipeline, dry running it to get root cause. >> I works on migrating on-prem system to Snowflake.