Sourabh Singh Rana

Programmer Analyst

Cognizant Technology Solutions•  October 2021 - Present

Project Details:- HBase to Snowflake Migration My Role and Responsibilities:- I was part of the data team for this project. #Worked on the whole data migration pipeline. #Handled SIT, UAT, and Prod Data migration cycles multiple times. #Came up with solutions when we found errors in data load-scripts. (Problem-Solving) The tools and technology I used for this project 1. Apache Oozie:- It's a workflow scheduler system that allows us to perform all migrations in one go. Creating Oozie jobs and testing them for errors was my responsibility. In the case of a successful Oozie job execution, data is successfully migrated from source to target. 2. Snowflake:- I used to prepare data loading queries that can handle exceptions. Also, I have created SPs (Stored Procedures) for data loading scripts for automation. 3. Jupiter Validation Tool:- Once I had created all the scripts, I used the Jupiter validation tool to make sure that data records matched in all the 3 layers. 4. Spark:- Spark use in this project is very minimal. I have gone through the Spark code. Our client developed it.