Reo the fighter

Project Lead

CADeploy Engineering•  July 2021 - Present

• Build SQL stored procedures and setup workflow jobs to automate the data ingestion process and to churn out daily financial reports. • Database Design and Datawarehouse Techniques • Creating PySpark Scripts for creation of automated pipelines and usage of triggers and cleansing, Analysing the datasets • Writing Basic to Complex SQL Queries, Creating Stored Procedures, Views and Functions • Created Azure data Pipelines(CI/CD) to perform ETL & ELT Process and use of Triggers wherever required • Worked and Implementation of Azure Data Factory(ADF), Azure Data Lake(ADL), BLOB Storage • Worked with Configurations in ADF to execute the SSIS Packages in Azure. • Developed ETL Pipelines, Data Flows and Control Flows using Azure Data Factories. • Experience Creating Build and Deployment Pipelines using Azure Data Factories • Conduct exploratory analysis on modelling datasets to gain insights, find anomalies and identify trends using sql. • Create visualization reports using Power BI • Work with the technical team to understand the data conversion requirements and to design the conversion procedures and applications • Aggregate, cleanse and combine reinsurance data from multiple source systems and derive reports to match financial reports extracted from source. • Write complex SQL to validate data across tables and perform gap analysis. • Create stored procedures queries for data validation and integrity • Work with ETL system developers to validate data consistency and ensure all processes are issue and bug free • Apply data mining techniques to acquire reliable data from multiple sources • Develop reports in MS excel to monitor models and implement changes when deemed necessary • Conduct exploratory analysis on modelling • datasets to gain insights, find anomalies and identify trends using Power BI. • Create visualization reports using Power BI • Work with the technical team to understand the data conversion requirements and to design the conversion procedures.