Badges
Certifications
Work Experience
Programmer Analyst
Cognizant Technology Solutions•  November 2020 - Present
Worked for an insurance industry client processing its data for hedging and business reporting. Input data was prepped and fed to a risk model whose output was processed in the cloud using an in-memory processing engine- Spark. The processed data was then loaded to reporting tables in the enterprise data warehouse (EDW) – Azure Synapse. Developed Spark scripts using PySpark and Spark-SQL to ingest, transform and aggregate data. Experienced in working with Spark on top of Databricks platform. Monitored, troubleshot and optimized spark jobs. Involved in transforming Hive/SQL queries to Spark transformation using DataFrame. Created generic helper functions for common spark transformations. Migration from Hortonworks Data Platform (HDP) to Azure Data Platform. Created generic pipelines in ADF using linked services/ Datasets/ Pipelines to extract, transform and load files/folders from on-premise servers to ADLS and Synapse. Extensively worked on Python scripting. Created Disk space analysis tool and Worked on a few Automations using Python.
Intern
Knowx Innovations•  January 2020 - February 2020
Designed and Developed Placement Prediction tool using Python, SQL, Machine Learning Algorithm.
Education
Angadi Institute of Technology and Management
Computer Science & Engineering, BE•  August 2016 - October 2020
Links
Skills
mahanteshng has not updated skills details yet.