Vivek Kumar

India

@vk04190

Data Engineer at Jio | Ex-Infosys

Badges

Problem Solving
CPP
Python
Sql

Certifications

Work Experience

  • Deputy Manager - Data Engineer

    Jio Platforms Limited•  October 2021 - Present

    Technology: Python, PL/SQL, Git, Azure DevOps, Microsoft Azure, VMware vSphere, Dell EMC Isilon • Collaborate with developers and fellow product engineers to design, build, and deliver a Hybrid Cloud Management Platform (HCMP) for developing cloud-native applications/adopting a multi-cloud strategy. • Design, develop, test, and deliver high-quality software that powers ever-increasing demands of availability, reliability, security, and performance of different cloud platform core tools. • Work with the architecture team to design and implement a cloud management solution to potentially span multiple Cloud Service providers and private clouds. • Be a part of DevOps culture establishing top engineering processes/practices. • Identify and recommend solutions to improve data reliability, efficiency, and quality for new and existing database systems. • Work closely with the architect and engineers to design networks, systems, and storage environments that effectively reflect business needs, security requirements, and service level requirements. • Addressing issues promptly, responding positively to setbacks and challenges with a mindset of continuous improvement.

  • Associate Consultant - Data Engineer

    Infosys Limited•  March 2021 - September 2021

    Technology: Python, SQL, PySpark, Pytest, Azure Data Factory, Azure Databricks, Azure Delta Lake, Git, Azure DevOps • Developing and supporting data lake solutions project using Azure (Azure data factory for ingestion, Blob and Data Lake Gen 2 for storage, Azure Databricks service for transformations and analysis, Apache Airflow for Dag Scheduling) • Design, build, test, and deploying a range of data engineering ETL pipelines into production, including using automation best practices for CI/CD. • Designing and implementing highly performant data ingestion pipelines from multiple sources using Azure Databricks and Apache Spark. • Developing python and spark-based unit tests and functional tests for automated testing using DevOps CI/CD Pipelines. • Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained. • Working within an Agile delivery / DevOps methodology to deliver proof of concept and production implementation in iterative sprints. • Develop Databricks Notebooks and create Delta Lake tables with optimization techniques to meet and exceed expectations.

  • Lead Software Engineer - Product Developer

    Persistent Systems•  November 2020 - March 2021

    Technology: Python, Pytest, Jython, CQL, Git, GitHub, DataStax Enterprise, DataStax OpsCenter • Design and implement features/enhancements on a big data managing platform that can be deployed and used on-premises or on Cloud. • Work on complex, distributed platforms for storing data, managing clusters, scaling parallel, repair, and backups of data. • Write bug-free code, refine, optimize the code, and maintain proper documentation of modification for future reference. • Write and interpret configuration scripts for customer environments to install programs, configure logging, and modify configuration files. • Dive deep to resolve problems at their root cause, looking for failure patterns and suggest fixes. • Check interdependency across modules Performing analyses on software application functionality and suggesting improvements. • Managing code migration across environments to ensure continued and synchronized functionality.

  • Software Engineer - 3D Simulation Developer

    Oceaneering International, Inc.•  May 2019 - October 2020

    Technology: Python, PyQt5, Django, Vortex Studio, Vs code, PyCharm, Git, GitLab • Worked as a 3D Simulation Developer in Digital Technologies Team for Major Oilfield and Aerospace projects development including 3D Computer Simulation Development and Control Integration. • Writing reusable, testable, and efficient code for Desktop Application Development. • Integrating user-facing elements into applications using Python GUI toolkit PyQt5. • Develop Real-Time Simulation using Vortex Studio with Python. • Develop and implement an enterprise-level multi-threaded Web application using Python Django for further analysis. • Work with teams across multiple geographies to develop and implement the next generation of Autonomous Computer Simulation Platforms. • Work with innovative software and hardware technologies, to build new and innovative features from initial concept to final integration and release.

  • Jr. Software Engineer / ETL Developer

    Altruist Technologies Pvt. Ltd.•  January 2018 - May 2019

    Technology: Python, Jython, Shell Scripting, PL/SQL, ODI, Oracle Database, Git Bash • Create and Modify Existing complex functions, scripts, stored procedures and packages using PL/SQL to support application development and Improve application's performances • Worked as an ETL Developer to support their existing Data warehouse in Oracle 10g and to integrate new Data warehouse in Oracle 12c Suite with ODI as an ELT tool and OBIEE as a Reporting solution. • Developed 20+ diff. Shell and Python Scripts bring in the automation of tasks which is making a critical impact on Business Performance. • Created and Implemented 150+ diff. PL/SQL functions, procedures, packages, and SQL Scripts in Oracle Data Integrator (ODI) and Oracle database. • Enabling application development by coordinating requirements, schedules, and activities. • Implemented 1000+ diff. ODI packages, procedures, Load Plans, Scenarios, Commands, and Diff. Jython Scripts in Oracle Data Integrator (ODI) to automatically connect and operate multiple tasks on a shared database environment. • Integrated multiple data sources such as RDBMS, JSON, CSV, TXT, Block file, etc into one centralized Data Warehouse using Oracle Data Integrator (ODI) and Python.

Education

  • Punjab Technical University, Jalandhar

    Computer Science & Engineering, B.Tech•  July 2014 - July 2018

    • Organizer and Coordinator of Programming Club, at RIMT University. • Placement Coordinator of Training and Placement Cell, RIMT University. • Participated in Cyber Security & Ethical Hacking Workshop by EGITS, VCPS Pvt. Ltd. • Participated in National Network Security Championship organized by E-Cell IIT Bombay. • Representative of Computer Science & Engineering Department at Avishkar Annual Tech Fest Conducted by RIMT University.

Skills

vk04190 has not updated skills details yet.