Om Prakash

Senior Data Engineer

IMVU•  September 2018 - Present

Design and develop state-of-the-art analytics systems that stores petabyte data and hundreds of GB of transactional data in order to apply machine learning techniques to design powerful and meaningful experience to our users. Conduct research on open source technologies and components to recommend and integrate into the design and implementation; provide professional analysis and guidance on novel data infrastructure, metrics, insights and data services. Build data pipelines to efficiently and reliably move data across systems, as well as build the next generation of data tools that will influence company products, data consumers and analysts. Partner with data analysts, product owners and data scientists to better understand requirements, determine bottlenecks and resolutions; support big data and batch/real time analytical solutions; design and develop different architectural models for our scalable data processing as well as scalable data storage; build data pipelines and extraction, transformation and load (ETL) using heterogeneous sources; build ingestion from various source systems to Hadoop using Kafka, Flume, Sqoop, Spark Streaming, etc. Transform data using mapping and data processing capabilities like MapReduce, Spark SQL; ensure platform goes through Continuous Integration (CI) and Continuous Deployment (CD) with DevOps automation. Expand and grow data platform capabilities to solve new problems and challenges. Work with development and quality assurance teams to design ingestion pipelines, integration API and provide Hadoop ecosystem services.