Anurag Sharma

Senior Software Engineer

Skidos•  January 2022 - Present

- Architected and developed serverless data-lake infrastructure for achieving a single source of truth for the key business metrics tracked at SKIDOS. - Created data pipelines in Airflow to ingest data from multiple sources into the data lake. - Scheduled 90% of critical data scripts on Airflow and configured alerts to get success/failure notifications. - Leading the data team of 5 members to drive data driven decisions in the organization - Tools - Python, Airflow, AWS Glue, AWS Athena, AWS S3, BigQuery, MySQL, RabbitMQ

Senior Software Engineer

Radisys•  July 2021 - December 2021

- Optimized the FAISS index to retrieve relevant Wikipedia passages (22 million) in 1/10th of the time. - Participated in designing and implementing the HLD & LLD of the Question Answering System. - Developed the system to optimize the Question Answering pipeline for serving batch requests. - Carried out POC on Long Form Question Answering model. - Tools - Python, FAISS, Hugging Face Transformers, Kafka, FastAPI

Senior Software Engineer

Esri•  February 2020 - June 2021

- Added Text Classification & Named Entity Resolution modules supporting transformer architectures like BERT, RoBERTa, XLNET, etc to our enterprise software offering arcgis.learn. - Used embedding technique to find similar images from a corpus of 9.5 million images. - Trained a NER model and created a Knowledge Graph by extracting named entities from text documents. - Tools - Python, PyTorch, FastAI, FAISS, Hugging Face Transformers, spaCy, Neo4j

Senior Software Engineer

BOLD•  January 2017 - January 2020

- Involved in optimizing and reducing the run time of Data Science APIs. - Created and productionized multiple Knowledge Graphs built on Neo4j using Docker. - Involved in re-architecting of data ingestion pipeline to make it more fault tolerant. - Tools - Python, Java, Neo4j, Docker, Gensim, MongoDB, Redis, RabbitMQ, Azure Service Bus.

Software Engineer

QuadAnalytix•  August 2015 - December 2016

- Written software robots to extract product information from various e-commerce websites in the US market. - Done continuous improvement in the platform to allow data extraction from new e-commerce websites. - Carry out various POCs at both infrastructure and platform/code level. - Tools - Python, Selenium, Amazon Redshift, Amazon EC2, Google Cloud, MongoDB, shell script

Software Engineer

HT Media•  September 2013 - August 2015

- Worked as a Django developer to build a portal which provides information on various colleges across India. - Worked on Apache Solr to improve the search quality of the site based on the keywords entered by the user. - Tools - Python, Django, Solr, MySql, and Memcache