Badges
Certifications
Work Experience
Associate Software Engineer
Rakuten Symphony•  April 2022 - Present
Working on RCP products with the OSS Business Unit in the telecom domain. Optimized data ingestion pipelines to efficiently process and load over 350 GB of weekly data from multiple sources into a centralized data warehouse or data lake. Developed and managed more than 10 ETL data flows using tools like Databricks, PySpark, and Spark SQL to transform raw data, ensuring data integrity and quality throughout the process. Enhanced data processing efficiency by 60%, reducing processing time by 1.25 hours, and optimized Spark resource usage through data cleaning and optimization techniques. Implemented scalable storage solutions in YugabyteDB (Cassandra), effectively managing an influx of over 400 GB of weekly data and ensuring the system could accommodate future growth. Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal downtime to maintain continuous data flow. Designed and Developed more than 15+ Rest APIs for cloud-based applications using Java technologies, ensuring optimal performance and scalability.
Education
Maulana Azad National Institute of Technology Bhopal
Master’s of Computer Application (MCA)•  June 2019 - April 2022•  CGPA: 7.45