Badges
Certifications
Work Experience
Senior Software Engineer
Apple•  March 2020 - Present
Working as a Senior Software Engineer in Applied Machine Learning Group.
Software Engineer
Apple•  February 2018 - March 2020
Working as a Software Engineer in Applied Machine Learning Group.
Software Engineer
Clairvoyant•  June 2016 - February 2018
[Technology Used: Apache Hadoop, Apache Spark, Apache Sqoop, Apache Hive, Hue, Airflow Apache Kafka, Oozie, Hadoop Distributed File System, Cloudera Manager, Cloudera Impala, DistCp, AWS, S3, EMR, CentOS, UNIX] - Developed ETL pipelines using Spark and Kafka with average load around 1 million+ records per minute. - Used Spark to parse and clean log files based on custom regular expressions and load into Impala where it can be further processed. - Managed and scheduled ingestion process for ETL pipelines using Airflow. - Deployed custom configured Cloudera clusters with Amazon EC2 on AWS. - Optimized clusters by optimizing YARN configurations - Implemented scripts to backup/restore cluster to amazon S3 using DistCp - Devised ways to separate compute and storage for replacing HDFS for Hive/Impala with Amazon S3. - Configured ways to store Hive meta-store and Sentry security configuration on a remote database instance to support separation of compute and storage. - Created build pipelines using Jenkins scripts. - Configured S3 to be used as maven repository vastly improving build and deploy times.
Big Data Engineer Intern
Clairvoyant•  January 2016 - May 2016
[Technology Used: Apache Hadoop, Apache Spark, Apache Sqoop, Apache Hive, Hue, Apache Kafka, Map Reduce, Oozie, Hadoop Distributed File System, Cloudera Manager, Apache Pig, YARN, Cloudera Impala] •Migrated Microsoft T-SQL queries to Apache Hive queries. •Exported Hive databases as targeted exports and bulk exports to SQL databases using Sqoop scripts. •Parsed text files using map reduce jobs to populate Hive tables. •Scheduled jobs using oozie manager.
Software Developer Intern
Epifinder•  May 2015 - December 2015
Epifinder Inc., Scottsdale, Arizona, USA [Technology Used: Spring Framework, Java Beans, MVC, MYSQL, Hibernate, Apache Tomcat Server, JBoss EWS 2.0, jQuery, Bootstrap, Spring STS, UML, Maven, GIT, Java Server Pages (JSP)] • Performed optimizations in MYSQL query by reducing number of natural joins, thus improving retrieval time to 1/5th of the initial retrieval time. • Improved company’s proprietary algorithm’s running time by 10 %. This was done in a 2-week delivery deadline. • Designed Webpages using Bootstrap framework and JQuery • Used Spring MVC for the backend controller architecture.
Education
Arizona State University, Tempe
Computer Science, MS•  2014 - 2016
Links
Skills
pbsureja has not updated skills details yet.