Shivani Vaidya

Senior Software Engineer

Io-Tahoe•  December 2018 - Present

● Read and processed data stored on ​AWS using Kafka along with Spark Streaming and Spark SQL ● Participated in ​designing the architecture​ of the core engine ● Wrote RESTful APIs​ in Java using Maven, Spring Boot and Spring Data ● Performed ​HBase CRUD operations​ to store processed data in HBase tables using Java APIs ● Installed and configured Io-tahoe on client systems and troubleshooted and fixed backend errors

Software Engineer

Barclays•  July 2018 - December 2018

● Wrote Java application to ​Sqoop data from Oracle to HDFS in Avro format​ based on the config files ● Created partitions​ to store large amount of data into Hive tables and wrote HiveQL and UDFs ● Generated reports using Spark ​with Scala to perform transformations and actions on dataframes and pair RDDs along with Spark SQL to analyze data in Cassandra

Software Engineer

Open Networking Foundation•  March 2017 - December 2017

● Designed in place upgrade protocol for network OS allowing zero downtime upgrades ● Built scalable and queryable logger for data center product allowing real time anomaly detection ● Converted existing Java REST services to gRPC​ and HTTP/2 resulting in significant performance gains because of smaller payloads and bi-directional streaming