Badges
Certifications
dhaval_ce has not earned any certificates yet.
Work Experience
Software Engineer
emids•  February 2019 - Present
• Understand Braze current data-model to work with the Enterprise architect & solution engineering team to design & review solutions. • Build PySpark data pipeline to ingest AVRO event data to BigQuery Staging tables using BigQuery API • Design configuration based incremental data ingestion strategy to support any new events type without any code changes • Build Infoworks ELT pipeline to support full & Incremental loads, with considering PHI/PII columns are encrypted with Voltage • Integrated custom PySpark code with Infoworks workflow to create ephemeral DataProc cluster • Implement Snowflake configuration framework to load & unload tables & schedule using snowflake Tasks • Wrote complex UNIX/windows scripts to orchestrate Python codes to support IWX integration • Started working on building data curation(semantic) model to support various use case • Needs to setup data pipeline in very short notice • Work with solution engineer to Identify best suited framework after working with Google, CVS security governance team & Snowflake SMEs. • Reached on pros cons using JDBC driver to connect to Snowflake & Pull data v/s push data form Snowflake using Storage integration • Worked closely with DBA team to provision needed access & role base security functional roles. • Perform POC to confirm design is working as expected and performance is as per understanding • Build Snowflake Procedure to configure any table to unload to GCP for ingestion to BigQuery • Use Snowflake Steams to build incremental data movement pipeline
Software Engineer
Syntel•  July 2018 - February 2019
• Building SSIS data pipeline to support current & newly enrolled clients. • Write complex SQL procedures, functions & SQL queries • Collaboration with business and product team to understand data need & setup ETL jobs to send/receive data from the vendor, regularly body • Run Medicare rollover process while open enrollment time
Senior Software Engineer
Infosys Ltd•  August 2010 - July 2018
Worked on various project for a fortune top 10 customer. Worked on Microsoft SQL Server, SSIS, ASP.NET, C#, SQL Server, FAST Search, VB.NET, IBM DB2 & more
Education
Dharmsinh Desai Institute of Technology
Computer Science & Engineering, BE•  August 2004 - May 2008
Links
Skills
dhaval_ce has not updated skills details yet.