Rafael Noriega

SSr Data Architect

Globant•  January 2021 - July 2022

Participation in the data lake project. - Implementation and design of Apis with Spring Boot, Java and Postgresql. - Data pipeline development with GCP Services (Dataflow, Cloud Composer, Dataproc, Dataprep, DataFusion, BigQuery, Cloud Storage). - Participation in cloud foundations. - Participation in the design of data architectures.- Participation in the data lake project. - Implementation and design of Apis with Spring Boot, Java and Postgresql. - Data pipeline development with GCP Services (Dataflow, Cloud Composer, Dataproc, Dataprep, DataFusion, BigQuery, Cloud Storage). - Participation in cloud foundations. - Participation in the design of data architectures.… ver más Aptitudes: Big Data Analytics · Apache Spark Streaming · Hadoop · Apache Spark · Airflow · Apache Beam · Apache Airflow · Big data · Google Cloud

Sr Data Engineer

Arauco•  September 2019 - January 2021

Participation in the data lake project. - Creation of Dag and Data Pipeline Airflow Apache Beam and Hadoop. - Migration and implementation of Dag from Airflow to Composer. - Migration and implementation of Sqoop Job from Hadoop to Dataproc. - Creating jobs in Dataflow - Use of Apache Kafka cluster for data ingestion from different sensors in different the company's plants. - Use of Cloud Pubsub to receive streaming data from different sources. - Use of Bigtable to store sensor data from the company's different production plants production plants of the company.- Participation in the data lake project. - Creation of Dag and Data Pipeline Airflow Apache Beam and Hadoop. - Migration and implementation of Dag from Airflow to Composer. - Migration and implementation of Sqoop Job from Hadoop to Dataproc. - Creating jobs in Dataflow - Use of Apache Kafka cluster for data ingestion from different sensors in different the company's plants. - Use of Cloud Pubsub to receive streaming data from different sources. - Use of Bigtable to store sensor data from the company's different production plants production plants of the company. Aptitudes: Big Data Analytics · Apache Spark Streaming · Hadoop · Apache Spark · Airflow · Apache Kafka · Dataproc · Google BigQuery · Bigtable · Apache Beam · Apache Airflow · Google Cloud

Big Data Engineer

Tigabytes•  October 2018 - August 2019

Participation in a project for a telephone company using Google's Dialogflow service. - Development of Google Cloud Functions to load sentences and phrases into Dialogflow. - Participation in a project for a Cellulose company, with the role of Data - Engineer for data ingestion from different sources. - Data Pipeline development with Dataflow and Dataproc GCP services. - Report generation with BigQuery and Data Studio. - Report creation with javascript and nodejs.- Participation in a project for a telephone company using Google's Dialogflow service. - Development of Google Cloud Functions to load sentences and phrases into Dialogflow. - Participation in a project for a Cellulose company, with the role of Data - Engineer for data ingestion from different sources. - Data Pipeline development with Dataflow and Dataproc GCP services. - Report generation with BigQuery and Data Studio. - Report creation with javascript and nodejs. Aptitudes: Nodejs · Google Cloud · JavaScript · Angular

Software Engineer

NTT Data•  November 2017 - October 2018

- Developer in java technologies(Spring Boot), nodejs, Angular 6 and Oracle 11g database. - Micro Services development. - Deployment of services in azure cloud.

Software Engineer

WiseSolutions•  November 2016 - November 2017

- Development of Apps for Android / IOS based on Ionic 3 / Angular 4. - Analysis and Development of Modules according to client's requirements, using PHP with Codeignaiter - PHP technology with Codeignaiter, Jquery / Javascript CSS / HTML and Mysql as. Database - Report creation with Mysql and Datatables. - Publication of the App on Android and IOS Store.

Software Engineer

Vhicoa•  May 2015 - November 2016

- Analysis, Design, Development and Implementation of Customized Modules using Java (GWT Framework), Sql Server, PHP. - Report Design with JasperReports - ERP Strumis Management - Creation or Modification of Stored Procedures, functions or Trigger in SQL Server according to the requirements of the Modules.

UNEG (Venezuela)

Computer Information Systems, MS•  March 2008 - November 2014

Graduated as a Computer engineer.