Badges
Certifications
Work Experience
senior data engineer
Moa Digital Works logo Senior Data Engineer• March 2023 - Present
Web scrapping- APIfy tiktok, YouTube, instagram and Facebook actors Big data facebook ads from Meta Graph ETL for Instagram and Facebook Graph API (Social Network BigData) Data Architecture Design: User, post, comments, replies and insights from big data collections Facebook: Meta for developers API AWS Lambda AWS CloudWatch Events AWS kinesis streaming AWS Glue AWS Redshift Amazon Eventbridge AWS S3 (Data storage) AWS DynamoBD AWS API Gateway AWS Identity and Access Management (IAM) Azure Databricks Notebooks (R, Scala, Python, SQL porgramming / job scheduler) MongoDB: NoSQL, documents and collections for Big Data models Python: Pandas, NumPy, TensorFlow, PyTorch, scikit-learn SQL for Big Data (Snowflake schemas) PostgreSQL MySQL Kubernetes MongoDB Atlas Azure Data Factory GitHub Atlassian JIRA
Senior BI Data Engineer Developer
Global Business IT Corp• June 2022 - May 2023
Copa Airlines Flight Reaccomm Project: Azure: DataBricks, DataFactory, Datalakes, Synapse, SQL, Cosmos DB PySpark API df from parquets databricks ETL from Snowflake schemas DWH (Facts and Dimension Tables) Azure DevOps Python, SQL, R, Scala notebooks Julia programming Teradata SQL DWH PostgreSQL Snowflake: Big Data sets manipulation Django API project Docker containers Mongo DB: options flights API request module Alteryx Data Flow. GitHub.Copa Airlines Flight Reaccomm Project: Azure: DataBricks, DataFactory, Datalakes, Synapse, SQL, Cosmos DB PySpark API df from parquets databricks ETL from Snowflake schemas DWH (Facts and Dimension Tables) Azure DevOps Python, SQL, R, Scala notebooks Julia programming Teradata SQL DWH PostgreSQL Snowflake: Big Data sets manipulation Django API project Docker containers Mongo DB: options flights API request module Alteryx Data Flow. GitHub. Skills: Julia (Programming Language) · MySQL · Django REST Framework · MongoDB · PostgreSQL · Django · Python · Microsoft Power BI · Teradata SQL · Microsoft Azure · SQL Azure · Azure Databricks · Python (Programming Language) · SQLite
Senior Lead Data Migration Consultant
Inchcape• December 2021 - February 2023
Team leader: * Azure: DataBricks, DataFactory, Datalakes, Synapse, SQL * PySpark Parquets API * Hands-on PYFRC module for master tables manipulation. *SCRUM - kanban agile Big Data Migration projects. *SQL command editor SAP *Jupyter Visual Studio Code - Hands-on Python. *ETL from Snowflake schemas DWH (Facts and Dimension Tables) queries desing. *BI analysis and Master Data Migration Workbench SAP *Cloud services Hana and Azure Databricks SQL integration. *Pandas, Numpy, Scikit-learn, Tkinter, Matplotlib, selenium SQL reporting automation with python dataframes. *KPI performance and Data visualization with *Power BI Dashboards DAX and Python Matplotlib. *Data cleaning and analysis with Jupyter python and visual studio code scripting with notebooks from Data warehouse ETLs. *ABAP Programming SAP automation. *VBA programming automation.Team leader: * Azure: DataBricks, DataFactory, Datalakes, Synapse, SQL * PySpark Parquets API * Hands-on PYFRC module for master tables manipulation. *SCRUM - kanban agile Big Data Migration projects. *SQL command editor SAP *Jupyter Visual Studio Code - Hands-on Python. *ETL from Snowflake schemas DWH (Facts and Dimension Tables) queries desing. *BI analysis and Master Data Migration Workbench SAP *Cloud services Hana and Azure Databricks SQL integration. *Pandas, Numpy, Scikit-learn, Tkinter, Matplotlib, selenium SQL reporting automation with python dataframes. *KPI performance and Data visualization with *Power BI Dashboards DAX and Python Matplotlib. *Data cleaning and analysis with Jupyter python and visual studio code scripting with notebooks from Data warehouse ETLs. *ABAP Programming SAP automation. *VBA programming automation. Skills: Django REST Framework · PostgreSQL · Python · SQL · SAP BW · Microsoft Power BI · SAP HANA · Teradata SQL · Microsoft Azure · spark · SQL Azure · Azure Databricks · Pandas (Software) · NumPy · Google Data Studio · SAP ERP
Business Intelligence Analyst
sura• July 2021 - December 2021
o Azure: DataBricks, Datalakes, DataFactory o Pyspark API parquets CVS json o Diagnostic customer analysis o Star, Snowflake and Constellation schema models from DWH teradata. o Automation with executable Python Bots - Pyinstaller. o Google Data Studio KPI and Data visualization. o Microsoft Azure Databricks - Spark o Dashboards on webapps with Plotly and Dash - Python o Descriptive statistical analysis with R and Py o Machine learning py: sklearn, Numpy, pandas, matplotlib, sqlalchemy, tkinter. o Py, R and VBA task automation o Data warehouse from Teradata SQL o KPI and dashboards projects in service sales o Clustering Customers from Microstrategy SINCO o Power BI, Power Query - DAX o ETL and CRUD BigData. o Remote support to transversal departments with just time queries.o Azure: DataBricks, Datalakes, DataFactory o Pyspark API parquets CVS json o Diagnostic customer analysis o Star, Snowflake and Constellation schema models from DWH teradata. o Automation with executable Python Bots - Pyinstaller. o Google Data Studio KPI and Data visualization. o Microsoft Azure Databricks - Spark o Dashboards on webapps with Plotly and Dash - Python o Descriptive statistical analysis with R and Py o Machine learning py: sklearn, Numpy, pandas, matplotlib, sqlalchemy, tkinter. o Py, R and VBA task automation o Data warehouse from Teradata SQL o KPI and dashboards projects in service sales o Clustering Customers from Microstrategy SINCO o Power BI, Power Query - DAX o ETL and CRUD BigData. o Remote support to transversal departments with just time queries. Skills: MySQL · Python · SAP BW · Microsoft Power BI · Microsoft Power Query · DAX · Teradata SQL · Microsoft Azure · spark · Azure Databricks · Pandas (Software) · NumPy · Tableau · SAP ERP
Taxes Information Systems Assistant
sura• July 2019 - July 2021
o Azure: DataBricks, Datalakes o Agile and lean methodologies SCRUM-Kanban Atlassian JIRA. o Data Warehouse DWH ETL from SAP-BW HANA (Abap). o Taxes Report Automation: Python, SQL, VBA, VBScript, Pulover’s, Microsoft PowerApps. o KPI Dashboards: Power Query, Power BI-DAX, Mycrostragies, Flourish, Access-SQL, Pivot tables & UI Forms. o Big Data & BI with Selenium, pandas, numpy, xlswriter, sqlalchemy, scrapy, tkinter, matplotlib pyinstaller. o Web scraping: Python, R, Matlab, VBA, VBS. o Just time report of accounting information to the Taxes Auditor. o Remote support to a team of 60 coworkers.o Azure: DataBricks, Datalakes o Agile and lean methodologies SCRUM-Kanban Atlassian JIRA. o Data Warehouse DWH ETL from SAP-BW HANA (Abap). o Taxes Report Automation: Python, SQL, VBA, VBScript, Pulover’s, Microsoft PowerApps. o KPI Dashboards: Power Query, Power BI-DAX, Mycrostragies, Flourish, Access-SQL, Pivot tables & UI Forms. o Big Data & BI with Selenium, pandas, numpy, xlswriter, sqlalchemy, scrapy, tkinter, matplotlib pyinstaller. o Web scraping: Python, R, Matlab, VBA, VBS. o Just time report of accounting information to the Taxes Auditor. o Remote support to a team of 60 coworkers. Skills: MySQL · Python · SAP BW · Microsoft Power BI · VBScript · Microsoft Power Query · SAP HANA · DAX · SQL Azure · Azure Databricks · SAP ERP · Visual Basic for Applications (VBA)
Business Intelligence Intern
Mazda motors• July 2018 - January 2019
o Daily KPI with VBA reports in Customer experience, marketing and sales o SQL lite Reports. o Analytics and monitoring of sales indicators o KPI Dashboards and Tools for Mazda customer service satisfaction o Relationship with showcases, workshops and warehouse o Tasks Automation VBA Office, Forms, Access SQL, Pivot tables y Dynamic graphs. o QlikView and QlikSense Programmingo Daily KPI with VBA reports in Customer experience, marketing and sales o SQL lite Reports. o Analytics and monitoring of sales indicators o KPI Dashboards and Tools for Mazda customer service satisfaction o Relationship with showcases, workshops and warehouse o Tasks Automation VBA Office, Forms, Access SQL, Pivot tables y Dynamic graphs. o QlikView and QlikSense Programming Skills: SAP BW · VBScript · Bases de datos · SAP HANA · Analítica de datos · Microsoft Azure · QlikView · SQL Azure · Azure Databricks · Python (Programming Language) · Pandas (Software) · SQLite · Tableau · Visual Basic for Applications (VBA)
intern
Ecopetrol• January 2018 - July 2018
o BD management for relations with communities and regional stakeholders. o Collection of primary information for BD- CMR. o Monitoring and reporting of KPIs in social investment projects. o Programming VBA-Office, VBS Out of Office. o CRM Management Salesforce. o Cloud Management: Sharepoint, Google drive, OneDrive.o BD management for relations with communities and regional stakeholders. o Collection of primary information for BD- CMR. o Monitoring and reporting of KPIs in social investment projects. o Programming VBA-Office, VBS Out of Office. o CRM Management Salesforce. o Cloud Management: Sharepoint, Google drive, OneDrive. Skills: MySQL · Python · SQL · Microsoft Power BI · VBScript · Analítica de datos · Visual Basic for Applications (VBA)
Education
Universidad Nacional de Colombia
Indusitral enigeer, BS• July 2014 - February 2019
Links
Skills
heaperezar has not updated skills details yet.