Badges
Certifications
Work Experience
Data Engineer
WillBank•  April 2022 - Present
CRM - Data Engineer My daily activities are related to the support to Customer User Experience area (CXM), building the pipeline integration between the Salesforce Marketing Cloud and the AWS Data Lake. Main Tools and Activities are: - AWS BigData Tools (EMR, Glue, Athena, S3, Lambda, DMS, Kinesis); - Spark Architecture, Redshift and Kafka; - Python, SQL, PySpark Programming; - Salesfoce Marketing Cloud.
Data Engineer
TIM Brasil•  November 2021 - March 2022
Data Engineer with responsabilites for designing and building Google Cloud Data Engineer Platform, project with main goal the migration from on-premisses Hadoop environments to GCP technologies. ETL Spark/PySpark development, support to data scientists team, support to Marketing/Financial teams for data quality and availability, Creation of Azure CI/CD Tools Pipeline. - Google Cloud Platform Data Engineer - Python - BigQuery, BigTable - Cloud DataProc - Filestore, Datastore - Cloud GKE, Cloud Run
Data Engineer
BLU pagamentos•  April 2020 - December 2021
Data Engineer responsible for building, finding trends in company data sets, the main roles are and skills are: - Development of Pipelines in Python, Shell. - Development and Maintenance of Apache Airflow DAGs; - Design, Implementation and Maintenance of Data Engineer infrastructure environment; - Database Development, architecture design of robust database environment; - Data Science and Data Service teams support; - Amazon Web Services Administration and Support; - Data Lake implementation and Development; - Amazon Redshift administration and Support; - Design and Implementation of system integrations; - Linux Administration. Involved Technologies: Apache Nifi, Amazon Athena, Amazon Glue, Python, Apache Airflow, Hadoop, Amazon Redshift, PostgreSQL Database, Amazon RDS, Linux, Blendo, Wevo, Metabase, CI/CD CircleCI, GitHub, Apache Spark, Docker, EC2, S3.
Education
PontifÃcia Universidade Católica do Rio de Janeiro
Data Warehouse, ME•  January 2011 - July 2013
Data Warehouse, Data Mining, Business Inteligence
Universidade do Grande Rio
Computer Information Systems, BS•  January 2005 - July 2009
Information System Degree, Network, Programming, Database.
Links
Skills
anderson_rsanta1 has not updated skills details yet.