Ganesh Darshan U

Cloud Associate

Niveus Solutions•  April 2022 - Present•  Bangalore

Led data migration efforts from various sources, including SAP and MongoDB, to destinations like Google BigQuery and PostgreSQL for improved performance and analysis. Ingested data from diverse sources into BigQuery and Google Cloud Storage using Cloud Data Fusion and other tools, performed ETL operations, and scheduled data pipelines using Cloud Composer. Utilized Cloud Data Fusion and Fivetran for ingestion, while monitoring and scheduling pipelines through Cloud Composer with Python-based DAGs. Actively involved in quality assurance, performing data validation, duplicate checks, null checks, and query testing.