Senior Data Engineer – GCP & BigQuery Pipelines

Affinity; Portugal; Híbrido; EUR 70 000 - 110 000; Tempo integral

Resumo da oferta

Affinity seeks a Senior Data Engineer to help evolve a modern cloud data platform on Google Cloud Platform. You will design scalable ETL/ELT pipelines, lead migrations from SQL Server to BigQuery, and build robust data workflows with Cloud Composer.

The role emphasizes advanced SQL skills, data modeling, and proactive collaboration with analysts, business stakeholders, and engineers in a hybrid Lisbon/Porto environment.

Qualificações

• Extensive experience with Google Cloud Platform (GCP).
• Advanced BigQuery performance optimization and data modeling.
• Experience with Cloud Composer (Airflow).
• Advanced SQL skills.
• Experience delivering data migration projects and modern data platforms.

Responsabilidades

• Design and develop scalable ETL/ELT pipelines on GCP.
• Lead data migration initiatives from SQL Server to BigQuery.
• Build and orchestrate data workflows using Cloud Composer.
• Develop automation and data transformation solutions using Python.
• Optimize BigQuery performance, data models, and cloud costs.
• Ensure data quality, reliability, and operational excellence.
• Collaborate with business stakeholders, analysts, and engineering teams to deliver high-quality data solutions.

Conhecimentos

Google Cloud Platform

BigQuery

Cloud Composer (Airflow)

SQL

Data migration

Ferramentas

Airflow

Descrição da oferta de emprego

Affinity seeks a Senior Data Engineer to help evolve a modern cloud data platform on Google Cloud Platform. You will design scalable ETL/ELT pipelines, lead migrations from SQL Server to BigQuery, and build robust data workflows with Cloud Composer.

The role emphasizes advanced SQL skills, data modeling, and proactive collaboration with analysts, business stakeholders, and engineers in a hybrid Lisbon/Porto environment.