Data Engineer GCP

Affinity; Portugal; Híbrido; EUR 70 000 - 110 000; Tempo integral

Resumo da oferta

Affinity seeks a Senior Data Engineer to help evolve a modern cloud data platform on Google Cloud Platform. You will design scalable ETL/ELT pipelines, lead migrations from SQL Server to BigQuery, and build robust data workflows with Cloud Composer.

The role emphasizes advanced SQL skills, data modeling, and proactive collaboration with analysts, business stakeholders, and engineers in a hybrid Lisbon/Porto environment.

Qualificações

• Extensive experience with Google Cloud Platform (GCP).
• Advanced BigQuery performance optimization and data modeling.
• Experience with Cloud Composer (Airflow).
• Advanced SQL skills.
• Experience delivering data migration projects and modern data platforms.

Responsabilidades

• Design and develop scalable ETL/ELT pipelines on GCP.
• Lead data migration initiatives from SQL Server to BigQuery.
• Build and orchestrate data workflows using Cloud Composer.
• Develop automation and data transformation solutions using Python.
• Optimize BigQuery performance, data models, and cloud costs.
• Ensure data quality, reliability, and operational excellence.
• Collaborate with business stakeholders, analysts, and engineering teams to deliver high-quality data solutions.

Conhecimentos

Google Cloud Platform

BigQuery

Cloud Composer (Airflow)

SQL

Data migration

Ferramentas

Airflow

Descrição da oferta de emprego

We are looking for a Senior Data Engineer to join an international team driving the evolution of a modern cloud data platform on Google Cloud Platform (GCP).

This role is ideal for professionals who enjoy working on large-scale data environments, designing robust data solutions, and leading complex migration initiatives.

Key responsibilities:

• Design and develop scalable ETL/ELT pipelines on GCP.
• Lead data migration initiatives from SQL Server to BigQuery.
• Build and orchestrate data workflows using Cloud Composer.
• Develop automation and data transformation solutions using Python.
• Optimize BigQuery performance, data models, and cloud costs.
• Ensure data quality, reliability, and operational excellence.
• Collaborate with business stakeholders, analysts, and engineering teams to deliver high-quality data solutions.

Required expertise:

• Strong experience with Google Cloud Platform (GCP).
• Advanced knowledge of BigQuery, including performance optimization and data modeling.
• Experience with Cloud Composer (Airflow).
• Advanced SQL knowledge.
• Experience delivering data migration projects and modern data platforms.

What we're looking for:

• Strong analytical and problem-solving skills.
• Autonomous and proactive mindset.
• Excellent communication and collaboration abilities.
• Curiosity for new technologies and continuous improvement.

Location:

• Lisbon or Porto
• Hybrid working model (2 times a week in office)