Senior Data Engineer: Cloud Data Pipelines for AI (Hybrid)

Aubay Portugal; Lisboa; Hybrid; EUR 65,000 - 95,000; Full time

Benefits offered by this job

Health insurance

Training academy

Mental health platform

Team events

Language platform

Hybrid work model

Job summary

Aubay Portugal is seeking a Senior Data Engineer to design, build and maintain scalable data platforms in cloud environments, ensuring data quality, security and resilience. You will design and optimize end-to-end data pipelines across sources, applying modern architectures like Data Lakes, Lakehouses and Data Warehouses.

Join a collaborative team, contribute to DataOps practices with Git, CI/CD, Terraform and Docker, and support AI/GenAI initiatives.

Qualifications

• At Aubay, at least 7 years of Senior Data Engineer experience with large-scale data pipelines.
• Proficient with Google Cloud Platform services including BigQuery, Dataflow, Dataproc and Pub/Sub.
• Strong SQL and data modelling skills; programming in Python or Scala.
• Experience with distributed processing frameworks like Apache Spark or Databricks; batch and streaming architectures.
• Familiarity with DataOps practices: Git, CI/CD pipelines, Infrastructure as Code (Terraform), and containerization (Docker).
• Fluency in English (B2 or higher) and legal authorization to work in Portugal.

Responsibilities

• Design, develop, and maintain scalable data platforms in cloud environments.
• Build and optimize robust batch and real-time data pipelines across data sources and systems.
• Implement modern architectures such as Data Lakes, Lakehouses, and Data Warehouses.
• Ensure high data quality, reliability, and security; contribute to governance and compliance.
• Support AI and Advanced Analytics by preparing and optimizing datasets for ML/GenAI.

Skills

Senior Data Engineer experience

GCP expertise (BigQuery, Dataflow, Dat

SQL & data modeling

Python/Scala

Spark/Databricks

DataOps (Git, CI/CD, IaC)

English (B2+)

Work authorization Portugal

Tools

BigQuery

Dataflow

Dataproc

Pub/Sub

Spark

Databricks

Docker

Terraform

Git

Job description

Aubay Portugal is seeking a Senior Data Engineer to design, build and maintain scalable data platforms in cloud environments, ensuring data quality, security and resilience. You will design and optimize end-to-end data pipelines across sources, applying modern architectures like Data Lakes, Lakehouses and Data Warehouses.

Join a collaborative team, contribute to DataOps practices with Git, CI/CD, Terraform and Docker, and support AI/GenAI initiatives.