Senior Data Engineer - Lead Scalable Data Pipelines & Team

Yonderland; Porto; Híbrido; EUR 65 000 - 110 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health insurance

26 days vacation

Hybrid work model (2 days in office, 3

Professional development

Resumo da oferta

Yonderland in Porto is seeking a Senior Data Engineer to build the core of our data platform. You will own ingestion, processing and transformation end to end, and lead the Data Engineering team, with a focus on reliable pipelines, tested datasets and a semantic layer for analytics and reporting.

The role involves collaborating with Power BI specialists, scaling with Spark or Flink, and stewarding infrastructure as code on AWS.

Qualificações

• Senior data engineering experience on platforms running at high volume in production.
• Experience leading or mentoring engineers and setting the standard for a team's output.
• A software engineering background alongside analytics and data delivery experience.
• Hands‑on experience building and running data workloads on AWS.
• Production‑level Python and at least one other language, with code that is tested, reviewed and deployed through a pipeline.
• Experience with a high‑volume parallel processing engine such as Spark or Flink, including performance tuning at scale.
• Terraform experience is required, since the role owns the infrastructure, its pipelines run on.
• Experience with integration and ingestion patterns - APIs, events, streaming and change data capture from operational systems.
• Strong SQL and dimensional modelling, dbt in production, a cloud warehouse (Snowflake preferred), and orchestration in Airflow or equivalent.
• A disciplined engineering practice: Git‑based workflow, CI/CD and automated testing.

Responsabilidades

• Own ingestion, processing and transformation end to end, maintaining pipelines as software with version control, testing and deployment.
• Engineer for scale, using distributed and parallel processing where it's needed and streaming ingestion where the use case calls for it.
• Own the infrastructure the pipelines run on, managed as code, deployed and monitored.
• Deliver documented, tested datasets and the semantic layer that analytics and reporting consume.
• Work with Power BI specialists and analysts so data models match how the business consumes them.
• Model data for reuse, shaped around how the business uses it, so more than one consumer can build on it.
• Lead the Data Engineering team day to day - direction, code review, prioritization and mentoring.
• Hold the team to standards for testing, modelling, deployment and infrastructure conventions through code review.
• Build to the architecture and standards the architects set, and feedback where they need to change in practice.
• Partner with operations and integration teams on how source data reaches the platform, including streaming and change data capture.

Conhecimentos

Data engineering

Leadership

Python

AWS

Spark/Flink

Terraform

SQL/dbt

Snowflake

Airflow

CI/CD

Testing

APIs/Streaming

Ferramentas

dbt

Snowflake

Airflow

Git

Kafka

Kinesis

Descrição da oferta de emprego

Yonderland in Porto is seeking a Senior Data Engineer to build the core of our data platform. You will own ingestion, processing and transformation end to end, and lead the Data Engineering team, with a focus on reliable pipelines, tested datasets and a semantic layer for analytics and reporting.

The role involves collaborating with Power BI specialists, scaling with Spark or Flink, and stewarding infrastructure as code on AWS.