Senior Data Engineer: Cloud Data Pipelines & Real-Time

thunes; Barcelona; Presencial; EUR 70.000 - 100.000; Jornada completa

Descripción de la vacante

Thunes is seeking a highly skilled Data Engineer to drive the development and optimization of our data platform in Barcelona. You will design and scale end-to-end data pipelines, manage streaming and batch processing, and ensure data governance and quality across global data products.

Join a fintech environment where you will collaborate with cross-functional teams to translate complex business needs into scalable data models and reporting solutions, while leveraging Python, SQL, Airflow, and

Formación

• Proficient in Python and SQL with strong data engineering background.
• Experience building scalable data pipelines in cloud-native environments.
• Familiarity with streaming architectures and real-time data replication.

Responsabilidades

• Data Platform Engineering: Design, implement, and scale end-to-end data pipelines using Python and SQL-based transformations within a cloud-native data lake environment.
• Infrastructure Orchestration: Manage and scale containerized data workloads and automated workflow orchestration (using tools like Apache Airflow) and Infrastructure as Code (using Terraform) or similar functional equivalents.
• Streaming & Real-time Integration: Maintain and evolve real-time data replication services and stream processing architectures (utilizing Apache Kafka or similar distributed messaging systems) to ensure low-latency data availability.
• Data Quality & Governance: Establish and implement Data Governance frameworks and automated validation protocols to ensure the highest standards of data accuracy, compliance, and platform reliability.
• Business Logic & Data Modeling: Partner with cross-functional stakeholders to interpret complex business requirements and translate them into performant data models for reporting and business intelligence.
• Systems Architecture: Provide technical insights into the continuous improvement of the data platform, ensuring the stack remains resilient and performant as data volumes and complexity increase.

Conocimientos

Python

SQL

Airflow

Terraform

Kafka

Cloud (AWS/GCP)

Data Modeling

Data Governance

Code Quality

Herramientas

Apache Airflow

Terraform

Kafka

SQL-based transformations

Python programming

Descripción del empleo

Thunes is seeking a highly skilled Data Engineer to drive the development and optimization of our data platform in Barcelona. You will design and scale end-to-end data pipelines, manage streaming and batch processing, and ensure data governance and quality across global data products.

Join a fintech environment where you will collaborate with cross-functional teams to translate complex business needs into scalable data models and reporting solutions, while leveraging Python, SQL, Airflow, and