Data Engineering Lead

buscojobs España; Burgos; Presencial; EUR 50.000 - 80.000; Jornada completa

Descripción de la vacante

A leading company in the technology sector is looking for a Principal Data Engineer to lead the development of robust data systems. You will guide a team to implement scalable solutions that merge cloud and on-premise infrastructures, ensuring high performance and data reliability. The ideal candidate has extensive experience in data engineering, strong technical skills in Python, Scala, or Java, and great leadership qualities. Join us to innovate and shape data solutions that meet the company's strategic goals.

Formación

• 5+ years in data engineering; advanced skills with Python, Scala, or Java.
• Production experience with Apache Kafka is mandatory.
• At least B2 level of English.

Responsabilidades

• Design and implement scalable data pipelines with a focus on stream processing.
• Lead and mentor a team in data engineering best practices.
• Ensure system reliability and data consistency in streaming architecture.

Conocimientos

Data engineering

Python

Scala

Java

Apache Kafka

AWS

Data visualization

Leadership

Communication

English (B2)

Educación

Bachelor's Degree or equivalent

Herramientas

ClickHouse

Redis

Flink

Superset

RabbitMQ

Grafana

Descripción del empleo

We are seeking a Principal Data Engineer to lead the development of scalable, reliable data systems that support real-time analytics and high-throughput data processing. As a Data Engineering Lead, you will architect and guide the implementation of hybrid data solutions that bridge on-premise infrastructure and cloud platforms (preferably AWS).

You will lead a team of skilled data engineers, drive the adoption of best practices in stream processing, and work closely with architecture, product, and software engineering teams to align technical solutions with business needs.

Key Responsibilities

• Design and lead the implementation of scalable data pipelines with a strong focus on stream processing (Kafka) .
• Guide the migration between cloud and on-premise infrastructure , optimizing for cost and performance.
• Lead and mentor a team of engineers; define roadmap, ensure quality, and promote collaboration.
• Implement and maintain high-performance data storage and processing solutions using tools such as ClickHouse , Redis , and Kafka .
• Ensure system reliability , data consistency , and "at least once" delivery guarantees in streaming architecture.
• Evaluate emerging tools like Flink, Superset, Cube.js , and Grafana for integration and optimization.
• Collaborate with cross-functional teams to gather data requirements and align on architecture and goals.
• Stay informed about trends in data engineering and apply innovation to continually improve infrastructure.

Required Skills

• 5+ years in data engineering with Python, Scala, or Java.
• Production experience with Apache Kafka .
• Strong understanding of relational and analytical databases (e.g., PostgreSQL, MySQL, ClickHouse).
• Hands-on experience with AWS or other cloud platforms, and on-premise environments .
• Familiarity with Flink, Redis, RabbitMQ , and data visualization tools ( Grafana, Superset ) is a plus.
• Strong communication and leadership skills.
• Experience in the iGaming industry is a plus.
• At least B2 level of English