Data Engineering Lead

buscojobs España; Santa Cruz de Tenerife; Presencial; EUR 50.000 - 80.000; Jornada completa

Descripción de la vacante

A leading company is seeking a Data Engineering Lead to drive the development of scalable data systems that support real-time analytics. In this role, you will guide a team of engineers and ensure the implementation of best practices in data processing, focusing on both cloud and on-premise solutions.

Formación

• 5+ years in data engineering with Python, Scala, or Java.
• Experience with relational and analytical databases.
• Hands-on experience with cloud platforms and on-premise environments.

Responsabilidades

• Design and lead the implementation of scalable data pipelines with a focus on stream processing (Kafka).
• Lead and mentor a team of engineers; define roadmap, ensure quality, and promote collaboration.
• Collaborate with cross-functional teams to gather data requirements and align on architecture and goals.

Conocimientos

Data Engineering

Python

Scala

Java

Communication

Leadership

Educación

B2 level of English proficiency

Herramientas

PostgreSQL

MySQL

ClickHouse

Redis

Kafka

Flink

RabbitMQ

Grafana

Superset

Descripción del empleo

To lead the development of scalable, reliable data systems that support real-time analytics and high-throughput data processing, as a Data Engineering Lead. You will architect and guide the implementation of hybrid data solutions that bridge

on-premise infrastructure and cloud platforms

(preferably AWS). You will lead a team of skilled data engineers, drive the adoption of best practices in stream processing, and work closely with architecture, product, and software engineering teams to align technical solutions with business needs.

Key Responsibilities

1. Design and lead the implementation of scalable data pipelines with a focus on stream processing (Kafka).
2. Guide the migration between cloud and on-premise infrastructure, optimizing for cost and performance.
3. Lead and mentor a team of engineers; define roadmap, ensure quality, and promote collaboration.
4. Implement and maintain high-performance data storage and processing solutions using tools such as ClickHouse, Redis, and Kafka.
5. Ensure system reliability, data consistency, and at least once delivery guarantees in streaming architecture.
6. Evaluate emerging tools like Flink, Superset, Cube.js, and Grafana for integration and optimization.
7. Collaborate with cross-functional teams to gather data requirements and align on architecture and goals.
8. Stay informed about trends in data engineering and apply innovation to continually improve infrastructure.

Required Skills

• 5+ years in data engineering with Python, Scala, or Java.
• Production experience with relational and analytical databases (e.g., PostgreSQL, MySQL, ClickHouse).
• Hands-on experience with cloud platforms and on-premise environments.
• Familiarity with Flink, Redis, RabbitMQ, and data visualization tools (Grafana, Superset) is a plus.
• Strong communication and leadership skills.
• Experience in [additional relevant experience] is a plus.
• At least B2 level of English proficiency.