Data Engineering Lead

buscojobs España; Málaga; Presencial; EUR 50.000 - 80.000; Jornada completa

Descripción de la vacante

A leading company in data solutions is seeking a Data Engineering Lead to design and implement scalable data systems. This role involves leading a team, optimizing data pipelines, and ensuring system reliability while collaborating with cross-functional teams. Ideal candidates will have extensive experience in data engineering, strong leadership skills, and proficiency in cloud platforms.

Formación

• 5+ years in data engineering with Python, Scala, or Java.
• Production experience with relational and analytical databases.
• At least B2 level of English.

Responsabilidades

• Design and lead the implementation of scalable data pipelines.
• Guide migration between cloud and on-premise infrastructure.
• Lead and mentor a team of engineers.

Conocimientos

Data Engineering

Python

Scala

Java

Cloud Platforms

Stream Processing

Leadership

Communication

Data Visualization

Database Management

Educación

Bachelor's Degree in Computer Science or related field

Herramientas

Kafka

ClickHouse

Redis

Flink

Grafana

Superset

RabbitMQ

Descripción del empleo

To lead the development of scalable, reliable data systems that support real-time analytics and high-throughput data processing. As a Data Engineering Lead, you will architect and guide the implementation of hybrid data solutions that bridge

on-premise infrastructure and cloud platforms

(preferably AWS). You will lead a team of skilled data engineers, drive the adoption of best practices in stream processing, and work closely with architecture, product, and software engineering teams to align technical solutions with business needs.

Key Responsibilities

1. Design and lead the implementation of scalable data pipelines with a strong focus on stream processing (Kafka).
2. Guide the migration between cloud and on-premise infrastructure, optimizing for cost and performance.
3. Lead and mentor a team of engineers; define roadmap, ensure quality, and promote collaboration.
4. Implement and maintain high-performance data storage and processing solutions using tools such as ClickHouse, Redis, and Kafka.
5. Ensure system reliability, data consistency, and at least once delivery guarantees in streaming architecture.
6. Evaluate emerging tools like Flink, Superset, Cube.js, and Grafana for integration and optimization.
7. Collaborate with cross-functional teams to gather data requirements and align on architecture and goals.
8. Stay informed about trends in data engineering and apply innovation to continually improve infrastructure.

Required Skills

• 5+ years in data engineering with Python, Scala, or Java.
• Production experience with relational and analytical databases (e.g., PostgreSQL, MySQL, ClickHouse).
• Hands-on experience with cloud platforms and on-premise environments.
• Familiarity with tools like Flink, Redis, RabbitMQ, and data visualization tools (e.g., Grafana, Superset) is a plus.
• Strong communication and leadership skills.
• Experience in the is a plus.
• At least B2 level of English.