Data Engineer II — Scalable Data Pipelines & Spark

Ziff Davis; Málaga; Presencial; EUR 70.000 - 78.000; Jornada completa

Descripción de la vacante

Ookla, an Accenture company, seeks a Senior Data Engineer to join the Data Engineering team in Málaga, Spain, to develop tools, libraries, and operations supporting data scientists and analysts working with large-scale internet performance data.

You will build and optimize data processing pipelines across Redshift, Spark, and related platforms, mentor junior engineers, and collaborate with product managers to deliver robust data products.

Formación

• Bachelor's degree in Computer Science or related field or equivalent experience.
• Strong understanding of programming concepts with experience in at least 1 OOP language (Python, Scala, Java).
• Strong background and 3+ years of direct experience working with Python.
• Experience with high volume distributed data processing in Spark.
• Strong working knowledge of SQL, databases (MySQL / Redshift / Athena / Trino), data modeling, and modern data warehouse (lakehouse) management.
• Excellent troubleshooting and analysis skills.
• Excited to learn and work with new technologies in a dynamic environment.
• Strong communication skills both in person and via virtual mediums.
• Strong time management skills and a self driven work ethic.
• Experience with AWS cloud services is a plus.
• Experience with event driven architecture and streaming data pipelines is a plus.
• Background check required.

Responsabilidades

• Develop high volume data processing jobs across various platforms including Redshift, Athena, Iceberg, Spark and Airflow
• Work closely with Data Scientists to turn theory and methodology into viable products
• Identify bottlenecks in system performance and make recommendations on improving process efficiency
• Support and collaborate with data scientists, analysts, and product managers
• You are enthusiastic about mentoring and guiding junior team members, helping them understand architectural principles, best practices, and effective ways of working.

Conocimientos

Python

Spark

SQL

Data Processing

OOP concepts

AWS

Educación

Bachelor's degree in Computer Science or related field

Herramientas

AWS

Descripción del empleo

Ookla, an Accenture company, seeks a Senior Data Engineer to join the Data Engineering team in Málaga, Spain, to develop tools, libraries, and operations supporting data scientists and analysts working with large-scale internet performance data.

You will build and optimize data processing pipelines across Redshift, Spark, and related platforms, mentor junior engineers, and collaborate with product managers to deliver robust data products.