Senior Data Engineer — Big Data Pipelines & Spark

Ziff Davis, Inc.; Málaga; Hybrid; EUR 60,000 - 90,000; Full time

Benefits offered by this job

Flexible work environment

Mentoring opportunities

Job summary

Ookla, an Accenture company, is seeking a Senior Data Engineer to join the Data Engineering team in Málaga to build scalable data processing systems. You will work on big data using Spark, Redshift, Athena, Iceberg, and Airflow to support data scientists and analysts with robust tooling and libraries.

You’ll mentor juniors and collaborate with product managers while maintaining a focus on accuracy, performance, and evolving data architectures in a flexible work environment.

Qualifications

• Bachelor's degree in Computer Science or related field, or equivalent experience.
• Strong programming concepts with experience in at least one OOP language (Python, Scala, Java).
• 6+ years of direct experience with Python.
• Experience with high-volume distributed data processing in Spark.
• Strong knowledge of SQL, databases (MySQL/Redshift/Athena/Trino) and modern data warehouse management.
• Excellent troubleshooting and analytical skills.
• Interest in learning new technologies in a dynamic environment.

Responsibilities

• Develop high-volume data processing jobs across platforms including Redshift, Athena, Iceberg, Spark and Airflow.
• Work with Data Scientists to turn theory into viable products.
• Identify bottlenecks in system performance and improve efficiency.
• Support and collaborate with data scientists, analysts, and product managers.
• Mentor and guide junior team members on architecture, best practices, and collaboration.

Skills

Python

Spark

SQL

Java

Scala

Airflow

Big Data

Education

Bachelor's degree in Computer Science or related field

Tools

AWS

Iceberg

Trino

Redshift

Athena

Job description

Ookla, an Accenture company, is seeking a Senior Data Engineer to join the Data Engineering team in Málaga to build scalable data processing systems. You will work on big data using Spark, Redshift, Athena, Iceberg, and Airflow to support data scientists and analysts with robust tooling and libraries.

You’ll mentor juniors and collaborate with product managers while maintaining a focus on accuracy, performance, and evolving data architectures in a flexible work environment.