Data Engineer III: Scale Data Pipelines & Mentor Teams

Ziff Davis, LLC; España; Remote; EUR 70,000 - 100,000; Full time

Job summary

Ookla, an Accenture company, is seeking a senior data engineer to build high-volume data processing pipelines across Redshift, Athena, Iceberg, Spark and Airflow. You will collaborate with data scientists, analysts and product managers to translate research into scalable products.

You will identify performance bottlenecks, optimize data models and participate in architectural discussions, mentoring junior engineers while adopting best practices in a fast-moving environment.

Qualifications

• Bachelor's degree in Computer Science or related field or equivalent experience.
• 6+ years of direct Python experience.
• Experience with high-volume distributed data processing using Spark.
• Strong SQL skills and data modeling for lakehouse warehousing.
• Experience with AWS cloud services is a plus.
• Excellent troubleshooting and communication skills.

Responsibilities

• Develop high volume data processing jobs across platforms (Redshift, Athena, Iceberg, Spark, Airflow).
• Collaborate with Data Scientists to turn theory into viable products.
• Identify bottlenecks and recommend performance improvements.
• Support data scientists, analysts, and product managers.
• Mentor and guide junior team members on architectural principles and best practices.

Skills

Python

Spark

SQL

Data modeling

AWS

OOP concepts

Education

Bachelor's degree in Computer Science or related field

Tools

MySQL

Redshift

Athena

Trino

Job description

Ookla, an Accenture company, is seeking a senior data engineer to build high-volume data processing pipelines across Redshift, Athena, Iceberg, Spark and Airflow. You will collaborate with data scientists, analysts and product managers to translate research into scalable products.

You will identify performance bottlenecks, optimize data models and participate in architectural discussions, mentoring junior engineers while adopting best practices in a fast-moving environment.