Senior Data Engineer: Big Data, Spark & Data Platforms

Ookla; España; Presencial; EUR 70.000 - 90.000; Jornada completa

Descripción de la vacante

Ookla, an Accenture company, is seeking a Senior Data Engineer to join the Data Engineering team and help process the world's best collection of data on mobile and fixed internet performance. You will build tools, libraries and pipelines to support data scientists and analysts across platforms like Spark, Redshift, and Airflow.

You should have a strong data-focused programming background and be passionate about accuracy and performance, with a willingness to mentor teammates while delivering

Formación

• Bachelor's degree in Computer Science or related field or equivalent experience
• Strong understanding of programming concepts with experience in at least 1 OOP language (Python, Scala, Java)
• Strong background and 6+ years of direct experience working with Python
• Experience with high volume distributed data processing in Spark
• Strong working knowledge of SQL, databases (MySQL / Redshift / Athena / Trino), data modeling, and modern data warehouse (lakehouse) management
• Excellent troubleshooting and analysis skills
• Excited to learn and work with new technologies in a dynamic environment
• Strong communication skills both in person and via virtual mediums
• Strong time management skills and a self driven work ethic
• Experience with AWS cloud services is a plus
• Experience with event driven architecture and streaming data pipelines is a plus
• Background check required

Responsabilidades

• Develop high volume data processing jobs across various platforms including Redshift, Athena, Iceberg, Spark and Airflow
• Work closely with Data Scientists to turn theory and methodology into viable products
• Identify bottlenecks in system performance and make recommendations on improving process efficiency
• Support and collaborate with data scientists, analysts, and product managers
• You are enthusiastic about mentoring and guiding junior team members, helping them understand architectural principles, best practices, and effective ways of working.

Conocimientos

Python

Spark

SQL

AWS

Data processing

OOP concepts

Communication

Educación

Bachelor's degree in Computer Science or related field

Herramientas

Redshift

Athena

Iceberg

Spark

Airflow

Descripción del empleo

Ookla, an Accenture company, is seeking a Senior Data Engineer to join the Data Engineering team and help process the world's best collection of data on mobile and fixed internet performance. You will build tools, libraries and pipelines to support data scientists and analysts across platforms like Spark, Redshift, and Airflow.

You should have a strong data-focused programming background and be passionate about accuracy and performance, with a willingness to mentor teammates while delivering