Senior Data Engineer — Big Data, Spark & Python

Human Ventures, LLC.; España; Presencial; EUR 70.000 - 110.000; Jornada completa

Descripción de la vacante

Ookla is seeking a Senior Data Engineer to join the Data Engineering team and help process the world's best data on internet performance. You will develop tools and pipelines to support data scientists and analysts, using Spark, Redshift, Athena, Iceberg and Airflow in a fast-paced environment.

You will collaborate across data science, analytics and product management, identify bottlenecks, and mentor junior engineers on architecture and best practices while learning new technologies.

Formación

• Bachelor's degree in CS or related field or equivalent experience.
• 6+ years with Python in data engineering.
• Experience with high-volume distributed data processing in Spark.
• Strong SQL and data warehouse (lakehouse) knowledge (Redshift/Athena/Trino).
• Experience with AWS cloud services is a plus.
• Excellent troubleshooting and communication skills.
• Background check required.

Responsabilidades

• Develop high-volume data processing jobs across platforms (Redshift, Athena, Iceberg, Spark, Airflow).
• Collaborate with data scientists to turn theory into viable products.
• Identify bottlenecks in system performance and improve efficiency.
• Support data scientists, analysts, and product managers.
• Mentor junior team members on architectural principles and best practices.

Conocimientos

Python

SQL

Spark

Data modeling

AWS

Communication

Time management

Mentoring

Educación

Bachelor's degree in Computer Science or related field

Herramientas

Spark

Redshift

Athena

Trino

Iceberg

Airflow

MySQL

Descripción del empleo

Ookla is seeking a Senior Data Engineer to join the Data Engineering team and help process the world's best data on internet performance. You will develop tools and pipelines to support data scientists and analysts, using Spark, Redshift, Athena, Iceberg and Airflow in a fast-paced environment.

You will collaborate across data science, analytics and product management, identify bottlenecks, and mentor junior engineers on architecture and best practices while learning new technologies.