Senior Data Engineer - Flexible, Big Data & Spark

Ookla; United Kingdom; On-site; GBP 50,000 - 56,000; Full time

Job summary

Ookla, a global leader in connectivity intelligence, is seeking a Senior Data Engineer to join the Data Engineering team in the United Kingdom. You will build data processing pipelines and tools to support data scientists and analysts, working with Redshift, Spark, Iceberg, and Airflow to handle large-scale data with a focus on accuracy and performance.

You'll collaborate with cross-functional partners, mentor junior engineers, and help shape architecture and best practices in a fast-paced,

Qualifications

• Bachelor's degree or equivalent experience in computer science or related field.
• Proficient in Python and at least one other OOP language (Python, Scala, Java).
• 3+ years direct Python experience and Spark processing.
• Strong SQL skills and experience with data warehousing (Redshift, Athena, Trino, MySQL).
• Excellent troubleshooting, collaboration, and communication.

Responsibilities

• Develop high-volume data processing jobs across Redshift, Athena, Iceberg, Spark and Airflow.
• Collaborate with Data Scientists to turn theory into viable products.
• Identify bottlenecks and improve processing efficiency.
• Support and collaborate with data scientists, analysts, and product managers.
• Mentor and guide junior engineers on architecture and best practices.

Skills

Python

Scala/Java

Communication

Self-driven

Education

Bachelor's degree in Computer Science or related field

Tools

Spark

SQL

MySQL

Redshift

Athena

Trino

Airflow

Job description

Ookla, a global leader in connectivity intelligence, is seeking a Senior Data Engineer to join the Data Engineering team in the United Kingdom. You will build data processing pipelines and tools to support data scientists and analysts, working with Redshift, Spark, Iceberg, and Airflow to handle large-scale data with a focus on accuracy and performance.

You'll collaborate with cross-functional partners, mentor junior engineers, and help shape architecture and best practices in a fast-paced,