Senior Data Engineer — Big Data, Spark & Cloud

Ziff Davis, LLC; United Kingdom; On-site; GBP 50,000 - 56,000; Full time

Job summary

Ookla, an Accenture company, is seeking a Senior Data Engineer to join the Data Engineering team and help process the world’s best collection of internet performance data. You will develop tools, libraries and operations to support data scientists and analysts as they discover new and exciting ways to apply our data.

You will work on big data using the latest technologies, including Spark, Redshift, Athena and Airflow, while collaborating with data scientists to turn theory into viable products

Qualifications

• Bachelor's degree in Computer Science or related field or equivalent experience
• Strong understanding of programming concepts with experience in at least 1 OOP language (Python, Scala, Java)
• Strong background and 3+ years of direct experience working with Python
• Experience with high volume distributed data processing in Spark
• Strong working knowledge of SQL, databases (MySQL / Redshift / Athena / Trino), data modeling, and modern data warehouse (lakehouse) management
• Excellent troubleshooting and analysis skills
• Excited to learn and work with new technologies in a dynamic environment
• Strong communication skills both in person and via virtual mediums
• Strong time management skills and a self driven work ethic
• Experience with AWS cloud services is a plus
• Experience with event driven architecture and streaming data pipelines is a plus
• Background check required

Responsibilities

• Develop high volume data processing jobs across various platforms including Redshift, Athena, Iceberg, Spark and Airflow
• Work closely with Data Scientists to turn theory and methodology into viable products
• Identify bottlenecks in system performance and make recommendations on improving process efficiency
• Support and collaborate with data scientists, analysts, and product managers
• You are enthusiastic about mentoring and guiding junior team members, helping them understand architectural principles, best practices, and effective ways of working.

Skills

Python

Scala

Java

Education

Bachelor's degree in Computer Science or related field

Tools

Spark

Job description

Ookla, an Accenture company, is seeking a Senior Data Engineer to join the Data Engineering team and help process the world’s best collection of internet performance data. You will develop tools, libraries and operations to support data scientists and analysts as they discover new and exciting ways to apply our data.

You will work on big data using the latest technologies, including Spark, Redshift, Athena and Airflow, while collaborating with data scientists to turn theory into viable products