Senior Data Engineer: Big Data Pipelines & Analytics

Ziff Davis, LLC; Spain (TX); Hybrid; USD 81,000 - 90,000; Full time

Job summary

Ookla, an Accenture company, seeks a Senior Data Engineer to join the Data Engineering team and help process the world’s best collection of data on mobile and fixed internet performance. You will develop tools, libraries and operations to support data scientists and analysts, focusing on accuracy and performance.

You will work on big data using the latest technologies, with a flexible work environment that values individuality, collaboration, and talent.

Qualifications

• Bachelor's degree in Computer Science or related field or equivalent experience.
• Strong understanding of programming concepts with experience in at least 1 OOP language (Python, Scala, Java).
• 3+ years of direct experience working with Python.
• Experience with high volume distributed data processing in Spark.
• Strong working knowledge of SQL, databases (MySQL / Redshift / Athena / Trino), data modeling, and modern data warehouse (lakehouse) management.
• Excellent troubleshooting and analysis skills.
• Excited to learn and work with new technologies in a dynamic environment.
• Strong communication skills both in person and via virtual mediums.

Responsibilities

• Develop high volume data processing jobs across platforms including Redshift, Athena, Iceberg, Spark and Airflow.
• Collaborate with Data Scientists to turn theory into viable products.
• Identify bottlenecks in system performance and improve processing efficiency.
• Support and collaborate with data scientists, analysts, and product managers.
• Mentor and guide junior team members on architectural principles and best practices.

Skills

Python

SQL

Data modeling

Distributed processing

OOP concepts

Communication

Education

Bachelor's degree in Computer Science or related field

Tools

Spark

Redshift

Athena

Trino

Airflow

MySQL

AWS

Job description

Ookla, an Accenture company, seeks a Senior Data Engineer to join the Data Engineering team and help process the world’s best collection of data on mobile and fixed internet performance. You will develop tools, libraries and operations to support data scientists and analysts, focusing on accuracy and performance.

You will work on big data using the latest technologies, with a flexible work environment that values individuality, collaboration, and talent.