Senior Data Engineer – Spark, Airflow & AWS

Fideo Intelligence; Spain (TX); On-site; USD 81,000 - 90,000; Full time

Job summary

Ookla, an Accenture company, is seeking a Senior Data Engineer to join the Data Engineering team and build scalable data processing pipelines supporting data scientists and analysts. You will work with tools like Spark, Redshift, Athena, and Airflow, turning theory into production-ready products.

You will optimize performance, mentor junior engineers, and engage with product managers and stakeholders to deliver impactful insights from large datasets.

Qualifications

• Bachelor's degree in Computer Science or related field or equivalent experience.
• Strong understanding of programming concepts with experience in at least 1 OOP language (Python, Scala, Java).
• 3+ years of direct experience with Python.
• Experience with high volume distributed data processing in Spark.
• Strong working knowledge of SQL, databases (MySQL / Redshift / Athena / Trino), data modeling, and modern data warehouse (lakehouse).
• Excellent troubleshooting and analysis skills.
• Excited to learn and work with new technologies in a dynamic environment.
• Strong communication skills both in person and via virtual mediums.

Responsibilities

• Develop high volume data processing jobs across various platforms including Redshift, Athena, Iceberg, Spark and Airflow.
• Work closely with Data Scientists to turn theory and methodology into viable products.
• Identify bottlenecks in system performance and make recommendations on improving process efficiency.
• Support and collaborate with data scientists, analysts, and product managers.
• Mentor and guide junior team members on architectural principles, best practices, and effective ways of working.

Skills

Python

Scala/Java

SQL

Data modeling

Analytical thinking

Team communication

Education

Bachelor's degree in Computer Science or related field

Tools

Spark

Redshift

Athena

Trino

Airflow

AWS

Job description

Ookla, an Accenture company, is seeking a Senior Data Engineer to join the Data Engineering team and build scalable data processing pipelines supporting data scientists and analysts. You will work with tools like Spark, Redshift, Athena, and Airflow, turning theory into production-ready products.

You will optimize performance, mentor junior engineers, and engage with product managers and stakeholders to deliver impactful insights from large datasets.