Senior Data Engineer – Big Data & Spark, Python

Fideo Intelligence; España; On-site; EUR 70,000 - 100,000; Full time

Job summary

Ookla, an Accenture company, is seeking a Senior Data Engineer to join its Data Engineering team in Spain. You will develop large-scale data processing jobs across Spark, Redshift, Athena and Airflow, collaborating with data scientists to turn methods into viable products while improving system performance and efficiency.

You will mentor juniors, work with analysts and product managers, and learn new technologies in a dynamic environment that values flexibility and collaboration.

Qualifications

• Bachelor's degree in Computer Science or related field or equivalent experience.
• Strong understanding of programming concepts with experience in at least 1 OOP language (Python, Scala, Java).
• 6+ years of direct experience working with Python.
• Experience with high volume distributed data processing in Spark.
• Strong working knowledge of SQL, databases (MySQL / Redshift / Athena / Trino), data modeling, and modern data warehouse (lakehouse) management.
• Excellent troubleshooting and analysis skills.
• Excited to learn and work with new technologies in a dynamic environment.
• Strong communication skills both in person and via virtual mediums.
• Strong time management skills and a self driven work ethic.
• Experience with AWS cloud services is a plus.
• Experience with event driven architecture and streaming data pipelines is a plus.
• Background check required.

Responsibilities

• Develop high volume data processing jobs across various platforms including Redshift, Athena, Iceberg, Spark and Airflow
• Work closely with Data Scientists to turn theory and methodology into viable products
• Identify bottlenecks in system performance and make recommendations on improving process efficiency
• Support and collaborate with data scientists, analysts, and product managers
• You are enthusiastic about mentoring and guiding junior team members, helping them understand architectural principles, best practices, and effective ways of working.

Job description

Ookla, an Accenture company, is seeking a Senior Data Engineer to join its Data Engineering team in Spain. You will develop large-scale data processing jobs across Spark, Redshift, Athena and Airflow, collaborating with data scientists to turn methods into viable products while improving system performance and efficiency.

You will mentor juniors, work with analysts and product managers, and learn new technologies in a dynamic environment that values flexibility and collaboration.