Junior Data Engineer: Big Data, Spark & Airflow

Ziff Davis; United States; On-site; USD 85,000 - 125,000; Full time

Job summary

Ookla, an Accenture company, is seeking an entry level Data Engineer to join the Data Engineering team, focusing on building scalable data pipelines and supporting data scientists and analysts.

You will develop jobs and libraries for processing large datasets using Redshift, Athena, Spark and Airflow, with emphasis on accuracy and performance. Collaboration with product managers and cross-functional teams is essential.

Qualifications

• Bachelor's degree in Computer Science or related field or equivalent experience.
• 1+ year of professional experience in data engineering.
• Knowledge of SQL, databases (MySQL / Redshift / Athena), Data modeling.
• Workflow orchestrators (Dagster, Airflow, Prefect).
• Experience working with Python.
• Strong communication skills both in person and via virtual mediums.
• Background check required.

Responsibilities

• Develop high volume data processing jobs across various platforms including Redshift, Athena, Iceberg, Spark and Airflow
• Debug queries, monitor jobs, identify bottlenecks in system performance and improve efficiency
• Support and collaborate with data scientists, analysts, and product managers

Skills

SQL

Python

Data modeling

Dagster

Airflow

Prefect

Databases (MySQL/Redshift/Athena)

Communication skills

Education

Bachelor's degree in Computer Science or related field

Tools

Spark

Redshift

Athena

Iceberg

Job description

Ookla, an Accenture company, is seeking an entry level Data Engineer to join the Data Engineering team, focusing on building scalable data pipelines and supporting data scientists and analysts.

You will develop jobs and libraries for processing large datasets using Redshift, Athena, Spark and Airflow, with emphasis on accuracy and performance. Collaboration with product managers and cross-functional teams is essential.