Data Engineer - Spark, Airflow on AWS EMR

Omada Network S; Tustin (CA); On-site; USD 100,000 - 120,000; Full time

Benefits offered by this job

Fully paid medical, dental, vision

401k contributions

4 weeks PTO per year

Bi-annual pay increases

Gym membership

Team-building events

Job summary

TP-Link Systems Inc in the United States is seeking a Big Data Engineer to own and optimize ETL pipelines on EMR (Spark) orchestrated by Airflow. You will write SQL and Python to shape datasets used by analysts and dashboards, ensure data quality, and develop dimensional data models that support scalable analytics.

The role emphasizes efficient, cost-aware job runs, reusable automation, and collaboration with analysts to deliver impactful data products.

Qualifications

• 2-4 years of hands-on data development in production environments.
• Strong SQL: window functions, multi-table joins, incremental loads.
• Python for production ETL and tooling (PySpark, pandas, boto3).
• Hands-on experience with Spark on a cloud platform: AWS EMR, Databricks, Glue.
• Production experience with a scheduler; Airflow preferred.
• Working understanding of dimensional modeling: fact and dimension tables, star schema.
• Comfortable working on AWS (S3 with Parquet / ORC), Linux, and Git.
• Effective use of AI to solve data problems with judgment.
• Bachelor's degree in Computer Science, Information Systems, or related field, or equivalent practical experience.

Responsibilities

• Build, run, and own ETL pipelines on EMR (Spark) orchestrated in Airflow — including monitoring, alerting, and recovery.
• Write SQL and Python for data ingestion, transformation, and the datasets that analysts and dashboards depend on.
• Own data quality for what you build — run the checks before you ship and add new ones where they're missing.
• Build and extend the data models for your area: fact and dimension tables following the team's layering conventions.
• Keep your jobs efficient — watch runtime and cost, and raise slow or expensive jobs rather than living with them.
• Use and extend the team's shared patterns and templates, and turn work you find yourself repeating into something automated or reusable.
• Work with analysts and business stakeholders to turn requests into datasets that actually get used.

Skills

SQL

Python

PySpark

Airflow

Dimensional modeling

AWS

Linux

Git

AI for data problems

Education

Bachelor's degree in CS/IS or related

Tools

Airflow

Spark

Databricks

EMR

Job description

TP-Link Systems Inc in the United States is seeking a Big Data Engineer to own and optimize ETL pipelines on EMR (Spark) orchestrated by Airflow. You will write SQL and Python to shape datasets used by analysts and dashboards, ensure data quality, and develop dimensional data models that support scalable analytics.

The role emphasizes efficient, cost-aware job runs, reusable automation, and collaboration with analysts to deliver impactful data products.