Data Engineer - ETL, Spark & Airflow on AWS

TP-Link Systems Inc.

Irvine (CA)

On-site

USD 100,000 - 120,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical insurance
401k contributions
PTO
Bi-annual pay increases
Wellness benefits
Team-building events

Job summary

TP-Link Systems Inc. is hiring a data engineer in Irvine, CA to design and operate production-grade ETL pipelines on Amazon EMR using Spark and Airflow. The role emphasizes data quality, scalable data models, and collaboration with analysts to deliver actionable datasets.

You will work with PySpark, SQL, and AWS tooling in a fast-paced environment, ensuring efficient, cost-aware data processing and robust data infrastructure.

Qualifications

  • 2–4 years of hands-on data development in a production environment.
  • Strong SQL with window functions and multi-table joins.
  • Python for production ETL and tooling (PySpark, pandas, boto3).
  • Hands-on experience with Spark on a cloud platform (AWS EMR, Databricks, Glue).
  • Production experience with a scheduler (Airflow preferred).
  • Dimensional modeling concepts (fact/dimension, star schema).
  • Comfortable with AWS S3 Parquet/ORC, Linux, Git.

Responsibilities

  • Build, run, and own ETL pipelines on EMR (Spark) orchestrated in Airflow.
  • Write SQL and Python for data ingestion, transformation, and datasets used by analysts and dashboards.
  • Own data quality checks and ensure correctness beyond job completion.
  • Develop data models and ensure scalable, cost-efficient pipelines.
  • Monitor runtimes and costs; optimize slow or expensive jobs.
  • Reuse patterns and automate repetitive work.
  • Collaborate with analysts and business stakeholders to deliver useful datasets.

Skills

SQL
Data development
Python
Airflow
Spark

Education

Bachelor's degree in CS/IS or related

Tools

PySpark
pandas
boto3
AWS EMR
Databricks
Glue
Airflow

Job description

TP-Link Systems Inc. is hiring a data engineer in Irvine, CA to design and operate production-grade ETL pipelines on Amazon EMR using Spark and Airflow. The role emphasizes data quality, scalable data models, and collaboration with analysts to deliver actionable datasets.

You will work with PySpark, SQL, and AWS tooling in a fast-paced environment, ensuring efficient, cost-aware data processing and robust data infrastructure.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - Spark, Airflow on AWS EMR
Data Engineer - Spark, Airflow on AWS EMR

TP-Link Systems Inc • Tustin (CA)

On-site
USD 100,000 - 120,000
Fully paid medical, dental, vision
401k contributions
4 weeks PTO per year
+3
ETL & Spark Data Engineer — AWS + Airflow
ETL & Spark Data Engineer — AWS + Airflow

TP-Link Systems Inc. • United States

On-site
USD 100,000 - 120,000
Fully paid medical, dental, and vision
401k contributions
Four weeks PTO
+3
Senior Big Data Engineer: Spark, Airflow & Cloud ETL
Senior Big Data Engineer: Spark, Airflow & Cloud ETL

TP-Link Systems USA • Tustin (CA)

On-site
USD 100,000 - 120,000
Medical, dental, vision insurance
401k contributions
Paid time off (4+ weeks)
+3
Data Engineer: Spark, Airflow & Anaplan Integrations
Data Engineer: Spark, Airflow & Anaplan Integrations

Tata Consultancy Services Limited • Irvine (CA)

On-site
USD 120,000 - 160,000
AWS Data Engineer | Spark, PySpark, Hive & Airflow
AWS Data Engineer | Spark, PySpark, Hive & Airflow

Tata Consultancy Services Limited • Irving (TX)

On-site
USD 90,000 - 110,000
Data Engineer - Scalable ETL, PySpark & Airflow on GCP
Data Engineer - Scalable ETL, PySpark & Airflow on GCP

Tata Consultancy Services Limited • Herndon (VA)

On-site
USD 100,000 - 120,000
Discretionary Annual Incentive.
Comprehensive Medical Coverage:Medical
Dental & Vision
+7
Senior Data Engineer: PySpark, Airflow & GCP
Senior Data Engineer: PySpark, Airflow & GCP

Tata Consultancy Services Limited • Sunnyvale (CA)

On-site
USD 110,000 - 150,000
Discretionary Annual Incentive
Comprehensive Medical Coverage
Family Support: Parental Leaves
+4
AWS PySpark Data Engineer: Scalable Data Pipelines
AWS PySpark Data Engineer: Scalable Data Pipelines

LTM • Irving (TX)

On-site
USD 120,000 - 180,000
Medical plan
Disability coverage
401(k) match
+3
Senior Dataflow Engineer - Spark, Airflow, Big Data
Senior Dataflow Engineer - Spark, Airflow, Big Data

Erias Ventures, LLC. • Maryland

On-site
USD 229,000 - 251,000
Above Market Pay
401k Immediate Vesting
Spot Bonuses
+10
Python Developer: Spark, Airflow & AWS Data Pipelines
Python Developer: Spark, Airflow & AWS Data Pipelines

Ethereum Technologies • Wilmington (DE)

On-site
USD 120,000 - 170,000