Data Engineer: Spark, Airflow & AWS ETL

TP-Link Systems Inc.; Irvine (CA); On-site; USD 100,000 - 120,000; Full time

Benefits offered by this job

Free snacks and drinks

Fully paid medical, dental, and vision

401K contributions

Bi-annual reviews and pay increases

Health and wellness benefits including

Quarterly team-building events

Job summary

TP-Link Systems Inc. in the United States is seeking a data engineer to build, run, and own scalable ETL pipelines on EMR (Spark) orchestrated by Airflow, writing SQL and Python for ingestion and transformations.

You will ensure data quality, extend dimensional models, optimize costs, and collaborate with analysts to deliver reliable datasets that support dashboards and decision making.

Qualifications

• 2–4 years of hands‑on data development in a production environment.
• Strong SQL: window functions, multi‑table joins, incremental loads.
• Python for production ETL and tooling (PySpark, pandas, boto3).
• Hands‑on experience with Spark on a cloud platform (AWS EMR, Databricks, Glue).
• Production experience with a scheduler, Airflow preferred.
• Working understanding of dimensional modeling: star schema and warehouse layering.
• Comfortable with AWS, Linux, and Git.
• Effective use of AI to accelerate data work.
• Bachelor's degree in CS/IS or equivalent.

Responsibilities

• Build, run, and own ETL pipelines on EMR (Spark) orchestrated in Airflow.
• Write SQL and Python for data ingestion, transformation, and datasets used by analysts and dashboards.
• Own data quality checks and extend patterns to ensure correctness.
• Build and extend data models with fact and dimension tables following layering conventions.
• Keep jobs efficient by monitoring runtime and cost and addressing slow or expensive jobs.
• Use reusable patterns and templates, automating repetitive work.
• Collaborate with analysts and stakeholders to turn requests into usable datasets.

Skills

SQL

Python (PySpark)

Spark

Airflow

Dimensional modelling

AWS

Linux

Git

AI for data problems

Education

Bachelor's degree in Computer Science / Information Systems or related field

Tools

Databricks

AWS EMR

S3

Parquet/ORC

Job description

TP-Link Systems Inc. in the United States is seeking a data engineer to build, run, and own scalable ETL pipelines on EMR (Spark) orchestrated by Airflow, writing SQL and Python for ingestion and transformations.

You will ensure data quality, extend dimensional models, optimize costs, and collaborate with analysts to deliver reliable datasets that support dashboards and decision making.