Senior Big Data Engineer: Spark, Airflow & Cloud ETL

TP-Link Systems USA; Tustin (CA); On-site; USD 100,000 - 120,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

401k contributions

Paid time off (4+ weeks)

Bi-annual raises

Gym membership

Team-building events

Job summary

TP-Link Systems USA in California is seeking a data engineer to build, run and own ETL pipelines on EMR (Spark) orchestrated by Airflow. You will write SQL and Python for data ingestion and datasets used by analysts and dashboards.

You will own data quality, design data models, optimize performance and costs, and collaborate with analysts and business stakeholders to deliver reliable data products.

Qualifications

• 2–4 years of hands-on data development in production pipelines.
• Strong SQL with window functions and complex joins; understand slow queries.
• Python for production ETL and tooling (PySpark, pandas, boto3).
• Experience with Spark on cloud platforms (AWS EMR, Databricks, Glue).
• Experience with a scheduler (Airflow) and DAG design.
• Understanding of dimensional modeling and star schemas.
• Familiarity with AWS, Linux, and Git; ability to learn new tools.
• Bachelor’s degree or equivalent practical experience.

Responsibilities

• Build, run, and own ETL pipelines on EMR (Spark) orchestrated in Airflow.
• Write SQL and Python for data ingestion and datasets used by analysts.
• Own data quality checks and ensure correctness beyond job completion.
• Build and extend data models: fact and dimension tables following conventions.
• Keep jobs efficient; monitor runtime and cost, raise slow or expensive jobs.
• Reuse patterns and templates; automate repetitive tasks where possible.
• Collaborate with analysts and stakeholders to turn requests into usable datasets.

Skills

Strong SQL

Python for ETL

PySpark / Spark

Airflow

Dimensional modeling

AWS / Linux / Git

AI for data problems

Education

Bachelor's degree in Computer Science or related field

Tools

AWS EMR

Databricks

Glue

Airflow

S3 with Parquet/ORC

Job description

TP-Link Systems USA in California is seeking a data engineer to build, run and own ETL pipelines on EMR (Spark) orchestrated by Airflow. You will write SQL and Python for data ingestion and datasets used by analysts and dashboards.

You will own data quality, design data models, optimize performance and costs, and collaborate with analysts and business stakeholders to deliver reliable data products.