Big Data Engineer

TP-Link Systems Inc.; United States; On-site; USD 100,000 - 120,000; Full time

Benefits offered by this job

Fully paid medical, dental, and vision

401k contributions

Four weeks PTO

Bi-annual pay raises

Wellness benefits

Team-building events

Job summary

TP-Link Systems Inc. is seeking a data engineer to build, run, and own ETL pipelines on EMR (Spark) orchestrated with Airflow. You’ll write SQL and Python for data ingestion and create datasets that analysts rely on, while ensuring data quality and scalable models.

You’ll work with AWS services (S3/Parquet), practice dimensional modeling, and optimize jobs for performance and cost in a production environment.

Qualifications

• 2–4 years of hands-on data development in a production environment.
• Strong SQL with window functions and multi-table joins.
• Python for production ETL (PySpark, pandas, boto3).
• Spark on a cloud platform (AWS EMR, Databricks, Glue).
• Experience with a scheduler (Airflow preferred).
• Dimensional modeling: fact and dimension tables, star schema.

Responsibilities

• Build, run, and own ETL pipelines on EMR (Spark) using Airflow.
• Write SQL and Python for data ingestion and dataset construction.
• Own data quality checks before shipping data products.
• Develop data models with fact and dimension tables.
• Optimize jobs for runtime and cost; automate repetitive tasks.
• Extend patterns and templates; automate what you repeat.
• Collaborate with analysts to turn requests into usable datasets.

Skills

SQL proficiency

Python ETL

Spark on cloud

Airflow

Dimensional modeling

AWS / S3 / Parquet

Linux / Git

AI-assisted data problem solving

Education

Bachelor's degree in CS/IS or related field

Tools

AWS EMR

Databricks/Glue

Airflow

S3/Parquet/ORC

Job description

Description

_ About Us _

Headquartered in the United States, TP-Link Systems Inc. is a global provider of reliable networking devices and smart home products, consistently ranked as the world’s top provider of Wi‑Fi devices. The company is committed to delivering innovative products that enhance people’s lives through faster, more reliable connectivity. With a commitment to excellence, TP-Link serves customers in over 170 countries and continues to grow its global footprint.

We believe technology changes the world for the better! At TP-Link Systems Inc, we are committed to crafting dependable, high-performance products to connect users worldwide with the wonders of technology.

Embracing professionalism, innovation, excellence, and simplicity, we aim to assist our clients in achieving remarkable global performance and enable consumers to enjoy a seamless, effortless lifestyle.

_ Overview: _

KEY RESPONSIBILITIES

• Build, run, and own ETL pipelines on EMR (Spark) orchestrated in Airflow — including their monitoring, alerting, and recovery.
• Write SQL and Python for data ingestion, transformation, and the datasets that analysts and dashboards depend on.
• Own data quality for what you build — run the checks before you ship and add new ones where they’re missing; confirm the results are correct, not only that the job completed.
• Build and extend the data models for your area: fact and dimension tables following the team’s layering conventions.
• Keep your jobs efficient — watch runtime and cost, and raise slow or expensive jobs rather than living with them.
• Use and extend the team’s shared patterns and templates, and turn work you find yourself repeating into something automated or reusable.
• Work with analysts and business stakeholders to turn requests into datasets that actually get used.

REQUIRED QUALIFICATIONS

• 2–4 years of hands‑on data development in a production environment — pipelines that run on a schedule with real downstream consumers, that you were responsible for including when they broke.
• Strong SQL: window functions, complex multi‑table joins, incremental loads, and the ability to work out why a query is slow.
• Python for production ETL and tooling (PySpark, pandas, boto3) — code that runs on a schedule, not only notebooks.
• Hands‑on experience with Spark on a cloud platform: AWS EMR, Databricks, Glue, or equivalent.
• Production experience with a scheduler, Airflow preferred: DAG design, dependencies, retries, and reruns that are safe to repeat.
• Working understanding of dimensional modeling: fact and dimension tables, star schema, and warehouse layering.
• Comfortable working on AWS (S3 with Parquet / ORC), Linux, and Git — and comfortable picking up new tools as the platform evolves.
• Effective use of AI to solve data problems — using it to move faster on SQL, debugging, and unfamiliar schemas, with the judgment to catch output that looks right but isn’t.
• Bachelor’s degree in Computer Science, Information Systems, or a related field, or equivalent practical experience.

PREFERRED QUALIFICATIONS

• Data ingestion or CDC tooling: DataX, Sqoop, Debezium, Fivetran, or similar.
• An OLAP / MPP engine: StarRocks, Doris, ClickHouse, Redshift, or similar.
• Spark performance work: partitioning, shuffle, skew, and memory tuning.
• AWS cost optimization: EMR instance sizing and Spot strategy, S3 lifecycle policies.
• Lakehouse formats (Iceberg, Hudi, Delta), streaming (Kafka, Flink), dbt, or a data quality framework.
• QuickSight or another BI tool: dataset and permission design.
• Self‑directed learning: a project, an open‑source contribution, or a tool you picked up on your own and put to real use

Benefits

_ Salary Range: _

$100,000 -120,000

_ Benefits: _

• Fully paid medical, dental, and vision insurance (partial coverage for dependents)

• Contributions to 401k funds

• Over four weeks of PTO per year

• Bi‑annual pay increases

• Health and wellness benefits, including free gym membership

• Quarterly team‑building events

At TP-Link Systems Inc., we are continually searching for ambitious individuals who are passionate about their work. We believe that diversity fuels innovation, collaboration, and drives our entrepreneurial spirit. As a global company, we highly value diverse perspectives and are committed to cultivating an environment where all voices are heard, respected, and valued. We are dedicated to providing equal employment opportunities to all employees and applicants, and we prohibit discrimination and harassment of any kind based on race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws. Beyond compliance, we strive to create a supportive and growth-oriented workplace for everyone.