Senior Data Engineer: Real-Time ML Pipelines

Apple Inc.; Cupertino, Northern (CA, KY); Hybrid; USD 185,000 - 325,000; Full time

Job summary

Apple Inc. is seeking an experienced Data Engineer to design, build, and operate massive ETL/ELT pipelines turning raw data into a trusted foundation. You will craft scalable batch and streaming workflows, integrate ML pipelines, and collaborate with ML engineers and platform teams.

The role emphasizes data modeling, governance, and high-throughput processing using Kafka, Spark, Iceberg, and cloud services. A Masters degree and 10+ years in data engineering are expected.

Qualifications

• 10+ years of data engineering experience with large-scale ETL/ELT pipelines.
• Strong data modeling and analytics experience.
• Proficient in Python and PySpark with Spark ecosystem.
• Experience with Kafka, Iceberg, Flink, and Airflow.

Responsibilities

• Build batch and streaming ETL/ELT pipelines from diverse sources.
• Develop Kafka-based ingestion and processing pipelines.
• Model data with dimensional design optimized for analytics.
• Define data quality checks, SLAs, and observability standards.
• Collaborate with ML engineers and platform teams.

Skills

ETL/ELT design

Data modeling

Python

PySpark

Scala/Java

Apache Kafka

Apache Spark

Airflow

Beams/Beam

AWS

Data governance

Education

Masters Degree

Tools

Iceberg

Flink

Kubernetes

Jenkins

S3

EMR

Redshift

BigQuery

Delta Lake

Job description

Apple Inc. is seeking an experienced Data Engineer to design, build, and operate massive ETL/ELT pipelines turning raw data into a trusted foundation. You will craft scalable batch and streaming workflows, integrate ML pipelines, and collaborate with ML engineers and platform teams.

The role emphasizes data modeling, governance, and high-throughput processing using Kafka, Spark, Iceberg, and cloud services. A Masters degree and 10+ years in data engineering are expected.