Senior Data Engineer, Real-Time ML & Multimodal Data

Socket.dev; Cupertino (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Apple is seeking a senior data engineer to design and maintain a massive real-time data platform that converts multimodal data into a searchable foundation. You will build end-to-end pipelines, craft analytics schemas, and enable ML/LLM inference in production, enabling services for billions of customers.

The role requires strong Spark, Kafka, Airflow, AWS, and Python/PySpark skills, plus experience with large-scale data lakes and modern data tooling.

Qualifications

• Masters degree required and 10+ years of data engineering experience.
• Experience building and maintaining large-scale ETL/ELT data pipelines.
• Data modeling and dimensional modeling for analytics and reporting.
• Experience with SQL/NoSQL databases (Postgres / Cassandra / Redis).
• Strong experience with Apache Spark.
• Experience with BigTable/Hadoop for distributed processing.
• Strong software engineering fundamentals in Scala and Java.
• Hands-on with Apache Kafka, Iceberg, and Flink.
• Experience with Airflow and Beam for workflows.
• Experience with AWS services: S3, EMR, Lambda, Glue, Redshift, Kinesis.
• Analytics with Trino (Presto), BigQuery, Snowflake.
• Big data lake architectures experience.
• Containerization with Docker and Kubernetes/EKS; Jenkins for CI/CD.
• Python and PySpark proficiency.
• Familiarity with graph databases like TigerGraph.
• Pipelines processing multimodal data and ML/LLMs in production.
• LLMs/ML inference in production using ONNX/TensorRT/TorchServe.

Responsibilities

• Design and maintain a massive real-time data platform.
• Develop and optimize end-to-end data pipelines for analytics.
• Collaborate on data models and analytics schemas for reporting.
• Build scalable data pipelines processing multimodal data and embeddings.
• Deploy and optimize ML/LLM inference in production environments.

Skills

ETL/ELT pipelines

Dimensional modeling

SQL/NoSQL databases

Apache Spark

BigTable/Hadoop

Scala

Java

Apache Kafka

Airflow

Beam

AWS

Trino/Presto/BigQuery/Snowflake

Big data lake architectures

Docker

Kubernetes/EKS

Jenkins

Python/PySpark

TigerGraph

Education

Masters Degree

Tools

Postgres

Cassandra

Redis

Snowflake

Redshift

Spark UI

Airflow

Beam

Job description

Apple is seeking a senior data engineer to design and maintain a massive real-time data platform that converts multimodal data into a searchable foundation. You will build end-to-end pipelines, craft analytics schemas, and enable ML/LLM inference in production, enabling services for billions of customers.

The role requires strong Spark, Kafka, Airflow, AWS, and Python/PySpark skills, plus experience with large-scale data lakes and modern data tooling.