Senior LLM & MLOps Engineer

Socket.dev; Cupertino (CA); On-site; USD 190,000 - 270,000; Full time

Job summary

Apple is seeking a highly experienced ML Engineer to build, deploy, optimize, and operationalize LLM-based applications with a strong focus on MLOps and scalable production systems. You will own CI/CD pipelines, serving infra, and governance for models at Apple scale.

You will work across the ML lifecycle from experimentation to deployment, with data enrichment, feature stores, lineage tracking, and robust observability.

Qualifications

• Master's degree in CS or related field.
• Proven track record shipping production-grade ML/LLM systems.
• Strong understanding of LLMs, fine-tuning, prompt engineering, and RAG patterns.

Responsibilities

• Own infra and tooling for CI/CD and serving of LLM-powered features.
• Deploy, monitor, and optimize ML/LLM production systems at scale.
• Implement governance, security, and privacy considerations for production ML pipelines.
• Mentor engineers and set technical standards for the team.

Skills

Python proficiency

Distributed systems

CI/CD pipelines

Kubernetes

Spark/Flink/Kafka

Education

Master's degree in Computer Science or related field

Ph.D. in Computer Science or ML (preferred)

Tools

ONNX Runtime

TensorRT

TorchServe

Triton

vLLM

SGLang

Flask/FastAPI

Spark/Flink/Kafka clients

Airflow

Feast

Pinecone

Milvus

FAISS

pgvector

Job description

Apple is seeking a highly experienced ML Engineer to build, deploy, optimize, and operationalize LLM-based applications with a strong focus on MLOps and scalable production systems. You will own CI/CD pipelines, serving infra, and governance for models at Apple scale.

You will work across the ML lifecycle from experimentation to deployment, with data enrichment, feature stores, lineage tracking, and robust observability.