Hybrid ML Systems Engineer – Distributed Training & Serving

Enigma; San Jose (CA); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Enigma is seeking a Machine Learning Engineer in San Jose, CA, to design and optimize scalable ML services. You will productize models from Research into reliable, cost-efficient deployments with clear SLOs, leveraging distributed training across GPUs and advanced optimization techniques.

You will collaborate with ML Ops on CI/CD, telemetry, and model registries, and partner with Scientists on reproducible handoffs and evaluations to ensure high-throughput, low-latency production systems.

Qualifications

• BS in CS/EE or equivalent; MS preferred.
• 3–5 years in ML/AI engineering owning training/serving at scale.
• Experience delivering high-throughput, low-latency ML services with reliability and cost improvements.

Responsibilities

• Productize and optimize models from Research into reliable, performant, and cost-efficient services with clear SLOs (latency, availability, cost).
• Scale training across nodes/GPUs (DDP/FSDP/ZeRO, pipeline/tensor parallelism) and own throughput/time-to-train using profiling and optimization.
• Implement model-efficiency techniques (quantization, distillation, pruning, KV-cache, Flash Attention) for training and inference without materially degrading quality.
• Build and maintain model-serving systems (vLLM/Triton/TGI/ONNX/TensorRT/AITemplate) with batching, streaming, caching, and memory management.
• Integrate with vector/feature stores and data pipelines (FAISS/Milvus/Pinecone/pgvector; Parquet/Delta) as needed for production.
• Define and track performance and cost KPIs; run continuous improvement loops and capacity planning.
• Partner with ML Ops on CI/CD, telemetry/observability, model registries; partner with Scientists on reproducible handoffs and evaluations.

Skills

Python

PyTorch

Distributed training

Model optimization

Profiling

Systems engineering

Education

Bachelors in CS/EE

Masters preferred

Tools

FAISS

Milvus

Pinecone

pgvector

Parquet

Delta

Triton

vLLM

ONNX

TensorRT

AITemplate

Job description

Enigma is seeking a Machine Learning Engineer in San Jose, CA, to design and optimize scalable ML services. You will productize models from Research into reliable, cost-efficient deployments with clear SLOs, leveraging distributed training across GPUs and advanced optimization techniques.

You will collaborate with ML Ops on CI/CD, telemetry, and model registries, and partner with Scientists on reproducible handoffs and evaluations to ensure high-throughput, low-latency production systems.