Machine Learning Engineer | Python | Pytorch | Distributed Training | Optimisation | GPU | Hybrid, San Jose, CA

Enigma; San Jose (CA); Hybrid; USD 150,000 - 230,000; Full time

Job summary

Enigma seeks a Machine Learning Engineer in San Jose to productize and scale models from Research into production-ready services with efficient, cost-conscious performance.

You will optimize training across GPUs, apply model-efficiency techniques, and build serving systems with batching, memory management, and telemetry integration. 3–5 years in ML/AI engineering is expected, with collaboration across Research, Platform/Infra, Data, and Product teams.

Qualifications

• Bachelor's degree in computer science, electrical/computer engineering, or a related field.
• Strong systems/ML engineering with exposure to distributed training and inference optimization.

Responsibilities

• Productize and optimize models from Research into reliable, performant, and cost-efficient services with clear SLOs (latency, availability, cost).
• Scale training across nodes/GPUs (DDP/FSDP/ZeRO, pipeline/tensor parallelism) and own throughput/time-to-train using profiling and optimization.
• Implement model-efficiency techniques (quantization, distillation, pruning, KV-cache, Flash Attention) for training and inference without materially degrading quality.
• Build and maintain model-serving systems (vLLM/Triton/TGI/ONNX/TensorRT/AITemplate) with batching, streaming, caching, and memory management.
• Integrate with vector/feature stores and data pipelines (FAISS/Milvus/Pinecone/pgvector; Parquet/Delta) as needed for production.
• Define and track performance and cost KPIs; run continuous improvement loops and capacity planning.
• Partner with ML Ops on CI/CD, telemetry/observability, model registries; partner with Scientists on reproducible handoffs and evaluations.

Skills

PyTorch

Distributed training

Model optimization

Performance profiling

TensorFlow

GPU

Education

Bachelor's degree in CS/EE

Master's preferred

Tools

vLLM

Triton

ONNX

TensorRT

AITemplate

FAISS

Milvus

Pinecone

Job description

Machine Learning Engineer | Python | Pytorch | Distributed Training | Optimisation | GPU | Hybrid, San Jose, CA

Title: Machine Learning Engineer

Location: San Jose, CA

Responsibilities:

• Productize and optimize models from Research into reliable, performant, and cost-efficient services with clear SLOs (latency, availability, cost).
• Scale training across nodes/GPUs (DDP/FSDP/ZeRO, pipeline/tensor parallelism) and own throughput/time-to-train using profiling and optimization.
• Implement model-efficiency techniques (quantization, distillation, pruning, KV-cache, Flash Attention) for training and inference without materially degrading quality.
• Build and maintain model-serving systems (vLLM/Triton/TGI/ONNX/TensorRT/AITemplate) with batching, streaming, caching, and memory management.
• Integrate with vector/feature stores and data pipelines (FAISS/Milvus/Pinecone/pgvector; Parquet/Delta) as needed for production.
• Define and track performance and cost KPIs; run continuous improvement loops and capacity planning.
• Partner with ML Ops on CI/CD, telemetry/observability, model registries; partner with Scientists on reproducible handoffs and evaluations.

Educational Qualifications:

• Bachelors in computer science, Electrical/Computer Engineering, or a related field required; Master's preferred (or equivalent industry experience).
• Strong systems/ML engineering with exposure to distributed training and inference optimization.

Industry Experience:

• 3–5 years in ML/AI engineering roles owning training and/or serving in production at scale.
• Demonstrated success delivering high-throughput, low-latency ML services with reliability and cost improvements.
• Experience collaborating across Research, Platform/Infra, Data, and Product functions.

Technical Skills:

• Familiarity with deep learning frameworks: PyTorch (primary), TensorFlow.
• Exposure to large model training techniques (DDP, FSDP, ZeRO, pipeline/tensor parallelism); distributed training experience a plus
• Optimization: experience profiling and optimizing code execution and model inference: (PTQ/QAT/AWQ/GPTQ), pruning, distillation, KV-cache optimization, Flash Attention
• Scalable serving: autoscaling, load balancing, streaming, batching, caching; collaboration with platform engineers.
• Understanding of the full ML lifecycle: data collection, model training, deployment, inference, optimization, and evaluation.

Machine Learning Engineer | Python | Pytorch | Distributed Training | Optimisation | GPU | Hybrid, San Jose, CA