Machine Learning Platform Engineer, Machine Learning (ML) and Artificial Intelligence (AI) Required, Work From Home

SmartRecruiters, Inc.; San Francisco (CA); Remote; USD 140,000 - 180,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

Savings Plan

Paid Time Off

Job summary

Parallel Partners is seeking a Machine Learning Platform Engineer to build the infrastructure powering AI capabilities. You will design and operate systems for model training, deployment, inference, and observability, collaborating with AI researchers and product engineers to ship production-ready AI products.

The role requires ML/AI experience and strong software engineering skills, with remote, full-time work and a mandatory 60-minute coding assessment.

Qualifications

• ML/AI experience required.
• Experience building production ML systems.
• Experience with model deployment, inference, evaluation, or data pipelines.
• Strong understanding of distributed systems and system reliability.
• Ability to write clean, maintainable, production-quality code.
• Comfortable in ambiguous, fast-moving environments.
• Bias toward ownership, experimentation, and continuous improvement.

Responsibilities

• Build and operate ML infrastructure and platforms powering AI products.
• Design systems for training, evaluation, deployment, inference, and experimentation.
• Build production serving and inference infra for high throughput and low latency.
• Improve reliability, scalability, latency, and cost efficiency of AI systems.
• Develop reliable pipelines for data prep, training, evaluation, release, and improvement.
• Create tooling that enables ML researchers to experiment and ship models faster.
• Develop benchmarking to measure model quality and regressions.
• Establish observability, monitoring, tracing, and alerting for ML workloads.
• Identify bottlenecks and improve ML stack performance.

Skills

Python

PyTorch

JAX

LLM serving

TensorRT-LLM

Distributed systems

Cloud infrastructure

GPU infrastructure

Vector databases

Tools

vLLM

SGLang

TensorRT-LLM

Job description

Machine Learning Platform Engineer, Machine Learning (ML) and Artificial Intelligence (AI) Required, Work From Home

• Full-time
• Compensation: USD 140,000 - USD 180,000 - yearly

Machine Learning Platform Engineer, Machine Learning (ML) and Artificial Intelligence (AI) Required, Work From Home

As the Machine Learning Platform Engineer, you will build the infrastructure and systems that power Artificial Intelligence (AI) capabilities. You will design and operate the systems behind the Artificial Intelligence (AI) stack, from model training and evaluation to deployment, inference, observability, and continuous improvement. You will work closely with Artificial Intelligence (AI) engineers, researchers, and product engineers to turn models into reliable, scalable, and cost-efficient production systems. You will build the platforms, tooling, and infrastructure that enable the team to experiment quickly and bring AI capabilities to production with confidence. Machine Learning (ML) and Artificial Intelligence (AI) experience are required. This position is 100% Remote.

MUST BE WILLING TO TAKE A 60 MINUTE CODING ASSESSMENT.

- Build and operate the Machine Learning (ML) infrastructure and platforms powering Artificial Intelligence (AI) products.

- Design systems for model training, evaluation, deployment, inference, and experimentation.

- Build and optimize model serving and inference infrastructure for high-throughput and low-latency workloads.

- Improve reliability, scalability, latency, and cost efficiency of Artificial Intelligence (AI) systems.

- Develop reliable pipelines for data preparation, training, evaluation, model release, and continuous improvement.

- Build platforms and tooling that enable Artificial Intelligence (AI) engineers and researchers to experiment, evaluate, and ship models faster.

- Develop evaluation and benchmarking infrastructure to measure model quality, performance, and regressions.

- Build production observability, monitoring, tracing, and alerting for Artificial Intelligence (AI)/Machine Learning (ML) workloads.

- Improve Artificial Intelligence (AI) systems across reliability, scalability, latency, throughput, and cost.

- Identify bottlenecks across the Machine Learning (ML) stack and continuously improve system performance.

- Work closely with Artificial Intelligence (AI) engineers, researchers, and product teams to turn evolving model requirements into production-ready infrastructure.

- AI infrastructure reliably supports production workloads at scale.

- Models can be trained, evaluated, deployed, and improved efficiently.

- Inference systems deliver strong latency, throughput, reliability, and cost efficiency.

- Machine Learning (ML) pipelines are reproducible, observable, maintainable, and robust.

- Model and infrastructure regressions are detected quickly and diagnosed efficiently.

- Common Machine Learning (ML) infrastructure capabilities become reusable platform primitives rather than being rebuilt for every AI product.

- The AI stack can evolve rapidly as new models, architectures, and inference techniques emerge.

Machine Learning Platform Engineer Qualifications:

- Machine Learning (ML) and Artificial Intelligence (AI) experience are required.

- Strong software engineering fundamentals and experience building production systems.

- Experience building Machine Learning (ML) infrastructure, platforms, or production machine learning systems.

- Experience with model deployment, inference, evaluation, or data pipelines.

- Strong understanding of distributed systems and system reliability.

- Ability to write clean, maintainable, production-quality code.

- Comfortable working in ambiguous, fast-moving environments.

- Bias toward ownership, experimentation, and continuous improvement.

- Tech Stack: Python, PyTorch, JAX, LLM and ML serving infrastructure such as vLLM, SGLang, or TensorRT-LLM, Cloud infrastructure, Distributed systems, Machine Learning (ML)/data pipelines and workflow orchestration, GPU infrastructure and performance tooling, and Vector databases and retrieval infrastructure.

Benefits include medical insurance, Dental, Vision, Savings Plan Options, PTO, etc.

Keywords: San Francisco CA Jobs, AI, Artificial Intelligence, Cloud Infrastructure, Data Pipelines, Distributed Systems, GPU Infrastructure, JAX, LLM, Large Language Model, Machine Learning Platform Engineer, ML, Machine Learning, Python, PyTorch, SGLang, TensorRT-LLM, Vector Databases, vLLM, Workflow Orchestration, Work From Home, Remote, California Recruiters, IT Jobs, California Recruiting

All your information will be kept confidential according to EEO guidelines.