Remote ML Platform Engineer: AI Infrastructure & Pipelines

SmartRecruiters, Inc.; San Francisco (CA); Remote; USD 140,000 - 180,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

Savings Plan

Paid Time Off

Job summary

Parallel Partners is seeking a Machine Learning Platform Engineer to build the infrastructure powering AI capabilities. You will design and operate systems for model training, deployment, inference, and observability, collaborating with AI researchers and product engineers to ship production-ready AI products.

The role requires ML/AI experience and strong software engineering skills, with remote, full-time work and a mandatory 60-minute coding assessment.

Qualifications

• ML/AI experience required.
• Experience building production ML systems.
• Experience with model deployment, inference, evaluation, or data pipelines.
• Strong understanding of distributed systems and system reliability.
• Ability to write clean, maintainable, production-quality code.
• Comfortable in ambiguous, fast-moving environments.
• Bias toward ownership, experimentation, and continuous improvement.

Responsibilities

• Build and operate ML infrastructure and platforms powering AI products.
• Design systems for training, evaluation, deployment, inference, and experimentation.
• Build production serving and inference infra for high throughput and low latency.
• Improve reliability, scalability, latency, and cost efficiency of AI systems.
• Develop reliable pipelines for data prep, training, evaluation, release, and improvement.
• Create tooling that enables ML researchers to experiment and ship models faster.
• Develop benchmarking to measure model quality and regressions.
• Establish observability, monitoring, tracing, and alerting for ML workloads.
• Identify bottlenecks and improve ML stack performance.

Skills

Python

PyTorch

JAX

LLM serving

TensorRT-LLM

Distributed systems

Cloud infrastructure

GPU infrastructure

Vector databases

Tools

vLLM

SGLang

TensorRT-LLM

Job description

Parallel Partners is seeking a Machine Learning Platform Engineer to build the infrastructure powering AI capabilities. You will design and operate systems for model training, deployment, inference, and observability, collaborating with AI researchers and product engineers to ship production-ready AI products.

The role requires ML/AI experience and strong software engineering skills, with remote, full-time work and a mandatory 60-minute coding assessment.