Remote ML Platform Engineer: Build Scalable AI Infra

Gina’s Tech Jobs - IT Recruiting Agency; San Francisco (CA); Remote; USD 150,000 - 190,000; Full time

Benefits offered by this job

Medical insurance

Dental

Vision

Savings plan

PTO

Job summary

Gina’s Tech Jobs - IT Recruiting Agency is seeking a Machine Learning Platform Engineer for a fully remote role in the US. You will build the ML infrastructure powering AI products, covering training, deployment, inference, and observability.

Collaboration with AI engineers and product teams is essential to deliver scalable, cost-efficient production systems. The role emphasizes building reliable pipelines, model serving at low latency, and continuous improvement, with a must-take 60-minute

Qualifications

• ML/AI experience required in production settings.
• Strong software engineering fundamentals for production systems.
• Experience building ML infrastructure, platforms, or production ML systems.
• Experience with model deployment, inference, evaluation, or data pipelines.
• Strong understanding of distributed systems and reliability.
• Ability to write clean, maintainable production-quality code.
• Comfortable in ambiguous, fast-moving environments.
• Ownership mindset and drive for experimentation.

Responsibilities

• Build and operate ML infrastructure and platforms powering AI products.
• Design systems for training, evaluation, deployment, inference, and experimentation.
• Build and optimize model serving and inference infrastructure for high throughput and low latency.
• Improve reliability, scalability, latency, and cost efficiency of AI systems.
• Develop reliable data pipelines for training, evaluation, release, and improvement.
• Create tooling to enable AI engineers to experiment and ship models faster.
• Develop evaluation and benchmarking infrastructure to measure quality and regressions.
• Build observability, monitoring, tracing, and alerting for AI/ML workloads.
• Identify bottlenecks and continuously improve ML stack performance.
• Collaborate with AI engineers and researchers to productionize evolving models.

Skills

ML/AI experience

Production systems

Distributed systems

Production-grade code

Fast-moving environment

Tools

Python

PyTorch

JAX

vLLM

TensorRT-LLM

Job description

Gina’s Tech Jobs - IT Recruiting Agency is seeking a Machine Learning Platform Engineer for a fully remote role in the US. You will build the ML infrastructure powering AI products, covering training, deployment, inference, and observability.

Collaboration with AI engineers and product teams is essential to deliver scalable, cost-efficient production systems. The role emphasizes building reliable pipelines, model serving at low latency, and continuous improvement, with a must-take 60-minute