AI Platform Engineer: Scalable ML Infra & Production

ActAI; United States; On-site; USD 150,000 - 190,000; Full time

Job summary

ActAI is seeking an ML Platform Engineer to build the infrastructure powering our AI capabilities. You will design and operate systems behind the AI stack, from model training and evaluation to deployment, inference, observability, and continuous improvement.

You will work closely with AI engineers, researchers, and product engineers to turn models into reliable, scalable, and cost-efficient production systems.

Qualifications

• Strong software engineering fundamentals and experience building production systems.
• Experience building ML infrastructure, platforms, or production machine learning systems.
• Experience with model deployment, inference, evaluation, or data pipelines.
• Strong understanding of distributed systems and system reliability.
• Ability to write clean, production-quality code.
• Comfortable working in ambiguous, fast-moving environments.
• Bias toward ownership, experimentation, and continuous improvement.

Responsibilities

• Build and operate the ML infrastructure and platforms powering ActAI's AI products.
• Design systems for model training, evaluation, deployment, inference, and experimentation.
• Build and optimise model serving and inference infrastructure for high-throughput and low-latency workloads.
• Improve reliability, scalability, latency, and cost efficiency of AI systems.
• Develop reliable pipelines for data preparation, training, evaluation, model release, and continuous improvement.
• Build platforms and tooling that enable AI engineers and researchers to experiment, evaluate, and ship models faster.
• Develop evaluation and benchmarking infrastructure to measure model quality, performance, and regressions.
• Build production observability, monitoring, tracing, and alerting for AI/ML workloads.
• Improve AI systems across reliability, scalability, latency, throughput, and cost.

Skills

Software engineering

Production systems

Ownership & initiative

Ambiguity tolerance

Tools

Python

PyTorch

JAX

vLLM

SGLang

TensorRT-LLM

Cloud infrastructure

Distributed systems

Vector databases

Job description

ActAI is seeking an ML Platform Engineer to build the infrastructure powering our AI capabilities. You will design and operate systems behind the AI stack, from model training and evaluation to deployment, inference, observability, and continuous improvement.

You will work closely with AI engineers, researchers, and product engineers to turn models into reliable, scalable, and cost-efficient production systems.