Machine Learning Platform Engineer

Bjak

Spain (TX)

On-site

USD 140,000 - 200,000

Full time

10 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

A1 is seeking an ML Platform Engineer to build the infrastructure powering AI capabilities. You will design and operate systems behind the AI stack, from training and evaluation to deployment, inference, observability, and continuous improvement.

You will collaborate with AI engineers, researchers, and product teams to turn evolving model requirements into reliable, scalable production platforms, tooling, and pipelines that enable rapid experimentation and cost-efficient operation.

Qualifications

  • Strong software engineering fundamentals and experience building production systems.
  • Experience building ML infrastructure, platforms, or production machine learning systems.
  • Experience with model deployment, inference, evaluation, or data pipelines.
  • Strong understanding of distributed systems and system reliability.
  • Ability to write clean, maintainable, production-quality code.
  • Comfortable working in ambiguous, fast-moving environments.

Responsibilities

  • Build and operate ML infrastructure and platforms powering AI products.
  • Design systems for training, evaluation, deployment, inference, and experimentation.
  • Build and optimize model serving and inference infrastructure for high-throughput, low-latency workloads.
  • Improve reliability, scalability, latency, and cost efficiency of AI systems.
  • Develop reliable pipelines for data preparation, training, evaluation, model release, and continuous improvement.
  • Build platforms and tooling enabling AI engineers and researchers to ship models faster.
  • Develop evaluation and benchmarking infrastructure to measure model quality and regressions.
  • Create production observability, monitoring, tracing, and alerting for ML workloads.
  • Identify bottlenecks across the ML stack and drive performance improvements.

Skills

Software Eng
ML infra
Model deployment
Distributed systems
Clean code
Ambiguity tolerance
Ownership mindset
PyTorch
TensorRT-LLM
vLLM

Tools

PyTorch
TensorRT-LLM
vLLM
SGLang

Job description

About A1


There are over 5 billion users using basic applications today such email, notes, tasks that are not AI-native. Our mission is to build a proactive smart assistant for everyday users to bring intelligence to conversations, errands, organising and workflows, with minimal prompting.


Our product focuses on achieving high reliability for long-running workflows, persistent context, and real-world task completion. The system must handle multi-step reasoning, interact with external tools, and remain reliable despite non-deterministic model behavior. Our objective is to help users complete tasks daily enjoyable with over ~90%* reduced time.


About the Role


As an ML Platform Engineer, you will build the infrastructure and systems that power A1's AI capabilities.


You will design and operate the systems behind the AI stack, from model training and evaluation to deployment, inference, observability, and continuous improvement.


You will work closely with AI engineers, researchers, and product engineers to turn models into reliable, scalable, and cost-efficient production systems. You will build the platforms, tooling, and infrastructure that enable the team to experiment quickly and bring AI capabilities to production with confidence.


Focus


  • Build and operate the ML infrastructure and platforms powering A1’s AI products


  • Design systems for model training, evaluation, deployment, inference, and experimentation


  • Build and optimise model serving and inference infrastructure for high-throughput and low-latency workloads


  • Improve reliability, scalability, latency, and cost efficiency of AI systems


  • Develop reliable pipelines for data preparation, training, evaluation, model release, and continuous improvement


  • Build platforms and tooling that enable AI engineers and researchers to experiment, evaluate, and ship models faster


  • Develop evaluation and benchmarking infrastructure to measure model quality, performance, and regressions


  • Build production observability, monitoring, tracing, and alerting for AI/ML workloads


  • Improve AI systems across reliability, scalability, latency, throughput, and cost


  • Identify bottlenecks across the ML stack and continuously improve system performance


  • Work closely with AI engineers, researchers, and product teams to turn evolving model requirements into production-ready infrastructure


Tech Stack


  • Python


  • PyTorch / JAX


  • LLM and ML serving infrastructure such as vLLM, SGLang, or TensorRT-LLM


  • Cloud infrastructure


  • Distributed systems


  • ML/data pipelines and workflow orchestration


  • GPU infrastructure and performance tooling


  • Vector databases and retrieval infrastructure


Ideal Experience


  • Strong software engineering fundamentals and experience building production systems


  • Experience building ML infrastructure, platforms, or production machine learning systems


  • Experience with model deployment, inference, evaluation, or data pipelines


  • Strong understanding of distributed systems and system reliability


  • Ability to write clean, maintainable, production-quality code


  • Comfortable working in ambiguous, fast-moving environments


  • Bias toward ownership, experimentation, and continuous improvement


Outcomes


  • AI infrastructure reliably supports production workloads at scale


  • Models can be trained, evaluated, deployed, and improved efficiently


  • Inference systems deliver strong latency, throughput, reliability, and cost efficiency


  • ML pipelines are reproducible, observable, maintainable, and robust


  • Model and infrastructure regressions are detected quickly and diagnosed efficiently


  • Common ML infrastructure capabilities become reusable platform primitives rather than being rebuilt for every AI product


  • The AI stack can evolve rapidly as new models, architectures, and inference techniques emerge

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Machine Learning Platform Engineer
Machine Learning Platform Engineer

Bjak • Germany (OH)

On-site
USD 120,000 - 180,000
Machine Learning Platform Engineer
Machine Learning Platform Engineer

Bjak • Town of Poland (NY)

On-site
USD 140,000 - 220,000
Machine Learning Platform Engineer
Machine Learning Platform Engineer

AI Chopping Block • Northern (KY)

Hybrid
USD 140,000 - 200,000
Machine Learning Platform Engineer
Machine Learning Platform Engineer

United States Digital Space LLC • Germany (OH)

On-site
USD 130,000 - 170,000
Machine Learning Platform Engineer
Machine Learning Platform Engineer

United States Digital Space LLC • United States

Remote
USD 120,000 - 180,000
Senior Machine Learning Engineer
Senior Machine Learning Engineer

United States Digital Space LLC • Germany (OH)

On-site
USD 180,000 - 240,000
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Visa Hunt • Town of Poland (NY)

On-site
USD 180,000 - 240,000
ML Platform Engineer: Scalable AI Infrastructure
ML Platform Engineer: Scalable AI Infrastructure

Bjak • Germany (OH)

On-site
USD 120,000 - 180,000
Staff Machine Learning Engineer
Staff Machine Learning Engineer

A1 • Palo Alto (CA)

On-site
USD 190,000 - 230,000
ML Platform Engineer: Scalable AI Infra & Reliability
ML Platform Engineer: Scalable AI Infra & Reliability

Bjak • Town of Poland (NY)

On-site
USD 140,000 - 220,000