Remote Staff ML Platform Engineer (MLOps) - Build AI Infra

futurefitai; United States; Remote; USD 172,000 - 215,000; Full time

Benefits offered by this job

Remote-friendly

Competitive compensation

Job summary

FutureFit AI is seeking a Staff ML Platform Engineer (MLOps) to build and operate the platform powering our ML and LLM-powered products. You will own compute provisioning, environments, and model routing, ensuring cost efficiency and reliability across batch and real-time serving.

You will lead with discipline in experiment tracking, deployment workflows, observability, and data/feature infrastructure, closely collaborating with the ML and data teams to ship robust, scalable solutions.

Qualifications

• Staff-level, hands-on experience in MLOps, ML platform, or ML infrastructure.
• End-to-end MLOps practice: CI/CD for models, experiment tracking, model registries, deployment workflows, and monitoring.
• Production experience with LLM-based systems: serving, prompt and response evaluation, routing across models and providers, cost and latency management.
• Experience operating models in both batch and real-time serving contexts.
• Compute provisioning and environment management: containers, reproducible training and serving environments.
• Experiments in production: A/B tests, shadow/canary deploys, holdouts, defined success criteria.

Responsibilities

• Evaluate current pipelines and ML workflows, and define a prioritized plan for changes.
• Own compute provisioning and environment management across services.
• Build LLM infrastructure and smart routing for cost-effective model selection.
• Lead experimentation with shadow deploys, canaries, and holdouts.
• Ensure observability and traceability: drift detection, alerting, lineage, and reproducibility.
• Operate models in production and fix incidents with hands-on debugging.
• Oversee data and feature infrastructure to align training and inference.
• Establish deployment and monitoring standards for the team.

Skills

MLOps

Platform ownership

CI/CD for models

Observability

LLM tooling

Data pipelines

Production ML

Troubleshooting

Tools

SageMaker

dbt

Airflow

PostgreSQL

Redshift

Kubernetes

GitHub Actions

Job description

FutureFit AI is seeking a Staff ML Platform Engineer (MLOps) to build and operate the platform powering our ML and LLM-powered products. You will own compute provisioning, environments, and model routing, ensuring cost efficiency and reliability across batch and real-time serving.

You will lead with discipline in experiment tracking, deployment workflows, observability, and data/feature infrastructure, closely collaborating with the ML and data teams to ship robust, scalable solutions.