Production ML Engineer for LLM Systems & Guardrails

Latitude

Austin (TX)

On-site

USD 224,000 - 279,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Fluidstack in Austin, TX is seeking a senior ML/LLM engineer to build and run models inside the company's operations, from framing to deployment and iteration in production.

You will own end-to-end models, ship agentic systems with guardrails and audits, and collaborate with data engineering and product teams to put predictions into the tools people use daily.

Experience shipping ML features to production and strong coding capabilities with AI tooling are required.

Qualifications

  • Shipped ML or LLM features to production and owned them after launch.
  • Built evaluation harnesses that tell the truth about model quality before users.
  • Prefer the simplest model that works and can defend the choice.
  • Hands-on with LLM APIs, fine-tuning, or retrieval systems on real business problems.
  • Write production-grade code and work with AI coding tools.

Responsibilities

  • Build ML/LLM systems that run inside Fluidstack operations: forecasting build timelines, flagging schedule risk, and extracting structure from vendor documents.
  • Own models end to end, from problem framing and data through deployment, evaluation, and iteration in production.
  • Ship agentic systems with guardrails, authorization, audit, and evals, so agents act on company systems.
  • Partner with data engineering and product pods to put predictions in the tools people already use.

Skills

ML features shipped
LLM APIs experience
Production code
Evaluation harnesses
Retrieval systems

Job description

Fluidstack in Austin, TX is seeking a senior ML/LLM engineer to build and run models inside the company's operations, from framing to deployment and iteration in production.

You will own end-to-end models, ship agentic systems with guardrails and audits, and collaborate with data engineering and product teams to put predictions into the tools people use daily.

Experience shipping ML features to production and strong coding capabilities with AI tooling are required.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

ML Engineer: Build Production LLMs and Agentic Systems
ML Engineer: Build Production LLMs and Agentic Systems

Fluidstack • Seattle (WA), New York (NY), San Francisco (CA), Austin (TX)

On-site
USD 130,000 - 180,000
Machine Learning Engineer
Machine Learning Engineer

Latitude • Austin (TX)

On-site
USD 224,000 - 279,000
Machine Learning Engineer
Machine Learning Engineer

Fluidstack • Seattle (WA), New York (NY), San Francisco (CA), Austin (TX)

On-site
USD 130,000 - 180,000
Senior GenAI ML Engineer: LLMs & Cloud Pipelines
Senior GenAI ML Engineer: LLMs & Cloud Pipelines

MACHINE LEARNING TECHNOLOGIES LLC • Austin (TX)

On-site
USD 83,000 - 165,000
Staff ML Engineer: End-to-End AI for Risk
Staff ML Engineer: End-to-End AI for Risk

Steadily • Austin (TX)

On-site
USD 180,000 - 240,000
Top of market salary + equity
3 weeks PTO + 6 federal holidays
Medical, dental, vision, life, disable
+4
Senior ML Engineer, LLMOps & Production Systems
Senior ML Engineer, LLMOps & Production Systems

Tech Economy • Houston (TX)

Hybrid
USD 148,000 - 162,000
Lead ML Architect for Scalable AI/LLM Platform
Lead ML Architect for Scalable AI/LLM Platform

Cloudflare • United States

Hybrid
USD 130,000 - 160,000
Equal Opportunity Employer
Diversity and Inclusiveness Initiatives
Reasonable accommodations for applicants with disabilities
Production ML Engineer: LLMs, RAG & MLOps on GCP
Production ML Engineer: LLMs, RAG & MLOps on GCP

DeepHow • United States

On-site
USD 140,000 - 210,000
ML Engineer: Production AI & LLM Systems
ML Engineer: Production AI & LLM Systems

CodeGeniusRecruit • United States

On-site
USD 413,000 - 551,000
Software Engineer (Applied AI)
Software Engineer (Applied AI)

Socket.dev • Cupertino (CA)

On-site
USD 180,000 - 240,000