AI Platform Engineer: Production LLM Infra & Orchestration

Quantum Technologies. LLC

Boston (MA)

On-site

USD 78,000 - 112,000

Full time

3 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Quantum Technologies. LLC in Boston seeks an AI Platform Engineer to build and operate a production agentic AI platform, overseeing orchestration, model gateways, registries, retrieval, guardrails, evaluation and observability. You own reliability, security and cost.

The role focuses on creating the layer others build on, ensuring scalable, secure AI services with cost-aware operations, employing LLM orchestration, model serving, retrieval and governance.

Qualifications

  • Typically 6+ years in software or platform engineering with production ownership of AI/ML infrastructure.
  • Has personally built and operated agentic or LLM systems in production, not just prototypes.

Responsibilities

  • Build and operate a production AI platform including orchestration, model gateway, registry, retrieval and guardrails.
  • Own reliability, security and cost of the platform.
  • Ensure observability with tracing, metrics and alerting for LLM and agent calls.
  • Implement scalable, secure and compliant AI services with governance.

Skills

LLM orchestration
Model serving
Retrieval-augmented generation
Agent infrastructure
Evaluation and LLMOps
Guardrails and AI security
Observability
Cloud and runtime
Python

Tools

Kubernetes
GKE
Vertex AI
LangChain
OpenTelemetry

Job description

Quantum Technologies. LLC in Boston seeks an AI Platform Engineer to build and operate a production agentic AI platform, overseeing orchestration, model gateways, registries, retrieval, guardrails, evaluation and observability. You own reliability, security and cost.

The role focuses on creating the layer others build on, ensuring scalable, secure AI services with cost-aware operations, employing LLM orchestration, model serving, retrieval and governance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Platform Engineer: Production LLM Orchestration
AI Platform Engineer: Production LLM Orchestration

CloudBigD • Boston (MA)

On-site
USD 78,000 - 112,000
Senior AI Platform Engineer — Production LLM Ops
Senior AI Platform Engineer — Production LLM Ops

Valiant Technologies LLC • Boston (MA)

On-site
USD 78,000 - 112,000
Enterprise AI Agent Platform Engineer
Enterprise AI Agent Platform Engineer

Quantum Technologies. LLC • Chicago (IL)

On-site
USD 140,000 - 200,000
AI Platform Engineer — Self-Service, Guarded AI Systems
AI Platform Engineer — Self-Service, Guarded AI Systems

Quantum Technologies. LLC • Boston (MA)

On-site
USD 140,000 - 190,000
LLM Platform Engineer - Production AI Gateway
LLM Platform Engineer - Production AI Gateway

mpathic • United States

Remote
USD 140,000 - 200,000
AI Full-Stack Engineer: LLM & Cloud Platforms
AI Full-Stack Engineer: LLM & Cloud Platforms

Quantum Technologies LLC • Dallas (TX)

On-site
USD 98,000 - 139,000
GenAI Engineer - Agentic AI & LLM Orchestration
GenAI Engineer - Agentic AI & LLM Orchestration

Quantum Technologies LLC • New York (NY)

On-site
USD 98,000 - 139,000
Senior AI Agent Engineer and Production Orchestration
Senior AI Agent Engineer and Production Orchestration

Quantum Technologies. LLC • California

On-site
USD 180,000 - 240,000
Competitive salary
Health insurance
AI Platform Engineer: LLM Orchestration & Cloud-Native
AI Platform Engineer: LLM Orchestration & Cloud-Native

Valiant Technologies LLC • Chicago (IL)

On-site
USD 130,000 - 190,000
Enterprise AI Guardrails & GenAI ML Engineer
Enterprise AI Guardrails & GenAI ML Engineer

Quantum Technologies. LLC • Charlotte (NC)

On-site
USD 180,000 - 240,000