Senior AI Platform Engineer: Production-Grade LLM Ops

Robotics Technologies LLC

Boston (MA)

On-site

USD 78,000 - 112,000

Full time

4 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Robotics Technologies LLC in Boston, MA is seeking an experienced AI Platform Engineer to build and operate a production agentic AI platform, focusing on orchestration, model gateway, and observability. You will own reliability, security and cost, and implement guardrails and evaluation tooling.

The role involves working with LangGraph/LangChain, multi-agent orchestration, and modern ML tooling on Kubernetes with cost-aware design. Boston-based, USC/GC/H-1B-OPT compatible candidates preferred.

Qualifications

  • Typically 6+ years in software or platform engineering with hands-on production ownership of AI or ML infrastructure.
  • Experience building and operating agentic or LLM systems in production, not only prototyping.
  • Strong Python and cloud-native tooling experience.

Responsibilities

  • Build and operate a production AI platform with orchestration, model gateway, agent registry, retrieval, guardrails, evaluation and observability.
  • Own reliability, security and cost of the platform; implement robust guardrails and monitoring.

Skills

LangGraph
LangChain
LlamaIndex
MCP
RAG/LLMOps
Python
Go/Java

Tools

Vertex AI
Kong AI Gateway
vLLM
Ollama
Pinecone
Weaviate
Elasticsearch
Terraform
OpenTelemetry

Job description

Robotics Technologies LLC in Boston, MA is seeking an experienced AI Platform Engineer to build and operate a production agentic AI platform, focusing on orchestration, model gateway, and observability. You will own reliability, security and cost, and implement guardrails and evaluation tooling.

The role involves working with LangGraph/LangChain, multi-agent orchestration, and modern ML tooling on Kubernetes with cost-aware design. Boston-based, USC/GC/H-1B-OPT compatible candidates preferred.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead AI Platform Engineer: LLM Orchestration & Ops
Lead AI Platform Engineer: LLM Orchestration & Ops

Robotic Technologies Automation • Boston (MA)

On-site
USD 78,000 - 112,000
AI Platform Engineer: Production LLM Orchestration
AI Platform Engineer: Production LLM Orchestration

CloudBigD • Boston (MA)

On-site
USD 78,000 - 112,000
Senior AI Platform Engineer — Production LLM Ops
Senior AI Platform Engineer — Production LLM Ops

Valiant Technologies LLC • Boston (MA)

On-site
USD 78,000 - 112,000
Boston AI Platform Engineer — Production LLM & Agents
Boston AI Platform Engineer — Production LLM & Agents

Ethereum Technologies • Boston (MA)

On-site
USD 78,000 - 112,000
AI Platform Engineer: Production LLM Infra & Orchestration
AI Platform Engineer: Production LLM Infra & Orchestration

Quantum Technologies LLC • Boston (MA)

On-site
USD 78,000 - 112,000
Senior AI Platform Engineer - Production Systems
Senior AI Platform Engineer - Production Systems

People in AI • San Francisco (CA)

Hybrid
USD 140,000 - 200,000
Senior AI Platform Engineer: LLMs, Vector DB, AWS
Senior AI Platform Engineer: LLMs, Vector DB, AWS

Robotic Technologies Automation • Chicago (IL)

On-site
USD 150,000 - 210,000
AI Platform Engineer With ROPES ASSESSMENT REQUIRED
AI Platform Engineer With ROPES ASSESSMENT REQUIRED

Robotics Technologies LLC • Boston (MA)

On-site
USD 78,000 - 112,000
AI Platform Engineer With ROPES ASSESSMENT REQUIRED
AI Platform Engineer With ROPES ASSESSMENT REQUIRED

Quantum Technologies LLC • Boston (MA)

On-site
USD 78,000 - 112,000
AI Platform Engineer With ROPES ASSESSMENT REQUIRED
AI Platform Engineer With ROPES ASSESSMENT REQUIRED

Ethereum Technologies • Boston (MA)

On-site
USD 78,000 - 112,000