AI Platform Engineer: Production LLM Orchestration

CloudBigD

Boston (MA)

Sur place

USD 78 000 - 112 000

Plein temps

Il y a 6 heures
Soyez parmi les premiers à postuler

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

CloudBigD in Boston, MA seeks an experienced AI Platform Engineer to build and operate a production-grade agentic AI platform, including orchestration, model gateway and retrieval. You will own reliability, security and cost, collaborating with ML and platform teams to deliver scalable AI services.

Role requires deep knowledge of LangGraph, LangChain, LlamaIndex, Kubernetes-based deployments on GCP, and strong OpenTelemetry observability practices.

Qualifications

  • 6+ years in software or platform engineering with hands-on ownership of AI/ML infrastructure.
  • Has built and operated agentic or LLM systems in production, not just prototypes.
  • Experience delivering reliable, secure, and cost-efficient AI platforms.

Responsabilités

  • Build and operate a production agentic AI platform including orchestration, model gateway, retrieval and observability.
  • Own reliability, security and cost of the platform.
  • Collaborate with ML and platform teams to deploy scalable solutions.

Connaissances

Python programming
Go/Java for platform services
ML infrastructure
Cloud orchestration
Security & cost awareness

Outils

Kubernetes
Terraform
Vertex AI
LangGraph
OpenTelemetry
GKE
vLLM

Description du poste

CloudBigD in Boston, MA seeks an experienced AI Platform Engineer to build and operate a production-grade agentic AI platform, including orchestration, model gateway and retrieval. You will own reliability, security and cost, collaborating with ML and platform teams to deliver scalable AI services.

Role requires deep knowledge of LangGraph, LangChain, LlamaIndex, Kubernetes-based deployments on GCP, and strong OpenTelemetry observability practices.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

AI Platform Engineer: Production LLM Infra & Orchestration
AI Platform Engineer: Production LLM Infra & Orchestration

Quantum Technologies. LLC • Boston (MA)

Sur place
USD 78 000 - 112 000
Senior AI Platform Engineer — Production LLM Ops
Senior AI Platform Engineer — Production LLM Ops

Valiant Technologies LLC • Boston (MA)

Sur place
USD 78 000 - 112 000
AI Platform Engineer: LLM Orchestration & Cloud-Native
AI Platform Engineer: LLM Orchestration & Cloud-Native

Valiant Technologies LLC • Chicago (IL)

Sur place
USD 130 000 - 190 000
Senior AI Platform Lead: Architect & Build Production LLMs
Senior AI Platform Lead: Architect & Build Production LLMs

OpenLoop • États-Unis

Hybride
USD 180 000 - 240 000
Equity
Competitive compensation
Health benefits
+2
Senior AI Engineer - LLM Orchestration & Cloud Infra
Senior AI Engineer - LLM Orchestration & Cloud Infra

Ethereum Technologies • Chicago (IL)

Sur place
USD 165 000 - 210 000
Senior AI Platform Architect: LLMs, RAG & Agent Orchestration
Senior AI Platform Architect: LLMs, RAG & Agent Orchestration

Capgemini • Dallas (TX)

Sur place
USD 54 000 - 85 000
Medical insurance
Dental insurance
Vision insurance
+1
Senior AI Platform Engineer – Production & LLM Workflows
Senior AI Platform Engineer – Production & LLM Workflows

Cloudbeds • San Diego (CA)

Sur place
USD 160 000 - 250 000
Paid Time Off
Fully Paid Parental Leave
Home Office Stipend
+4
Senior AI Platform Engineer for Production LLMs & Agents
Senior AI Platform Engineer for Production LLMs & Agents

lgads • Denver (CO)

Sur place
USD 140 000 - 190 000
Senior AI Platform Engineer – LLM & Production Systems
Senior AI Platform Engineer – LLM & Production Systems

Compunnel Inc. • Jersey City (NJ)

Sur place
USD 150 000 - 230 000
Senior AI Platform Engineer: LLMs, Vector DB, AWS
Senior AI Platform Engineer: LLMs, Vector DB, AWS

Robotic Technologies Automation • Chicago (IL)

Sur place
USD 150 000 - 210 000