AI Platform Engineer With ROPES ASSESSMENT REQUIRED

Robotic Technologies Automation

Boston (MA)

On-site

USD 78,000 - 112,000

Full time

2 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Robotic Technologies Automation in Boston, MA seeks an AI Platform Engineer to build and operate a production-grade AI platform. You will own orchestration, model gateway, agent registry, retrieval, guardrails and observability, ensuring reliability, security and cost control.

Candidates should have 6+ years in software/platform engineering, strong Python, and experience with LangChain, LLM tooling, and vector stores. This role requires on-site work in Boston and may include hybrid collaboration.

Qualifications

  • Minimum 6+ years in software or platform engineering.
  • Hands-on ownership of AI/ML infrastructure in production.
  • Experience with multi-agent or agentic systems is a plus.
  • Strong Python, Go or Java and containerized environments.

Responsibilities

  • Build and operate a production AI platform including orchestration, model gateway, agent registry, retrieval, guardrails, evaluation and observability.
  • Own reliability, security and cost of the platform.
  • Collaborate with other engineers to provide a robust layer for higher-level services.

Skills

Python
Go
Java
ML infrastructure
Production ownership

Tools

LangGraph
LangChain
LlamaIndex
CrewAI
AutoGen
Google ADK
LiteLLM
Portkey
Kong AI Gateway
TrueFoundry
Vertex AI
vLLM
Ollama
LoRA/QLoRA
Pinecone
Weaviate
pgvector
Elasticsearch

Job description

Title: AI Platform Engineer With ROPES ASSESSMENT REQUIRED
Location: Boston,MA
Duration: 11 Months+ Extension
Bill Rate: $69/hour(C2C)
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: USC, GC, H-1B, OPT-EAD, GC-EAD, H4-EAD

Job Summary

Build and operate a production agentic AI platform: orchestration, model gateway, agent registry, retrieval, guardrails, evaluation and observability. You build the layer other engineers build on, and you own its reliability, security and cost.

Core technical skills

LLM and agent orchestration: LangGraph, LangChain, LlamaIndex, CrewAI, AutoGen, or the Google Agent Development Kit (ADK), with production multi-agent orchestration, state management and retry/fallback design.

Model serving and gateway: LiteLLM, Portkey, Kong AI Gateway, TrueFoundry, or Vertex AI Model Garden; routing, fallback, rate limiting and token/usage capture. Serving open-weight models (Llama, Mistral, Gemma, Qwen) via vLLM, TGI, Ollama or Vertex endpoints; fine-tuning and adapter techniques (LoRA/QLoRA).

Retrieval-augmented generation: vector stores (Vertex Vector Search, Pinecone, Weaviate, pgvector, Elasticsearch), embedding models, chunking, hybrid and semantic search, reranking, and grounding-quality evaluation.

Agent infrastructure: Model Context Protocol (MCP) and tool/function-calling contracts, agent registries, permission enforcement, and the separation of reasoning from acting agents.

Evaluation and LLMOps: eval harness design with RAGAS, DeepEval, Promptfoo, or OpenAI Evals; offline and online evaluation, regression suites, drift and hallucination detection; experiment tracking with MLflow, LangSmith, Langfuse, Arize Phoenix or Braintrust.

Guardrails and AI security: NeMo Guardrails, Guardrails AI, Model Armor, Lakera; prompt-injection, jailbreak and data-leakage defense; PII detection and redaction in prompt and response.

Observability: OpenTelemetry-based tracing for LLM and agent calls, token and latency and cost telemetry, quality-signal monitoring feeding alerting.

Cloud and runtime: Kubernetes and containers, GCP preferred (GKE, Vertex AI, Cloud Run), infrastructure-as-code (Terraform), CI/CD, and SRE practice for production AI services.

Languages: strong Python; Go or Java useful for platform services.

Experience
  • Typically 6+ years in software or platform engineering, with hands-on production ownership of AI or ML infrastructure. Has personally built and operated agentic or LLM systems in production, not only prototyped them.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Platform Engineer With ROPES ASSESSMENT REQUIRED
AI Platform Engineer With ROPES ASSESSMENT REQUIRED

Robotics Technologies LLC • Boston (MA)

On-site
USD 78,000 - 112,000
AI Platform Engineer With ROPES ASSESSMENT REQUIRED
AI Platform Engineer With ROPES ASSESSMENT REQUIRED

Quantum Technologies LLC • Boston (MA)

On-site
USD 78,000 - 112,000
AI Platform Engineer With ROPES ASSESSMENT REQUIRED
AI Platform Engineer With ROPES ASSESSMENT REQUIRED

CloudBigD • Boston (MA)

On-site
USD 78,000 - 112,000
AI Platform Engineer With ROPES ASSESSMENT REQUIRED
AI Platform Engineer With ROPES ASSESSMENT REQUIRED

Valiant Technologies LLC • Boston (MA)

On-site
USD 78,000 - 112,000
AI Platform Engineer With ROPES ASSESSMENT REQUIRED
AI Platform Engineer With ROPES ASSESSMENT REQUIRED

Ethereum Technologies • Boston (MA)

On-site
USD 78,000 - 112,000
AI Engineer
AI Engineer

Robotic Process Automation LLC • New York (NY)

Remote
USD 88,000 - 125,000
AI Software Engineer
AI Software Engineer

Valiant Technologies LLC • Dearborn (MI)

On-site
USD 94,000 - 134,000
Gen AI Engineer
Gen AI Engineer

Ethereum Technologies LLC • Chicago (IL)

On-site
USD 140,000 - 200,000
AI Engineer
AI Engineer

Quantum Technologies LLC • Phoenix (AZ)

On-site
USD 82,000 - 117,000
AI Engineer
AI Engineer

Valiant Technologies LLC • Cupertino (CA)

On-site
USD 82,000 - 117,000