AI Platform Engineer — Enterprise Production Systems

Moring AI

Raleigh (NC)

On-site

USD 60,000 - 80,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Moring.ai is hiring an AI Engineer to help build our AI platform and the agents that run on it. You will work on the platform components, including the LLM gateway, agent runtime, MCP servers, registry, and observability, delivering end-to-end features inside customer environments with strict security constraints.

The role focuses on engineering fundamentals, hands-on AI work within the last year, and collaboration with senior engineers and enterprise customers to ensure reliability, cost

Qualifications

  • 2-5 years of software engineering experience shipping production systems (backend, platform, or full stack).
  • Strong Python and the habits of a production engineer: testing, code review, observability.
  • Good grounding in APIs, data, and distributed systems.
  • Working knowledge of AWS (ECS or EKS, Lambda, IAM, networking) and infrastructure-as-code (Terraform or CDK).
  • Real AI work from roughly the last year: built agents, RAG pipelines, or LLM applications hands-on.

Responsibilities

  • Build features in the LLM gateway: routing, caching, rate limits, per-customer model rules, and cost tracking.
  • Build parts of the agent runtime: how agents start, run, hold state, and get versioned and rolled back.
  • Build MCP servers for tools and data, hosted inside the customer's boundary, with scopes and security handled properly.
  • Build and extend the AI registry: models, agents, prompts, tools, and datasets, with owners, versions, and approval state.
  • Add governance pieces: policy checks, guardrails, approval steps, and audit logs.
  • Write evals and regression tests so AI changes ship with evidence.

Skills

Python
APIs
Distributed systems
Testing
Observability

Tools

AWS (ECS/EKS/Lambda)
Terraform/CDK
LangGraph / CrewAI
Model APIs (Anthropic/OpenAI/Bedrock)

Job description

Moring.ai is hiring an AI Engineer to help build our AI platform and the agents that run on it. You will work on the platform components, including the LLM gateway, agent runtime, MCP servers, registry, and observability, delivering end-to-end features inside customer environments with strict security constraints.

The role focuses on engineering fundamentals, hands-on AI work within the last year, and collaboration with senior engineers and enterprise customers to ensure reliability, cost

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Platform Engineer – Enterprise Production
AI Platform Engineer – Enterprise Production

Moring AI • Alpharetta (GA)

On-site
USD 60,000 - 80,000
AI Platform Engineer - Enterprise On-Prem
AI Platform Engineer - Enterprise On-Prem

Moring AI • Texas

On-site
USD 60,000 - 80,000
Enterprise AI Engineer - Production Systems & Governance
Enterprise AI Engineer - Production Systems & Governance

Moring, inc. • Alpharetta (GA)

On-site
USD 60,000 - 80,000
AI Platform Engineer — On-Site in Newark, NJ
AI Platform Engineer — On-Site in Newark, NJ

Moring AI • Town of Newark (WI)

On-site
USD 60,000 - 80,000
Senior AI Platform Engineer - Production Systems
Senior AI Platform Engineer - Production Systems

People in AI • San Francisco (CA)

Hybrid
USD 140,000 - 200,000
AI Platform & Gateway Engineer (LLMs & Automation)
AI Platform & Gateway Engineer (LLMs & Automation)

Apt • Birmingham (AL)

On-site
USD 120,000 - 160,000
AI Platform Engineer - Real-Time Enterprise AI
AI Platform Engineer - Real-Time Enterprise AI

Eloquent AI • San Francisco (CA)

On-site
USD 120,000 - 180,000
AI Platform Engineer: LLM Agents & RAG Architect
AI Platform Engineer: LLM Agents & RAG Architect

Equinix, Inc. • Redwood City (CA)

On-site
USD 142,000 - 212,000
AI Platform Engineer - LLMs & Enterprise Apps
AI Platform Engineer - LLMs & Enterprise Apps

Bigbear.ai • McLean (VA)

Hybrid
USD 120,000 - 180,000
AI Platform Engineer — Remote, Infra for Agents & LLM
AI Platform Engineer — Remote, Infra for Agents & LLM

Life360 • United States

Remote
USD 180,000 - 280,000
Paid parental leave
401(k) matching
Flexible PTO
+1