Enterprise AI Engineer - Production Systems & Governance

Moring, inc.; Alpharetta (GA); On-site; USD 60,000 - 80,000; Full time

Job summary

Moring.ai is hiring an AI Engineer to help build our AI platform and the agents that run on it. You've spent 2–5 years as a software engineer and in the last year or so you've gone hands-on with AI: agents, RAG, LLM-powered features. Not just reading about them.

You're focused on a platform that includes the LLM gateway, agent runtime, MCP servers, registry, evals, and observability. Your code will operate inside a bank's cloud environment with strict security, audit trails, and no internet

Qualifications

• 2–5 years of software engineering experience shipping production systems.
• Strong Python and production-grade engineering habits (testing, code review, observability).
• Familiarity with APIs, data, and distributed systems.
• Working knowledge of AWS (ECS/EKS, Lambda, IAM) and IaC like Terraform or CDK.
• Real AI work in the last year: agents, RAG pipelines, or LLM applications.
• Experience with major model APIs and at least one agent framework.
• Understanding of LLM behavior, costs, latency, and non-deterministic testing.
• Interest in working directly with enterprise customers and ability to explain trade-offs.

Responsibilities

• Build features in the LLM gateway: routing, caching, rate limits, per-customer rules, cost tracking.
• Develop parts of the agent runtime: startup, state, versioning, rollback.
• Create MCP servers for tools and data within customer boundaries.
• Extend the AI registry: models, agents, prompts, tools, datasets with ownership and versions.
• Add governance: policy checks, guardrails, approval steps, audit logs.
• Write evals and regression tests to ensure AI changes ship with evidence.
• Add tracing, cost and latency dashboards, and quality monitoring.
• Build retrieval pipelines that respect caller permissions and validate functionality.
• Deploy into customer AWS environments with private VPCs and restricted networks.
• Support demos, security reviews, and enterprise customer engagements.
• Own features from design through deployment and operate what you build.

Skills

Python

Distributed systems

AWS

APIs

Testing

Observability

RAG

LLM applications

Terraform

CDK

Tools

Terraform

CDK

ECS/EKS

Job description

Moring.ai is hiring an AI Engineer to help build our AI platform and the agents that run on it. You've spent 2–5 years as a software engineer and in the last year or so you've gone hands-on with AI: agents, RAG, LLM-powered features. Not just reading about them.

You're focused on a platform that includes the LLM gateway, agent runtime, MCP servers, registry, evals, and observability. Your code will operate inside a bank's cloud environment with strict security, audit trails, and no internet