Senior AI Platform Architect Engineering Alpharetta, GA, USA (on-site) →

Moring, inc.; Alpharetta (GA); On-site; USD 160,000 - 180,000; Full time

Job summary

Moring.ai is building an enterprise AI platform for a regulated financial services client. We seek a Senior AI Platform Architect to own the platform architecture, write design docs, review code, and present solutions to security and client teams.

Location: Alpharetta, GA; 100% onsite. 10–15 years’ experience in platforms. Competitive salary with bonus and stock options; travel up to 10%.

Qualifications

• 10–12 years of software engineering, with platform-building focus.
• Very strong Kubernetes: production workloads, networking, security & multi-tenancy.
• Very good AWS: EKS, IAM, VPC, private endpoints, Terraform or CDK.
• Solid understanding of AI platform concepts: LLM gateways, agent runtimes, MCP, RAG, evals, observability.
• Strong distributed systems, API design, and security fundamentals.
• Comfortable in Python for reference implementations and code reviews.
• Experience in large, regulated enterprises (finance/insurance/healthcare).
• Ability to write and defend design documents to a client’s architect.

Responsibilities

• Own the end-to-end architecture of the AI platform: gateway, agent runtime, MCP layer, skills/asset registry, retrieval, evals, observability, identity and governance.
• Design how agents run on Kubernetes: packaging, scheduling, scaling, isolation, networking, state, memory, versioning, promotion, rollback.
• Design AWS foundation the platform sits on: EKS, IAM, networking, private endpoints, and IaC, for a regulated enterprise with restricted egress.
• Define the identity model for agents: authentication, user delegation, audit trail.
• Define the developer experience: from idea to deployed agent with guardrails and minimal friction.
• Set patterns for MCP servers, skills, tools, prompts so they are reusable, versioned, governed.
• Write architecture docs and reference implementations, and review designs and code.
• Present the architecture to the customer’s chief architect, platform teams, security and model risk reviewers and incorporate constraints.
• Evaluate new AI platform capabilities (providers, frameworks, runtimes, registries) and decide what belongs in the platform.
• Mentor senior engineers and raise the team’s platform engineering practices.

Skills

Kubernetes

AWS

Python

Platform architecture

Security fundamentals

Distributed systems

API design

Tools

Terraform

CDK

Bedrock AgentCore

Job description

About Us

Moring.ai builds enterprise AI that runs in production for regulated industries: financial services and other compliance-heavy organizations. We ship AI applications and agents inside our customers’ own cloud environments, wired into the systems they already run. Not slideware, not demos.

We’re early-stage, lean, and profitable, so what you build reaches serious enterprises fast.

The Role

We are building an AI platform for a large financial services enterprise. It lets developers inside that organization build and deploy agentic AI workflows: Python applications that call LLMs, use tools, and run as agents on Kubernetes. The platform includes an LLM gateway, an agent runtime, MCP servers for tools and data, a skills registry, retrieval, evaluation, observability, and the identity and governance controls a bank needs before it says yes.

We are hiring a Senior AI Platform Architect to own the architecture of this platform. You have 10–12 years of experience and you have built platforms before: a cloud platform, a developer platform, a container platform, or an internal platform other engineers build on. You know AWS well and Kubernetes very well, because the platform runs on Kubernetes and so do the agents. On top of that, you understand the concepts that make up an AI platform (MCP, RAG, agent runtimes such as Bedrock AgentCore, skills and tool registries, gateways, evals) and you can design how they fit together.

This is a hands-on role. You will write design documents, review code, build reference implementations, and make the architecture calls that the engineering team follows. You will also present and defend the architecture to the customer’s architects and security teams.

What You’ll Do

• Own the end-to-end architecture of the AI platform: gateway, agent runtime, MCP layer, skills and asset registry, retrieval, evals, observability, identity, and governance.
• Design how agents run on Kubernetes: packaging, scheduling, scaling, isolation, networking, state and memory, versioning, promotion, and rollback.
• Design the AWS foundation the platform sits on: EKS, IAM, networking, private endpoints, and infrastructure-as-code, built for a regulated enterprise with restricted egress.
• Define the identity model for agents: how an agent authenticates as itself, acts on behalf of a user without gaining more access than that user has, and leaves an audit trail.
• Define the developer experience: how a developer in the customer’s organization goes from an idea to a deployed agent, with the right guardrails and the least friction.
• Set the patterns for MCP servers, skills, tools, and prompts so they are reusable, versioned, and governed.
• Write architecture documents and reference implementations, and review the team’s designs and code against them.
• Present the architecture to the customer’s chief architect, platform teams, and security and model risk reviewers, and incorporate their constraints into the design.
• Evaluate new AI platform capabilities (model providers, agent frameworks, runtimes, registries) and decide what belongs in the platform.
• Mentor senior engineers and raise the team’s platform engineering practices.

What We’re Looking For

• 10–12 years of software engineering, with a substantial part of it spent building platforms: cloud, developer, container, or internal platforms, or as a software architect with deep platform knowledge.
• Very strong Kubernetes: you have designed and run production workloads on it, and you understand networking, scheduling, security, multi-tenancy, and operators, not just deployments.
• Very good AWS: EKS, IAM, VPC networking, private endpoints, Terraform or CDK. You have built and operated a cloud platform before.
• Solid understanding of AI platform concepts: LLM gateways, agent runtimes (Bedrock AgentCore or comparable), MCP, RAG and retrieval, skills and tool registries, evals, and AI observability. You can explain how each piece fits and where the risks are.
• Strong distributed systems, API design, and security fundamentals.
• Comfortable in Python, enough to build reference implementations and review code.
• Experience working inside large enterprises, preferably regulated ones (financial services, insurance, healthcare). You know the difference between a policy you can configure around and one that forces a redesign.
• You can write a clear design document and defend a trade-off in front of a client’s chief architect.

Role Details

• Location: Alpharetta, GA (100% onsite)
• Years of experience: 10–15
• Type: Full-time, hands-on architect
• Salary: 160-180k + 25k Bonus + Stock Options (Based on experience and match to the role)
• Travel: Up to 10% to customer sites
• Work authorization: Must be authorized to work in the United States (GC/EAD/US Citizen)