AI Platform Engineer — On-Site in Newark, NJ

Moring AI

Town of Newark (WI)

On-site

USD 60,000 - 80,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Moring AI is hiring an AI Engineer to build and scale its AI platform and the agents that run on it. You’ll focus on the platform, including the LLM gateway, agent runtime, MCP servers, the registry, evals, and observability, collaborating with a tech lead and an architect.

You’ll deploy inside customer environments with strict security constraints and no internet egress. You’ll work directly with an enterprise customer, often alongside a senior engineer, ensuring reliability, cost management,

Qualifications

  • 2–5 years of software engineering experience shipping production systems.
  • Strong Python and the habits of a production engineer: testing, code review, observability.
  • Good grounding in APIs, data, and distributed systems.
  • Experience with AWS (ECS or EKS, Lambda, IAM, networking) and infrastructure-as-code (Terraform or CDK).
  • Real AI work from roughly the last year: built agents, RAG pipelines, or LLM apps hands-on.

Responsibilities

  • Build features in the LLM gateway: routing, caching, rate limits, per-customer model rules, and cost tracking.
  • Build parts of the agent runtime: how agents start, run, hold state, and get versioned and rolled back.
  • Build MCP servers for tools and data, hosted inside the customer's boundary, with proper scopes and security.
  • Extend the AI registry: models, agents, prompts, tools, and datasets, with owners, versions, and approval state.
  • Add governance: policy checks, guardrails, approval steps, and audit logs.
  • Write evals and regression tests to ensure changes ship with evidence.
  • Add tracing, cost and latency dashboards, and quality monitoring.
  • Build retrieval pipelines that respect caller's permissions and measure effectiveness.

Skills

Python
APIs & data
Distributed systems
AWS
Terraform
CDK
LLM apps
Agent framework
RAG pipelines
Observability

Tools

AWS ECS/EKS
Lambda
Terraform
CDK

Job description

Moring AI is hiring an AI Engineer to build and scale its AI platform and the agents that run on it. You’ll focus on the platform, including the LLM gateway, agent runtime, MCP servers, the registry, evals, and observability, collaborating with a tech lead and an architect.

You’ll deploy inside customer environments with strict security constraints and no internet egress. You’ll work directly with an enterprise customer, often alongside a senior engineer, ensuring reliability, cost management,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Platform Engineer — Enterprise Production Systems
AI Platform Engineer — Enterprise Production Systems

Moring AI • Raleigh (NC)

On-site
USD 60,000 - 80,000
AI Platform Engineer - Enterprise On-Prem
AI Platform Engineer - Enterprise On-Prem

Moring AI • Texas

On-site
USD 60,000 - 80,000
Senior AI Platform Engineer: Build Internal AI Apps
Senior AI Platform Engineer: Build Internal AI Apps

PCOnline • Newark (DE)

On-site
USD 120,000 - 160,000
Senior AI Platform Architect - Kubernetes, AWS, Onsite Newark
Senior AI Platform Architect - Kubernetes, AWS, Onsite Newark

Moring AI • Town of Newark (WI)

On-site
USD 160,000 - 180,000
AI Platform Engineer – Enterprise Production
AI Platform Engineer – Enterprise Production

Moring AI • Alpharetta (GA)

On-site
USD 60,000 - 80,000
Senior AI Platform Tech Lead (On-Site Newark)
Senior AI Platform Tech Lead (On-Site Newark)

Moring AI • Newark (NJ)

On-site
USD 100,000 - 125,000
AI Observability Engineer – Enterprise Platform, On‑Site Newark
AI Observability Engineer – Enterprise Platform, On‑Site Newark

Moring AI • Town of Newark (WI)

On-site
USD 130,000 - 190,000
AI Agents Platform Engineer — NYC Onsite, Equity
AI Agents Platform Engineer — NYC Onsite, Equity

Morgan Pinnacle Group • New York (NY)

On-site
USD 150,000 - 300,000
Equity: Highly competitive equity
AI Integration Engineer — On-site NYC Platforms
AI Integration Engineer — On-site NYC Platforms

Objective Partners • New York (NY)

On-site
USD 103,000 - 110,000
AI Platform Architect
AI Platform Architect

Kastech Software Solutions Group • New York (NY)

Hybrid
USD 150,000 - 210,000