AI Platform Engineering Manager — GenAI, RAG & Scale

NEOGOV

United States

On-site

USD 180,000 - 260,000

Full time

43 hours ago
Be an early applicant
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health benefits
Remote work
401K matching
Paid parental leave
Generous PTO
Career growth
Inclusive environment

Job summary

NEOGOV is hiring an AI Platform Leader to guide a small team building the company's GenAI services, agents, and orchestration for public-sector SaaS products. You will own the roadmap, partner with Product, Data, Infrastructure, and Security to ship at scale with governance and safety in mind.

You will work hands-on on GenAI/LLMs, vector databases, and tool calling, while fostering a high-performing engineering culture and delivering reusable services across NEOGOV's products.

Qualifications

  • 6–8 years engineering with 1–2 years in a manager/tech lead role
  • Shipped shared/platform services used by other engineers
  • Hands-on with GenAI/LLMs, RAG, vector databases, and semantic search
  • Strong .NET and Python for APIs and AI services
  • Solid distributed systems, microservices, event-driven, API-first foundations

Responsibilities

  • Lead the AI/ML team — hire, coach, and grow
  • Own delivery — convert strategy into a prioritized roadmap and ship
  • Build the GenAI platform — services, agents, orchestration, and tool calling
  • Define patterns and shared frameworks for other teams
  • Modernize — microservices, event-driven, API-first, IaC, CI/CD across .NET, Python, cloud-native
  • Governance & safety — evals, guardrails, tracing, PII protection, human-in-the-loop workflows
  • Stay hands-on with design reviews and prototyping

Skills

GenAI/LLMs
Net & Python
Distributed systems
Microservices
Cloud-native SaaS
Leadership

Tools

Langfuse
LangSmith
MLflow
OpenSearch
Snowflake
Databricks
Terraform
AWS CDK
Kubernetes

Job description

NEOGOV is hiring an AI Platform Leader to guide a small team building the company's GenAI services, agents, and orchestration for public-sector SaaS products. You will own the roadmap, partner with Product, Data, Infrastructure, and Security to ship at scale with governance and safety in mind.

You will work hands-on on GenAI/LLMs, vector databases, and tool calling, while fostering a high-performing engineering culture and delivering reusable services across NEOGOV's products.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

AI Platform Engineering Manager – GenAI & Services
AI Platform Engineering Manager – GenAI & Services

NEOGOV • El Segundo (CA)

On-site
USD 180,000 - 260,000
Comprehensive benefits
Generous PTO
Remote work option
+3
GenAI Platform Product Manager, Public Sector
GenAI Platform Product Manager, Public Sector

Scale AI • New York (NY)

On-site
USD 238,000 - 297,000
Equity compensation
Learning stipend
Generous PTO
+2
Remote Enterprise Platform Architect (Cloud & AI)
Remote Enterprise Platform Architect (Cloud & AI)

NEOGOV, Inc. • El Segundo (CA)

On-site
USD 150,000 - 210,000
Competitive compensation
Comprehensive benefits
Generous PTO
+3
Public Sector GenAI Platform Product Lead
Public Sector GenAI Platform Product Lead

Scale AI, Inc. • New York (NY)

On-site
USD 213,000 - 297,000
Health, dental, and vision coverage
Retirement benefits
Learning and development stipend
+2
Enterprise GenAI Platform Lead (Azure)
Enterprise GenAI Platform Lead (Azure)

Apex Systems • Ridgeland (MS), Northern (KY)

Hybrid
USD 150,000 - 230,000
Health insurance
401K matching
ESPP program
+2
Engineering Manager, Agent Oversight Platform
Engineering Manager, Agent Oversight Platform

Scale AI, Inc. • New York (NY)

On-site
USD 252,000 - 315,000
Health, dental and vision coverage
Retirement benefits
Learning and development stipend
+2
Senior AI Platform Architect, GenAI & Applications
Senior AI Platform Architect, GenAI & Applications

Relha LLC • Palo Alto (CA), Northern (KY)

Hybrid
USD 210,000 - 350,000
Staff Engineer - GenAI Platform & LLMOps
Staff Engineer - GenAI Platform & LLMOps

Vibehackers • Northern (KY)

Hybrid
USD 133,000 - 182,000
Dental coverage
Health & dependent care
Disability insurance
+3
Senior AI Platform Architect — LLMs, RAG & Multi-Agent
Senior AI Platform Architect — LLMs, RAG & Multi-Agent

Capgemini • Dallas (TX)

On-site
USD 89,000 - 207,000
Medical, dental, and vision
401(k)
Paid time off
+2
Senior AI Engineer — Generative AI & Enterprise Platforms
Senior AI Engineer — Generative AI & Enterprise Platforms

StatusNeo Inc. • New York (NY), Northern (KY)

Hybrid
USD 150,000 - 230,000