AI Engineering Manager: Agent Infrastructure Leader

permitflow; United States; On-site; USD 180,000 - 240,000; Full time

Job summary

PermitFlow is redefining how America builds. We are seeking an Engineering Manager, AI to lead and scale the engineering team building PermitFlow's core agentic infrastructure and evaluation systems.

This builder-leader role owns both people leadership and technical execution for systems that decide whether an AI agent can submit a permit on its own, or needs a human in the loop. You will report to the VP of Engineering and collaborate with our Product Manager, AI to move the quality bar forward.

Qualifications

• 5+ years in software engineering and 1+ year in leadership.
• Direct experience building or shipping a production AI/agentic system.
• Hands-on familiarity with evaluation infrastructure (golden data sets, LLM-as-judge, human annotation, monitoring).
• Strong system design and architecture fundamentals with judgment on when an agent is ready to submit.

Responsibilities

• Lead and grow an engineering team building and hardening PermitFlow's agentic infrastructure, raising ownership, quality, and execution speed.
• Build a strong engineering culture through clear expectations, 1:1s, feedback loops, and career development.
• Own the technical architecture behind workflow agents: orchestration, model serving, latency, cost per task, and failure handling at scale.
• Partner with Product Manager, AI to define reliability criteria and build systems that gate releases against that bar.
• Build and scale evaluation infrastructure: golden data sets, LLM-as-judge pipelines, annotation tooling, and drift/regression monitoring.
• Drive internal tooling used to test, error-analyze, and hill-climb agentic work across teams.
• Improve system reliability, observability, and engineering efficiency as usage scales.
• Play a key role in hiring and developing engineers with ML/AI systems depth.

Skills

Software engineering

Engineering leadership

AI systems

Evaluation infrastructure

System design

Job description

PermitFlow is redefining how America builds. We are seeking an Engineering Manager, AI to lead and scale the engineering team building PermitFlow's core agentic infrastructure and evaluation systems.

This builder-leader role owns both people leadership and technical execution for systems that decide whether an AI agent can submit a permit on its own, or needs a human in the loop. You will report to the VP of Engineering and collaborate with our Product Manager, AI to move the quality bar forward.