AI Systems Engineering Manager for Construction Permitting

PermitFlow; New York, Northern (NY, KY); Hybrid; USD 170,000 - 250,000; Full time

Benefits offered by this job

Equity

Healthcare coverage

401(k)

Unlimited PTO

Home office stipend

Daily meals

Commuter benefits

Job summary

PermitFlow in New York is seeking an Engineering Manager, AI to lead and scale our core agentic infrastructure. You will own both people leadership and technical execution for systems that determine whether an AI agent can submit a permit autonomously or needs human oversight.

You’ll partner with our VP of Engineering and Product Manager to set the quality bar, drive end-to-end roadmaps, and push measurable improvements in accuracy and reliability across production AI workloads.

Qualifications

• 5+ years in software engineering, including 1+ year in engineering leadership.
• Direct experience building or shipping production AI/agentic systems.
• Hands-on familiarity with evaluation infrastructure: golden data sets, human annotation, or online monitoring.
• Strong system design and architecture fundamentals.
• Ability to lead through ambiguity and turn unclear problems into structured execution.
• Deep technical fluency: comfortable in code review and architecture discussions.
• Strong communication across technical and non-technical stakeholders.
• High standards for engineering quality, reliability, and performance.
• Bonus: enterprise SaaS experience.
• Bonus: exposure to complex regulated environments (construction, logistics, government).

Responsibilities

• Lead and grow the engineering team building PermitFlow's agentic infrastructure.
• Foster engineering culture through clear expectations and career development.
• Own the technical architecture behind our workflow agents: orchestration, model serving, latency, cost per task, and failure handling at scale.
• Partner with Product Manager, AI to define reliability criteria and gate releases accordingly.
• Build and scale our evaluation infrastructure: golden data sets, LLM-as-judge pipelines, human annotation tooling, and drift monitoring.
• Drive internal tooling used to test, analyze errors, and hill-climb agentic work.

Job description

PermitFlow in New York is seeking an Engineering Manager, AI to lead and scale our core agentic infrastructure. You will own both people leadership and technical execution for systems that determine whether an AI agent can submit a permit autonomously or needs human oversight.

You’ll partner with our VP of Engineering and Product Manager to set the quality bar, drive end-to-end roadmaps, and push measurable improvements in accuracy and reliability across production AI workloads.