Senior Manager of AI Product Engineering

People in AI; United States; Remote; USD 150,000 - 250,000; Full time

Job summary

People in AI is seeking a Senior Manager of AI Product Engineering (Agentic AI, Architecture & SaaS). This remote US role leads architecture for customer-facing AI across an established SaaS portfolio, and pairs hands-on coding with technical leadership.

You will own agentic workflows, mentor a small senior AI team, drive production AI at scale, and collaborate with product engineering to ship safe, evaluated AI features across platforms.

Qualifications

• Hands-on delivery of production agentic AI systems.
• Experience with orchestration, memory, context management in agentic workflows.
• Strong knowledge of LLM application architecture, retrieval, evaluation, and prompt engineering.
• Experience operating at SaaS scale and improving existing products and architectures.
• Ability to clearly communicate complex architecture to engineers and executives.
• A collaborative player-coach who mentors teams and handles regulatory constraints.

Responsibilities

• Own architecture across agentic workflows, content generation, retrieval, memory, and other customer-facing AI capabilities.
• Design agent architectures, orchestration patterns, integrations, and reference implementations for wider teams.
• Establish rigorous evaluation methodologies and quality standards for production AI features.
• Lead build-versus-buy decisions covering models, infrastructure, hosting, evaluation.
• Partner with product and platform teams to prototype, productionize, and transfer ownership without bottlenecks.
• Define approaches to data governance, tenant isolation, model hosting, privacy, cost management, and enterprise needs.
• Coach engineers through architecture reviews, workshops, demos while continuing to write production code.

Skills

Production AI ownership

Agentic systems design

LLM architecture

SaaS scale

Clear communication

Collaborative leadership

Job description

Senior Manager of AI Product Engineering (Agentic AI, Architecture & SaaS)

Compensation: Up to $250,000 base + bonus

Location: Remote, US

The Company

An established, PE-backed B2B SaaS company operating in a regulated market is making AI a core part of its product strategy. The business has a substantial existing customer base, multiple production platforms, and a roadmap moving from relatively straightforward LLM applications toward more sophisticated agentic systems and AI infrastructure.

The Opportunity

This is a high-impact architecture role for someone who wants broader technical leadership without stepping away from the code. You will help define how customer-facing AI is built across an established product portfolio while enabling a broader engineering organization to adopt stronger agentic, evaluation, context, and governance patterns.

The Role

You will take significant ownership of the architecture behind the company’s customer-facing AI capabilities and help lead a small senior AI team. This is explicitly a player-coach position: you will make important technical decisions, build reference implementations, work directly in the codebase, and partner with product engineering teams to ship production AI safely at scale.

What You’ll Do

• Own architecture across agentic workflows, compliance-focused AI, content generation, retrieval, memory, context, and other customer-facing AI capabilities.
• Design agent architectures, orchestration patterns, MCP integrations, reusable context standards, and reference implementations for wider engineering teams.
• Establish rigorous evaluation methodologies and quality standards for production AI features.
• Lead build-versus-buy decisions covering models, infrastructure, hosting, evaluation, and supporting AI platforms.
• Partner with product and platform engineering teams to prototype capabilities, move them into production, and transfer ownership without becoming a bottleneck.
• Help define technical approaches to data governance, tenant isolation, model hosting, privacy, cost management, and enterprise AI requirements.
• Coach engineers through architecture reviews, workshops, demos, and hands-on collaboration while continuing to write production code.

What You’ll Bring

• Software engineering experience, including senior technical ownership of a production AI product.
• Proven experience designing and shipping agentic systems involving orchestration, tool use, multi-step workflows, memory, or context management.
• Current hands-on knowledge of LLM application architecture, retrieval, evaluation, prompt/context engineering, and production AI systems.
• Experience operating at SaaS scale and improving existing products and architectures rather than working exclusively on greenfield systems.
• Ability to communicate complex architecture clearly to engineers, product teams, executives, and non-engineering stakeholders.
• A collaborative player-coach approach: comfortable setting technical direction while building relationships, mentoring teams, and working through regulatory or organizational constraints.

What This Role Requires

• Hands-on delivery of production agentic systems used by customers.
• Current fluency across LLM application architecture and evaluation.
• A genuine desire to remain hands-on in the code while taking on broader technical leadership.

Why Join

• Take meaningful ownership of one of the most strategically important technical areas in the business, with influence over AI architecture across multiple product teams.
• Work on real production challenges across agents, retrieval, knowledge graphs, evaluation, privacy, governance, and AI infrastructure rather than isolated prototypes.
• Keep building while growing into broader leadership responsibility, with the opportunity to raise the technical standard for AI across a substantial engineering organization.