Director of AI Engineering & Agent Systems

Baker Tilly Advisory Group, LP; Irvine (CA); Sur place; USD 250 000 - 400 000; Plein temps

Résumé du poste

Baker Tilly Advisory Group, LP in Irvine seeks a Head of AI Engineering to lead the design, orchestration, and deployment of the firm's AI agents. You will define standards for task decomposition, context and memory management, tool use, and human-in-the-loop controls.

This hands-on leadership role requires building a high-performance team, reviewing code, and translating emerging agentic practices into scalable firm-wide standards.

Qualifications

• 15+ years of software engineering experience.
• 3+ years building and deploying production-grade LLM/agentic systems.
• Staff- or principal-level engineering experience building production agent systems.
• Experience designing evaluation harnesses and baselines to drive iteration.
• Strong knowledge of orchestration frameworks, tool calling, memory management.
• Experience with evaluation methodologies and confidence frameworks.
• Full-stack product engineering experience and building agent-operated apps.
• Experience designing human-in-the-loop workflows and failure containment.
• Strong Python/TypeScript coding skills.

Responsabilités

• Define and build agentic reference patterns and memory management.
• Maintain the agent pattern library and orchestration standards.
• Own Compass agents and full-stack experiences end to end.
• Build evaluation harnesses, baselines, and regression discipline.
• Establish evaluation criteria with Product, Architecture, Platform & Production Eng.
• Partner to enable scalable evaluation in production.
• Lead the Agent Factory and mentor engineers.
• Conduct hands-on design and code reviews.
• Hire and develop full-stack AI engineers.
• Translate practices into Baker Tilly standards.
• Direct third-party and partner engineers to standards.
• Evaluate third-party/vendor agents against internal standards.
• Collaborate with Chief Architect to promote patterns.
• Collaborate with Data & AI Platform, Product, Design, QE, and India teams.
• Engage in special projects and other duties.

Connaissances

LLM-based systems

Agentic engineering

Full-stack product engineering

Python/TypeScript

Evaluation harness design

Human-in-the-loop design

Leadership / mentoring

Collaboration across teams

Vendor/third-party evaluation

Observability/tracing

Formation

Bachelor's degree in CS/Engineering

Advanced degree preferred

Description du poste

Baker Tilly Advisory Group, LP in Irvine seeks a Head of AI Engineering to lead the design, orchestration, and deployment of the firm's AI agents. You will define standards for task decomposition, context and memory management, tool use, and human-in-the-loop controls.

This hands-on leadership role requires building a high-performance team, reviewing code, and translating emerging agentic practices into scalable firm-wide standards.