Head of AI Agent Engineering & Platform

Baker Tilly (US); Santa Clara (CA); On-site; USD 250,000 - 400,000; Full time

Job summary

Baker Tilly is seeking a Head of Agent Engineering to define how AI agents are designed, orchestrated, evaluated, and deployed across the firm’s systems. This senior leader will own BT Compass, establish standards, and mentor a growing team, while collaborating with Product, Architecture, and Engineering to scale agentic capabilities.

The role demands hands‑on coding, architecture review, and building scalable, repeatable agentic practices for production use in a fast‑moving environment.

Qualifications

• Bachelor’s degree in computer science, engineering, or a related field, or equivalent practical experience; advanced degree preferred.
• 15+ years of software engineering experience, including 3+ years building and deploying LLM‑based or agentic systems in production.
• Staff‑or principal‑level engineering experience with demonstrated success personally designing and shipping production agent systems.
• Deep experience designing and building evaluation harnesses and using evaluation results, baselines, and regression testing to drive iteration and release decisions.
• Strong knowledge of the modern agentic technology stack, including orchestration frameworks, tool/function calling and MCP, retrieval using vector and graph approaches, and context and memory management.
• Experience with evaluation methodologies, including evaluation design, baselines, regression discipline, confidence frameworks, and LLM‑as‑judge patterns and limitations.
• Full‑stack product engineering experience, including building the applications and user experiences in which agents operate.
• Experience designing human‑in‑the‑loop workflows, checkpoints, review experiences, and failure‑containment mechanisms.
• Strong hands‑on software engineering skills with recent experience writing production‑quality code in Python and/or TypeScript.
• Experience with observability and tracing for agentic systems.
• Experience directing third‑party or partner engineers against established technical standards.
• Experience evaluating third‑party technologies or vendor agents against internal technical and quality standards.
• Demonstrated ability to use AI and agentic development tools as a force multiplier in day‑to‑day engineering work.
• Strong ability to collaborate across engineering, product, design, platform, and business teams while translating emerging technical practices into repeatable standards.
• No certifications or licenses required.

Responsibilities

• Define and build agentic reference patterns, including task decomposition, orchestration, context engineering, memory management, tool use, human‑in‑the‑loop checkpoints, and failure containment and recovery.
• Maintain the agent pattern library and establish orchestration standards that product teams can consistently build from.
• Own BT Compass end to end, including its agentic workflows and full‑stack product experiences, on the intelligence layer built by the Data & Intelligence team.
• Build and own the evaluation harness, baselines, and regression discipline used to drive iteration and inform release and acceptance decisions for internally developed and third‑party agents.
• Establish evaluation and acceptance criteria in partnership with Product, Architecture, Platform & Production Engineering, Quality Engineering, and other key stakeholders.
• Partner with Platform & Production Engineering to enable evaluation capabilities to operate at scale in production.
• Lead the Agent Factory as it grows, setting a high standard for agent design, engineering quality, and full‑stack product development.
• Conduct hands‑on design and code reviews across product teams and mentor engineers in agentic engineering practices.
• Hire and develop full‑stack, forward‑deployed AI engineers who can build both agents and the applications in which they operate.
• Partner with expert agentic‑engineering resources to absorb leading practices and translate them into Baker Tilly‑owned standards, patterns, and runbooks.
• Direct third‑party and partner engineers delivering solutions against Baker Tilly’s technical standards.
• Evaluate third‑party and vendor agents against the firm’s established technical and evaluation standards.
• Partner with the Chief Architect to establish evaluation standards and promote proven patterns into the platform’s shared library.
• Collaborate closely with Data & AI Platform, Product, Design, Quality Engineering, Platform & Production Engineering, subject matter experts, and engineering teams in India.
• Engage in special projects and perform other duties as assigned.

Skills

Leadership

Agentic engineering

Python/TypeScript

LLM-based systems

Collaboration across teams

Education

Bachelor’s degree in CS/Engineering

Tools

Python

TypeScript

Job description

Baker Tilly is seeking a Head of Agent Engineering to define how AI agents are designed, orchestrated, evaluated, and deployed across the firm’s systems. This senior leader will own BT Compass, establish standards, and mentor a growing team, while collaborating with Product, Architecture, and Engineering to scale agentic capabilities.

The role demands hands‑on coding, architecture review, and building scalable, repeatable agentic practices for production use in a fast‑moving environment.