Director, AI Agent Engineering & Orchestration

Baker Tilly Advisory Group, LP; San Jose (CA); On-site; USD 250,000 - 400,000; Full time

Job summary

Baker Tilly is seeking a Head of Agent Engineering to define how the firm’s AI agents are designed, orchestrated, evaluated, and deployed. This role will establish task decomposition, orchestration, context and memory management, tool use, human-in-the-loop controls, and failure recovery for product teams.

The Head of Agent Engineering will own the evaluation harness and baselines used to guide iteration and inform release decisions for both internally developed and third‑party agents, and will

Qualifications

• 15+ years of software engineering experience.
• 3+ years building and deploying LLM-based or agentic systems in production.
• Staff- or principal-level engineering experience with production agent systems.

Responsibilities

• Define and build agentic reference patterns and orchestration standards.
• Own BT Compass end-to-end and its agentic workflows.
• Build and own the evaluation harness, baselines, and regression discipline.

Skills

Python

TypeScript

LLM-based systems

Agent design

Mentoring engineers

Cross‑functional collaboration

Education

Bachelor’s degree in computer science, engineering, or a related field

Advanced degree preferred

Tools

Orchestration frameworks

Tool/function calling

Retrieval using vector and graph approaches

Observability and tracing

Job description

Baker Tilly is seeking a Head of Agent Engineering to define how the firm’s AI agents are designed, orchestrated, evaluated, and deployed. This role will establish task decomposition, orchestration, context and memory management, tool use, human-in-the-loop controls, and failure recovery for product teams.

The Head of Agent Engineering will own the evaluation harness and baselines used to guide iteration and inform release decisions for both internally developed and third‑party agents, and will