Head of Agent Engineering - AI Orchestration & Systems

Baker Tilly (US); San Jose (CA); On-site; USD 250,000 - 400,000; Full time

Job summary

Baker Tilly is seeking a Head of Agent Engineering to lead the design, orchestration, evaluation, and deployment of the firm’s AI agents. You will set patterns for task decomposition, context and memory management, tool use, and human‑in‑the‑loop controls.

You will own the evaluation harness, baselines, and production release decisions for both internal and 3rd‑party agents, and you’ll lead BT Compass from end to end with hands‑on coding and reviews.

Qualifications

• Bachelor’s degree in computer science or related field; advanced degree preferred.
• 15+ years of software engineering experience, with 3+ years building agentic/LLM systems.
• Staff‑level engineering experience with production agent systems and code reviews.
• Strong knowledge of orchestration tools, memory management, and evaluation baselines.

Responsibilities

• Define and build agentic reference patterns for decomposition, orchestration, context engineering, and memory management.
• Maintain the agent pattern library and establish cross‑team orchestration standards.
• Own BT Compass end to end, including agentic workflows and front‑end experiences.
• Build and own evaluation harnesses, baselines, and regression discipline for agent systems.
• Set evaluation criteria with Product, Architecture, Platform & Production Eng, and Quality Eng.
• Lead the Agent Factory, mentor engineers, and translate practices into scalable standards.

Skills

LLM-based systems

Agentic engineering

Python

TypeScript

Code reviews

Mentoring engineers

Education

Bachelor's degree in computer science or related field

Advanced degree preferred

Tools

Python

TypeScript

Job description

Baker Tilly is seeking a Head of Agent Engineering to lead the design, orchestration, evaluation, and deployment of the firm’s AI agents. You will set patterns for task decomposition, context and memory management, tool use, and human‑in‑the‑loop controls.

You will own the evaluation harness, baselines, and production release decisions for both internal and 3rd‑party agents, and you’ll lead BT Compass from end to end with hands‑on coding and reviews.