Chief AI Engineering & Agent Systems Leader

Baker Tilly Advisory Group, LP; Redwood City (CA); On-site; USD 250,000 - 400,000; Full time

Job summary

Baker Tilly Advisory Group, LP seeks a Head of AI Engineering to lead and architect the design, orchestration, evaluation, and deployment of our agentic AI capabilities. You will own standards for task decomposition, memory management, tool use, and human-in-the-loop controls and work directly on code and reviews.

You will guide the Compass agents and agentic experiences end to end, mentor a growing team, and partner across internal groups to scale agentic engineering practices firm-wide.

Qualifications

• Bachelor's degree in computer science, engineering, or related field, or equivalent practical experience; advanced degree preferred.
• 15+ years of software engineering experience, including 3+ years building and deploying LLM-based or agentic systems in production.
• Staff- or principal-level engineering experience with demonstrated success personally designing and shipping production agent systems.
• Strong knowledge of modern agentic tech stack: orchestration, tool calling, vector/graph retrieval, context and memory management.
• Experience with evaluation methodologies, baselines, regression, and LLM-as-judge patterns.

Responsibilities

• Define and build agentic reference patterns including task decomposition, orchestration, context engineering, memory management, tool use, and failure recovery.
• Maintain the agent pattern library and establish orchestration standards for product teams.
• Own Compass agents and full-stack experiences end to end on the intelligence layer.
• Build and own the evaluation harness, baselines, and regression discipline for production agents.
• Establish evaluation and acceptance criteria with cross-functional stakeholders (Product, Architecture, Platform, QA).
• Partner to enable scalable evaluation capabilities in production.
• Lead the Agent Factory, setting high standards for design and engineering quality.
• Conduct hands-on design and code reviews; mentor engineers in agentic practices.
• Hire and develop full-stack AI engineers; build agents and their applications.
• Collaborate with experts to codify leading practices into Baker Tilly standards.

Skills

LLM systems

Agentic engineering

Python

TypeScript

Full-stack engineering

Leadership

Cross-team collaboration

Evaluation harness

Education

Bachelor's in CS or related field

Advanced degree preferred

Tools

Python

TypeScript

Vector databases

Job description

Baker Tilly Advisory Group, LP seeks a Head of AI Engineering to lead and architect the design, orchestration, evaluation, and deployment of our agentic AI capabilities. You will own standards for task decomposition, memory management, tool use, and human-in-the-loop controls and work directly on code and reviews.

You will guide the Compass agents and agentic experiences end to end, mentor a growing team, and partner across internal groups to scale agentic engineering practices firm-wide.