Chief Agentic AI Engineer

Baker Tilly Advisory Group, LP; San Diego (CA); On-site; USD 250,000 - 400,000; Full time

Job summary

Baker Tilly Advisory Group, LP is seeking a Head of AI Engineering to lead the design, orchestration, evaluation and deployment of agentic systems across the firm. This hands-on leadership role sets standards, mentors engineers and partners with product, data and platform teams to scale AI capabilities.

You will own Compass agents and end-to-end experiences, driving robust evaluation harnesses and scalable, firm-owned practices.

Qualifications

• 15+ years of software engineering experience.
• 2–3+ years building and deploying LLM-based or agentic systems in production.
• Staff- or principal-level engineering experience.
• Experience with evaluation harnesses, baselines and regression testing.
• Strong knowledge of agentic technology stack (orchestration, tool calling, vector/graph retrieval).
• Production code in Python and/or TypeScript.

Responsibilities

• Define agentic reference patterns and orchestration standards.
• Own the Compass agents and end-to-end experiences.
• Build and own evaluation harnesses and baselines for agents.
• Lead the Agent Factory and mentor engineers.
• Collaborate with Product, Architecture, Platform, Quality Engineering and partner teams.
• Hire and develop full-stack AI engineers.

Skills

Python

TypeScript

LLM/agentic systems

Code reviews

Cross-functional collaboration

Observability

Education

Bachelor's degree in CS/Engineering

Advanced degree preferred

Job description

Baker Tilly Advisory Group, LP is seeking a Head of AI Engineering to lead the design, orchestration, evaluation and deployment of agentic systems across the firm. This hands-on leadership role sets standards, mentors engineers and partners with product, data and platform teams to scale AI capabilities.

You will own Compass agents and end-to-end experiences, driving robust evaluation harnesses and scalable, firm-owned practices.