Chief AI Engineering & Agent Systems Leader

Baker Tilly Advisory Group, LP; Portland (OR); On-site; USD 250,000 - 400,000; Full time

Job summary

Baker Tilly Advisory Group, LP is seeking a Head of AI Engineering to lead the firm’s AI agent strategy across design, orchestration, evaluation and deployment. You will define standards and patterns for agentic systems and mentor a growing team of engineers.

You will collaborate with Data & AI Platform, Product, Design and Production Engineering to scale agentic capabilities, own evaluation baselines, and drive hands-on code reviews while delivering firm-wide, high-quality AI solutions.

Qualifications

• Bachelor's degree in computer science, engineering, or related field required; advanced degree preferred.
• 15+ years software engineering experience.
• 3+ years building and deploying production-grade LLM/agent systems.
• Experience with evaluation harnesses, baselines, and regression testing.

Responsibilities

• Define agentic reference patterns and orchestration standards.
• Own the Compass agents and full-stack experiences end-to-end.
• Build and maintain evaluation harness and baselines for release decisions.
• Lead hands-on reviews and mentor engineers in agentic practices.
• Hire and develop engineers capable of building agents and applications.

Skills

Python

TypeScript

LLM engineering

Leadership

Education

Bachelor's degree in CS or related field

Advanced degree preferred

Tools

LLM tooling

Job description

Baker Tilly Advisory Group, LP is seeking a Head of AI Engineering to lead the firm’s AI agent strategy across design, orchestration, evaluation and deployment. You will define standards and patterns for agentic systems and mentor a growing team of engineers.

You will collaborate with Data & AI Platform, Product, Design and Production Engineering to scale agentic capabilities, own evaluation baselines, and drive hands-on code reviews while delivering firm-wide, high-quality AI solutions.