AI Engineering Lead: LLM & Agent Orchestration

BDO USA; United States; On-site; USD 130,000 - 160,000; Full time

Benefits offered by this job

ESOP

Total Rewards benefits

Job summary

BDO USA is seeking an AI Engineering Manager to lead the design, build, and production operation of AI capabilities across the DT&I portfolio. You will guide agent architectures, orchestration, and LLM-powered features while ensuring governance and security within BDO’s Azure ecosystem.

You will collaborate with Context Engineering, Automation & Infrastructure, and Data & Analytics leads to deliver integrated AI solutions.

Qualifications

• Requires 7+ years in software engineering with 3+ years in production AI/ML or LLM applications.
• Experience with AI orchestration frameworks (Semantic Kernel, LangChain) and Azure AI services.
• Proven ability to design, build, and operate AI systems with governance and responsible-AI practices.

Responsibilities

• Lead design and production operation of agent architectures and multi-agent orchestration across the DT&I portfolio.
• Implement retrieval-augmented generation (RAG) pipelines and application-layer prompt strategies.
• Own model selection, routing, cost and latency optimization for AI features and maintain LLMOps.

Skills

AI engineering

Team leadership

Communication skills

AI governance

Education

Bachelor's degree in Computer Science/Engineering

Tools

Semantic Kernel

Azure AI Foundry

Azure OpenAI

Azure AI Search

.NET 10 / C#

React

Docker

Azure DevOps

Job description

BDO USA is seeking an AI Engineering Manager to lead the design, build, and production operation of AI capabilities across the DT&I portfolio. You will guide agent architectures, orchestration, and LLM-powered features while ensuring governance and security within BDO’s Azure ecosystem.

You will collaborate with Context Engineering, Automation & Infrastructure, and Data & Analytics leads to deliver integrated AI solutions.