AI Architect- Associate Director

KPMG LLP; Montvale (NJ); On-site; USD 180,000 - 240,000; Full time

Job summary

KPMG LLP is seeking an AI Architect to join our Audit Technology Alliance. You will design scalable microservice architectures and guide development teams through architectural decisions.

You will collaborate with senior engineers, QA, and product managers to refine requirements, enforce code quality, and evaluate AI models using LangSmith and related tools. This role blends prototyping with strategic planning.

Qualifications

• Eight+ years of software development and architecture experience, with cloud-native AI apps.
• Bachelor's degree; master's preferred in CS/Engineering or related field.
• Strong hands-on experience with LLM frameworks and Azure services; data platform integrations.

Responsibilities

• Design and document robust, scalable microservice architectures for key product features.
• Collaborate with senior developers, QA, and product managers to define technical requirements and user stories.
• Lead architectural oversight through design reviews and mentorship within pods during sprints.

Skills

Cloud-native AI apps

Architectural design

Analytical problem solving

Collaboration

Education

Bachelor's degree

Master's degree (preferred)

Tools

LangChain

LangGraph

AKS

Azure AI Search

Service Bus

Databricks

Microsoft Fabric

Azure DevOps

Git

Job description

KPMG is currently seeking an AI Architect to join our Audit Technology Alliance organization.

Responsibilities:

• Design and document robust, scalable microservice architectures for key product features, providing direct technical guidance to development teams
• Collaborate daily with senior developers, QA, and product managers to define technical requirements, refine user stories, and ensure architectural integrity throughout the development lifecycle
• Implement and enforce best practices for code quality, automated testing, and AI model evaluation using LangSmith, directly contributing to the continuous improvement of our engineering standards
• Lead the detailed technical design and successful execution of critical platform components, including context engineering services, RAG pipelines, and intuitive human-in-the-loop (HITL) interfaces
• Serve as a primary technical leader and mentor for development pods, providing architectural oversight through design reviews, pair programming, and resolving complex technical hurdles during sprints
• Balance long-term architectural planning with hands-on prototyping and proof-of-concepts to validate new technologies and patterns before they are adopted across the engineering team

Qualifications:

• Minimum eight years of recent progressive experience in software development and architecture, with significant, demonstrated experience in designing and building cloud-native AI applications
• Bachelor's degree from an accredited college or university; master's degree from an accredited college or university in Computer Science, Engineering, or a related technical field is preferred
• Strong, hands‑on proficiency with LLM frameworks (LangChain/LangGraph), core Azure services (AKS, Azure AI Search, Service Bus), and experience integrating with data platforms like Databricks or Microsoft Fabric
• In‑depth experience working within an Agile framework, utilizing Azure DevOps and Git for source control, and a strong practical understanding of CI/CD principles
• Excellent analytical and problem‑solving skills, with a proven ability to deconstruct large‑scale business problems into manageable, well‑designed technical solutions
• Clear and effective interpersonal and communication skills, essential for collaborating within a fast‑paced, multi‑disciplinary team of engineers, data scientists, and product managers(200TEC)