Lead AI Platform Architect - Agentic AI & LLM Systems

Boston Consulting Group; Boston (MA); On-site; USD 171,000 - 209,000; Full time

Benefits offered by this job

Zero dollar health insurance premiums

Fully vested retirement contributions

Generous PTO

Job summary

Boston Consulting Group seeks a Lead AI Tech Architect – AI Platforms to design and guide the implementation of intelligent, agentic AI platforms. You will bridge platform architecture and hands-on technical leadership, defining end-to-end AI platform solutions and prototyping architectural validation across AI, data, product, and engineering teams.

You will design scalable AI architectures, evaluate frameworks (LangChain, LangGraph, Semantic Kernel, etc.), and mentor junior architects while

Qualifications

• Bachelor’s degree in information technology, computer science, engineering or related field required.
• 6+ years of software engineering, data engineering, or AI systems experience with architecture/leadership.
• Experience with AI/ML production systems and modern AI tooling is highly valued.

Responsibilities

• Design AI platform architectures for LLM-based solutions with a focus on scalability and reliability.
• Define integration patterns, data lineage, and MLOps practices for enterprise environments.
• Prototype and validate agentic AI workflows and orchestration patterns.
• Guide implementation teams and collaborate with product managers, data scientists, and engineers.
• Communicate complex concepts clearly to both technical and non-technical stakeholders.

Skills

Software engineering

Data engineering

AI systems architecture

Distributed systems

Python/JavaScript/TypeScript

Cloud architecture (AWS/Azure/GCP)

Containerization (Docker/Kubernetes)

Consulting mindset

Gen AI fluency

Travel willingness

Education

Bachelor’s degree in information technology, computer science, engineering

Master’s degree is a plus

Tools

LangChain

LangGraph

Semantic Kernel

AutoGen

LlamaIndex

Cursor

Claude Code

Replit

Lovable

Docker

Kubernetes

Job description

Boston Consulting Group seeks a Lead AI Tech Architect – AI Platforms to design and guide the implementation of intelligent, agentic AI platforms. You will bridge platform architecture and hands-on technical leadership, defining end-to-end AI platform solutions and prototyping architectural validation across AI, data, product, and engineering teams.

You will design scalable AI architectures, evaluate frameworks (LangChain, LangGraph, Semantic Kernel, etc.), and mentor junior architects while