Senior AI Platform Architect & Systems Lead

Boston Consulting Group

Waltham (MA)

On-site

USD 171,000 - 209,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Zero-dollar health insurance premiums
Dental coverage
Vision coverage
Retirement contributions
Paid time off

Job summary

Boston Consulting Group is seeking an AI Architecture & Solution Design lead within BCG Platinion in the U.S. You will design scalable AI platform architectures, guide client implementations, and mentor technical teams across product, data science, and engineering disciplines.

You will evaluate frameworks, define integration patterns, and help scale AI solutions from prototype to production, collaborating closely with clients and internal stakeholders. Travel to client sites may be required.

Qualifications

  • Bachelor's degree in IT/CS/Engineering (Master's a plus).
  • 6+ years in software engineering, data engineering, or AI systems with architecture/leadership roles.
  • Strong foundation in software architecture and distributed systems.
  • Experience designing AI/ML or LLM-based systems in production or near-production environments.
  • Proficiency in programming languages (Python, JavaScript, TypeScript) is nice to have.
  • Familiarity with agentic AI concepts: RAG, multi-agent orchestration, memory patterns, vector databases, and function-calling.

Responsibilities

  • Design system architectures for AI and LLM-based solutions emphasizing scalability, performance, and modularity.
  • Evaluate emerging AI frameworks and tooling and recommend fit-for-purpose usage.
  • Design agentic AI solutions for intelligent workflow automation and orchestration patterns.
  • Define AI integration patterns such as context management, model orchestration, and prompt workflows.
  • Contribute to architectural standards for model lifecycle management, data lineage, and responsible AI practices.
  • Support hybrid pipelines (batch training, real-time inference) with cost, latency, and risk considerations.
  • Develop proofs-of-concept to validate AI platform designs and agent orchestration patterns.
  • Collaborate with engineering teams to implement agentic workflows.

Skills

AI Architecture & Solution Design

Education

Bachelor's degree in information technology, computer science, engineering
Master's degree preferred

Tools

Docker
Kubernetes
Cursor
Claude Code
Replit
Lovable
LangChain
LangGraph
Semantic Kernel
AutoGen
LlamaIndex
Pinecone
Qdrant
Aure Search

Job description

Boston Consulting Group is seeking an AI Architecture & Solution Design lead within BCG Platinion in the U.S. You will design scalable AI platform architectures, guide client implementations, and mentor technical teams across product, data science, and engineering disciplines.

You will evaluate frameworks, define integration patterns, and help scale AI solutions from prototype to production, collaborating closely with clients and internal stakeholders. Travel to client sites may be required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Architecture Lead
Senior AI Architecture Lead

Boston Consulting Group • Detroit (MI)

On-site
USD 171,000 - 209,000
Zero-dollar health insurance premiums
Fully vested retirement contributions
Generous paid time off with officewide
+1
Senior AI Tech Architect - Cloud, GenAI & Data Ops
Senior AI Tech Architect - Cloud, GenAI & Data Ops

Boston Consulting Group • Pittsburgh

On-site
USD 130,000 - 180,000
Zero-dollar health insurance premiums
Dental coverage
Vision insurance
+3
Senior AI Tech Architect - GenAI & IT Architecture Leader
Senior AI Tech Architect - GenAI & IT Architecture Leader

Boston Consulting Group • Austin (TX)

On-site
USD 135,000 - 165,000
Benefits package
Profit sharing
Retirement fund
Lead AI Platform Architect & Agentic Systems
Lead AI Platform Architect & Agentic Systems

Boston Consulting Group • Stoughton (MA)

On-site
USD 171,000 - 209,000
Medical, dental & vision coverage
Generous paid time off
Parental leave
Senior AI Platform Architect
Senior AI Platform Architect

Boston Consulting Group • New York (NY)

On-site
USD 210,000 - 260,000
Zero dollar health insurance premiums
Generous retirement contributions
Paid parental leave
+1
Senior AI Tech Architect — GenAI & Cloud Design Lead
Senior AI Tech Architect — GenAI & Cloud Design Lead

Boston Consulting Group • Durham (NC)

On-site
USD 135,000 - 165,000
Zero-dollar health insurance premiums
Dental coverage
Vision insurance
+3
Senior AI Tech Architect - GenAI & Cloud Architecture
Senior AI Tech Architect - GenAI & Cloud Architecture

Boston Consulting Group • River Grove (IL)

On-site
USD 171,000 - 209,000
Competitive compensation
Comprehensive benefits
Paid time off
+1
Senior AI Tech Architect, GenAI, Cloud and IT Architecture
Senior AI Tech Architect, GenAI, Cloud and IT Architecture

Boston Consulting Group • Houston (TX)

On-site
USD 135,000 - 165,000
Zero-dollar health premiums
Retirement contributions
Generous paid time off
+1
Senior AI Strategy & Delivery Consultant
Senior AI Strategy & Delivery Consultant

Boston Consulting Group • Detroit (MI)

On-site
USD 135,000 - 165,000
Zero-dollar health premiums
Dental & Vision coverage
Fully vested retirement contributions
+2
Senior AI Tech Architect for Digital Transformation
Senior AI Tech Architect for Digital Transformation

Boston Consulting Group • Detroit (MI)

On-site
USD 135,000 - 165,000
Health benefits package
Paid parental leave
Retirement contributions
+1