Lead AI Platform Architect

Boston Consulting Group; New York (NY); On-site; USD 171,000 - 209,000; Full time

Benefits offered by this job

Cross-disciplinary collaboration

Industry-leading benefits

Job summary

Boston Consulting Group (BCG) Platinion seeks a Lead AI Platform Architect to design intelligent, agentic AI platforms and guide cross‑functional teams across AI, data, product, and engineering. You will shape end‑to‑end architectures for LLM‑based solutions, evaluate frameworks, and lead prototyping to production‑readiness.

You will collaborate with senior stakeholders, drive architectural decisions, and mentor junior architects, while staying current with GenAI patterns and cloud integrations.

Qualifications

• Bachelor’s degree in IT/CS/engineering or related field required.
• 6+ years in software engineering, data engineering, or AI systems with architecture or technical leadership.
• Strong foundation in software architecture and distributed systems.
• Experience designing AI/ML or LLM-based systems in production or near-production.
• Proficiency with Python, JavaScript, or TypeScript is nice to have.
• Experience with AI-assisted coding tools to accelerate prototyping and implementation.
• Familiarity with agentic AI concepts including RAG and multi-agent orchestration.
• Cloud architecture and API-based system integration experience; exposure to containers (Docker, Kubernetes).

Responsibilities

• Design system architectures for AI and LLM-based solutions balancing scalability and modularity.
• Evaluate emerging AI frameworks (LangChain, LangGraph, Semantic Kernel) and recommend usage.
• Design agentic AI solutions for intelligent workflow automation and orchestration patterns.
• Define AI integration patterns for context management and enterprise connectivity.
• Contribute to standards for model lifecycle, data lineage, and responsible AI.
• Support hybrid pipelines with regard to cost, latency, and risk.
• Develop proofs-of-concept and architectural prototypes; validate AI platform designs.

Skills

Architecture

AI platforms

Cloud architecture

Distributed systems

Prototyping

Communication

Agile delivery

Education

Bachelor’s degree in IT/CS/Engineering or related field

Tools

LangChain

LangGraph

Semantic Kernel

LlamaIndex

Docker

Kubernetes

Cursor

Claude Code

Replit

Lovable

Job description

Boston Consulting Group (BCG) Platinion seeks a Lead AI Platform Architect to design intelligent, agentic AI platforms and guide cross‑functional teams across AI, data, product, and engineering. You will shape end‑to‑end architectures for LLM‑based solutions, evaluate frameworks, and lead prototyping to production‑readiness.

You will collaborate with senior stakeholders, drive architectural decisions, and mentor junior architects, while staying current with GenAI patterns and cloud integrations.