Senior AI Platform Architect

Boston Consulting Group; Nashville (TN); On-site; USD 171,000 - 209,000; Full time

Benefits offered by this job

Cross-disciplinary exposure

Problem-solving team

Job summary

Boston Consulting Group in Nashville seeks a Lead AI Tech Architect to design and guide the implementation of intelligent AI platforms, integrating large language models, data pipelines, and enterprise systems across AI, data, product, and engineering teams.

You will prototype architectures, validate agentic workflows, mentor junior architects, and partner with senior stakeholders to translate business needs into scalable solutions.

Qualifications

• Bachelor’s degree in IT, CS, engineering, or a related field.
• 6+ years in software engineering, data engineering, or AI systems with leadership.
• Experience deploying AI/LLM-based systems in production.
• Strong communication with both technical and non-technical stakeholders.

Responsibilities

• Design AI platform architectures for LLM-based solutions.
• Prototype and validate agentic AI workflows and orchestration.
• Collaborate with product, data science, and engineering teams.
• Guide teams through production deployment and governance.

Skills

AI platform engineering

Distributed systems

Programming in Python/JS/TS

Gen AI fluency

Consulting mindset

Travel up to 25%

Education

Bachelor’s degree in IT/CS/Engineering

Master’s degree preferred

Tools

LangChain

LangGraph

Semantic Kernel

LlamaIndex

Pinecone

Docker

Kubernetes

AWS/Azure/GCP

Job description

Boston Consulting Group in Nashville seeks a Lead AI Tech Architect to design and guide the implementation of intelligent AI platforms, integrating large language models, data pipelines, and enterprise systems across AI, data, product, and engineering teams.

You will prototype architectures, validate agentic workflows, mentor junior architects, and partner with senior stakeholders to translate business needs into scalable solutions.