Senior AI Platform Architect (Agentic AI & LLM)

Boston Consulting Group; New York (NY); On-site; USD 135,000 - 165,000; Full time

Benefits offered by this job

Competitive benefits

Paid time off

Parental leave

Health insurance

Retirement contributions

Job summary

Boston Consulting Group in the United States is seeking a Senior AI Platform Architect to design and implement intelligent, agentic AI platforms, balancing hands‑on development with architectural growth. You will collaborate with Lead and Principal Architects to integrate large language models, data pipelines, and enterprise systems.

The role emphasizes prototyping, validation, deployment, monitoring, and cross‑functional teamwork.

Qualifications

• Bachelor’s degree in information technology, computer science, engineering, or a related field.
• 4+ years of experience in software engineering, data engineering, or AI development.
• Hands‑on experience building or integrating AI/ML or LLM‑based components.
• Proficiency in Python or JavaScript.
• Experience with AI frameworks and libraries (LangChain, LlamaIndex, Semantic Kernel).
• Willingness to travel to work with clients.

Responsibilities

• Contribute to AI and LLM‑based system architectures.
• Implement agentic AI components for workflows.
• Build RAG‑based solutions for context retrieval and integration.
• Support deployment and monitoring of AI services.
• Collaborate with engineers, data scientists, and product teams.
• Provide knowledge sharing and mentoring junior teammates.

Skills

Hands-on development

Architectural thinking

Gen AI fluency

Agile delivery

Client travel readiness

Education

Bachelor’s degree in IT/CS

Tools

Python

JavaScript

LangChain

LlamaIndex

Semantic Kernel

Docker

Kubernetes

Job description

Boston Consulting Group in the United States is seeking a Senior AI Platform Architect to design and implement intelligent, agentic AI platforms, balancing hands‑on development with architectural growth. You will collaborate with Lead and Principal Architects to integrate large language models, data pipelines, and enterprise systems.

The role emphasizes prototyping, validation, deployment, monitoring, and cross‑functional teamwork.