BCG Platinion | Senior AI Tech Architect - AI Platforms

Boston Consulting Group (BCG); Toronto; On-site; CAD 144,000 - 176,000; Full time

Benefits offered by this job

Zero dollar health insurance premiums

Comprehensive mental health support

Generous paid time off

Job summary

Boston Consulting Group (BCG) in Toronto is looking for a Senior AI Tech Architect for their Platinion team. In this role, you will design and implement AI platforms, work closely with cross-functional teams, and tackle complex digital challenges. Ideal candidates should have a strong background in software engineering and experience with AI technologies.

BCG offers a competitive salary of $160,000 CAD, alongside comprehensive benefits including zero premium health insurance, mental health support, and generous paid time off.

Qualifications

• 4+ years of experience in software engineering, data engineering, or AI development.
• Hands-on experience building AI/ML components.
• Familiar with Docker and Kubernetes.

Responsibilities

• Design AI architectures and implement components.
• Collaborate with engineers and data scientists.
• Support AI solution deployment and performance monitoring.

Skills

AI and software engineering skills

Collaboration

Problem-solving

Agile methodology

Education

Bachelor’s degree in IT, computer science, engineering, or related

Master’s degree

Tools

Python

JavaScript

AI frameworks (e.g., LangChain, LlamaIndex)

Cloud platforms

Job description

Who We Are

Boston Consulting Group (BCG) is a global consulting firm that partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. Our success depends on a spirit of deep collaboration and a global community of diverse individuals determined to make the world and each other better every day.

BCG's Tech and Digital Advantage (TDA) practice focuses on helping clients deliver competitive advantage and superior business performance through the use of data, technology and digital. Platinion is the fastest growing practice at BCG and at the heart of the strategic impact we have with our clients. Our consultants and experts globally work across all industries and provide deep experience and expertise across a number of topics including Digital Transformation, Data & Digital Platforms, AI at Scale, Agile, Cybersecurity and Digitizing the Tech Function.

At BCG, we bring together the right people to conquer complexity, drive material change, and initiate positive, long‑term impact.

About BCG Platinion

BCG Platinion's presence spans across the globe, with offices in Asia, Europe, and South and North America. We achieve digital excellence for clients with sustained solutions to the most complex and time‑sensitive challenge. We guide clients into the future to push the status quo, overcome tech limitations, and enable our clients to go further in their digital journeys than what has ever been possible in the past. At BCG Platinion, we deliver business value through the innovative use of technology at a rapid pace. We roll up our sleeves to transform business, revolutionize approaches, satisfy customers, and change the game through Architecture, Cybersecurity, Digital Transformation, Enterprise Application and Risk functions. We balance vision with a pragmatic path to change transforming strategies into leading‑edge tech platforms, at scale.

What You'll Do

Senior AI Tech Architects – AI Platforms at BCG Platinion are:

• Collaborative. They are strong team players who work closely with engineers, data scientists, and architects to deliver AI platform components effectively.
• Systems‑Oriented. They contribute to the design and implementation of AI platform and agentic system components that solve real business problems.
• Hands‑on Technologists. They apply solid AI and software engineering skills to build, test, and improve AI platform capabilities.
• Comfortable with ambiguity. They can operate effectively when requirements are evolving, adapting their technical approach as solutions take shape.
• Delivery focused. They help teams adopt new AI capabilities by supporting implementation, integration, and operational readiness.
• Agile contributors. They work within agile teams, iterating on designs and implementations as requirements and feedback evolve.
• Curious and Innovative. They explore and apply modern AI platform and agentic patterns to improve solution quality and scalability.
• Developing architects. They grow their architectural skills by combining hands‑on implementation with exposure to broader system design decisions.
• Reliable team members. They support senior architects and technical leads by executing assigned workstreams and contributing to high‑quality AI platform solutions.

AI Architecture & Solution Design

• Contribute to the design of AI and LLM‑based system architectures with guidance from senior architects.
• Implement agentic AI components that support intelligent workflow automation and task execution.
• Build and extend RAG‑based solutions for context retrieval, prompt workflows, and system integration.
• Follow established architectural standards and contribute feedback to improve design patterns and practices.
• Support implementation of batch and real‑time inference pipelines with attention to performance and reliability.

Prototyping & Validation

• Develop prototypes and technical proofs‑of‑concept to validate AI platform components and workflows.
• Implement solutions using modern AI frameworks and libraries under architectural guidance.
• Test and iterate on agentic workflows, prompts, and retrieval strategies to improve solution behavior.

Implementation Management and Support

• Support implementation and deployment of AI platform components into development and production environments.
• Assist with monitoring, troubleshooting, and improving system performance and reliability.
• Follow defined standards for versioning, testing, and monitoring of AI services and models.

Communication and Collaboration

• Communicate technical concepts clearly within the project team and with immediate stakeholders.
• Support preparation of technical documentation and presentations.
• Collaborate closely with engineers, data scientists, and product team members to deliver agreed solutions.
• Participate in technical working sessions and design discussions, contributing ideas and implementation insights.
• Seek and incorporate feedback from senior team members to improve technical output.

Team Management

• Support junior team members through knowledge sharing and day‑to‑day collaboration.
• Contribute positively to team culture and ways of working.
• Seek feedback on work quality and incorporate guidance from senior architects.
• Demonstrate professionalism and alignment with BCG’s culture and values.

Innovation and Growth

• Stay current on emerging concepts in agentic AI, RAG, and AI platform tooling.
• Experiment with new tools and techniques under guidance to expand technical skill sets.
• Build depth in AI platform engineering through hands‑on delivery experience.
• Actively pursue learning opportunities to grow toward broader architectural responsibilities.
• Contribute technical input to proposals or internal initiatives when needed.

What You’ll Bring

• Bachelor’s degree in information technology, computer science, engineering, or a related field (Master’s degree is a plus).
• 4+ years of experience in software engineering, data engineering, or AI development.
• Solid foundation in software development and distributed systems concepts.
• Hands‑on experience building or integrating AI/ML or LLM‑based components.
• Proficiency in one or more programming language such as Python or JavaScript is nice to have.
• Hands‑on experience using AI‑assisted coding tools (e.g., Cursor, Claude Code, Replit, Lovable) to support development, debugging, and rapid iteration of AI platform components.
• Familiarity with modern AI frameworks and libraries (e.g., LangChain, LlamaIndex, Semantic Kernel, or similar).
• Working understanding of agentic AI concepts such as RAG, prompt orchestration, vector databases, and basic multi‑agent patterns.
• Basic understanding of cloud platforms and AI services, with experience in at least one hyperscaler environment.
  • Exposure to deploying AI workloads on cloud platforms.
  • Experience integrating AI components with APIs and data sources.
  • Familiarity with containerization concepts (Docker; Kubernetes exposure is a plus).
• Strong problem‑solving skills and attention to code quality.
• Ability to explain technical concepts clearly within a project team.
• Willingness to learn and grow in fast‑paced, ambiguous environments.
• Agile mindset with a focus on iterative delivery and continuous improvement.
• Willingness to travel to work with clients and BCG teams as needed.
• Gen AI fluency (e.g., proven usage of GenAI such as ChatGPT, Claude) and validation of response.

What We Offer

• An opportunity to work organically across disciplines and across BCG, we offer a unified and unrivaled opportunity that combines strategic thinking with hands‑on applications.
• A unique experience to work alongside a team of passionate and driven problem‑solvers with a mission to deliver innovative and valuable digital solutions in a supportive environment.

The first year base compensation for this role is $160,000 CAD.

In addition to your base salary, you will be eligible for an annual discretionary performance bonus and a retirement contribution. BCG also provides a market‑leading benefits package described below.

At BCG, we believe that supporting the health and well‑being of our employees and their families is essential. That’s why we offer a comprehensive benefits program designed to help you live life to the fullest. BCG pays 100% of the premium costs for employees and their eligible family members. This means zero dollars are deducted from your paycheck for core health benefits.

Our employee benefit plan provides best in class coverage, including:

• Zero dollar ($0) health insurance premiums for BCG employees, spouses, and children.
• 100% coverage for prescription drugs, with no dispensing fee maximum.
• Access to Telemedicine – virtual care when you need it.
• Substantial mental health support, including mental health practitioner coverage and access to meditation and well‑being apps.
• Dental coverage, including orthodontia benefits for children and adults.
• Robust vision coverage.
• Flexible Spending Account for additional medical and wellbeing activities.
• Retirement contributions made annually (whether you contribute or not), plus the option for employees to make personal contributions to an RRSP Plan.
• Premier Family programs including, paid parental and family care leaves, and reimbursement for fertility, surrogacy, and adoption expenses.
• Generous paid time off, including 10 public holidays and 2 floater days, office closure between Christmas and New Year’s, and 15 vacation days (earned at 1.25 days per month) annually.
• Paid sick time on an as needed basis.

This posting is for a new role. BCG is committed to a positive recruitment experience for all candidates and as part of that, has partnered with iCIMS and Eightfold.ai, using artificial intelligence (AI) as part of our overall recruitment process. An independent audit of the Eightfold Matching Model tool can be found at https://eightfold.ai/nyc-eightfoldmatching-model/.

Boston Consulting Group is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status or any other characteristic protected under national, provincial or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.

BCG is an E‑Verify Employer. Click here for more information on E‑Verify.