AI LLM Technology Architecture

1200 Accenture Inc Company; Toronto; On-site; CAD 109,000 - 220,000; Full time

Job summary

Accenture Canada is seeking an experienced AI/LLM Architect to design end-to-end AI platform architectures, spanning classical ML, generative AI, and agentic systems. You will own the technical design, drive architecture decisions, and ensure security, observability, governance, and scalability for client engagements.

Lead workshops, define non-functional requirements, evaluate build-vs-buy options, and architect multi-agent systems.

Qualifications

• Minimum 5 years designing enterprise AI solutions.
• Minimum 2 years in agentic, LLM and Generative AI.
• Minimum 4 years coding in Python.
• Bachelor's Degree or equivalent English required.
• Experience communicating with English-speaking stakeholders in Canada.

Responsibilities

• Translate strategy into a technical vision with non-functional requirements (NFRs).
• Lead stakeholder workshops to align on technical feasibility and scope.
• Evaluate build-vs-buy decisions for AI platforms and foundational models.
• Architect multi-agent systems governed by an MCP Control Plane.
• Design and implement security, governance, and observability controls.

Skills

AI architecture

Cloud experience

LLM / Generative AI

Python

Architecture leadership

Education

Bachelor's degree

Tools

Arize

LangSmith

Job description

You Are:

As an experienced and senior AI/LLM Architect, you will play a pivotal role in designing and delivering end-to-end AI platform architectures that power the modern, reinvented enterprise. Operating at the intersection of business and engineering, you will own the technical design of advanced AI systems — spanning classical machine learning, generative AI, and agentic systems — ensuring they are purposefully architected to meet client business objectives and enterprise-grade standards. Within this scope, you will take deep ownership of one or more critical architecture domains — such as agentic application design, AI security and trust, AI operations and observability, data and knowledge engineering, or model platforms and inference — serving as the lead authority in your domain across client engagements. You will develop and maintain specialized expertise in the technologies, patterns, and emerging practices within your domain, bringing that depth to bear in shaping architecture decisions, accelerating delivery, and building reusable assets that extend across the practice. You will evaluate, select, and apply the right design patterns, technical frameworks, and tools within your domain and across the broader AI architecture — ensuring cohesion across the full system. This includes architecting AI agents encompassing multi-agent orchestration, tool use, skills use, and memory systems, as well as the integration of fine-tuned foundation models and classical ML models into scalable, production-ready platforms. A critical dimension of this role is owning the design of a comprehensive AI context layer — drawing on enterprise knowledge bases, structured and unstructured data sources, and domain-specific content — to ground AI systems in the realities of each client’s business and ensure outputs are accurate, trustworthy, and impactful. As the technical authority on your domains, you will lead architecture decisions and be accountable for ensuring systems meet rigorous non-functional requirements across security, observability, governance, performance, and scalability. You will produce and own the architecture artifacts that shape delivery — including architecture decision records (ADRs), component and data flow diagrams, and integration specifications — and provide the technical leadership that enables cross-functional teams of data engineers, ML engineers, and application developers to execute with clarity and confidence. Your contributions will be instrumental in shaping how clients adopt and scale AI, pushing the boundaries of what these systems can achieve and delivering measurable, lasting business value.

The Work:

• Translate business strategy into a technical vision by defining the non-functional requirements (NFRs) necessary to meet operational goals for performance, reliability, and cost.
• Lead stakeholder workshops to align on technical feasibility, define project scope, and manage expectations with clients and leadership.
• Drive the technology selection process, evaluating build-vs-buy decisions for AI platforms (e.g., Arize, LangSmith) and foundational models.
• Architect model- and tool-agnostic multi-agent systems governed by an MCP Control Plane.
• Design and implement the Agent Registry as the mandatory system of record and the AI Gateway for runtime policy enforcement.
• Design and implement a certification gate to ensure no uncertified agents enter production, validating identity, policies, and evaluation metrics.
• Design, implement, and abstract core agent services, including a first-class abstracted memory service with semantic, episodic, and procedural endpoints.
• Architect the end-to-end data pipeline for AI systems, including data ingestion, preprocessing, and synchronization for fine-tuning and RAG.
• Design and implement the context layer—spanning knowledge graphs, vector search, and semantic retrieval—to create reliable, grounded RAG pipelines.
• Architect foundation model adaptation strategies, including dynamic, cost-and-performance-aware model routing and selection.
• Design, implement, and prototype high-throughput, low-latency inferencing solutions using techniques like response caching and request batching.
• Define security, governance, and observability as centrally-enforced, by-design controls for all AI systems.
• Architect a robust, defense-in-depth security framework, including per-agent identity with IAM/IAP binding and layered guardrails.
• Design and implement FinOps controls enforced at the AI Gateway, including token budgets, cost-center labeling, and threshold alerts.
• Establish the framework for comprehensive system evaluation, adopting productized tools and instrumenting observability with OTel.
• Define and maintain the enterprise-wide AI reference architecture, reusable design patterns, and a library of approved software components.
• Independently design, implement, build, and deliver proof-of-concept prototypes and foundational software components to validate architectural decisions.
• Produce and own authoritative architecture artifacts, including blueprints, sequence diagrams, design specifications, and Architectural Decision Records (ADRs).
• Mentor and guide cross-functional engineering teams (data, ML, application) on architectural best practices and design patterns.
• Continuously research and integrate emerging AI patterns, frameworks, and technologies to maintain a forward-looking architecture.

Here’s what you need:

• Minimum of 5 years of experience in designing & deploying enterprise grade advanced ai solutions using agentic, generative and classical AI/ML using at least one cloud vendor.
• Minimum of 2 years of experience in the Agentic, LLM and Generative AI space.
• Minimum of 4 years of coding experience using python
• Minimum of 2 years of experience architecting and operationalizing LLM driven application architecture patterns.
• Minimum of 4 years in coding engineering, machine learning, deep learning and NLP solutions and applications.
• Minimum of 4 years of experience as a machine learning architect in the industry designing big data, machine learning. large scale analytical engineering solutions.
• Bachelor's Degree or equivalent English is required for this position, as the incumbent is required to interact regularly with English-speaking stakeholders across Canada. Given the significant volume of interactions with these English-speaking stakeholders—which is intrinsic to the role—reorganizing business activities to avoid this requirement is not feasible.

Compensation at Accenture varies depending on a wide array of factors, which may include but are not limited to the specific office location, role, skill set, and level of experience. As required by local law, Accenture provides a reasonable range of compensation, based on full-time employment, for roles that may be hired as set forth below. The recruiting efforts for this position are intended to fill a brand new position. The base pay range shown below is intended as a guideline to reflect the majority of offers for this role. It does not represent a maximum limit — in some cases, actual compensation may exceed the range where appropriate.

Role Location Annual Salary Range British Columbia/Ontario/New Brunswick $108,800 to $220,400 #LI-NA-FY25 #LI-MP

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities. Visit us at www.accenture.com

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences.All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, military veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by applicable law.Our rich diversity makes us more innovative, more competitive, and more creative, which helps us better serve our clients and our communities.

Bring your incredible skills and join our global team of innovators. We come together from different backgrounds across the world and work with the latest technologies to create value and growth for our clients. With us, you’ll continue to learn and grow so you can advance in your career. Your personal dreams and ambitions are just as important to us; that’s why we offer support any way we can—when you thrive, we all thrive.

Explore your next step at Accenture Belong. Grow. Thrive. Join agreat place to work for reinventors who drive meaningful change for our clients, communities, and the world. Wo rld. Explore your next step at Accenture