AI Large Language Model (LLM) Technology Architect

4200 Accenture AS Company

Oslo fylke

On-site

NOK 1,200,000 - 1,800,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Accenture PLC in Oslo is seeking a hands-on AI/LLM Architect at Associate Manager level to lead design and delivery of enterprise AI systems across ML, Generative AI, and agentic architectures. You will build components, evaluate frameworks, and produce ADRs and architecture blueprints while collaborating with data engineers, ML engineers, and application developers.

You will own end-to-end delivery from requirements to production, optimize cost and performance, ensure security and governance,

Qualifications

  • Proven experience in designing & deploying enterprise AI/ML solutions using agentic, generative and classical AI/ML, with at least one cloud vendor.
  • Practical experience in the Agentic, LLM and Generative AI space.
  • Well versed in coding using Python.
  • Solid foundation in architecting and operationalizing LLM-driven application architecture patterns.
  • Professional working experience in coding, engineering, ML, DL and NLP solutions.
  • Several years of hands-on experience as a machine learning architect designing big data and scalable analytical solutions.

Responsibilities

  • Independently design, build, and deliver software components across the AI architecture — owning them end to end from design through implementation, integration, and testing as a hands‑on practitioner.
  • Design and build AI agent architectures — including agents, prompts, tools, skills, and memory systems, with multi-agent orchestration.
  • Design and implement agent orchestration patterns for task handoffs, state management, and error recovery with prototyping.
  • Evaluate design options balancing capability, cost, performance, and reliability.
  • Design, build, and run evaluation strategies measuring accuracy, relevance, and faithfulness.
  • Architect and implement foundation model integrations (fine-tuning, RAG, custom integration) based on capability and cost.
  • Design and build model adaptation and fine-tuning pipelines for transformer architectures.
  • Design the AI context layer with context graphs and ingestion pipelines grounding AI outputs in enterprise content.
  • Build embedding, vector storage, and retrieval into end-to-end RAG pipelines.
  • Design and implement context assembly and memory components for grounded outputs.
  • Identify and build reusable components and patterns templated across engagements.
  • Design for cost efficiency and performance — optimizing usage, inference patterns, caching, and resource use.
  • Develop and validate systems against enterprise non-functional requirements including security and Responsible AI.
  • Create governance controls including versioning, audit logging, and lineage tracking; document models.
  • Build observability: logging, tracing, monitoring, alerting, and cost tracking for production readiness.
  • Produce architecture artifacts (ADRs, blueprints, design docs, data flow diagrams) to guide teams.
  • Continuously learn and apply new patterns and technologies while balancing innovation with reliability.
  • Collaborate with cross-functional teams to translate requirements into concrete architecture decisions.

Skills

Python
Agentic AI
Gen AI/LLM

Education

Bachelor's Degree or equivalent

Tools

Cloud platforms

Job description

AI Large Language Model (LLM) Technology Architect Career Level: Associate Manager #LI-EU

YOU ARE

As a hands-on AI/LLM Architect, you will be at the heart of designing and building advanced AI systems that power the modern enterprise. This is a deeply technical, hands‑on role — you will spend the majority of your time in the architecture and engineering of real‑world AI solutions across classical machine learning, generative AI, and agentic systems, delivering these within active client engagements. You will translate requirements into concrete architecture decisions: selecting design patterns, evaluating and benchmarking technical frameworks, assembling reusable components, and making deliberate technology choices that balance innovation with enterprise‑grade reliability. You will design and build AI agent architectures — including multi‑agent orchestration, tool use, skills use, and memory systems — and work hands‑on with foundation models through fine‑tuning, retrieval‑augmented generation (RAG), and custom model integration. A part of your work will also involve engineering the AI context layer that makes these systems intelligent in practice — connecting enterprise knowledge bases, structured and unstructured data sources, and domain‑specific content so that AI outputs are grounded, accurate, and relevant to the client's business. You will design and validate systems against enterprise non‑functional requirements across security, observability, governance, performance, and scalability. A core output of this role is the production of tangible engineering and architecture deliverables. This means writing and owning software components — building, integrating, and testing AI system modules as a practitioner — alongside producing detailed architecture artifacts including architecture decision records (ADRs), component diagrams, data flow diagrams, and integration specifications that guide and enable broader engineering teams. You will work with cross‑functional delivery teams alongside data engineers, ML engineers, and application developers, and this role is an opportunity to develop deep expertise across the full AI architecture stack, sharpen your engineering instincts on complex, real‑world problems, and build a foundation for growing into a lead or principal architect over time.

THE WORK
  • Independently design, build, and deliver software components across the AI architecture — owning them end to end from design through implementation, integration, and testing as a hands‑on practitioner
  • Design and build AI agent architectures — including individual agents, their prompts, tools, and skills, multi‑agent orchestration, and memory systems — making deliberate design pattern and technology choices
  • Design and implement agent orchestration patterns that handle task handoffs, communication, state management, and error recovery, validating them through hands‑on prototyping
  • Evaluate multiple design options and technical approaches, making deliberate, justified design choices that balance capability, cost efficiency, performance, and enterprise‑grade reliability
  • Design, build, and run evaluation strategies and harnesses that measure agent and system quality on metrics such as accuracy, relevance, and faithfulness, translating findings into design improvements
  • Architect and implement foundation model integrations — selecting the right models, invocation patterns, and customization approaches (fine‑tuning, RAG, custom integration) based on capability, cost, and performance trade‑offs
  • Design and build model adaptation and fine‑tuning pipelines, applying working knowledge of transformer‑based architectures to inform model selection and optimization
  • Design and build the AI context layer — including context graph design and ingestion pipelines that parse, chunk, enrich, and index structured and unstructured enterprise content, and the retrieval components that ground AI outputs in the client's knowledge
  • Build embedding, vector storage, and retrieval (semantic, hybrid, reranking) into end‑to‑end RAG pipelines, applying integration patterns that connect to enterprise data sources
  • Design and implement context assembly and memory components that manage prompts, context windows, and conversational state for grounded, accurate outputs
  • Identify, design, and build reusable components and solution patterns that accelerate delivery and can be templated across engagements
  • Design for cost efficiency and performance — optimizing model usage, inference patterns, caching, and resource utilization to meet target latency, throughput, and cost objectives
  • Design, build, and validate systems against enterprise non‑functional requirements — implementing guardrails, prompt‑injection defenses, PII handling, and access controls for security and Responsible AI
  • Build governance controls including versioning, audit logging, and lineage tracking, and produce the model documentation that keeps systems auditable
  • Build observability into systems — logging, tracing, monitoring, alerting, and cost tracking — to ensure AI solutions remain healthy, performant, and scalable in production
  • Produce detailed architecture artifacts — including architecture decision records (ADRs), architecture blueprints, design documents, agent orchestration and integration pattern specifications, component and data flow diagrams — that guide and enable broader engineering teams
  • Continuously learn, evaluate, and apply new design patterns, frameworks, and technologies across the fast‑evolving AI landscape, balancing innovation with enterprise‑grade reliability
  • Collaborate with cross‑functional delivery teams — data engineers, ML engineers, and application developers — to translate requirements into concrete architecture decisions that meet stakeholder needs
EDUCATION

Bachelor's Degree or equivalent

BASIC (REQUIRED) QUALIFICATION
  • Proven experience in designing & deploying enterprise grade advanced ai solutions using agentic, generative and classical AI/ML using at least one cloud vendor
  • Practical experience in the Agentic, LLM and Generative AI space
  • Well versed in coding using python
  • Solid foundation in architecting and operationalizing LLM driven application architecture patterns
  • Professional working experience in coding engineering, machine learning, deep learning and NLP solutions and applications
  • Several years of hands on experience as a machine learning architect in the industry designing big data, machine learning, large scale analytical engineering solutions
About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale.

We are a talent‑and innovation‑led company with approximately 791,000 people serving clients in more than 120 countries.

Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships.

We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability.

Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships.

We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com

Equal Employment Opportunity Statement

We believe that no one should be discriminated against because of their differences.All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, sexual orientation, gender identity or expression, marital status, citizenship status or any other basis as protected by applicable law.

Bring your incredible skills and join our global team of innovators. We come together from different backgrounds across the world and work with the latest technologies to create value and growth for our clients. With us, you’ll continue to learn and grow so you can advance in your career. Your personal dreams and ambitions are just as important to us; that’s why we offer support any way we can—when you thrive, we all thrive.

Explore your next step at Accenture Belong. Grow. Thrive. Join a great place to work for reinventors who drive meaningful change for our clients, communities, and the world.

Wo rld. Explore your next step at Accenture

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Large Language Model (LLM) Technology Architect
AI Large Language Model (LLM) Technology Architect

Accenture Nordics • Oslo fylke

On-site
NOK 1,000,000 - 1,600,000
AI Engineer
AI Engineer

AECOM • Oslo fylke

On-site
NOK 900,000 - 1,200,000
AI Tech Architect — Lead AI/Cloud Architecture & Innovation
AI Tech Architect — Lead AI/Cloud Architecture & Innovation

Boston Consulting Group • Oslo fylke

On-site
NOK 900,000 - 1,300,000
Enterprise AI Architect: LLM & Agent Systems
Enterprise AI Architect: LLM & Agent Systems

Accenture Nordics • Oslo fylke

On-site
NOK 1,000,000 - 1,600,000
Vil du være med på å utvikle AI-løsninger som brukes av tusenvis av mennesker?
Vil du være med på å utvikle AI-løsninger som brukes av tusenvis av mennesker?

4200 Accenture AS Company • Oslo fylke

On-site
NOK 850,000 - 1,200,000
AI-utvikler søkes – bli med på å forme morgendagens teknologi
AI-utvikler søkes – bli med på å forme morgendagens teknologi

Accenture PLC • Oslo fylke

On-site
NOK 900,000 - 1,500,000
Forward Deployed Consultant
Forward Deployed Consultant

monday.com • London

Hybrid
NOK 820,000 - 1,136,000
AI LLM Architect: Enterprise Agentic Systems
AI LLM Architect: Enterprise Agentic Systems

4200 Accenture AS Company • Oslo fylke

On-site
NOK 1,200,000 - 1,800,000
Senior AI Engineer - Center of Excellence
Senior AI Engineer - Center of Excellence

Columbus Norway AS • Oslo

On-site
NOK 1,500,000 - 2,200,000
Senior Manager to Technology Strategy & Transformation – Oslo og Stavanger
Senior Manager to Technology Strategy & Transformation – Oslo og Stavanger

4200 Accenture AS Company • Oslo fylke

Hybrid
NOK 950,000 - 1,250,000
Pensjonsordning
Kollektiv helseforsikring
Ansattaksjer
+2
Top locations