AI Large Language Model (LLM) Engineer

Accenture Belgium; Brussel; On-site; EUR 70,000 - 110,000; Full time

Job summary

Accenture Belgium is seeking a hands-on AI Engineer to design and build AI system components across ML, generative AI, and agentic systems within client engagements.

You will translate detailed design specs into production-ready software, wire agents, tools, and memory components, ensuring security, observability, and governance across the stack. This role offers growth toward lead engineer or architect roles.

Qualifications

• Experience designing, coding, building advanced AI solutions using agentic, generative and classical AI/ML with at least one cloud vendor.
• Experience in the Agentic, LLM and Generative AI space.
• Experience architecting and operationalizing LLM-driven application architectures.
• Experience in coding and engineering, machine learning, deep learning and NLP solutions.
• Proficiency in Python

Responsibilities

• Design, build, and configure agents, prompts, tools, and skills for multi-agent workflows.
• Implement agent orchestration logic for handoffs, communication and error recovery.
• Build evaluation harnesses and test suites measuring accuracy, relevance, and faithfulness.
• Integrate foundation models into applications and select appropriate model invocation patterns.
• Develop model fine-tuning pipelines and data preparation for domain adaptation.
• Create ingestion pipelines to parse and index unstructured content for retrieval.
• Implement embedding generation, vector databases, and retrieval components for RAG pipelines.
• Assemble prompts and manage context window data passed to models.
• Develop memory components to store and recall conversation history.
• Implement input/output guardrails, content filtering, and prompt-injection defenses.
• Build PII detection and redaction components with access controls.
• Versioning, audit logging and lineage tracking; maintain model documentation.
• Instrument components with logging, tracing, and cost tracking in production.
• Continuously learn design patterns and frameworks; collaborate with cross-functional teams.
• Create and maintain clear technical documentation for troubleshooting and future work.

Skills

Python

Agentic AI

Generative AI

Classical AI/ML

Cloud platforms

Education

Bachelor's Degree in Computer Science, Computer Engineering, Data Science, or related engineering discipline

Tools

Vector databases

Model serving

ML pipelines

Transformer architectures

Job description

As a hands on AI Engineer, you will be at the heart of designing and building the components that make up advanced AI systems powering the modern enterprise. This is a deeply technical, hands-on engineering role — you will spend the majority of your time in the detailed design, development, integration, and testing of AI system components across classical machine learning, generative AI, and agentic systems, delivering these within active client engagements. You will take detailed architecture and design specifications and translate them into working, production-quality software components. This means writing clean, well-structured code, making low-level design decisions within your assigned scope, and ensuring your components integrate reliably within the broader AI system. You will build and wire together the constituent parts of AI agent systems — including individual agent logic, tool integrations, skills, and memory components — and contribute to the development and integration of foundation and classical ML models into end-to-end pipelines. A hands-on curiosity for the open source ecosystem is essential in this role. You will continuously evaluate, learn, and adopt relevant open source libraries and frameworks — such as those spanning agent orchestration, vector storage, model serving, and ML pipelines — selecting and applying the right ones for the problem at hand. Equally, you will configure, integrate, and operationalize third-party AI technologies and platform services, understanding their capabilities and constraints deeply enough to make them work reliably within the context of a larger enterprise system. You will engineer components with enterprise-grade qualities in mind, ensuring your work meets defined requirements across security, observability, governance, performance, and scalability. You will write and maintain the technical artifacts that accompany your engineering work — including low-level design documents, component specifications, and integration contracts — ensuring your work is well-documented, testable, and handoff-ready. You will operate as a practitioner within cross-functional delivery teams alongside data engineers, ML engineers, and application developers, taking direction from lead and principal architects while contributing meaningfully to technical problem-solving and design discussions within your domain. This role is an opportunity to build deep, hands-on expertise across the AI engineering stack, develop strong software engineering fundamentals applied to cutting-edge AI systems, and grow toward a lead engineer or architect role over time.

THE WORK

• Design, build, and configure individual agents — including their prompts, tools, and skills — and integrate them into multi-agent workflows
• Implement agent orchestration logic that handles task handoffs, communication, and error recovery
• Build evaluation harnesses and test suites that measure agent and component quality on metrics such as accuracy, relevance, and faithfulness, and share findings to inform design improvements
• Integrate foundation models into applications, selecting the appropriate model and invocation pattern for each use case
• Build and run model fine-tuning pipelines — including data preparation and training — to adapt models to specific business domains, applying working knowledge of transformer-based architectures
• Build ingestion pipelines that parse, chunk, enrich, and index unstructured enterprise content for retrieval
• Implement embedding generation, integrate vector databases, and develop retrieval components, including connectors and adapters that process unstructured content into end-to-end RAG pipelines
• Build the logic that assembles prompts and manages what information is passed to the model within its context window
• Implement memory components that store and recall conversational history and other relevant context
• Implement input/output guardrails, content filtering, and defenses against prompt injection
• Build PII detection and redaction components and integrate access controls for model and tool access
• Implement versioning, audit logging, and lineage tracking, and maintain model documentation that keeps the system auditable
• Instrument components with logging and tracing for requests, responses, token usage, and tool calls
• Contribute to monitoring, alerting, and cost tracking that keep AI systems healthy in production
• Continuously learn and apply new design patterns, technologies, and frameworks across the fast-evolving AI landscape, bringing fresh approaches to the components you build
• Collaborate within cross-functional teams to clarify requirements and ensure your components meet stakeholder needs
• Create and maintain clear technical documentation for the components you build, supporting troubleshooting and future development

EDUCATION

• Bachelor's Degree in Computer Science, Computer Engineering, Data Science, or a related engineering discipline

Basic (required) Qualification

• Experience (work or coursework) in designing, coding, building advanced AI solutions using agentic, generative and classical AI/ML using at least one cloud vendor.
• Experience (work or coursework in the Agentic, LLM and Generative AI space.
• Experience (work or coursework) architecting and operationalizing LLM driven application architecture patterns.
• Experience in coding and engineering, machine learning, deep learning and NLP solutions and applications.
• Coding experience using Python