AI Solutions Architect (m/f/d)

EPAM Systems; Deutschland; On-site; EUR 120,000 - 180,000; Full time

Benefits offered by this job

30 days holiday

Company Pension Scheme

Discount on Fitness-First Black

Employee Stock Purchase Plan (ESPP)

Learning and development opportunities

Flexible and remote working

Award-winning workplace

Job summary

EPAM Systems, Inc. in Germany seeks an AI Solutions Architect (m/f/d) to design and deliver AI-native solutions, leveraging LLMs and agentic systems to drive real business value.

You will work hands-on to build scalable architectures, write production-grade code, and create evaluation frameworks ensuring performance and reliability. You will collaborate with stakeholders to integrate AI into business processes, improve operations and decision-making, and deploy secure cloud solutions with CI/CD

Qualifications

• 7+ years of engineering experience delivering production-grade AI or LLM-based systems.

Responsibilities

• Build AI-native solutions end-to-end, including agents, RAG workflows, tool harnesses and evaluation frameworks.
• Design fault-tolerant agent workflows with retries, fallbacks and human-in-the-loop mechanisms.
• Translate business and domain expertise into scalable AI solutions.
• Write robust production-grade Python code covering APIs, integrations and secure deployment.
• Develop observability tools to monitor performance and reliability.
• Deploy solutions securely in cloud environments using containerized deployments and CI/CD pipelines.

Skills

Agent design

RAG techniques

Python

Software engineering

LLMs

German fluency

Tools

LangChain

LangGraph

Semantic Kernel

OpenAI

Anthropic

Google Gemini

Job description

We're looking for an AI Solutions Architect (m/f/d) to join our team in Germany in a hybrid working mode.In this role, you will design and deliver AI-native solutions where Large Language Models (LLMs) and advanced agentic systems generate real business value. You will work hands-on to build scalable architectures, write production-grade code, and create evaluation frameworks that ensure high performance and reliability.You will collaborate directly with stakeholders and end users to deeply understand their workflows, integrate AI technologies seamlessly into business processes, and improve operations and decision-making. This position demands technical excellence, user-centric problem-solving, and the ability to deliver innovative solutions aligned with client goals.ResponsibilitiesBuild AI-native solutions end-to-end, including agents, Retrieval-Augmented Generation (RAG) workflows, tool harnesses and evaluation frameworksDesign fault-tolerant agent workflows with retries, fallbacks and human-in-the-loop mechanisms to ensure reliabilityTranslate business and domain expertise into scalable, repeatable AI solutionsWrite robust production-grade Python code covering APIs, integrations and secure deploymentOptimize retrieval and context engineering capabilities using vector databases, embeddings and hybrid searchDevelop observability tools with platforms such as LangSmith or Arize Phoenix to monitor performanceDeploy solutions securely in cloud environments (AWS, Azure or GCP) using containerized deployments and CI/CD pipelinesConduct user testing and workflow analysis to validate real-world usabilityCollaborate with cross-functional teams to assess technical feasibility and shape use casesRequirements7+ years of engineering experience delivering production-grade AI or LLM-based systemsExpertise in agent design and RAG techniques (vector databases, hybrid search, embedding optimization)Advanced proficiency in Python and strong software engineering fundamentalsExperience with frameworks such as LangChain, LangGraph or Semantic Kernel and familiarity with major LLM providers (OpenAI, Anthropic, Google Gemini)Proven ability to design evaluation pipelines and apply AI observability toolsHands-on deployment experience with major cloud platforms and CI/CD practicesStrong communication skills for both technical and non-technical audiencesFluency in German and English at C1 level or higherNice to haveExperience with A/B testing and iterative improvements based on usage dataBackground in NLP or applied machine learning, including production deploymentKnowledge of advanced retrieval methods and enterprise-grade context engineeringFamiliarity with AI governance, compliance, security guardrails and injection preventionExposure to enterprise AI platforms such as AWS Bedrock or Databricks GeniePrevious work in client-facing or pre-sales consulting rolesWe offer30 days holiday per annumCompany Pension SchemeRegular performance assessmentsDiscount on Fitness-First Black Membershipbitkom - Corporate BenefitsEmployee Stock Purchase Plan (ESPP) (subject to certain eligibility requirements)Learning and development opportunities, including in-house training and coaching, professional certifications, and coursesFriendly and enjoyable working teamRegular corporate and social eventsFlexible and remote working opportunitiesAward-winning workplace: Great Place To Work certified in 2026, Kununu (Top Company 2022–2026), NewWork Business Award 2025 for outstanding culture, innovation and employee satisfaction.