Senior AI Architect

Jimmy Technologies; Thüringen; Hybrid; EUR 110,000 - 150,000; Full time

Job summary

Jimmy Technologies seeks a highly experienced Senior AI Architect to drive GenAI strategy for a long-term public-sector project in Germany. You will lead the architecture of multiple GenAI solutions, with deep hands-on expertise in LLMs, fine-tuning, and deployment, especially in on-premises or sovereign cloud environments.

The role is long-term, full-time, with ~90% remote work and ~10% on-site in Nuremberg, start ASAP. German fluency and strong communication are essential.

Qualifications

• German fluency and strong communication skills.
• Lead architect on 2–3 GenAI projects, ideally in the public sector.
• In-depth knowledge of LLMs, RAG, GraphRAG, AI Gateways, and related architectures.
• Hands-on implementation experience: LLM fine-tuning or productive GenAI solutions.
• Experience with on-prem or sovereign cloud environments.
• Technical background in CS/ML/AI/Data Science.

Skills

German language

Communication skills

GenAI architecture

LLMs & RAG

GraphRAG

AI Gateways

On-prem / sovereign cloud

LLM fine-tuning

GenAI deployment

Public sector experience (Germany)

Education

Computer science / ML / AI / data science degree

Job description

We are seeking a highly experienced German-speaking Senior AI Architect for a long-term public - sector project in Germany. We're looking for an architect with a deep technical foundation in modern AI systems : someone who has led the architecture of multiple GenAI solutions and understands LLMs not just conceptually, but from the inside, including fine-tuning and productive deployment.

The environment is primarily on-premises / sovereign cloud, so experience designing AI systems outside of hyperscaler-native setups is key.

This is a long-term, full-time contract position , approx. 90% remote and 10% on site in Nuremberg.

Work Conditions

• Start Date : ASAP
• Location : ~90% remote, ~10% on site in Nuremberg

Job Requirements

• Very good German and strong communication skills.
• Lead architect experience on at least 2–3 GenAI projects, ideally in the public sector (not required).
• In-depth knowledge of LLMs, RAG, GraphRAG, AI Gateways, and comparable architectures.
• Deep understanding of modern AI model architecture and hands-on implementation experience, e.g. LLM fine-tuning or building productive GenAI solutions.
• Experience with on-prem architectures or sovereign cloud environments.
• Technical background, ideally a degree in computer science, machine learning, artificial intelligence, or data science.

Technical Requirements

Mandatory

• RAG and GraphRAG architectures
• AI Gateways and LLM orchestration patterns
• LLM fine-tuning and/or productive GenAI solution development
• On-prem or sovereign cloud AI infrastructure

Nice to have

• Public sector project experience (Germany / DACH)
• AWS
• Project management or technical delivery lead experience
• Academic background in ML, AI, or data science