Senior AI Platform & Software Engineer (m/f/d)

Validas AG; München; On-site; EUR 110,000 - 160,000; Full time

Benefits offered by this job

Attractive compensation

Flexible working hours

Home office option

Company pension scheme

Individual training opportunities

Casual work environment

Regular team events

Modern office near S-Bahn Hackerbrücke

Pool table, games, drinks, high-end咖啡機

Job summary

Validas AG in Munich seeks a Senior AI Platform & Software Engineer to build and operate the secure, scalable AI infrastructure powering our products and internal processes. You will deploy self-hosted LLMs, integrate AI capabilities, and optimize performance across Linux environments.

Responsibilities include API integration, guardrails and governance, robust documentation, and architecture decisions. Strong German/English, Linux, and GPU experience are essential.

Qualifications

• Degree in CS/SE/DS/AI or equivalent qualification with experience.
• Several years in software development, AI engineering or IT operations.
• Strong Linux skills and API/distributed systems experience.
• Solid understanding of AI concepts, LLMs, embeddings, and inference services.
• Security-focused with RBAC, SSO, auditing and secrets management.
• Fluent German and English communication abilities.

Responsibilities

• Develop and integrate innovative software solutions for Validas products and internal tools.
• Design, operate and improve internal AI/LMM infrastructure and self-hosted models.
• Optimize performance, memory use, throughput and hardware utilization.
• Administer Linux systems, GPUs, drivers, and multi-GPU configurations.
• Implement security guardrails and content filters; ensure governance and auditing.
• Create documentation, specifications and contribute to architecture decisions.

Skills

Linux

APIs

Distributed systems

LLMs

Embeddings

Inference services

RAG pipelines

Security concepts

German language

English language

Analytical thinking

Education

Degree in Computer Science/Software Engineering/Data Science/AI

Tools

vLLM

TGI

llama.cpp

NVIDIA Triton

CUDA toolkit

Job description

Senior AI Platform & Software Engineer (m/f/d)

Full or part-time

Your mission

You want to help build a secure, scalable platform that powers real-world software products? Then join our development team and help shape the technical foundation for the next generation of our software solutions.

At Validas, you will take responsibility for the development and continuous improvement of our AI infrastructure. In this role, you will create the foundation for the secure, reliable, and efficient use of modern AI technologies across our products and internal processes.

You will play a key role in expanding our AI capabilities and driving innovation throughout the organization. Your responsibilities will include, among others:

• Software Development and Integration: You will develop and enhance innovative software solutions for our Validas products, internal tools, and business processes. In this role, you will integrate modern AI capabilities into existing applications using secure APIs, services, and workflows.
• AI and LLM Platform: You will design, operate, and continuously improve our internal AI and LLM infrastructure. In addition, you will deploy and manage self-hosted Large Language Models as inference services and evaluate suitable models, model formats, and quantization techniques.
• Performance and Operations: You will optimize context handling, KV cache and memory consumption, throughput, latency, and hardware resource utilization. You will also ensure reliable operations through monitoring, backup and recovery processes, and proactive capacity planning.
• Linux, GPU, and Infrastructure: You will administer the underlying Linux systems and manage GPU and accelerator hardware, including drivers, primarily the CUDA toolkit and driver stack. Furthermore, you will support multi-GPU configurations and hardware upgrades.
• Security and Governance: You will protect our AI infrastructure against prompt injection, data leakage, and misuse by implementing guardrails and content filters, and you will secure the platform through RBAC, SSO, audit logging, and secrets management.
• Documentation, Architecture and Quality: You will create technical specifications, operational documentation, and security designs, while contributing to architectural decisions. In addition, you will ensure the quality, stability, and maintainability of our systems through testing, code reviews, monitoring, and structured root cause analysis.

Your profile

What you bring

• A degree in Computer Science, Software Engineering, Data Science, Artificial Intelligence, or a comparable field; alternatively, a vocational qualification in IT combined with relevant professional experience.
• Several years of experience in software development, AI engineering, system administration, or the operation of production‑grade IT systems.
• Strong Linux skills, along with experience working with APIs, internal services, and distributed systems.
• A solid understanding of modern AI and machine learning concepts, particularly in the areas of LLMs, embeddings, inference service integration, and agentic workflows / RAG pipelines.
• Solid knowledge of security principles, access control concepts, authentication mechanisms, and the secure operation of IT systems.
• Strong analytical thinking, a pragmatic approach to problem‑solving, and a passion for turning emerging technologies into robust, practical solutions.
• Good written and spoken German and English skills.

Preferred Qualifications

• Experience operating LLM‑based systems, AI serving frameworks, or tools such as vLLM, TGI, llama.cpp, or NVIDIA Triton, or comparable technologies.
• Knowledge of model formats, quantization, tokenization, context windows, LoRA, and performance optimization techniques for AI systems.
• Hands‑on experience with GPU or accelerator hardware, device drivers, the CUDA toolkit and driver stack, GPU memory management, and multi‑GPU configurations.
• Experience with monitoring, backup and recovery, capacity planning, and the operation of business‑critical systems.
• Understanding of AI‑specific security risks, including prompt injection, data leakage, insecure tool usage, and excessive agent permissions.

We offer

• Attractive compensation
• Flexible working hours & option for home office
• Company pension scheme
• Individual training opportunities
• Casual work environment with employees from 20+ different nations
• Regular team events
• Spacious, light‑filled, and modern office spaces
• Convenient location directly at the S-Bahn station Hackerbrücke in the heart of Munich
• Pool table, games, drinks, and a high‑end coffee machine

About us

We make the world safer: Validas AG from Munich is a hidden champion in the field of functional safety. For 25 years, we have been supporting our international customers from the automotive, aerospace and semiconductor industries with the qualification of tools, libraries, and basic software, as well as powerful qualification kits for code generators, compilers, and simulators.

This ensures that the software used in cars, airplanes, or complex technical systems meets the highest safety requirements and common safety standards such as ISO 26262 or IEC 61508.

The demands for safe an reliable software are continuously growing - and so is our company. Become a part of Validas!