ML & LLM Ops Specialist (all genders)

Mental Health Group; Wien; Hybrid; EUR 34,000 - 41,000; Full time

Benefits offered by this job

Flexible hours

Home office

Learning & development

Life balance

Modern workspace

Health & sports

Job summary

Mental Health Group in Vienna is seeking an ML & LLM Ops Specialist (all genders) for a full-time hybrid role. You will collaborate across data scientists, domain experts and product owners to design GenAI products and to build and operate RAG apps on Databricks.

Ideal candidates have strong Python/engineering skills, Databricks/MLflow experience and a good grasp of LangChain/LangGraph. English required; German is a plus.

Qualifications

• Degree in CS/SE/Data Science or equivalent with hands-on AI experience.
• Strong Python and software engineering skills suitable for production-grade GenAI.
• Hands-on Databricks, MLflow, model serving and data pipelines.
• Knowledge of RAG, prompt engineering, tool use and agent architectures.
• Experience designing AI judges and evaluation datasets.
• CI/CD, observability, security, governance and responsible AI.

Responsibilities

• Collaborate with data scientists, data engineers, domain experts and product owners to design maintainable GenAI products across the Group
• Design, build and operate RAG applications, copilots/assistants, agentic workflows and other LLM-based solutions on Databricks
• Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops
• Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate them against expert human feedback
• Develop agentic solutions using tool/function calling, MCP and orchestration frameworks such as LangChain and LangGraph
• Ensure security, governance, reliability, latency and cost-efficiency; contribute reusable components, standards and documentation

Skills

Python

Software engineering

Communication

Teamwork

English (fluent)

German (plus)

Education

Degree in Computer Science, Software Engineering, Information Systems, Data Science, AI, or equivalent

Tools

Databricks

MLflow

LangChain

LangGraph

APIs & data pipelines

Vector search

Job description

WORKING IN THE MIDDLE OF VIENNA:
EXCHANGING ACROSS EUROPE

ML & LLM Ops Specialist (all genders)

Vienna
full-time
hybrid
all genders
asap
experienced
Data & Analytics

Your Tasks

• Collaborate with data scientists, data engineers, domain experts and product owners to design maintainable GenAI products across the Group
• Design, build and operate RAG applications, copilots/assistants, agentic workflows and other LLM-based solutions on Databricks
• Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops
• Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate them against expert human feedback
• Develop agentic solutions using tool/function calling, MCP and orchestration frameworks such as LangChain and LangGraph
• Ensure security, governance, reliability, latency and cost-efficiency; contribute reusable components, standards and documentation

Your Benefits

37,5 Working Hours, Flexi Time & Home-Office

Learning & Development

Life Balance & Family Specials

Modern Workspace & Canteen

Health & Sports Offers

More Benefits

Your Profile

• Degree in Computer Science, Software Engineering, Information Systems, Data Science, AI, or equivalent practical experience
• Strong Python and software engineering skills, with experience taking LLM applications from prototype to production
• Hands-on experience with Databricks, MLflow, model serving, vector search, APIs and data pipelines
• Practical knowledge of RAG, prompt engineering, tool use, agent architecture, stateful workflows and human-in-the-loop processes
• Experience designing AI judges, evaluation datasets and scoring rubrics, including validation against human assessments
• Strong understanding of CI/CD, observability, security, governance and responsible AI
• Excellent communication and teamwork skills, independent and solution-oriented working style, very good English, German is a plus

Based on the legal requirements, we inform about the monthly minimum salary according to the collective agreement of EUR 3,353.17 gross on the basis of full-time employment (37,5 hours / week). Of course, the remuneration package is market-compliant. It is important to us that your salary is based on your qualifications and experience, therefore we will discuss the salary together in a personal interview.
This full-time position is to be filled as soon as possible.

Keyfacts

• No. 1 in Central and Eastern Europe
• More than 50 insurance companies and pension funds
• Operating in 30 countries
• Around 34,000 employees
• Around 36 million customers
• VIG share listed on the Vienna, Prague and Budapest stock exchanges
• Standard & Poor’s rating: A+ with positive outlook

We stand for diversity and respect. That is why we see it as an enrichment to employ people of different backgrounds, ages, genders, sexual orientations, religions and abilities. Become part of our diverse Group!