LLMOps Engineer for GenAI & RAG Apps - Hybrid

Mental Health Group; Wien; Hybrid; EUR 34,000 - 41,000; Full time

Benefits offered by this job

Flexible hours

Home office

Learning & development

Life balance

Modern workspace

Health & sports

Job summary

Mental Health Group in Vienna is seeking an ML & LLM Ops Specialist (all genders) for a full-time hybrid role. You will collaborate across data scientists, domain experts and product owners to design GenAI products and to build and operate RAG apps on Databricks.

Ideal candidates have strong Python/engineering skills, Databricks/MLflow experience and a good grasp of LangChain/LangGraph. English required; German is a plus.

Qualifications

• Degree in CS/SE/Data Science or equivalent with hands-on AI experience.
• Strong Python and software engineering skills suitable for production-grade GenAI.
• Hands-on Databricks, MLflow, model serving and data pipelines.
• Knowledge of RAG, prompt engineering, tool use and agent architectures.
• Experience designing AI judges and evaluation datasets.
• CI/CD, observability, security, governance and responsible AI.

Responsibilities

• Collaborate with data scientists, data engineers, domain experts and product owners to design maintainable GenAI products across the Group
• Design, build and operate RAG applications, copilots/assistants, agentic workflows and other LLM-based solutions on Databricks
• Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops
• Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate them against expert human feedback
• Develop agentic solutions using tool/function calling, MCP and orchestration frameworks such as LangChain and LangGraph
• Ensure security, governance, reliability, latency and cost-efficiency; contribute reusable components, standards and documentation

Skills

Python

Software engineering

Communication

Teamwork

English (fluent)

German (plus)

Education

Degree in Computer Science, Software Engineering, Information Systems, Data Science, AI, or equivalent

Tools

Databricks

MLflow

LangChain

LangGraph

APIs & data pipelines

Vector search

Job description

Mental Health Group in Vienna is seeking an ML & LLM Ops Specialist (all genders) for a full-time hybrid role. You will collaborate across data scientists, domain experts and product owners to design GenAI products and to build and operate RAG apps on Databricks.

Ideal candidates have strong Python/engineering skills, Databricks/MLflow experience and a good grasp of LangChain/LangGraph. English required; German is a plus.