Data & Analytics Vienna ML & LLM Ops Specialist (all genders)

Vienna Insurance Group; Wien; Vor Ort; EUR 34.000 - 41.000; Vollzeit

Zusammenfassung

Vienna Insurance Group in Vienna is seeking a GenAI specialist to design and scale AI-powered products across the Group. You will work with data scientists, engineers, and product owners to translate complex problems into maintainable GenAI solutions.

The role emphasizes hands-on Databricks, MLflow, and RAG implementations, plus end-to-end LLMOps, evaluation, and governance. Strong Python skills and fluent English are required; German is a plus.

Qualifikationen

• Degree in Computer Science, Software Engineering, Information Systems, Data Science or AI-related field.
• Strong Python and software engineering skills with production experience.
• Hands-on Databricks, MLflow and model deployment experience.
• Practical knowledge of RAG, tool use and agent architectures.
• Excellent communication and teamwork; very good English; German a plus.

Aufgaben

• Collaborate with data scientists, data engineers, domain experts and product owners to design GenAI products across the Group.
• Design, build and operate RAG applications, copilots/assistants and actoric workflows on Databricks.
• Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops.
• Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate with human feedback.
• Develop agentic solutions using tool/function calling and orchestration frameworks such as LangChain and LangGraph.
• Ensure security, governance, reliability, latency and cost-efficiency; contribute reusable components, standards and documentation.

Kenntnisse

Python

Software engineering

LLM applications

AI/GenAI development

LLMOps

Ausbildung

Degree in Computer Science, Software Engineering, Information Systems, Data Science, AI

Tools

Databricks

MLflow

Model serving

Vector search

APIs

Data pipelines

Jobbeschreibung

• Collaborate with data scientists, data engineers, domain experts and product owners to design maintainable GenAI products across the Group
• Design, build and operate RAG applications, copilots/assistants, agentic workflows and other LLM-based solutions on Databricks
• Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops
• Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate them against expert human feedback
• Develop agentic solutions using tool/function calling, MCP and orchestration frameworks such as LangChain and LangGraph
• Ensure security, governance, reliability, latency and cost-efficiency; contribute reusable components, standards and documentation
• Degree in Computer Science, Software Engineering, Information Systems, Data Science, AI, or equivalent practical experience
• Strong Python and software engineering skills, with experience taking LLM applications from prototype to production
• Hands-on experience with Databricks, MLflow, model serving, vector search, APIs and data pipelines
• Practical knowledge of RAG, prompt engineering, tool use, agent architecture, stateful workflows and human-in-the-loop processes
• Experience designing AI judges, evaluation datasets and scoring rubrics, including validation against human assessments
• Strong understanding of CI/CD, observability, security, governance and responsible AI
• Excellent communication and teamwork skills, independent and solution-oriented working style, very good English, German is a plus

Benefits may vary between VIG companies

Based on the legal requirements, we inform about the monthly minimum salary according to the collective agreement of EUR 3,353.17 gross on the basis of full-time employment (37,5 hours / week). Of course, the remuneration package is market-compliant. It is important to us that your salary is based on your qualifications and experience, therefore we will discuss the salary together in a personal interview.
This full-time position is to be filled as soon as possible.

• More than 50 insurance companies and pension funds
• Operating in 30 countries
• Around 34,000 employees
• Around 36 million customers
• VIG share listed on the Vienna, Prague and Budapest stock exchanges
• Standard & Poor’s rating: A+ with positive outlook

We stand for diversity and respect. That is why we see it as an enrichment to employ people of different backgrounds, ages, genders, sexual orientations, religions and abilities.

As diverse as you are – your perspectives at the Vienna Insurance Group

Our employees are characterised by commitment, competence and service orientation. The diversity of these people makes a significant contribution to our success. We are committed to promoting diversity in the work environment and are proud to offer fair opportunities for all as an employer.

The CV and cover letter are most important to us. Other documents include certificates, letters of recommendation and references, which can then be submitted at a later date.