ML & LLM Ops Specialist (all genders)

Vienna Insurance Group (VIG); Wien; Vor Ort; EUR 34.000 - 41.000; Vollzeit

Benefits dieser Stelle

Home office

Flexitime

37.5 hours / week

Onboarding and L&D program

Childcare services

Health care center

Canteen

Sports facilities

Employee Assistance Program

Flat hierarchy

Central Vienna office

Salary discussion in personalInterview

Zusammenfassung

Vienna Insurance Group (VIG) seeks an AI/GenAI specialist to design and implement range of LLM-based solutions across the Group. You will collaborate with data scientists, domain experts and product owners to create robust GenAI products and RAG-based copilots on Databricks.

You will establish end-to-end LLMOps, build AI judges for evaluation, and advance agentic workflows with LangChain/LangGraph. Strong Python, CI/CD, security and governance experience required.

Qualifikationen

• Degree in Computer Science, Software Engineering, Information Systems, Data Science, AI, or equivalent practical experience
• Strong Python and software engineering skills; experience taking LLM apps from prototype to production
• Hands-on experience with Databricks, MLflow, model serving, vector search, APIs and data pipelines
• Practical knowledge of RAG, prompt engineering, tool use, agent architecture, stateful workflows and human-in-the-loop processes
• Experience designing AI judges, evaluation datasets and scoring rubrics, including validation against human assessments
• Strong understanding of CI/CD, observability, security, governance and responsible AI
• Excellent communication and teamwork skills; very good English, German a plus

Aufgaben

• Collaborate with data scientists, data engineers, domain experts and product owners to design GenAI products across the Group
• Design, build and operate RAG applications, copilots/assistants, agentic workflows and other LLM-based solutions on Databricks
• Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops
• Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate them against expert human feedback
• Develop agentic solutions using tool/function calling, MCP and orchestration frameworks such as LangChain and LangGraph
• Ensure security, governance, reliability, latency and cost-efficiency; contribute reusable components, standards and documentation

Kenntnisse

Python

Software engineering

Databricks

MLflow

Model serving

Vector search

APIs

Data pipelines

RAG

Prompt engineering

Tool use

Agent architecture

Stateful workflows

Human-in-the-loop

AI judges

Evaluation datasets

Scoring rubrics

CI/CD

Observability

Security

Governance

Responsible AI

English (very good)

German (plus)

Ausbildung

CS degree

Software Engineering degree

Information Systems degree

Data Science degree

AI-related studies or experience

Equivalent practical experience

Tools

Databricks

MLflow

Model serving

APIs

Vector search

Data pipelines

Jobbeschreibung

• Collaborate with data scientists, data engineers, domain experts and product owners to design maintainable GenAI products across the Group
• Design, build and operate RAG applications, copilots/assistants, agentic workflows and other LLM-based solutions on Databricks
• Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops
• Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate them against expert human feedback
• Develop agentic solutions using tool/function calling, MCP and orchestration frameworks such as LangChain and LangGraph
• Ensure security, governance, reliability, latency and cost- efficiency; contribute reusable components, standards and documentation

Our Offer

• Great flexibility, e.g. home office, flexitime, 37.5 hours / week
• Extensive onboarding and learning & development program
• Benefits, including childcare services, company health care center, canteen, sports facilities, Employee Assistance Program
• Flat company hierarchy
• Workplace in the heart of Vienna and in the center of CEE in international teams
• Here you find more about our benefits
• Here you find more about VIG
• Based on the legal requirements, we inform about the monthly minimum salary according to the collective agreement of EUR 3,353.17 gross on the basis of full-time employment (37.5 hours / week). Of course, the remuneration package is market-compliant. It is important to us that your salary is based on your qualifications and experience, therefore we will discuss the salary together in a personal interview.
• This full-time position is to be filled as soon as possible

Your Profile

• Degree in Computer Science, Software Engineering, Information Systems, Data Science, AI, or equivalent practical experience
• Strong Python and software engineering skills, with experience taking LLM applications from prototype to production
• Hands-on experience with Databricks, MLflow, model serving, vector search, APIs and data pipelines
• Practical knowledge of RAG, prompt engineering, tool use, agent architecture, stateful workflows and human- in-the-loop processes
• Experience designing AI judges, evaluation datasets and scoring rubrics, including validation against human assessments
• Strong understanding of CI/CD, observability, security, governance and responsible AI
• Excellent communication and teamwork skills, independent and solution- oriented working style, very good English, German is a plus

Keyfacts

• No. 1 in Central and Eastern Europe
• More than 50 insurance companies and pension funds
• Operating in 30 countries
• Around 34,000 employees
• Around 36 million customers
• VIG share listed on the Vienna, Prague and Budapest stock exchanges
• Standard & Poor’s rating: A+ with positive outlook

We stand for diversity and respect. That is why we see it as an enrichment to employ people of different backgrounds, ages, genders, sexual orientations, religions and abilities. Become part of our diverse Group!