ML & LLM Ops Spezialist:in

VIG IT Digital Solutions; Wien; On-site; EUR 34,000 - 41,000; Full time

Benefits offered by this job

Home office

Flexitime

Onboarding program

Childcare services

Company health care center

Canteen

Sports facilities

Employee Assistance Program

Flat hierarchy

Vienna HQ

Job summary

Vienna Insurance Group (VIG) in Vienna, Austria, seeks a GenAI engineer to design and operate cutting-edge LLM-based solutions across the Group. You’ll collaborate with data scientists, data engineers and product owners to build RAG applications and agentic workflows on Databricks.

You will establish end-to-end LLMOps processes, develop AI judges, ensure governance, security and cost efficiency, and contribute reusable components. Fluent English required; German is a plus. Full-time in Vienna.

Qualifications

• Degree in Computer Science, Software Engineering, Information Systems, Data Science, AI, or equivalent practical experience
• Strong Python and software engineering skills, with experience taking LLM applications from prototype to production
• Hands-on experience with Databricks, MLflow, model serving, vector search, APIs and data pipelines
• Practical knowledge of RAG, prompt engineering, tool use, agent architecture, stateful workflows and human- in-the-loop processes
• Experience designing AI judges, evaluation datasets and scoring rubrics, including validation against human assessments
• Strong understanding of CI/CD, observability, security, governance and responsible AI
• Excellent communication and teamwork skills, independent and solution- oriented working style, very good English, German is a plus

Responsibilities

• Collaborate with data scientists, data engineers, domain experts and product owners to design maintainable GenAI products across the Group
• Design, build and operate RAG applications, copilots/assistants, agentic workflows and other LLM-based solutions on Databricks
• Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops
• Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate them against expert human feedback
• Develop agentic solutions using tool/function calling, MCP and orchestration frameworks such as LangChain and LangGraph
• Ensure security, governance, reliability, latency and cost- efficiency; contribute reusable components, standards and documentation

Skills

Python

English

Communication

Teamwork

CI/CD

Cost awareness

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

MLflow

Model serving

Vector search

APIs

Job description

Your Tasks

• Collaborate with data scientists, data engineers, domain experts and product owners to design maintainable GenAI products across the Group


• Design, build and operate RAG applications, copilots/assistants, agentic workflows and other LLM-based solutions on Databricks


• Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops


• Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate them against expert human feedback


• Develop agentic solutions using tool/function calling, MCP and orchestration frameworks such as LangChain and LangGraph


• Ensure security, governance, reliability, latency and cost- efficiency; contribute reusable components, standards and documentation

Our Offer

• Great flexibility, e.g. home office, flexitime, 37.5 hours / week


• Extensive onboarding and learning & development program


• Benefits, including childcare services, company health care center, canteen, sports facilities, Employee Assistance Program


• Flat company hierarchy


• Workplace in the heart of Vienna and in the center of CEE in international teams


• Here you find more about our benefits


• Here you find more about VIG


• Based on the legal requirements, we inform about the monthly minimum salary according to the collective agreement of EUR 3,353.17 gross on the basis of full-time employment (37.5 hours / week). Of course, the remuneration package is market-compliant. It is important to us that your salary is based on your qualifications and experience, therefore we will discuss the salary together in a personal interview.


• This full-time position is to be filled as soon as possible

Your Profile

• Degree in Computer Science, Software Engineering, Information Systems, Data Science, AI, or equivalent practical experience


• Strong Python and software engineering skills, with experience taking LLM applications from prototype to production


• Hands-on experience with Databricks, MLflow, model serving, vector search, APIs and data pipelines


• Practical knowledge of RAG, prompt engineering, tool use, agent architecture, stateful workflows and human- in-the-loop processes


• Experience designing AI judges, evaluation datasets and scoring rubrics, including validation against human assessments


• Strong understanding of CI/CD, observability, security, governance and responsible AI


• Excellent communication and teamwork skills, independent and solution- oriented working style, very good English, German is a plus

Does this sound interesting to you?

Keyfacts

• *No. 1 in Central and Eastern Europe*


• *More than 50 insurance companies and pension funds*


• *Operating in 30 countries*


• *Around 34,000 employees*


• *Around 36 million customers*


• *VIG share listed on the Vienna, Prague and Budapest stock exchanges*


• *Standard & Poor’s rating: A+ with positive outlook*

*We stand for diversity and respect. That is why we see it as an enrichment to employ people of different backgrounds, ages, genders, sexual orientations, religions and abilities. Become part of our diverse Group!*