GenAI & LLM Ops Engineer – Data Analytics (Vienna)

Vienna Insurance Group; Wien; On-site; EUR 34,000 - 41,000; Full time

Job summary

Vienna Insurance Group in Vienna is seeking a GenAI specialist to design and scale AI-powered products across the Group. You will work with data scientists, engineers, and product owners to translate complex problems into maintainable GenAI solutions.

The role emphasizes hands-on Databricks, MLflow, and RAG implementations, plus end-to-end LLMOps, evaluation, and governance. Strong Python skills and fluent English are required; German is a plus.

Qualifications

• Degree in Computer Science, Software Engineering, Information Systems, Data Science or AI-related field.
• Strong Python and software engineering skills with production experience.
• Hands-on Databricks, MLflow and model deployment experience.
• Practical knowledge of RAG, tool use and agent architectures.
• Excellent communication and teamwork; very good English; German a plus.

Responsibilities

• Collaborate with data scientists, data engineers, domain experts and product owners to design GenAI products across the Group.
• Design, build and operate RAG applications, copilots/assistants and actoric workflows on Databricks.
• Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops.
• Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate with human feedback.
• Develop agentic solutions using tool/function calling and orchestration frameworks such as LangChain and LangGraph.
• Ensure security, governance, reliability, latency and cost-efficiency; contribute reusable components, standards and documentation.

Skills

Python

Software engineering

LLM applications

AI/GenAI development

LLMOps

Education

Degree in Computer Science, Software Engineering, Information Systems, Data Science, AI

Tools

Databricks

MLflow

Model serving

Vector search

APIs

Data pipelines

Job description

Vienna Insurance Group in Vienna is seeking a GenAI specialist to design and scale AI-powered products across the Group. You will work with data scientists, engineers, and product owners to translate complex problems into maintainable GenAI solutions.

The role emphasizes hands-on Databricks, MLflow, and RAG implementations, plus end-to-end LLMOps, evaluation, and governance. Strong Python skills and fluent English are required; German is a plus.