GenAI LLM Ops Engineer — Databricks, RAG, Remote

VIG IT Digital Solutions; Wien; On-site; EUR 34,000 - 41,000; Full time

Benefits offered by this job

Home office

Flexitime

Onboarding program

Childcare services

Company health care center

Canteen

Sports facilities

Employee Assistance Program

Flat hierarchy

Vienna HQ

Job summary

Vienna Insurance Group (VIG) in Vienna, Austria, seeks a GenAI engineer to design and operate cutting-edge LLM-based solutions across the Group. You’ll collaborate with data scientists, data engineers and product owners to build RAG applications and agentic workflows on Databricks.

You will establish end-to-end LLMOps processes, develop AI judges, ensure governance, security and cost efficiency, and contribute reusable components. Fluent English required; German is a plus. Full-time in Vienna.

Qualifications

• Degree in Computer Science, Software Engineering, Information Systems, Data Science, AI, or equivalent practical experience
• Strong Python and software engineering skills, with experience taking LLM applications from prototype to production
• Hands-on experience with Databricks, MLflow, model serving, vector search, APIs and data pipelines
• Practical knowledge of RAG, prompt engineering, tool use, agent architecture, stateful workflows and human- in-the-loop processes
• Experience designing AI judges, evaluation datasets and scoring rubrics, including validation against human assessments
• Strong understanding of CI/CD, observability, security, governance and responsible AI
• Excellent communication and teamwork skills, independent and solution- oriented working style, very good English, German is a plus

Responsibilities

• Collaborate with data scientists, data engineers, domain experts and product owners to design maintainable GenAI products across the Group
• Design, build and operate RAG applications, copilots/assistants, agentic workflows and other LLM-based solutions on Databricks
• Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops
• Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate them against expert human feedback
• Develop agentic solutions using tool/function calling, MCP and orchestration frameworks such as LangChain and LangGraph
• Ensure security, governance, reliability, latency and cost- efficiency; contribute reusable components, standards and documentation

Skills

Python

English

Communication

Teamwork

CI/CD

Cost awareness

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

MLflow

Model serving

Vector search

APIs

Job description

Vienna Insurance Group (VIG) in Vienna, Austria, seeks a GenAI engineer to design and operate cutting-edge LLM-based solutions across the Group. You’ll collaborate with data scientists, data engineers and product owners to build RAG applications and agentic workflows on Databricks.

You will establish end-to-end LLMOps processes, develop AI judges, ensure governance, security and cost efficiency, and contribute reusable components. Fluent English required; German is a plus. Full-time in Vienna.