Remote GenAI LLM Ops Engineer — Build RAG Apps

Vienna Insurance Group (VIG); Wien; Vor Ort; EUR 34.000 - 41.000; Vollzeit

Benefits dieser Stelle

Home office

Flexitime

37.5 hours / week

Onboarding and L&D program

Childcare services

Health care center

Canteen

Sports facilities

Employee Assistance Program

Flat hierarchy

Central Vienna office

Salary discussion in personalInterview

Zusammenfassung

Vienna Insurance Group (VIG) seeks an AI/GenAI specialist to design and implement range of LLM-based solutions across the Group. You will collaborate with data scientists, domain experts and product owners to create robust GenAI products and RAG-based copilots on Databricks.

You will establish end-to-end LLMOps, build AI judges for evaluation, and advance agentic workflows with LangChain/LangGraph. Strong Python, CI/CD, security and governance experience required.

Qualifikationen

• Degree in Computer Science, Software Engineering, Information Systems, Data Science, AI, or equivalent practical experience
• Strong Python and software engineering skills; experience taking LLM apps from prototype to production
• Hands-on experience with Databricks, MLflow, model serving, vector search, APIs and data pipelines
• Practical knowledge of RAG, prompt engineering, tool use, agent architecture, stateful workflows and human-in-the-loop processes
• Experience designing AI judges, evaluation datasets and scoring rubrics, including validation against human assessments
• Strong understanding of CI/CD, observability, security, governance and responsible AI
• Excellent communication and teamwork skills; very good English, German a plus

Aufgaben

• Collaborate with data scientists, data engineers, domain experts and product owners to design GenAI products across the Group
• Design, build and operate RAG applications, copilots/assistants, agentic workflows and other LLM-based solutions on Databricks
• Establish end-to-end LLMOps processes including prompt/model versioning, automated testing, deployment, monitoring, guardrails and feedback loops
• Build and operate AI judges for quality evaluation, regression testing and production monitoring; calibrate them against expert human feedback
• Develop agentic solutions using tool/function calling, MCP and orchestration frameworks such as LangChain and LangGraph
• Ensure security, governance, reliability, latency and cost-efficiency; contribute reusable components, standards and documentation

Kenntnisse

Python

Software engineering

Databricks

MLflow

Model serving

Vector search

APIs

Data pipelines

RAG

Prompt engineering

Tool use

Agent architecture

Stateful workflows

Human-in-the-loop

AI judges

Evaluation datasets

Scoring rubrics

CI/CD

Observability

Security

Governance

Responsible AI

English (very good)

German (plus)

Ausbildung

CS degree

Software Engineering degree

Information Systems degree

Data Science degree

AI-related studies or experience

Equivalent practical experience

Tools

Databricks

MLflow

Model serving

APIs

Vector search

Data pipelines

Jobbeschreibung

Vienna Insurance Group (VIG) seeks an AI/GenAI specialist to design and implement range of LLM-based solutions across the Group. You will collaborate with data scientists, domain experts and product owners to create robust GenAI products and RAG-based copilots on Databricks.

You will establish end-to-end LLMOps, build AI judges for evaluation, and advance agentic workflows with LangChain/LangGraph. Strong Python, CI/CD, security and governance experience required.