On-Prem AI Developer for Local Legal Workflows

R & R; Georges River; Hybrid; AUD 120,000 - 180,000; Full time

Job summary

R&R in Sydney, NSW is seeking an AI Developer to build and operate private, on-premises AI agents for legal workflow automation. You will train, run and expose agents behind REST APIs used by .NET desktop and web apps, while keeping client data on our infrastructure.

You will design workflows, label training data, and collaborate with the in-house team to maintain the AI stack on an Ubuntu workstation with GPU support.

Qualifications

• 3+ years of commercial AI/ML development experience.
• Strong Python with PyTorch and Transformers.
• Experience running and fine-tuning open-weight LLMs locally.
• Experience with .NET Core / .NET (C#) for API design.
• Experience building agent/workflow automation calling tools and APIs.
• Familiarity with Linux (Ubuntu), GPU/CUDA, Docker.
• Secure REST APIs with authentication and logging.
• Confidential data handling and privacy focus.
• Excellent written and verbal communication.

Responsibilities

• Build, fine-tune, and evaluate local AI agents for legal workflows.
• Design agent workflows to extract details and route tasks.
• Prepare and label training data with privacy considerations.
• Expose models via secure REST APIs for .NET apps.
• Integrate with SQL databases for matter and workflow records.
• Maintain AI stack on the Ubuntu workstation (GPU drivers, versioning).
• Measure accuracy, apply human-in-the-loop when needed, log AI decisions.
• Document work for team support and future expansion.

Skills

Python

Local LLM deployment

Agent/workflow automation

C#/NET API design

Linux administration

Docker

REST APIs

Communication

Tools

Ollama

vLLM

llama.cpp

Job description

R&R in Sydney, NSW is seeking an AI Developer to build and operate private, on-premises AI agents for legal workflow automation. You will train, run and expose agents behind REST APIs used by .NET desktop and web apps, while keeping client data on our infrastructure.

You will design workflows, label training data, and collaborate with the in-house team to maintain the AI stack on an Ubuntu workstation with GPU support.