AI Developer

R & R; Georges River; Hybrid; AUD 120,000 - 180,000; Full time

Job summary

R&R in Sydney, NSW is seeking an AI Developer to build and operate private, on-premises AI agents for legal workflow automation. You will train, run and expose agents behind REST APIs used by .NET desktop and web apps, while keeping client data on our infrastructure.

You will design workflows, label training data, and collaborate with the in-house team to maintain the AI stack on an Ubuntu workstation with GPU support.

Qualifications

• 3+ years of commercial AI/ML development experience.
• Strong Python with PyTorch and Transformers.
• Experience running and fine-tuning open-weight LLMs locally.
• Experience with .NET Core / .NET (C#) for API design.
• Experience building agent/workflow automation calling tools and APIs.
• Familiarity with Linux (Ubuntu), GPU/CUDA, Docker.
• Secure REST APIs with authentication and logging.
• Confidential data handling and privacy focus.
• Excellent written and verbal communication.

Responsibilities

• Build, fine-tune, and evaluate local AI agents for legal workflows.
• Design agent workflows to extract details and route tasks.
• Prepare and label training data with privacy considerations.
• Expose models via secure REST APIs for .NET apps.
• Integrate with SQL databases for matter and workflow records.
• Maintain AI stack on the Ubuntu workstation (GPU drivers, versioning).
• Measure accuracy, apply human-in-the-loop when needed, log AI decisions.
• Document work for team support and future expansion.

Skills

Python

Local LLM deployment

Agent/workflow automation

C#/NET API design

Linux administration

Docker

REST APIs

Communication

Tools

Ollama

vLLM

llama.cpp

Job description

AI Developer – Local AI Agents for Legal Workflow Automation

R&R

• Kogarah, Sydney NSW
• Full-time
• On-site / WFH

About the role

We're a legal practice building our own private AI capability, and we want an experienced AI developer to implement it. You'll design, train and run specialised AI agents on our local AI workstation. They'll classify incoming work and drive our workflows. Nothing leaves our environment - client confidentiality comes first.

Your models will sit behind APIs used by our .NET desktop and web applications. Those apps take in tickets, emails, and phone calls, pass them to your agents, and write the results to our database. You'll own the AI layer end to end and work closely with our in-house development team.

What you'll do

Build, fine-tune, and evaluate local language models and classifiers for legal work, such as matter type, urgency, document type and routing.

Design agent workflows that extract key details from emails, tickets, and call transcripts and trigger the right next step.

Prepare and label training data from our historical records, with proper handling of privileged and confidential information.

Expose models and agents through secure, well-documented REST APIs for our .NET applications.

Integrate with our SQL databases so agents can look up and update matter, client, and workflow records.

Set up and maintain the AI stack on our Ubuntu workstation: GPU drivers, model serving, versioning, monitoring and backups.

Measure accuracy, add human-in-the-loop review where confidence is low, and keep audit logs of AI decisions.

Document your work so the wider team can support and extend it.

AI platform: a dedicated, well-stocked, on-premises AI workstation running Ubuntu, provided by us.

Applications: .NET desktop and web apps (.NET Core / .NET and .NET Framework) that act as the middle layer between incoming requests and our database.

Data: SQL Server databases holding case, client and workflow records.

Inputs: tickets, emails and phone calls (transcribed).

Principle: local-first AI. Client data stays on our infrastructure.

What you'll need

At least 3 years of proven commercial experience building and deploying AI/ML solutions, with examples you can show or talk through.

Strong Python, including PyTorch and Hugging Face Transformers (or similar).

Hands-on experience running and fine-tuning open-weight LLMs locally (for example Llama, Mistral or Qwen) using tools such as Ollama, vLLM or llama.cpp.

Experience with decision models such as Jev, Kev,other system one type models and APIs.

Experience building agent or workflow automation that calls tools, APIs and databases.

Familiarity with .NET Core / .NET and .NET Framework (C#), enough to design APIs our apps can use and to work inside our codebase.

Comfort administering Linux (Ubuntu), including GPU/CUDA setup, Docker and service management.

Building secure REST APIs (for example FastAPI) with authentication and logging.

A careful approach to confidential data, privacy and security.

Exceptional written and verbal communication skillsacross all organizational tiers.

Nice to have

Experience in legal, professional services or another regulated industry.

Speech-to-text (for example Whisper) for call transcription.

Microsoft 365 and Microsoft Graph integration (email, Teams, SharePoint).

Fine-tuning methods such as LoRA/QLoRA, and model quantisation.

MLOps tooling for experiment tracking and model versioning (for example MLflow).

Knowledge of the Australian Privacy Principles and legal professional privilege.

What we offer

Competitive salary +super

The chance to build a private AI platform from the ground up, with real ownership.

Dedicated local AI hardware to work with.

Candidates must have permanent work rights in Australia.