AI Engineer - Enterprise Copilot & Retrieval Solutions

Blackroc; City of Brisbane; Hybrid; AUD 120,000 - 180,000; Full time

Job summary

BLACKROC is recruiting an AI Engineer to lead the build capability in a small innovation team, delivering LLM-based agents and retrieval-grounded assistants for a Queensland Government department. You’ll drive proof-of-concept to production, focusing on Copilot Studio, Power Platform and enterprise integration.

Based in Brisbane with hybrid work (2 days WFH), the role emphasizes assurance, governance and risk controls, including FAIRA and DLP considerations, while collaborating across

Qualifications

• Proven delivery of LLM-based solutions into pilot or production in enterprise or government environments.
• Hands-on build experience with Copilot Studio, Power Platform and Microsoft 365 Copilot extensibility.
• Experience with embeddings, vector/hybrid search and chunking strategies.
• Identity and permission design in Microsoft Entra ID and DLP considerations for AI.
• AI evaluation including prompt-injection testing and release gates.

Responsibilities

• Design, build and release AI agents and retrieval-grounded assistants using Copilot Studio, SharePoint agents, Microsoft 365 Copilot extensibility and the Power Platform
• Build retrieval solutions over organisational content, including source selection, chunking, indexing, retrieval tuning and grounding controls
• Move proofs of concept to a supportable state, covering environment placement, ownership, monitoring, cost and a documented support model
• Integrate AI capability with enterprise systems through APIs, connectors and managed data flows
• Design identity, permission and data-protection controls, including least privilege, sensitivity labelling and oversharing controls
• Define and run evaluation for each solution, covering accuracy, groundedness, prompt-injection testing, regression testing and release gates
• Author the technical content of assurance artefacts, including FAIRA, security and privacy assessments and Architecture Review Board submissions
• Assess third-party AI tools and build automation to speed up assessment at volume
• Advise on self-hosted or offline model deployments where cloud isn’t appropriate
• Lift capability through reference implementations, reusable patterns, guidance and workshops

Skills

LLM-based solutions

Copilot Studio & Power Platform

Microsoft 365 Copilot extensibility

Retrieval-augmented architecture

Identity & data protection design

AI evaluation & release gates

Education

Degree in CS / Software Engineering / Data Science or related field

Tools

Copilot Studio

Power Platform

Azure OpenAI

Azure DevOps / GitHub

SharePoint connectors

Entra ID / Purview / DLP tooling

Job description

BLACKROC is recruiting an AI Engineer to lead the build capability in a small innovation team, delivering LLM-based agents and retrieval-grounded assistants for a Queensland Government department. You’ll drive proof-of-concept to production, focusing on Copilot Studio, Power Platform and enterprise integration.

Based in Brisbane with hybrid work (2 days WFH), the role emphasizes assurance, governance and risk controls, including FAIRA and DLP considerations, while collaborating across