Senior AI Engineer - Security Automation with LLM Agents

XPT Software; Sydney; On-site; AUD 180,000 - 240,000; Full time

Job summary

XPT Software Australia is seeking an experienced Senior Software/AI engineer to architect and implement an AI layer on top of SAST/SCA tooling. You will design and build custom automation using OpenAI or equivalent LLM APIs and agentic patterns to reduce triage effort, cut false positives, and speed remediation.

You will own prompt engineering, guardrails, and audit logs, ensuring governance and data residency compliance while integrating with GitLab APIs and external pipelines.

Qualifications

• Hands-on experience with LLM APIs (OpenAI, Anthropic, or equivalents) including function calling and context management.
• Experience designing agentic systems with multi-step reasoning and tool orchestration.
• Strong software engineering skills to build robust integration pipelines (GitLab API/webhooks, CI/CD).
• Knowledge of prompt engineering best practices and evaluation of AI triage decisions.
• Awareness of AppSec concepts (SAST/SCA, CVE/CWE) to automate security workflows.

Responsibilities

• Design and build integrations that pull SAST/SCA findings from GitLab into an external AI-aware pipeline via API/webhooks.
• Develop LLM-based triage assistance with false-positive scoring, explanations, and remediation suggestions tied to code context.
• Create agentic workflows that correlate CVEs with code usage and draft remediation MR suggestions.
• Own prompt engineering, evaluation, guardrails, and audit logging for AI-assisted decisions.
• Select and integrate LLM stack with data residency and governance considerations.
• Implement feedback loops to improve AI outputs against analyst decisions.
• Collaborate with SMEs and BA to align automation targets with MTTR reduction.

Skills

LLM APIs

Agentic systems

Software engineering

Prompt engineering

AppSec concepts

Data governance

GitLab API/webhooks

Tools

GitLab API

Webhook integrations

CI/CD

OpenAI API

Job description

XPT Software Australia is seeking an experienced Senior Software/AI engineer to architect and implement an AI layer on top of SAST/SCA tooling. You will design and build custom automation using OpenAI or equivalent LLM APIs and agentic patterns to reduce triage effort, cut false positives, and speed remediation.

You will own prompt engineering, guardrails, and audit logs, ensuring governance and data residency compliance while integrating with GitLab APIs and external pipelines.