Production-Scale AI Security Automation Engineer

The Judge Group; Texas; On-site; USD 150,000 - 210,000; Full time

Job summary

The Judge Group is seeking an experienced AI Security Automation Engineer to design, build, and deploy an AI-powered alert triage and investigation platform using Claude and Splunk. This role moves from concept to production, leveraging AI agents to analyze security alerts, gather evidence, and produce structured investigation outcomes.

You will develop agent workflows on Claude, integrate with Splunk, create evaluation frameworks, and run shadow deployments to validate performance.

Qualifications

• Hands-on experience with Claude Messages API, tool calling, and multi-step agent workflows.
• Experience building AI agents using the Claude Agent SDK or comparable orchestration frameworks.
• Experience with Model Context Protocol (MCP) and exposing external systems as agent tools.
• Strong prompt engineering skills focused on structured outputs and automated decision-making.

Responsibilities

• Design and build AI agent workflows on the Claude platform to automate alert triage and investigations.
• Integrate AI agents with Splunk and enrichment sources using secure, read-only tools.
• Develop structured outputs including verdicts, confidence scores, supporting evidence, and recommended next actions.
• Create evaluation frameworks using historical alert data and analyst dispositions.
• Run and optimize shadow-mode deployments alongside security analysts to validate performance.
• Continuously refine prompts, tools, and workflows to achieve agreed-upon accuracy and false-negative thresholds.
• Deploy and operate the solution in production with secure architecture and secrets management, CI/CD and infrastructure automation, monitoring, tracing, logging, and observability.

Skills

AI security

Claude platform

Agent workflows

CI/CD

Observability

Cost optimization

Tools

Claude Messages API

Splunk

Agent SDK

MCP

Job description

The Judge Group is seeking an experienced AI Security Automation Engineer to design, build, and deploy an AI-powered alert triage and investigation platform using Claude and Splunk. This role moves from concept to production, leveraging AI agents to analyze security alerts, gather evidence, and produce structured investigation outcomes.

You will develop agent workflows on Claude, integrate with Splunk, create evaluation frameworks, and run shadow deployments to validate performance.