AI Engineer: Multi-Agent LLM Systems

CipherData; Bellevue (WA); On-site; USD 130,000 - 180,000; Full time

Job summary

CipherData is seeking an AI Engineer to design and deploy a multi-agent LLM system that analyzes telemetry from 70+ security vendors. You’ll build orchestration pipelines, optimize cost, latency, and accuracy, and push research into production for SOC use.

You’ll craft evaluation harnesses and refine prompts and architectures to reduce hallucinations and improve reliability, with a focus on measurable outcomes.

Qualifications

• Hands-on experience designing and building LLM applications (agents, RAG, orchestration, etc.).
• Strong software engineering fundamentals in Python.
• Experience building LLM workflows with various agent frameworks.
• Experience evaluating and improving LLM output quality, both qualitatively and quantitatively.
• Comfort defining ambiguous problems, experimenting quickly, and making decisions from data.

Responsibilities

• Build our multi-agent LLM system: design and improve the core system where multiple LLM agents collaborate to detect, investigate, and correlate threats.

Skills

LLM apps

Python

Agent frameworks

LLM eval/measurement

Ambiguity handling

Job description

CipherData is seeking an AI Engineer to design and deploy a multi-agent LLM system that analyzes telemetry from 70+ security vendors. You’ll build orchestration pipelines, optimize cost, latency, and accuracy, and push research into production for SOC use.

You’ll craft evaluation harnesses and refine prompts and architectures to reduce hallucinations and improve reliability, with a focus on measurable outcomes.