AI Engineer

CipherData, Inc.; Bellevue (WA); On-site; USD 120,000 - 160,000; Full time

Job summary

CipherData, Inc. in the Greater Seattle Area is seeking an AI Engineer to own the core multi-agent reasoning layer that turns telemetry from 70+ security vendors into actionable conclusions for analysts.

You’ll design agent architectures, run experiments to decide which ideas ship, and deploy in production where SOC teams rely on reliable, low-latency results. Collaborate with security researchers and engineers to frame problems, validate outcomes, and balance performance with cost, accuracy,

Qualifications

• Hands‑on experience designing and building LLM applications (agents, RAG, orchestration, etc.)
• Strong software engineering fundamentals in Python
• Experience building LLM workflows with various agent frameworks
• Experience evaluating and improving LLM output quality, both qualitatively and quantitatively
• Comfort defining ambiguous problems, experimenting quickly, and making data-driven decisions

Responsibilities

• Build our multi-agent LLM system by designing and improving the core system where multiple LLM agents collaborate to detect, investigate, and correlate threats.
• LLM orchestration: Build pipelines that coordinate multiple models against cost, latency, and accuracy trade-offs.
• Evaluation & continuous improvement: Create evaluation systems that measure agent output quality and feed data back as learning signals.
• Reliability: Experiment with prompting, architecture, and verification strategies to reduce hallucination and improve stability.
• Build what’s next: Expand into automated response, deeper threat correlation, and new product areas.

Skills

LLM applications

Python

LLM workflows

LLM evaluation

Data-driven decisions

Job description

About the Role

You’ll join the team that owns AIDR’s core reasoning engine — the multi-agent layer that turns telemetry from 70+ security vendors into investigated, correlated conclusions an analyst can act on. You’ll design the agent architectures, run the experiments that decide which ones ship, and take them into production environments where SOC teams depend on the output. Success is measured in precision, recall, latency, and cost, not demo quality.

That standard shapes how we work:

• Accuracy and honesty. We’re clear about what we’ve measured versus what’s still a hypothesis. We expect the same of your results — including when one doesn’t hold up.
• Research into production. We move new research into the product quickly, then validate it against operational standards rather than demo conditions.
• Measure, then decide. We experiment in small increments and make calls from metrics, not intuition.

In practice, you’ll spend as much time building the evaluation harnesses that tell us whether an agent is good as you will building the agent itself. If you want to work on LLM systems where “is it good?” has a number attached, this is that role.

What you’ll do

• Build our multi-agent LLM system: Design and improve the core system where multiple LLM agents collaborate to detect, investigate, and correlate threats.
• LLM orchestration: Build pipelines that coordinate multiple models against cost, latency, and accuracy trade-offs based on the task.
• Evaluation & continuous improvement: Create the evaluation systems that measure agent output quality, and design the loops that feed operational data back as a learning signal.
• Reliability: Experiment with and ship prompting, architecture, and verification strategies that reduce hallucination and improve stability and reproducibility.
• Build what’s next: Go beyond investigation into automated response, deeper threat correlation, and new product areas that push security operations further — built from the ground up, with you.

Minimum Qualifications

• Hands‑on experience designing and building LLM applications (agents, RAG, orchestration, etc.)
• Strong software engineering fundamentals in Python
• Experience building LLM workflows with various agent frameworks
• Experience evaluating and improving LLM output quality, both qualitatively and quantitatively — a real instinct for measurement, not just implementation
• Comfort defining ambiguous problems, experimenting quickly, and making decisions from data

Preferred Qualifications

• Security domain knowledge (SOC / SIEM / SOAR, threat intelligence, incident response, etc.)
• Experience designing evaluations/benchmarks, or an ML research background (publications, open source contributions, etc.)
• Experience operating production LLM systems (monitoring, cost optimization, latency management)
• Experience deploying production systems across cloud environments

Details

• Position: AI Engineer
• Experience: 2+ years
• Employment type: Full-time
• Location: Greater Seattle Area

CipherData is an equal opportunity employer. We consider all qualified applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other protected characteristic.