Claude AI Design & Dev Engineer (Contract)

Delphi-US, LLC - Peacemakers in the Talent War; Chicago (IL); On-site; USD 124,000 - 145,000; Full time

Job summary

Delphi-US - Peacemakers In The Talent War is seeking an experienced AI Design/Development Engineer to lead the creation of an AI-driven alert triage and investigation system on the Claude Platform, integrated with Splunk. This long-term contract role will design, build, and deploy scalable AI workflows with production readiness and comprehensive documentation.

The role requires hands-on Claude Platform experience, Python with async architectures, cloud deployment, observability, and a

Qualifications

• Hands-on experience with Claude Platform, Messages API, and MCP for orchestrating multi-step agent workflows.
• Proficiency in Python, including async and queue-based architectures, with a focus on idempotent processing.
• Strong knowledge of cloud deployment, CI/CD pipelines, infrastructure as code, secrets management, and API rate limiting.
• Experience with observability tools for tracing, logging, and dashboard creation to monitor latency, cost, and error rates.
• Demonstrated ability to build and evaluate datasets from historical alerts and analyst feedback, with a focus on accuracy and false-negative control.
• Proven experience in system testing, regression testing, and managing model version upgrades.
• Ability to deploy in shadow mode, compare AI and analyst results, and ensure system robustness before production.

Responsibilities

• Architect and develop agent workflows utilizing the Claude Platform, Messages API, and MCP for alert review, evidence gathering, and verdict generation.
• Implement secure deployment practices, including secrets management, logging, tracing, and safeguards against prompt injection.
• Build an evaluation framework using historical alert data and analyst dispositions to measure system accuracy, false-negative rates, and agreement with analyst decisions.
• Optimize system performance through cost and latency management techniques such as prompt caching, model tiering, batching, and token budgeting.
• Collaborate with internal security teams to incorporate domain expertise, triage criteria, escalation rules, and labeled datasets.
• Conduct shadow-mode testing, monitor system metrics, and iterate until predefined accuracy thresholds are achieved.
• Deliver all source code, prompts, tools, datasets, documentation, and runbooks, ensuring the client can independently maintain and upgrade the system.

Skills

Claude Platform

Python (async)

Cloud deployment & CI/CD

Observability & logging

Dataset creation from alerts

Model versioning & testing

Job description

Delphi-US - Peacemakers In The Talent War is seeking an experienced AI Design/Development Engineer to lead the creation of an AI-driven alert triage and investigation system on the Claude Platform, integrated with Splunk. This long-term contract role will design, build, and deploy scalable AI workflows with production readiness and comprehensive documentation.

The role requires hands-on Claude Platform experience, Python with async architectures, cloud deployment, observability, and a