Staff AI Engineer — Remote Production Health Claims AI Architect

Rawlings Company; United States; Remote; USD 180,000 - 300,000; Full time

Benefits offered by this job

Work from anywhere in the US

Medical/Dental/Vision benefits

Tuition reimbursement

Competitive salary with 401(k)

Job summary

Machinify is hiring a Staff AI Engineer to set the technical direction for agentic systems auditing medical claims. You will own the architecture of audit agents, decide context strategies, and lead the design work across engineers while coding the hardest parts yourself.

You will define evaluation metrics with clinical experts, build scalable context handling for long records, and drive production reliability, cost control, and performance improvements using tools like Claude Code and

Qualifications

• 8+ years software or ML engineering; 3+ years building production AI systems.
• Staff‑level technical leadership: set architecture of production systems.
• Hands‑on generative AI experience: training or fine‑tuning models or building agentic systems.
• Deep understanding of agent loops and tool integration.
• Experience with at least one major agent SDK and Claude Code / Codex familiarity.
• Strong Python engineering with clean abstractions and testing.
• Proficiency with VS Code and git workflows.
• Bias toward measurable evals and reproducible metrics.

Responsibilities

• Own the agent architecture from design to production, choosing loops, tools, and context strategy.
• Define evaluation metrics with clinical/coding input and ship infra to measure improvement.
• Engineer context at scale for long, noisy medical records and grounded outputs.
• Lead cross‑engineer projects, guiding model choice and trade‑offs between cost, latency, and accuracy.
• Ensure reliability, observability, and cost control for LLM workloads in production.
• Mentor engineers, review designs and code, and set engineering standards for agents.
• Leverage Claude Code/Codex and other tools to accelerate development.

Skills

Staff‑level leadership

Generative AI experience

Agent loops knowledge

Python engineering

Code/tool fluency

Evaluation & metrics

VS Code & Git

Education

Bachelors in CS/Math/Engineering

Masters/PhD preferred

Tools

OpenAI Agents SDK

Anthropic Claude SDK

LangGraph

Job description

Machinify is hiring a Staff AI Engineer to set the technical direction for agentic systems auditing medical claims. You will own the architecture of audit agents, decide context strategies, and lead the design work across engineers while coding the hardest parts yourself.

You will define evaluation metrics with clinical experts, build scalable context handling for long records, and drive production reliability, cost control, and performance improvements using tools like Claude Code and