Autonomous AI Engineer for Mission-Critical Systems - Remote

Ruya AI; California; Hybrid; USD 160,000 - 230,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Commuter benefits

Relocation assistance

Paid time off; location-based

Job summary

Ruya AI, a defense-tech company, is expanding its engineering team in the US to build an AI-native multi-modal intel agent. You will own the orchestration layer, connect complex operator requirements to secure, reliable AI capabilities, and work hands-on with the broader engineering team.

You will design and implement agent systems, tooling integrations, and evaluation pipelines to surface hidden patterns, generate predictive outcomes, and ensure robust behavior in high-stakes environments.

Qualifications

• Strong production Python and asynchronous programming experience.
• Experience building LLM applications with tool use and multi-step reasoning.
• Knowledge of structured output validation and non-deterministic system testing.
• Practical understanding of prompt injection and sensitive-data risks.
• Ability to evaluate AI behavior empirically rather than relying on demonstrations.

Responsibilities

• Build asynchronous Python/TypeScript services with FastAPI, Pydantic, and asyncio.
• Develop agent orchestration, subagent delegation, tool calling, and structured outputs.
• Design MCP tools and AG-UI/SSE integrations.
• Improve prompt, context, memory, and token-management strategies.
• Build safeguards against prompt injection, data leakage, and unsafe tool use.
• Create behavioral evals and regression datasets using Langfuse.
• Trace model calls and tool execution with Langfuse, Sentry, and OpenTelemetry.
• Diagnose failures spanning model behavior, tools, data sources, and distributed services.

Skills

Production Python

Asynchronous programming

LLM applications

Tool use

Empirical AI evaluation

Tools

Langfuse

MCP

Langchain-style tools

Anthropic-compatible APIs

CopilotKit

Job description

Ruya AI, a defense-tech company, is expanding its engineering team in the US to build an AI-native multi-modal intel agent. You will own the orchestration layer, connect complex operator requirements to secure, reliable AI capabilities, and work hands-on with the broader engineering team.

You will design and implement agent systems, tooling integrations, and evaluation pipelines to surface hidden patterns, generate predictive outcomes, and ensure robust behavior in high-stakes environments.