Lead AI Engineer — Production LLM & Agent Systems (Remote)

Elios, Inc.; United States; Teletrabalho; USD 140 000 - 210 000; Tempo integral

Resumo da oferta

Elios, Inc. is seeking an AI Engineer to lead the design and build of production agents and LLM features for a specialized financial advisory firm.

You will own the work end to end, from architecture through production hardening to ensure reliable streams, deduplicated tool calls, and validated structured output. You will architect core runtime capabilities, develop a provider-agnostic LLM client, and shape evaluation gates to ship model and prompt changes with confidence, while mentoring

Qualificações

• Mid-level or senior experience building production LLM or agent systems, including tool/function calling, structured output, prompts, and streaming, and a working knowledge of how each one fails
• Strong systems engineering in Python (or a comparable backend language) with sound architectural judgment
• Rigorous testing discipline: dependency injection, boundary mocks, and tests that assert behavior rather than implementation
• Experience building evaluation pipelines or quality gates for model and prompt changes
• A mentoring instinct and a track record of raising the quality of the engineers around you
• Based in the UK or Germany and comfortable working fully remote
• Bonus: Hands-on Anthropic API experience: Claude tool usage, the Managed Agents API, MCP, or Skills; Familiarity with actor or agent frameworks and columnar analytics tools like DuckDB; Background in finance, accounting, audit, or another regulated domain

Responsabilidades

• Lead the design and development of agents and LLM features end to end, from architecture through production hardening
• Architect core agent-runtime capabilities: session lifecycle, SSE streaming with reconnect and de-duplication, crash-safe tool dispatch, and structured and streaming model integration
• Build out the provider-agnostic LLM client (text, JSON-schema structured output, streaming tool use) and the prompt registry behind it, with templating and versioning
• Own the evaluation frameworks and quality gates the team relies on to ship model and prompt changes with confidence
• Take on the ambiguous, high-impact problems, like streaming reliability, tool-call correctness, and cost versus latency trade-offs
• Telemetry over LLM requests and background jobs, so token usage, latency, cost, and outcome quality are always visible
• Compose tools and actions across both self-hosted and cloud-sandbox execution models
• Work on the integration layer and its mock seams, plus columnar analytics where agents reason over data
• Mentor engineers on craft, conventions, and judgment. A big part of this role is setting the patterns others follow.

Conhecimentos

Python backend

Systems engineering

Testing discipline

Evaluation pipelines

Mentoring

Descrição da oferta de emprego

Elios, Inc. is seeking an AI Engineer to lead the design and build of production agents and LLM features for a specialized financial advisory firm.

You will own the work end to end, from architecture through production hardening to ensure reliable streams, deduplicated tool calls, and validated structured output. You will architect core runtime capabilities, develop a provider-agnostic LLM client, and shape evaluation gates to ship model and prompt changes with confidence, while mentoring