Applied AI Engineer - Agent Architecture

Thira

Bellevue (WA)

On-site

USD 150,000 - 210,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Thira is building a CIO-grade agentic AI platform and Bellevue-based engineers will design the core orchestration framework powering autonomous enterprise execution. You will own an end-to-end stack from agent orchestration to memory and retrieval, shaping how AI agents interact with tools, data, and human operators.

You will work directly with the CTO, influence technical direction, and ship production-ready components that handle real traffic, meet latency goals, and support governance and

Qualifications

  • 3+ years building production AI/ML systems with real traffic.
  • Experience designing multi-step LLM pipelines with tool use and retry/parsing patterns.
  • Deep understanding of RAG architectures, embedding models, and retrieval workflows.

Responsibilities

  • Design and build the multi-agent orchestration layer (LangGraph, CrewAI) and related systems.
  • Implement the episodic and semantic memory stack including vectors and retrieval pipelines.
  • Develop MCP-based action library and connectors to identity systems, SaaS tools, and internal KBs.
  • Own the LLM evaluation framework: prompt versioning, regression testing, benchmarking.

Skills

Production AI/ML
LLM pipelines
RAG architectures
REST API
Pydantic

Job description

About Thira

Thira is the CIO's trusted agentic AI platform that continuously learns and executes repetitive IT work. Enterprises will spend $6.3 trillion on IT this year, and roughly 40% of it goes to people doing repetitive work across systems that were never built to work together. The work arrives faster than any team can absorb it, the backlog never clears, and there's no capacity left for the work that moves the business forward. Thira learns how an enterprise actually runs, finds a better way to deliver each outcome, and executes the work end to end across every system, with every action governed. The result is measurable ROI and employees whose problems are resolved before they notice them. Thira is backed by a $21M seed round led by Madrona and led by the co-founders of Apptio, and we're building the team that will define this category.

The role

You'll design and build the core AI agentic framework powering Thira's autonomous enterprise execution engine. This isn't prompt engineering on top of an existing platform. You are architecting the orchestration layer, memory systems, and agent pipelines from scratch. You'll work directly with the CTO and have outsized influence on technical direction, owning a significant chunk of the full agentic stack from day one and setting the tone for our technology and culture.

What you will own
  • Design and build the multi-agent orchestration layer (LangGraph, CrewAI, and the like) that detects, routes, delegates, and resolves issues autonomously.
  • Implement the full episodic and semantic memory stack: vector stores, retrieval pipelines, and the feedback loop that lets agents learn from human resolutions.
  • Build the MCP-based action library and third-party connectors: integrations with identity systems, SaaS tools, device-management platforms, and internal knowledge bases.
  • Own the LLM evaluation framework: prompt versioning, regression testing, and model benchmarking across frontier and budget tiers.
  • Architect human-in-the-loop approval flows with structured JSON extraction, retry logic, and graceful fallback to human agents.
  • Instrument agent traces, latency, and resolution-rate metrics so the team can iterate fast with data.
What we are looking for
  • 3+ years building production AI/ML systems: not notebooks, but shipped code handling real traffic.
  • Hands-on experience designing multi-step LLM pipelines with tool use, structured outputs, and retry/parsing patterns.
  • Deep understanding of RAG architectures: chunking strategies, embedding models, hybrid retrieval, and re-ranking.
  • Fluency in Java, Python async patterns, REST API design, and Pydantic schema validation.
  • Strong instincts for eval-driven development: you write test cases before you tune prompts.
  • Comfortable operating in a 0-1 environment with minimal process and high ambiguity.
Strong plusses
  • Experience with ITSM, enterprise SaaS, or IT operations tooling (ServiceNow, Jira Service Management, Freshservice).
  • Experience building an agentic harness for governance.
  • Prior work on agent memory systems or long-horizon task completion with LLMs.
  • LLMOps tooling: Langfuse, OpenTelemetry, or Arize Phoenix for observability and tracing.
  • Familiarity with open-weight models (Llama, Mistral, Qwen) and when to use them over frontier APIs.
Location

Bellevue, WA

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Applied AI Engineer
Applied AI Engineer

Thira • Seattle (WA)

Hybrid
USD 120,000 - 180,000
AI Systems Engineer - Learning and Knowledge Graph
AI Systems Engineer - Learning and Knowledge Graph

Thira • Bellevue (WA)

On-site
USD 150,000 - 210,000
Agentic AI Engineer
Agentic AI Engineer

Trilagen • Bethesda (MD)

Hybrid
USD 120,000 - 160,000
401K
Health Insurance
Dental Insurance
+2
Agentic AI Developer
Agentic AI Developer

Xpetize • United States

Remote
USD 120,000 - 180,000
AI Agent Architect for Autonomous Enterprise Execution
AI Agent Architect for Autonomous Enterprise Execution

Thira • Bellevue (WA)

On-site
USD 150,000 - 210,000
Production-Ready Agentic AI Engineer
Production-Ready Agentic AI Engineer

Trilagen • Bethesda (MD)

Hybrid
USD 120,000 - 160,000
401K
Health Insurance
Dental Insurance
+2
AI Engineer
AI Engineer

Teserac • Santa Clara (CA)

On-site
USD 140,000 - 210,000
Health Care Plan
Paid Time Off
Free Food
+2
AI Architech
AI Architech

Meeru AI Inc • Pleasanton (CA)

Remote
USD 150,000 - 210,000
AI Engineer
AI Engineer

Feltsense • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior Applied AI Engineer, Agentic Systems
Senior Applied AI Engineer, Agentic Systems

Thresh Consulting • Chicago (IL)

Hybrid
USD 190,000 - 235,000
Healthcare benefits
401(k) with company matching
Hybrid travel flexibility
+1