Remote AI Solutions Architect for Production AI

Eliassen Group; Montpelier (VT); Remote; USD 286,541,000 - 358,176,000; Full time

Benefits offered by this job

Medical, Dental, Vision benefits

401k with company matching

Life insurance

Job summary

Eliassen Group is seeking an AI Solutions Architect to enable product teams in shipping AI-native capabilities. The role focuses on embedding with a solution team, co-building production vertical slices across LLM features, agentic workflows, tool calling, and RAG within an AI middleware platform.

You will establish evaluation discipline, design reusable platform capabilities, and coach engineers and product managers to continue iterating after rotation.

Qualifications

• Shipped LLM-powered functionality to real users with production exposure.
• Hands-on evaluation engineering with golden datasets, rubrics, LLM-as-judge, and automated quality gates.
• Agentic architecture experience across tool calling, orchestration, context and memory management, and multi-step workflows.

Responsibilities

• Co-build production vertical slices with solution team engineers, including LLM features, agentic workflows, tool calling, and RAG integrated with an AI middleware platform.
• Own evaluation engineering with golden datasets, rubrics, LLM-as-judge, and transition ownership to the team.
• Design and build reusable platform capabilities on the AI middleware and guide teams through onboarding.
• Decide when to use generative AI versus deterministic approaches.
• Support discovery and shaping through a Catalyst-style program from pain-point identification to first working slice with middleware integration and baseline evaluations.
• Implement model routing, guardrails, observability, and cost controls.
• Coach engineers and product managers on AI-native software patterns, including agent harness and tool design.
• Produce durable artifacts such as architecture notes, evaluation suites, runbooks, and implementation patterns.

Skills

LLM-powered features

Evaluation engineering

Agentic architecture

AI-native software patterns

Tools

Azure

REST APIs

Terraform

Langfuse

Job description

Eliassen Group is seeking an AI Solutions Architect to enable product teams in shipping AI-native capabilities. The role focuses on embedding with a solution team, co-building production vertical slices across LLM features, agentic workflows, tool calling, and RAG within an AI middleware platform.

You will establish evaluation discipline, design reusable platform capabilities, and coach engineers and product managers to continue iterating after rotation.