Remote AI Solutions Architect: Production AI Features Lead

Eliassen Group; Cheyenne (WY); Remote; USD 138,000 - 172,000; Full time

Benefits offered by this job

Medical, Dental, Vision benefits

401k with company matching

Life insurance

Job summary

Eliassen Group is seeking an AI Solutions Architect to enable product teams in delivering AI-native capabilities. You will embed with a solution team, co-building production vertical slices across LLM features, agentic workflows, tool calling, and RAG on top of an AI middleware platform.

You will establish evaluation discipline and coach engineers and product managers to iterate after rotation. Responsibilities include owning evaluation with golden datasets and CI/CD quality gates, designing

Qualifications

• Experience shipped LLM-powered functionality to real users and handled production issues.
• Hands-on evaluation engineering with golden datasets, rubrics, LLM-as-judge, and automated quality gates.
• Agentic architecture across tool calling, orchestration, and multi-step workflows.
• Familiarity with Azure cloud services, REST APIs, and CI/CD.

Responsibilities

• Co-build production vertical slices with solution team engineers, including LLM features and RAG integration.
• Own evaluation engineering with golden datasets, rubrics, and CI/CD quality gates; transition ownership to the team.
• Design and build reusable platform capabilities on the AI middleware and guide teams through onboarding.
• Decide when to use generative AI versus deterministic approaches.
• Support discovery and shaping through a Catalyst-style program from pain-point to first working slice.
• Implement model routing, guardrails, observability, and cost controls.
• Coach engineers and product managers on AI-native software patterns; produce durable artifacts.

Skills

LLM-powered features

Azure OpenAI

REST APIs

CI/CD

Software engineering fundamentals

Communication

Tools

Azure OpenAI

Terraform

Langfuse

LiteLLM

Job description

Eliassen Group is seeking an AI Solutions Architect to enable product teams in delivering AI-native capabilities. You will embed with a solution team, co-building production vertical slices across LLM features, agentic workflows, tool calling, and RAG on top of an AI middleware platform.

You will establish evaluation discipline and coach engineers and product managers to iterate after rotation. Responsibilities include owning evaluation with golden datasets and CI/CD quality gates, designing