Remote AI Solutions Architect for Production LLMs

Eliassen Group; Hartford (CT); Remote; USD 138,000 - 172,000; Full time

Benefits offered by this job

Medical

Dental

Vision

401k with match

Life insurance

Job summary

Eliassen Group is seeking an AI Solutions Architect to enable product teams to ship AI-native capabilities remotely. You will embed with a solution team, building production vertical slices across LLM features and RAG on our AI middleware platform.

You will establish evaluation discipline, design reusable platform capabilities, and coach engineers and product managers so teams continue to iterate after rotation. This is a W2 contract with comprehensive benefits.

Qualifications

• Shipped LLM-powered functionality to real users.
• Hands-on evaluation engineering with golden datasets and CI/CD gates.
• Agentic architecture experience across tool calling, orchestration, context and memory management.
• RAG and semantic search implementation.
• Azure cloud services, REST APIs, and CI/CD.
• Strong software engineering fundamentals with production coding.
• Ability to onboard to a new codebase within 6–8 weeks.
• Clear communication of technical decisions.

Responsibilities

• Co-build production vertical slices with solution engineers on LLM features and RAG integration.
• Own evaluation engineering with golden datasets, rubrics, LLM-as-judge, and automated quality gates.
• Design reusable platform capabilities on the AI middleware and onboard teams.
• Decide when to use generative AI versus deterministic approaches.
• Support discovery and shaping through a Catalyst-style program from pain-point identification to first working slice with middleware integration and baseline evaluations.
• Implement model routing, guardrails, observability, and cost controls.
• Coach engineers and product managers on AI-native software patterns.
• Produce architecture notes, evaluation suites, runbooks, and implementation patterns.

Skills

LLM features

Evaluation engineering

Agentic architecture

RAG integration

Azure cloud

REST APIs

CI/CD

Software engineering

Communication

Tools

Azure OpenAI

Terraform

Azure Container Apps

LiteLLM

Langfuse

Job description

Eliassen Group is seeking an AI Solutions Architect to enable product teams to ship AI-native capabilities remotely. You will embed with a solution team, building production vertical slices across LLM features and RAG on our AI middleware platform.

You will establish evaluation discipline, design reusable platform capabilities, and coach engineers and product managers so teams continue to iterate after rotation. This is a W2 contract with comprehensive benefits.