Remote AI Solutions Architect - Build Production AI

Eliassen Group; Boston (MA); Remote; USD 138,000 - 172,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

401k with match

Life insurance

Job summary

Eliassen Group is seeking an AI Solutions Architect to enable product teams in shipping AI-native capabilities. You will embed with one solution team at a time, co-building production vertical slices across LLM features, agentic workflows, tool calling, and RAG on top of an AI middleware platform.

Responsibilities include evaluating datasets, establishing CI/CD quality gates, and coaching engineers and product managers in AI-native software patterns; remote, contract work with strong benefits

Qualifications

• Shipped LLM-powered functionality to real users.
• Hands-on evaluation engineering with golden datasets and CI/CD gates.
• Agentic architecture experience across tool calling and multi-step workflows.
• RAG and semantic search implementation.

Responsibilities

• Co-build production LLM features with solution team engineers, including LLM features, agentic workflows, tool calling, and RAG integrated with an AI middleware platform.
• Own evaluation engineering with golden datasets, rubrics, LLM-as-judge, and CI/CD quality gates, and transition ownership to the team.
• Design and build reusable platform capabilities on the AI middleware and guide teams through onboarding.
• Decide when to use generative AI versus deterministic approaches.
• Support discovery and shaping through a Catalyst-style program from pain-point identification to first working slice with middleware integration and baseline evaluations.
• Implement model routing, guardrails, observability, and cost controls.
• Coach engineers and product managers on AI-native software patterns, including agent harness and tool design.
• Produce durable artifacts such as architecture notes, evaluation suites, runbooks, and implementation patterns.

Skills

LLM features

Azure

CI/CD

Software engineering

Observability

Tool calling

Tools

Azure OpenAI

Terraform

Langfuse

Job description

Eliassen Group is seeking an AI Solutions Architect to enable product teams in shipping AI-native capabilities. You will embed with one solution team at a time, co-building production vertical slices across LLM features, agentic workflows, tool calling, and RAG on top of an AI middleware platform.

Responsibilities include evaluating datasets, establishing CI/CD quality gates, and coaching engineers and product managers in AI-native software patterns; remote, contract work with strong benefits