Remote AI Solutions Architect for Production ML

Eliassen Group; Nashville (TN); Remote; USD 138,000 - 172,000; Part time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

401k with match

Life Insurance

Sick time

Job summary

Eliassen Group is seeking an AI Solutions Architect for remote engagement, embedding with a solution team to ship AI-native capabilities. You will co-build production vertical slices with LLM features, agentic workflows, tool calling, and RAG on an AI middleware platform.

The role emphasizes evaluation discipline, reusable platform capabilities, and coaching engineers and product managers to iterate after rotation.

Qualifications

• Shipped LLM-powered functionality to real users with exposure to production issues.
• Hands-on evaluation engineering with golden datasets, rubrics, LLM-as-judge, and automated quality gates.
• Agentic architecture experience across tool calling, orchestration, context and memory management, and multi-step workflows.
• RAG and semantic search implementation.
• Azure, cloud-native services, REST APIs, and CI/CD.
• Strong software engineering fundamentals with direct coding contributions.

Responsibilities

• Co-build production vertical slices with solution team engineers, including LLM features, agentic workflows, tool calling, and RAG integrated with an AI middleware platform.
• Own evaluation engineering with golden datasets, rubrics, LLM-as-judge, hallucination and regression detection, and CI/CD quality gates, and transition ownership to the team.
• Design and build reusable platform capabilities on the AI middleware and guide teams through onboarding.
• Decide when to use generative AI versus deterministic approaches.
• Support discovery and shaping through a Catalyst-style program from pain-point identification to first working slice with middleware integration and baseline evaluations.
• Implement model routing, guardrails, observability, and cost controls.
• Coach engineers and product managers on AI-native software patterns, including agent harness and tool design.
• Produce durable artifacts such as architecture notes, evaluation suites, runbooks, and implementation patterns.

Skills

LLM-powered functionality

Agentic architecture

RAG & semantic search

Azure cloud & CI/CD

Software engineering fundamentals

Tools

Azure OpenAI

Terraform

Langfuse

LiteLLM

REST APIs

Job description

Eliassen Group is seeking an AI Solutions Architect for remote engagement, embedding with a solution team to ship AI-native capabilities. You will co-build production vertical slices with LLM features, agentic workflows, tool calling, and RAG on an AI middleware platform.

The role emphasizes evaluation discipline, reusable platform capabilities, and coaching engineers and product managers to iterate after rotation.