Remote AI Engineer: Build LLM Features & RAG Pipelines

Eliassen Group; Boston (MA); Remote; USD 124,000 - 152,000; Full time

Job summary

Eliassen Group is partnering with a Boston-area client to deliver AI-powered features as a second engineer in a two-person pod. You will co-build RAG pipelines, tool-calling agents, and production-grade services while working with a senior AI Solutions Architect and cross-functional teams.

Ideal candidates have 3+ years of software engineering, backend experience in .NET or Java with Python familiarity, and hands-on delivery of LLM-powered capabilities in Azure cloud environments.

Qualifications

• 3+ years of professional software engineering.
• Backend experience in .NET or Java with working familiarity in Python.
• Hands-on experience delivering LLM-powered features such as RAG, tool-calling, prompt engineering, and structured outputs.
• Experience with Azure or comparable cloud, REST APIs, Git, and CI/CD.
• Comfortable with a modern front end such as React, Angular, or TypeScript.
• Demonstrated curiosity and ability to become productive in a new codebase and business within 6 to 8 weeks.
• Preferred: Azure OpenAI, Azure Container Apps, Terraform.

Responsibilities

• Build and ship LLM-powered features including RAG pipelines, tool-calling agents, multi-step workflows, and prompt frameworks.
• Integrate solutions with the AI middleware platform and contribute reusable capabilities.
• Implement evaluation and testing for AI outputs including test sets, automated checks, regression detection, and quality gates.
• Develop APIs, backend services, integrations, and UI components required for AI features.
• Add observability, logging, and cost tracking to deployed AI systems and remediate issues.
• Pair with solution team engineers to enable independent execution of AI feature development.
• Document designs, decisions, and lessons to accelerate future teams.

Skills

.NET or Java

Python

LLM features

Azure

REST APIs

Git

CI/CD

Frontend (React/Angular/TypeScript)

Tools

Azure OpenAI

Terraform

LiteLLM

Langfuse

Vector databases

Job description

Eliassen Group is partnering with a Boston-area client to deliver AI-powered features as a second engineer in a two-person pod. You will co-build RAG pipelines, tool-calling agents, and production-grade services while working with a senior AI Solutions Architect and cross-functional teams.

Ideal candidates have 3+ years of software engineering, backend experience in .NET or Java with Python familiarity, and hands-on delivery of LLM-powered capabilities in Azure cloud environments.