Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.
Good Sam Analytics in Chicago, IL is hiring an AI Engineer to design agent architectures, implement LLM pipelines, and validate outputs for a purpose-trained AI platform.
You will work in a hybrid environment building scalable agent orchestration, RAG for knowledge bases, and governance controls while partnering with non-technical stakeholders to scope and ship new agents.
Good Sam Analytics - AI Enablement
Location: Chicago, Illinois (Hybrid)
Employment Type: Full-time
Good Sam Analytics is building the internal platform that enables Good Sam departments to talk with purpose-trained AI agents to answer real questions. We are seeking an AI Engineer who can design and build agent architecture, implement LLM pipelines, validate their outputs rigorously, and work directly with non-technical stakeholders to scope and ship new agents. This role blends Data Engineering, Data Architecture, Backend Software Engineering, and AI Orchestration. You will work inside a small, tightly-scoped squad whose mission is shipping production-quality agents on a defined staged build plan.
Build and extend our agent-serving architecture: a hierarchical orchestrator routing questions through specialized agents, with all LLM calls governed through a gateway for per-agent cost attribution, rate limiting, and circuit breaking.
Bridge internal-only systems (Snowflake, internal Postgres, internal APIs) to agents securely via MCP or custom tool patterns, without ever exposing internal infrastructure to the public internet.
Design and wire multi-agent workflows using frameworks like LangGraph, LangChain, or agentic harnesses where the task genuinely requires fan-out, specialized sub-agents, or a dedicated verifier step -- and just as importantly, know when a single well-built agent loop is the right call instead.
Implement Retrieval-Augmented Generation (RAG) for department knowledge bases: hierarchical chunking, hybrid search, and selective retrieval so agents ground answers in real company content instead of hallucinating.
Use Claude Code and similar AI coding tools as the primary means of writing, refactoring, and testing code across the stack -- direct, prompt, review, and harden AI-generated output rather than hand-writing every line.
Translate department requirements into precise structured specs and agent instructions (system prompts, tool schemas, knowledge files) that produce reliable, production-ready behavior.
Build and maintain a golden question set for each agent domain -- question-to-expected-result pairs that run in CI and catch regressions before they reach stakeholders.
Maintain sound judgment on when to trust AI-generated code versus when to intervene manually -- speed never substitutes for correctness on a shipped agent.
Build in security and cost controls including per-agent spend caps and rate limits, human-approval gates on any consequential action, read-only enforcement, etc.
Implement audit logging for every tool call, session, and human approval -- tie every action back to the requesting user's identity.
Apply a progressive-autonomy rollout: pilot with one team before wider release, gate write/action capability behind a proven read/advise phase. Autonomous write-backs are explicitly out of scope at launch -- agents answer questions, they do not initiate actions.
Versioned, human-reviewed knowledge artifacts (retrieval documents, prompt playbooks) for teaching an agent department-specific knowledge.
Partner directly with department stakeholders (Sales, Marketing, etc.) to scope what their agent actually needs to answer, gather real stakeholder phrasing for the golden question set, and communicate technical tradeoffs in plain terms.
Document architecture decisions and open questions as you go -- this team keeps a living internal knowledge base of what's been tried, what worked, and what's still unresolved. You are expected to contribute to it.
Mentor other engineers on agent-building patterns, eval design, and validation discipline as the team and platform grow.