Senior Enterprise AI Platform Engineer

Jobtailor; Chicago (IL); On-site; USD 140,000 - 180,000; Full time

Job summary

Jobtailor in Chicago seeks a software engineer to architect a hierarchical, agent-serving system and govern LLM calls for cost and reliability. You will wire Snowflake, Postgres, and internal APIs to agents, designing multi-agent workflows with LangGraph/LangChain and implementing RAG.

Role requires transforming department needs into precise specs, maintaining CI-driven checks, and mentoring engineers on agent patterns and evaluation methods.}

Qualifications

• 2+ years of software engineering with backend in Python
• Hands-on experience with LLMs, prompt engineering, tool/function calling
• Experience with agent orchestration patterns (LangGraph, LangChain)
• SQL and data warehouse proficiency; Snowflake preferred
• Ability to write and debug CTEs, window functions, and joins
• Direct experience directing AI coding assistants to generate/modify production code
• Specification-writing skills and API design understanding
• Familiarity with RAG architectures, vector stores, and eval-driven development
• Git and CI/CD practices
• Experience with MCP and related protocols

Responsibilities

• Build and extend a hierarchical agent-serving architecture routing questions through specialized agents
• Govern LLM calls through a gateway for cost attribution, rate limiting, and reliability
• Securely connect Snowflake, Postgres, and internal APIs to agents
• Design and wire multi-agent workflows using LangGraph, LangChain, or similar tools
• Implement RAG for department knowledge bases using hierarchical chunking and hybrid search
• Use Claude Code and similar tools to write, refactor, and test production code
• Translate requirements into structured specs, prompts, and tool schemas
• Maintain golden question sets and CI-based regression checks
• Apply security and cost controls including spend caps and human approvals
• Implement audit logging for tool calls and sessions tied to user identity
• Roll out agents from pilots to wider release
• Maintain versioned retrieval documents and prompt playbooks
• Collaborate with Sales/Marketing to scope capabilities and communicate tradeoffs
• Document architecture decisions and team knowledge
• Mentor engineers on agent-building patterns and evaluation design

Skills

Python

LLM Integration

LangGraph/LangChain

SQL Snowflake

AI Coding Assistant

Tools

Claude Code

MLflow

Airflow

Docker

AWS

Azure

GCP

Job description

Jobtailor in Chicago seeks a software engineer to architect a hierarchical, agent-serving system and govern LLM calls for cost and reliability. You will wire Snowflake, Postgres, and internal APIs to agents, designing multi-agent workflows with LangGraph/LangChain and implementing RAG.

Role requires transforming department needs into precise specs, maintaining CI-driven checks, and mentoring engineers on agent patterns and evaluation methods.}