AI Platform Engineer: Retrieval & Agent Pipelines

Insight Global; Atlanta (GA); On-site; USD 120,000 - 180,000; Full time

Job summary

Insight Global is seeking an experienced software engineer to work across the AI layer of our platform, contributing to retrieval pipelines, agent workflows, and model evaluation. The role is hands‑on and empirical, with experimentation, measurement, and iteration driving progress, in collaboration with the Senior AI Engineer and broader engineering team.

You will implement and tune retrieval components, build out the agent orchestration layer, and instrument observability across AI systems.

Qualifications

• 3+ years of software engineering experience, with at least 1 year building LLM-powered systems.
• Practical experience in retrieval-augmented generation or agent workflows.
• Proficient in Python with asynchronous programming and REST APIs.
• Familiarity with evaluation of LLM systems and observability tooling.
• Knowledge of RAG pipelines, agent orchestration, or fine-tuning.

Responsibilities

• Contribute to the hybrid retrieval pipeline — implementing and tuning retrieval components, running experiments to improve quality, and validating results on real evaluations.
• Build and maintain components of the agent orchestration layer — tool integrations, prompt management, and supporting human‑in‑the‑loop workflows.
• Instrument AI and agent systems for observability — tracing model and tool calls, capturing token and latency telemetry, and supporting failure analysis.
• Build and maintain evaluation datasets and test suites across retrieval and agent workflows, contributing to CI‑level quality gates.
• Support document AI capabilities — working with parsing, extraction, and OCR pipelines as the platform serves new client engagements.
• Implement per‑tenant isolation checks across retrieval and agent layers, helping ensure no cross‑tenant data leakage occurs.
• Contribute to model behavior evaluation — running prompt injection and adversarial tests as part of ongoing eval work.

Skills

Python

Async code

REST APIs

LLM systems

RAG pipelines

Tools

LangGraph

OCR pipelines

Evaluation datasets

Job description

Insight Global is seeking an experienced software engineer to work across the AI layer of our platform, contributing to retrieval pipelines, agent workflows, and model evaluation. The role is hands‑on and empirical, with experimentation, measurement, and iteration driving progress, in collaboration with the Senior AI Engineer and broader engineering team.

You will implement and tune retrieval components, build out the agent orchestration layer, and instrument observability across AI systems.