Production AI Agent Engineer: Build & Scale

Perform Digital; United States; Remote; USD 140,000 - 200,000; Full time

Job summary

Perform Digital is seeking a hands-on software engineer to build, fine-tune, evaluate, and operate specialized AI agents for enterprise clients. The role blends applied research with production engineering, from choosing agent patterns to ensuring observability and cost efficiency at scale.

You will own agent design, curate datasets for fine-tuning, and optimize prompt architecture, retrieval, and latency. Strong Python, plus TypeScript/Go, and cloud experience are required.

Qualifications

• 4+ years of software engineering experience with 1 year shipping LLM-based products to production.
• Strong Python skills, plus TypeScript or Go for glue code and APIs.
• Hands-on production experience with major providers (Anthropic, OpenAI) or open-weight models on self-managed infra.
• Experience with fine-tuning workflows: LoRA, SFT, dataset curation, eval harnesses.
• Production RAG experience: vector stores, embedding choices, chunking, reranking, hybrid retrieval.
• Cost and latency aware: read dashboards and identify optimization levers.
• Comfort with AWS, GCP or Azure and one container orchestrator (ECS, Kubernetes).

Responsibilities

• Own agent design from problem framing to production, selecting patterns like tool-use orchestration, RAG, multi-step planning, and reflection loops.
• Curate datasets and run LoRA or full supervised fine-tunes when off-the-shelf models fall short, evaluating them against a harness.
• Engineer prompt architecture, retrieval strategy, chunking, reranking, and eval-driven prompt iteration.
• Optimize for cost and latency through quantization, batching, streaming, and fallback strategies.
• Instrument observability from day one, including tracing, regression suites, online evals, and drift alerts.

Skills

Python

TypeScript/Go

LLM production

Cost & latency awareness

Cloud platforms (AWS/GCP/Azure)

Kubernetes / ECS

Tools

lm-eval-harness

Vectors / embedding stores

Job description

Perform Digital is seeking a hands-on software engineer to build, fine-tune, evaluate, and operate specialized AI agents for enterprise clients. The role blends applied research with production engineering, from choosing agent patterns to ensuring observability and cost efficiency at scale.

You will own agent design, curate datasets for fine-tuning, and optimize prompt architecture, retrieval, and latency. Strong Python, plus TypeScript/Go, and cloud experience are required.