Senior Backend Engineer, AI/LLM Production

TradeTrax; Phoenix (AZ); On-site; USD 140,000 - 200,000; Full time

Job summary

TradeTrax is hiring a senior software engineer to build and run the production AI pipeline behind a new feature for a production homebuilders platform. The role focuses on engineering around non-determinism in LLMs, instrumenting workflow, and defining quality metrics.

You will build the production backend for the AI pipeline (STT/LLM orchestration), implement evaluation layers, and operate scalable AWS services with CI/CD and Docker, with opportunities to grow into broader backend work.

Qualifications

• Senior backend engineer with strong Python experience and FastAPI or equivalent.
• Production experience running services on a major cloud with CI/CD, Docker, and ops practices.
• Experience taking a non-deterministic component (LLM or probabilistic system) into production with instrumentation and evaluation.
• Ability to learn unfamiliar domains quickly and influence team practices.
• Deep experience in LLM orchestration and evaluation infrastructure.
• Claude Code-centric or comparable agentic workflows with demonstrable impact.

Responsibilities

• Build and operate the production backend for the AI pipeline, including STT and LLM orchestration and the services around them.
• Develop instrumentation and evaluation layer with quality metrics and regression/eval harness.
• Treat the LLM as a calibrated dependency and optimize it over time.
• Create scalable backend services on AWS (Lambda, API Gateway, Docker, CI/CD).
• Evaluate and tune STT and LLM providers against internal metrics.
• Extend into broader backend platform engineering after production readiness.
• Set an example for AI-assisted engineering within the team.

Skills

Python

FastAPI

REST API

Distributed systems

CI/CD

LLM orchestration

Non-deterministic system handling

AWS

Backend engineering

Tools

Docker

AWS

Lambda

API Gateway

Job description

TradeTrax is hiring a senior software engineer to build and run the production AI pipeline behind a new feature for a production homebuilders platform. The role focuses on engineering around non-determinism in LLMs, instrumenting workflow, and defining quality metrics.

You will build the production backend for the AI pipeline (STT/LLM orchestration), implement evaluation layers, and operate scalable AWS services with CI/CD and Docker, with opportunities to grow into broader backend work.