Senior AI Platform Backend Engineer — LLM & Infra

Aimlroles; Northern (KY); Hybrid; USD 120,000 - 210,000; Full time

Benefits offered by this job

Health insurance

Equity

Bonus eligibility

Flexible time off

Fully remote culture

Job summary

AZX is building a scalable LLM infrastructure platform for client-facing engineers. As a Backend Engineer, you will own the LLM gateway, retrieval service, and async framework, shaping how models are accessed, billed, and governed.

You will work in a fully remote role with a fast-growing, mission-driven team, collaborating across energy, real estate, utilities, and climate initiatives, with opportunities to travel to Seattle for company summits.

Qualifications

• 5+ years of production async Python experience.
• Experience with PostgreSQL, Redis, and distributed systems.
• Experience shipping API surfaces with versioning and docs.
• Knowledge of LLM gateway or retrieval engineering.
• Comfort with async frameworks and modern Python stack.

Responsibilities

• Own the LLM gateway: routing, metering, budgets, guardrails and adapters.
• Manage retrieval service: connectors, chunking, hybrid search and reranking.
• Build an eval harness with confidence intervals and breakdowns.
• Own the async framework API, rate-limit algorithms, and admin tooling.
• Design authorization across the surface: per-tenant isolation and governance.
• Define done criteria: evals, traces, cost accounting and dashboards.

Skills

Async Python (5+ years)

API design / versioning

Distributed systems experience

OpenTelemetry familiarity

Energy/real estate/utilities industrya

Tools

PostgreSQL

Redis/Dragonfly

FastAPI/Starlette

SQLAlchemy

Lua in Redis

Job description

AZX is building a scalable LLM infrastructure platform for client-facing engineers. As a Backend Engineer, you will own the LLM gateway, retrieval service, and async framework, shaping how models are accessed, billed, and governed.

You will work in a fully remote role with a fast-growing, mission-driven team, collaborating across energy, real estate, utilities, and climate initiatives, with opportunities to travel to Seattle for company summits.