Senior Backend Engineer (AI Platform)

Provn

United States

Teletrabalho

USD 140 000 - 230 000

Tempo integral

Há 4 dias
Torna-te num dos primeiros candidatos

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Vantagens oferecidas por esta oferta de emprego

Health insurance
Flexible PTO
Equity and bonus eligibility
Fully remote culture

Resumo da oferta

AZX is seeking a Backend Engineer to build the services powering our AI-driven products and client solutions. The focus is an LLM gateway that unifies models, hosted and self-hosted, with concrete requirements from client engineers and measurable outcomes.

You will own routing, metering, budgets, guardrails, and adapters, while advancing retrieval, evals, and governance. Remote-friendly, with Seattle travel for interviews and annual summits.

Qualificações

  • 5+ years of production async Python experience.
  • Deep PostgreSQL knowledge and distributed systems experience.
  • Experience shipping API surfaces for engineers with versioning and migrations.
  • Familiarity with OpenTelemetry, streaming lifecycles, and AI tooling.
  • Exposure to OpenAI/Anthropic provider APIs and Redis/Dragonfly.

Responsabilidades

  • Own the LLM gateway: routing, metering, budgets, guardrails, and adapters.
  • Manage the retrieval and knowledge service: connectors, chunking, hybrid search and reranking.
  • Build the eval harness that turns retrieval tuning into evidence with confidence intervals.
  • Own the async framework API, rate-limit algorithms, and admin tooling.
  • Design authorization across the surface: token hierarchies and per-tenant isolation.
  • Define done criteria: evals, traces, cost accounting, and the dashboard.

Conhecimentos

Async Python
PostgreSQL
API design
Distributed systems
OpenTelemetry
Cloud/DevOps

Ferramentas

Postgres
Redis
SQLAlchemy
FastAPI
Dragonfly
Lua
pgvector

Descrição da oferta de emprego

About AZX

Our mission is to accelerate positive impact in critical industries through AI transformation. We specialize in physics-informed ML and enterprise AI solutions that directly address climate and sustainability challenges. We're growing quickly and already work with category-leaders in real estate (CBRE), energy (LevelTen Energy), logistics (Flexe) and utilities. We're a public benefit corporation, founded in 2024, and have been profitable from inception. We work on challenges in clean energy, decarbonization, climate risk, energy systems, and global economics. We're building our company for long-term success and aim to create the ultimate place to work for those passionate about AI and making a positive impact.

About the role

We're looking for a Backend Engineer you will build the services our products and client solutions run on. The center of gravity is LLM infrastructure: the layer that puts one governed front door over many models, hosted and self-hosted, and answers the questions enterprises actually ask: who used which model, for what, at what cost, under whose rules. The platform's first customers are our own client-facing engineers, the people delivering client outcomes with what you build, so requirements arrive concrete, feedback arrives same-day, and the people you support are in the same meeting.

Responsibilities
  • Own the LLM gateway: routing, metering, budgets, guardrail composition, and provider/backend adapters across hosted and self-hosted models.
  • Manage the retrieval and knowledge service: connectors, chunking, hybrid search and reranking, grounded answers, and the MCP surface.
  • Build the eval harness that turns retrieval tuning from judgment into evidence, with confidence intervals and per-segment breakdowns.
  • Own the async framework (its public API, rate-limit algorithms, and admin tooling) and lead its evolution into durable execution for agent runs.
  • Design authorization across the whole surface: token hierarchies, capability grammars, and per-tenant isolation tested as a regression, not asserted in a doc.
  • Own your own definition of done on everything you ship: evals, traces, cost accounting, and the dashboard that would wake you up.
Required Qualifications
  • 5+ years of deep, production async Python: cancellation scopes, streaming lifecycle, and connection pooling.
  • Postgres as infrastructure: comfortable reasoning about MVCC, advisory locks, and vacuum discipline, with Redis/Dragonfly used (and not used) where it belongs; real distributed-systems experience, not just familiarity.
  • Experience shipping API surfaces other engineers build on: versioning, idempotency, error vocabularies, migration discipline, and documentation to match.
  • Depth in at least one of LLM gateway concerns (routing, metering, guardrails, provider failover) or retrieval engineering (hybrid search, reranking, eval methodology, audit-ready RAG), with credibility on the other.
  • A cost accounting and evals first mindset: you've shipped a gate or harness that caught a real regression, ideally one of your own.
  • Production depth in some modern stack, and the aptitude to ramp quickly on unfamiliar tools.
  • Practical familiarity with our core stack: Python 3.12+ (async, type-strict, FastAPI/Starlette, Pydantic v2), asyncpg/SQLAlchemy, Postgres (incl. pgvector), and Redis/Dragonfly with Lua, with willingness to research into the rest.
  • Exposure to the surrounding ecosystem: OpenTelemetry (incl. GenAI conventions), SSE/streaming lifecycles, OpenAI/Anthropic provider APIs, job frameworks (Celery/Dramatiq/Prefect-class), rate-limit algorithms (token bucket, GCRA), and integer-cents money handling.
  • Past work in energy, real estate, utilities, climate or related fields is a plus.
  • Experience in both startup and enterprise environments is a plus.
Additional Information

Must be willing to travel to Seattle area for final interview and travel 2x/year for company summits.

Applicants must be currently authorized to work in the United States on a full-time basis.

We are unable to sponsor or take over sponsorship of employment visas at this time.

Benefits
  • Competitive early-stage startup compensation (based on capabilities, experience, and location).
  • Bonus eligibility and equity.
  • Health insurance with meaningful coverage for dependents.
  • Flexible PTO.
  • Fully remote culture with a cluster of teammates in Seattle.

Join a fast-growing, profitable, mission-driven company with industry-leading clients leading AI transformation in critical industries.

Estimated annual OTE: $140-230k.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Senior Backend Engineer (AI Platform)
Senior Backend Engineer (AI Platform)

Provn • Bellevue (WA)

Teletrabalho
USD 140 000 - 230 000
Equity
Health insurance
Flexible PTO
+2
Senior Backend Engineer (AI Platform)
Senior Backend Engineer (AI Platform)

AZX • EUA

Teletrabalho
USD 140 000 - 230 000
Health insurance
Equity
Flexible paid time off
+1
Senior ML Engineer (Client Solutions)
Senior ML Engineer (Client Solutions)

Provn • Bellevue (WA)

Teletrabalho
USD 140 000 - 230 000
Health insurance
Equity & Bonus eligibility
Flexible PTO
+1
Senior ML Engineer (Energy & Utilities)
Senior ML Engineer (Energy & Utilities)

Provn • Bellevue (WA)

Teletrabalho
USD 140 000 - 230 000
Bonus eligibility
Equity
Health insurance for dependents
+2
Forward Deployed AI Engineer (Senior)
Forward Deployed AI Engineer (Senior)

Provn • EUA

Presencial
USD 150 000 - 230 000
Senior ML Engineer (Client Solutions)
Senior ML Engineer (Client Solutions)

AZX • EUA

Teletrabalho
USD 140 000 - 230 000
Health insurance
Equity
Fully remote culture
+2
Senior ML Engineer: Production AI for Clients
Senior ML Engineer: Production AI for Clients

AZX • Seattle (WA)

Híbrido
USD 170 000 - 240 000
Health insurance
Equity
Fully remote culture
+2
Forward Deployed AI Engineer (Senior)
Forward Deployed AI Engineer (Senior)

AZX • EUA

Teletrabalho
USD 140 000 - 230 000
Health insurance
Equity
Fully remote culture
+2
Senior ML Engineer (Client Solutions)
Senior ML Engineer (Client Solutions)

AZX • Seattle (WA)

Híbrido
USD 170 000 - 240 000
Health insurance
Equity
Fully remote culture
+2
Forward Deployed AI Engineer (Senior)
Forward Deployed AI Engineer (Senior)

Provn • Bellevue (WA)

Teletrabalho
USD 140 000 - 230 000
Health insurance
Equity
Remote‑friendly culture
+1