Backend AI Engineer: Scale Conversational Agents

Bilt; New York (NY); On-site; USD 170,000 - 300,000; Full time

Benefits offered by this job

Health insurance

401k with match

Unlimited PTO

Equity and bonus program

Commuter benefits

Team events

Bilt Points for employees

Job summary

Bilt is building a backend-focused AI-powered assistant platform. You will own the backend services, architect multi-agent interactions, and optimize performance and reliability.

The role emphasizes end-to-end ownership, from prompts and tools to production-grade infrastructure on Google Cloud. We value strong backend proficiency, hands-on LLM experience, and a willingness to ship rapid iterations with robust monitoring and security controls.

Qualifications

• 4+ years building and operating backend services in production.
• Strong in at least one backend language and experience running services in the cloud. We mostly use Python (FastAPI), Java (Quarkus), and Go on Google Cloud.
• Solid distributed systems fundamentals (async processing, pub/sub, idempotency, retries, caching).
• Hands-on experience with LLMs, at work or on your own, and curiosity about making them reliable.
• Product judgment: you can read a bad conversation and tell whether the cause is the prompt, a tool, the data, or a service.
• Daily use of AI coding agents, and good judgment about when to trust their output.
• Clear writing. Design docs, PR descriptions, and the prompts you give agents all matter here.

Responsibilities

• Agent capabilities end to end: tools, workflows, prompts, and the integrations with Bilt and partner systems behind them
• The agent runtime: multi-agent orchestration, context and memory, prompt caching, and routing across frontier and open-weight models
• Performance: p50 and p99 across the full request path, bursty traffic, and cost per conversation
• Eval harnesses, LLM judges, and conversation replay, so every model and prompt change is measured before it ships
• Assistants for merchants' staff that work from the business's own data, and browser agents that can act where no API exists
• Proactive features that drive engagement with members and merchants' customers: briefings, follow-ups, and outreach that land at the right moment
• The conversation platform: one inbox where the agent, merchant staff, and Bilt support share threads across SMS, iMessage, email, web, and in-app chat
• Messaging: realtime streaming replies, attachments, message ordering and idempotent delivery, carrier and iMessage sending limits, and handing off to a person at the right moment
• Authentication and fine-grained authorization, so the agent only sees and does what it should for members, merchants, and staff

Skills

Backend engineering

Backend language proficiency

Distributed systems

LLMs experience

Product judgment

AI coding agents

Technical writing

Tools

Google Cloud

Python (FastAPI)

Java (Quarkus)

Go

Job description

Bilt is building a backend-focused AI-powered assistant platform. You will own the backend services, architect multi-agent interactions, and optimize performance and reliability.

The role emphasizes end-to-end ownership, from prompts and tools to production-grade infrastructure on Google Cloud. We value strong backend proficiency, hands-on LLM experience, and a willingness to ship rapid iterations with robust monitoring and security controls.