Backend AI Engineer — LLMs & Distributed Systems

Bilt Technologies, Inc.

New York (NY)

On-site

USD 170,000 - 300,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive salary with equity
Health insurance
401k with match
Unlimited PTO
Team events

Job summary

Bilt Technologies, Inc. is hiring a Back End / AI Engineer to build and run the backend powering concierge across the app, web, and messaging channels. You will design end-to-end agent capabilities, run multi-agent orchestration, and optimize performance and cost for tens of thousands of conversations daily.

You’ll work with Python (FastAPI), Java (Quarkus), and Go in a cloud environment, and apply your knowledge of distributed systems and LLMs to improve reliability and user experience.

Qualifications

  • 4+ years building and operating backend services in production.
  • Hands-on experience with LLMs and curiosity about reliability.
  • Clear writing and ability to review prompts and prompts’ prompts.

Responsibilities

  • Build and run backend services for concierge platform across multiple channels (app, web, SMS, iMessage, email).
  • Develop agent capabilities, runtime orchestration, context/memory, and prompt caching across models.
  • Improve performance (p50/p99) and cost per conversation, ensure reliability.
  • Create eval harnesses, LLM judges, and conversation replay to measure changes before shipping.
  • Support merchant staff assistants using business data and browser agents where APIs are missing.

Skills

Backend development
Python
Java
Go
LLMs
Distributed systems
Cloud

Tools

FastAPI
Go
Java

Job description

Bilt Technologies, Inc. is hiring a Back End / AI Engineer to build and run the backend powering concierge across the app, web, and messaging channels. You will design end-to-end agent capabilities, run multi-agent orchestration, and optimize performance and cost for tens of thousands of conversations daily.

You’ll work with Python (FastAPI), Java (Quarkus), and Go in a cloud environment, and apply your knowledge of distributed systems and LLMs to improve reliability and user experience.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Backend AI Engineer — Build Scalable Agent Platform
Backend AI Engineer — Build Scalable Agent Platform

Bilt Rewards • New York (NY)

On-site
USD 170,000 - 300,000
Health insurance
401k
Unlimited PTO
+3
Backend AI Engineer: Scale Conversational Agents
Backend AI Engineer: Scale Conversational Agents

Bilt • New York (NY)

On-site
USD 170,000 - 300,000
Health insurance
401k with match
Unlimited PTO
+4
Backend Engineer – AI Platform & LLM Orchestration
Backend Engineer – AI Platform & LLM Orchestration

Axiamatic • Menlo Park (CA)

Hybrid
USD 140,000 - 200,000
Principal AI Systems Engineer (LLM Backend Architect)
Principal AI Systems Engineer (LLM Backend Architect)

Salesforce, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
Paid Time Off
Medical Insurance
Dental Insurance
+7
Full-Stack AI Engineer: LLM Agents & Backend
Full-Stack AI Engineer: LLM Agents & Backend

Ampcus, Inc • Irving (TX)

On-site
USD 120,000 - 180,000
Senior Backend Engineer - AI/LLM & Microservices
Senior Backend Engineer - AI/LLM & Microservices

Coinbase, Inc. • New York (NY)

On-site
USD 150,000 - 210,000
Medical Insurance
Dental Insurance
Vision Insurance
+3
AI Systems Platform Engineer - LLM-Powered Backend & Orchestration
AI Systems Platform Engineer - LLM-Powered Backend & Orchestration

Federato Technologies • United States

Remote
USD 180,000 - 240,000
AI Engineer — Production-Grade LLM & Agent Systems
AI Engineer — Production-Grade LLM & Agent Systems

Awareson Sp. z o.o. • United States

Remote
USD 120,000 - 160,000
Remote AI/ML Engineer: LLMs, RAG & AI Agents
Remote AI/ML Engineer: LLMs, RAG & AI Agents

Client • United States

Remote
USD 120,000 - 190,000
Remote-friendly environment
Senior Java Backend Engineer - AI Chatbot & LLMs
Senior Java Backend Engineer - AI Chatbot & LLMs

Binance • United States

Remote
USD 120,000 - 180,000