Backend Engineer, AI

USA Tech Recruit; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

USA Tech Recruit is seeking a Backend Engineer, AI to join a fast-growing AI-first technology company building the production infrastructure behind next-generation AI applications powered by large language models.

You will design inference pipelines, orchestration layers, and high-performance APIs that connect cutting-edge models with real-world products, while optimizing latency, reliability, and observability in scalable systems.

Qualifications

• Experience with AI inference pipelines and model orchestration.
• Experience building high-throughput, low-latency backend systems.
• Proficient with SQL and NoSQL databases.
• Experience with monitoring, logging and observability.
• Strong API design and backend architecture skills.
• Knowledge of performance optimisation, caching and streaming.

Responsibilities

• Build and operate backend systems powering AI interactions at scale.
• Design inference pipelines and orchestration layers.
• Develop high-performance APIs connecting models with products.
• Optimize latency, reliability, and throughput of AI services.
• Collaborate with ML and product teams to deliver scalable observability.

Skills

AI inference pipelines

Model orchestration

High-throughput backend

SQL

NoSQL

Observability

API design

Performance optimisation

Job description

A fast-growing AI-first technology company is looking for a Backend Engineer, AI to join their team building the production infrastructure behind next-generation AI applications powered by large language models.

Successful candidates will build and operate the backend systems that power AI interactions at scale, designing inference pipelines, orchestration layers, and high-performance APIs that connect cutting-edge models with real-world products. You will optimise latency, reliability, and throughput while working closely with machine learning and product teams to deliver fast, scalable, and observable AI services.

Ideal candidates will have knowledge of:

• AI inference pipelines and model orchestration
• High-throughput, low-latency backend systems
• SQL and NoSQL databases
• Monitoring, logging and observability
• API design and backend architecture
• Performance optimisation, caching and streaming

For more information please see our Privacy Notice (https://eu-recruit.com/about-us/privacy-notice/)