Backend Engineer - GenAI at Enterprise Scale

Scale AI; City Of London; On-site; GBP 85,000 - 110,000; Full time

Job summary

Scale AI is seeking a Backend Engineer to build scalable GenAI infrastructure for enterprise customers. You will design and implement robust APIs, distributed data pipelines, and deployment workflows that run at production scale across hybrid cloud environments.

You will collaborate with ML and product teams to integrate AI models, ensure reliability, security, and observability, and ship high-quality backend systems that empower Scale’s GenAI platform in enterprises.

Qualifications

• 4+ years of experience developing large-scale backend or infrastructure systems.
• Proficiency in Python or TypeScript with experience designing high-performance APIs.
• Deep familiarity with cloud infrastructure (AWS and Azure) including container orchestration and Terraform.
• Experience managing data systems (PostgreSQL, NoSQL) and building data pipelines.
• Hands-on experience with GenAI applications, model integration, or AI agent systems.
• Strong understanding of observability, CI/CD, and security for enterprise services.
• Ability to balance rapid iteration with production-grade quality.

Responsibilities

• Design, build, and scale backend systems powering enterprise GenAI products with reliability and performance.
• Develop core services and APIs that securely integrate AI models and data sources.
• Architect scalable distributed systems for data processing, inference, and orchestration of GenAI workloads.
• Optimize backend performance for latency, throughput, and cost across hybrid/multi-cloud environments.
• Manage and evolve cloud infrastructure (AWS, Azure, or GCP) with automation and observability.
• Collaborate with ML and product teams to deploy and scale AI workloads in production.
• Improve reliability and scalability through robust engineering practices.

Skills

Python

TypeScript

Distributed systems

Cloud infrastructure

Kubernetes

Docker

Express

NestJS

FastAPI

Terraform

PostgreSQL

DynamoDB

CI/CD

Observability

Tools

FastAPI

Flask

Express

NestJS

Terraform

Docker

Kubernetes

Job description

Scale AI is seeking a Backend Engineer to build scalable GenAI infrastructure for enterprise customers. You will design and implement robust APIs, distributed data pipelines, and deployment workflows that run at production scale across hybrid cloud environments.

You will collaborate with ML and product teams to integrate AI models, ensure reliability, security, and observability, and ship high-quality backend systems that empower Scale’s GenAI platform in enterprises.