Senior Backend Engineer - AI Platform, Flexible Hours

FriendliAI Inc.

San Francisco (CA)

On-site

USD 180,000 - 250,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible working hours
Daily lunch and dinner provided
Health check-up support

Job summary

FriendliAI is seeking a Senior Backend Engineer to own the business logic layer between inference engine and customers, building scalable, production-grade backend services. You will design APIs (REST/gRPC/GraphQL), implement multi-tenant SaaS architecture with authentication, RBAC, and billing, and work across OLTP/OLAP data stores.

Join a small, fast-moving team driving AI infrastructure. We value collaboration, solving complex architectural challenges, and active contribution to developer

Qualifications

  • 5+ years of backend or systems engineering experience in production environments.
  • Bachelor's or Master's degree in Computer Science, Computer Engineering, or equivalent.
  • Expertise in Python and modern frameworks (e.g., FastAPI).
  • Strong experience designing and operating distributed systems at scale.
  • Solid API design experience across REST, gRPC, and GraphQL.
  • Proficiency in data modeling and SQL, with hands-on experience in PostgreSQL and OLAP systems such as ClickHouse.
  • Working knowledge of LLM serving.
  • Experience building secure, multi-tenant SaaS architectures: authentication, RBAC, and compliance requirements.

Responsibilities

  • Own the architecture and evolution of core backend microservices powering our AI inference platform, from the API layer through business logic to the data layer.
  • Design and build production-grade APIs (REST, gRPC, GraphQL) that serve as the foundation for AI deployments, developer integrations, and enterprise workflows.
  • Build and scale enterprise-grade platform capabilities: authentication, RBAC, billing, organization management, and secure multi-tenant SaaS infrastructure.
  • Develop AI-specific platform features, including LLM deployment workflows and inference-specific service integrations.
  • Design and optimize data models and pipelines across OLTP (PostgreSQL) and OLAP (ClickHouse) systems.
  • Collaborate with infrastructure engineers on multi-cloud deployment and resource orchestration pipelines.
  • Set reliability and performance standards for the services you own, resolving production issues with urgency and rigor
  • Drive engineering quality through design reviews, automated testing, and CI/CD.

Skills

Python
FastAPI
Distributed systems
API design
PostgreSQL
ClickHouse
LLM serving
Multi-tenant SaaS
Cloud-native
Kubernetes
OpenTelemetry
SQL

Education

Bachelor's or Master's degree in CS/CE or equivalent

Tools

Kubernetes
Git

Job description

FriendliAI is seeking a Senior Backend Engineer to own the business logic layer between inference engine and customers, building scalable, production-grade backend services. You will design APIs (REST/gRPC/GraphQL), implement multi-tenant SaaS architecture with authentication, RBAC, and billing, and work across OLTP/OLAP data stores.

Join a small, fast-moving team driving AI infrastructure. We value collaboration, solving complex architectural challenges, and active contribution to developer

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer - Senior Backend San Francisco
Software Engineer - Senior Backend San Francisco

FriendliAI Inc. • San Francisco (CA)

On-site
USD 180,000 - 250,000
Flexible working hours
Daily lunch and dinner provided
Health check-up support
Flexible AI Platform Full-Stack Engineer
Flexible AI Platform Full-Stack Engineer

FriendliAI Inc. • San Francisco (CA)

On-site
USD 120,000 - 160,000
Flexible working hours
Daily lunch and dinner provided
Health check-up support
+2
Senior Backend Engineer, AI Platform (Remote)
Senior Backend Engineer, AI Platform (Remote)

Affirm, Inc. • San Francisco (CA)

Remote
USD 173,000 - 255,000
Health coverage for you and dependents
Monthly tech stipend
Flexible time off
+1
Senior Backend Engineer, AI Platform (Remote)
Senior Backend Engineer, AI Platform (Remote)

Affirm, Inc. • Chicago (IL)

Remote
USD 173,000 - 233,000
Health coverage for dependents
Monthly tech stipend
Flexible time off
+1
Remote Senior Backend Engineer, AI Platform & Infra
Remote Senior Backend Engineer, AI Platform & Infra

Affirm, Inc. • Sioux Falls (SD)

Remote
USD 173,000 - 233,000
Health coverage for you and dependents
Monthly tech stipends and wellness
Flexible time off and holidays
+1
Senior AI Platform Backend Engineer (Remote)
Senior AI Platform Backend Engineer (Remote)

Affirm, Inc. • Charlotte (NC)

Remote
USD 173,000 - 255,000
Health coverage
Stock purchase plan
Tech stipends
+2
Senior Backend Engineer, AI Platform (Remote)
Senior Backend Engineer, AI Platform (Remote)

Affirm, Inc. • United States

Remote
USD 173,000 - 255,000
Health coverage
Tech stipends
Flexible time off
+1
Senior Backend Engineer - AI Infrastructure, Remote
Senior Backend Engineer - AI Infrastructure, Remote

Essence Ventures • San Francisco (CA)

Remote
USD 200,000 - 250,000
In-person hubs SF/NYC
Flexible PTO with US holidays
100% health insurance for policyholder
+6
Senior Backend Engineer, AI Infrastructure (Remote)
Senior Backend Engineer, AI Infrastructure (Remote)

Fuel Talent • United States

Hybrid
USD 140,000 - 225,000
Software Engineer - Full Stack San Francisco
Software Engineer - Full Stack San Francisco

FriendliAI Inc. • San Francisco (CA)

On-site
USD 180,000 - 230,000
Flexible hours
Lunch/dinner provided
Unlimited snacks
+4