Senior Backend & Platform Engineer, AI Inference

TypeSafe AI; San Francisco (CA); On-site; USD 150,000 - 250,000; Full time

Benefits offered by this job

Equity

Job summary

TypeSafe AI is seeking a Senior Backend Engineer to build and maintain our API platform for AI inference. You will work on latency-sensitive, user-facing APIs with strong uptime and backward compatibility requirements using Python, with TypeScript, Next.js, Tailwind, and Kubernetes in the stack.

You will define APIs, create robust infrastructure across cloud providers, and evolve abstractions for billing and business logic.

Qualifications

• 5+ years of professional software engineering experience (3+ years of infra/backend) with a team with rigorous engineering standards.
• Have shipped backend services at scale with continuous delivery and uptime SLAs of at least 3 9s.
• Have designed and operated a developer-facing API service.
• Have experienced LLMs' capabilities and limitations from implementing them in the past.

Responsibilities

• Define APIs for a new kind of AI inference experience and iterate on the design to ensure they are delightful to use
• Create robust infrastructure for serving inference across multiple cloud providers
• Define abstractions that will serve us moving forward as our billing needs and business logic needs grow
• Work on exposing new model features to users

Skills

Python

Distributed systems

API design

Team collaboration

Tools

TypeScript

Next.js

Tailwind CSS

Kubernetes

Job description

TypeSafe AI is seeking a Senior Backend Engineer to build and maintain our API platform for AI inference. You will work on latency-sensitive, user-facing APIs with strong uptime and backward compatibility requirements using Python, with TypeScript, Next.js, Tailwind, and Kubernetes in the stack.

You will define APIs, create robust infrastructure across cloud providers, and evolve abstractions for billing and business logic.