Senior Backend Architect - Enterprise AI Platform

Cohere; New York (NY); Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

Lunch stipend

Health and dental benefits

RRSP matching/401K

Parental leave top-up

Enrichment benefits stipend

Paid vacation 6 weeks

Office travel budget

Home office stipend

Job summary

Cohere, a leading security-first enterprise AI company, is seeking a Senior/Staff Backend Software Engineer to shape the architecture of Model Vault. You will focus on authentication, deployment management, billing, metering, security, and confidential computing to support enterprise-scale models.

The role involves designing APIs, distributed systems, and end-to-end ownership, with a focus on reliability, scalability, and security as Cohere scales to millions of users.

Qualifications

• Strong backend engineer with fundamentals in distributed systems, databases, networking, operating systems, and security.
• Proficient in production systems in Go, Python, Java, C++, Rust, or similar; write clean, maintainable, tested code.
• Experience designing and operating production systems with emphasis on correctness, availability, security, and performance.
• Ability to translate ambiguous problems into robust architectures and drive them to production.
• Understanding of concurrency, caching, queues, rate limiting, and observability.
• Awareness of authentication, authorization, identity, cryptography, secrets, tenant isolation, and security risks.

Responsibilities

• Evolve and scale backend systems powering Model Vault, including authentication, deployment management, billing, metering, and customer lifecycle.
• Lead major architectural initiatives across identity, payments, usage systems, and platform scalability.
• Build reliable control-plane services for provisioning, configuring, scaling, and operating model deployments across clouds and hardware.
• Design APIs and distributed systems with strong guarantees around correctness, consistency, isolation, failure recovery, idempotency, and observability.
• Incorporate security and privacy into platform architecture, including tenant isolation and secrets management.
• Solve complex backend, cloud, security, and AI inference challenges where standard SaaS patterns fall short.
• Drive projects end-to-end from architecture and threat modeling through rollout and production operations.

Skills

Distributed systems

Databases

Networking

Operating systems

Security

Go

Python

Java

C++

Rust

Job description

Cohere, a leading security-first enterprise AI company, is seeking a Senior/Staff Backend Software Engineer to shape the architecture of Model Vault. You will focus on authentication, deployment management, billing, metering, security, and confidential computing to support enterprise-scale models.

The role involves designing APIs, distributed systems, and end-to-end ownership, with a focus on reliability, scalability, and security as Cohere scales to millions of users.