Senior Backend Platform Engineer – Build Our Foundation

Harvey AI; San Francisco (CA); On-site; USD 231,000 - 340,000; Full time

Job summary

Harvey AI is seeking a Backend Platform Engineer to build and operate a cohesive backend platform used by all services. You will design shared frameworks, APIs, and versioned interfaces that enable product teams to ship fast with reliability and observability.

You’ll work on asynchronous patterns, data governance, and prompt lifecycle for GenAI-native applications, while collaborating across DevEx, Infrastructure, and product teams to implement a robust paved road for engineers.

Qualifications

• 8+ years of software engineering, building scalable backend systems.
• Proficiency in Python and backend fundamentals (APIs, data stores, concurrency).
• Hands-on experience with Flask or FastAPI and microservices architectures.
• Familiarity with Redis, Kafka, SQL/NoSQL, and vector databases.
• Track record of writing well-tested code and using CI to improve reliability.
• Strong collaboration and communication, with a passion for developer experience.

Responsibilities

• Develop and maintain internal backend frameworks and libraries.
• Create APIs, service templates, and versioned interfaces.
• Champion async I/O and streaming patterns for performance.
• Design domain-specific abstractions for cross-cutting concerns.
• Embed observability with tracing, metrics, and tests.
• Collaborate with Model Infrastructure on GenAI-heavy workloads.
• Work with DevEx and Infra teams to integrate components into CI/CD.
• Partner with product engineers to promote a fast, paved-road approach.

Skills

Backend development

Collaboration & communication

Problem solving

Education

BS/MS in CS or related field

Tools

Flask

FastAPI

Redis

Kafka

SQL/NoSQL databases

Vector databases

Job description

Harvey AI is seeking a Backend Platform Engineer to build and operate a cohesive backend platform used by all services. You will design shared frameworks, APIs, and versioned interfaces that enable product teams to ship fast with reliability and observability.

You’ll work on asynchronous patterns, data governance, and prompt lifecycle for GenAI-native applications, while collaborating across DevEx, Infrastructure, and product teams to implement a robust paved road for engineers.