Senior Backend Architect for Enterprise AI Platforms

Cacheflow; San Francisco (CA); On-site; USD 164,200 - 225,700; Full time

Job summary

Databricks is hiring for a senior backend architect to design and scale the enterprise Agentic Framework. You will help build a multi-tenant platform across domains and ensure robust, observable, and secure backend systems.

Lead cross-functional initiatives with Product and Platform Engineering, mentor engineers, and raise the bar on code quality and performance. This is an on-site role based in San Francisco, offering a competitive compensation package.

Qualifications

• BS or higher in Computer Science or related field.
• Extensive backend development experience designing, building, and maintaining high-throughput production systems.
• Proven success deploying enterprise-grade backend infrastructure, microservices, and robust APIs in highly complex environments.
• Deep familiarity with distributed systems, data platforms, and handling large-scale internal or external traffic.
• Hands-on experience with ML-assisted backend systems, LLM orchestration frameworks, state machines, or agentic automation.
• Strong understanding of multi-cloud environments (AWS, Azure, GCP) alongside enterprise compliance, data privacy, and security constraints.

Responsibilities

• Architect the Agentic Ecosystem: contribute to the technical vision, core infrastructure, and backend architecture for Databricks’ next-generation Enterprise Agentic Framework.
• Scale across domains: build a vertical modular, multi-tenant agent platform initially for Customer Support and expand to IT, Security, Compliance, Marketing, HR, Legal and ticket workflows.
• Engineer reliability: drive rapid, iterative backend development while upholding quality, safety, throughput, and reliability standards for agentic-based systems.
• Orchestrate complex workflows: design state-machine and agentic workflows evolving from human-in-the-loop to full automation.
• Enterprise-grade observability: implement robust backend tracing, logging, transparency, and safe execution including instant rollback mechanisms.
• Cross-functional leadership: liaison between CXI, Product, Platform Engineering, and stakeholders to unblock dependencies and align roadmaps.
• Raise the bar: set a high engineering bar for backend code quality, system performance, and architectural maintainability.
• Mentor and cultivate: mentor engineers and SMEs across Software, Support, and internal operations teams.

Skills

Backend development

Distributed systems

ML-assisted backend

LLM orchestration

Multi-cloud (AWS, Azure, GCP)

API design

Education

BS in Computer Science or related field

Job description

Databricks is hiring for a senior backend architect to design and scale the enterprise Agentic Framework. You will help build a multi-tenant platform across domains and ensure robust, observable, and secure backend systems.

Lead cross-functional initiatives with Product and Platform Engineering, mentor engineers, and raise the bar on code quality and performance. This is an on-site role based in San Francisco, offering a competitive compensation package.