Staff Backend Engineer: Scale Data & AI Platform

Databricks; California (MO); On-site; USD 192,000 - 260,000; Full time

Job summary

Databricks is seeking a backend-focused software engineer to design, implement, test, and operate micro-services for the Databricks platform. You will work with Scala/Java, build data pipelines with Spark and Kafka, and integrate with cloud APIs across AWS, Azure, and GCP.

Join teams like Data Science and Machine Learning Infrastructure, Compute Fabric, and Data Plane Storage to deliver scalable, secure software for a global SaaS platform. Experience with distributed systems and SOA is essential.

Qualifications

• BS/MS/PhD in CS or related field.
• 10+ years of production level experience in one of: Java, Scala, C++, or similar language.
• Experience with large-scale distributed systems.
• Experience with SaaS platforms and Service-Oriented Architectures.
• Strong knowledge of SQL and data security practices.

Responsibilities

• Build and operate micro-services for the Databricks platform.
• Design, implement, test, and maintain backend services in Scala/Java.
• Develop data pipelines using Spark and Kafka.
• Integrate with cloud APIs (AWS, Azure, GCP) and third-party apps.

Skills

Java

Scala

C++

Distributed systems

Cloud platforms

Education

BS/MS/PhD in Computer Science, or a related field

Tools

Docker

Kubernetes

Apache Spark

Apache Kafka

Terraform

AWS

Job description

Databricks is seeking a backend-focused software engineer to design, implement, test, and operate micro-services for the Databricks platform. You will work with Scala/Java, build data pipelines with Spark and Kafka, and integrate with cloud APIs across AWS, Azure, and GCP.

Join teams like Data Science and Machine Learning Infrastructure, Compute Fabric, and Data Plane Storage to deliver scalable, secure software for a global SaaS platform. Experience with distributed systems and SOA is essential.