Senior Data Infrastructure Engineer (Spark & Delta Lake)

Cacheflow; Mountain View (CA); On-site; USD 166,000 - 225,000; Full time

Job summary

Databricks is hiring a Software Engineer for the Runtime team to build the next generation distributed data storage and processing systems. You will work on technologies such as Apache Spark, Delta Lake, and Delta Pipelines to support ETL, data science, and diverse workloads with high performance and reliability.

The role requires 5+ years of production experience in Java, Scala, or C++, a strong foundation in algorithms and data structures, and a passion for delivering customer value.

Qualifications

• BS (or higher) in Computer Science, related technical field or equivalent practical experience.
• Comfortable working towards a multi-year vision with incremental deliverables.
• Motivated by delivering customer value and impact.
• 5+ years of production level experience in either Java, Scala or C++.
• Strong foundation in algorithms and data structures and their real-world use cases.
• Experience with distributed systems, databases, and big data systems (Apache Spark, Hadoop).

Responsibilities

• Build the next generation distributed data storage and processing systems.
• Work on Spark, Delta Lake, and Delta Pipelines components to enable scalable data workflows.

Skills

Java

Scala

C++

Algorithms

Data structures

Education

BS in Computer Science or related field

Tools

Apache Spark

Hadoop

Distributed systems

Job description

Databricks is hiring a Software Engineer for the Runtime team to build the next generation distributed data storage and processing systems. You will work on technologies such as Apache Spark, Delta Lake, and Delta Pipelines to support ETL, data science, and diverse workloads with high performance and reliability.

The role requires 5+ years of production experience in Java, Scala, or C++, a strong foundation in algorithms and data structures, and a passion for delivering customer value.