Senior Data Systems Engineer: Lakehouse & Performance

Databricks; California (MO); On-site; USD 166,000 - 225,000; Full time

Job summary

Databricks seeks an experienced engineer to design next-gen query engines and storage systems, advancing Spark-based workloads from ETL to ML/AI. You’ll tackle compilation, distribution, and vectorized execution while ensuring data security and efficient resource management.

Ideal candidates bring 5+ years in related systems, a passion for performance, and a track record of delivering multi-year vision with incremental milestones, driving customer value and impact.

Qualifications

• Passion for database/storage/distributed systems or performance optimization.
• 5+ years of experience in a related system (preferred).
• Experience working toward a multi-year vision with incremental deliverables.
• Motivated by delivering customer value and impact.

Responsibilities

• Query compilation and optimization.
• Distributed query execution and scheduling.
• Vectorized execution engine.
• Data security.
• Resource management.
• Transaction coordination.
• Efficient storage structures (encodings, indexes).
• Automatic physical data optimization.

Skills

Database systems

Distributed systems

Query optimization

Performance tuning

Big data tooling

Education

PhD in databases or distributed systems

Job description

Databricks seeks an experienced engineer to design next-gen query engines and storage systems, advancing Spark-based workloads from ETL to ML/AI. You’ll tackle compilation, distribution, and vectorized execution while ensuring data security and efficient resource management.

Ideal candidates bring 5+ years in related systems, a passion for performance, and a track record of delivering multi-year vision with incremental milestones, driving customer value and impact.