Senior Spark & Data Platform Engineer

Databricks; New South Wales; On-site; AUD 180,000 - 240,000; Full time

Job summary

Databricks is seeking a Staff Designated Engineer to partner with Field and Engineering teams, delivering high-touch support and tailored technical solutions for the largest customers in the Digital Native Business (DNB) segment.

In this customer-facing role, you will leverage your technical expertise in Apache Spark and other data technologies to triage and resolve complex product issues and unblock our customers’ most critical technical challenges.

Qualifications

• 10+ years designing, building, and troubleshooting distributed computing apps.
• 4+ years delivering production-scale Spark/ML/AI solutions using Python, Java, or Scala.
• Hands-on data engineering with data lakes and SQL-based databases.
• Experience with Snowflake, Redshift, or BigQuery.
• Cloud platforms and CI/CD, with monitoring and alerting.

Responsibilities

• Triage and resolve complex Spark/SQL/Delta issues for strategic customers.
• Develop playbooks and knowledge base for Spark, ML, AI workflows.
• Train customers on performance tuning, debugging, and Databricks features.
• Collaborate with Field Eng, Sales and Product to provide rapid production solutions.
• Partner with R&D and NOC to optimize customer environments.

Skills

Big Data Spark

Spark ML AI prod

Customer-facing

Cloud CI/CD

Cross-functional

Data Lakes/SQL

Tools

Snowflake

Redshift

BigQuery

Spark UI

CI/CD

AWS

Azure

GCP

Job description

Databricks is seeking a Staff Designated Engineer to partner with Field and Engineering teams, delivering high-touch support and tailored technical solutions for the largest customers in the Digital Native Business (DNB) segment.

In this customer-facing role, you will leverage your technical expertise in Apache Spark and other data technologies to triage and resolve complex product issues and unblock our customers’ most critical technical challenges.