Staff Designated Engineer: Spark & Data Platform Expert

Triwill Group; Australia; On-site; AUD 180,000 - 240,000; Full time

Job summary

Databricks is seeking a Staff Designated Engineer to partner with Field and Engineering teams, delivering tailored technical solutions for Databricks' largest customers in the DNB segment. Leverage Spark and data technologies to triage and resolve complex issues and unblock critical challenges for customer environments.

You will collaborate with R&D, NOC, and cross-functional teams, build rapid POCs, write playbooks, and train customer engineers on performance tuning and best practices.

Qualifications

• 10+ years in designing and troubleshooting distributed applications.
• 4+ years delivering production Spark/ML/AI solutions using Python, Java, or Scala.
• Hands-on expertise with Data Lakes, SQL-based databases, and cloud data warehousing/ETL tools like Snowflake, Redshift, BigQuery.
• Strong communication and ability to work with senior leadership so complex issues are understood.

Responsibilities

• Perform advanced troubleshooting and root-cause analysis for Spark, SQL, Delta, and Databricks runtime.
• Collaborate with R&D and NOC teams to optimise customer environments for monitoring.
• Build rapid POCs and monitor deployments addressing customer challenges.
• Develop playbooks and knowledge base for Spark, ML, and AI workflows.
• Train customer teams on performance tuning, debugging, and best practices.
• Pilot new processes and drive cross-functional improvements.
• Advocate for customers in business reviews as the technical lead contact.
• Collaborate onsite with Field Engineering, Sales, and Product during engagements.

Skills

Spark

Big Data

Python/Java/Scala

Troubleshooting & RCA

Customer-facing

Cross-functional collaboration

CI/CD

Cloud platforms (AWS/Azure/GCP)

Tools

Snowflake

Redshift

BigQuery

Spark UI

Mosaic AI Model Service

Job description

Databricks is seeking a Staff Designated Engineer to partner with Field and Engineering teams, delivering tailored technical solutions for Databricks' largest customers in the DNB segment. Leverage Spark and data technologies to triage and resolve complex issues and unblock critical challenges for customer environments.

You will collaborate with R&D, NOC, and cross-functional teams, build rapid POCs, write playbooks, and train customer engineers on performance tuning and best practices.