Senior Spark & Data Platform Support Engineer

Triwill Group; Australia; On-site; AUD 150,000 - 230,000; Full time

Job summary

Databricks seeks a Senior Designated Engineer to partner with Field and Engineering teams, delivering high-touch support and tailored technical solutions for top Digital Native Business customers. You will triage complex product issues, leveraging Spark and data tech to unblock critical challenges.

You will build rapid POCs, deploy and monitor solutions, and develop playbooks while training customer teams on performance tuning and best practices.

Qualifications

• 5–8 years designing and building distributed computing apps.
• 4+ years delivering production Spark/ML/AI solutions (Python/Java/Scala).
• Hands-on with Data Lakes, SQL databases, and cloud data warehousing/ETL tools.

Responsibilities

• Perform advanced troubleshooting and root cause analysis for Spark, SQL, Delta, and Databricks runtime issues.
• Develop playbooks and a knowledge base for Spark, ML, and AI workflows.
• Train customer teams on performance tuning, debugging, and best practices.

Skills

Spark expertise

Big Data

Troubleshooting

Customer-facing

Python/Java/Scala

Tools

Spark UI

Delta/Iceberg

DAGs

Mosaic AI

Job description

Databricks seeks a Senior Designated Engineer to partner with Field and Engineering teams, delivering high-touch support and tailored technical solutions for top Digital Native Business customers. You will triage complex product issues, leveraging Spark and data tech to unblock critical challenges.

You will build rapid POCs, deploy and monitor solutions, and develop playbooks while training customer teams on performance tuning and best practices.