Databricks Platform Engineer for AI & Data - Hybrid

EY; Sydney; Hybrid; AUD 140,000 - 200,000; Full time

Benefits offered by this job

Flexible work arrangements

Career development

8 weeks flex leave per year

Job summary

EY is hiring a Databricks Platform Engineer to design, build and optimise scalable cloud-based data platforms for analytics, AI and data engineering workloads. You will work with data engineers, architects and stakeholders to deliver secure, high-performing Databricks environments across Azure or AWS.

The role is hybrid and can be based in Naarm–Melbourne, Meanjin–Brisbane or Warrang–Sydney, with flexible options discussed at interview.

Qualifications

• Experience designing and implementing cloud-based data platforms on Azure and/or AWS.
• Hands-on Databricks Data Intelligence Platform experience.
• Proficiency in Databricks, Spark, Delta Lake, Unity Catalog.
• Experience with IAM, permissions, networking, data governance; IaC and DevOps (Terraform, CI/CD, Git workflows).
• Experience implementing platform security, governance and monitoring frameworks.
• Strong problem-solving and analytical abilities with practical issue resolution.
• Excellent communication with technical and non-technical stakeholders.
• Experience delivering in cross-functional teams.

Responsibilities

• Design, build and maintain scalable Databricks platforms across Azure or AWS.
• Configure and manage Databricks workspaces, clusters, jobs, workflows, permissions.
• Support Lakehouse architectures using Databricks, Spark, Delta Lake, Unity Catalog; develop IaC and CI/CD pipelines.
• Implement platform security, access controls, governance and monitoring.
• Collaborate with data engineers, AI engineers, and architects on platform patterns.
• Troubleshoot Databricks, Spark and cloud service issues; improve reliability.
• Document platform designs, configurations and standards.
• Support and guide team members in delivery planning and direction.

Skills

Azure

AWS

Databricks

Apache Spark

Delta Lake

Unity Catalog

Terraform

CI/CD

Git workflows

Tools

Databricks Workspace

Databricks Compute

Job description

EY is hiring a Databricks Platform Engineer to design, build and optimise scalable cloud-based data platforms for analytics, AI and data engineering workloads. You will work with data engineers, architects and stakeholders to deliver secure, high-performing Databricks environments across Azure or AWS.

The role is hybrid and can be based in Naarm–Melbourne, Meanjin–Brisbane or Warrang–Sydney, with flexible options discussed at interview.