Databricks Platform Engineer for AI & Data - Hybrid

EY; City of Melbourne; Hybrid; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Career development

Flexible work

Wellness incentive & flexible leave

Parental leave

Job summary

EY is seeking a Databricks Platform Engineer to design, build and optimise scalable cloud-based data platforms supporting analytics, AI and data engineering workloads. You will lead Databricks environments across Azure or AWS, implement security, governance and automation, and collaborate with engineers, architects and stakeholders to deliver reliable data solutions.

The role is hybrid, based in Naarm-Melbourne, Meanjin-Brisbane or Warrang-Sydney, with options for reduced hours.

Qualifications

• Experience designing and implementing cloud-based data platforms (Azure and/or AWS).
• Hands-on Databricks Data Intelligence Platform experience including workspace configuration, compute management, jobs, workflows, and platform administration.

Responsibilities

• Design, build and maintain scalable Databricks-based data platforms across Azure or AWS.
• Configure and manage Databricks workspaces, clusters, jobs, workflows, permissions and platform services.
• Support Lakehouse architectures using Databricks, Spark, Delta Lake, Unity Catalog; develop infrastructure-as-code and CI/CD pipelines.
• Implement platform security, access controls, governance, monitoring and operational standards.
• Collaborate with data engineers, AI engineers and architects to design platform patterns for ingestion, transformation, storage and consumption.
• Troubleshoot platform issues across Databricks, Spark and cloud services; work with teams to resolve incidents.
• Document platform designs, configuration patterns and operational processes.
• Support and guide team members in delivery planning and technical direction.
• Ideally experience with AI/ML platforms, observability tools, and data visualization tools.

Skills

Cloud platforms (Azure/AWS)

Databricks platform

Spark/Delta Lake/Unity Catalog

Infrastructure as code (Terraform)

CI/CD pipelines

Security & governance

Problem solving

Communication

Tools

Databricks

Apache Spark

Delta Lake

Unity Catalog

Power BI

Tableau

Job description

EY is seeking a Databricks Platform Engineer to design, build and optimise scalable cloud-based data platforms supporting analytics, AI and data engineering workloads. You will lead Databricks environments across Azure or AWS, implement security, governance and automation, and collaborate with engineers, architects and stakeholders to deliver reliable data solutions.

The role is hybrid, based in Naarm-Melbourne, Meanjin-Brisbane or Warrang-Sydney, with options for reduced hours.