Databricks Platform Engineer, AI and Data, Technology Consulting

EY; City of Melbourne; Hybrid; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Career development

Flexible work

Wellness incentive & flexible leave

Parental leave

Job summary

EY is seeking a Databricks Platform Engineer to design, build and optimise scalable cloud-based data platforms supporting analytics, AI and data engineering workloads. You will lead Databricks environments across Azure or AWS, implement security, governance and automation, and collaborate with engineers, architects and stakeholders to deliver reliable data solutions.

The role is hybrid, based in Naarm-Melbourne, Meanjin-Brisbane or Warrang-Sydney, with options for reduced hours.

Qualifications

• Experience designing and implementing cloud-based data platforms (Azure and/or AWS).
• Hands-on Databricks Data Intelligence Platform experience including workspace configuration, compute management, jobs, workflows, and platform administration.

Responsibilities

• Design, build and maintain scalable Databricks-based data platforms across Azure or AWS.
• Configure and manage Databricks workspaces, clusters, jobs, workflows, permissions and platform services.
• Support Lakehouse architectures using Databricks, Spark, Delta Lake, Unity Catalog; develop infrastructure-as-code and CI/CD pipelines.
• Implement platform security, access controls, governance, monitoring and operational standards.
• Collaborate with data engineers, AI engineers and architects to design platform patterns for ingestion, transformation, storage and consumption.
• Troubleshoot platform issues across Databricks, Spark and cloud services; work with teams to resolve incidents.
• Document platform designs, configuration patterns and operational processes.
• Support and guide team members in delivery planning and technical direction.
• Ideally experience with AI/ML platforms, observability tools, and data visualization tools.

Skills

Cloud platforms (Azure/AWS)

Databricks platform

Spark/Delta Lake/Unity Catalog

Infrastructure as code (Terraform)

CI/CD pipelines

Security & governance

Problem solving

Communication

Tools

Databricks

Apache Spark

Delta Lake

Unity Catalog

Power BI

Tableau

Job description

At EY, we’re all in to shape your future with confidence. We’ll help you succeed in a globally connected powerhouse of diverse teams and take your career wherever you want it to go. Join EY and help to build a better working world.

The opportunity

As a Databricks Platform Engineer, you will design, build and optimise scalable cloud-based data platforms that support advanced analytics, AI and data engineering workloads. Working closely with data engineers, architects, and business stakeholders, you will play a key role in enabling secure, high-performing and reliable Databricks environments that drive business outcomes. You will bring experience across modern cloud ecosystems and the Databricks Data Intelligence Platform, contributing to the design, implementation and operation of enterprise data and AI platforms. Your work will include platform configuration, automation, security, governance, monitoring and performance optimisation, helping teams build and run data workloads with confidence. You will also support team delivery, providing technical leadership and guidance where required.

This is a hybrid position that can be based in Naarm - Melbourne, Meanjin - Brisbane or Warrang - Sydney. Our roles can potentially be adjusted to work flexibly with reduced hours. Please speak with us about potential options.

Your Key Responsibilities

• Design, build and maintain scalable Databricks-based data platforms across Azure or AWS.
• Configure and manage Databricks workspaces, clusters, jobs, workflows, permissions and platform services to support data engineering, analytics and AI use cases.
• Support the implementation of Lakehouse architectures using Databricks, Apache Spark, Delta Lake, Unity Catalog and related cloud-native services. Develop and maintain infrastructure-as-code, CI/CD pipelines and automation to support repeatable, reliable platform delivery.
• Implement platform security, access controls, governance, monitoring and operational standards across cloud and Databricks environments.
• Work with data engineers, AI engineers, and architects to design and implement platform patterns which support ingestion, transformation, orchestration, storage and consumption requirements.
• Troubleshoot platform issues across Databricks, Spark and cloud services, working with technical teams to resolve incidents and improve stability.
• Document platform designs, configuration patterns, operational processes and technical standards.
• Support and guide team members, contributing to delivery planning and technical direction.

Skills And Attributes For Success

• Strong experience designing and implementing cloud-based data platforms (Azure and/or AWS)
• Hands‑on experience working with the Databricks Data Intelligence Platform, including workspace configuration, compute management, jobs, workflows and platform administration activities.
• Proficiency in Databricks, Apache Spark, Delta Lake, Unity Catalog and related data engineering technologies
• Experience supporting secure and governed data platform environments, including identity, access management, permissions, secrets, networking and data governance controls. Knowledge of infrastructure-as-code and DevOps practices (e.g. Terraform, CI/CD pipelines, Git‑based workflows and automated deployment processes).
• Experience implementing platform security, governance and monitoring frameworks.
• Strong problem‑solving and analytical capability, with a practical approach to working through technical issues.
• Excellent communication skills with the ability to engage technical and non-technical stakeholders.
• Experience contributing to or leading delivery within a team environment, including working with engineers, architects and stakeholders to achieve shared outcomes.

Ideally, you’ll have the skills and attributes below, but don’t worry if you don’t tick all the boxes. We’re interested in your aptitude, attitude and willingness to learn.

• Experience with AI/ML platforms, model serving and MLOps practices within Databricks.
• Experience with platform observability, monitoring and optimisation tools.
• Experience working with data visualisation and reporting tools such as Power BI or Tableau.
• Databricks certifications and experience implementing enterprise-scale Lakehouse solutions would be highly regarded.

What We Offer You

At EY, we’ll fuel you and your extraordinary talents in a diverse and inclusive culture of globally connected teams. We’re proud to be recognised as the #1 WORK180 Endorsed Employer in the Top 101 Employers for Women 2026.

• Career development: At EY, your career is yours to shape! We’ll develop you with future-focused skills and equip you with world-class experiences ey.com/au/careerdevelopment
• Flexible work arrangements: Our flexible work policies empower you to balance your professional and personal life, fostering a culture of trust and autonomy.
• A comprehensive benefits package: From a yearly wellness incentive, to access to additional 8 weeks of flex leave per year, and family-friendly policies, including up to 26 weeks of gender-neutral paid parental leave, we cater to your diverse needs to help you thrive both personally and professionally www.ey.com/au/benefits

Acknowledgement of Country

EY acknowledges the Traditional Owners and Custodians of the lands on which EY offices are located around Australia. We pay our respects to their cultures, and to their Elders - past, present, and emerging. Find out more about our vision for reconciliation at ey.com/en_au/careers/indigenous

Inclusiveness is core to who we are and how we work together, driving value for our people and for our business. We encourage applications from people of all ages, nationalities, abilities, cultures, sexual orientations, and gender identities and are committed to providing an equitable and barrier free recruitment experience for all. We encourage you to share any support and adjustments you need to be your best and participate equitably in our recruitment process. We understand sharing your needs with us can be daunting, so if you have questions before or during your application, we welcome you to get in touch at [e-mail] or [phone] (option 2). Anything you tell us will be kept completely confidential.

EY | Building a better working world

Our preferred applicant will be required to undertake employment screening by EY or our external third-party provider.

© 2025 Ernst & Young Australia. A member firm of Ernst & Young Global Limited. All Rights Reserved. Liability limited by a scheme approved under Professional Standards Legislation.