Data Engineer / Databricks Platform Administrator

Accenture PLC; Melbourne; Hybrid; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Flexible Work Arrangements

Health insurance

Paid Time Off

Learning & Development

Career Growth

Diversity & Inclusion

Job summary

Accenture PLC is seeking a Data Engineer / Databricks Platform Administrator to join our Data & AI team. This hybrid role blends Databricks platform engineering and administration with hands‑on data engineering delivery responsibilities on AWS.

You will design and operate a secure, scalable Databricks environment, implement Unity Catalog governance, build data pipelines, and contribute to best practices across the platform in a global client context.

Qualifications

• Strong hands-on experience administering Databricks environments.
• Experience implementing and managing Unity Catalog and Databricks governance frameworks.
• Experience building and supporting production-grade data pipelines.
• Strong Python and SQL development skills.
• Strong AWS experience including: VPC Private Link IAM S3 Networking and security architecture.
• Strong Infrastructure-as-Code experience using Terraform (preferred) or equivalent tools.
• Experience implementing CI/CD pipelines for infrastructure and platform deployments.

Responsibilities

• Design, build, and implement Databricks workspaces on AWS from the ground up.
• Configure and manage Unity Catalog, metastores, catalogs, schemas, storage credentials, and access controls.
• Design secure network architectures using AWS VPCs, Private Link, network isolation, and enterprise security best practices.
• Implement and manage IAM roles, instance profiles, and cloud access models.
• Develop and maintain Infrastructure-as-Code solutions using Terraform or equivalent tooling.
• Establish CI/CD pipelines for platform configuration, deployment, and governance controls.
• Define and enforce cluster policies, workspace standards, and operational guardrails.

Skills

Databricks administration

Unity Catalog

Python

SQL

AWS

Terraform

CI/CD pipelines

Tools

Databricks

Terraform

Job description

We are seeking a highly skilled Data Engineer / Databricks Platform Administrator to join our Data & AI team. This hybrid role combines Databricks platform engineering and administration with hands‑on data engineering delivery responsibilities.

You will play a key role in establishing and operating a secure, scalable, enterprise‑grade Databricks platform on AWS while also contributing to data pipeline development, governance initiatives, and engineering best practices.

Key Responsibilities

• Design, build, and implement Databricks workspaces on AWS from the ground up.
• Configure and manage Unity Catalog, metastores, catalogs, schemas, storage credentials, and access controls.
• Design secure network architectures using AWS VPCs, Private Link, network isolation, and enterprise security best practices.
• Implement and manage IAM roles, instance profiles, and cloud access models.
• Develop and maintain Infrastructure-as-Code solutions using Terraform or equivalent tooling.
• Establish CI/CD pipelines for platform configuration, deployment, and governance controls.
• Define and enforce cluster policies, workspace standards, and operational guardrails.

Required Skills & Experience

• Strong hands‑on experience administering Databricks environments.
• Experience implementing and managing Unity Catalog and Databricks governance frameworks.
• Experience building and supporting production‑grade data pipelines.
• Strong Python and SQL development skills.
• Strong AWS experience including: VPC Private Link IAM S3 Networking and security architecture
• Strong Infrastructure‑as‑Code experience using Terraform (preferred) or equivalent tools.
• Experience implementing CI/CD pipelines for infrastructure and platform deployments.

Additional Requirements

Security Clearance Requirement: Given the secure nature of this role, we are seeking candidates who are Australian Citizens with an active security clearance.

This requirement ensures that all team members are cleared to handle sensitive information and contribute to maintaining the highest standards of security in our operations.

Why Join Us?

We offer a dynamic, inclusive, and collaborative work environment that values your growth and well‑being. As a part of our team, you will enjoy:

• Competitive Salary Package: Attractive remuneration that rewards your expertise.
• Flexible Work Arrangements: Options for remote work, hybrid models, and a strong work‑life balance.
• Learning and Development: Access to world‑class training programs, certifications, and mentorship opportunities to advance your skills.
• Career Growth: Defined career pathways with opportunities to work on impactful projects for global clients.
• Health and Wellness: Comprehensive health insurance, wellness programs, and mental health support.
• Paid Time Off: Generous leave policies, including parental leave and additional paid holidays.
• Diversity and Inclusion: A commitment to fostering a diverse and inclusive workplace where everyone feels valued and empowered.

#LI-GM