Databricks Platform Engineer | AWS Data Pipelines

Accenture Global; Canberra; Hybrid; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Competitive salary package

Flexible work arrangements (remote/hyr

Health insurance

Learning & development opportunities

Job summary

Accenture is seeking a Data Engineer / Databricks Platform Administrator to join our Data & AI team in a hybrid role. You will design and operate a secure, scalable Databricks platform on AWS while delivering data engineering work, governance initiatives, and engineering best practices.

You will build workspaces, manage Unity Catalog, and implement IAM, Terraform IaC, and CI/CD pipelines to support enterprise-grade data solutions across client projects.

Qualifications

• Experience administering Databricks environments.
• Experience implementing Unity Catalog and governance frameworks.
• Experience building production-grade data pipelines.
• Strong Python and SQL development skills.
• Strong AWS experience including VPC, Private Link, IAM, S3, networking and security architecture.
• Infrastructure-as-Code experience using Terraform (preferred) or equivalent.
• Experience implementing CI/CD pipelines for infrastructure and platform deployments.

Responsibilities

• Design, build, and implement Databricks workspaces on AWS from the ground up.
• Configure and manage Unity Catalog, metastores, catalogs, schemas, storage credentials, and access controls.
• Design secure network architectures using AWS VPCs, Private Link, network isolation, and enterprise security best practices.
• Implement and manage IAM roles, instance profiles, and cloud access models.
• Develop and maintain IaC solutions using Terraform or equivalent tooling.
• Establish CI/CD pipelines for platform configuration, deployment, and governance controls.
• Define and enforce cluster policies, workspace standards, and operational guardrails.

Skills

Databricks administration

Unity Catalog

Databricks governance

Production-grade pipelines

Python

SQL

AWS (VPC, Private Link, IAM, S3)

Networking & security

Terraform (IaC)

CI/CD for infra/platform

Tools

Terraform

Job description

Accenture is seeking a Data Engineer / Databricks Platform Administrator to join our Data & AI team in a hybrid role. You will design and operate a secure, scalable Databricks platform on AWS while delivering data engineering work, governance initiatives, and engineering best practices.

You will build workspaces, manage Unity Catalog, and implement IAM, Terraform IaC, and CI/CD pipelines to support enterprise-grade data solutions across client projects.