Databricks Platform Engineer - AWS Data Pipelines

8200 Accenture Australia P/L Company; Canberra; Hybrid; AUD 140,000 - 190,000; Full time

Benefits offered by this job

Flexible work arrangements

Learning and development programs

Health insurance

Career growth opportunities

Paid time off

Job summary

8200 Accenture Australia P/L Company is seeking a Data Engineer / Databricks Platform Administrator to join the Data & AI team in a hybrid role. You will design and operate a secure, scalable Databricks platform on AWS while contributing to data pipeline development, governance, and engineering best practices.

You will build Databricks workspaces, manage Unity Catalog and metastores, implement CI/CD, and help define platform standards and security controls to support enterprise data initiatives

Qualifications

• Experience administering Databricks environments and Unity Catalog
• Experience building production data pipelines and governance frameworks
• Strong Python and SQL development skills
• Hands-on AWS experience (VPC, Private Link, IAM, S3) and IaC tooling

Responsibilities

• Design, build, and implement Databricks workspaces on AWS from the ground up
• Configure and manage Unity Catalog, metastores, catalogs, schemas, storage credentials, and access controls
• Design secure network architectures using AWS VPCs, Private Link, network isolation, and enterprise security best practices
• Implement IAM roles, instance profiles, and cloud access models
• Develop and maintain Infrastructure-as-Code solutions using Terraform or equivalent tooling
• Establish CI/CD pipelines for platform configuration, deployment, and governance controls
• Define and enforce cluster policies, workspace standards, and operational guardrails

Skills

Databricks admin

Unity Catalog

Python

SQL

AWS

Terraform

CI/CD

Databricks

Tools

Terraform

Databricks

AWS

Job description

8200 Accenture Australia P/L Company is seeking a Data Engineer / Databricks Platform Administrator to join the Data & AI team in a hybrid role. You will design and operate a secure, scalable Databricks platform on AWS while contributing to data pipeline development, governance, and engineering best practices.

You will build Databricks workspaces, manage Unity Catalog and metastores, implement CI/CD, and help define platform standards and security controls to support enterprise data initiatives