Data Engineer / Databricks Platform Administrator

Accenture Global; Melbourne; Hybrid; AUD 140,000 - 190,000; Full time

Benefits offered by this job

Competitive salary

Flexible work arrangements

Learning & development opportunities

Career growth pathways

Health insurance and wellness support

Generous leave & parental leave

Job summary

Accenture Global is seeking a Data Engineer / Databricks Platform Administrator to design and operate a secure, scalable Databricks platform on AWS in a hybrid role. You will deliver data pipelines, governance programs, and platform best practices while enabling production-grade analytics for global clients.

You will configure Unity Catalog, manage metastores, and implement enterprise security, IAM, and CI/CD for infrastructure and platform deployments.

Qualifications

• Strong hands-on Databricks administration experience.
• Experience implementing Unity Catalog and governance frameworks.
• Experience building production-grade data pipelines.
• Strong Python and SQL development skills.
• Strong AWS experience including VPC, Private Link, IAM, S3 networking and security architecture.
• IaC experience using Terraform or equivalent tooling.
• Experience implementing CI/CD pipelines for infrastructure and platform deployments.

Responsibilities

• Design, build, and implement Databricks workspaces on AWS from the ground up.
• Configure and manage Unity Catalog, metastores, catalogs, schemas, storage credentials, and access controls.
• Design secure network architectures using AWS VPCs, Private Link, network isolation, and enterprise security best practices.
• Implement and manage IAM roles, instance profiles, and cloud access models.
• Develop and maintain Infrastructure-as-Code solutions using Terraform or equivalent tooling.
• Establish CI/CD pipelines for platform configuration, deployment, and governance controls.
• Define and enforce cluster policies, workspace standards, and operational guardrails.

Skills

Databricks administration

Python development

SQL development

AWS experience

Security & governance awareness

Tools

Terraform

CI/CD pipelines

Unity Catalog

Databricks platform

Private Link

IAM & S3 networking

Job description

We are seeking a highly skilled Data Engineer / Databricks Platform Administrator to join our Data & AI team. This hybrid role combines Databricks platform engineering and administration with hands-on data engineering delivery responsibilities. You will play a key role in establishing and operating a secure, scalable, enterprise-grade Databricks platform on AWS while also contributing to data pipeline development, governance initiatives, and engineering best practices.

Key Responsibilities

• Design, build, and implement Databricks workspaces on AWS from the ground up.
• Configure and manage Unity Catalog, metastores, catalogs, schemas, storage credentials, and access controls.
• Design secure network architectures using AWS VPCs, Private Link, network isolation, and enterprise security best practices.
• Implement and manage IAM roles, instance profiles, and cloud access models.
• Develop and maintain Infrastructure-as-Code solutions using Terraform or equivalent tooling.
• Establish CI/CD pipelines for platform configuration, deployment, and governance controls.
• Define and enforce cluster policies, workspace standards, and operational guardrails.

Required Skills & Experience

• Strong hands-on experience administering Databricks environments.
• Experience implementing and managing Unity Catalog and Databricks governance frameworks.
• Experience building and supporting production-grade data pipelines.
• Strong Python and SQL development skills.
• Strong AWS experience including: VPC Private Link IAM S3 Networking and security architecture
• Strong Infrastructure-as-Code experience using Terraform (preferred) or equivalent tools.
• Experience implementing CI/CD pipelines for infrastructure and platform deployments.

Additional Requirements:

Security Clearance Requirement: Given the secure nature of this role, we are seeking candidates who are Australian Citizens with an active security clearance. This requirement ensures that all team members are cleared to handle sensitive information and contribute to maintaining the highest standards of security in our operations.

Why Join Us?

We offer a dynamic, inclusive, and collaborative work environment that values your growth and well-being. As a part of our team, you will enjoy:

• Competitive Salary Package: Attractive remuneration that rewards your expertise.
• Flexible Work Arrangements: Options for remote work, hybrid models, and a strong work-life balance.
• Learning and Development: Access to world-class training programs, certifications, and mentorship opportunities to advance your skills.
• Career Growth: Defined career pathways with opportunities to work on impactful projects for global clients.
• Health and Wellness: Comprehensive health insurance, wellness programs, and mental health support.
• Paid Time Off: Generous leave policies, including parental leave and additional paid holidays.
• Diversity and Inclusion: A commitment to fostering a diverse and inclusive workplace where everyone feels valued and empowered.

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities. Visit us at www.accenture.com

Equal Employment Opportunity Statement for Australia:

At Accenture, our intention is to foster a culture and a workplace in which all of our people feel a sense of belonging and are respected and empowered to do their best work. As part of our talent strategy, we hire and develop people who have different backgrounds, different perspectives and different lived experiences. These differences ensure that we have and attract the cognitive diversity to deliver a variety of perspectives, observations and insights which are essential to drive the innovation needed to reinvent, and we hold our leaders accountable for ensuring we have the most innovative and talented people in our industry. We encourage applications from all people, and we are committed to removing barriers to the recruitment process and employee lifecycle. All employment decisions shall be made without regard to age, disability status, ethnicity, gender, gender identity or expression, religion or sexual orientation and we do not tolerate discrimination.