Databricks Data Engineering Manager

Accenture Infrastructure and Capital Projects, LLC; Auckland; Hybrid; NZD 150,000 - 210,000; Full time

Benefits offered by this job

Parental leave

Career development

Global opportunities

Flexible work

Diversity & Inclusion

Job summary

Accenture is seeking a Data & AI Platform Engineering lead to join our Databricks practice in ANZ. You’ll design, modernize, and accelerate data journeys with proven assets and scalable architectures across cloud platforms.

Lead cross-functional teams, collaborate with clients and SMEs, own delivery, and drive governance, CI/CD, and GenAI integrations to deliver outcomes.

Qualifications

• Experience leading large data engineering teams.
• Expertise with Databricks Lakehouse, Delta Lake and Unity Catalog.
• Strong Python, PySpark and SQL skills, incl. streaming pipelines.

Responsibilities

• Lead end-to-end Databricks solutions for clients.
• Architect scalable, secure data platforms across cloud environments.
• Own project delivery, stakeholder communication and issue resolution.
• Enforce data governance, observability and CI/CD practices.

Skills

Databricks

PySpark

SQL

Python

Delta Lake

Unity Catalog

CI/CD

DevOps

Cloud platforms

Data governance

Tools

Spark Declarative Pipelines

Declarative Automation Bundles

Job description

About Accenture

Accenture is a global professional services company with leading capabilities in digital, cloud and security. Find out more about us at www.accenture.com.

Job Description

Join Accenture's Data & AI practice and help build the next generation of AI‑ready data platforms on Databricks. We're investing heavily to lead in GenAI, Data & AI, and we bring that momentum to real client outcomes across ANZ.

As Accenture, we are Databricks' largest partner and have earned Global GSI Partner of the Year recognition 7 years in a row (2019–2025) and APJ Industry Leader Partner of the Year 2025.

You’ll work alongside one of the largest certified Databricks teams in ANZ, supported by a strong local bench and global delivery scale - designing, modernizing, and accelerating data journeys with proven assets and accelerators that move clients faster from strategy to implementation.

Key Responsibilities

• Lead and mentor cross-functional data engineering teams to deliver end-to-end Databricks solutions.

• Collaborate with clients and SMEs to architect scalable, secure, and efficient data platforms.

• Own project delivery, stakeholder communication, and issue resolution across cloud data engagements.

• Enforce best practices around data governance, observability, and CI/CD pipelines.

• Drive innovation by evaluating emerging data technologies and promoting continuous learning.

Key Skills

Databricks & Lakehouse Expertise

Expertise across Databricks Lakehouse Platform:

• Delta Lake & Delta Live Tables (DLT)

• Unity Catalog (governance, lineage, data sharing)

• Workflows & orchestration

• SQL Warehouses & AI/BI Genie capabilities

• AgentBricks for agentic AI orchestration

Data + AI Platform Engineering

• Experience with GenAI on Databricks: Model Serving, Vector Search, and LLM integration patterns.

• Strong understanding of data product architectures, semantic layers, and domain-oriented data design.

Engineering Excellence

• Advanced proficiency in Python, PySpark, and SQL for large-scale data processing.

• Strong experience in streaming (Structured Streaming), batch pipelines, and performance optimisation.

• Hands‑on with CI/CD, DevOps, and Lakehouse‑native deployment frameworks (e.g. Spark Declarative Pipelines and Declarative Automation Bundles).

Cloud & Ecosystem

• Deep experience across cloud platforms (AWS, Azure, or GCP) and integration with enterprise data ecosystems.

• Familiarity with event‑driven architectures, APIs, and Microservices integration.

Leadership & Consulting

• Proven ability to lead large, distributed teams and deliver complex, multi‑workstream programs.

• Strong stakeholder management with C‑level engagement and strategic advisory capability.

• Experience in driving business outcomes through data and AI transformation programs.

Benefits of working at Accenture:

• 18 weeks paid parental leave
• Long & short‑term career break opportunities
• Structured career development program
• Local and international career opportunities.
• Certified as a Family Inclusive Workplace™
• Flexible Work Arrangements - centered around Accenture's Truly Human ethos and our commitment to supporting the health and wellbeing of our people.
• We are proud to be in the top 3 of last year's Diversity & Inclusion Index!

All our consulting professionals receive comprehensive training covering business acumen, technical and professional skills development. You'll also have opportunities to hone your functional skills and expertise in an area of specialization. We offer a variety of formal and informal training programs at every level to help you acquire and build specialized skills faster. Learning takes place both on the job and through formal training conducted online, in the classroom, or in collaboration with teammates. The sheer variety of work we do, and the experience it offers, provide an unbeatable platform from which to build a career.

Accenture is a an EEO and Affluent Action Employee of Females/Minorities/Veterans/Individuals with Disabilities.

Equal Employment Opportunity Statementfor Australia:

At Accenture, we recognise that our people are multi-dimensional, and we create a work environment where all people feel like they can bring their authentic selves to work, every day.

Our unwavering commitment to inclusion and diversity unleashes innovation and creates a culture where everyone feels they have equal opportunity. Our range of progressive policies support flexibility in 'where', 'when' and 'how' our people work to ensure that Accenture is an organisation where you can strive for more, achieve great things and maintain the balance and wellbeing you need.

We encourage applications from all people, and we are committed to removing barriers to the recruitment process and employee lifecycle. All employment decisions shall be made without regard to age, disability status, ethnicity, gender, gender identity or expression, religion or sexual orientation and we do not tolerate discrimination. If you require adjustments to the recruitment process or have a preferred communication method, please email [e-mail] and cite the relevant Job Number, or contact us on [phone].

To ensure our workplace is inclusive and diverse we are setting bold goals and taking comprehensive action. To achieve these goals, we collect information that allows us to track the effectiveness of our Inclusion and Diversity programs. Learn how Accenture protects your personal data and know your rights in relation to your personal data. Read more about our Privacy Statement.

About Accenture

Accenture is a leading global professional services company that helps the world’s leading businesses, governments and other organizations build their digital core, optimize their operations, accelerate revenue growth and enhance citizen services—creating tangible value at speed and scale. We are a talent- and innovation-led company with approximately 791,000 people serving clients in more than 120 countries. Technology is at the core of change today, and we are one of the world’s leaders in helping drive that change, with strong ecosystem relationships. We combine our strength in technology and leadership in cloud, data and AI with unmatched industry experience, functional expertise and global delivery capability. Our broad range of services, solutions and assets across Strategy & Consulting, Technology, Operations, Industry X and Song, together with our culture of shared success and commitment to creating 360° value, enable us to help our clients reinvent and build trusted, lasting relationships. We measure our success by the 360° value we create for our clients, each other, our shareholders, partners and communities.

Visit us at www.accenture.com

Equal Employment Opportunity Statement for New Zealand:

At Accenture, our intention is to foster a culture and a workplace in which all of our people feel a sense of belonging and are respected and empowered to do their best work.

As part of our talent strategy, we hire and develop people who have different backgrounds, different perspectives and different lived experiences. These differences ensure that we have and attract the cognitive diversity to deliver a variety of perspectives, observations and insights which are essential to drive the innovation needed to reinvent, and we hold our leaders accountable for ensuring we have the most innovative and talented people in our industry.

We encourage applications from all people, and we are committed to removing barriers to the recruitment process and employee lifecycle. All employment decisions shall be made without regard to age, disability status, ethnicity, gender, gender identity or expression, religion or sexual orientation and we do not tolerate discrimination. If you require adjustments to the recruitment process or have a preferred communication method, please email [e-mail] and cite the relevant Job Number, or contact us on [phone].

Learn how Accenture protects your personal data and know your rights in relation to your personal data. Read more about our Privacy Statement.