Senior Data&AI Engineer - Databricks

Mantel; City of Melbourne; Hybrid; AUD 140,000 - 190,000; Full time

Benefits offered by this job

Flexible hybrid work

My Deal personal development plan

Family Inclusive Workplace

Mantel AI Gateway access

Job summary

Mantel, an Australian-owned IT Professional Services consultancy, seeks a Senior Data & AI Engineer to design and scale enterprise data solutions. You will build data architectures on Databricks across AWS/Azure/GCP, develop Spark-based pipelines, and productionise AI models feeding live and batch inferencing apps.

You will lead technical work, mentor teammates and collaborate with clients and Mantel leadership to deliver high-value data initiatives with a focus on Lakehouse architectures and

Qualifications

• Experience with Databricks and cloud ecosystems (AWS/Azure/GCP).
• Proven ability to design and build production-grade data pipelines.
• Hands-on with Spark-based processing and Lakehouse architectures.
• Strong SQL and Python (PySpark) or Scala skills.
• Experience delivering data engagements to senior stakeholders.

Responsibilities

• Work on complex data solutions meeting/exceeding client expectations.
• Build and deploy modern data architectures on Databricks in cloud environments.
• Develop ETL/ELT data pipelines with Spark, Delta Lake, and dbt.
• Productionise AI data pipelines for batch/real-time inference.
• Lead small teams or act as senior technical lead on projects.
• Collaborate with project leadership to manage scope, risks and dependencies.
• Mentor team members and share knowledge.

Skills

Data engineering breadth

SQL

Python (PySpark)

Scala

Databricks

Cloud platforms (AWS/GCP/Azure)

CI/CD

ML/AI data pipelines

Stakeholder engagement

Team leadership

Tools

Databricks

Spark

Delta Lake

dbt

Unity Catalog

Delta Live Tables

AWS

Azure

GCP

Job description

Mantel is an Australian-owned IT Professional Services consultancy, focused on emerging technology to help advance our clients by leveraging AI, Digital, Cloud, Data & Security technology. We are a fully AI-enabled technology consultancy and the partner that bridges the gap between blue-sky ambition and practical steps to deliver value. Since our inception in November 2017, we have experienced remarkable growth across Australia & New Zealand and are honoured to be recognised as a Great Place to Work for 6 years in a row!

Data Working in data at Mantel means you'll be ahead of the curve. You can align to a particular cloud platform or remain cloud agnostic, specialising in data engineering, machine learning, analytics, or data science. You'll design and scale enterprise-level, fully automated Agentic AI solutions, and speed up data platform migrations.

Location: Melbourne, Sydney, Brisbane, Perth

As a Senior Data&AI Engineer you will:

• Work on complex data solutions that meet and exceed client expectations.
• Build and deploy modern data architectures (Medallion/Lakehouse) primarily on Databricks, utilizing cloud platforms like AWS, Azure, or GCP.
• Develop complex code-based ETL/ELT data pipelines with performance-optimized data modeling using Spark, Delta Lake, and dbt.
• Work on Big Data processing - handling PII, data formatting & wrangling, data preparation.
• Apply best practices in coding, monitoring and alerting, using CI/CD, IaC and cloud architectures.
• Productionise AI models by building and monitoring the high-performance data pipelines that feed batch or real-time data into live, inferencing applications (e.g., using MLflow)
• Be a technical expert in at least one data engineering area, while adopting new technologies along the way.
• At times, successfully lead small teams, operate as the most senior technical person on a project and/or work collaboratively in larger teams of people with varying levels of experience.
• Work with project leadership to define scope, align on expectations, manage dependencies, elevate and mitigate risks, and seek timely support.
• Help identify potential opportunities within projects and client relationships.
• Participating in events to raise awareness of Mantel’s Data capability and building relationships in the community.
• Helping to train, coach and mentor others within the team through on-the-job teaching, tutorials, hands-on training, presentations and other similar activities.

You will thrive in this role if you have:

• Expertise in a broad range of data engineering approaches, Lakehouse architecture and Spark-based processing.
• Proficiency in data languages: SQL and Python (PySpark) or Scala; having a deep understanding of the Spark engine is a significant plus.
• Demonstrable experience building and deploying data engineering pipelines into production, including using automation best practices for CI/CD.
• Hands-on experience with Databricks (Workflows, Unity Catalog, Delta Live Tables) and modern cloud ecosystems (AWS/GCP/Azure).
• Previously worked on medium to large scale data engineering projects in enterprise environments
• Experience delivering engagements for clients and the ability to engage with senior level stakeholders
• Previous commercial data experience, ideally across different industries and organisations
• Can collaborate effectively, not just with your immediate team, but with other people in both Mantel and our clients
• You take ownership, always stepping up to help and prioritising your teammates. You're also a clear, kind communicator who makes sound decisions based on good judgement.
• At Mantel, we want you to be yourself. We trust our team members to use their professional judgment while treating colleagues and clients with respect, compassion, and professionalism in alignment with our five principles.

At Mantel, we value curiosity and a growth mindset just as much as technical skill—so if you’re excited about this role but don’t tick every single box, we’d still love to hear from you.

What you can expect from us:

• You’ll get all the tools you need to hit the ground running including a new phone, laptop & swag.
• We believe in unique experiences for all. Our My Deal program allows you to tailor your yearly plan, with the support of your Leader, to decide on what’s most important to you. That might be extra professional development, extra annual leave, time to work on your side hustle, or something else completely different! One size does not fit all.
• Mantel is a certified Family Inclusive Workplace, which means we are committed to improving your wellbeing at work through leading practices on flexible work, parental leave, family care and family wellbeing.
• You’ll be genuinely supported by an organisation that cares about not only you but your family as well, Mantel offers Flexible Personal Leave options for those unplanned moments in life.
• We support a flexible hybrid approach to working which is guided by our principles; we trust each other to “make good choices” about the best workplace locations for the requirements of the project, role and client. This can change based on our client needs.
• A true investment in your AI-first career. We are a fully AI-enabled consultancy and provide you with the tools to lead. This includes access to the Mantel AI Gateway, our secure, centralised platform with multiple AI models, plus a dedicated monthly budget and a safe environment to experiment and innovate.
• We know you won’t have one job for life. At Mantel, we believe in supporting our team to take their career in a direction that aligns with their passions. We have internal opportunities across Cloud, Data, Digital, Delivery & Security.
• Our elite partnerships are a direct result of our deep platform mastery. For you, this means you'll be working alongside teams with the highest levels of technical expertise and tackling the most complex, high-profile projects on the market. Check out our partner awards and recognitions here.

We hire smart and talented people and get out of their way. As a principle-based organisation, we have a flat structure with no hierarchy. By focusing on our five principles and not getting caught up in red tape, we trust you to get the job done!