Senior Data Engineer – Databricks / AWS

Otic Group; City of Melbourne; On-site; AUD 150,000 - 190,000; Full time

Job summary

Otic Group in Melbourne is seeking a Senior Data Engineer to design, build and deploy enterprise data platforms and pipelines within cloud environments. Strong hands-on experience with Databricks, Python, PySpark and AWS is essential to deliver scalable data solutions.

The role requires experience building ETL pipelines with Spark and dbt, plus IaC with Terraform and CI/CD using GitHub Actions or similar tooling. Melbourne-based, permanent work rights required for local operations.

Qualifications

• 7+ years data engineering experience in large enterprises.
• Proven delivery of data platforms and pipelines.
• Strong stakeholder communication and independence.

Responsibilities

• Design, build and deploy enterprise data platforms and pipelines in cloud environments.
• Develop scalable data pipelines using Apache Spark and dbt.
• Implement CI/CD and IaC practices with GitHub Actions and Terraform.

Skills

Databricks

Python

PySpark

AWS

ETL pipelines

CI/CD

Terraform

Git

Data lakes

Data warehousing

Stakeholder comms

7+ yrs exp

Tools

Databricks

Apache Spark

dbt

Terraform

GitHub Actions

Job description

“Otic” means smart people doing smart work, together.

We are a wholly owned Australian company committed to helping our clients design and build intelligent software solutions that unlock value in their business.

Otic Group was formed to provide talented technology professionals an opportunity to work with not only some of the most prominent companies in Australia, but work with incredibly talented peers in an exciting, dynamic young environment.

We are seeking a Senior Data Engineer with strong hands-on experience designing, building and deploying enterprise data platforms and pipelines within cloud environments.

Key Skills And Experience Required

• Strong commercial experience with Databricks, including development of scalable data architectures and data pipelines.
• Advanced Python and PySpark development skills.
• Strong AWS cloud experience supporting data engineering solutions.
• Experience building and maintaining ETL/data pipelines using technologies such as Apache Spark and dbt.
• Strong Terraform / Infrastructure as Code experience, ideally provisioning and managing Databricks environments.
• Experience implementing automated CI/CD pipelines, preferably using GitHub Actions or similar tooling.
• Strong understanding of modern data lake, data warehouse and cloud data architecture patterns.
• Experience processing and transforming large-scale datasets.
• Strong software engineering practices including Git, testing, deployment automation and code quality.
• Ability to translate business and technical requirements into practical, scalable data solutions.
• Strong stakeholder communication skills and the ability to operate independently in a complex enterprise environment.
• Ideally 7+ years of data engineering experience with recent hands-on delivery in large enterprise environments.

Over and above having these technical skills, you will also have a strong passion and flair for creating professional prototypes and dashboards.

Being a Melbourne based organisation, we’re looking for our team to be based locally. We also require applicants to hold an Australian Citizenship, Permanent Residency (PR), or have other permanent work rights.