Senior Data Engineer: Databricks & AWS Pipelines

Otic Group; City of Melbourne; On-site; AUD 150,000 - 190,000; Full time

Job summary

Otic Group in Melbourne is seeking a Senior Data Engineer to design, build and deploy enterprise data platforms and pipelines within cloud environments. Strong hands-on experience with Databricks, Python, PySpark and AWS is essential to deliver scalable data solutions.

The role requires experience building ETL pipelines with Spark and dbt, plus IaC with Terraform and CI/CD using GitHub Actions or similar tooling. Melbourne-based, permanent work rights required for local operations.

Qualifications

• 7+ years data engineering experience in large enterprises.
• Proven delivery of data platforms and pipelines.
• Strong stakeholder communication and independence.

Responsibilities

• Design, build and deploy enterprise data platforms and pipelines in cloud environments.
• Develop scalable data pipelines using Apache Spark and dbt.
• Implement CI/CD and IaC practices with GitHub Actions and Terraform.

Skills

Databricks

Python

PySpark

AWS

ETL pipelines

CI/CD

Terraform

Git

Data lakes

Data warehousing

Stakeholder comms

7+ yrs exp

Tools

Databricks

Apache Spark

dbt

Terraform

GitHub Actions

Job description

Otic Group in Melbourne is seeking a Senior Data Engineer to design, build and deploy enterprise data platforms and pipelines within cloud environments. Strong hands-on experience with Databricks, Python, PySpark and AWS is essential to deliver scalable data solutions.

The role requires experience building ETL pipelines with Spark and dbt, plus IaC with Terraform and CI/CD using GitHub Actions or similar tooling. Melbourne-based, permanent work rights required for local operations.