Senior Data Engineer – Databricks / AWS

Otic Group; City of Melbourne; On-site; AUD 150,000 - 190,000; Full time

Job summary

Otic Group, a wholly Australian company, seeks a Senior Data Engineer to design, build, and deploy enterprise data platforms and pipelines in cloud environments. The role emphasizes hands-on delivery with Databricks, Spark, PySpark, and Terraform, in a Melbourne-based team.

You will translate business and technical requirements into scalable data solutions, collaborate with stakeholders, and contribute to automated CI/CD pipelines. Local presence in Melbourne is preferred.

Qualifications

• 7+ years of data engineering experience in large enterprise environments.
• Strong hands-on delivery of Databricks data platforms and pipelines.
• Experience with cloud data architectures and modern data stacks.

Skills

Databricks

Python

PySpark

AWS

ETL pipelines

Apache Spark

dbt

Terraform

CI/CD

GitHub Actions

Data lake patterns

Data warehouse

Git

Testing

Stakeholder comms

Tools

GitHub Actions

Job description

“Otic” means smart people doing smart work, together.

We are a wholly owned Australian company committed to helping our clients design and build intelligent software solutions that unlock value in their business.

Otic Group was formed to provide talented technology professionals an opportunity to work with not only some of the most prominent companies in Australia, but work with incredibly talented peers in an exciting, dynamic young environment.

We are seeking a Senior Data Engineer with strong hands‑on experience designing, building and deploying enterprise data platforms and pipelines within cloud environments.

Key Skills And Experience Required

• Strong commercial experience with Databricks, including development of scalable data architectures and data pipelines.
• Advanced Python and PySpark development skills.
• Strong AWS cloud experience supporting data engineering solutions.
• Experience building and maintaining ETL/data pipelines using technologies such as Apache Spark and dbt.
• Strong Terraform / Infrastructure as Code experience, ideally provisioning and managing Databricks environments.
• Experience implementing automated CI/CD pipelines, preferably using GitHub Actions or similar tooling.
• Strong understanding of modern data lake, data warehouse and cloud data architecture patterns.
• Experience processing and transforming large-scale datasets.
• Strong software engineering practices including Git, testing, deployment automation and code quality.
• Ability to translate business and technical requirements into practical, scalable data solutions.
• Strong stakeholder communication skills and the ability to operate independently in a complex enterprise environment.
• Ideally 7+ years of data engineering experience with recent hands‑on delivery in large enterprise environments.

Over and above having these technical skills, you will also have a strong passion and flair for creating professional prototypes and dashboards.

Being a Melbourne based organisation, we’re looking for our team to be based locally. We also require applicants to hold an Australian Citizenship, Permanent Residency (PR), or have other permanent work rights.