Hybrid Cloud Data Engineer - Databricks & ELT Pipelines

Indigeco Pty Ltd; Perth; Hybrid; AUD 120,000 - 170,000; Full time

Job summary

Indigeco Pty Ltd is seeking an experienced Cloud Data Engineer for a 6-month contract to design and implement enterprise data pipelines, cloud platforms, and production-ready data solutions. The role is hybrid, with occasional regional meetings outside standard Perth hours.

You will collaborate with Data SMEs, Analysts, Cloud Architects and Developers to deliver scalable pipelines using Databricks Lakehouse, Python/Scala/Java, and CI/CD practices across AWS/Azure/GCP.

Qualifications

• Hands-on Databricks and Lakehouse experience.
• Experience designing and implementing end-to-end production data solutions.
• Experience with cloud platforms (AWS, Azure or Google Cloud) and ETL/ELT pipelines.
• Strong programming capability in Python, Scala or Java.
• Advanced SQL skills and experience with relational databases.

Responsibilities

• Contribute to the design and engineering of end-to-end, production-ready data solutions
• Develop, deploy and maintain scalable cloud data pipelines
• Assist with pipeline architecture and solution design
• Design and implement ETL and ELT processes across multiple data sources
• Support data preparation, transformation, validation and integration activities
• Contribute to data governance decisions covering data quality, sources, standards and tools
• Develop and improve cloud data platforms, engineering practices and automation tools
• Identify technical blockers, delivery risks and opportunities for improvement
• Support data warehousing and Databricks Lakehouse solutions
• Implement infrastructure and workflow automation using Terraform and Apache Airflow
• Apply CI/CD, Git-based version control and automated deployment practices
• Monitor cloud data platforms, analyse logs and troubleshoot performance or pipeline issues
• Participate actively in Agile ceremonies, sprint planning, demonstrations and continuous improvement activities
• Collaborate with regional teams and attend occasional meetings outside standard Perth working hours

Skills

Databricks

Lakehouse

ETL/ELT pipelines

Python

SQL

AWS

Azure

GCP

Airflow

Docker

Kubernetes

CI/CD

Git

NoSQL

Education

Relevant tertiary qualification in information technology, computer science, engineering, data science or a related discipline

Tools

Apache Airflow

Terraform

Job description

Indigeco Pty Ltd is seeking an experienced Cloud Data Engineer for a 6-month contract to design and implement enterprise data pipelines, cloud platforms, and production-ready data solutions. The role is hybrid, with occasional regional meetings outside standard Perth hours.

You will collaborate with Data SMEs, Analysts, Cloud Architects and Developers to deliver scalable pipelines using Databricks Lakehouse, Python/Scala/Java, and CI/CD practices across AWS/Azure/GCP.