Databricks Data Engineer – Lakehouse & AWS (6mo Contract)

Talent Corp; City of Brisbane; On-site; AUD 218,000 - 232,000; Full time

Job summary

Talent Corp is seeking an experienced Data Engineer in Brisbane to join a cloud and AI-focused data environment. You will design and implement Databricks-based data pipelines and Lakehouse solutions, leveraging AWS, Python, SQL and PySpark to deliver scalable data integrations.

The role requires hands-on Databricks expertise, production experience, and strong collaboration with engineering and analytics teams to improve data quality, governance and performance in a dynamic setting.

Qualifications

• 5+ years' Data Engineering experience.
• Databricks is mandatory and production-grade Databricks pipelines are required.
• Strong understanding of the Databricks Lakehouse Platform.
• Strong Spark/PySpark, Python and SQL skills.
• AWS experience across S3, Glue, Lambda, Athena, Redshift, IAM and API Gateway.
• Experience with cloud-native data integration and orchestration.
• Knowledge of APIs and modern integration patterns.
• Excellent communication and problem-solving abilities.

Responsibilities

• Build and optimise Databricks data pipelines and Lakehouse solutions.
• Develop scalable ingestion, transformation and orchestration workflows.
• Design and deliver cloud-native data integrations across AWS.
• Work extensively with Python, SQL, Spark/PySpark.
• Improve data performance, quality, security and governance.
• Support AI-enabled data and integration initiatives.
• Collaborate with engineering, architecture and business teams.
• Contribute to engineering standards, automation and best practices.

Skills

Databricks

AWS

Python

SQL

PySpark

Spark

Delta Lake

Unity Catalog

Medallion Architecture

Terraform/CloudFormation

CI/CD

Docker/Kubernetes

APIs & integration

Tools

Terraform/CloudFormation

CI/CD tooling

Docker/Kubernetes

Delta Lake

Unity Catalog

Medallion Architecture

Job description

Talent Corp is seeking an experienced Data Engineer in Brisbane to join a cloud and AI-focused data environment. You will design and implement Databricks-based data pipelines and Lakehouse solutions, leveraging AWS, Python, SQL and PySpark to deliver scalable data integrations.

The role requires hands-on Databricks expertise, production experience, and strong collaboration with engineering and analytics teams to improve data quality, governance and performance in a dynamic setting.