Data Engineer / Senior Data Engineer: Scalable Databricks & Cloud Pipelines

TechnologyOne

Brisbane

On-site

AUD 120,000 - 160,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive remuneration package
Employee share plan access
Salary packaging options
Purchase Leave program (up to 10 extra
Family-friendly flexible hours
Free gym membership
Volunteer leave 2.5 days/year
Free breakfast and coffee on-site
LinkedIn Learning access and career路径

Job summary

TechnologyOne is expanding its Data Insights Platform in Brisbane, Australia, seeking Data Engineer and Senior Data Engineer roles. You will design and deliver scalable data and analytics solutions, building Databricks streaming/batch workflows with Python and enhancing data ingestion, security and access controls across AWS.

The role focuses on cost-efficient cloud data solutions, ETL development with Python, Spark and SQL, and ongoing pipeline performance improvements while leveraging

Qualifications

  • Experience designing scalable data and analytics solutions aligned to business needs.
  • Strong Python, Spark and SQL capabilities for data processing and modeling.
  • Proficiency with cloud data platforms on AWS and Databricks.
  • Knowledge of data ingestion patterns, data quality controls and data security.

Responsibilities

  • Design and deliver scalable data and analytics solutions.
  • Build Databricks streaming and batch workflows using Python.
  • Develop data ingestion patterns and robust data architecture.
  • Create secure, cost-effective cloud data solutions on Databricks and AWS.
  • Build and optimise ETL pipelines with Python, Spark and SQL.
  • Implement data quality controls to ensure data accuracy and consistency.
  • Monitor, troubleshoot and optimise pipeline performance and reliability.
  • Manage infrastructure with Terraform and CI/CD pipelines.
  • Evolve the Data Insights Platform to reduce cost and improve performance.

Skills

Python
Spark
SQL
Databricks
AWS
Terraform
CI/CD
OpenSearch
Git/Bitbucket

Tools

Databricks Unity Catalog
Terraform
CI/CD pipelines

Job description

TechnologyOne is expanding its Data Insights Platform in Brisbane, Australia, seeking Data Engineer and Senior Data Engineer roles. You will design and deliver scalable data and analytics solutions, building Databricks streaming/batch workflows with Python and enhancing data ingestion, security and access controls across AWS.

The role focuses on cost-efficient cloud data solutions, ETL development with Python, Spark and SQL, and ongoing pipeline performance improvements while leveraging

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer: Cloud Pipelines for AI-Ready Analytics
Data Engineer: Cloud Pipelines for AI-Ready Analytics

TechnologyOne • Brisbane

On-site
AUD 110,000 - 150,000
Competitive remuneration package
Employee share plan
Salary packaging options
+3
Data Engineer: Build Scalable Data Pipelines
Data Engineer: Build Scalable Data Pipelines

Technology One Limited • Queensland

On-site
AUD 109,000 - 148,000
Data Engineer
Data Engineer

TechnologyOne • Brisbane

On-site
AUD 120,000 - 160,000
Competitive remuneration package
Employee share plan access
Salary packaging options
+6
Senior Data Engineer: Hands-on Databricks & Client Impact
Senior Data Engineer: Hands-on Databricks & Client Impact

Greenyard • Melbourne

On-site
AUD 140,000 - 180,000
Senior Databricks Data Engineer — AWS, ITIL BAU Ops
Senior Databricks Data Engineer — AWS, ITIL BAU Ops

Coforge Limited • Brisbane

On-site
AUD 140,000 - 190,000
Databricks Platform Engineer - AWS Data Pipelines
Databricks Platform Engineer - AWS Data Pipelines

Accenture PLC • Canberra

Hybrid
AUD 140,000 - 190,000
Flexible work arrangements
Learning and development programs
Health insurance
+2
Data Engineer: Databricks & Modern Data Pipelines
Data Engineer: Databricks & Modern Data Pipelines

Bupa • Melbourne

On-site
AUD 110,000 - 160,000
Senior Data Platform Engineer: Databricks & Pipelines
Senior Data Platform Engineer: Databricks & Pipelines

Simple Machines • Sydney

On-site
AUD 150,000 - 180,000
Databricks Data Engineer — Banking Pipelines (Brisbane)
Databricks Data Engineer — Banking Pipelines (Brisbane)

Randstad Pty • Brisbane

Hybrid
AUD 166,000 - 203,000
Udemy license for learning
Exclusive discounts
Discounts on private health funds
+1
Data Engineer - Databricks
Data Engineer - Databricks

Ingrity Pty • Sydney

Hybrid
AUD 120,000 - 180,000
Hybrid work environment
Top locations