Data Engineer - (Databricks & Python)

Talent; City of Brisbane; On-site; AUD 150,000 - 197,000; Full time

Job summary

Talent in Brisbane is seeking an experienced Data Engineer to join a major enterprise organisation. You will design, develop and maintain scalable data pipelines in Databricks, using Python and SQL to transform complex datasets and deliver robust data solutions.

You will work with business stakeholders and technology teams to understand requirements, analyse data needs, validate data and support reporting and analytics across the business.

Qualifications

• Strong hands-on experience with Databricks and cloud data platforms.
• Proficient in Python and SQL for data transformation and analysis.
• Experience designing and supporting data pipelines for reporting and analytics.

Responsibilities

• Design, develop and maintain scalable data pipelines and data solutions within Databricks.
• Use Python and SQL to transform, manipulate and analyse complex datasets.
• Collaborate with business stakeholders to translate requirements into technical solutions.

Skills

Databricks

Python

SQL

Data pipelines/ETL/ELT

Analytical thinking

Business communication

Collaboration

Job description

An exciting opportunity is available for an experienced Data Engineer to join a major enterprise organisation and work within an established Operations Data Squad delivering high-value data initiatives across the business.

This is not just a heads-down engineering position. We are looking for someone who combines strong Databricks, Python and SQL capability with excellent analytical thinking and business communication skills.

You’ll work closely with business stakeholders, analysts and technology teams to understand operational requirements, analyse complex data needs and deliver robust, scalable data solutions that support better business decision-making.

What You’ll Be Doing

• Design, develop and maintain scalable data pipelines and data solutions within Databricks


• Use Python and SQL to transform, manipulate and analyse complex datasets


• Work with operational and business stakeholders to understand data requirements and translate them into practical technical solutions


• Analyse data, identify trends, issues and opportunities, and communicate findings clearly


• Support the delivery of reliable, high-quality datasets for reporting, analytics and operational use


• Perform data validation, troubleshooting and root-cause analysis


• Collaborate across data, technology and business teams within an enterprise environment


• Contribute to data engineering standards, documentation and continuous improvement

What We’re Looking For

• Strong hands-on experience with Databricks


• Advanced Python and SQL capability


• Strong experience developing and supporting data pipelines / ETL / ELT solutions


• Excellent analytical and problem-solving skills


• Excellent business communication skills, with the ability to work directly with non-technical stakeholders


• Ability to understand business problems and translate them into data and technical requirements


• Strong data investigation, validation and troubleshooting capability


• Experience working within a large, complex commercial or enterprise environment


• Ability to work effectively within a collaborative delivery squad

Experience within aviation, travel, banking, insurance or another large commercial environment would be highly regarded.

Location: Brisbane
Contract: 12 months
Rate: $940 per day inclusive of super
Type: Contract