Data Engineer — Databricks, PySpark & AI Data Solutions

LDK Healthcare; City of Brisbane; On-site; AUD 110,000 - 165,000; Full time

Benefits offered by this job

Competitive salary package

Flexible working arrangements

On-site cafes and restaurants

Job summary

LDK Seniors Living is seeking a Data Engineer to join the Innovation & Business Transformation team in Brisbane. You will build and maintain data pipelines, integrate data from multiple systems, and help create a single source of truth to support decision-making and AI initiatives.

You will work with Databricks, SQL, Python and Power BI, implement governance and quality controls, and collaborate with stakeholders to translate business needs into robust data solutions across clinical care,

Qualifications

• Hands-on data engineering experience and data pipelines.
• Strong SQL and Python/PySpark programming skills.
• Experience with Databricks lakehouse and cloud data platforms.
• Ability to translate business needs into data solutions.

Responsibilities

• Design, build, test and maintain scalable data pipelines and integrations across LDK's Databricks lakehouse environment.
• Develop and manage data solutions using SQL, Python (PySpark) and CI/CD, version control and automated deployments.
• Monitor platform performance, troubleshoot issues, and optimise data workloads for reliability and cost-effectiveness.
• Implement data quality, governance and privacy controls with automated testing and documentation.
• Create trusted data products, semantic models, dashboards and reports to support decision-making and AI initiatives.
• Collaborate with stakeholders to deliver data-driven solutions and promote data/AI capability across LDK.

Skills

Data pipeline design

SQL

Python

PySpark

Databricks

CI/CD

Version control

Education

STEM or technology degree

Databricks Certified Data Engineer

Azure Data Engineer Associate

Tools

Databricks

PySpark

SQL

Python

Job description

LDK Seniors Living is seeking a Data Engineer to join the Innovation & Business Transformation team in Brisbane. You will build and maintain data pipelines, integrate data from multiple systems, and help create a single source of truth to support decision-making and AI initiatives.

You will work with Databricks, SQL, Python and Power BI, implement governance and quality controls, and collaborate with stakeholders to translate business needs into robust data solutions across clinical care,