ML Engineer - Production Pipelines & MLOps (Databricks)

Bailey Abbott Pty Ltd; Western Australia; Hybrid; AUD 120,000 - 180,000; Full time

Job summary

Bailey Abbott Pty Ltd in Western Australia is seeking a Machine Learning Engineer with a strong software engineering foundation to productionise, scale, and maintain advanced analytical models. You will bridge data science experiments and robust software, building scalable data pipelines in Databricks using Spark, R, and modern engineering practices.

Join a collaborative team to integrate predictive outputs into downstream systems, monitor pipeline latency, and ensure data governance across

Qualifications

• Experience building and deploying production ML pipelines.
• Proficiency with Databricks, MLflow, and Unity Catalog.
• Strong background in Spark performance tuning and data governance.
• Production-ready R workflows with Spark integrations.
• Experience with Delta Lake and time-series data.

Responsibilities

• Build production-grade ML pipelines on Spark/Databricks.
• Standardise model deployment and monitoring.
• Ensure code quality with automated tests and CI/CD.
• Scale R-based analytics on distributed data.
• Collaborate with data engineers and domain analysts.
• Monitor performance and data governance in production.

Skills

Software engineering

CI/CD pipelines

Apache Spark

R production

Delta Lake

Git

Tools

Databricks

MLflow

Unity Catalog

sparklyr

SparkR

Job description

Bailey Abbott Pty Ltd in Western Australia is seeking a Machine Learning Engineer with a strong software engineering foundation to productionise, scale, and maintain advanced analytical models. You will bridge data science experiments and robust software, building scalable data pipelines in Databricks using Spark, R, and modern engineering practices.

Join a collaborative team to integrate predictive outputs into downstream systems, monitor pipeline latency, and ensure data governance across