Senior Data Engineer — AI in Production (Databricks, Hybrid)

HorizonOne Recruitment; Canberra; Hybrid; AUD 120,000 - 150,000; Full time

Benefits offered by this job

Hybrid working across Australia

Contract role with extension option

Job summary

HorizonOne Recruitment is partnering with a specialist government agency to recruit a senior data engineer. The role focuses on building complex data pipelines, turning unstructured data into structured formats, and delivering production-grade ML/NLP pipelines with robust MLOps practices.

Hybrid work across multiple Australian locations is offered, with a long-term contract from October 2026 to June 2027 and a potential 12-month extension.

Qualifications

• Senior data engineer with advanced Python skills and experience building pipelines at scale.
• Hands-on experience with Databricks or similar cloud platforms.
• Track record deploying ML/NLP/generative AI into production with model serving and MLOps practices.

Responsibilities

• Refactor and expand the data ingestion stage for new use cases and structured outputs.
• Automate data ingestion across multiple sources and implement data quality checks.
• Build and maintain model-serving, deployment and API integration capabilities; ensure CI/CD and documentation.

Skills

Advanced Python

Databricks

ML in production

APIs

MLOps

Tools

Databricks

Job description

HorizonOne Recruitment is partnering with a specialist government agency to recruit a senior data engineer. The role focuses on building complex data pipelines, turning unstructured data into structured formats, and delivering production-grade ML/NLP pipelines with robust MLOps practices.

Hybrid work across multiple Australian locations is offered, with a long-term contract from October 2026 to June 2027 and a potential 12-month extension.