AI Systems Engineer — Custom Models & Deployment (Remote-Friendly)

black.ai; City of Melbourne; On-site; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Learning budget

Wellness allowance

Home office budget

Parental leave

Equity

Job summary

Heidi is expanding its team to build enterprise AI systems tailored to healthcare work, focusing on model customization, deployment, agent systems, and customer delivery. You will own delivery across multiple domains and collaborate across teams to balance quality, cost, latency, and reliability.

The role emphasizes practical production experience and strong software or ML engineering skills, with a focus on real-world healthcare challenges and customer outcomes.

Qualifications

• Strong experience in at least two of the areas above.
• Practical experience building or operating production AI systems.
• Solid software engineering or machine learning engineering skills.
• Familiarity with open-weight language models and the modern LLM ecosystem.
• Good judgement balancing model quality, cost, latency, and reliability.
• Ability to work through ambiguous technical and customer requirements.
• Clear communication with technical and non-technical stakeholders.

Responsibilities

• Turn customer use cases into training and evaluation plans.
• Select data, models, and training approaches.
• Fine-tune and evaluate models for specialised domains.
• Improve quality based on testing and production feedback.
• Design cloud or on-prem deployment approaches.
• Choose infrastructure and serving configurations.
• Improve reliability, latency, and operating cost.
• Build monitoring, backup, and recovery processes.
• Build agent workflows around language models.
• Connect models with customer data, tools, and existing systems.
• Add controls and observability for production use.
• Understand customer requirements and constraints.
• Explain trade-offs between quality, cost, privacy, and complexity.
• Help take solutions from discovery through production launch.

Skills

Model customization

Deployment & inference

Agent systems

Customer delivery

Job description

Heidi is expanding its team to build enterprise AI systems tailored to healthcare work, focusing on model customization, deployment, agent systems, and customer delivery. You will own delivery across multiple domains and collaborate across teams to balance quality, cost, latency, and reliability.

The role emphasizes practical production experience and strong software or ML engineering skills, with a focus on real-world healthcare challenges and customer outcomes.