ML Engineer - LLM & Agent AI Benchmarking (Hybrid)

Micromine

Western Australia

Hybrid

AUD 120,000 - 170,000

Full time

14 days+

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Hybrid working model

Competitive remuneration

Career development within a growing全球組

14 weeks paid parental leave

Health and wellbeing support

Job summary

Weir Software Solutions seeks a Machine Learning Engineer to evaluate, benchmark and improve LLM and agent-based AI systems across the product suite. You will develop evaluation frameworks, measure model performance and provide insights to deliver reliable AI solutions for the mining industry.

You’ll collaborate with product and engineering to define AI success metrics, design training and evaluation data, and deploy models into production with a focus on reliability and scalability in mining

Qualifications

Proven experience developing ML/AI solutions.
Experience in ML evaluation and benchmarking for LLM or agentic systems.
Strong experience with PyTorch or similar deep learning frameworks.
Experience deploying ML models into production environments.
Advanced Python skills with ML libraries (NumPy, Pandas, Scikit-learn).
Solid understanding of neural networks, CV, NLP or related AI disciplines.
Bachelor's degree or higher in CS, AI, DS or related field.

Responsibilities

Design, develop and deploy ML models using PyTorch and related technologies.
Design and implement evaluation frameworks for LLM and agentic AI systems.
Develop benchmarks, metrics and test datasets to assess model quality and reliability.
Analyse model performance and identify opportunities for improvement.
Partner with product and engineering teams to define AI success measures.