Senior AI/ML Engineer - Benchmarking Analytics (Melbourne)

FDE Times; Melbourne; On-site; AUD 120,000 - 180,000; Full time

Job summary

Artificial Analysis in Melbourne is seeking a Senior AI/ML Engineer to lead projects in benchmarking and analysis. You will collaborate with founders to build core parts of the software stack for a fast-growing startup.

The role focuses on data-intensive backend systems, Python-driven benchmarking, and delivering intuitive visualizations for thousands of daily users. Strong AI interest and leadership are essential.

Qualifications

• 3+ years of professional software engineering experience.
• Passion for AI and eagerness to work at the forefront of technological innovation.
• Proficiency with Python libraries for data analysis (e.g. pandas) and AI APIs (e.g. OpenAI).
• Familiarity with cloud infrastructure, orchestration and monitoring tools.
• Experience with visualizing and presenting data.
• Strong problem-solving skills and ability to distill complex concepts into actionable insights in the face of uncertainty.
• Excellent communication and collaboration skills.
• Proven ability to lead projects independently in a fast-paced environment.
• Bachelor’s or Master’s in Computer Science, Engineering, or related field (e.g. Physics).

Responsibilities

• Lead the development and optimization of core benchmarking stack, focusing on data-intensive backend systems and APIs.
• Design and implement robust Python solutions for benchmarking, model evaluation and data analysis.
• Design and implement user interfaces and data visualizations that distill complex benchmarking data into intuitive experiences for thousands of daily users.
• Conduct custom analyses for enterprise customers, providing actionable insights to inform their AI strategies.
• Contribute to the evolution of benchmarking methodologies, including evaluation methods for emerging modalities and capabilities.
• Embrace an AI-native workflow, using cutting-edge AI tools to generate leverage in a fast-changing industry.

Skills

Python

Data visualization

OpenAI API usage

Cloud infrastructure

Data analysis

Communication

Leadership

Problem solving

Education

Bachelor’s or Master’s in Computer Science/Engineering/related field

Tools

Pandas

OpenAI API

PyTorch

Job description

Artificial Analysis in Melbourne is seeking a Senior AI/ML Engineer to lead projects in benchmarking and analysis. You will collaborate with founders to build core parts of the software stack for a fast-growing startup.

The role focuses on data-intensive backend systems, Python-driven benchmarking, and delivering intuitive visualizations for thousands of daily users. Strong AI interest and leadership are essential.