Senior AI/ML Engineer — Benchmarking & Data Viz, Equity

FDE Times; Melbourne; On-site; AUD 140,000 - 190,000; Full time

Benefits offered by this job

Equity

Job summary

Artificial Analysis is seeking a Senior AI/ML Engineer to lead projects in benchmarking and analysis. You will work with founders to build core parts of the software stack for a fast-growing startup in Melbourne, with an on-site role and a focus on data-intensive backend systems and AI evaluation.

The role emphasizes developing robust Python solutions, data visualizations, and custom analyses for enterprise customers, shaping AI benchmarking methodologies as the AI landscape evolves.

Qualifications

• 3+ years of professional software engineering experience.
• Bachelor's or Master's in CS/Engineering or related field.
• Proficient with Python libraries for data analysis (e.g. pandas) and AI APIs (OpenAI).
• Experience with cloud infrastructure, orchestration and monitoring tools.
• Strong communication and collaboration skills.
• Proven ability to lead projects independently in a fast-paced environment.
• Experience with data visualization.

Responsibilities

• Lead the development and optimization of core benchmarking stack, focusing on data-intensive backend systems and APIs.
• Design and implement robust Python solutions for benchmarking, model evaluation and data analysis.
• Design and implement user interfaces and data visualizations that distill complex AI benchmarking data for thousands of daily users.
• Conduct custom analyses for enterprise customers, providing actionable insights for AI strategies.
• Contribute to evolution of benchmarking methodologies and evaluation approaches for emerging modalities.
• Embrace an AI-native workflow using cutting-edge AI tools to gain leverage in a fast-changing industry.

Skills

Python programming

Data analysis

Visualization

Problem solving

Leadership

Communication

Education

Bachelor's or Master's in Computer Science or Engineering

Tools

pandas

OpenAI API

Cloud infrastructure

Monitoring tools

Job description

Artificial Analysis is seeking a Senior AI/ML Engineer to lead projects in benchmarking and analysis. You will work with founders to build core parts of the software stack for a fast-growing startup in Melbourne, with an on-site role and a focus on data-intensive backend systems and AI evaluation.

The role emphasizes developing robust Python solutions, data visualizations, and custom analyses for enterprise customers, shaping AI benchmarking methodologies as the AI landscape evolves.