Senior AI/ML Engineer: Benchmarking & Backend Lead

Artificial Analysis, Inc.; City of Melbourne; On-site; AUD 198,000 - 296,000; Full time

Benefits offered by this job

Competitive compensation including-equ

Equity

Job summary

Artificial Analysis is seeking a Senior AI/ML Engineer to lead projects in AI benchmarking and analysis, building core parts of the software stack and collaborating closely with the founders.

You will design Python solutions for benchmarking, create intuitive interfaces and data visualizations, and perform enterprise analyses to inform AI strategies in a fast-growing startup environment.

Qualifications

• 3+ years of professional software engineering experience.
• Passion for AI and eagerness to work at the forefront of technological innovation.
• Proficiency with Python data-analysis libraries (pandas) and AI APIs (OpenAI).
• Familiarity with cloud infrastructure, orchestration and monitoring tools.
• Experience with visualizing and presenting data.
• Strong problem-solving skills and the ability to distill complex concepts into actionable insights.
• Excellent communication and collaboration skills.
• Proven ability to lead projects independently in a fast-paced environment.
• Bachelor’s or Master’s in Computer Science, Engineering, or related field (e.g. Physics).

Responsibilities

• Lead the development and optimization of core benchmarking stack backend systems and APIs.
• Design and implement robust Python solutions for benchmarking, model evaluation and data analysis.
• Design and implement user interfaces and visualizations that distill benchmarking data for thousands of daily users.
• Conduct custom analyses for enterprise customers, providing actionable AI insights.
• Contribute to evolving benchmarking methodologies and evaluation approaches for emerging modalities.
• Embrace an AI-native workflow and leverage cutting-edge AI tools in a fast-changing industry.

Skills

Python

Pandas

OpenAI API

Data Visualization

Cloud Infrastructure

Communication

Project Leadership

Education

Bachelor's or Master's in CS/Engineering/Physics

Tools

PyTorch

Docker

REST APIs

Job description

Artificial Analysis is seeking a Senior AI/ML Engineer to lead projects in AI benchmarking and analysis, building core parts of the software stack and collaborating closely with the founders.

You will design Python solutions for benchmarking, create intuitive interfaces and data visualizations, and perform enterprise analyses to inform AI strategies in a fast-growing startup environment.