Senior AI/ML Engineer — Benchmarking & Analytics Lead

Fdetimes; San Francisco (CA); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Equity

On-site office

Competitive salary

Job summary

Artificial Analysis is seeking a Senior AI/ML Engineer in San Francisco to lead data-intensive backend work and the evolution of our AI benchmarking stack. You will design Python-based solutions for benchmarking, model evaluation and data analysis, while delivering interactive visualizations for thousands of users.

You will collaborate with founders, apply cutting-edge AI tools, and drive insights for enterprise customers, shaping the future of AI benchmarking and analytics in a fast-growing

Qualifications

• 3+ years of professional software engineering experience.
• Passion for AI and eagerness to work at the forefront of technological innovation.
• Proficiency with Python libraries for data analysis (e.g. pandas) and key AI APIs (e.g. OpenAI).
• Familiarity with cloud infrastructure, orchestration and monitoring tools.
• Experience with visualizing and presenting data.
• Strong problem-solving skills and ability to distill complex concepts into actionable insights.

Responsibilities

• Lead the development and optimization of core benchmarking stack components, focusing on data-intensive backend systems and APIs.
• Design and implement robust Python solutions for benchmarking, model evaluation and data analysis.
• Design and implement user interfaces and visualizations that distill benchmarking data for thousands of daily users.
• Conduct custom analyses for enterprise customers and provide actionable AI strategy insights.
• Contribute to the evolution of benchmarking methodologies and evaluation approaches for emerging modalities.
• Embrace an AI-native workflow using cutting-edge AI tools.

Skills

Python

Data analysis

Data visualization

Communication

Education

Bachelor’s or Master’s in Computer Science/Engineering or related field

Tools

OpenAI API

PyTorch

Cloud platforms

Job description

Artificial Analysis is seeking a Senior AI/ML Engineer in San Francisco to lead data-intensive backend work and the evolution of our AI benchmarking stack. You will design Python-based solutions for benchmarking, model evaluation and data analysis, while delivering interactive visualizations for thousands of users.

You will collaborate with founders, apply cutting-edge AI tools, and drive insights for enterprise customers, shaping the future of AI benchmarking and analytics in a fast-growing