Forward Deployed Engineer

Artificial Analysis

San Francisco (CA)

On-site

USD 120,000 - 170,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Artificial Analysis in San Francisco, CA or Melbourne, Australia, is seeking an engineer to run our LLM benchmarking stack, set up experiments, run benchmarks on language models, analyze results, and own the experimental pipelines. This role is part of our Forward Deployed Engineering team focused on Language Models.

You will collaborate with AI labs on pre-release models and contribute to benchmarking efforts in a fast-paced environment.

Qualifications

  • Responsibilities include setting up experiments
  • Running benchmarks on language models
  • Analyzing results and owning experimental pipelines

Responsibilities

  • Set up experiments and run benchmarks on language models.
  • Analyze results and collaborate with labs on pre-release models.
  • Own and maintain experimental pipelines for benchmarking.

Job description

Job Description
Run our LLM benchmarking stack and work directly with AI labs. Responsibilities include setting up experiments, running benchmarks on language models, analyzing results, collaborating with labs on pre-release models, and owning experimental pipelines. This role is part of our Forward Deployed Engineering team focused on Language Models.

Remote Conditions

On-site in San Francisco, CA or Melbourne, Australia; no remote.

Reach thousands of tech candidates from the Hacker News community.

Include this company Only other companies

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

LLM Benchmarking Engineer - On-Site SF/Melbourne
LLM Benchmarking Engineer - On-Site SF/Melbourne

Artificial Analysis • San Francisco (CA)

On-site
USD 120,000 - 170,000
Forward Deployed Engineer, Language Models (Onsite) Equity
Forward Deployed Engineer, Language Models (Onsite) Equity

FDE Times • San Francisco (CA)

On-site
USD 150,000 - 230,000
Equity
Frontline Language Model Engineer – AI Benchmarking
Frontline Language Model Engineer – AI Benchmarking

Artificial Analysis • San Francisco (CA)

On-site
USD 140,000 - 190,000
Forward Deployed Engineer - Language Models
Forward Deployed Engineer - Language Models

FDE Times • San Francisco (CA)

On-site
USD 150,000 - 230,000
Equity
Forward Deployed Engineer
Forward Deployed Engineer

Elios, Inc. • Houston (TX)

Remote
USD 83,000 - 131,000
Forward Deployed Engineer
Forward Deployed Engineer

Elios, Inc. • San Francisco (CA)

Remote
USD 140,000 - 210,000
Hybrid Forward Deployed Engineer (LLM Deployments)
Hybrid Forward Deployed Engineer (LLM Deployments)

OpenAI, Inc. • San Francisco (CA)

Hybrid
USD 185,000 - 300,000
Relocation assistance
Hybrid work model
Travel up to 50%
Forward Deployed Engineer
Forward Deployed Engineer

Elios, Inc. • Dallas (TX)

Remote
USD 140,000 - 180,000
Forward Deployed Engineer (FDE) - SF
Forward Deployed Engineer (FDE) - SF

vibehackers • San Francisco (CA)

Hybrid
USD 180,000 - 280,000
Relocation assistance
Hybrid work (3 days in office)
Forward Deployed Engineer
Forward Deployed Engineer

Elios, Inc. • Seattle (WA)

Remote
USD 120,000 - 180,000