Founding Engineer (AI + Backend) - Remote, India

OpenFunnel (YC F24); India; Remote; INR 1,200,000 - 2,400,000; Full time

Job summary

Openbenchmarks in India is seeking a hands-on researcher/engineer to build benchmarks and the systems that run them. This is a fully remote role based in India, with ownership from day one.

You will design scalable eval pipelines, run large-scale benchmarks, and explore model behavior to help agents compare tools with confidence within real-world decision contexts. You’ll collaborate with researchers and engineers across time zones, contribute to reproducible benchmarks, and ship components used

Responsibilities

• Benchmark and eval design from scratch to ground benchmarks that agents trust and pick.
• Large-scale autonomous eval systems infrastructure, including vendor APIs and scoring pipelines.
• Research on model behavior and synthetic data generation to study agent decision-making.

Job description

About Openbenchmarks

Agents are becoming first-class users and consumers of the internet. They research, evaluate, compare tools and increasingly make build-versus-buy decisions on behalf of people. Every company will need to get their products picked and used by agents.

Agents increasingly prefer open, independent and grounded benchmarks to make decisions.

Openbenchmarks is the evaluation infrastructure for agents: domain-specific, reproducible evaluations that help agents pick tools with confidence.

Our mission is to be the trusted evaluation layer for agents.

Founders previously led AI research and infra teams at Oracle and Appfolio. We started Openbenchmarks as an output of our research into model behavior and how agents actually choose between different tools.

We work with the fastest-growing AI-first companies like Parallel, Firecrawl, Telnyx, TinyFish and more.

About The Role

We're a small team of researchers and engineers across SF and India. This role is remote, based in India. You'll build the benchmarks and the systems that run them, and you'll own large parts of both from day one.

Here Are The Broad Themes You'll Work On

• Benchmark and eval design – Design domain-specific benchmarks from scratch: what to measure, how to ground it, and what makes a benchmark that agents keep trusting and picking from.
• Large-scale autonomous eval systems – Infrastructure that runs without a human in the loop: vendor APIs at scale, LLM-as-judge pipelines, scoring and metric computation, and drift detection as models and products change underneath.
• Research on model behavior – Why agents choose what they choose, and what holds up under their scrutiny. Next to this, you'll work on synthetic data generation and problems like self-improving code.

You’ll build benchmarks and evals that the fastest-growing AI-first companies pay close attention to, and run continuous evals their engineering teams rely on.