Founding Engineer, Applied AI Research

Armature

Paris

On-site

EUR 70,000 - 90,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Armature in Paris is seeking a researcher to own the studies we publish and the evals system behind our results. You’ll collaborate with a forward deployed engineer and a product engineer to decide what to study next, run studies, and publish findings under your name to shape how software gets rebuilt for agents.

You will publish research and design evals, test against data, and ship what works into the product.

Qualifications

  • Experience designing and running studies on AI systems.
  • Ability to analyze experimental results and present insights.
  • Familiarity with coding agents or related tooling.

Responsibilities

  • Design and run studies on how coding agents choose tools and how models behave.
  • Publish findings and contribute to public leaderboards under your name.
  • Design evals and ship what works into the product with engineers.

Skills

Research design
Experimentation
Data analysis
Coding agents

Education

Engineering degree from a top school

Job description

**_Location:_** _Paris, France. We value working in person, and we stay flexible. You may also get the chance to join us on occasional trips to San Francisco._ **_Language:_** _English is required. You do not need to speak French._

The role

You own two things at Armature: the research we publish and the evals system behind our results. You work on both hand in hand with our forward deployed engineer and our product engineer. **1. The research we publish.** Our studies on how coding agents think and choose are how most customers find us. You decide what we study next, you run the studies behind our public leaderboards, and you publish the findings under your name. **2. The evals system.** Everything we tell a customer depends on our evals, so they have to be excellent. You research how to design them to get the best results, and you build what works into the product. This field is young, so many of your questions won’t have an answer yet, and what you find will shape how software gets rebuilt for agents.

What you will do

Published research

  • * Design and run studies on how coding agents choose tools, how models and harnesses differ, and how agents use software.
  • * Find the next questions worth asking, and new ways to look at the data we already have.
  • * Automate the research runs and the analysis, so each study takes less time than the one before.
  • * Write up your findings so developers want to read and share them.

Evals system

  • * Test the latest research on evals against our own data, and keep what improves our results.
  • * Turn the questions our customers ask into better evals.
  • * Ship what works into the product with our product engineer.
Who we look for
  • * You’re an engineer from a top school, and if you’re a new grad, your internships show that you can build things.
  • * You build through coding agents every day: you split the work, guide the agents and understand what they produce, and this is the skill we value most.
  • * You can go from raw data to a finding on your own.
  • * You come with your own ideas, and you like to test them.
  • * You have high agency: you move forward without waiting for instructions.
Not a fit if
  • * You want pure research and nothing to ship.
  • * You need a fixed scope before you start.
  • * You want to train models more than you want to study how they behave.
  • * You prefer to write every line yourself over working through coding agents.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Engineer, Applied AI Research
Founding Engineer, Applied AI Research

Armature (YC P26) • Paris

On-site
EUR 70,000 - 120,000
Founding Engineer, Product
Founding Engineer, Product

Armature • Paris

On-site
EUR 70,000 - 110,000
Restaurant on site
Founding Engineer, Applied AI Research
Founding Engineer, Applied AI Research

present of AI • Paris

Hybrid
EUR 70,000 - 110,000
Founding Engineer, Product
Founding Engineer, Product

Armature (YC P26) • Paris

On-site
EUR 90,000 - 120,000
Founding AI Research Engineer — Coding Agents & Evals
Founding AI Research Engineer — Coding Agents & Evals

Armature • Paris

On-site
EUR 70,000 - 90,000
Founding Forward Deployed Engineer (FDE)
Founding Forward Deployed Engineer (FDE)

Armature (YC P26) • Paris

On-site
EUR 90,000 - 120,000
Founding Engineer — AI Agent Research & Tooling
Founding Engineer — AI Agent Research & Tooling

present of AI • Paris

Hybrid
EUR 70,000 - 110,000
Founding AI Research Engineer: Applied Coding Agents, Paris
Founding AI Research Engineer: Applied Coding Agents, Paris

Armature (YC P26) • Paris

On-site
EUR 70,000 - 120,000
Founding Engineer, Product
Founding Engineer, Product

present of AI • Paris

Hybrid
EUR 70,000 - 95,000
Research Engineer (Evals)
Research Engineer (Evals)

whitecircle • France

Hybrid
EUR 70,000 - 95,000