Member of Technical Staff - Research Engineer

Composio; San Francisco (CA); On-site; USD 100,000 - 150,000; Full time

Job summary

A technology company in San Francisco is looking for a candidate to drive research initiatives that influence engineering solutions. You'll build evaluations using real tool data, tackle search challenges for tools, and train systems for improved accuracy. Ideal candidates will have research experience, the ability to rapidly prototype and effectively communicate complex ideas, and excel in team collaboration. The position offers a dynamic work environment focused on innovation and productivity.

Qualifications

• Ability to independently execute research goals.
• Proficient in quickly prototyping and testing experiments.
• Able to collaborate with product and engineering teams.

Responsibilities

• Build large evaluations with real tool calling data.
• Work on search problems for finding semantically similar tools.
• Train systems to improve session accuracy using baseline data.

Skills

Research

Prototyping

Documentation

Collaboration with teams

Adaptability

Job description

Overview

At Composio, we are building infrastructure that allows agents to communicate with the tools you use for work including Github, Gmail, Notion, Salesforce, etc. We are a small team of engineers wrangling problems from context to search, that help us provide the most capable bridge between your agents and your tools.

What you'll do

• build large evals with real tool calling data, measuring where models suck in long horizon tool execution
• work on search problems for finding semantically similar tools and cached tool execution paths and plans
• train large agentic harness systems to improve session accuracy with millions of real tool calls as baseline data
• SFT on our agentic traces and RL models on top of our agentic harness and app sandboxes

Qualifications

• research
• you can independently execute against the research goals
• you can prototype and test experiments very quickly
• you can work with product and engineering teams to take research ideas to production in a matter of days
• typist — you can write docs well and explain complex ideas clearly
• human — you build trust and admit what you don’t know