Senior AI Engineer - Autonomous Agents & Tooling

CommodityAI

San Francisco (CA)

Hybrid

USD 200,000 - 250,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CommodityAI, based in San Francisco, is hiring a senior engineer to turn model capabilities into autonomous agents. You will build the harnesses around those models—tools, context, execution loops, state and feedback—to carry tasks to completion.

The role focuses on prototyping quickly, validating with users, and using evals and production traces to decide what runs autonomously and what needs more work. Hands-on with ownership from experiment to production.

Qualifications

  • Experience building working agent systems that take actions and complete tasks.
  • Understanding harness design, context management and tool interfaces.
  • Experience creating evals, reading execution traces and improving unreliable behavior.
  • Ability to move quickly from idea to working feature and productionize it.

Responsibilities

  • Build agent harnesses giving models tools, context and execution environment to complete tasks across product and connected systems.
  • Design how agents plan, take actions, maintain state, recover from failures and hand work back to a person when needed.
  • Prototype features with models and agents, test against real customer problems, and ship capabilities.
  • Create evals around task completion and decision quality; turn production failures into reproducible cases.
  • Inspect traces and debug prompts, context, tool interfaces, orchestration and model behavior.
  • Increase useful autonomy over time with clear checkpoints and human intervention when required.
  • Experiment with new models and approaches, measure impact on capability, reliability, latency and cost.
  • Create reusable tools and harness components to scale development for more customers.

Skills

Software engineering
Agent systems
Context management
Eval design

Tools

Python
APIs
LLM tooling

Job description

CommodityAI, based in San Francisco, is hiring a senior engineer to turn model capabilities into autonomous agents. You will build the harnesses around those models—tools, context, execution loops, state and feedback—to carry tasks to completion.

The role focuses on prototyping quickly, validating with users, and using evals and production traces to decide what runs autonomously and what needs more work. Hands-on with ownership from experiment to production.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer
Senior AI Engineer

CommodityAI • San Francisco (CA)

Hybrid
USD 200,000 - 250,000
Senior AI Infrastructure Engineer for Autonomous Agents
Senior AI Infrastructure Engineer for Autonomous Agents

Clera • San Francisco (CA)

On-site
USD 150,000 - 250,000
Senior Product Engineer - AI-Driven Commodity Workflows
Senior Product Engineer - AI-Driven Commodity Workflows

CommodityAI • San Francisco (CA)

Hybrid
USD 200,000 - 250,000
Equity
Senior AI Product Engineer — Production Agent Systems
Senior AI Product Engineer — Production Agent Systems

Harrison Clarke • San Francisco (CA)

Hybrid
USD 220,000 - 300,000
Senior AI Agent Backend Engineer - Remote
Senior AI Agent Backend Engineer - Remote

Commerce Inc • Austin (TX)

Hybrid
USD 116,000 - 195,000
Remote AI Engineer — Build Production-Grade AI Agents
Remote AI Engineer — Build Production-Grade AI Agents

remote work • United States

Remote
USD 110,000 - 190,000
Senior AI Engineer: Agentic Workflows & Autonomous Systems
Senior AI Engineer: Agentic Workflows & Autonomous Systems

High Country Search Group • San Francisco (CA)

Hybrid
USD 225,000 - 350,000
Applied AI Engineer: Frontier Models & Agent Capabilities
Applied AI Engineer: Frontier Models & Agent Capabilities

Perplexity • San Francisco (CA)

On-site
USD 190,000 - 230,000
Senior AI Platform Architect for Autonomous Workflows
Senior AI Platform Architect for Autonomous Workflows

AGI Dialect, LLC • United States

On-site
USD 120,000 - 180,000
Senior AI Agent Engineer — Build Next-Gen Capabilities
Senior AI Agent Engineer — Build Next-Gen Capabilities

Serus • New York (NY)

On-site
USD 180,000 - 260,000