LLM Product Engineer - Agents & Features (NYC, Onsite)

Digital Waffle

New York (NY)

On-site

USD 140,000 - 200,000

Full time

10 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

In-office in New York
Competitive compensation

Job summary

Digital Waffle in New York is seeking an AI Engineer to design, build and ship LLM-powered product features and agentic workflows into production. This is a hands-on, build-focused role working alongside product and users, not a pure research position.

You will work with Python and TypeScript, handle tool calling, RAG, vector search and eval pipelines, integrate with React/Next.js surfaces, and own AI layer metrics like cost, latency and reliability while collaborating closely with model

Qualifications

  • Production experience shipping LLM-powered features.
  • Strong Python and TypeScript in production.
  • Familiarity with tool calling, RAG and vector databases.

Responsibilities

  • Design and ship production LLM features and agents.
  • Build the applied AI toolkit end to end (tool calling, RAG, vector search).
  • Work with model APIs (Anthropic, OpenAI, Google) and open-source models as suitable.
  • Build evaluation pipelines to measure quality.
  • Integrate agents into React/Next.js product surfaces.
  • Own AI layer cost, latency and reliability.

Skills

Python
TypeScript
LLM features
Production experience
API integration

Tools

Anthropic API
OpenAI API
LangSmith
Vector databases

Job description

Digital Waffle in New York is seeking an AI Engineer to design, build and ship LLM-powered product features and agentic workflows into production. This is a hands-on, build-focused role working alongside product and users, not a pure research position.

You will work with Python and TypeScript, handle tool calling, RAG, vector search and eval pipelines, integrate with React/Next.js surfaces, and own AI layer metrics like cost, latency and reliability while collaborating closely with model

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer
AI Engineer

Digital Waffle • New York (NY)

On-site
USD 140,000 - 200,000
In-office in New York
Competitive compensation
Production AI Engineer - Ship LLM Features & Agents
Production AI Engineer - Ship LLM Features & Agents

Digital Waffle • San Francisco (CA)

On-site
USD 180,000 - 260,000
Staff AI Engineer — Production LLM Agents & AI Infra
Staff AI Engineer — Production LLM Agents & AI Infra

People in AI • New York (NY)

On-site
USD 250,000 - 275,000
Senior Applied AI Engineer: Production LLM Agents (NYC, Equity)
Senior Applied AI Engineer: Production LLM Agents (NYC, Equity)

Mural Group • New York (NY)

On-site
USD 220,000 - 300,000
Equity
Visa sponsorship available
Senior AI Engineer — Production Agents & LLM Workflows
Senior AI Engineer — Production Agents & LLM Workflows

People in AI • New York (NY)

On-site
USD 180,000 - 250,000
Product Engineer: End-to-End AI Features (In-Office NYC)
Product Engineer: End-to-End AI Features (In-Office NYC)

Digital Waffle • New York (NY)

On-site
USD 90,000 - 150,000
AI/ML Engineer — LLM Infra & Agentic Workflows
AI/ML Engineer — LLM Infra & Agentic Workflows

Objective Partners • New York (NY)

On-site
USD 150,000 - 260,000
Medical, dental, vision insurance
High-performance hardware access
Competitive base + incentive options
Applied AI Engineer: Agentic AI & LLMs – Onsite NYC
Applied AI Engineer: Agentic AI & LLMs – Onsite NYC

Robson Bale Ltd • New York (NY)

On-site
USD 150,000 - 200,000
Competitive base salary
Medical, dental, vision coverage
401(k) with matching
+4
Remote AI Engineer: LLM Agents (Contract)
Remote AI Engineer: LLM Agents (Contract)

Hidden Jobs • United States

Remote
USD 170,000 - 250,000
Fully remote work
Paid time off
Reduced Friday hours in summer
+1
Enterprise AI Agent Engineer: LLM Workflows
Enterprise AI Agent Engineer: LLM Workflows

Cohere • New York (NY)

Hybrid
USD 150,000 - 190,000
Weekly lunch stipend
Health and dental benefits
RRSP matching / 401K
+5