Senior AI Engineer: Production LLM Agents & Workflows (NYC On-Site)

People in AI

New York (NY)

On-site

USD 180,000 - 250,000

Full time

5 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

People In AI is hiring a hands-on IC engineer in New York City to build production AI agents and multi-step LLM workflows. You will own ideas through deployment, integrating with existing backend and ML systems, and ensuring reliability in production.

You will work closely with the CTO, ML and backend teams to ship meaningful technical work that powers complex insurance investigations and real customer workflows.

Qualifications

  • Strong Python and production backend engineering experience.
  • Experience shipping LLM agents and AI systems to production.
  • Hands-on with evaluations, graders, and testing frameworks.
  • Familiarity with agent tooling such as OpenHands, Agent2Agent, and MCP.
  • Able to move quickly from prototype to robust production systems.

Responsibilities

  • Build and ship production AI agents and multi-step LLM workflows.
  • Develop agents that enrich claim information using permissible public sources.
  • Build internal workflows to help operations review ambiguous records.
  • Integrate agents with existing backend, data, and ML systems.
  • Monitor production performance, investigate failures, and improve reliability.
  • Work closely with the CTO, ML, backend, and operations teams.

Skills

Python
Backend engineering
LLM agents
Testing frameworks
Agent tooling
Production deployment

Tools

OpenHands
Agent2Agent
MCP

Job description

People In AI is hiring a hands-on IC engineer in New York City to build production AI agents and multi-step LLM workflows. You will own ideas through deployment, integrating with existing backend and ML systems, and ensuring reliability in production.

You will work closely with the CTO, ML and backend teams to ship meaningful technical work that powers complex insurance investigations and real customer workflows.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Generative AI Engineer: Production-Ready LLMs & Agents
Staff Generative AI Engineer: Production-Ready LLMs & Agents

Citi • New York (NY)

Hybrid
USD 142,000 - 213,000
Health benefits
401(k)
Lead AI Engineer: Production LLMs for Insurance Workflows
Lead AI Engineer: Production LLMs for Insurance Workflows

DataJobs • New York (NY)

On-site
USD 145,000 - 180,000
Medical, Dental and Vision Insurance
Health Savings Account
401(k) Matching
Senior AI Engineer — Production LLM & RAG Pipelines
Senior AI Engineer — Production LLM & RAG Pipelines

Brown Brothers Harriman & Co. • Town of Boston (NY)

On-site
USD 175,000 - 215,000
Senior AI Agent Engineer — Production LLM Systems
Senior AI Agent Engineer — Production LLM Systems

Jobot • New York (NY)

On-site
USD 185,000 - 235,000
Equity / ownership
Direct access to founders and CTO
Very high technical ownership
+6
Applied AI Engineer — Production ML & LLMs (Hybrid NYC)
Applied AI Engineer — Production ML & LLMs (Hybrid NYC)

Logicbroker • New York (NY)

On-site
USD 102,000 - 138,000
Senior Applied AI Engineer
Senior Applied AI Engineer

People in AI • New York (NY)

On-site
USD 180,000 - 250,000
Senior AI Production Engineer: LLMs & Agent Workflows
Senior AI Production Engineer: LLMs & Agent Workflows

Acceler • United States

Remote
USD 140,000 - 190,000
Senior AI Agents Engineer — LLM Systems
Senior AI Agents Engineer — LLM Systems

Testing Site - JPMC • New York (NY)

On-site
USD 160,000 - 240,000
AI/ML Engineer — LLM Infra & Agentic Workflows
AI/ML Engineer — LLM Infra & Agentic Workflows

Objective Partners • New York (NY)

On-site
USD 150,000 - 260,000
Medical, dental, vision insurance
High-performance hardware access
Competitive base + incentive options
LLM-Driven Automation Engineer (Agents & Tools)
LLM-Driven Automation Engineer (Agents & Tools)

AI Experts • New York (NY)

On-site
USD 90,000 - 130,000