Senior AI Product Engineer II

Harnham

San Francisco (CA)

Hybrid

USD 192,000 - 260,000

Full time

4 hours ago
Be an early applicant
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity participation
Comprehensive health coverage
Flexible paid time off

Job summary

Harnham is hiring a Senior AI Product Engineer II to build AI-powered product experiences, leveraging LLMs, retrieval systems, and agent-based workflows. You will work with AI specialists, product managers, and designers to transform AI capabilities into polished features, combining full-stack engineering with practical AI development.

The role emphasizes hands-on development of streaming UI, backend APIs, and robust testing, with a hybrid work model in a fast-paced environment.

Qualifications

  • 7+ years of professional software engineering experience.
  • 2+ years of experience developing AI-enabled product features.
  • Strong expertise in React and TypeScript.
  • Hands-on experience with LLM-based applications and prompt design techniques.
  • Experience building highly interactive web applications that handle asynchronous and real-time data.
  • Experience designing and consuming APIs that integrate with AI services.

Responsibilities

  • Design, build, and maintain AI-powered product features across the full stack using modern web technologies.
  • Develop responsive user interfaces that support streaming responses and real-time interactions.
  • Create backend services and APIs integrating with AI models and orchestration frameworks.
  • Translate retrieval-based systems and autonomous workflows into intuitive user experiences.
  • Collaborate with AI engineers to define interfaces, output schemas, and integration patterns.
  • Establish observability and monitoring for AI features including latency and engagement metrics.
  • Implement automated testing strategies for integration and end-to-end AI workflows.
  • Mentor engineers and contribute to technical and product design discussions.

Skills

React
TypeScript
LLM-based applications
API design
Streaming data
Cross-functional collaboration

Tools

Python
Node.js

Job description

Senior AI Product Engineer II
Overview

A high-growth software company is seeking a Senior AI Product Engineer to develop and deliver AI-powered product experiences. This role focuses on building customer-facing features that leverage large language models (LLMs), retrieval systems, and agent-based workflows to improve user productivity and decision-making. You will work closely with AI specialists, product managers, and designers to transform AI capabilities into polished product experiences. The ideal candidate combines strong full-stack engineering expertise with practical AI development experience and excellent product instincts.

Key Responsibilities
  • Design, build, and maintain AI-powered product features across the full stack using modern web technologies.
  • Develop responsive user interfaces that support streaming responses, real-time interactions, and progressive AI-generated content.
  • Create backend services and APIs that integrate with AI models, orchestration frameworks, and supporting services.
  • Translate retrieval-based systems, autonomous workflows, and structured reasoning outputs into intuitive user experiences.
  • Collaborate with AI engineers to define interfaces, output schemas, and integration patterns.
  • Evaluate how AI-generated content performs in real-world usage and improve product experiences accordingly.
  • Build feedback mechanisms that capture user sentiment and AI output quality.
  • Establish observability and monitoring for AI features, including latency, adoption, engagement, and task completion metrics.
  • Implement automated testing strategies covering integration and end-to-end AI workflows.
  • Develop reusable components, patterns, and frameworks that accelerate future AI product development.
  • Mentor engineers and contribute to technical and product design discussions.
Required Qualifications
  • 7+ years of professional software engineering experience building and shipping production applications.
  • 2+ years of experience developing AI-enabled product features.
  • Strong expertise in React and TypeScript.
  • Experience building highly interactive web applications that handle asynchronous and real-time data.
  • Solid backend development experience with Python, Node.js, and TypeScript.
  • Experience designing and consuming APIs that integrate with AI services.
  • Hands-on experience with LLM-based applications and prompt design techniques.
  • Practical understanding of:
    • Context management
    • Retrieval-Augmented Generation (RAG)
    • Structured outputs
    • AI evaluation and quality measurement frameworks
  • Familiarity with agent orchestration frameworks and multi-step AI workflows.
  • Experience implementing streaming patterns such as Server-Sent Events (SSE), WebSockets, or similar real-time communication methods.
  • Strong product mindset with a focus on user experience and adoption.
  • Proven ability to work effectively with cross-functional teams in fast-paced environments.
Preferred Qualifications
  • Experience in regulated, compliance-oriented, security-focused, governance, risk, or document-intensive business environments.
  • Familiarity with Model Context Protocol (MCP) or comparable tool-integration approaches.
  • Experience troubleshooting retrieval quality and search relevance issues within AI applications.
  • Experience building annotation, review, or feedback tooling for AI systems.
Work Model / Location / Engagement Details
  • Hybrid work environment with a combination of in-office collaboration and flexible remote work days.
  • Full-time position.
  • Compensation range: $192,000 - $259,800 base salary, plus equity and benefits.
Benefits Highlights
  • Equity participation.
  • Comprehensive medical, dental, and vision coverage.
  • Retirement savings program and financial wellness benefits.
  • Life and disability insurance.
  • Paid parental leave and family-building support programs.
  • Professional development and learning stipends.
  • Flexible paid time off and company holidays.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Product Engineer I
Senior AI Product Engineer I

Harnham • San Francisco (CA)

Hybrid
USD 150,000 - 230,000
Equity participation
Comprehensive benefits package
Professional development stipend
+1
Senior AI Software Engineer - Level I
Senior AI Software Engineer - Level I

Symbiotic Services • New York (NY)

Hybrid
USD 150,000 - 230,000
Hybrid Work Model
Career Development
Benefits Package
+3
Senior AI Software Engineer
Senior AI Software Engineer

Summit Tech Partners • Washington, Baltimore (MD)

On-site
USD 140,000 - 170,000
Senior AI Engineer (4647)
Senior AI Engineer (4647)

Hireclout • El Segundo (CA)

On-site
USD 120,000 - 220,000
Company-paid medical, dental, and vision insurance
401(k) with company match
Generous PTO
+2
Senior AI/ML Engineer
Senior AI/ML Engineer

Peraton • Herndon (VA)

On-site
USD 135,000 - 216,000
Software Engineer - AI Agentic Product Dev Team (US)
Software Engineer - AI Agentic Product Dev Team (US)

Nutanix • Santa Clara (CA)

On-site
USD 90,000 - 120,000
Family medical coverage
Vision and dental coverage
Competitive base salary
+2
Senior AI Engineer
Senior AI Engineer

Weekday (YC W21) • San Francisco (CA)

On-site
USD 200,000 - 275,000
Manager, AI Engineering - Analytics
Manager, AI Engineering - Analytics

Drata • San Francisco (CA)

Hybrid
USD 197,000 - 268,000
Competitive base salary
Stock equity
100% employer-paid medical premiums
+1
Senior AI Engineer
Senior AI Engineer

Empathy Talent • San Francisco (CA)

On-site
USD 180,000 - 260,000
Senior Fullstack Engineer - AI
Senior Fullstack Engineer - AI

Harnham • Houston (TX)

On-site
USD 130,000 - 180,000