Senior LLM Engineer - NYC Hybrid

Open Talent; New York (NY); Hybrid; USD 160,000 - 240,000; Full time

Benefits offered by this job

Equity

Hybrid work (2 days in NYC)

Conference budget

Learning allowance

Flexible PTO

Job summary

Open Talent is seeking a Senior Software Engineer in NYC to build production-grade LLM-powered systems. You will own features end-to-end across frontend UI, backend services and ML pipelines, delivering reliable, user-friendly tools for complex workflows.

You’ll work with product, design, and ML engineers to ship with strong emphasis on latency, observability and model quality, in a hybrid setup with two NYC office days.

Responsibilities

• Design and build TypeScript services that power LLM workflows including RAG pipelines, prompt orchestration and fine-tuning flows.
• Develop rich, intuitive React interfaces for AI-driven products - heavy focus on UX, clarity and usability.
• Implement retrieval systems using vector databases, hybrid search and structured data sources.
• Work hands-on with LLM APIs and open-source models (OpenAI, Anthrop ic, open-weight models).
• Collaborate with ML engineers on evaluation, fine-tuning strategies and production rollout.
• Own backend architecture across Node.js services, async pipelines and model-facing APIs.
• Improve system reliability through logging, monitoring, tracing and failure handling.
• Mentor engineers and contribute to design and architecture decisions across the platform.

Skills

React

TypeScript

Next.js

Tailwind CSS

Storybook

Tools

React

TypeScript

Next.js

Tailwind CSS

Storybook

Node.js

vector databases

Job description

Open Talent is seeking a Senior Software Engineer in NYC to build production-grade LLM-powered systems. You will own features end-to-end across frontend UI, backend services and ML pipelines, delivering reliable, user-friendly tools for complex workflows.

You’ll work with product, design, and ML engineers to ship with strong emphasis on latency, observability and model quality, in a hybrid setup with two NYC office days.