LLM-Powered AI Applications Engineer

Eleven Recruiting; New York (NY); On-site; USD 140,000 - 210,000; Full time

Job summary

Eleven Recruiting represents a client investment firm hiring a Software Engineer, AI Applications in New York, NY. You will integrate LLM-powered features and design data layers to make AI outputs explainable and auditable.

The role emphasizes building backend services, defining patterns for AI capabilities, and delivering near-term agentic workflows such as meeting briefs and summaries. A strong emphasis on production-grade shipping and collaboration across teams is required.

Qualifications

• 5–8 years of software engineering experience with a backend or fullstack foundation.
• 2+ years building and shipping LLM-powered applications to production.
• Experience integrating AI capabilities via APIs, data pipelines and product codebases.
• Hands-on experience with RAG pipelines, prompt engineering at scale, and LLM evaluation.

Responsibilities

• Integrate LLM-powered features into an existing product within codebases and UI patterns.
• Design a data and metadata layer for explainable, auditable AI outputs.
• Set engineering patterns for building, testing, evaluating, and maintaining AI capabilities.
• Scope and ship near-term, high-ROI agentic workflows (e.g., meeting prep briefs, summaries).
• Build backend services and APIs that synthesize internal data into client outputs.
• Take on additional projects as needs evolve.

Skills

Backend development

Fullstack foundations

LLM integration

APIs and data pipelines

RAG pipelines

Prompt engineering

Production-grade shipping

Tools

LangGraph

CrewAI

Job description

Eleven Recruiting represents a client investment firm hiring a Software Engineer, AI Applications in New York, NY. You will integrate LLM-powered features and design data layers to make AI outputs explainable and auditable.

The role emphasizes building backend services, defining patterns for AI capabilities, and delivering near-term agentic workflows such as meeting briefs and summaries. A strong emphasis on production-grade shipping and collaboration across teams is required.