Senior AI Engineer: Scale Production LLMs & RAG

Brellium; New York (NY); Hybrid; USD 230,000 - 300,000; Full time

Benefits offered by this job

401(k) Retirement Savings Plan

Equity Compensation

Dinner Provided via DoorDash & stocked

Medical, Dental, and Vision coverage

HSA / FSA

11 paid holidays each year

Unlimited PTO

Training and professional development

Hybrid Work Schedule (4 days onsite, 3

Job summary

Brellium in New York, NY is seeking a Senior AI Engineer to own the intelligence engine powering Brellium. You will design LLM pipelines, optimize for latency and cost, and collaborate with backend and product teams to deliver production-grade AI capabilities in a high-stakes clinical domain.

Ideal candidates have 5+ years of software engineering, hands-on experience with LLMs in production, and deep knowledge of prompt design and RAG.

Qualifications

• 5+ years of professional software engineering experience.
• Hands-on experience building and shipping LLM-powered applications in production.
• Deep familiarity with LLM concepts: prompt engineering, structured extraction, function/tool calling, RAG, evaluation frameworks.
• Experience with AWS or comparable cloud infrastructure for AI workloads.
• Strong software engineering fundamentals – you write clean, maintainable systems, not just notebooks.

Responsibilities

• Design and improve LLM-powered pipelines and agent architectures.
• Build robust evaluation and benchmarking frameworks to measure output quality and regression.
• Optimize for latency, cost, determinism, and output quality across high daily volume.
• Implement retrieval-augmented generation (RAG) and tool-use strategies where appropriate.
• Ship production-grade AI systems – not experiments.
• Collaborate closely with backend and product teams to integrate AI capabilities into the core platform.

Skills

5+ years of software engineering

LLM applications in production

Prompt engineering

Structured extraction

Function/tool calling

RAG (Retrieval Augmented Generation)

AWS cloud services

Tools

AWS cloud services

Job description

Brellium in New York, NY is seeking a Senior AI Engineer to own the intelligence engine powering Brellium. You will design LLM pipelines, optimize for latency and cost, and collaborate with backend and product teams to deliver production-grade AI capabilities in a high-stakes clinical domain.

Ideal candidates have 5+ years of software engineering, hands-on experience with LLMs in production, and deep knowledge of prompt design and RAG.