Senior AI Engineer — Production-Ready LLM Systems

Brellium, Inc.; New York (NY); Hybrid; USD 230,000 - 300,000; Full time

Benefits offered by this job

401(k)

Equity

DoorDash dinners

Healthcare coverage

HSA/FSA

11 paid holidays

Unlimited PTO

Training & development

Hybrid schedule

Job summary

Brellium, Inc. is seeking a Senior AI Engineer to own and evolve the intelligence engine powering Brellium.

This role demands deep fluency in prompt design, evaluation frameworks, agentic systems, structured extraction, tool use, retrieval pipelines, and performance tradeoffs to scale safely and cost-effectively. You will design LLM-powered pipelines, build robust evaluation tools, optimize latency/cost, implement RAG and tool-use strategies, and ship production-grade AI systems while

Qualifications

• 5+ years of professional software engineering experience.
• Hands-on experience shipping LLM-powered applications in production.
• Deep familiarity with LLM concepts: prompt engineering, structured extraction, function/tool calling, RAG, evaluation frameworks
• Experience with AWS or comparable cloud infrastructure for AI workloads
• Strong software engineering fundamentals – you write clean, maintainable systems, not just notebooks

Responsibilities

• Design and improve LLM-powered pipelines and agent architectures
• Build robust evaluation and benchmarking frameworks to measure output quality and regression
• Optimize for latency, cost, determinism, and output quality across high daily volume
• Implement retrieval-augmented generation (RAG) and tool-use strategies where appropriate
• Ship production-grade AI systems – not experiments
• Collaborate closely with backend and product teams to integrate AI capabilities into the core platform

Skills

Software engineering

LLM in production

Prompt engineering

AWS / cloud infra

Clean code

Tools

AWS

LLM tool calling

Job description

Brellium, Inc. is seeking a Senior AI Engineer to own and evolve the intelligence engine powering Brellium.

This role demands deep fluency in prompt design, evaluation frameworks, agentic systems, structured extraction, tool use, retrieval pipelines, and performance tradeoffs to scale safely and cost-effectively. You will design LLM-powered pipelines, build robust evaluation tools, optimize latency/cost, implement RAG and tool-use strategies, and ship production-grade AI systems while