Senior AI Engineer

raylu-ai; New York (NY); On-site; USD 165,000 - 250,000; Full time

Benefits offered by this job

Workflow engines (Temporal)

Job summary

raylu-ai in New York City is seeking a Senior AI Engineer focused on productizing AI agents, orchestration, evaluation, and reliability to ship real systems safely and quickly.

You will design end-to-end agent workflows, implement safety and latency controls, and collaborate with product and design to invent new interaction patterns. This role is in-office in Midtown Manhattan with occasional travel.

Qualifications

• Experience designing agentic systems with function/tool calling and memory.
• Ability to wire up services, eval harnesses, and optimize latency/cost.
• Product-focused with ability to run experiments and improve task success.
• Strong ability to make system-level and code design decisions from first principles.

Responsibilities

• Design, build, and productionize agent workflows end-to-end (APIs, tools, evals, monitoring).
• Create safety, cost, and latency controls; build dashboards and alerts for reliability.
• Partner with product/design to invent new interaction patterns and ship them fast.
• Document patterns and mentor engineers on best practices for LLM-powered features.

Skills

Agentic systems

Engineering first

LLM breadth

Product focus

Opinionated

Job description

Position Summary

We’re hiring a product-oriented Senior AI Engineer who loves tinkering with LLMs and shipping real agent systems. We spend less time on fine-tuning and more on orchestration, evaluation, and reliability—so agents do real work safely, quickly, and repeatedly.

What we’re looking for

• Agentic systems: Function/tool calling, multi-step planning, routing, memory, and retrieval.
• Engineering first: You can wire up services, craft eval harnesses, and debug latency/cost at scale.
• LLM breadth: Comfortable comparing models/hosts, prompt strategies, and guardrail techniques.
• Product focus: You instrument outcomes, run A/Bs, and iterate to improve task success rates.
• Opinionated: Deep level of understanding of the technological landscape, making both high level system and granular code design decisions based on understanding rather than preference - diving deep on unknown patterns in order to build the best product.

Responsibilities

• Design, build, and productionize agent workflows end-to-end (APIs, tools, evals, monitoring).
• Create safety, cost, and latency controls; build dashboards and alerts for reliability.
• Partner with product/design to invent new interaction patterns and ship them fast.
• Document patterns and mentor engineers on best practices for LLM-powered features.

Nice to have

• Experience with workflow engines (e.g., Temporal), comfort in full stack engineering

Logistics:

• Compensation: $165K - $250K salary, $100K-200K equivalent in new hire equity (4 year vest)
• Location: New York City. We are a fully in-office team working out of Midtown Manhattan Monday through Friday. We allow for WFH days when anyone is traveling, but we do not allow for permanent remote work.
• Benefits:
  • Generous health, dental, and vision insurance
  • 401k with 3% automatic contribution (no vesting)
  • Paid Lunches
  • Wellness and Citi Bike benefit