Remote Senior AI Engineer: Production-Grade LLM Systems

Ruby Labs

Atlanta (GA)

Remote

USD 120,000 - 210,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote Work Environment
Unlimited PTO
Paid National Holidays
Company-provided MacBook
Flexible Independent Contractor Agenda

Job summary

Ruby Labs is seeking an AI Engineer (Strong Middle / Senior) to own the quality, reliability and evolution of our AI systems in production. You will drive end-to-end delivery of AI features and ensure production stability across our AI stack.

You will design clean tool contracts, orchestrate multi-provider LLM workflows and guide data-driven experiments using Langfuse, tool gateways and a TS/Node.js/Cloudflare Workers stack.

Qualifications

  • 4+ years of backend/fullstack software engineering experience, with production-grade TypeScript/Node.js.
  • 1+ year of AI/LLM systems in production with real users.
  • Daily use of AI-centred development tools (Claude Code, Cursor or similar).
  • Deep hands-on experience with LLM APIs (OpenAI, Anthropic, Google Gemini or similar) in production.
  • Experience with agentic AI, multi-step orchestration, tool-based workflows (function calling / tool execution) or RAG pipelines (indexing, retrieval, re-ranking).
  • Experience with LLM observability and evaluation tools (Langfuse, LangSmith or similar).
  • Experience with AI gateways and model routing (OpenRouter, Cloudflare AI Gateway or equivalent).
  • Solid understanding of relational databases (PostgreSQL) and caching (Redis, KV or similar).
  • Exceptional ownership and personal responsibility for engineering quality and delivery.

Responsibilities

  • Take ownership of major AI features and LLM workflows and deliver them to production within agreed timelines.
  • Own AI output quality, structure and predictability across user-facing AI interactions, with consistent structured output across different LLMs for the same request type.
  • Integrate and orchestrate multiple LLM providers through an AI gateway, managing model selection, fallback strategies and cost optimisation.
  • Design and orchestrate tool-using and agentic AI workflows: clean tool contracts (including MCP-based tools), function-calling interfaces and reliable AI-to-system integrations.
  • Build and maintain multi-step LLM workflows and RAG pipelines (indexing, embeddings, retrieval, re-ranking) for reasoning, context reuse and search.
  • Design and manage production prompt systems with dynamic prompting, context injection, and conditional logic.
  • Own prompt management, the release of LLM experiments and Langfuse-based evaluation pipelines: test datasets, LLM-as-a-judge, output scoring.
  • Run A/B tests across models and prompts, analyse the results and present the data-driven impact of AI features and experiments.
  • Deep-debug LLM chains using Langfuse traces: identify bottlenecks, optimise for cost, latency and context-window usage, and root-cause hallucinations and logic errors.

Skills

TS/Node.js backend
AI/LLM in production
Langfuse experience
Tool-based AI workflows
LLM observability

Tools

OpenAI
Anthropic
Google Gemini
MCP protocol
OpenRouter
Cloudflare AI Gateway
PostgreSQL
Redis

Job description

Ruby Labs is seeking an AI Engineer (Strong Middle / Senior) to own the quality, reliability and evolution of our AI systems in production. You will drive end-to-end delivery of AI features and ensure production stability across our AI stack.

You will design clean tool contracts, orchestrate multi-provider LLM workflows and guide data-driven experiments using Langfuse, tool gateways and a TS/Node.js/Cloudflare Workers stack.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote AI Engineer Rails - LLM Features in Production
Remote AI Engineer Rails - LLM Features in Production

OnTheGoSystems Ltd. • United States

Remote
USD 120,000 - 180,000
Fully remote environment
Async-friendly work
Fair compensation and great benefits
Remote Senior LLM Engineer — Production AI & RAG
Remote Senior LLM Engineer — Production AI & RAG

Phoenixoutcomes • United States

Remote
USD 180,000 - 260,000
Senior AI/ML Engineer: Production LLMs & Orchestration
Senior AI/ML Engineer: Production LLMs & Orchestration

CyberCoders, Inc. • United States

Remote
USD 180,000 - 240,000
Remote work
Unlimited vacation
Comprehensive benefits
+2
Senior ML Engineer: Production LLM Systems & Client-Facing
Senior ML Engineer: Production LLM Systems & Client-Facing

Arionkoder • United States

Remote
USD 150,000 - 230,000
Monthly USD Service Fee
Paid Agreed Time Off
Caregiver Time Off
+2
Staff AI Engineer - Architect of Production LLM Systems
Staff AI Engineer - Architect of Production LLM Systems

Harnham • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior AI/ML Engineer - Production LLM & RAG Solutions
Senior AI/ML Engineer - Production LLM & RAG Solutions

Overnox • United States

Remote
USD 150,000 - 220,000
Senior AI Engineer: Production-Ready LLM & Automation
Senior AI Engineer: Production-Ready LLM & Automation

Koda North • United States

Remote
USD 140,000 - 230,000
Senior AI Agentic Engineer: Production-Ready LLM Agents
Senior AI Agentic Engineer: Production-Ready LLM Agents

MTech Systems USA LLC • Dunwoody (GA)

On-site
USD 180,000 - 240,000
Production LLM AI Engineer: RAG, Safety & Latency
Production LLM AI Engineer: RAG, Safety & Latency

Newnovation • San Francisco (CA)

On-site
USD 200,000 - 225,000
Senior AI Engineer — Production-Grade LLM Applications
Senior AI Engineer — Production-Grade LLM Applications

Diverse Lynx, LLC • Long Beach (CA)

On-site
USD 96,000 - 165,000