AI Engineer

Ruby Labs Ltd

United States

On-site

USD 120,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Ruby Labs Ltd. in the United States seeks a Senior AI Engineer to enhance AI infrastructure through advanced prompt engineering and model optimization using a modern tech stack. You will focus on dynamic prompting and LLM observability to improve system reliability and performance.

The role emphasizes building robust evaluation pipelines, running A/B tests, and making data-driven deployment decisions based on rigorous benchmarks and quantitative analysis.

Qualifications

  • Role requires expertise in AI infrastructure, prompt engineering, and LLM observability.
  • Experience with evaluation pipelines and deterministic outputs is beneficial.

Responsibilities

  • Enhance AI infrastructure with advanced prompt engineering and model optimization.
  • Implement response schemes and evaluation pipelines to ensure AI outputs integrate with application logic.
  • Deep debug of LLM chains and conduct A/B tests to compare model performance.

Job description

Ruby Labs seeks a Senior AI Engineer to enhance AI infrastructure through advanced prompt engineering and model optimization using a modern tech stack. Ideal candidates are experienced in dynamic prompting and LLM observability.

In this role, you will focus on optimizing AI models and their performance through advanced prompt engineering and structured outputs. You will implement various response schemes and build robust evaluation pipelines to ensure AI outputs integrate seamlessly into application logic.

You will also be responsible for deep debugging of LLM chains and running A/B tests to compare model performance. The role emphasizes data-driven decision-making, requiring you to analyze results quantitatively and make deployment decisions based on solid benchmarks.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer: Prompting & Model Optimization
Senior AI Engineer: Prompting & Model Optimization

Ruby Labs Ltd • United States

Remote
USD 120,000 - 180,000
Remote Senior AI Engineer: Production-Grade LLM Systems
Remote Senior AI Engineer: Production-Grade LLM Systems

Ruby Labs • Atlanta (GA)

Remote
USD 120,000 - 210,000
Remote Work Environment
Unlimited PTO
Paid National Holidays
+2
AI Engineer
AI Engineer

Falcon Smart IT (FalconSmartIT) • Los Angeles (CA)

On-site
USD 190,000 - 260,000
AI Systems Engineer - Full-Stack & Automation
AI Systems Engineer - Full-Stack & Automation

Ruby Advisory • New York (NY)

Remote
USD 96,000 - 152,000
Sr. AI Engineer
Sr. AI Engineer

Photon • Dallas (TX)

On-site
USD 120,000 - 180,000
Ruby Engineer
Ruby Engineer

SME.careers • United States

Remote
USD 55,000 - 83,000
AI Engineer
AI Engineer

EthicalHat Cyber Security Pvt. Ltd. • United States

Remote
USD 120,000 - 180,000
AI Engineer
AI Engineer

Unstuck Labs • Washington

Hybrid
USD 110,000 - 170,000
Gen AI Engineer: Prompting, LLMs & Production AI
Gen AI Engineer: Prompting, LLMs & Production AI

Valiant Technologies LLC • San Jose (CA)

On-site
USD 130,000 - 190,000
Senior AI Prompt Engineer — Hybrid, Cutting-Edge LLM
Senior AI Prompt Engineer — Hybrid, Cutting-Edge LLM

Persistent Systems • Whippany (NJ)

Hybrid
USD 150,000 - 190,000
Health coverage: Mediclaim
Group term life
Flexible work hours
+3