Production AI Engineer: LLM Workflows & Guardrails

DataDrone Inc.

United States

Remote

USD 140,000 - 230,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

DataDrone Inc. is seeking an experienced AI platform expert to own the production LLM workflow design.

You will shape prompts, agent usage, and retrieval strategies to ensure accurate, bounded, and measurable outcomes in client deployments. You will lead the creation of guardrails and evals, diagnose difficult LLM issues, and collaborate with Integration Engineers to ship production-ready solutions that stand up to real-world use.

Qualifications

  • Deep experience in prompt engineering for production systems.
  • Hands-on with agents and tool-use patterns.
  • Proven ability to design guardrails and evals.
  • Strong production LLM workflow design experience.
  • Ability to set a concrete acceptance bar for validation.

Responsibilities

  • Own the technical design of the production LLM workflow end to end.
  • Engineer prompts, agent/tool-use patterns, and retrieval for accuracy and reliability.
  • Design and configure guardrails so the workflow stays bounded and safe in production.
  • Build eval suites that make accuracy and quality measurable, not anecdotal.
  • Partner with the Integration Engineer to get the design live in the client's stack.
  • Set the acceptance bar with QA; define what "good enough to ship" means concretely.
  • Diagnose and solve hard LLM behavior problems; document design decisions.

Skills

Prompt engineering
Agents & tools
LLM APIs
Guardrails design
Eval frameworks
Production workflows

Job description

DataDrone Inc. is seeking an experienced AI platform expert to own the production LLM workflow design.

You will shape prompts, agent usage, and retrieval strategies to ensure accurate, bounded, and measurable outcomes in client deployments. You will lead the creation of guardrails and evals, diagnose difficult LLM issues, and collaborate with Integration Engineers to ship production-ready solutions that stand up to real-world use.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Production Engineer: LLMs & Agent Workflows
Senior AI Production Engineer: LLMs & Agent Workflows

Acceler • United States

Remote
USD 140,000 - 190,000
Senior AI Engineer: LLM Agents & Production Guardrails
Senior AI Engineer: LLM Agents & Production Guardrails

CCC Intelligent Solutions Inc. • United States

Remote
USD 120,000 - 180,000
Lead AI Engineer - Production LLMs & Agentic Workflows
Lead AI Engineer - Production LLMs & Agentic Workflows

Doceree • United States

On-site
USD 140,000 - 210,000
Competitive Salary Package
Generous Leave Policy
Flexible Working Hours
+2
LLM-Powered AI Engineer: Production & Security
LLM-Powered AI Engineer: Production & Security

Cccis • United States

Remote
USD 140,000 - 190,000
401K Match
Paid time off
Annual Incentive Plan
+7
AI Engineer — Production-Grade LLM & Agent Systems
AI Engineer — Production-Grade LLM & Agent Systems

Awareson Sp. z o.o. • United States

Remote
USD 120,000 - 160,000
Senior AI Engineer: LLM Evaluation, Production & Optimization
Senior AI Engineer: LLM Evaluation, Production & Optimization

LawPro.ai • North Carolina

On-site
USD 140,000 - 190,000
Remote AI Engineer: Production LLM Apps & Agents
Remote AI Engineer: Production LLM Apps & Agents

aptendo • United States

Remote
USD 120,000 - 180,000
Production AI Engineer: LLM Systems & Orchestration
Production AI Engineer: LLM Systems & Orchestration

Data • Union City (NJ)

On-site
USD 120,000 - 150,000
Staff AI Engineer - Architect of Production LLM Systems
Staff AI Engineer - Architect of Production LLM Systems

Harnham • San Francisco (CA)

On-site
USD 180,000 - 240,000
Staff AI Engineer: Production LLM Lead
Staff AI Engineer: Production LLM Lead

Overnox • United States

Remote
USD 180,000 - 260,000