Applied AI Engineer, LLMs & Guardrails for Production

FICO; United States; Remote; USD 105,000 - 165,000; Full time

Benefits offered by this job

Competitive compensation

Health benefits

Work-life balance

Job summary

FICO is hiring an Applied AI engineer to own the quality, safety, and performance of AI-powered consumer features. You will combine Python and Java backend work with hands-on LLM experience to curate prompts, evaluate results, and ensure safe, compliant outputs.

You will build evaluation tooling, run regression suites, and ship AI improvements through A/B tests, with a focus on reliability, latency, and cost efficiency.

Qualifications

• Experience building and operating LLM-powered applications in production.
• Proficient with prompt design, tool calling, structured outputs and streaming.
• Production ownership including CI/CD and on-call support.

Responsibilities

• Own the AI prompts, tool descriptions, and evaluation prompts for AI features.
• Build and grow evaluation framework and regression test suites.
• Design and monitor guardrails, including PII redaction and compliance rules.
• Lead model upgrades and measure quality, cost, and latency.

Skills

Python

Java

LLM

AWS

Education

Bachelor's or Master's in Computer Science or related field

Tools

Spring Boot

Datadog

Tableau

Job description

FICO is hiring an Applied AI engineer to own the quality, safety, and performance of AI-powered consumer features. You will combine Python and Java backend work with hands-on LLM experience to curate prompts, evaluate results, and ensure safe, compliant outputs.

You will build evaluation tooling, run regression suites, and ship AI improvements through A/B tests, with a focus on reliability, latency, and cost efficiency.