AI Engineer, Platform

present of AI; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Readily is building the shared AI foundation that engineers use to ship language model features quickly and safely. The role covers retrieval, prompting, evaluation and model routing in a regulated healthcare context, where outputs must be defensible and traceable.

You will ship production LM systems using Python and TypeScript, reinforce solid backend basics, document clearly, and help unblock colleagues through thoughtful tooling and monitoring.

Qualifications

• This role requires shipping LM systems in production and a habit of measuring quality.
• Candidate writes clean Python and TypeScript.
• Strong backend fundamentals and documentation to unblock teammates.

Responsibilities

• Build the shared AI foundation used by engineers for retrieval, prompting, evaluation and routing.
• Ensure model outputs are traceable and defensible under regulated requirements.
• Develop evaluation harnesses and monitoring to keep quality steady.
• Operate a model gateway with routing and cost tracking.

Skills

Python

TypeScript

Retrieval

RAG

Agents

Evaluation

Monitoring

Backend

Documentation

Cloud basics

Tools

Git

CI/CD

AWS

Docker

Job description

This role builds the shared AI foundation other engineers use, covering retrieval, prompting, evaluation and model routing so product teams can ship language model features quickly and safely. A strong candidate has shipped language model systems in production, writes clean Python and TypeScript, and treats measurement as the way to judge quality. The work also calls for solid backend basics and a habit of documenting and unblocking others.

How it fits the AI era

The role sits at the center of how AI gets used in a regulated field, where answers must be cited and defensible. Much of the craft is making model output traceable to source rules and keeping quality steady through evaluation and monitoring. The human parts are judgment about tradeoffs, clean design of shared tools, and care with details that carry real stakes.

How it builds AI experience

A person here would gain hands on work with retrieval, agents, structured outputs and evaluation harnesses, plus running a model gateway with routing and cost tracking. Because the company maps healthcare regulations to clinical policies, that experience would center on grounded, auditable answers rather than open ended chat. Building evaluation and tracing habits early would prepare someone well for this kind of platform work.

Worth showing

• Production LLM systems
• RAG and agents
• Python and TypeScript
• Evals and monitoring
• Backend and cloud basics

This is our own read, written from the employer's posting and the company's Spotlight. The employer's posting is the source of truth for the role.

About Readily

Readily develops an artificial intelligence compliance platform that maps healthcare regulations to internal clinical policies to automate gap analysis and audit readiness, per the company.