Agentic AI Scientist for GRC Production ML

Amazon Inc.; Seattle (WA); On-site; USD 143,000 - 193,000; Full time

Benefits offered by this job

Health insurance

RSUs

Sign-on payments

Paid time off

Parental leave

Job summary

Amazon in Seattle is seeking a ML/AI engineer to own production NLI models end-to-end, calibrate thresholds, and monitor drift for compliance verdicts across frameworks.

You will design framework-decomposition pipelines, improve evidence linking with ranking and OCR challenges, and drive governance for AI agents with privacy-safe data handling. This role offers growth and strong impact in a fast-paced environment.

Qualifications

• 2+ years of building models for business application experience.
• 2+ years of programming in Java, C++, Python or related language experience.
• 2+ years of hands-on predictive modeling and large data analysis experience.

Responsibilities

• Own the production NLI model end-to-end: fine-tune, promote, calibrate thresholds, and monitor for drift to ensure accurate compliance verdicts across frameworks.
• Design and implement framework decomposition pipelines that translate compliance controls into NLI hypotheses, including enrichment and per-framework threshold calibration.
• Build and improve the evidence auto-linking system using ranking, embedding, and reranking techniques, tuning precision-recall tradeoffs and addressing OCR quality challenges.
• Drive the quality flywheel by establishing labeling standards, designing offline and online evaluation methods, orchestrating retraining cycles, and ensuring privacy-safe data handling.
• Research and develop the agent-context capability — retrieval and representation of lifecycle signals, cross-framework knowledge, memory, grounding, and hallucination measurement.

Skills

Model building

NLI modeling

Model drift monitoring

Education

PhD in computer science

Tools

Strands Agent

LangGraph

Job description

Amazon in Seattle is seeking a ML/AI engineer to own production NLI models end-to-end, calibrate thresholds, and monitor drift for compliance verdicts across frameworks.

You will design framework-decomposition pipelines, improve evidence linking with ranking and OCR challenges, and drive governance for AI agents with privacy-safe data handling. This role offers growth and strong impact in a fast-paced environment.