Applied Scientist: Agentic AI for Compliance

Amazon Web Services (AWS); Arlington (VA); On-site; USD 143,000 - 193,000; Full time

Benefits offered by this job

Health insurance

RSUs

401(k) matching

Job summary

Amazon Development Center U.S., Inc. is seeking an Applied Scientist to own the production NLI model central to our GRC compliance engine. You will fine-tune, calibrate thresholds, and monitor for drift, shaping how evidence is linked and how agent-context systems operate in production.

You will design and implement decomposition pipelines translating controls into hypotheses and drive evaluation methods, retraining cycles, and privacy-safe data handling across multiple frameworks.

Qualifications

• 2+ years building models for business applications.
• 2+ years programming in Java/C++/Python or related language.
• 2+ years hands-on predictive modeling and large data analysis.

Responsibilities

• Own the production NLI model end-to-end: fine-tune, promote, calibrate thresholds, monitor drift.
• Design framework decomposition pipelines translating controls into NLI hypotheses.
• Build and improve evidence auto-linking using ranking, embedding, and reranking.

Skills

Model building

Programming: Java/C++/Python

Predictive modeling

Data analysis

Education

PhD in CS/ML

Job description

Amazon Development Center U.S., Inc. is seeking an Applied Scientist to own the production NLI model central to our GRC compliance engine. You will fine-tune, calibrate thresholds, and monitor for drift, shaping how evidence is linked and how agent-context systems operate in production.

You will design and implement decomposition pipelines translating controls into hypotheses and drive evaluation methods, retraining cycles, and privacy-safe data handling across multiple frameworks.