Applied Scientist, Agentic AI & Governance

Amazon Inc.; Seattle (WA); On-site; USD 143,000 - 193,000; Full time

Benefits offered by this job

Health insurance

RSUs included

401(k) matching

Job summary

Amazon Development Center U.S., Inc. is seeking an Applied Scientist to advance its Governance, Risk, and Compliance AI systems within AWS. You will own end-to-end NLI modeling, calibrate thresholds, and maintain drift monitoring to ensure reliable compliance verdicts across frameworks.

You will help design decomposition pipelines, develop evidence linking, and improve agent-context representations. Collaboration with multiple pods and an agile cadence is essential for production-ready solutions.

Qualifications

• 2+ years of building models for business application experience.
• 2+ years of programming in Java, C++, Python or related language experience.
• 2+ years of hands-on predictive modeling and large data analysis experience.

Responsibilities

• Own the production NLI model end-to-end: fine-tune, promote, calibrate thresholds, and monitor for drift to ensure accurate compliance verdicts across frameworks.
• Design and implement framework decomposition pipelines that translate compliance controls into NLI hypotheses, including enrichment and per-framework threshold calibration.
• Build and improve the evidence auto-linking system using ranking, embedding, and reranking techniques, tuning precision-recall tradeoffs and addressing OCR quality challenges.
• Drive the quality flywheel by establishing labeling standards, designing offline and online evaluation methods, orchestrating retraining cycles, and ensuring privacy-safe data handling.
• Research and develop the agent-context capability - retrieval and representation of lifecycle signals, cross-framework knowledge, memory, grounding, and hallucination measurement - collaborating with engineering pods to bring these models into production.

Skills

Model development

Programming languages

Predictive modeling

Education

PhD in CS/ML/Engineering

Tools

Strands Agent

LangGraph

LLM post-training

Job description

Amazon Development Center U.S., Inc. is seeking an Applied Scientist to advance its Governance, Risk, and Compliance AI systems within AWS. You will own end-to-end NLI modeling, calibrate thresholds, and maintain drift monitoring to ensure reliable compliance verdicts across frameworks.

You will help design decomposition pipelines, develop evidence linking, and improve agent-context representations. Collaboration with multiple pods and an agile cadence is essential for production-ready solutions.