Applied Scientist: Agentic AI & NLI Governance

Amazon Web Services (AWS); Arlington (VA); Presencial; USD 143.000 - 193.000; Tempo integral

Benefícios oferecidos por esta vaga

Health insurance

RSUs

401(k) matching

Paid time off

Parental leave

Resumo da vaga

Amazon Development Center U.S., Inc. is seeking an Applied Scientist to own the production Natural Language Inference (NLI) model within our AWS GRC service.

You will fine-tune, calibrate, and monitor the model in production, and design the science behind framework decomposition and evidence auto-linking for AI agents. You will work on retrieval, grounding, and hallucination measurement, collaborating with engineering pods to bring models into production and improve trustworthiness of

Qualificações

• 2 years of building models for business application experience.
• 2 years of programming in Java, C, Python or related language experience.
• 2 years of hands-on predictive modeling and large data analysis experience.

Responsabilidades

• Own the production NLI model end-to-end: fine-tune, promote, calibrate thresholds, and monitor for drift to ensure accurate compliance verdicts across frameworks.
• Design and implement framework decomposition pipelines that translate compliance controls into NLI hypotheses, including enrichment and per-framework threshold calibration.
• Build and improve the evidence auto-linking system using ranking, embedding, and reranking techniques, tuning precision-recall tradeoffs and addressing OCR quality challenges.
• Drive the quality flywheel by establishing labeling standards, designing offline and online evaluation methods, orchestrating retraining cycles, and ensuring privacy-safe data handling.
• Research and develop the agent-context capability — retrieval and representation of lifecycle signals, cross-framework knowledge, memory, grounding, and hallucination measurement.

Conhecimentos

Java

C

Python

Formação

PhD in computer science, machine learning, engineering, or related fields

Descrição da vaga

Amazon Development Center U.S., Inc. is seeking an Applied Scientist to own the production Natural Language Inference (NLI) model within our AWS GRC service.

You will fine-tune, calibrate, and monitor the model in production, and design the science behind framework decomposition and evidence auto-linking for AI agents. You will work on retrieval, grounding, and hallucination measurement, collaborating with engineering pods to bring models into production and improve trustworthiness of