Agentic AI Scientist - Research & Evaluation

Johns Hopkins University; Gaithersburg (MD); On-site; USD 80,000 - 100,000; Full time

Job summary

Johns Hopkins University is seeking a PREP Research Associate to advance agentic AI research within the NIST PREP program. You will design, develop, and evaluate AI agents, build experimental platforms, and contribute to benchmarks and methodologies for safe, trustworthy agentic AI across multiple domains.

The role emphasizes collaboration with researchers and stakeholders to transition findings into practical tools and standards that support government and industry partners.

Qualifications

• Experience conducting research in artificial intelligence, machine learning, or related fields.
• Experience designing or evaluating AI agents or autonomous systems.
• Ability to develop benchmarks, testbeds, or evaluation frameworks for AI systems.
• Ability to translate research findings into practical tools or guidance.

Responsibilities

• Design, develop, and evaluate AI agents and agentic AI systems.
• Build experimental platforms and demonstrations to assess capabilities.
• Conduct advanced research and develop methodologies and benchmarks.
• Collaborate with researchers to advance trustworthy agentic AI.
• Support transition of research into practical tools and guidance.

Skills

AI research

Agentic AI

Multi-agent systems

LLMs

Tool-using AI

Job description

Johns Hopkins University is seeking a PREP Research Associate to advance agentic AI research within the NIST PREP program. You will design, develop, and evaluate AI agents, build experimental platforms, and contribute to benchmarks and methodologies for safe, trustworthy agentic AI across multiple domains.

The role emphasizes collaboration with researchers and stakeholders to transition findings into practical tools and standards that support government and industry partners.