GenAI Research Scientist — NIST PREP Project

Johns Hopkins University; Gaithersburg (MD); On-site; USD 28,000 - 33,000; Full time

Job summary

Johns Hopkins University is seeking a PREP Research Associate to support the NIST GenAI evaluation program. You will develop AI evaluation infrastructure, design databases, and work on deepfake related projects while collaborating with a broad research team.

The role involves building and maintaining software for AI/ML experiments, handling big data, and delivering evaluation results that align with program goals. U.S. citizen preferred for some tasks.

Qualifications

• Proficiency in one or more mainstream programming languages used in scientific and networking domains.
• Familiarity with REST-based applications and networking basics.
• Shell scripting (Bash, Zsh, etc.) is a plus.
• Experience with virtualization and cloud stacks (Docker, Kubernetes, AWS).

Responsibilities

• Install, develop, and deploy software for AI/ML based systems on a GPU cluster.
• Conduct AI evaluation series across text, audio, image, video, and code modalities.
• Design experiments and curate datasets for robust evaluation.
• Develop baseline algorithms for generative AI and improve existing infrastructure.
• Contribute to reports aligning with GenAI program objectives.

Skills

Python

Java

JavaScript

Ruby

R

C

C++

Rust

Tools

Docker

Kubernetes

AWS

REST APIs

Job description

Johns Hopkins University is seeking a PREP Research Associate to support the NIST GenAI evaluation program. You will develop AI evaluation infrastructure, design databases, and work on deepfake related projects while collaborating with a broad research team.

The role involves building and maintaining software for AI/ML experiments, handling big data, and delivering evaluation results that align with program goals. U.S. citizen preferred for some tasks.