Senior AI/ML Security Engineer: Red Team LLMs

Markesman Group; Annapolis (MD); On-site; USD 120,000 - 150,000; Full time

Job summary

Markesman Group is seeking a Senior AI/ML Security Engineer to support evaluation, testing, and security assessments of AI/ML systems, including large language models (LLMs). The role operates on-site at Fort Meade, MD, with a focus on identifying vulnerabilities and developing automated testing frameworks in Python.

Applicants should have TS/SCI with Polygraph, 3+ years of AI/ML experience, and strong communication skills to document findings for both technical and non-technical stakeholders.

Qualifications

• Bachelor's degree and 3+ years of AI/ML experience, or 6+ years of related experience in lieu of a degree.
• Experience with Python development and automated testing.
• Experience in Linux environments and Docker containerization.
• Experience conducting security assessments or red-team activities.
• TS/SCI with Polygraph clearance.

Responsibilities

• Conduct security assessments and red-team evaluations of AI/ML systems, including LLMs.
• Develop automated testing and evaluation frameworks using Python.
• Identify model vulnerabilities, failure modes, data leakage, and other security concerns.
• Analyze AI/ML outputs and document findings for technical and non-technical stakeholders.
• Support deployment and testing of AI systems in Linux and containerized environments.
• Collaborate with intelligence analysts and technical teams to assess operational risks.
• Provide recommendations to improve the security and resilience of AI-enabled systems.
• Support development of AI security strategies and testing methodologies.

Skills

Python programming

Linux environments

Security assessments & red-team

Communication of findings

Education

Bachelor's degree in related field

Tools

Docker

Job description

Markesman Group is seeking a Senior AI/ML Security Engineer to support evaluation, testing, and security assessments of AI/ML systems, including large language models (LLMs). The role operates on-site at Fort Meade, MD, with a focus on identifying vulnerabilities and developing automated testing frameworks in Python.

Applicants should have TS/SCI with Polygraph, 3+ years of AI/ML experience, and strong communication skills to document findings for both technical and non-technical stakeholders.