Senior AI Security Engineer — Generative AI & Autonomy

Compass; New York (NY); On-site; USD 180,000 - 240,000; Full time

Job summary

Compass is embedding generative and agentic AI into products used by agents and clients. You will own the security of that surface, acting as the technical authority on how AI features are built safely—from the model and retrieval layer to client-facing outputs.

You will partner with the AI platform and product engineering teams to define security standards, perform threat modeling, and deploy real-time protections across LLM inputs/outputs and multi-agent workflows.

Qualifications

• 7+ years in security engineering, with 2+ years focused on AI/ML or LLM security.
• Experience threat modeling complex distributed systems and driving remediation with engineering teams.
• Demonstrated experience securing a production AI or ML system end to end, development lifecycle, deployment, and runtime.
• Expertise in adversarial ML and LLM risks including prompt injection, model poisoning, data extraction, and unsafe tool use, with hands‑on red teaming experience.
• Background building evaluation and safety-testing harnesses for LLM applications.

Responsibilities

• Own the AI product security roadmap. Define the multi-year vision, strategy, and standards for securing AI capabilities in the Compass platform, developed jointly with the AI platform and product engineering teams.
• Threat model AI capability builds. Drive architectural reviews and threat modeling for new AI features, RAG pipelines, multi-agent workflows, and automated decisioning before they ship.
• Build production guardrails. Architect, deploy, and automate real-time protections for LLM inputs and outputs, including injection mitigation, jailbreak defense, output verification, and sensitive-data egress checks on generated responses.
• Constrain autonomy. Design blast-radius controls for autonomous agents: scoped permissions, human-in-the-loop checkpoints for consequential actions, action audit trails, and safe tool-invocation patterns.
• Secure the retrieval layer. Enforce data access controls, source integrity, tenancy boundaries, and retrieval-boundary protections across RAG and vector store implementations.
• Harden the AI supply chain. Assess the security posture, privacy controls, data retention, and training-use terms of third-party foundation models, inference providers, and vector stores used in production.
• Instrument and detect. Build detections and telemetry for AI-specific abuse in production, anomalous tool invocation, prompt abuse patterns, unusual retrieval behavior, and data exfiltration through model responses and integrate them into our monitoring estate.
• Automate the standard. Ship reusable libraries, CI/CD checks, and evaluation harnesses so secure AI patterns are the default path for product engineers rather than a review gate.
• Advise and evangelize. Act as the primary technical consultant for AI architecture decisions and translate emerging AI risk into concrete engineering roadmaps for both engineers and executives.

Skills

Python

Go

AI security

Threat modeling

Security architecture

Cloud security

DevSecOps

Threat detection

Communication

Adversarial ML

Tools

AWS

GCP

Kubernetes

IAM

CI/CD tooling

Vector stores

MITRE ATLAS

Job description

Compass is embedding generative and agentic AI into products used by agents and clients. You will own the security of that surface, acting as the technical authority on how AI features are built safely—from the model and retrieval layer to client-facing outputs.

You will partner with the AI platform and product engineering teams to define security standards, perform threat modeling, and deploy real-time protections across LLM inputs/outputs and multi-agent workflows.