Threat Investigator

10a Labs; Greater London; Hybrid; GBP 50,000 - 70,000; Full time

Job summary

A leading technology firm is seeking a Threat Investigator to join their investigations team in London. The role involves detecting and investigating malicious use of their platform, working with sensitive content, and requires strong technical skills in SQL and Python. Candidates should have at least 3 years of experience in Trust & Safety or related fields. This position includes on-call responsibilities to address urgent matters outside standard hours, offering a dynamic work environment with a significant impact on user safety.

Qualifications

• Minimum 3 years in Trust & Safety or related fields.
• Strong SQL and Python programming skills required.
• Experience working with sensitive subject matters.

Responsibilities

• Detect and reacquire bad actors on the platform.
• Investigate policy violations using SQL and Python.
• Document findings and share with stakeholders.

Skills

SQL proficiency

Python proficiency

Investigative experience

Technical investigative skills

Ability to manage escalations

Job description

About 10a Labs: 10a Labs is the safety and threat-intelligence layer trusted by frontier AI labs, AI unicorns, Fortune 10 companies, and leading global technology platforms. Our adversarial red teaming, model evaluations, and intelligence collection enable engineering, safety, and security teams to stay ahead of evolving threats and deploy AI systems safely.

10a Labs’ Investigations Team needs additional support to respond to critical safety incidents and conduct investigations across a range of abuse areas, including but not limited to Violence, Hate, Mental Health, CBRNE, Child Safety, Cyber Abuse and more.

About the Role:

As a Threat Investigator, you will be supporting our London-based Europe, Middle East, and Africa (EMEA) Investigations Team. You will be responsible for detecting and/or responding to malicious use and abuse on our platform, investigating activity, drafting reports based on your findings, and making recommendations. This will require technical experience investigating threat actors, harmful behaviors, cyber abuse, and/or other activities; as well as a strong ability to use SQL and Python to query, transform, and understand data. You will also respond to escalations and reactive leads, including those that are not caught by our existing safety systems.

Investigations involve sensitive and distressing content, including sexual, violent, or otherwise-disturbing material.

This role includes serving in an on-call capacity that will involve resolving urgent escalations outside of normal work hours, occasionally including evenings and weekends. The typical on-call rotation is 7 consecutive days per 2 months, though this may shift based on operational needs and candidates should be prepared to remain flexible.

In this role, you will:

• Proactively detect and reacquire bad actors on our platform.
• Investigate potentially policy-violating activity by querying internal data sources (using SQL and Python) and cross-referencing open source information (OSINT).
• Document and share investigative findings with internal stakeholders.

Requirements:

• At least 3+ years of related investigative experience in Trust & Safety, National Security, Defense, Intelligence, or Law Enforcement domains working on related topics; must be willing to work on sensitive subject matter including child safety.
• Europe, Middle East, or Africa-based, with the ability to work London/GMT hours (9am - 5pm GMT).
• Ability to be on-call that will involve resolving urgent escalations outside of normal work hours, including occasional evenings and weekends.
• Strong SQL and Python proficiency and/or additional programming skills.
• Strong and applicable technical investigative skillset with ability to develop and maintain detection pipelines.
• Ability to rapidly context switch across domains, modalities, and abuse areas.
• Excited to work in a fast paced, ambiguous, and purposeful space with high impact across users and beyond.

Desired Qualities (but not required):

• Based in London, UK preferred, but not required. This is a remote position.
• Expertise with risk and abuse related to AI platforms.
• EMEA geopolitical expertise and/ or professional experience as an EMEA-based Threat Investigator.
• Full professional proficiency in Arabic, Chinese, Farsi, Portuguese, Russian, or Spanish.
• Have experience scaling and automating detection and mitigation processes.
• Familiarity using language models to scale.
• Familiarity with one of the following topics/areas: violence, extremism, child safety, prompt injection, litigation, scams and fraud abuse, radicalization/persuasion/grooming, hateful activities and groups.