GenAI Analyst

ActiveFence; United Kingdom; On-site; GBP 40,000 - 60,000; Full time

Job summary

A leading security solutions provider in the UK is seeking a driven GenAI Analyst to analyze content infringements in Generative AI tools. Responsibilities include developing adversarial prompt strategies, managing various projects, and collaborating with diverse teams to enhance AI safety. Candidates should have a background in AI safety and a strong command of English. This role requires attention to detail and the ability to manage multiple tasks in a fast-paced environment.

Qualifications

• Background in AI Safety and/or Responsible AI and/or AI Ethics is required.
• Near-native level command of English is a must.
• Experience with various model types and OSINT is a plus.

Responsibilities

• Develop adversarial prompt strategies to expose vulnerabilities in models.
• Manage projects from planning to delivery.
• Handle extensive datasets across multiple languages.
• Investigate tactics for circumventing safety measures.
• Work with diverse teams to tackle challenges.

Skills

Attention to detail

Organizational capabilities

Task juggling

AI Safety knowledge

Familiarity with Generative AI models

Job description

GenAI Analyst

• Intelligence
• UK
• Intermediate
• Full-time

Description

ActiveFence is seeking a driven, detail-focused professional to become a vital part of our team as a Generative AI Analyst. In this role, you'll dive into the cutting-edge of technology, meticulously analyzing various content infringements to secure the new wave of Generative AI tools. Your duties will include collaborating with experts in diverse fields such as Hate Speech, Misinformation, Intellectual Property and Copyright, Child Safety, among others.

Your tasks will involve writing adversarial; prompts to identify weaknesses in various AI models, including Large Language Models (LLMs), Text-to-Image, Text-to-Video, and beyond. You'll also oversee data management to guarantee the highest quality of outputs.

Responsibilities:

• Developing adversarial and risky prompt strategies across several areas of abuse to expose potential vulnerabilities in models.
• Managing projects end-to-end, from initial planning and oversight through quality assurance to final delivery.
• Handling extensive datasets across multiple languages and areas of abuse, ensuring precision and meticulous attention to detail.
• Ongoing investigation into new tactics for circumventing foundational models' safety measures.
• Working alongside diverse teams, engineering, product, policy, to tackle new challenges and craft forward-thinking strategies and resolutions.
• Promoting a culture of knowledge exchange and continual learning within the team.

Requirements

Must have:

• Background in AI Safety and/or Responsible AI and/or AI Ethics
• Familiarity with recent Generative AI models and agents is essential, though direct technical experience is not a prerequisite.
• Command of English at a near-native level.
• Attention to detail, organizational capabilities, and the capacity to juggle numerous tasks concurrently.

Additional Wants:

• Experience with various model types (Text-to-Text, Text-to-Image) is desirable.
• Prior experience with OSINT (Open Source Intelligence) will be considered an asset.
• A self-starter attitude, with the energy to excel in a fast-moving and variable environment.

About ActiveFence

ActiveFence is the leading provider of security and safety solutions for online experiences, safeguarding more than 3 billion users, top foundation models, and the world’s largest enterprises and tech platforms every day.

As a trusted ally to major technology firms and Fortune 500 brands that build user-generated and GenAI products, ActiveFence empowers security, AI, and policy teams with low-latency Real-Time Guardrails and a continuous Red Teaming program that pressure-tests systems with adversarial prompts and emerging threat techniques. Powered by deep threat intelligence, unmatched harmful-content detection, and coverage of 117+ languages, ActiveFence enables organizations to deliver engaging and trustworthy experiences at global scale while operating safely and responsibly across all threat landscapes.