Trust and Safety Analyst (CONTRACT)

Coyle Consulting; Dublin; On-site; EUR 90,000 - 120,000; Full time

Job summary

Coyle Consulting in Ireland is seeking a seasoned Trust & Safety professional to mitigate risks across shopping experiences. The role combines policy expertise with analytical rigor and an interest in AI-powered tooling.

You will work with engineering and vendor teams to translate policy into scalable solutions, develop enforcement frameworks, and drive cross-functional initiatives across data labelling, model evaluation, and anomaly detection.

Qualifications

• 5–7 years of Trust & Safety experience.
• Strong understanding of Trust & Safety policies and enforcement.
• Strong analytical ability.
• Experience working in operational environments.
• Experience writing or developing policies, guidelines, or enforcement rules.
• Ability to work cross-functionally with engineering, operations, vendors, and other stakeholders.
• Ability to independently manage projects and drive initiatives forward.

Responsibilities

• Analyze Trust & Safety risks and trends across shopping and e-commerce.
• Develop and maintain policies, guidelines, and enforcement frameworks for risks.
• Review and analyze labelled data produced by operations or vendor teams.
• Support the development and launch of new classifiers for identifying policy violations in listings.
• Partner closely with engineering teams to translate policy requirements into scalable technical solutions.
• Coordinate with external vendor teams responsible for data labelling and enforcement.
• Investigate anomalies and changes in North Star metrics, reporting trends.
• Respond to escalations and coordinate appropriate enforcement responses.
• Develop scalable solutions to recurring Trust & Safety problems.
• Build datasets and evaluation frameworks to assess AI and ML systems.
• Explore and apply LLM-based tools and automation to improve workflows.
• Use AI tools to augment analysis and productivity, potentially building internal agents.
• Manage projects involving multiple stakeholders and drive initiatives.

Skills

Trust & Safety policy

Analytical thinking

Cross-functional collaboration

SQL querying

LLMs & AI tooling

Policy enforcement

Data trend analysis

Tools

Data labelling tools

Model evaluation tools

Job description

The role sits at the intersection of Trust & Safety, operations, policy, data analysis, and applied AI. The person will help identify and mitigate risks across Shopping and e-commerce experiences, working closely with engineering, vendors, and cross-functional stakeholders.

The ideal candidate is a strong independent operator who can combine deep Trust & Safety policy expertise with analytical thinking and an interest in emerging technologies such as LLMs, machine learning, and AI-powered tooling.

Core Responsibilities

• Analyze Trust & Safety risks and trends across Shopping and e-commerce experiences.
• Develop and maintain policies, guidelines, and enforcement frameworks for emerging and existing risks.
• Review and analyze labelled data produced by operational/vendor teams.
• Support the development and launch of new classifiers for identifying policy violations in listings.
• Partner closely with engineering teams to translate policy requirements into scalable technical solutions.
• Coordinate with external vendor teams responsible for data labelling and operational enforcement.
• Investigate anomalies and changes in North Star metrics, identifying potential Trust & Safety issues and reporting on trends.
• Respond to escalations and coordinate appropriate enforcement responses.
• Develop scalable solutions to recurring Trust & Safety problems.
• Build datasets and evaluation frameworks to assess the performance of AI and machine-learning systems.
• Explore and apply LLM-based tools and automation to improve operational workflows.
• Use AI tools to augment analysis, improve efficiency, and potentially build internal agents or automated workflows.
• Manage projects and programs involving multiple stakeholders and teams.
• Work independently, identify opportunities for improvement, and take initiative without requiring extensive direction.

Key Skills & Experience

• Approximately 5–7 years of Trust & Safety experience.
• Strong understanding of Trust & Safety policies and enforcement.
• Strong analytical ability.
• Experience working in operational environments.
• Experience writing or developing policies, guidelines, or enforcement rules.
• Ability to work cross-functionally with engineering, operations, vendors, and other stakeholders.
• Ability to independently manage projects and drive initiatives forward.

Technical / Analytical

• SQL querying experience.
• Ability to analyze datasets and identify trends, anomalies, and patterns.
• Understanding of machine-learning concepts and how models are trained and evaluated.
• Experience with training data, data labelling, and model evaluation.
• Familiarity with LLMs and how they are developed, trained, curated, and evaluated.
• Experience using AI tools to augment productivity or analytical work.
• Interest or experience in building AI agents or automated workflows.

Nice to Have

• Cybersecurity experience.
• Experience working with large-scale e-commerce or marketplace platforms.
• Program or project management experience.