ML Engineer, Trust & Safety [Hapiko]

Jobgether

United States

Remote

USD 98,000 - 131,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Remote-first
Toronto-based opportunity
Flexible hours
Comprehensive benefits
Career development
Innovative AI tech
Collaborative culture
Professional impact
Inclusive workplace
Engaging environment

Job summary

Jobgether is seeking a Trust & Safety engineer to own and enhance the end-to-end content moderation pipeline. You will build safeguards for AI-generated content, develop evaluation frameworks, and maintain incident response playbooks.

You will collaborate with ML, Backend, and Platform teams to embed safety in new features, and you will continuously improve moderation systems as the product scales. The role emphasizes responsibility, independent leadership of critical initiatives, and a strong

Qualifications

  • Experience in applied Trust & Safety engineering for consumer products.
  • Strong Python software engineering for production-grade moderation pipelines.
  • Proven track record building or improving ML classifiers for harmful content.
  • Understanding of moderation methodologies and safety systems.
  • Experience designing evaluation suites to measure model safety impact.
  • Ability to balance precision/recall and tuning thresholds.
  • Experience with red-teaming, adversarial testing and vulnerability identification.
  • Ability to build reliable, fail-safe production systems for sensitive content.

Responsibilities

  • Own end-to-end content moderation pipeline safety.
  • Develop safeguards for AI-generated content and copyrighted material.
  • Expand safety evaluation frameworks and thresholds.
  • Define criteria to deploy new models and prompts with safety.
  • Improve classifiers for harmful content and decide tool usage.
  • Balance moderation precision with user protections and minimize false positives.
  • Run red-team exercises to identify model and pipeline weaknesses.
  • Develop internal review tools for investigating content and parent reports.
  • Own incident response procedures and runbooks for safety issues.
  • Overlap safety with data retention and privacy compliance.
  • Collaborate with ML, Backend, and Platform teams to embed safety in features.
  • Monitor safeguards and expand as product scales internationally.
  • Maintain reliable, scalable moderation systems.

Skills

Python
ML classifiers
Content moderation
Red-teaming
Incident response
Data privacy
Collaboration
Decision making
Ownership mindset

Job description

Accountabilities:
  • Own and maintain the end-to-end content moderation pipeline, ensuring safety at every stage, from children's voice requests to the final AI-generated images and printed stickers.
  • Develop and maintain technical safeguards for AI-generated content, including the detection and handling of potentially harmful, inappropriate, copyrighted, or licensed character-related material.
  • Build, expand, and maintain safety evaluation frameworks to measure moderation performance and assess the impact of changes to models, prompts, and classification thresholds.
  • Define and manage evaluation criteria to determine whether new models, prompts, and moderation configurations meet safety standards before being deployed to production.
  • Continuously improve machine learning classifiers for harmful content detection, evaluating when internally developed models or third-party solutions are most appropriate.
  • Optimize moderation systems by balancing precision and recall, reducing unnecessary content blocking while maintaining strong protection for children.
  • Conduct ongoing red-team exercises to identify vulnerabilities, potential misuse scenarios, and weaknesses across models and moderation workflows.
  • Develop and maintain internal review tools that enable teams to investigate flagged content, assess moderation decisions, and respond to parent reports.
  • Own and continuously improve incident response procedures and operational runbooks for safety-related issues.
  • Manage the technical implementation of compliance requirements, including data retention, deletion, and other relevant data protection practices.
  • Collaborate closely with Machine Learning, Backend, and Platform Engineering teams to integrate safety requirements into new models, product features, and technical infrastructure before release.
  • Monitor the effectiveness of existing safeguards, identify emerging risks, and implement continuous improvements as the product expands internationally.
  • Establish and maintain reliable, scalable, and fail-safe moderation systems that support a growing user base and evolving AI capabilities.
Requirements:
  • Demonstrated professional experience in applied Trust & Safety engineering, particularly developing safety solutions for products used by real customers.
  • Strong software engineering expertise in Python, with the ability to develop, deploy, and maintain production-grade code within performance-sensitive moderation pipelines.
  • Proven experience building and improving machine learning classifiers or evaluation frameworks for harmful content detection, rather than simply configuring third-party moderation APIs.
  • Solid understanding of content moderation methodologies, machine learning safety systems, and techniques for identifying inappropriate or harmful AI-generated content.
  • Practical experience designing and maintaining evaluation suites to measure model performance, validate safety improvements, and assess the impact of technical changes.
  • Strong understanding of precision and recall trade-offs, with the ability to establish appropriate classification thresholds and balance false positives against false negatives.
  • Experience optimizing moderation systems to minimize unnecessary restrictions while maintaining effective protection against harmful content.
  • Familiarity with red‑teaming methodologies, adversarial testing, and identifying vulnerabilities in AI models and content generation pipelines.
  • Ability to develop reliable, efficient, and fail‑safe production systems, particularly in environments where incorrect moderation decisions can have significant consequences.
  • Understanding of incident response practices, safety investigations, and operational procedures for managing sensitive content‑related issues.
  • Familiarity with data privacy, retention, deletion, and technical compliance requirements.
  • Strong collaboration skills, with the ability to work effectively alongside machine learning, backend, and platform engineering teams.
  • Excellent analytical and problem‑solving abilities, combined with sound technical judgment and the capacity to make informed decisions under pressure.
  • A proactive and ownership‑driven mindset, with the ability to independently lead critical engineering initiatives and establish technical processes from the ground up.
  • Genuine interest in responsible AI development and creating safe, trustworthy digital experiences for children.
Benefits:
  • Competitive compensation: Annual salary ranging from CA$136,700 to CA$182,300 for Ontario-based candidates, depending on experience, qualifications, and relevant expertise.
  • Remote working opportunities: Remote-first arrangements, with the advertised opportunity available in Toronto.
  • Flexible working hours: Flexibility to organize your schedule and support a healthy work‑life balance.
  • Comprehensive benefits: Access to a broad benefits package.
  • Career development: Opportunities for professional growth, career progression, and internal mobility.
  • Innovation‑driven environment: Work on pioneering AI‑powered technologies and contribute to the development of safe digital experiences for children.
  • Collaborative culture: Join a hands‑on, dynamic engineering environment that encourages creativity, teamwork, and meaningful contributions.
  • Professional impact: Take ownership of a critical Trust & Safety engineering function and influence the development of safety standards and infrastructure.
  • Inclusive workplace: Join an organization committed to accessibility, diversity, and equal employment opportunities.
  • Engaging work environment: Be part of a creative and fast‑paced team that values innovation, collaboration, and fun.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Engineer, Trust & Safety [Hapiko]
ML Engineer, Trust & Safety [Hapiko]

Ladders • United States

Remote
USD 137,000 - 182,000
Remote work
Innovative team
Generative AI exposure
+2
Backend Platform Engineer - Hapiko
Backend Platform Engineer - Hapiko

Jobgether • United States

Remote
USD 98,000 - 131,000
Remote-first
Toronto-based opportunity
Flexible hours
+7
Head of Trust & Safety
Head of Trust & Safety

Magic School, Inc. • United States

Remote
USD 180,000 - 280,000
Unlimited time off
Employer-paid health insurance
Stock options
+2
Head of Trust & Safety
Head of Trust & Safety

TrulyHired • United States

Remote
USD 180,000 - 280,000
Head of Trust & Safety
Head of Trust & Safety

OpenKrill • United States

Remote
USD 170,000 - 230,000
Unlimited time off
Health insurance
Stock options
+1
Head of Trust & Safety
Head of Trust & Safety

MagicSchool AI • Oregon

Hybrid
USD 140,000 - 200,000
Unlimited time off
Employer-paid health insurance
Stock options
+3
Head of Trust & Safety
Head of Trust & Safety

MagicSchool AI • Denver (CO)

Remote
USD 140,000 - 200,000
Unlimited time off
Employer-paid health insurance
Stock options
+2
ML Engineer, Trust & Safety [Hapiko]
ML Engineer, Trust & Safety [Hapiko]

Spin Master • New York (NY)

On-site
USD 137,000 - 182,000
Growth opportunities
Flexible hours
Innovation & Fun
+2
Head of Trust & Safety
Head of Trust & Safety

MagicSchool AI • United States

Remote
USD 150,000 - 210,000
Unlimited time off
Stock options
401k match & wellness stipend
Safeguards Enforcement Lead, User Well-Being
Safeguards Enforcement Lead, User Well-Being

Anthropic • United States

Hybrid
USD 285,000 - 330,000