Founding ML Engineer: AI Compliance & Trust Platform

SourceIn; San Francisco (CA); Hybrid; USD 180,000 - 250,000; Full time

Job summary

SourceIn is building an AI monitoring and assurance platform that evaluates customer interactions against regulations and business requirements. You’ll own the intelligence from compliance detection to production ML observability, shaping how enterprises measure and demonstrate accountability.

As a founding ML engineer, you will work closely with the CTO, guide evaluation practices, and mentor the engineering team while staying hands-on with Python and modern ML systems in a rapidly evolving

Qualifications

• Production ML experience with NLP/LLM systems in real-world settings.
• Strong evaluation pipelines and ground-truthing from noisy labels.
• Experience in early-stage startups with ambiguity and ownership.

Responsibilities

• Own compliance detection, hallucination monitoring, scoring architecture.
• Design evaluation frameworks and data flywheel.
• Build detectors for compliance, grounding, risk, and interaction quality.
• Collaborate with CTO and QA/compliance teams; mentor engineers.
• Ensure production observability and monitoring for regressions.

Skills

Python

LLMs

NLP

Machine Learning

AWS

Leadership

Evaluation pipelines

Compliance knowledge

Tools

LLM-based judges

Rules & classifiers

Job description

SourceIn is building an AI monitoring and assurance platform that evaluates customer interactions against regulations and business requirements. You’ll own the intelligence from compliance detection to production ML observability, shaping how enterprises measure and demonstrate accountability.

As a founding ML engineer, you will work closely with the CTO, guide evaluation practices, and mentor the engineering team while staying hands-on with Python and modern ML systems in a rapidly evolving