Founding ML Engineer Senior Level $200,000-$250,000 View →

Nguyening Strategies Group; San Francisco (CA); Remote; USD 200,000 - 250,000; Full time

Job summary

Nguyening Strategies Group is seeking a Senior ML leader to own the compliance and intelligence layer end to end, collaborating with the CTO to ensure AI-led interactions are accurate, grounded, and safe.

You will be the first dedicated ML hire, inherit a running production pipeline, write code regularly, and establish the measurement practice the company relies on. You will hire ML engineers and set the technical bar for them.

Qualifications

• 6+ years of experience in ML/NLP/LLM systems.
• Staff or principal depth in applied ML, NLP, or LLM systems.
• Hands-on production ML experience with models at scale.
• Startup experience is required.
• Ability to work with limited training data and generate data when needed.
• Own production ML work without a separate MLOps team.

Responsibilities

• Own compliance, hallucination, and scoring architecture for detectors, with risk and accuracy trade-offs.
• Oversee data flywheel: annotation guidelines, evaluation, and per-customer reporting.
• Build tooling for rubric onboarding, active-learning loops, and production detectors.
• Improve speech quality and evaluate ASR/diarization as raw audio ingestion comes online.
• Manage production economics: latency, cost, and monitoring for drift and quality.
• Hire ML engineers and set the technical bar for the team.

Skills

Applied ML depth

NLP

LLM systems

Production engineering

Python

Startup experience

Tools

Python

Job description

Remote San Francisco, CA New York, NY (United States) Senior Level $200,000-$250,000 Posted 12 days ago Full-Time

About the role

The Role

You'll own the company's compliance and intelligence layer end to end and work with the CTO on making AI-led interactions accurate, grounded, and safe. You'll write code regularly, decide what is a model problem and what isn't, and build the measurement practice the company relies on.

You are the first dedicated ML hire. You inherit a running production pipeline and real design-partner data, not a blank repository. Our test suite fails if an unearned compliance claim, an ungrounded model output, or an unmeasured accuracy number ships. You'll hire the ML engineers who follow and set the technical bar for them.

What You'll Own

• Compliance, hallucination, and scoring architecture. Turn customer and regulatory rubrics into measurable detectors for disclosures, violations, grounding and hallucination failures, risk, escalation, and quality. Choose the right mix of rules, classifiers, judges, and fallbacks, and set confidence and promotion thresholds against explicit accuracy, cost, and risk trade-offs.
• Evaluation and the data flywheel. Own annotation guidelines, adjudication, offline and online evaluation, regression gates, and per-customer reporting across compliance, grounding, and quality. Turn QA reviews, disputes, and human-versus-machine agreement into training data, and use synthetic data only where it improves downstream accuracy.
• Rubric onboarding. Build the tooling, prompts, datasets, and active-learning loops that turn a new customer's framework into a measured production detector quickly.
• Speech quality. Make noisy transcripts reliably scorable today, and choose and evaluate ASR and diarization as raw-audio ingestion comes online.
• Production economics and observability. Own cost and latency per interaction, routing across model tiers, and continuous monitoring for drift in compliance detection, grounding and hallucination detection, and scoring quality.

You'll work directly with design partners' QA and compliance teams, where most signal about model errors originates, and you'll take part in the enterprise security and AI-governance reviews that gate each deal.

What We're Looking For

• Staff or principal depth in applied ML, NLP, or LLM systems. You've owned models other teams depended on, set technical direction, and been accountable when the numbers were wrong.
• Production ML or LLM experience where accuracy was measured, not assumed. You've built evaluation pipelines, constructed ground truth from inconsistent human labels, and made explicit decisions about acceptable error rates.
• Startup experience is required. You've shipped with broad ownership, ambiguity, and little supporting infrastructure.
• Range in model selection: prompting, retrieval, fine-tuning, distillation, classical classifiers, and recognizing when the answer is a regex. You can explain the accuracy, latency, and cost trade-offs.
• Hands-on production engineering. You've trained and debugged models yourself, shipped maintained Python services, and worked with messy unstructured data and the annotation operations that make it usable.
• Production judgment on inference cost, latency, and sensitive or regulated data, including the enterprise security reviews that come with it.
• You want build the ML team while staying hands-on, and use coding agents for leverage without lowering the quality bar.

Bonus

• Speech and audio in production: ASR, diarization, streaming transcription, or real-time latency budgets.
• Custom NLP or scoring-model development, or LLM-as-judge systems validated against human ground truth.
• Weak supervision, programmatic labeling, or active learning in production.
• Domain experience in trust and safety, fraud and risk, contact-center QA, or compliance and GRC.

What we are looking for

• 6+ years of experience
• Staff or principal depth in applied ML, NLP, or LLM systems
• Hands-on experience training or fine-tuning models for a specific domain and taking them to production at scale
• Ability to work with limited training data, including finding or generating alternative data
• Comfort owning production ML work without a separate MLOps team, and adapting to shifting startup priorities
• Startup experience is required