Applied Data Scientist

Zof AI, Inc.; San Francisco (CA); On-site; USD 120,000 - 190,000; Full time

Benefits offered by this job

MacBook Pro

Premium AI development tools

High ownership

Direct product impact

Job summary

Zof AI is hiring an Applied Data Scientist to measure how well our agent fleets find and fix defects. This on-site role in San Francisco, CA owns the numbers behind the product: detection precision, remediation success rates, and rigorous experiment design.

You should be fluent in Python and SQL, with a strong statistics background, and enjoy turning questions into actionable metrics. You’ll build analysis pipelines and partner with engineering, product, and leadership to drive product

Qualifications

• Strong fluency with Python and SQL.
• Solid grounding in statistics, experiment design, and inference.
• Experience analyzing messy real-world data and drawing defensible conclusions.

Responsibilities

• Define and own the metrics that describe how well our agent fleets find and fix defects.
• Measure detection precision and recall against real customer codebases.
• Quantify remediation success rates and the strength of the validation evidence behind them.
• Design experiments that show whether a product or model change actually helped.
• Partner with engineering on eval design so agent runs are scored consistently over time.

Skills

Python

SQL

Statistics

Experiment design

Communication

Causality thinking

Tools

dbt

Job description

Applied Data Scientist – San Francisco, CA

Location: San Francisco, CA

Contract: Full-time, Mid-level, On-site

Compensation

Competitive salary

Plus meaningful equity

About This Role

Zof AI is hiring for this role in San Francisco, CA. This is a full-time opportunity for candidates who want to contribute directly to the development of ambitious AI products in a high-performance environment.

Hands-on experience measuring the quality of AI or machine learning systems with data, plus daily use of AI tools in your own analysis work, is required.

Zof AI is seeking an Applied Data Scientist to measure how well our agent fleets actually find and fix defects. This role owns the numbers behind the product: detection precision and recall, remediation success rates, experiment design, and the statistical rigor that separates a real improvement from noise. If you have worked as an Applied Scientist, Product Data Scientist, Quantitative Analyst, or Machine Learning Analyst, this is that discipline at Zof AI. The ideal candidate is fluent in Python and SQL, reasons about causes rather than correlations, and would rather report an honest number than a flattering one.

Responsibilities

• Define and own the metrics that describe how well our agent fleets find and fix defects.
• Measure detection precision and recall against real customer codebases.
• Quantify remediation success rates and the strength of the validation evidence behind them.
• Design experiments that show whether a product or model change actually helped.
• Partner with engineering on eval design so agent runs are scored consistently over time.
• Build analysis pipelines in Python and SQL that other people can rerun and trust.
• Translate findings into clear recommendations for engineering, product, and leadership.
• Own the reporting that keeps our claims about the product grounded in evidence.

Requirements

• Strong working fluency with Python and SQL.
• Solid grounding in statistics, experiment design, and inference.
• Experience analyzing messy real-world data and drawing defensible conclusions.
• Ability to turn a fuzzy question into a metric someone can act on.
• Comfort reasoning about causality, bias, and confounding.
• Clear written and verbal communication.
• Comfort operating in a fast-moving environment.
• Evidence of analysis that changed a decision.

Nice to Have

• Experience measuring the quality of machine learning or AI systems.
• Experience with causal inference methods or Bayesian analysis.
• Experience with data warehouses, dbt, or notebook-to-production workflows.
• Familiarity with software testing, CI pipelines, or developer tooling metrics.

Data Science Experimentation Statistics Python SQL

Data Science Experimentation Statistics Python SQL

What We Provide in San Francisco

• MacBook Pro
• Premium AI development tools
• Cursor Ultra
• Claude Code Ultra
• OpenAI Codex Max or equivalent advanced AI tooling
• Access to a high-performance AI product environment
• Close collaboration with leadership, engineering, and customers
• Opportunity to work in the San Francisco AI ecosystem
• Wellness and productivity support where applicable
• Competitive startup environment
• High ownership
• Direct product impact

Benefits may depend on role and final offer terms.