Head of AI and ML

Xplor Education; United States; On-site; USD 180,000 - 320,000; Full time

Job summary

Xplor—Head of AI/ML R&D role seeking a hands-on leader to own the evaluation science for every agent, the predictive and decision models behind shared AI components, and the experiments that prove value. You will balance building models with setting methods, and you’ll grow a small team of scientists while ensuring model quality and cost efficiency.

The role requires strong experience in production ML, experimentation, and multi-BU collaboration.

Qualifications

• Twelve plus years in data science, ML or applied research with four+ years leading teams.
• Proven track record shipping ML/LLM/agentic systems to production.
• Experience designing robust evaluation frameworks and A/B testing.
• Strong statistics, sampling, confidence intervals and uplift modelling.
• Familiarity with AI-native toolchains and agentic coding assistants.
• Experience explaining model trade-offs to executives in business terms.

Responsibilities

• Define enterprise eval methodology: golden-set design, labeling, and inter-rater agreement.
• Own quality signals: task success, groundedness, hallucination, escalation rates.
• Develop predictive models for churn, payment recovery, demand forecasting and fraud risk.
• Produce production-grade code, eval harnesses, notebooks and monitoring pipelines.
• Lead ML ethics, privacy, and security considerations across multiple BU projects.
• Mentor and grow a team of scientists/ML engineers.

Skills

Data science

Machine learning

Leadership

Production ML

Experiment design

Statistics

Python/SQL

SaaS systems

Tools

Snowflake

Datadog

OpenTelemetry

Feature stores

Job description

Company Description

At Xplor, we believe that helping people make the most of each day is the most rewarding way to spend ours.

We give small and medium-sized businesses cloud-based, intuitive technology solutions that enable them to manage all the hassles of running and growing a business, so business owners can get back to doing what they love. With Xplor Pay, we help businesses get paid quickly and securely – without hidden fees. We built the tech ourselves, and our platform delivers secure, transparent, fast, and accurate payments.

We are unified by our purpose of helping people to succeed. So, when you become part of our team, you also become part of the personal connection that strengthens the relationship people have with Xplor products.

Job Description

Position overview

The Head of AI/ML R&D decides, with evidence, whether an AI system works, how well, for whom, and at what cost. They come from data science and machine learning, and they build today with AI-native tools and agentic development.

The role owns the science of evaluation across every agent, the predictive and decision models behind the shared agents (churn, demand, payment recovery, fraud), and the experiment design that lets Finance count AI value once, against a holdout.

The role is hands‑on. At least 50% of time goes to building models, evals and experiments; the rest to setting methods, reviewing, and growing a small team. This role makes what engineers ship measurable, cheaper and trustworthy, and supplies the models where an LLM alone is the wrong tool.

Key responsibilities

1. Evaluation science for every agent

• Set the enterprise eval methodology: golden‑set design, sampling, labelling and inter‑rater agreement, LLM‑as‑judge validation, slice analysis and statistical thresholds.
• Own the quality signals in the minimum telemetry contract: task success, groundedness, hallucination and escalation rates.
• Re‑run evals per BU and tenant on every agent‑core upgrade; catch regressions before customers do.

2. Predictive and decision models behind the shared agents

• Build and run the models the horizontal pods need: churn and retention uplift, payment‑recovery propensity and timing, demand and capacity forecasting, later fraud and onboarding risk.
• Choose the right tool per task: classical ML, a small or fine‑tuned model, retrieval, or a frontier LLM.
• Ship models to production on the golden path, with monitoring for drift and feedback loops.

3. Model economics

• Build the evidence behind model routing: accuracy, cost and latency per task, so routing is a measured decision.
• Drive cost per successful task down through distillation, caching strategy, smaller models and prompt and context optimization.

4. AI‑native R&D and horizon scanning

• Prototype varied techniques (agent memory, planning, multi‑agent patterns, synthetic data) against real Xplor problems.
• Turn what works into reference implementations in the golden path; retire what doesn’t.
• Bring a monthly view of what has changed in models and methods, and what it means for our roadmap.

5. Data science for Data‑as‑a‑Service

• Shape the statistical design of benchmarks and indices: cohort minimums, anonymization, and comparability across businesses.
• Lead entity‑resolution modeling with the data team.

6. Raise the ML fluency of the whole R&D organization

• Teach evals, experimentation and probabilistic thinking through the AI‑P/SDLC training and office hours.
• Pair with BU engineers on hard model problems in lighthouse BUs; review eval designs for R2 and R3 agents.

Hands‑on expectations

• Writes production code, notebooks and eval harnesses; uses AI coding and agent tools daily at "platform contributor" fluency.
• Builds the first eval suite and the first predictive model for each golden‑path exemplar (conversational analytics, booking agent, retention and churn).
• Reviews model and eval pull requests from pods and BUs.
• Decides on a demo, an eval or a metric, not a deck.

Qualifications

Required

• 12+ years in data science, machine learning or applied research, with 4+ years leading teams of scientists or ML engineers.
• Grew up in ML: has trained, evaluated, deployed and maintained models in production, not only consumed APIs.
• Has shipped LLM or agentic systems to production in the last two years, including the eval suite that gated them.
• Deep experimental design and causal inference: A/B tests, holdouts, uplift modelling, matched cohorts, and knowing when each is valid.
• Strong statistics: sampling, confidence intervals, calibration, multiple‑comparison traps.
• Builds with AI‑native tools today (agentic coding assistants, MCP, agent frameworks) and can show recent work.
• Writes production‑quality Python and SQL; reviews others' code credibly.
• Has worked on SaaS or marketplace data at scale: multi‑tenant, messy, many products.
• Explains model trade‑offs and uncertainty to executives in business terms (revenue, margin, risk).

Preferred

• Churn, retention, propensity or pricing models in subscription or SMB software.
• Payments ML: recovery, dunning optimization, fraud or risk scoring.
• Fine‑tuning, distillation or small‑model work to cut inference cost.
• LLM‑as‑judge design and validation; red‑teaming of model behavior.
• Snowflake (or similar) and feature stores; Datadog or OpenTelemetry for model monitoring.
• Familiar with NIST AI RMF, ISO/IEC 42001 and the EU AI Act, and with privacy rules for analytics across AU, NZ, US, UK and EU.
• Published research or open‑source work is a plus, not a requirement.

Competencies and behaviors

• Evidence first. Brings a number with its error bar.
• Builder, not only researcher. Measures success by what reaches customers.
• Pragmatic. Picks the simplest model that clears the bar; says no to research that has no BU sponsor.
• Teacher. Grows ML judgement in engineers who don't report to them.
• Security‑ and privacy‑minded. Treats training data, prompts and tool output as untrusted; no card data, credentials or customer data where it doesn't belong.
• Partner to BUs. Treats BUs as customers; works within the co‑build‑with‑two‑BUs rule.

Additional Information

All your information will be kept confidential according to EEO guidelines.

Before you apply

To be considered for employment, you must be legally authorized to work in the country where the role is advertised. This applies to remote roles too. Xplor does not sponsor visas, either at the time of hire or at any later time. We're also not able to offer contractor arrangements or Employer of Record engagements for this position at this stage.

Interview Recording and Background Checks

As part of our hiring process, successful candidates will be asked to complete background and identity verification checks. Many of our roles are remote, and to protect both candidates and our business from recruitment fraud, we may record video interviews during the process. We keep any recordings and related data only for as long as the hiring process is active and do not retain them afterwards.

EEO and Artificial Intelligence

We believe in transparent hiring. We use an applicant tracking system with artificial intelligence‑enabled features to support our recruitment process, but our recruitment team makes all hiring decisions after human review. We do not rely on artificial intelligence to make final hiring decisions. Find our Candidate AI Usage guidelines here.

Xplor is proud to be an Equal Employment Opportunity employer. We're dedicated to attracting, retaining and developing our people regardless of gender identity, ethnicity, sexual orientation, disability, veteran status and age. We encourage applications from all sectors of the community. All Information will be kept confidential according to EEO guidelines.

Xplor is committed to fully including all qualified individuals. In keeping with our commitment, Xplor will take steps to ensure people with disabilities receive reasonable accommodations. Accordingly, if reasonable accommodation is required to fully participate in the job application or interview process, to perform the essential functions of the position, and/or to receive all other benefits and privileges of employment, please contact us via [email protected].

We make it a priority to respond to every applicant.