Senior Applied AI/ML Scientist - Compass

United States Digital Space LLC

New York (NY)

Hybrid

USD 211,000 - 291,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Equity
Hybrid work
Comprehensive benefits

Job summary

United States Digital Space LLC is building Compass, a retailer assistant powered by agentic AI to help independent retailers make smarter buying decisions. You will lead data-driven development, evaluation, and end-to-end feature shipping across AI, ML, and backend systems.

The role emphasizes ownership of applied-science work, rapid iteration, and collaboration with engineering teams to deliver high-impact product capabilities while maintaining robust guardrails.

Qualifications

  • 5+ years of industry experience building and shipping production ML/AI systems with measurable business impact.
  • Shipped agentic/LLM-powered features in a core production product with defense of design choices.
  • Strong applied ML / data science foundations and ability to turn data into product capability.
  • Experience shipping across backend, data, and frontend stacks with quality at speed.

Responsibilities

  • Own the science and technical north star for Compass’s agentic products and how to measure agent quality.
  • Ship retailer-assistant features end-to-end across the FLARE Python app, data plumbing, tool wrappers, and frontend surfaces.
  • Translate ambiguous product bets into sequenced, de-risked tactical plans.
  • Set and raise the bar for eval- and experiment-driven development with offline evals and metrics.
  • Make pragmatic engineering choices that ship now but evolve over time.
  • Partner with engineers on architecture and serve as science/technical interface to adjacent teams.
  • Raise the team’s collective judgment through prototypes, analyses, and design reviews.

Skills

5+ years in production ML/AI
Agentic/LLM-powered features
Applied ML / data science
Cross-stack shipping
AI-native workflows
Architectural maturity
Autonomy and judgment
Strong engineering communication

Job description

About the company

the company is a technology wholesale platform built on the belief that the future is local. Independent retailers around the globe collectively represent a multi-hundred-billion-dollar wholesale market that has historically been fragmented and offline. At the company, we're using the power of tech, data, and machine learning to connect this thriving community of entrepreneurs across the globe. Picture your favorite boutique in town — we help them discover the best products from around the world to sell in their stores. With the right tools and insights, we believe that we can level the playing field so businesses can grow and local communities can thrive.

We’re looking for smart, resourceful and passionate people to join us as we power the shop local movement. If you believe in community, come join ours.

About the role

the company is building the future of wholesale, connecting independent retailers with the brands that will define their stores. At the heart of this mission is Compass — the company’s user facing AI bet within the Discovery Pillar — building an always-present, context-aware retailer assistant along the enagement journey. Compass helps retailers make smarter buying decisions by combining the company’s rich proprietary data with agentic AI and web search, and is increasingly able to take action on retailers’ behalf.

As a Senior Applied AI/ML Scientist on the Compass team, you will be the science and technical lead for this product — driving agent quality through data, evaluation, and modeling, while shipping product features end-to-end with high velocity. This is a deeply hands-on individual contributor role: no direct reports, keyboard first. You will set the data-grounded direction for how the assistant works, while also being a full-stack (AI, ML, backend) builder who turns ideas into shipped product fast.

You will work at the frontier of agentic AI, blending applied science rigor (eval-driven development, experimentation, data strategy) with cross-stack engineering range to build the retailer assistant of the future. This is a rare opportunity to shape a product from near-zero — where your judgment, speed, and instincts will define the outcomes.

What you’ll do
  • Own the science and technical north star for Compass’s agentic products — the retailer assistant today and whatever comes next: how to leverage the company’s proprietary data, agent + tool + context strategy (preload vs. tool-calling vs. hybrid), and how to measure and raise agent quality as systems gain the ability to act.
  • Ship retailer-assistant features end-to-end — across the FLARE Python app, data plumbing, tool wrappers, and the frontend surfaces where the assistant appears, using AI-native workflows to multiply your output.
  • Translate ambiguous product bets into sequenced, de-risked tactical plans — what to build now, what to defer, and which bets carry the highest impact × probability-of-success.
  • Set and raise the bar for eval- and experiment-driven development — define how the team knows an agent is good, including offline eval suites, LLM-as-judge metrics, and quality criteria per surface and retailer journey.
  • Make pragmatic engineering choices: simple enough to ship now, designed to evolve — not over-engineered for imagined future scale, but not throwaway either.
  • Partner closely with engineers on architecture and serving tradeoffs, and act as the science/technical interface to adjacent teams (Search, Personalization, Platform/FLARE).
  • Raise the team’s collective judgment through prototypes, analyses, design reviews, and pairing.
You’re a great fit if you have…
  • 5+ years of industry experience building and shipping production ML/AI systems with measurable business impact — including hands-on ownership of the applied-science side (data, evaluation, modeling, quality), not just system plumbing.
  • Has shipped agentic / LLM-powered features in a core production product — with a deep, opinionated grasp of agent design tradeoffs: eval strategy, latency/cost/quality tension, tool-calling vs. context preload, guardrails, and failure containment.
  • Strong applied ML / data science foundation — reasons from data, designs experiments and evals, and has turned proprietary or structured data into product capability.
  • Track record of shipping fast across multiple stacks (backend, data, and ideally frontend) with quality — not a single-layer specialist; demonstrates cross-stack range.
  • AI-native in practice: uses AI coding tools and agent workflows as a force multiplier in day-to-day work.
  • Architectural maturity — can explain design choices that work simply today but won’t need to be thrown away when requirements grow.
  • Operates with high autonomy and resourcefulness, with good judgment about when to elevate and when to just solve it.
  • Fluent enough in engineering to make sound architecture calls.
Bonus points for…
  • E-commerce, marketplace, or two-sided platform context — understanding of both sides of the retailer/brand dynamic.
  • Experience evolving a read-only assistant into one that takes actions safely — confirm-first patterns, guardrails, and failure containment.
  • Hands-on experience with the OpenAI Agents SDK or similar agentic frameworks in production.
  • Familiarity with preload-over-RAG context strategies, Snowflake-backed grounding, or hybrid approaches.
  • Prior 0→1 / early-stage product experience — has built something meaningful from scratch.
  • Recommendation, retrieval, or personalization modeling background.
  • Public writing, open-source contributions, or talks that show structured thinking about agentic / applied-AI systems.
Salary Range

US: the pay range for this role is $211,000 to $290,500 per year.

This role will also be eligible for equity and benefits. Actual base pay will be determined based on permissible factors such as transferable skills, work experience, market demands, and primary work location. The base pay range provided is subject to change and may be modified in the future.

**Hybrid the company employees currently go into the office 3 days per week on Tuesdays, Thursdays, and a third flex day of their choosing (Monday, Wednesday, or Friday).* Additionally, hybrid in-office roles will have the flexibility to work remotely up to 4 weeks per year. Specific Workplace and Information Technology positions may require onsite attendance 5 days per week as will be indicated in the job posting.*

Why you’ll love working at the company
  • Move fast: You'll own meaningful problems that serve customers around the globe with the agency to move fast and see your results clearly.
  • Equipped to scale: We invest in what matters, including the latest enterprise AI tools, to help you work smarter and get more out of every day.
  • Best in class: Our team is full of sharp, kind, and generous colleagues who care about their craft and about helping you grow in yours.
  • Real rewards. Competitive pay, equity, and comprehensive benefits designed to support your life inside and outside of work.
  • Belonging:
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Agent Strategist: AI Agent Development for Retail
Agent Strategist: AI Agent Development for Retail

United States Digital Space LLC • San Francisco (CA)

On-site
USD 120,000 - 180,000
Unlimited PTO
Medical, dental, and vision benefits
Retirement plan
+2
Strategist, Agent Development - Retail
Strategist, Agent Development - Retail

United States Digital Space LLC • San Francisco (CA)

On-site
USD 120,000 - 180,000
Unlimited PTO
Medical, dental, and vision benefits
Retirement plan
+2
Sr. Lead Engineer, Applied AI (Customer Agent)
Sr. Lead Engineer, Applied AI (Customer Agent)

United States Digital Space LLC • Boston (MA)

On-site
USD 216,000 - 324,000
Senior Software Engineer I
Senior Software Engineer I

Compass • Boston (MA)

On-site
USD 149,580 - 166,200
Paid vacation
401(k) plan
Medical benefits
+1
Staff Security Engineer - Enterprise AI
Staff Security Engineer - Enterprise AI

United States Digital Space LLC • San Francisco (CA)

Hybrid
USD 204,000 - 281,000
Equity
Hybrid work
Medical insurance
Engineering Manager, Agent
Engineering Manager, Agent

United States Digital Space LLC • New York (NY)

On-site
USD 180,000 - 240,000
Flexible PTO
Medical, dental, and vision benefits
Retirement plan
+3
Senior Software Engineer I
Senior Software Engineer I

Compass • New York (NY)

On-site
USD 149,580 - 166,200
Paid vacation, holidays, sick time
Medical, tele-health, dental and vision benefits
401(k) plan
+3
Senior AI Engineer
Senior AI Engineer

United States Digital Space LLC • San Francisco (CA)

On-site
USD 160,000 - 230,000
Medical, Dental & Vision insurance
401(k) with employer match
Flexible time off
+1
Senior Engineering Manager - Discovery
Senior Engineering Manager - Discovery

United States Digital Space LLC • San Francisco (CA)

Hybrid
USD 231,000 - 318,000
Equity
Benefits
Senior Applied ML/AI Scientist - Search
Senior Applied ML/AI Scientist - Search

United States Digital Space LLC • New York (NY)

Hybrid
USD 211,000 - 291,000
Equity eligible
Hybrid work model
Competitive compensation