Product-Focused Data Scientist (LLM Products)

blueroseresearch; United States; Remote; USD 160,000 - 210,000; Full time

Benefits offered by this job

Remote-first company

Office in NYC

Medical, dental, and vision coverage

401(k) match

Unlimited PTO

Job summary

blueroseresearch seeks a product-focused data scientist to build LLM-powered research tools for political strategists and campaigns. The role blends applied modeling with product decisions, co-evolving user experience with models to expand the breadth, depth, and speed of strategic research.

You will prototype quickly, collaborate with strategists, and design evaluations to ensure accuracy and usefulness. Strong communication with engineers and clients is essential.

Qualifications

• 5+ years as a data scientist or applied statistician with product shipping experience.
• Proficiency in Python, SQL, and standard ML tooling on messy data.
• Experience evaluating/building on LLMs, including eval sets and embeddings.
• Strong product instincts and clear communication with cross-functional teams.
• Comfort with ambiguous problems and mission-driven work.

Responsibilities

• Work with strategists to turn workflows into product decisions for human-and-agent collaboration.
• Define rigor standards for AI systems balancing ideal quality with deadlines.
• Design evaluations and LLM-as-judge systems to verify accuracy and usefulness.
• Prototype quickly using coding agents to test ideas.
• Present findings to technical and non-technical stakeholders, including clients.

Skills

Python

SQL

ML tooling

LLM evaluation

Product instincts

Communication

Tools

Embeddings

LLM platforms

Job description

Role overview

A product-focused data scientist role building LLM-powered research and analysis tools for political strategists and campaigns. The position blends applied modeling with product decisions, co-evolving the user experience alongside the models that power it to expand the breadth, depth, and speed of strategic research.

Responsibilities

• Spend time with political strategists to understand their workflows and identify where AI can improve their work, then translate that into product decisions about human-and-agent collaboration.
• Define the bar for rigor on what "good" looks like in an AI system, balancing ideal standards against real deadlines and real user needs.
• Design evaluations and LLM-as-judge systems that measure whether an LLM-powered feature is accurate, well-grounded, and useful.
• Prototype quickly, using coding agents to test ideas before they become product commitments.
• Communicate findings and tradeoffs clearly to both technical and non-technical audiences, including in client-facing settings.

Requirements

• 5+ years of experience as a data scientist or applied statistician with significant exposure to shipping features or products, not just producing analyses.
• Proficiency in Python, SQL, and standard statistical or ML tooling, with comfort working through messy real-world data.
• Hands-on experience evaluating or building on top of LLMs, including designing eval sets, building LLM-as-judge pipelines, and working with embeddings.
• Strong product instincts and care for how the end user will interact with the model through the product.
• Clear written and verbal communication with engineers, product managers, and non-technical stakeholders.
• Comfort with ambiguous problems and motivation by the organization's mission of supporting progressive political work.

Nice to have

• Prior political or civic-tech experience.

Benefits and work setup

• Salary range of $160,000 to $210,000 annually, commensurate with experience.
• Remote-first company with an office in NYC; candidates must be authorized to work in the United States.
• Medical, dental, and vision coverage, 401(k) match, and unlimited PTO.