Senior AI Trading Platform Quality Scientist

Clear Street; United States; Remote; USD 180,000 - 250,000; Full time

Benefits offered by this job

Lunch stipends

Fully stocked kitchens

Happy hours

Great location

Amazing views

Company equity

401k matching

Gender neutral parental leave

Full medical, dental and vision

Job summary

Clear Street is modernizing the brokerage ecosystem and building a cloud-native clearing platform for global markets. This role owns the reliability and quality of an AI copilot embedded in the trading platform used by sophisticated investors.

You will design evaluation systems, benchmarks, and automated quality gates, partnering with engineering and product to ensure safe, auditable, and deterministic AI behavior.

Qualifications

• Eight+ years of production software experience required.
• Strong knowledge of computer science fundamentals, testing methodologies, and systems design.
• Experience building evaluation frameworks, test harnesses, and benchmark suites for complex systems (LLMs/agents).
• Experience running model improvement cycles: dataset curation, labeling/QA, offline experimentation.

Responsibilities

• Own the reliability and quality bar for an AI copilot embedded in a trading platform used by sophisticated investors.
• Design and build evaluation systems that measure correctness, safety, latency, and regression risk across market analysis, portfolio/risk reasoning, and trading workflows.
• Develop and maintain benchmarks: golden sets, scenario suites, stress/adversarial cases, and refreshed market/regime corpora.
• Build automated quality gates and regression workflows that block releases when metrics degrade.
• Partner with engineering and product to define safe tool/action contracts and ensure predictable assistant behavior.
• Own model improvement loops tied to evals: data collection/labeling strategies, error taxonomy, prompt/tooling changes, and fine-tuning where appropriate.
• Design and operate monitoring and incident response for AI: telemetry, RCA, and fix-forward processes.
• Develop deep understanding of trading concepts (margin, shorting, risk) and articulate them to users.

Skills

Production software

CS fundamentals

Testing methodologies

Systems design

Metrics & data-driven decisions

Cross-stack debugging

Self-motivation

Tools

Rust

TypeScript

Postgres

React

React Native

LLM APIs

Job description

Clear Street is modernizing the brokerage ecosystem and building a cloud-native clearing platform for global markets. This role owns the reliability and quality of an AI copilot embedded in the trading platform used by sophisticated investors.

You will design evaluation systems, benchmarks, and automated quality gates, partnering with engineering and product to ensure safe, auditable, and deterministic AI behavior.