Remote Senior ML Engineer - Search Quality & Relevance

Constructor; United States; Remote; USD 80,000 - 120,000; Full time

Benefits offered by this job

Fully remote team

Stock options

Work from home stipend

Apple laptops provided

Unlimited vacation

Training and development budget

Job summary

Constructor.io is an AI-first ecommerce search and discovery platform. As a Senior Machine Learning Engineer in the Search Quality team, you will improve the e-commerce experience for hundreds of millions of users by building systems that power relevance across multiple domains.

The role focuses on relevance evaluation, real-time quality in production, and automated monitoring. You will fine-tune models, manage latency tradeoffs, run AB tests, and collaborate with product and data teams in a

Qualifications

• 4+ years shipping production ML systems.
• Experience with search, information retrieval, or recommendation systems.
• Hands-on experience with fine-tuning, evaluation frameworks, and scaling LLM deployments.
• Strong Python and PyTorch. Fluency in SQL and data orchestration tools (Spark, Airflow).
• Experience designing and running A/B tests to validate model impact.
• Excellent English communication skills and cross-functional collaboration.

Responsibilities

• Relevance evaluation and quality improvements in the search stack.
• Real-time quality in production: reranking, filtering, and latency management.
• Automated quality monitoring and agentic insights with actionable recommendations.

Skills

Production ML systems

Information retrieval / search systems

Fine-tuning models

Python

PyTorch

SQL

Spark

Airflow

AB testing

English communication

Tools

Spark

Airflow

SQL

Job description

Constructor.io is an AI-first ecommerce search and discovery platform. As a Senior Machine Learning Engineer in the Search Quality team, you will improve the e-commerce experience for hundreds of millions of users by building systems that power relevance across multiple domains.

The role focuses on relevance evaluation, real-time quality in production, and automated monitoring. You will fine-tune models, manage latency tradeoffs, run AB tests, and collaborate with product and data teams in a