Remote Senior Software Engineer (Python/TS) - AI Pipelines

Crossing Hurdles; United States; Remote; CAD 241,000 - 343,000; Full time

Job summary

Crossing Hurdles is seeking a Senior Software Engineer proficient in Python and TypeScript for a remote, contractor assignment. The role is part-time (20 hours/week) with at least 4 hours overlap during PST business hours, focusing on building pipelines and AI data evaluation workflows.

You will collaborate with researchers and engineers, review and label data, and help translate qualitative judgment into scalable processes.

Qualifications

• Hands-on experience with preference data collection and rubric creation.
• Experience navigating large codebases; VSCode experience is a plus.
• Experience with AI/LLM evaluation or related engineering workflows preferred.
• LinkedIn profile is mandatory for review and you should not be currently employed by Microsoft.

Responsibilities

• Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows.
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label preference data while identifying subtle quality issues.
• Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
• Synthesize technical findings into clear, actionable write-ups, updates, and recommendations.

Skills

Preference data collection

Rubric creation

Large codebases navigation

AI/LLM evaluation

Tools

VSCode

Job description

Crossing Hurdles is seeking a Senior Software Engineer proficient in Python and TypeScript for a remote, contractor assignment. The role is part-time (20 hours/week) with at least 4 hours overlap during PST business hours, focusing on building pipelines and AI data evaluation workflows.

You will collaborate with researchers and engineers, review and label data, and help translate qualitative judgment into scalable processes.