Senior Python Engineer | $150/hr Remote

Crossing Hurdles; Canada; Remote; CAD 241,000 - 343,000; Part time

Job summary

Crossing Hurdles is seeking a Senior Software Engineer with Python and TypeScript experience for a remote, part-time contractor role. You will build and maintain pipelines and AI-related evaluation workflows, contributing to scalable data rubrics and quality labeling.

Ideal candidates have hands-on work with preference data, experience in large codebases, and familiarity with AI/LLM evaluation. A LinkedIn profile is required for review, and candidates must not be currently employed by Microsoft.

Qualifications

• Hands-on experience with preference data collection and/or rubric creation.
• Experience navigating large codebases; experience with codebases such as VSCode is a plus.
• Experience with AI/LLM evaluation or related engineering workflows is preferred.
• A LinkedIn profile is mandatory for review.
• Candidates should not currently be working with Microsoft.

Responsibilities

• Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows.
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label preference data while identifying subtle quality issues.
• Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
• Synthesize technical findings into clear, actionable write-ups, updates, and recommendations.

Skills

Preference data

Rubric creation

Large codebases

AI/LLM evaluation

LinkedIn profile mandatory

Microsoft restriction

VSCode experience

Tools

VSCode

Job description

Position: Senior Software Engineer Python/TypeScript

Type: Contractor Assignment

Compensation: $150/hr

Location: Remote

Commitment: Part-time(20 hours/week), with at least 4 hours overlap during PST business hours

Role Responsibilities

• Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows.
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label preference data while identifying subtle quality issues.
• Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
• Synthesize technical findings into clear, actionable write-ups, updates, and recommendations.

Requirements

• Hands-on experience with preference data collection and/or rubric creation.
• Experience navigating or contributing to large codebases; experience with codebases such as VSCode is a plus.
• Experience with AI/LLM evaluation or related engineering workflows is preferred.
• A LinkedIn profile is mandatory for review.
• Candidates should not currently be working with Microsoft.