AI Engineer | $150/hr Remote

Crossing Hurdles; United States; Remote; CAD 241,000 - 343,000; Part time

Job summary

Crossing Hurdles is seeking a Senior Software Engineer Python/TypeScript for a remote contractor assignment. The role requires part-time commitment (20 hours/week) with at least 4 hours overlap during PST business hours. Compensation is $150 per hour.

The ideal candidate will build pipelines for AI data generation, evaluate data quality, and collaborate with researchers to translate qualitative judgments into scalable processes. LinkedIn profile is mandatory and Microsoft employment is excluded.

Qualifications

• Hands-on experience with preference data collection and rubric creation.
• Experience navigating large codebases; VSCode experience is a plus.
• Experience with AI/LLM evaluation workflows preferred.
• LinkedIn profile is mandatory for review.
• Candidates should not currently be working with Microsoft.

Responsibilities

• Build and maintain pipelines and infrastructure for AI data generation, collection, and evaluation workflows.
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label preference data while identifying quality issues.
• Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
• Synthesize technical findings into clear, actionable write-ups, updates, and recommendations.

Skills

Preference data collection

Rubric creation

Large codebases

AI/LLM evaluation

VSCode

Tools

VSCode

Job description

Position: Senior Software Engineer Python/TypeScript

Type: Contractor Assignment

Compensation: $150/hr

Location: Remote

Commitment: Part-time(20 hours/week), with at least 4 hours overlap during PST business hours

Role Responsibilities

• Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows.
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label preference data while identifying subtle quality issues.
• Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
• Synthesize technical findings into clear, actionable write-ups, updates, and recommendations.

Requirements

• Hands-on experience with preference data collection and/or rubric creation.
• Experience navigating or contributing to large codebases; experience with codebases such as VSCode is a plus.
• Experience with AI/LLM evaluation or related engineering workflows is preferred.
• A LinkedIn profile is mandatory for review.
• Candidates should not currently be working with Microsoft.