Platform Engineer | $150/hr Remote

Crossing Hurdles; United States; Remote; USD 170,000 - 243,000; Part time

Job summary

Crossing Hurdles is seeking a Senior Software Engineer (Python/TypeScript) for a remote contractor assignment. This part-time role requires 20 hours per week with at least 4 hours overlap during PST business hours, compensated at $150/hour.

You will help build pipelines and evaluation workflows supporting AI data generation and assessment. You will review and refine rubrics, label data for quality, and collaborate with researchers to translate qualitative judgment into scalable processes.

Qualifications

• Hands-on experience with preference data collection and/or rubric creation.
• Experience navigating or contributing to large codebases; VSCode is a plus.
• Experience with AI/LLM evaluation or related engineering workflows is preferred.
• A LinkedIn profile is mandatory for review.
• Candidates should not currently be working with Microsoft.

Responsibilities

• Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows.
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label preference data while identifying subtle quality issues.
• Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
• Synthesize technical findings into clear, actionable write-ups, updates, and recommendations.

Skills

Preference data collection

Rubric creation

Large codebases navigation

AI/LLM evaluation workflows

Tools

VSCode

Job description

Position: Senior Software Engineer Python/TypeScript

Type: Contractor Assignment

Compensation: $150/hr

Location: Remote

Commitment: Part-time(20 hours/week), with at least 4 hours overlap during PST business hours

Role Responsibilities

• Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows.
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label preference data while identifying subtle quality issues.
• Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
• Synthesize technical findings into clear, actionable write-ups, updates, and recommendations.

Requirements

• Hands-on experience with preference data collection and/or rubric creation.
• Experience navigating or contributing to large codebases; experience with codebases such as VSCode is a plus.
• Experience with AI/LLM evaluation or related engineering workflows is preferred.
• A LinkedIn profile is mandatory for review.
• Candidates should not currently be working with Microsoft.