Remote Senior Infra Engineer for AI Data & Evaluation

Crossing Hurdles; United States; Remote; USD 138,000 - 207,000; Part time

Job summary

Crossing Hurdles seeks a Senior Software Engineer proficient in Python and TypeScript for a remote contractor assignment. The part-time role (20-40 hours/week) offers hourly compensation between $100 and $150.

You will build and refine AI/data evaluation pipelines, craft rubrics, review data quality, and collaborate with researchers and engineers to scale evaluation processes. A LinkedIn profile is mandatory, and applicants should not be at Microsoft.

Qualifications

• Hands-on experience with preference data collection and/or rubric creation.
• Experience navigating or contributing to large codebases; familiarity with VSCode is a plus.
• Experience with AI/LLM evaluation or related engineering workflows is preferred.
• LinkedIn profile is mandatory for review; candidates should not be currently employed by Microsoft.

Responsibilities

• Build and maintain pipelines and infrastructure supporting AI data generation, collection, and evaluation workflows.
• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label preference data while identifying subtle quality issues.
• Collaborate with researchers and engineers to translate qualitative judgment into scalable evaluation processes.
• Synthesize technical findings into clear, actionable write-ups, updates, and recommendations.

Skills

Preference data

Rubric creation

Large codebases

VSCode familiarity

AI/LLM evaluation

Job description

Crossing Hurdles seeks a Senior Software Engineer proficient in Python and TypeScript for a remote contractor assignment. The part-time role (20-40 hours/week) offers hourly compensation between $100 and $150.

You will build and refine AI/data evaluation pipelines, craft rubrics, review data quality, and collaborate with researchers and engineers to scale evaluation processes. A LinkedIn profile is mandatory, and applicants should not be at Microsoft.