Remote Python Engineer

turing; Canada; Remote; CAD 83,000 - 124,000; Full time

Benefits offered by this job

Fully remote

Job summary

Turing is seeking a high‑taste engineer with a strong eye for quality to work hands‑on with preference data and rubric creation. You will design rubrics, label data to a high standard, and build pipelines to support evaluation workflows in a fully remote freelance capacity.

The engagement runs for 3 months, at ~40 hours/week with a minimum 6-hour overlap with Pacific Time. Market-rate compensation; share your hourly rate. Independent contractor role with no medical or paid leave, start ASAP.

Qualifications

• Experience building/maintaining data pipelines and infra.
• Hands-on experience with preference data collection or rubric creation.
• Excellent written and verbal communication; ability to produce actionable summaries.
• Strong judgment on quality and taste in data and evaluation.

Responsibilities

• Design, refine, and iterate on rubrics and evaluation criteria for preference data.
• Review and label data with a high bar for quality, catching subtle issues others might miss.
• Build and maintain pipelines/infra that support data generation, collection, and evaluation workflows.
• Synthesize findings from data work into clear write-ups, updates, or recommendations for the team.
• Collaborate closely with researchers/engineers to translate qualitative judgment into scalable processes.

Skills

Python

TypeScript

Rubric creation

Communication

Tools

VSCode

Job description

About Turing:

Turing is one of the world's leading AGI infrastructure companies, working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent.

About the Role:

We're looking for a high-taste engineer with a strong eye for quality — someone who's worked hands-on with preference data and rubric creation, and knows what separates a good example from a great one. You communicate clearly and can synthesize complex technical work the way a strong MAI dev would: concise, structured, and easy for others to act on. You're comfortable in ambiguous, fast-moving environments and default to shipping over deliberating.

What does day-to-day look like:

• Design, refine, and iterate on rubrics and evaluation criteria for preference data
• Review and label data with a high bar for quality, catching subtle issues others might miss
• Build and maintain pipelines/infra that support data generation, collection, and evaluation workflows
• Synthesize findings from data work into clear write-ups, updates, or recommendations for the team
• Collaborate closely with researchers/engineers to translate qualitative judgment into scalable processes

Required Skills:

• Proficiency in Python (especially building/maintaining pipelines and infra) or Typescript (experience contributing to or navigating large codebases like VSCode a plus)
• Hands‑on experience with preference data collection and/or rubric creation
• Strong written and verbal communication — able to distill technical work into clear, actionable summaries
• Demonstrated high‑taste judgment — able to articulate why something is good, not just that it is.

Perks of Freelancing With Turing:

• Work in a fully remote environment.
• Opportunity to work on cutting‑edge AI projects with leading LLM companies.

Engagement Details:

• Compensation: Market rate. Please share a specific rate expectation (rather than a range) so we can quickly assess mutual fit
• Availability: 40 hours/week preferred, with a minimum 6-hour overlap with Pacific Time. If you're unable to commit to 40 hours, please share your available hours and overlap window
• Employment Type: Independent contractor (does not include medical or paid leave benefits
• Duration: 3 months, with an expected start date as soon as possible

Evaluation Process (approximately 30 mins):

• One round of interview (30 mins of technical & cultural discussion)