Remote Freelance Senior Python AI Evaluation Engineer

ZettaMine Labs Pvt. Ltd.; Canada; Remote; CAD 83,000 - 124,000; Full time

Benefits offered by this job

Fully remote

Cutting-edge AI projects

AI model training

Competitive hourly pay

Job summary

ZettaMine Labs Pvt. Ltd. is seeking a Senior Software Engineer – Python/TypeScript for a short-term AI Engineering and Evaluation project based in Canada.

This remote freelance role requires 4+ years of experience and focuses on building pipelines, evaluating data quality, and supporting AI training workflows. You’ll design evaluation rubrics, review data quality, and collaborate with researchers and engineers to scale qualitative judgments into robust processes.

Qualifications

• Experience building, maintaining, and improving software pipelines and infrastructure.
• Hands-on experience with preference data collection and rubric creation.
• Ability to review technical data and evaluate quality using defined criteria.
• Strong analytical, problem-solving, and technical judgment skills.
• Experience with large codebases, such as VS Code, is an advantage.
• Ability to explain why a technical solution is good, accurate, and effective.
• Strong written and verbal communication skills.

Responsibilities

• Design, develop, and improve evaluation rubrics and criteria for preference data.
• Review and label data while ensuring high standards of quality and accuracy.
• Identify subtle issues and inconsistencies in data and evaluation results.
• Build and maintain pipelines and infrastructure for data generation, collection, and evaluation.
• Analyze technical findings and prepare clear reports, summaries, and recommendations.
• Collaborate with researchers and engineers to convert qualitative judgments into scalable processes.
• Support AI training and evaluation workflows to improve the quality of AI model outputs.
• Communicate technical findings clearly and recommend improvements to project teams.

Skills

Analytical skills

Problem-solving

Technical judgment

Written communication

Verbal communication

Collaboration

Education

Bachelor’s or Master’s degree in a relevant field

Tools

VS Code

Job description

ZettaMine Labs Pvt. Ltd. is seeking a Senior Software Engineer – Python/TypeScript for a short-term AI Engineering and Evaluation project based in Canada.

This remote freelance role requires 4+ years of experience and focuses on building pipelines, evaluating data quality, and supporting AI training workflows. You’ll design evaluation rubrics, review data quality, and collaborate with researchers and engineers to scale qualitative judgments into robust processes.