Remote Python AI Evaluation Specialist - Expert Code Review

G2i Inc.; Winnipeg; Remote; CAD 80,000 - 100,000; Full time

Job summary

A leading AI training company based in Winnipeg is seeking experts for a remote project focusing on reviewing AI-generated responses and providing feedback to enhance AI systems. Candidates must have a strong background in Computer Science, particularly in Python, and demonstrate expert-level communication skills. Additional programming knowledge is a plus. Competitive compensation based on qualifications and experience is offered.

Qualifications

• Significant experience using large language models (LLMs).
• Prior Software Engineering work experience is strongly preferred.
• Expert at fact-checking information using public sources.

Responsibilities

• Review AI-generated responses and evaluate technical accuracy.
• Provide expert feedback to train AI systems for better code generation.
• Work with various programming languages and coding challenges.

Skills

Python

Expert-level English proficiency

Fact-checking

Analytical thinking

Structured thinking

Education

BS, MS, or PhD with a focus on Computer Science

Tools

Large language models (LLMs)

Programming languages (C#, Java, SQL, etc.)

Job description

A leading AI training company based in Winnipeg is seeking experts for a remote project focusing on reviewing AI-generated responses and providing feedback to enhance AI systems. Candidates must have a strong background in Computer Science, particularly in Python, and demonstrate expert-level communication skills. Additional programming knowledge is a plus. Competitive compensation based on qualifications and experience is offered.