Senior Software Engineer - AI Training Review Layer (Python)

G2i Inc.; Calgary; Remote; CAD 125,000 - 150,000; Full time

Job summary

A leading AI technology firm is seeking experienced software engineers in Calgary, Canada, to join their annotation team. You will create training data for state-of-the-art AI models, engage in coding challenges, and evaluate AI-generated code. Ideal candidates will have a strong background in Python and a passion for engaging with AI technologies. This position offers flexible schedules and long-term engagement without a strict end date.

Qualifications

• Master’s or PhD in Computer Science, or Bachelor's with 4+ years of experience.
• Fluency in the English language.
• Excellent attention to detail.

Responsibilities

• Evaluate quality of AI-generated code and provide rationale.
• Write functional and efficient code for various projects.
• Create robust test cases to confirm code functionality.

Skills

Fluency in English

Attention to detail

Proficiency with Python

Ability to articulate complex concepts

Communication skills

Education

Master’s or PhD in Computer Science

Bachelor’s in Computer Science/Engineering/STEM

Job description

Job Description

Overview

You’ll join an expert annotation team to create training data for the world's most advanced AI models. No previous AI experience is necessary. You'll get your foot in the door with one of the most prominent players in the AI / LLM space today. We seek software engineers with 4+ years of experience to train large AI language models, helping cutting-edge generative AI models write better code. Projects typically include discrete, highly variable problems that involve engaging with these models as they learn to code. We currently have 200+ roles open!

What Will I Be Doing?

• Evaluating the quality of AI-generated code, including human-readable summaries of your rationale
• Solve coding problems, writing functional and efficient code
• Writing robust test cases to confirm code works efficiently and effectively
• Solving coding challenges, creating instructions to help others, reviewing the code before it goes into the model, and working on a variety of projects (e.g., determining which piece of Python code is better, or building a full mobile application using a chatbot and improving its responses)

Pay Rates & Availability

Pay rates vary based on location and seniority; see this list. Expect 15+ hours per week, with no strict upper limit. Some engineers work 20-40 hours per week, and others 40+ hours per week. You’ll be paid weekly per hour of work on the platform.

Contract Length

Long term; there is no end date. They expect to have work for the next 2 years. You can end the contract at any time. A 12-month commitment is preferred, but if it’s not a fit, it’s understood.

Flexible Schedules

Developers can set their own hours—ideal candidates will be interested in spending 40 hours a week. They will be with teams, so strong performers will adapt to project urgency and stay engaged, but they will also be flexible on working hours. You can take a 3-hour lunch under this arrangement. Instead of tracking hours, you are paid according to time spent on the platform, calculated in coding exercises.

Interview Process

• Apply using this Ashby form.
• If you seem like a good fit, an async RLHF code review will be assigned, taking 35 minutes and must be completed within 72 hours.
• You’ll receive credentials to the RLHF platform, then a group call to answer onboarding questions.
• Perform a simulated production-level RLHF task; successful completion determines employment and leveling, and may lead to project opportunities as they become available.

Tech Stack Priorities

The current priority for this team is software engineers who are well-versed in Python.

Required Qualifications

• Master’s or PhD in Computer Science, OR Bachelor’s in Computer Science / Engineering / STEM with 4+ years of specialized experience
• Complete fluency in the English language
• Ability to articulate complex scientific concepts clearly and engagingly
• Excellent attention to detail and ability to maintain consistency in writing
• Solid understanding of grammar, punctuation, and style guidelines
• Proficiency with Python

Nice To Haves

• Recognized accomplishments or contributions to the coding community or in projects
• Proven analytical skills with an ability to approach problems creatively
• Adept communication skills, especially when understanding and discussing project requirements
• A commitment to continuous learning and staying updated with the latest coding advancements and best practices
• Enthusiasm for teaching AI models and experience with technical writing