Senior Software Engineer

Umanist Staffing LLC; Toronto; Remote; CAD 150,000 - 200,000; Part time

Job summary

A staffing solutions company in Toronto is looking for a contractor to improve LLM performance on various projects. The role involves leading edge-agent use cases, collaborating with the team, reviewing code responses, and evaluating code diffs. Applicants should have extensive software engineering experience, particularly in building scalable applications, and possess excellent communication skills. Commitment is flexible, with a minimum of 10 hours per week.

Qualifications

• Several years of software engineering experience with a top-tier product company.
• Strong expertise in deploying scalable software using modern languages.
• Deep understanding of software architecture and code quality.
• Proven ability to review code diffs effectively.

Responsibilities

• Lead end-to-end agent use cases such as home automation.
• Collaborate to identify model behavior edge cases.
• Review model-generated code responses using a ranking system.
• Evaluate code diffs for correctness and provide rationales.

Skills

Software engineering experience

Building full-stack applications

Code review assessment

Good communication skills

Job description

Job Description

Job Description

Work across multiple different projects to improve LLM performance on code : sample projects

• Leading and delivering end-to-end agent use cases such as home automation agents, coding copilots, or creative design assistants.
• Collaborate with the team to identify edge cases and ambiguities in model behavior.
• Review and compare 3–4 model-generated code responses per task using a structured ranking system.
• Evaluate code diffs for correctness, code quality, style, and efficiency. Provide clear, detailed rationales explaining the reasoning behind each ranking decision.

Required Skills Experience

Several years of software engineering experience, including 2+ continuous years at a top-tier product company (e.g., Google, Stripe, Amazon, Apple, Meta, Netflix, Microsoft, Datadog, Dropbox, Shopify, PayPal, IBM Research).

Strong expertise in building full-stack applications and deploying scalable, production-grade software using modern languages and tools.

Deep understanding of software architecture, design, development, debugging, and code quality / review assessment.

Proven ability to review code diffs and evaluate correctness, maintainability, and efficiency.

Excellent oral and written communication skills for clear, structured evaluation rationales.

Engagement Details

Commitment : flexible engagement, minimum 10 hrs / week, up to 40 hrs / week (partial PST overlap required).

Type : Contractor (no medical / paid leave).

Duration : 1 month potential extensions based on performance and fit.