Embedded / Systems Engineer (C) – AI Code Analysis | Remote

Crossing Hurdles; United States; Remote; USD 82,656 - 137,760; Part time

Job summary

A technology solutions provider is looking for Software Engineering, Data Science, and Systems Design Experts proficient in C programming to evaluate responses generated by large language models. Responsibilities include assessing the accuracy, clarity, and completeness of LLM outputs, as well as conducting code testing and validation. Candidates should possess a degree in Computer Science and have real-world software engineering experience. This role offers remote working options and flexible commitment levels.

Qualifications

• Real-world experience in software engineering or related technical roles.
• Experience contributing to open-source projects.
• Strong attention to detail and ability to evaluate complex technical reasoning.

Responsibilities

• Evaluate LLM-generated responses for accuracy and completeness.
• Conduct fact-checking using trusted public sources.
• Test code and validate outputs using appropriate tools.

Skills

C programming language

Code review

HackerRank/LeetCode problem solving

Attention to detail

Familiarity with programming paradigms

Education

BS, MS, or PhD in Computer Science

Job description

Overview

Position: Software Engineering, Data Science, and Systems Design Experts, C language (5+ YOE)

Type: Hourly contract

Compensation: $60-$100 per hour

Location: Remote

Commitment: Full-time or Part-time Contract Work

Role Responsibilities

• Evaluate LLM-generated responses to coding and software engineering queries for accuracy, reasoning, clarity, and completeness
• Conduct fact-checking using trusted public sources and authoritative references
• Conduct accuracy testing by executing code and validating outputs using appropriate tools
• Annotate model responses by identifying strengths, areas of improvement, and factual or conceptual inaccuracies
• Assess code quality, readability, algorithmic soundness, and explanation quality
• Ensure model responses align with expected conversational behavior and system guidelines
• Apply consistent evaluation standards by following taxonomies, benchmarks, and detailed evaluation guidelines

Requirements

• BS, MS, or PhD in Computer Science or a closely related field
• Real-world experience in software engineering or related technical roles
• Expertise in C programming language
• Ability to solve HackerRank or LeetCode Medium and Hard–level problems independently
• Experience contributing to open-source projects, including merged pull requests
• Experience using LLMs while coding and understanding their strengths and failure modes
• Strong attention to detail and ability to evaluate complex technical reasoning and identify bugs or logical flaws
• Prior experience with RLHF, model evaluation, or data annotation work preferred
• Track record in competitive programming preferred
• Experience reviewing code in production environments preferred
• Familiarity with multiple programming paradigms or ecosystems preferred
• Experience explaining complex technical concepts to non-expert audiences preferred