Remote Contract Software Engineer — AI Evaluation & Automation

RemoteJobsOne; Atlanta (GA); Remote; USD 69,000 - 96,000; Part time

Job summary

RemoteJobsOne is seeking Software Engineers for a fully remote contractor role focused on AI-assisted development workflow enhancements. You will contribute to training data and evaluation tasks, emphasizing real-world inputs and reproducible environments.

Required are 3+ years in software engineering, strong Git/GitHub workflows, and experience with CI/CD tools, REST APIs, and SaaS platforms. Apply your expertise to ensure high-quality assessments.

Qualifications

• 3+ years of software eng experience required.
• Strong command of Git/GitHub workflows including PRs, reviews, branching, and diffs.
• Experience with CI/CD, especially GitHub Actions, and reproducible builds.
• Familiarity with AI tooling, agent calls, MCP, and SaaS platforms.

Responsibilities

• Execute structured evaluation tasks simulating developer activities.
• Assess and grade technical outputs hands-on in relevant environments.
• Seed and maintain reproducible test environments with real histories and CI workflows.
• Configure integrations and authentication flows across services.
• Investigate undocumented product behaviors through hands-on testing.
• Participate in calibration sessions to align evaluation methods.

Skills

Git/GitHub workflows

CI/CD pipelines

Python scripting

REST APIs

OAuth

Webhooks

Slack

Google Workspace

Microsoft 365

AI assistants

Agent tools

Model Context Protocol

QA and data annotation

English communication

Tools

GitHub Actions

Job description

RemoteJobsOne is seeking Software Engineers for a fully remote contractor role focused on AI-assisted development workflow enhancements. You will contribute to training data and evaluation tasks, emphasizing real-world inputs and reproducible environments.

Required are 3+ years in software engineering, strong Git/GitHub workflows, and experience with CI/CD tools, REST APIs, and SaaS platforms. Apply your expertise to ensure high-quality assessments.