Remote Software Engineer - QA, CI/CD & AI Tooling

SaidGig

New York (NY)

Remote

USD 69,000 - 96,000

Full time

5 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

SaidGig is seeking experienced software evaluation engineers to design and execute real‑world coding tasks that mirror authentic developer work. You will work with version control, code review, issue tracking, and CI/CD workflows using AI‑powered tools to validate performance, reliability, and correctness.

Your duties include assessing technical outputs in relevant environments, building reproducible test suites, configuring integrations, and documenting product behavior.

Qualifications

  • Minimum 3 years of professional software engineering experience.
  • Strong Git/GitHub workflow knowledge including PRs, reviews, branching, diff analysis, and CI logs.
  • Proficiency with CI/CD systems; GitHub Actions preferred for reproducible builds.
  • Experience using connectors across Claude and ChatGPT.
  • Advanced Python or Bash scripting for automating env setup and resets.
  • Solid understanding of REST APIs, OAuth, and webhooks.
  • Familiar with enterprise SaaS platforms (Slack, Google Workspace, Microsoft 365).
  • Experience with AI assistants or agent tools; MCP knowledge is a plus.
  • Technical QA, evaluation, or data annotation with rubric-based assessment.
  • Excellent written and spoken English with attention to detail.

Responsibilities

  • Design and execute structured evaluation tasks mirroring developer work (VCS, code review, issues, CI/CD).
  • Assess and grade technical outputs for correctness in relevant environments.
  • Create reproducible test environments with real histories and CI workflows.
  • Configure, document, and troubleshoot integrations and authentication across services.
  • Investigate undocumented product behavior through hands-on testing.
  • Participate in calibration sessions to maintain consistent evaluation across contributors.

Skills

Git & GitHub
CI/CD
Python / Bash
REST APIs / OAuth
AI tools / agent tooling
English communication

Tools

GitHub Actions
CI log diagnostics

Job description

SaidGig is seeking experienced software evaluation engineers to design and execute real‑world coding tasks that mirror authentic developer work. You will work with version control, code review, issue tracking, and CI/CD workflows using AI‑powered tools to validate performance, reliability, and correctness.

Your duties include assessing technical outputs in relevant environments, building reproducible test suites, configuring integrations, and documenting product behavior.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote Senior Software Engineer - AI Evaluation & Coding
Remote Senior Software Engineer - AI Evaluation & Coding

SaidGig • New York (NY)

Remote
USD 138,000 - 207,000
Remote QA Specialist - AI Video Testing & Support
Remote QA Specialist - AI Video Testing & Support

SaidGig • New York (NY)

Remote
USD 41,000 - 47,000
Remote AI QA Engineer — Contract Backed by Human-in-the-Loop Testing
Remote AI QA Engineer — Contract Backed by Human-in-the-Loop Testing

SaidGig • New York (NY)

Remote
USD 124,000 - 241,000
Remote Engineering & Data Tools Specialist
Remote Engineering & Data Tools Specialist

SaidGig • New York (NY)

Remote
USD 55,000 - 110,000
Remote Software Developer for AI Training & Architecture
Remote Software Developer for AI Training & Architecture

SaidGig • New York (NY)

Remote
USD 83,000 - 103,000
Remote Research Engineer - Code Gen & Model Evaluation
Remote Research Engineer - Code Gen & Model Evaluation

SaidGig • New York (NY)

Remote
USD 69,000 - 138,000
Software Engineer
Software Engineer

Remotebridge • United States

Remote
USD 8,266,000 - 13,776,000
Remote Software Engineer - AI Workflows & QA Eval
Remote Software Engineer - AI Workflows & QA Eval

Remotebridge • United States

Remote
USD 8,266,000 - 13,776,000
Remote QA Automation Engineer for CI/CD & Performance
Remote QA Automation Engineer for CI/CD & Performance

Quik Hire Staffing • United States

Remote
GBP 60,000 - 75,000
Remote AI Workflow Evaluator for Specialized Industries
Remote AI Workflow Evaluator for Specialized Industries

SaidGig • New York (NY)

Remote
USD 41,000 - 110,000