Remote SRE Evaluator: AI-Driven Infra & DevOps

YO AI Labs

New York (NY)

Remote

USD 83,000 - 138,000

Part time

3 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

YO AI Labs is seeking experienced Developer & Infrastructure Experts to evaluate AI-powered workflows across software development, cloud infrastructure, DevOps, SRE, and platform engineering. You will test AI-generated commands, configurations, and workflows and provide practical feedback based on real-world engineering standards.

No prior AI experience is required—your technical infrastructure knowledge matters most.

Qualifications

  • Hands-on experience in software engineering, DevOps, SRE, cloud, or infrastructure engineering.
  • Proficiency with major cloud platforms and observability tools.
  • Experience with developer workflows and project management platforms such as GitHub, GitLab, Azure DevOps, and JIRA.
  • Experience using AI agents like ChatGPT, Claude Code, Claude Cowork, or Codex in development or infrastructure workflows.

Responsibilities

  • Test and validate AI-assisted workflows across DevOps, cloud, infrastructure, and platform engineering.
  • Evaluate AI-generated commands, configurations, scripts, and deployment workflows for accuracy and reliability.
  • Work with AWS, Azure, GCP, Kubernetes, Docker, Terraform, and CI/CD environments.
  • Review workflows involving GitHub, GitLab, Azure DevOps, and JIRA.
  • Assess AI agents and workplace connectors across tools such as Slack, Google Drive, and Microsoft 365.
  • Identify technical errors, security or reliability concerns, and workflow gaps.
  • Document findings and provide clear, actionable feedback.
  • Recommend improvements based on real-world engineering practices and industry standards.
  • Collaborate remotely with project stakeholders through written evaluations and virtual discussions.

Skills

Azure DevOps
Cloud Infrastructure
SRE
Platform Engineering
AWS/Azure/GCP
Kubernetes
Docker
Terraform
CI/CD
GitHub/GitLab/JIRA
Observability
AI Agents
Workplace Connectors

Tools

Kubernetes
Docker
Terraform
GitHub
GitLab
JIRA
AWS
Azure
GCP
CI/CD
Azure DevOps

Job description

YO AI Labs is seeking experienced Developer & Infrastructure Experts to evaluate AI-powered workflows across software development, cloud infrastructure, DevOps, SRE, and platform engineering. You will test AI-generated commands, configurations, and workflows and provide practical feedback based on real-world engineering standards.

No prior AI experience is required—your technical infrastructure knowledge matters most.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Remote DevOps & AI Infra Evaluator
Remote DevOps & AI Infra Evaluator

YO AI Labs • New York (NY)

Remote
USD 80,000 - 140,000
Remote Contract: Infrastructure & DevOps Evaluation Specialist
Remote Contract: Infrastructure & DevOps Evaluation Specialist

YO AI Labs • New York (NY)

Remote
USD 150,000 - 190,000
Remote AI-Powered DevOps & Infrastructure Specialist
Remote AI-Powered DevOps & Infrastructure Specialist

YO AI Labs • New York (NY)

Remote
USD 90,000 - 130,000
Remote DevOps Engineer — Build AI Infra & CI/CD
Remote DevOps Engineer — Build AI Infra & CI/CD

YO AI Labs • New York (NY)

Remote
USD 124,000 - 207,000
Remote SRE Incident Evaluator: AI Output Quality Reviewer
Remote SRE Incident Evaluator: AI Output Quality Reviewer

Obsidian • San Francisco (CA)

On-site
Remote Senior Civil Engineer - AI Evaluation Specialist
Remote Senior Civil Engineer - AI Evaluation Specialist

YO AI Labs • Houston (TX)

Remote
USD 55,000 - 124,000
Remote Specialized Industries Expert — AI Workflow Tester
Remote Specialized Industries Expert — AI Workflow Tester

YO AI Labs • New York (NY)

Remote
USD 83,000 - 165,000
Remote AI Software Engineer – Domain Expert (Contract)
Remote AI Software Engineer – Domain Expert (Contract)

YO AI Labs • Los Angeles (CA)

Remote
USD 55,000 - 110,000
Remote SRE AI Evaluator: Code Review & Debugging
Remote SRE AI Evaluator: Code Review & Debugging

AuraOne • United States

On-site
USD 83,000 - 131,000
Remote AI Data Science Domain Expert & Evaluator
Remote AI Data Science Domain Expert & Evaluator

YO AI Labs • Austin (TX)

Remote
USD 83,000 - 96,000