Remote Site Reliability Engineer — AI Workflow Evaluator

YO AI Labs

Seattle (WA)

Remote

USD 138,000 - 276,000

Full time

4 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

YO AI Labs is seeking experienced Developer & Infrastructure Experts to evaluate AI-powered workflows across software development, cloud infrastructure, DevOps, SRE, and platform engineering. You will test AI-generated commands, configurations, and workflows and provide practical feedback based on real-world engineering standards.

No prior AI experience is required—your technical expertise and infrastructure knowledge are what matter most.

Qualifications

Experience evaluating AI-assisted workflows and configurations.
Strong infrastructure knowledge across cloud, DevOps and platform engineering.
Ability to give clear, actionable feedback.

Responsibilities

Test and validate AI-assisted workflows across DevOps, cloud, infrastructure, and platform engineering.
Evaluate AI-generated commands, configurations, scripts, and deployment workflows.
Work with AWS, Azure, GCP, Kubernetes, Docker, Terraform, and CI/CD environments.
Review workflows involving GitHub, GitLab, Azure DevOps, and JIRA.
Assess AI agents and workplace connectors across Slack, Google Drive, and Microsoft 365.
Identify technical errors, security or reliability concerns, and workflow gaps.
Document findings and provide clear, actionable feedback.
Recommend improvements based on real-world engineering practices and standards.
Collaborate remotely with project stakeholders through written evaluations and virtual discussions.