Senior QA Engineer, Agent Security

Runlayer; Northern (KY); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Competitive salary & equity

Paid time off

Professional development

Top-tier equipment

Health benefits

Customer interaction

Job summary

Runlayer is seeking a senior QA engineer to own quality and testability for Runlayer Endpoint across macOS, Windows, Linux, and enterprise device-management platforms. You will build scalable, agent-driven testing systems for a complex cross-platform product and help ensure every release is reliable in real enterprise environments.

You’ll automate installation, enrollment, configuration, upgrade, rollback, and removal flows, reproduce customer issues, and partner with engineers to improve

Qualifications

• Senior-level experience owning QA automation or test infrastructure.
• Strong engineering skills in Python and system scripting (Bash/PowerShell).
• Hands-on experience testing software across macOS, Windows, Linux.

Responsibilities

• Own release testing and quality for Runlayer Endpoint.
• Build and operate device labs (physical and virtual).
• Design scalable test strategy across platforms, configurations, clients, and product states.
• Automate installation, enrollment, configuration, upgrade, rollback, and removal flows.
• Test deployments through enterprise device-management platforms.
• Validate integrations with AI coding clients.
• Build agent-driven tooling to expand coverage and accelerate analysis.
• Integrate automated quality signals into CI/release workflows.
• Reproduce customer issues and create regression tests.
• Collaborate with engineers to improve diagnostics, observability, and testability.

Skills

QA automation

Python

Bash

PowerShell

Cross-platform testing

Tools

CI/CD tooling

Job description

About Runlayer

AI is transforming how every company operates, but most enterprises are stuck. They want to move fast with AI Agents, tools, and workflows, but they can't do it safely. We're fixing that.

Our team built AI Actions for OpenAI, shipped Zapier Agents to millions of users, and launched the first remote MCP server with Anthropic. We helped establish the protocol, and now we're building the platform enterprises need to actually put AI to work.

Runlayer is one platform for MCPs, Skills, and Agents: purpose-built security, fine-grained governance, and complete observability so organizations can go all-in on AI across the entire company without the risk. We just raised a $30M Series A led by Felicis, with participation from Khosla Ventures, bringing our total raised to $42M. Already trusted by Gusto, Instacart, Opendoor, dbt Labs, and Decagon.

About the Role

You’ll own quality and testability for Runlayer Endpoint across macOS, Windows, Linux, enterprise device-management platforms, and AI clients.

This is a senior, hands-on engineering role combining exploratory testing, release qualification, and test-infrastructure development. You’ll build scalable, agent-driven testing systems for a complex cross-platform product and help ensure every release is reliable in real enterprise environments.

What You’ll Do

• Own release testing and quality for Runlayer Endpoint

• Build and operate a physical and virtual device lab

• Design a scalable test strategy across platforms, configurations, clients, and product states

• Automate installation, enrollment, configuration, upgrade, rollback, and removal flows

• Test deployments through enterprise device-management platforms

• Validate integrations with leading AI coding clients

• Build agent-driven tooling that expands coverage, gathers evidence, and accelerates failure analysis

• Integrate automated quality signals into CI and release workflows

• Reproduce customer issues and turn confirmed incidents into permanent regression tests

• Partner with engineers to improve product diagnostics, observability, and testability

• Define testability and coverage standards for new platforms, clients, and features

What We’re Looking For

• Senior-level experience owning QA automation or test infrastructure

• Strong engineering skills in Python and system scripting such as Bash and PowerShell

• Hands-on experience testing software across macOS, Windows, and Linux

• Experience with endpoint management, MDM, device labs, or comparable fleet orchestration

• Experience testing native installation, upgrades, background services, permissions, credentials, and OS configuration

• Strong knowledge of integration, end-to-end, stateful, and combinatorial testing

• Ability to distinguish product defects from infrastructure failures and flaky tests

• Experience building reliable CI-driven systems with useful diagnostics and test artifacts

• Clear technical judgment and excellent bug reporting

Bonus Qualifications

• Experience with Intune, Jamf Pro, Kandji, SimpleMDM, Mosyle, or Workspace ONE

• Experience testing endpoint-security or fleet-management products

• Familiarity with MCP and AI coding clients

• Experience building testing tools for AI agents

• Experience with native packaging and signing on macOS, Windows, or Linux

• Experience with fault injection, change-impact analysis, or combinatorial test generation

What We Offer

We provide a competitive package designed to attract and retain top talent who can work effectively with enterprise customers.

• Competitive salary and equity — compensation that reflects your expertise and customer-facing responsibilities.

• Paid time off — paid vacation, paid sick leave, and paid parental leave.

• Professional development — budget for conferences, courses, and certifications in AI, enterprise software, and customer success.

• Top-tier equipment — your choice of laptop and accessories to create your ideal work environment.

• Health benefits — comprehensive health, dental, and vision coverage.

• Customer interaction opportunities — work directly with innovative companies and see the immediate impact of your work.