Software Development Engineer in Test - Agentic Automation (Remote, CAN)

Skillhub Solutions Inc.

Canada

Remote

CAD 120,000 - 170,000

Full time

9 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

CrowdStrike is hiring a remote, Canada-based Software Development Engineer in Test to support its Detonations and Threat Analysis Platform Engineering team. The role builds automation for a large-scale cloud cybersecurity platform and contributes to testing and evaluation of AI agents.

The candidate will design and implement automated tests, extend AI-driven test generation, and ensure reliability of AI outputs within CI pipelines.

Qualifications

  • At least 5 years in software quality, including 3 or more years in SDET or test automation development.
  • Strong programming skills in Java, Node.js, or Python; Python is preferred for evaluation and agent work.
  • Experience building test frameworks integrated with CI/CD, testing web services and APIs, and using performance tools such as Locust or k6.
  • A verification-first approach to AI output and experience using AI technologies to improve workflows and business outcomes.

Responsibilities

  • Design, develop, and maintain automated test suites and frameworks for distributed cloud systems.
  • Extend agentic test generation and analysis tools, and build AI-powered workflows to automate testing tasks.
  • Maintain AI agent evaluation suites, datasets, and scoring pipelines; enforce evaluation gates in CI and incorporate production failures into evaluations.
  • Identify unreliable AI output, including hallucinated assertions, flaky or redundant tests, incorrect failure triage, and judge bias.
  • Design and analyze performance, load, and stress tests; validate service integrations and customer-facing features end to end.
  • Review designs for testability and contribute to team quality and evaluation standards.

Skills

SDET
Java
Node.js
Python
CI/CD

Tools

Locust
k6
Web services APIs

Job description

Software Development Engineer in Test - Agentic Automation (Remote, CAN)

Remote - Canada Full-time CA$120,000 - CA$170,000 / year

CrowdStrike is hiring a remote, Canada-based Software Development Engineer in Test to support its Detonations and Threat Analysis Platform Engineering team. The role builds automation for a large-scale cloud cybersecurity platform and contributes to testing and evaluation of AI agents.

Responsibilities
  • Design, develop, and maintain automated test suites and frameworks for distributed cloud systems.
  • Extend agentic test generation and analysis tools, and build AI-powered workflows to automate testing tasks.
  • Maintain AI agent evaluation suites, datasets, and scoring pipelines; enforce evaluation gates in CI and incorporate production failures into evaluations.
  • Identify unreliable AI output, including hallucinated assertions, flaky or redundant tests, incorrect failure triage, and judge bias.
  • Design and analyze performance, load, and stress tests; validate service integrations and customer-facing features end to end.
  • Review designs for testability and contribute to team quality and evaluation standards.
Qualifications
  • At least 5 years in software quality, including 3 or more years in SDET or test automation development.
  • Strong programming skills in Java, Node.js, or Python; Python is preferred for evaluation and agent work.
  • Experience building test frameworks integrated with CI/CD, testing web services and APIs, and using performance tools such as Locust or k6.
  • A verification-first approach to AI output and experience using AI technologies to improve workflows and business outcomes.

Compensation: CAD $120,000–$170,000 per year, plus variable/incentive compensation, equity, and benefits.

Canadian-based employment; employees must be legally entitled to work in Canada. Background checks may apply.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior SDET for AI-Driven Cloud Testing (Remote CAN)
Senior SDET for AI-Driven Cloud Testing (Remote CAN)

Skillhub Solutions Inc. • Canada

Remote
CAD 120,000 - 170,000
Equity
Benefits
Software Development Engineer in Test - Agentic Automation (Remote, CAN)
Software Development Engineer in Test - Agentic Automation (Remote, CAN)

CrowdStrike Inc. • Halifax

On-site
CAD 120,000 - 170,000
Equity
Benefits
Professional development
+1
Software Development Engineer in Test - Agentic Automation (Remote, CAN)
Software Development Engineer in Test - Agentic Automation (Remote, CAN)

CrowdStrike Inc. • Toronto

On-site
CAD 120,000 - 170,000
Market-leading compensation
Equity awards
Wellness programs
+5
Software Development Engineer in Test - Agentic Automation (Remote, CAN)
Software Development Engineer in Test - Agentic Automation (Remote, CAN)

CrowdStrike Inc. • Calgary

On-site
CAD 120,000 - 170,000
Equity awards
Wellness programs
Vacation time
+5
Software Development Engineer in Test - Agentic Automation (Remote, CAN)
Software Development Engineer in Test - Agentic Automation (Remote, CAN)

CrowdStrike Inc. • British Columbia

On-site
CAD 120,000 - 170,000
Competitive compensation & equity
Wellness programs
Generous vacation
Software Development Engineer in Test - Agentic Automation (Remote, CAN)
Software Development Engineer in Test - Agentic Automation (Remote, CAN)

CrowdStrike Inc. • Winnipeg

On-site
CAD 120,000 - 170,000
Market-leading compensation and equity
Comprehensive wellness programs
Generous vacation and holidays
+4
Software Development Engineer in Test - Agentic Automation (Remote, CAN)
Software Development Engineer in Test - Agentic Automation (Remote, CAN)

CrowdStrike Canada ULC • Alberta

Hybrid
CAD 120,000 - 170,000
Competitive compensation
Equity awards
Medical and wellness programs
+2
SDET - AI Agent Testing & Platform Automation
SDET - AI Agent Testing & Platform Automation

CrowdStrike Inc. • Halifax

On-site
CAD 120,000 - 170,000
Equity
Benefits
Professional development
+1
AI and Automation Engineer
AI and Automation Engineer

Skillhub Solutions Inc. • Canada

Remote
CAD 86,000 - 143,000
Developement+QA Architect Canada-Remote
Developement+QA Architect Canada-Remote

RELQ TECHNOLOGIES • Canada

Remote
CAD 140,000 - 180,000