Quality Engineer II: AI/ML Test Automation & CI/CD

Arctic Wolf; Hinoba-an; On-site; PHP 600,000 - 900,000; Full time

Job summary

Arctic Wolf is seeking experienced quality engineers to join our pack and expand the capabilities of our testing platform. You will build and maintain automation frameworks, drive CI/CD, and contribute to AI/ML testing workflows across distributed services.

Join a team focusing on API validation, performance testing, and LLM evaluation to ensure robust security operations. Remote-friendly, with a strong emphasis on collaboration and continuous learning.

Qualifications

• 2–4 years of experience shipping quality software.
• Experience deploying services on cloud platforms (AWS, Azure, GCP).
• Proficient with functional, load and fuzz testing tools (e.g., Locust, CATS).

Responsibilities

• Create and extend software frameworks and tools to run, monitor, and report on automated tests.
• Have experience building and maintaining Automation frameworks and CI/CD pipeline.
• Review testing strategies, approaches, and test plans and provide insight to development teams.
• Architect, design and build software to automate a variety of testing methods (e.g. API validation, performance/load testing, fuzzing, etc.).
• Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection, and regression testing for AI inference APIs.
• Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability.
• Work as part of a team of highly skilled software professionals.
• Continuously learn and expand your technical horizons.

Skills

Automation frameworks

CI/CD pipelines

API testing

Performance testing

AI/ML testing

LLM evaluation

Distributed systems

Tools

Selenium

Playwright

Docker

Kubernetes

AWS

LangChain

OpenAPI

Postgres

Linux

Job description

Arctic Wolf is seeking experienced quality engineers to join our pack and expand the capabilities of our testing platform. You will build and maintain automation frameworks, drive CI/CD, and contribute to AI/ML testing workflows across distributed services.

Join a team focusing on API validation, performance testing, and LLM evaluation to ensure robust security operations. Remote-friendly, with a strong emphasis on collaboration and continuous learning.