Staff Quality Engineer

arcticwolf; Bengaluru; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Arctic Wolf is seeking a Staff Quality Engineer to join our security operations platform. You will build and extend automation frameworks, run automated tests, and contribute to CI/CD pipelines to improve release quality.

You will design testing for GenAI/AI/ML models, validate LLM prompts, assess latency, bias and reliability, and ensure robust quality across distributed microservices running on AWS, Kubernetes and cloud-native stacks.

Qualifications

• 8+ years of experience shipping quality software.
• Experience deploying services on cloud platforms (AWS, Azure, GCP).
• Experience using testing tools for functional, load and fuzz testing (e.g. Locust, CATS).
• Experience with distributed systems and microservices architecture (preferred).

Responsibilities

• Create and extend automation frameworks and tools to run, monitor, and report on automated tests; build automation frameworks and CI/CD pipelines.
• Review testing strategies, approaches, and test plans and provide insight to development teams.
• Architect, design and build software to automate testing methods (API validation, performance/load testing, fuzzing).
• Develop and maintain test frameworks for GenAI/AI/ML applications, including model validation and regression testing for AI inference APIs.
• Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability.
• Work as part of a team of highly skilled software professionals.
• Continuously learn and expand your technical horizons.

Skills

Automation testing

CI/CD pipelines

API validation

Load testing

GenAI testing

LLM evaluation

Distributed systems

Cloud deployment

Tools

Selenium

Playwright

Docker

Kubernetes

AWS

LangChain

LLM evaluation frameworks

OpenAPI

Postgres

Linux

Job description

Job Description

At Arctic Wolf, we're redefining the cybersecurity landscape. With our employee Pack members, spread out globally, committed to setting new industry standards. Our accomplishments speak for themselves, from our recognition in the Forbes Cloud 100 , CNBC Disruptor 50 , Fortune Future 50 , and Fortune Cyber 60 to winning the 2024 CRN Products of the Year award. We're proud to be named a Leader in the IDC MarketScape for Worldwide Managed Detection and Response Services and earning a Customers' Choice distinction from Gartner Peer Insights . Our Aurora Platform also received CRN's Products of the Year award in the inaugural Security Operations Platform category. Join a company that's not only leading, but also shaping, the future of security operations.

Our mission is simple: End Cyber Risk. We're looking for a Staff QE to be part of making this happen.

About the Role

The Arctic Wolf security operations platform ingests and processes upwards of 600 billion events a day from a wide variety of on-premise devices and cloud platforms. The security pipeline is a distributed system of loosely-coupled microservices that constitute our Realtime analysis and threat detection systems. These services distil the incoming events into actionable intelligence that our Concierge Security Teams use to protect customers. We are looking for experienced quality engineers to join our pack and work with us to build and expand the capabilities of our testing platform.

You Will:

• Create and extend software frameworks and tools to run, monitor, and report on automated tests. Have experience building and maintaining Automation frameworks and CI/CD pipeline.
• Review testing strategies, approaches, and test plans and provide insight to development teams.
• Architect, design and build software to automate a variety of testing methods (e.g. API validation, performance/load testing, fuzzing, etc.).
• Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection, and regression testing for AI inference APIs.
• Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability.
• Work as part of a team of highly skilled software professionals.
• Continuously learn and expand your technical horizons

Our Technology Stack:

• Selenium
• Playwright
• Docker
• Kubernetes
• AWS (Bedrock, Lambda, SQS, S3, etc.)
• LangChain
• LLM evaluation frameworks (e.g., Ragas)
• OpenAPI
• Postgres
• Linux

You:

• Are excited to work at the intersection of AIML, Big Data and the Cybersecurity problem space
• Have 8+ years of experience shipping quality software
• Love driving high software quality
• Have experience deploying services on cloud computing platforms (e.g, AWS, Azure, GCP)
• Are an expert using common tools for executing functional, load and fuzz testing (e.g. Locust, CATS)
• Have worked on distributed systems and microservices architecture (preferred)

About Arctic Wolf

At Arctic Wolf, we're cultivating a collaborative and productive work environment that welcomes a diversity of backgrounds, cultures, and ideas to make our teams even stronger as we grow globally. We've been named one of the 50 Most Innovative Companies in the world for 2022 (Fast Company)-and the 2nd Most Innovative Security Company. We have won countless awards for our excellence in security operations and remain dedicated to providing an industry-leading customer and employee experience including:

• Top Workday USA (2021-2024)
• Great Place to Work (2022-2024) & Best Workplaces for Women (2024) in Canada
• Best Workplaces in Tech & For Women in the UK (2023)
• Top Company by Kununu in Germany (2024)

Our Values

Arctic Wolf recognizes that success comes from delighting our customers, so we work together to ensure that happens every day. We believe in diversity and inclusion and truly value the unique qualities and unique perspectives all employees bring to the organization. And we appreciate that-by protectingpeople's and organizations' sensitive data and seeking to end cyber risk- we get to work in an industry that is fundamental to the greater good. We celebrate unique perspectives by creating a platform for all voices to be heard through our Pack Unity program. We encourage all employees to join or create a new alliance. See more about our Pack Unity here. Arctic Wolf is an Equal Opportunity Employer and considers applicants for employment without regard to race, colour, religion, sex, orientation, national origin, age, disability, genetics, or any other basis forbidden under federal, provincial, or local law. Arctic Wolf is committed to fostering a welcoming, accessible, respectful, and inclusive environment ensuring equal access and participation for people with disabilities. As such, we strive to make our entire employee experience as accessible as possible and provide accommodations as required for candidates and employees with disabilities and