Senior Quality Engineer - AutoSOC

arcticwolf; Bengaluru; On-site; INR 1,200,000 - 1,600,000; Full time

Job summary

Arctic Wolf is seeking experienced quality engineers in Bengaluru to advance automation testing across our security operations platform.

You will build and maintain automation frameworks, review test strategies, and design AI/ML testing pipelines including GenAI validation.

Join a team delivering scalable cloud-based testing with Selenium, Playwright, Docker, Kubernetes, and AWS services.

Qualifications

• 5+ years of experience shipping quality software.
• Experience building automation frameworks.
• Experience with CI/CD pipelines and automation tooling.
• Experience deploying services on cloud platforms (AWS, Azure, GCP).
• Experience testing AI/ML systems including LLMs.

Responsibilities

• Create and extend software frameworks and tools to run, monitor, and report on automated tests.
• Review testing strategies and test plans and provide input to development teams.
• Architect, design and build software to automate testing methods (API validation, performance, fuzzing).
• Develop and maintain test frameworks for GenAI-based and AI/ML apps, including model validation and regression testing.
• Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability.
• Work as part of a team of highly skilled software professionals.
• Continuously learn and expand your technical horizons.

Skills

Automation frameworks

CI/CD pipelines

API validation

Performance testing

AI/ML testing

LLM evaluation

Load testing

Fuzz testing

Distributed systems

Cloud deployments

Tools

Selenium

Playwright

Docker

Kubernetes

AWS

LangChain

OpenAPI

Postgres

Linux

Ragas

LLM evaluation frameworks

Job description

About the Role

The Arctic Wolf security operations platform ingests and processes upwards of 600 billion events a day from a wide variety of on-premise devices and cloud platforms. The security pipeline is a distributed system of loosely-coupled microservices that constitute our Realtime analysis and threat detection systems. These services distil the incoming events into actionable intelligence that our Concierge Security Teams use to protect customers.

We are looking for experienced quality engineers to join our pack and work with us to build and expand the capabilities of our testing platform.

You Will:

• Create and extend software frameworks and tools to run, monitor, and report on automated tests. Have experience building and maintaining Automation frameworks and CI/CD pipeline.


• Review testing strategies, approaches, and test plans and provide insight to development teams .


• Architect, design and build software to automate a variety of testing methods (e.g. API validation, performance/load testing, fuzzing, etc.)


• Develop and maintain test frameworks fo r GenAI -based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection, and regression testing for AI inference APIs.


• Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability .


• Work as part of a team of highly skilled software professionals .


• Continuously learn and expand your technical horizons

Our Technology Stack:

Selenium, Playwright, Docker, Kubernetes, AWS (Bedrock, Lambda, SQS, S3, etc.) , LangChain , LLM evaluation frameworks (e.g., Ragas), OpenAPI , Postgres, Linux.

You :

• Are excited to work at the intersection of AIML, Big Data and the Cybersecurity problem space


• Have 5+ years of experience shipping quality software


• Love driving high software quality


• Have experience deploying services on cloud computing platforms ( e.g , AWS, Azure, GCP)


• Are an expert using common tools for executing functional, load and fuzz testing (e.g. Locust , CATS )


• Have worked on distributed systems and microservices architecture (preferred)

About Arctic Wolf

At Arctic Wolf, we're cultivating a collaborative and productive work environment that welcomes a div ersit y of backgrounds, cultures, and ideas to make our teams even stronger as we grow globally. We've been named one of the 50 Most Innovative Companies in the world for 2022 (Fast Company)-and the 2nd Most Innovative Security Company. We have won countless awards for our excellence in security operations and remain dedicated to providing an industry-leading customer and employee experience including:

• Top Workday USA (2021-2024)


• Great Place to Work (2022-2024) & Best Workplaces for Women (2024) in Canada


• Best Workplaces in Tech & For Women in the UK (2023)


• Top Company by Kununu in Germany (2024)

Our Values

Arctic Wolf recognizes that success comes from delighting our customers, so we work together to ensure that happens every day. We believe in diversity and inclusion and truly value the unique qualities and unique perspectives all employees bring to the organization. And we appreciate that-by protecting people's and organizations' sensitive data and seeking to end cyber risk- we get to work in an industry that is fundamental to the greater good.

We celebrate unique perspectives by creating a platform for all voices to be heard through our Pack Unity program. We encourage all employees to join or create a new alliance. See more about our Pack Unity here. Arctic Wolf is an Equal Opportunity Employer and considers applicants for employment without regard to race, colour , religion, sex, orientation, national origin, age, disability, genetics, or any other basis forbidden under federal, provincial, or local law. Arctic Wolf is committed to fostering a welcoming, accessible, respectful, and inclusive environment ensuring equal access and participation for people with disabilities. As such, we strive to make our entire employee experience as accessible as possible and provide accommodations as required for candidates and employees with disabilities and/or other specific needs where possible. Please let us know if you require any accommodations by emailing [e-mail] .

On-Camera Policy

To support a fair, transparent, and engaging interview experience, candidates interviewing remotely are expected to be on camera during all video interviews.

Being on camera fosters authentic connection, improves communication, and allows for full engagement from both candidates and interviewers.

We understand that technical, bandwidth, or location-related challenges may occasionally prevent video use. If this applies, candidates are required to notify us in advance so we can explore appropriate accommodations.

Security Requirements

Conducts duties and responsibilities in accordance with AWN's Information Security policies, standards, processes, and controls to protect the confidentiality, integrity and availabilit