Senior Software Quality Engineer

Red Hat; Boston (MA); On-site; USD 100,000 - 140,000; Full time

Job summary

Red Hat is seeking a Senior Software Quality Engineer to join the InstructLab team. This role involves developing test strategies for AI/ML products, executing tests, and engaging with open-source communities. Ideal candidates will have extensive experience in quality engineering and automation, particularly with Python, and a passion for collaborating on complex projects.

Qualifications

• 5+ years of experience as a Software Quality Engineer or similar role.
• Proficiency in Python and Bash scripting.
• Experience with AI/ML platforms like PyTorch and TensorFlow.

Responsibilities

• Execute manual and automated tests, providing timely status updates.
• Identify and document unwanted behavior and bias in models.
• Develop and maintain automation frameworks using Python.

Skills

Scripting and automation

AI/ML platforms

CI/CD tools

Test case development

Quick learning

Education

Bachelor’s degree in computer science or related field

Job description

Join to apply for the Senior Software Quality Engineer role at Red Hat

Job Summary

Red Hat’s Global Engineering team is looking for an experienced quality engineer to join our newly formed InstructLab team. In this role, you’ll contribute directly to Red Hat’s rapidly growing AI/ML (artificial intelligence and machine learning) family of products and will be responsible for developing test strategies and frameworks, designing and implementing automated tests, creating and carrying out test plans, and maintaining and enhancing test frameworks. Quality engineers in this role will participate in standard quality practices, design reviews, automated testing, and productization for major product features and bug fixes. You may also explore novel testing methods for non-deterministic systems and address potential sources of bias during model build and training.

The ideal candidate will be highly collaborative, passionate about working on complex projects, and able to communicate effectively with team members, stakeholders, and leadership. This role requires engaging with upstream open source communities and working in a flexible, open environment. The position reports to the Manager of Software Engineering for InstructLab and requires a presence in the local office at least 3 days per week.

Primary Job Responsibilities

1. Execute manual and automated tests, providing timely status updates.
2. Identify, document, and advocate for the resolution of unwanted behavior, output, and bias in models, and communicate impacts to customers.
3. Engage with upstream AI/ML communities, evaluate new technologies, and consider integrations.
4. Research new features and design test cases focusing on performance, scalability, automation, and bias reduction.
5. Develop and maintain automation frameworks, scripts, and benchmarking tools using Python.
6. Lead initiatives to improve and scale testing processes.
7. Contribute to open-source projects within Red Hat’s AI product family.
8. Communicate regularly with project stakeholders, including teams, product managers, and leadership.

Required Skills

1. 5+ years of experience as a Software Quality Engineer, Software Engineer, or similar role.
2. Proficiency in scripting and automation with Python and Bash.
3. Experience with AI/ML platforms such as PyTorch, LLaMA.cpp, vLLM, fsdp, deepspeed, Kubeflow, and TensorFlow.
4. Experience with CI/CD tools like GitHub Actions.
5. Knowledge of hardware accelerators like GPU, CUDA, and ROCm.
6. Experience developing various levels of test cases and automation.
7. Ability to quickly learn new tools and technologies.

Nice to Haves

1. Experience with Kubernetes/OpenShift, containers, YAML, controllers, and operators.
2. Understanding of DevOps, Scrum, and Jira.
3. Bachelor’s degree or higher in computer science or related field, or equivalent experience.