Machine Learning Test Engineer, Transformers team - US Remote

Hugging Face; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

A leading AI platform provider in New York is seeking a Senior Test Engineer to lead the redesign and scaling of their testing infrastructure. This pivotal role emphasizes a strategic approach to testing within diverse platforms and projects. Ideal candidates possess experience in modern ML frameworks and managing extensive test suites. The position promotes collaboration across teams to ensure testing remains a core growth enabler. Competitive opportunities in a dynamic environment await.

Qualifications

• Proven experience with large-scale software projects.
• Strong belief in architecting for growth.
• Experience in managing high-volume test suites.

Responsibilities

• Lead the reinvention and scaling of testing infrastructure.
• Design growth-oriented testing architectures.
• Partner with existing leads to improve the testing ecosystem.
• Embed testing as a priority with cross-functional teams.
• Anticipate future testing needs and adapt systems.

Skills

Experience with modern machine learning frameworks

Mindset prioritizing testing

Architecting scalable testing systems

Managing high-volume test suites

Familiarity with CI/CD tools

Tools

Testing frameworks

CI/CD tools

Docker

Kubernetes

pytest

Job description

Get AI-powered advice on this job and more exclusive features.

At Hugging Face, we’re on a journey to democratize good AI. We are building the fastest growing platform for AI builders with over 5 million users & 100k organizations who collectively shared over 1M models, 300k datasets & 300k apps. Our open-source libraries have more than 400k+ stars on Github.

About the Role

We are seeking a highly motivated Senior Test Engineer to join our Transformers team, where you will play a pivotal role in advancing one of the most critical aspects of our mission: testing. As projects like Transformers, PyTorch, and vLLM rapidly expand in scale and complexity, the testing infrastructure must evolve in tandem. With over 100,000‑150,000 tests for the Transformers library alone—and the need to support diverse platforms—this role is essential to ensuring our testing ecosystem scales seamlessly to meet growing demands.

This is not a conventional testing role. You will own the strategic redesign and scaling of our testing infrastructure, ensuring it keeps pace with the relentless growth of our projects. While every engineer contributes to testing for their features, we need someone with a bird’s-eye view to champion testing as a core enabler of growth, rather than an afterthought.

• Lead the reinvention and scaling of testing infrastructure to support 100K+ tests across multiple platforms (e.g., Transformers, PyTorch, vLLM)
• Design growth‑oriented testing architectures that prioritize scalability, reliability, and integration with CI/CD pipelines, avoiding fragmented or isolated test workflows
• Partner with the existing testing lead to establish best practices and drive continuous improvement of the testing ecosystem
• Collaborate with cross‑functional teams to embed testing as a first‑class project, ensuring it receives the focus and resources required to sustain rapid growth
• Anticipate future testing needs and proactively adapt systems to accommodate evolving project scope, complexity, and platform diversity

About you

• Proven experience working with modern machine learning frameworks (e.g., Transformers, PyTorch) and large‑scale software projects
• A mindset that treats testing as a strategic priority, not a secondary task—demonstrating how robust testing directly enables project scalability
• Strong belief in architecting for growth: You prioritize scalable, modular testing systems over isolated, atomic tests
• Experience managing high‑volume test suites (100K+ tests) and cross‑platform testing challenges
• Familiarity with CI/CD tools and automated testing frameworks

Preferred Qualifications

• Background in open‑source development or contributions to major ML libraries
• Experience in re‑architecting testing systems for rapidly growing projects

If you’re interested in joining us, but don’t tick every box above, we still encourage you to apply! We're building a diverse team whose skills, experiences, and background complement one another. We're happy to consider where you might be able to make the biggest impact.

We are an equal opportunity employer and we do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.