Machine Learning Test Engineer, Transformers team - EMEA Remote

Jobgether; United Kingdom; Hybrid; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Flexible working hours

Health, dental, and vision coverage

Parental leave and flexible paid time off

Reimbursement for conferences and training

Company equity

Job summary

A technology company in the United Kingdom is seeking a Machine Learning Test Engineer to lead the redesign of testing infrastructure. You will manage high-volume test suites, architect testing systems integrated with CI/CD pipelines, and collaborate with cross-functional teams. The ideal candidate has experience with modern machine learning frameworks and a strategic mindset towards testing as a vital component of project success. This role offers flexible working hours and a collaborative environment.

Qualifications

• Proven experience with modern machine learning frameworks (e.g., Transformers, PyTorch).
• Experience managing high-volume test suites and cross-platform testing challenges.
• Strong understanding of CI/CD pipelines and automated testing frameworks.
• Excellent communication in English.

Responsibilities

• Lead the redesign and scaling of testing infrastructure.
• Architect and implement scalable testing systems integrated with CI/CD pipelines.
• Establish best practices for test coverage, reliability, and maintainability.
• Anticipate future testing needs and adapt systems to evolving complexity.
• Collaborate with engineers, product managers and stakeholders to make testing a core project aspect.
• Monitor and improve testing processes to reduce technical debt.

Skills

Experience with modern machine learning frameworks

Managing high-volume test suites

Understanding of CI/CD pipelines

Excellent collaboration and communication skills

Open-source involvement

English communication

Tools

Test automation frameworks

Cross-platform testing tools

Job description

As a Machine Learning Test Engineer, you will play a critical role in scaling and advancing testing infrastructure for large-scale AI projects. You will work on complex, high-volume test suites across multiple platforms, ensuring that machine learning frameworks operate reliably and efficiently. This role offers the chance to design robust, growth-oriented testing architectures, integrate testing deeply into CI/CD pipelines, and collaborate with cross-functional teams to elevate testing as a strategic priority.

Accountabilities

• Lead the redesign and scaling of testing infrastructure to support high-volume test suites (100K+ tests) across multiple platforms
• Architect and implement scalable, modular testing systems integrated with CI/CD pipelines
• Establish best practices for test coverage, reliability, and maintainability, partnering with testing leads and engineering teams
• Anticipate future testing needs and proactively adapt systems to evolving project complexity and platform diversity
• Collaborate with engineers, product managers, and other stakeholders to ensure testing is a core component of project planning and execution
• Continuously monitor and improve testing processes to optimize efficiency and reduce technical debt

Requirements

• Proven experience with modern machine learning frameworks (e.g., Transformers, PyTorch) and large-scale software projects
• Experience managing high-volume test suites and cross-platform testing challenges
• Strong understanding of CI/CD pipelines and automated testing frameworks
• Strategic mindset that treats testing as a critical enabler of project growth and reliability
• Proficiency in designing scalable, modular, and maintainable testing architectures
• Excellent collaboration and communication skills in English
• Preferred: background in open-source development and experience re-architecting testing systems for rapidly growing projects

Benefits

• Flexible working hours and remote options to support work-life balance
• Health, dental, and vision coverage for employees and their dependents
• Parental leave and flexible paid time off policies
• Reimbursement for relevant conferences, training, and education
• Company equity as part of the compensation package
• Opportunity to work in a collaborative, community-focused environment with cutting-edge AI technologies