Machine Learning Engineer, Software QA - Creativity Apps at Apple

Apple; Vancouver; On-site; CAD 165,000 - 320,000; Full time

Benefits offered by this job

Comprehensive medical and dental

Relocation assistance

Educational expense reimbursement

Discretionary bonuses

Employee stock programs

Job summary

Apple in Vancouver, BC, is seeking a Machine Learning QA Engineer for Creativity Apps to ensure high-quality iOS and macOS experiences. This on-site role involves defining evaluation strategies, scripting, automation, and leading testing efforts to integrate reliable ML models into apps.

The ideal candidate has 5+ years in QA with ML, strong ML knowledge, and proficiency in Python or Swift. Collaboration across teams and rapid learning are essential in this fast-paced environment.

Qualifications

• Bachelor's degree in Computer Science, Data Science, Applied Mathematics or similar with understanding of SQA methodologies, ML and software engineering.
• At least 5 years industry experience in quality assurance with a focus in ML.
• Strong understanding of ML algorithms, supervised and unsupervised modeling.
• Proficient in Python and/or Swift or comparable languages.
• Experience with evaluating models and data quality.

Responsibilities

• Scripting, parsing data, and working with the annotation operations team.
• Analyzing annotations and test results to ensure end-to-end feature quality.
• Developing and implementing workflow projects, regression testing, and bug filing.
• Collaborating to develop requirements, testing processes, and methodologies.
• Manage priorities and communicate progress and risk regularly.
• Ramp up quickly on existing and new technologies.

Skills

Python

Swift

ML concepts

QA methodologies

Problem solving

Presentation skills

Education

Bachelor's degree in CS/Data Science/Applied Math

Tools

LLMs / Generative AI frameworks

Annotation tools

Job description

Machine Learning Engineer, Software QA - Creativity Apps at Apple, Vancouver, BC, CA. This Full time on site position offers great opportunities for career growth. Imagine what you could do here. At Apple, new ideas have a way of becoming outstanding products, services, and customer experiences very quickly. Bring passion and dedication to your job and there's no telling what you could accomplish. The Creativity Apps QA team is seeking a Software QA Engineer, Machine Learning to help us ensure that our iOS and macOS creativity applications are high-quality. We’re looking for an engineer to take projects from defining evaluation strategy, evaluation scripting and automation, leading all stages of testing, triaging and driving issues to resolution, and ensuring high quality models are integrated into our Apps' clients through rigorous testing methodologies. You will have the unique and rewarding opportunity to help shape upcoming products that will delight and inspire millions of Apple’s customers every day.

Description This position requires a self-motivated individual with strong technical, problem solving and communication skills, and the willingness to work in a sophisticated environment.

Responsibilities

• Responsibilities include scripting, parsing data, and working closely with the annotation operations team.
• Analyzing annotations and test results to ensure the features work end-to-end for customers.
• Developing and implementing workflow projects, regression testing, and bug filing.
• You will work closely with other team members to develop requirements, identify appropriate testing implementations processes, and methodologies.
• You should be able to be comfortable with ambiguity and make educated, critical judgments.
• You must be effective and systematic at managing priorities, and communicating progress as well as risk through regular status updates.
• Have a proven ability to ramp up quickly on both existing and new technologies.

Preferred Qualifications

• Understanding of subjective/objective image and video quality evaluation, and color science concepts is a strong plus.
• Understanding of SQA methodologies and practices, software engineering experience preferred.
• iOS and macOS familiarity.

Minimum Qualifications

• At least 5 years industry experience ideally in quality assurance with a prior focus in Machine Learning.
• Strong comprehension of machine learning algorithms, supervised and unsupervised modeling techniques.
• Understand of the mechanics of machine learning, deep learning, computer vision, natural language processing, and generative AI.
• Proficient in Python and/or Swift or comparable languages.
• Preparing and collecting data for evaluation and ensuring data quality.
• Meticulous, analytical, methodical and creative problem solving ability with a commitment to driving quality forward.
• Detail-oriented, analytical, methodical and creative thinker committed to driving quality forward.
• Prototyping and tools development experience.
• Strong presentation skills and ability to adapt technical presentation to various audiences.
• Proficiency in utilizing LLMs and Generative AI frameworks to automate model evaluation processes, optimize test execution times, and improve evaluation accuracy and efficiency.
• Bachelor's degree in Computer Science, Data Science, Applied Mathematics or similar, combined with an understanding of SQA methodologies, machine learning and software engineering experience.

Pay & Benefits

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role.

The base pay range for this role is between $119,100 and $230,500, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple Inc.'s discretionary employee stock programs. Employees are eligible for discretionary restricted stock unit award recommendations, and can purchase Apple Inc. stock at a discount if voluntarily participating in Apple Inc.'s Employee Stock Purchase Plan. Participation in Apple Inc.'s discretionary stock programs is governed by Apple Inc.'s stock plans and agreements and are not part of local employment contracts or compensation.

• Comprehensive medical and dental coverage
• retirement benefits
• a range of discounted products and free services
• reimbursement for certain educational expenses - including tuition
• discretionary bonuses or commission payments
• relocation

Note: Apple benefit and compensation programs are subject to eligibility requirements and other terms of the applicable plan or program.