Video Processing Engineer

Apple, Inc.; Cupertino (CA); On-site; USD 150,000 - 225,000; Full time

Job summary

Apple in Cupertino, California, is seeking a hardware video processing architect to bridge architectural design with software tools. You will develop hybrid video processing techniques, translate architectures into C-models, and drive machine learning-augmented image quality while preserving power efficiency.

Collaborate across architecture, design, and DV teams to map algorithms to hardware and software, generate test vectors, and ensure bit-exact implementations.

Qualifications

• Experience in Python, PyTorch, and/or C/C++ for developing and prototyping video processing algorithms.
• Understanding of image/video/signal processing fundamentals.
• Understanding of neural network fundamentals.

Responsibilities

• Investigate and develop hybrid video processing architectures.
• Map algorithms into well-defined architectures for software/hardware implementation.
• Generate architecture test vectors for quality validation.
• Write bit exact C-models of defined architectures.
• Support Design and Verification teams during verification against bit exact C-models.

Skills

Python

PyTorch

C/C++

Education

MS or PhD degree

Job description

Cupertino, California, United States Hardware

Do you love problem solving in a collaborative environment and then having the results of your efforts benefitting millions around the world? At Apple, our Architecture group is responsible for connecting our hardware and software into one unified system. Join this team, and you’ll collaborate with engineers across Apple to design how all of our technologies work in unison! You’ll drive development of our renowned system‑on‑a‑chip architecture and develop algorithms to improve image quality and enable new use cases. You’ll develop forward‑looking prototype systems as well as build and deploy software development tools that will be distributed to the Apple engineering community and help build the seamless technology experiences we’re known for worldwide.This role will be responsible for investigating techniques for improving video processing solutions along the quality vs. power axes. State‑of‑the‑art video processing solutions often involve the use of Machine Learning, but this can be computationally intensive and not practical. There exists a computational gap between Machine Learning techniques and traditional methods. The goal is to find operating points in between that can leverage the improved quality due to Machine Learning when needed and fall back to traditional, low‑compute methods when not needed. Examples of video processing solutions that can benefit from using a hybrid solution comprised of traditional techniques and Machine Learning based techniques include (but not limited to) 1) Under Display Camera enhancement 2) Motion Estimation for Codec, GGM and MCTF 3) Face ID processing. The result of finding hybrid solutions is better video quality and/or longer battery life on the Phone, Pad and Mac. You will be responsible for investigating hybrid video processing techniques that can be translated into efficient SoC architectures. You will be expected to be able to translate architectures into specifications and C‑models. You will also be expected to work cross‑functionally with other Architects as well as Design and DV.

Description

• Investigate and develop hybrid video processing architectures.
• Support chip architecture team and software teams to map algorithms into well‑defined architectures that can be implemented in software and/or hardware.
• Generate architecture test vectors for quality validation.
• Write bit exact C‑models of defined architectures.
• Support Design and Verification teams when verifying designs against bit exact C‑models.

Minimum Qualifications

• Ability to program in the following languages: Python, PyTorch and/or C/C++
• Understanding of image/video/signal processing fundamentals
• Understanding of neural network fundamentals

Preferred Qualifications

• MS or PhD degree or 3+ years of experience
• Demonstrated ability of developing new image/video processing algorithms
• Experience in developing neural network based image/video processing algorithms
• Communication skills and ability to work across various groups
• Understanding of fixed point representation and processing and/or ability to write bit‑accurate software models
• Understanding of pipelining and pixel processing architectures
• Knowledge of computer architecture fundamentals

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $225,300, and your base pay will depend on your skills, qualifications, experience, and location.
Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation. Learn more about Apple Benefits
Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.
Learn about accessibility in Apple’s workplace
Learn about reasonable accommodations for job applicants

Apple accepts applications to this posting on an ongoing basis.