Staff Perception Scientist

Arm; Seattle (WA); On-site; USD 209,000 - 283,000; Full time

Benefits offered by this job

Relocation package

Job summary

Arm seeks a Staff Perception Scientist to advance perception for Physical AI across sensors and on-device deployment in Seattle. You will lead research turning camera, depth, radar, lidar, and audio into reliable representations for robotic and autonomous decision‑making.

You will shape models, conduct rigorous experiments, and collaborate with cross-functional teams to deliver production-ready perception pipelines on Arm hardware, balancing latency, power, and accuracy.

Qualifications

• 6+ years of experience in applied perception, computer vision, ML, or related field.
• Proficiency in Python and C++ with PyTorch, JAX, TensorFlow, or similar frameworks.
• Strong understanding of deep learning for visual or multimodal perception, training, evaluation, and failure analysis.
• Knowledge of probability, optimization, 3D geometry, coordinate transforms, calibration, and sensor fusion.
• Experience moving perception research into real-time or production systems.

Responsibilities

• Perception research and algorithm development across sensors and modalities.
• Define datasets, metrics, benchmarks, and evaluation protocols reflecting real-world requirements.
• Develop reproducible training and analysis pipelines and communicate results with quantitative evidence.
• Collaborate with robotics, systems, and product teams to deploy on-device perception pipelines.

Skills

Perception & CV

Python & C++

Deep learning & multimodal

Sensor fusion & 3D geometry

Edge deployment

Experiment design

Leadership & mentoring

Education

PhD or equivalent in CV/ML/Robotics

Tools

PyTorch

JAX

TensorFlow

Job description

We seek a Staff Perception Scientist to advance how Physical AI systems understand the world on Arm. You will research and develop perception methods that transform camera, depth, radar, lidar, audio, and other sensor data into reliable representations for robotic and autonomous decision-making.

You will provide scientific and technical leadership from problem formulation and experimentation through optimized on-device deployment. This is a high-impact role at the intersection of computer vision, machine learning, multimodal sensing, robotics, and edge computing.

Responsibilities:

Perception research and algorithm development

• Develop innovative methods for detection, segmentation, tracking, localization, scene understanding, and multimodal sensor fusion.
• Formulate research questions, design controlled experiments, and translate promising ideas into robust production algorithms.
• Advance model architectures and representations that remain accurate under motion, occlusion, domain shift, and sensor degradation.

Data, evaluation, and scientific rigor

• Define datasets, labeling strategies, metrics, benchmarks, and evaluation protocols that reflect real-world product requirements.
• Build reproducible training and analysis pipelines, investigate failure modes, and communicate findings with quantitative evidence.
• Develop methods for efficient data selection, synthetic data, weak or self-supervision, and continuous model improvement.

Edge deployment and performance

• Optimize models and algorithms for latency, power, memory, and accuracy across Arm CPUs and heterogeneous AI accelerators.
• Partner with systems engineers to integrate perception pipelines with sensor I/O, runtimes, robotics middleware, and downstream consumers.
• Create reference implementations and diagnostics that make perception behavior observable, testable, and maintainable on-device.

Scientific leadership and collaboration

• Partner with robotics, controls, hardware, product, and customer teams to define perception requirements and system tradeoffs.
• Lead research reviews, mentor scientists and engineers, and guide the technical roadmap for on-device perception.
• Publish, patent, or contribute open work when appropriate, and represent Arm in relevant research and developer communities.

Required Skills and Experience:

• 6+ years of experience in applied perception, computer vision, machine learning, or a related field.
• Proficiency in Python and C++ with PyTorch, JAX, TensorFlow, or similar frameworks.
• Strong understanding of:
• Deep learning for visual or multimodal perception, training, evaluation, and failure analysis
• Probability, optimization, 3D geometry, coordinate transforms, calibration, and sensor fusion
• Efficient inference, numerical precision, model compression, and edge deployment constraints
• 3+ years of experience moving perception research into real-time or production systems.
• A record of impact through deployed systems, publications, patents, or widely used research artifacts.
• Ability to design rigorous experiments and explain results to research, engineering, and product audiences.
• Excellent scientific judgment, problem-solving, communication, collaboration, and mentoring skills.

Nice To Have Skills and Experience:

• PhD or equivalent experience in computer vision, machine learning, robotics, computer science, or a related field.
• Experience with 3D perception, SLAM, visual-inertial estimation, tracking, occupancy, or world models.
• Experience with multimodal models, self-supervised learning, domain adaptation, or continual learning.
• Familiarity with synthetic data, simulation, active learning, and dataset curation.
• Experience with quantization, pruning, distillation, compilers, or heterogeneous accelerators.
• Background in robotics, autonomous systems, industrial vision, or other safety- or reliability-sensitive applications.
• Contributions to open-source perception systems, benchmarks, datasets, or research communities.

Why this role matters:

Physical AI depends on perception that is accurate, efficient, and resilient outside controlled cloud environments. Models must interpret changing scenes and imperfect sensors while meeting strict limits on latency, power, memory, privacy, and connectivity.

In this role, you will shape perception technology for Arm-powered devices used in robotics, industrial systems, and consumer products. Your work will help intelligent machines understand and respond to the physical world in real time.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

In Return

You will have the opportunity to work on important technical challenges in AI and platform engineering as part of a growing team in Seattle. This position offers a chance to contribute to core platform capabilities. You’ll work alongside skilled colleagues from various subject areas and help invent the way new AI services are built and scaled at Arm.

In addition to meaningful technical work, Arm offers an environment that values thoughtful engineering, collaboration, and continuous learning. This opportunity suits someone who enjoys solving complex systems problems, working across teams, and contributing to technology important to the future of AI at Arm.

Additional Information

Please note that a relocation package (including visa sponsorship assistance) is offered for this role, for candidates who need it.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.

Accommodations at Arm

At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [e-mail]. To note, by sending us the requested information, you consent to its use by Arm to arrange for appropriate accommodations. All accommodation or adjustment requests will be treated with confidentiality, and information concerning these requests will only be disclosed as necessary to provide the accommodation. Although this is not an exhaustive list, examples of support include breaks between interviews, having documents read aloud, or office accessibility. Please email us about anything we can do to accommodate you during the recruitment process.

Hybrid Working at Arm

Arm’s approach to hybrid working is designed to create a working environment that supports both high performance and personal wellbeing. We believe in bringing people together face to face to enable us to work at pace, whilst recognizing the value of flexibility. Within that framework, we empower groups/teams to determine their own hybrid working patterns, depending on the work and the team’s needs. Details of what this means for each role will be shared upon application. In some cases, the flexibility we can offer is limited by local legal, regulatory, tax, or other considerations, and where this is the case, we will collaborate with you to find the best solution. Please talk to us to find out more about what this could look like for you.

Equal Opportunities at Arm

Arm is an equal opportunity employer, committed to providing an environment of mutual respect where equal opportunities are available to all applicants and colleagues. We are a diverse organization of dedicated and innovative individuals, and don’t discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Salary Range:

$209,100-$282,900 per year

We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.