Multimodal Input Systems Engineer

Socket.dev; San Jose (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Apple seeks a Systems Engineer to own the architecture that fuses spatial input (hand, wrist, eye, head) with keyboard/mouse/trackpad signals into a single, low-latency interaction model on Mac. You will define how input modalities combine for faster, more efficient work without added fatigue.

Responsibilities include setting system-wide requirements across sensors, firmware, and macOS integration, building robust measurement methods, and leading human-performance studies to prove faster truth

Qualifications

• Define system-level architecture for fusing spatial input (hand, wrist, eye, head) with keyboard/mouse/trackpad signals into a single, low-latency interaction model.
• Set and validate an ambitious input-efficiency improvement target against Mac-only baselines, across productivity tasks.
• Own the specification for high-rate text input where keyboard remains backbone and fusion augments it.
• Build the measurement methodology and test harness for input efficiency and fatigue/comfort as co-primary metrics.
• Decompose the fused-input experience into system requirements across sensors, firmware, input-stack, and macOS-integration.
• Partner with Sense & Constellation, Display Systems, hand/eye tracking, human factors, and product design teams to land a coherent spec.
• Run structured human-performance studies, own the resulting data, and be the team’s authority on what’s actually faster.

Responsibilities

• Own architecture to fuse spatial sensing with keyboard/mouse/trackpad input when connected to Mac.
• Define and drive end-to-end system requirements across sensors, firmware, and macOS integration.
• Lead structured human-performance studies and analyze data to validate speed vs. comfort.

Skills

Systems engineering

HID

Sensor fusion

HCI

MacOS integration

Text input design

Measurement methodology

Fatigue assessment

Education

Bachelor's degree

Master's degree

Job description

Apple seeks a Systems Engineer to own the architecture that fuses spatial input (hand, wrist, eye, head) with keyboard/mouse/trackpad signals into a single, low-latency interaction model on Mac. You will define how input modalities combine for faster, more efficient work without added fatigue.

Responsibilities include setting system-wide requirements across sensors, firmware, and macOS integration, building robust measurement methods, and leading human-performance studies to prove faster truth