Senior Perception Software Engineer

Sauron; United States; Remote; USD 80,000 - 120,000; Full time

Job summary

An innovative company is seeking a talented perception engineer to join their team. This role focuses on designing and developing models for advanced perception tasks, utilizing both traditional computer vision and cutting-edge machine learning techniques. You will work collaboratively with hardware teams to ensure the system operates flawlessly in diverse environments. Your contributions will drive the performance of state-of-the-art models for object detection, tracking, and scene understanding, ultimately enhancing user experience and safety. If you're passionate about pushing the boundaries of technology in a collaborative setting, this opportunity is perfect for you.

Qualifications

• Experience in model design and evaluation for perception tasks.
• Strong background in machine learning and computer vision.

Responsibilities

• Develop and evaluate models for perception tasks in various conditions.
• Collaborate with hardware teams for sensing and tracking requirements.

Skills

Machine Learning

Computer Vision

3D Object Detection

Facial Recognition

Data Management

Education

Bachelor's in Computer Science

Master's in Machine Learning

Tools

TensorFlow

PyTorch

OpenCV

Job description

We are building a perception stack for the home. This system must be able to provide full contextual awareness by reliably identifying threats in all environmental conditions. False positives lead to a terrible customer experience, while false negatives detract from our goal to provide absolute peace of mind.

About the role:

This role involves model design, development, and evaluation for perception tasks that include both classic computer vision approaches and more modern ML approaches. Our hardware will operate around the home and must be able to complete its mission reliably in the face of all environmental conditions. We aim to build a system that handles a wide variety of scenarios and do so without error. This role will be highly collaborative with our hardware team to develop requirements needed for sensing, tracking, and other perception tasks, as well as iteration for various generations of hardware.

You Will Contribute By...

1. Extracting the maximum value from our sensors, fusing all observations available while being robust to occlusions, poor lighting, and disguises.
2. Assisting in the collection, labeling, and management of datasets to train and evaluate ML models.
3. Leveraging state-of-the-art models for 3D object detection, tracking, facial recognition, and semantic scene understanding, and pushing them to the limits of their performance in this problem domain.
4. Analyzing the performance of systems both in simulation and using data from deployments in the field to find headroom and devise solutions to reduce it.
5. Probing the inner workings of neural networks to uncover and mitigate edge case failures.
6. Contributing to machine learning infrastructure (e.g., distributed training, continuous model integration, data management, and evaluation of production systems).