Senior Computer Vision Engineer (Localization)

Niantic Spatial; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

Niantic Spatial is looking for an experienced engineer to design and develop computer vision systems, especially for their Visual Positioning System. The ideal candidate will have over five years of experience in image processing algorithms, a strong command of Python and/or C++, and a robust understanding of 3D mapping and Structure from Motion methodologies. Collaborating with cross-functional teams, you will also lead technical design reviews and mentor junior engineers, enhancing the overall capabilities of our technology stack.

Qualifications

• 5+ years of experience developing algorithms for image processing.
• Expert-level proficiency in Python and/or C++.
• Proven track record in designing solutions for Structure from Motion.

Responsibilities

• Design, develop, and maintain computer vision systems for VPS.
• Refine and scale algorithms for best accuracy and recall.
• Optimize ML and CV code for cloud and mobile environments.

Skills

Computer Vision

Algorithm Development

Python

C++

Deep Learning

GPU/CPU Optimization

Education

BS, MS, or PhD in Computer Science, Robotics, or Computer Vision

Tools

PyTorch

JAX

Git

Job description

Responsibilities

• System Architecture: Design, develop, and maintain production-grade computer vision systems that power Niantic Spatial’s VPS (Visual Positioning System) and 3D mapping pipelines.
• Algorithmic Innovation: Refine and scale algorithms for our VPS system including SfM (Structure from Motion), efficient feature and descriptor extraction to have the best possible accuracy and recall. Moving algorithms from research concepts to hardened production code that can scale for our map of the world.
• Performance Engineering: Optimize complex ML and CV code for maximum efficiency in cloud and mobile environments, ensuring low latency and high-performance execution on GPU/CPU.
• Benchmarking & Evaluation: Create and own the tools and frameworks used to evaluate the quality of our spatial grounding and 3D maps against ground-truth data.
• Technical Leadership: Lead technical design reviews, mentor junior engineers, and serve as a team anchor for resolving complex technical disagreements within the mapping stack.
• Cross-Functional Delivery: Collaborate with Product, Research, and Operations teams to ensure that state-of-the-art computer vision solutions translate into delightful user experiences.

Requirements

• Education: BS, MS, or PhD in Computer Science, Robotics, Computer Vision, or a related technical field (or equivalent professional experience).
• Years of Experience: 5+ years of experience developing and shipping algorithms for image processing, computer vision, or 3D reconstruction.
• Coding Proficiency: Expert-level proficiency in Python and/or C++.
• Domain Expertise: Proven track record in designing solutions for Structure from Motion (SfM), VPS or 3D mapping.
• Frameworks & Tools: Deep experience with Deep Learning frameworks (PyTorch or JAX) and version control (Git).
• Required in-office days: 3 days per week

Plus If:

• Experience in planning and leading technical projects from inception to production.
• Significant contributions to open-source CV libraries (OpenCV, COLMAP, etc.).
• Experience with CUDA or shader programming for performance optimization.