Senior Computer Vision/AI Scientist

6267-Auris Health Inc. Legal Entity; Santa Clara (CA); On-site; USD 125,000 - 201,000; Full time

Benefits offered by this job

Medical

Dental

Vision

Life insurance

Disability

401(k)

Job summary

Johnson & Johnson MedTech in Santa Clara, CA is seeking a Senior Computer Vision/AI Scientist to join the Algorithms & AI team within MONARCH R&D. You will develop advanced CV and ML capabilities for robotic-assisted endoscopy and collaborate with CV/AI, navigation, and hardware teams.

You will design, implement and validate pose estimation, 3D reconstruction, and segmentation algorithms, publish findings, and contribute to deployment in cloud and on-device workflows.

Qualifications

• 4+ years experience in computer vision and DL/AI algorithm development.
• PhD preferred in CS, engineering, robotics, or related field.
• Strong 3D reconstruction, segmentation, mapping and pose estimation.
• Experience with PyTorch, TensorFlow, TensorRT for CV tasks.
• Proficient in Python and/or C++.

Responsibilities

• Design, develop and implement ML/AI CV algorithms for pose estimation and 3D reconstruction.
• Experiment design, testing, and validation in simulated and real environments.
• Integrate new algorithms into ML pipelines and SW frameworks.
• Evaluate navigation and ML/AI algorithms with multi-modal data.
• Advance MLOps infra and annotation pipelines; collaborate across teams.
• Support partnerships in simulation and AI for MONARCH products.

Skills

Computer Vision

DL/AI

Python

C++

PyTorch

TensorFlow

TensorRT

3D Reconstruction

Pose Estimation

ML/Ops

Education

PhD degree

Tools

PyTorch

TensorFlow

TensorRT

Job description

At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at jnj.com.

As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world. We provide an inclusive work environment where each person is considered as an individual. At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.

Job Function: R&D Product Development

Job Sub Function: R&D Machine Learning

Job Category: Scientific/Technology

All Job Posting Locations: Santa Clara, California, United States of America

Job Description

We are searching for the best talent for a Senior Computer Vision/AI Scientist position in our Santa Clara, CA location. Fueled by innovation at the intersection of biology and technology, we’re developing the next generation of smarter, less invasive, more personalized treatments. Your unique talents will help patients on their journey to wellness. Learn more at https://www.jnj.com/medtech

Purpose

Are you passionate about improving and expanding the possibilities of surgery? Ready to join a team that’s reimagining how we heal? At Johnson & Johnson MedTech we are passionate about redefining medical interventions. By combining advancements in medical robotics, instrumentation, navigation, and AI, we are building intelligent platforms capable of growing the applicability of robotics to a new spectrum of medical procedures. We are seeking a hardworking individual for a Senior Computer Vision/AI Scientist position within the Algorithms & AI team (part of MONARCH™ R&D). You will work closely with other Computer Vision Scientist, Navigation and ML/AI Research Scientists and Engineers, as well as SW and System Engineers to develop advanced computer vision and AI capabilities for robotic-assisted flexible endoscopy procedures. This will be a great opportunity to develop your skills in solving complex challenges and contribute to technology development and innovative simulation capabilities for next generation robotic platforms!

Responsibilities

• The design, development and implementation of advanced ML/AI based computer vision algorithms for pose estimation, mapping/localization, anatomy/tool segmentation, and 3D reconstruction in dynamic environments.
• Experiment design, testing, and validation of algorithm performance in simulated and real environments.
• Integrating and deploying new algorithms into existing SW frameworks and machine learning pipelines.
• Analysis and evaluation of navigation, localization and other ML/AI algorithms with large multi-modal datasets.
• Improving existing MLOps (e.g. DVC, MLFlow) infra and development of innovative annotation pipelines.
• Working in a multi-functional setting with other CV/AI and Navigation Research Scientists, SW and System Engineers, Data Scientists, and Product Management to transfer new solutions into MONARCH™ products and applications.
• Support external partnerships in the space of simulation and AI.

Qualifications / Requirements

• 4+ years experience and proven track record in computer vision and DL/AI algorithm development and deployment.
• Candidates with a PhD degree in computer science, engineering, robotics, or similar fields preferred.
• Hands-on experience and strong understanding of 3D reconstruction, segmentation, mapping, pose estimation and visual odometry.
• Hands-on experience with machine learning/deep learning frameworks (e.g. PyTorch, Tensorflow and TensorRT) for computer vision.
• Proficiency in Python and/or C++.
• Comfortable working with multi-functional teams and strong interpersonal skills.

Desired Qualifications

• Experience in processing endoscopic and/or laparoscopic image datasets.
• Experience with world foundation models, simulation, and synthetic data generation (e.g. NVIDIA Cosmos, Isaac Sim).
• Experience working with multi-modal datasets.
• Experience with medical robotic systems.
• Experience in deploying machine learning models into real-world cloud applications using MLOps standards.
• Active publication record in venues such as ICCV/CVPR, MICCAI, IPCAI, or similar.

Required Skills: Preferred Skills

• Artificial Intelligence (AI)
• Coaching
• Cognitive Computing
• Critical Thinking
• Cross-Functional Collaboration
• Curious Mindset
• Data Structures
• Distributed Computing
• Emerging Technologies
• Human-Computer Relationships
• Machine Learning (ML)
• Persistence and Tenacity
• Program Management
• Research and Development
• SAP Product Lifecycle Management
• Scripting Languages
• Technologically Savvy

Pay

The anticipated base pay range for this position is $125,000 and $201,250 USD.

Benefits & Perks

Subject to the terms of their respective plans, employees and/or eligible dependents are eligible to participate in the following Company sponsored employee benefit programs:

• medical
• dental
• vision
• life insurance
• short- and long-term disability
• business accident insurance
• group legal insurance

Subject to the terms of their respective plans, employees are eligible to participate in the Company’s consolidated retirement plan (pension) and savings plan (401(k)).

This position is eligible to participate in the Company’s long-term incentive program.

Subject to the terms of their respective policies and date of hire, Employees are eligible for the following time off benefits:

• Vacation –120 hours per calendar year
• Sick time - 40 hours per calendar year; for employees who reside in the State of Washington –56 hours per calendar year
• Holiday pay, including Floating Holidays –13 days per calendar year
• Work, Personal and Family Time - up to 40 hours per calendar year
• Parental Leave – 480 hours within one year of the birth/adoption/foster care of a child
• Condolence Leave – 30 days for an immediate family member: 5 days for an extended family member
• Caregiver Leave – 10 days
• Volunteer Leave – 4 days
• Military Spouse Time-Off – 80 hours

Equal Opportunity Employer

Johnson & Johnson is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, protected veteran status or other characteristics protected by federal, state or local law.

We actively seek qualified candidates who are protected veterans and individuals with disabilities as defined under VEVRAA and Section 503 of the Rehabilitation Act.

Johnson & Johnson is committed to providing an interview process that is inclusive of our applicants’ needs. If you are an individual with a disability and would like to request an accommodation, external applicants please contact us via https://www.jnj.com/contact-us/careers , internal employees contact AskGS to be directed to your accommodation resource.

Do Not Sell or Share My Personal Information Limit the Use of My Personal Information

At Johnson & Johnson, we believe health is everything. Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented, treated, and cured, where treatments are smarter and less invasive, and solutions are personal. Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity. Learn more at https://www.jnj.com/.