Senior Computer Vision/AI Scientist

Johnson & Johnson MedTech; Santa Clara (CA); On-site; USD 125,000 - 201,000; Full time

Job summary

Johnson & Johnson MedTech in Santa Clara, CA seeks a Senior Computer Vision/AI Scientist to advance robotic-assisted surgery within MONARCH R&D. You will develop cutting-edge CV/AI capabilities and collaborate with CV/AI, SW, and Systems teams to translate research into patient-ready platforms.

4+ years in computer vision/AI, Python/C++, and ML frameworks are required; a PhD is preferred. This full-time on-site role offers a competitive package and opportunities to publish and innovate.

Qualifications

• 4+ years in computer vision and DL/AI algorithm development and deployment.
• Hands-on experience with 3D reconstruction, segmentation, mapping, pose estimation and visual odometry.
• Proficiency in Python and/or C++ and experience with ML frameworks.

Responsibilities

• Design, develop and implement advanced ML/AI based CV algorithms for pose estimation, mapping/localization, anatomy/tool segmentation, and 3D reconstruction.
• Experiment design, testing and validation of algorithm performance in simulated and real environments.
• Integrate and deploy new algorithms into existing software frameworks and ML pipelines.
• Analyze and evaluate navigation, localization and other ML/AI algorithms with large multi-modal datasets.
• Improve MLOps infrastructure and develop annotation pipelines.
• Collaborate with CV/AI researchers, SW and Systems engineers, Data Scientists and Product Management to transfer solutions into MONARCH products.

Skills

Artificial Intelligence

Machine Learning

Python

C++

3D reconstruction

Pose estimation

DL/AI frameworks

Education

PhD in CS/Engineering/Robotics

Tools

PyTorch

TensorFlow

TensorRT

Job description

At Johnson & Johnson,we believe health is everything. Our strength in healthcare innovation empowers us to build aworld where complex diseases are prevented, treated, and cured,where treatments are smarter and less invasive, andsolutions are personal.Through our expertise in Innovative Medicine and MedTech, we are uniquely positioned to innovate across the full spectrum of healthcare solutions today to deliver the breakthroughs of tomorrow, and profoundly impact health for humanity.Learn more at jnj.com

As guided by Our Credo, Johnson & Johnson is responsible to our employees who work with us throughout the world. We provide an inclusive work environment where each person is considered as an individual. At Johnson & Johnson, we respect the diversity and dignity of our employees and recognize their merit.

Job Function

R&D Product Development

Job Sub Function

R&D Machine Learning

Job Category

Scientific/Technology

All Job Posting Locations

Santa Clara, California, United States of America

Job Description

We are searching for the best talent for a Senior Computer Vision/AI Scientist position in our Santa Clara, CA location.

Fueled by innovation at the intersection of biology and technology, we’re developing the next generation of smarter, less invasive, more personalized treatments.

Your unique talents will help patients on their journey to wellness. Learn more at https://www.jnj.com/medtech

Purpose

Are you passionate about improving and expanding the possibilities of surgery?

Ready to join a team that’s reimagining how we heal?

At Johnson & Johnson MedTech we are passionate about redefining medical interventions. By combining advancements in medical robotics, instrumentation, navigation, and AI, we are building intelligent platforms capable of growing the applicability of robotics to a new spectrum of medical procedures. We are seeking a hardworking individual for a Senior Computer Vision/AI Scientist position within the Algorithms & AI team (part of MONARCH™ R&D).

You will work closely with other Computer Vision Scientist, Navigation and ML/AI Research Scientists and Engineers, as well as SW and System Engineers to develop advanced computer vision and AI capabilities for robotic-assisted flexible endoscopy procedures. This will be a great opportunity to develop your skills in solving complex challenges and contribute to technology development and innovative simulation capabilities for next generation robotic platforms!

You Will Be Responsible For

• The design, development and implementation of advanced ML/AI based computer vision algorithms for pose estimation, mapping/localization, anatomy/tool segmentation, and 3D reconstruction in dynamic environments.
• Experiment design, testing, and validation of algorithm performance in simulated and real environments.
• Integrating and deploying new algorithms into existing SW frameworks and machine learning pipelines.
• Analysis and evaluation of navigation, localization and other ML/AI algorithms with large multi-modal datasets.
• Improving existing MLOps (e.g. DVC, MLFlow) infra and development of innovative annotation pipelines.
• Working in a multi-functional setting with other CV/AI and Navigation Research Scientists, SW and System Engineers, Data Scientists, and Product Management to transfer new solutions into MONARCH™ products and applications. Support external partnerships in the space of simulation and AI.

Qualifications / Requirements

• 4+ years experience and proven track record in computer vision and DL/AI algorithm development and deployment. Candidates with a PhD degree in computer science, engineering, robotics, or similar fields preferred.
• Hands-on experience and strong understanding of 3D reconstruction, segmentation, mapping, pose estimation and visual odometry.
• Hands-on experience with machine learning/deep learning frameworks (e.g. PyTorch, Tensorflow and TensorRT) for computer vision.
• Proficiency in Python and/or C++.
• Comfortable working with multi-functional teams and strong interpersonal skills.

Desired Qualifications

• Experience in processing endoscopic and/or laparoscopic image datasets.
• Experience with world foundation models, simulation, and synthetic data generation (e.g. NVIDIA Cosmos, Isaac Sim)
• Experience working with multi-modal datasets. Experience with medical robotic systems.
• Experience in deploying machine learning models into real-world cloud applications using MLOps standards.
• Active publication record in venues such as ICCV/CVPR, MICCAI, IPCAI, or similar.

Johnson & Johnson is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, age, national origin, disability, protected veteran status or other characteristics protected by federal, state or local law. We actively seek qualified candidates who are protected veterans and individuals with disabilities as defined under VEVRAA and Section 503 of the Rehabilitation Act.

Johnson & Johnson is committed to providing an interview process that is inclusive of our applicants’ needs. If you are an individual with a disability and would like to request an accommodation, external applicants please contact us via https://www.jnj.com/contact-us/careers , internal employees contact AskGS to be directed to your accommodation resource.

#JNJDataScience

#JNJMedTech-DS

Required Skills

Artificial Intelligence (AI), Coaching, Cognitive Computing, Critical Thinking, Cross-Functional Collaboration, Curious Mindset, Data Structures, Distributed Computing, Emerging Technologies, Human-Computer Relationships, Machine Learning (ML), Persistence and Tenacity, Program Management, Research and Development, SAP Product Lifecycle Management, Scripting Languages, Technologically Savvy

The anticipated base pay range for this position is :

The anticipated base pay range for this position is $125,000 and $201,250 USD.

Additional Description For Pay Transparency

Subject to the terms of their respective plans, employees and/or eligible dependents are eligible to participate in the following Company sponsored employee benefit programs: medical, dental, vision, life insurance, short- and long-term disability, business accident insurance, and group legal insurance. Subject to the terms of their respective plans, employees are eligible to participate in the Company’s consolidated retirement plan (pension) and savings plan (401(k)). This position is eligible to participate in the Company’s long-term incentive program. Subject to the terms of their respective policies and date of hire, Employees are eligible for the following time off benefits: Vacation –120 hours per calendar year Sick time - 40 hours per calendar year; for employees who reside in the State of Washington –56 hours per calendar year Holiday pay, including Floating Holidays –13 days per calendar year Work, Personal and Family Time - up to 40 hours per calendar year Parental Leave – 480 hours within one year of the birth/adoption/foster care of a child Condolence Leave – 30 days for an immediate family member: 5 days for an extended family member Caregiver Leave – 10 days Volunteer Leave – 4 days Military Spouse Time-Off – 80 hours Additional information can be found through the link below. https://www.careers.jnj.com/employee-benefits