Engineer- Embodied AI Lab Automation: Vision-Guided Real Time Robotic Manipulation

Brookhaven National Laboratory; Upton (NY); On-site; USD 71,900 - 119,000; Full time

Benefits offered by this job

Comprehensive benefits program

Health, dental, and vision insurance

Retirement plans

Job summary

Brookhaven National Laboratory is seeking an engineer to develop an automated protein crystal harvesting system at the Center for BioMolecular Structure in Upton, New York. This role involves working on vision-guided robotic manipulation to improve the harvesting process. The position requires a B.S. in a related field and strong programming skills.

The position offers a salary range of $71,900 - 119,000 per year, commensurate with experience, along with a comprehensive benefits package.

Qualifications

• B.S. in Robotics, Computer Science, Physics, Applied Mathematics, or related field.
• Demonstrated experience in robotics systems development.
• Strong programming skills in Python and/or C++.

Responsibilities

• Develop vision-guided robotic manipulation methods for crystal harvesting.
• Design closed-loop perception and control pipelines using visual feedback.
• Collaborate closely with domain experts in crystallography and engineering.

Skills

Robotics systems development

Python programming

C++ programming

Robot kinematics

Motion planning

Calibration methods

Education

B.S. in Robotics, Computer Science, Physics or related field

Tools

ROS2

Machine learning integration

Job description

Brookhaven National Laboratory's National Synchrotron Light Source II (NSLS-II) is seeking an engineer to develop an automated protein crystal harvesting system at the Center for BioMolecular Structure (CBMS).

This position is a 2-year term, with the possibility of renewal contingent on performance and funding availability.

The successful candidate will develop vision-guided robotic manipulation capabilities for detecting, tracking, and harvesting fragile micron-scale protein crystals suspended in liquid droplets. Working closely with a multidisciplinary team of crystallographers, beamline scientists, controls engineers, mechanical engineers, and data scientists, the candidate will help integrate computer vision, machine learning, and robotic manipulation into an automated crystal harvesting platform.

This is a hands-on role centered on building and deploying closed-loop perception, visual servoing, and robotic control systems in a real laboratory environment. The position offers the opportunity to advance machine vision, robotic manipulation, and embodied AI techniques while addressing a scientifically impactful problem in structural biology.

Essential Duties and Responsibilities

• Develop and implement vision-guided real-time robotic manipulation methods for crystal harvesting
• Design and deploy closed-loop perception and control pipelines using visual feedback
• Contribute to vision-based servoing approaches for precise, real-time positioning
• Integrate perception outputs with motion planning and execution using ROS2 and MoveIt2
• Perform system calibration (e.g., hand-eye calibration, camera calibration) to ensure accurate 3D spatial alignment
• Evaluate and improve system robustness, including perception uncertainty and failure modes
• Collaborate closely with domain experts across crystallography, controls, and engineering
• Participate in system testing, tuning, and performance evaluation
• Document methods and results; contribute to reports, publications, and presentations

Required Knowledge, Skills, and Abilities

• B.S. in Robotics, Computer Science, Physics, Applied Mathematics, Mechanical Engineering, Electrical Engineering, or a related field
• Demonstrated experience developing and implementing robotics systems.
• Strong programming skills in Python and/or C++.
• Knowledge of robotic systems:
  • Robot kinematics and coordinate transformations
  • Motion planning and trajectory generation.
  • Calibration methods

Preferred Knowledge, Skills, and Abilities

• M.S. in Robotics, Computer Science, Physics, Applied Mathematics, Mechanical Engineering, Electrical Engineering, or a related field
• Experience developing robotic systems that integrate vision-guided control in real-world settings
• Experience working with ROS2-based ecosystems
• Experience with camera calibration, hand-eye calibration, and coordinate frame registration
• Experience integrating machine learning models into robotics
• Familiarity with:
  • Micro-Manipulation
  • Sensor fusion or state estimation
  • Real-time system debugging and performance tuning

What Success Looks Like

• Development of a system capable of reliably detecting and localizing protein crystals
• Implementation of closed-loop robotic manipulation using visual feedback
• Improved robustness and reliability of the crystal harvesting process under real-world conditions

Additional Information

• This is an on-site position based at Brookhaven National Laboratory in Upton, New York.
• Salary range: $71,900 - 119,000 per year. The level and compensation are commensurate with experience.

Benefits and Compensation

Brookhaven National Laboratory is committed to employee success and offers a comprehensive benefits program that includes health, dental, vision, retirement plans, paid time off, and other employee benefits.

Equal Opportunity/Affirmative Action Employer

Guided by our core values of integrity, responsibility, innovation, respect, and teamwork, Brookhaven Science Associates is an Equal Employment Opportunity Employer-Vets/Disabled. We are committed to fostering a respectful and collaborative environment that fuels scientific discovery. We consider all qualified applicants without regard to any characteristic protected by law. All qualified individuals are encouraged to apply. We ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation. VEVRAA Federal Contractor.