AI Research Scientist- Multimodal Foundational Models

Bosch USA; Sunnyvale (CA); On-site; USD 165,000 - 195,000; Full time

Benefits offered by this job

Premium health coverage

401(k) with generous matching

Paid time off

Parental leave

Life and disability protection

Job summary

Bosch USA in Sunnyvale, CA, is seeking a senior AI researcher to lead projects that label, predict, and fuse multi-sensor data for ADAS and related Bosch products. You will architect multi-modal foundation models for time series data and extend them with video and image modalities to deepen context understanding.

The role emphasizes staying at the forefront of AI innovations, collaborating across teams, and publishing results or filing patents. A Ph.D.

Qualifications

• Ph.D. in CS/EE/IT or related discipline OR Masters with 2-3 years of experience.
• Expertise with Time Series Foundation Models beyond forecasting.
• Strong signal processing experience with sensor data and DL integration.
• Proficiency in Python and PyTorch (torchaudio, torchvision, torchmetrics).
• Publication record in ICASSP, NeurIPS, ICML, CVPR, ICCV, ECCV or patents.

Responsibilities

• Develop and lead AI research labeling, prediction, classification and fusion of multi-sensor data for ADAS and Bosch products.
• Architect, design and validate multi-modal deep learning and TSFM models for multivariate time series.
• Integrate TSFM with videos/images to enhance context understanding.
• Provide expert technical insights to management for R&D strategy and investment decisions.
• Publish findings and contribute to patent submissions.

Skills

Time Series FMs

Python

PyTorch

Signal processing

Publications/Patents

Team collaboration

Education

Ph.D. in Computer Science / Electrical Engineering / Information Technology or related

Masters degree with 2-3 years of experience

Tools

Git

MLFlow

VSCode or PyCharm

Slurm / LSF

Job description

Company Description

The Bosch Research and Technology Center North America with offices in Sunnyvale, California, Pittsburgh, Pennsylvania, and Cambridge, Massachusetts is a part of the global Bosch Group (www.bosch.com), a company with over 70 billion euro revenue, 400,000 employees worldwide, a very diverse product portfolio, and a history spanning over 125 years. The Research and Technology Center North America (RTC-NA) is dedicated to providing technologies and system solutions for various Bosch business fields, primarily in the field of artificial intelligence, energy technologies, internet technologies, circuit design, semiconductors and wireless, as well as advanced MEMS design.

Company Description

The Bosch Research and Technology Center North America with offices in Sunnyvale, California, Pittsburgh, Pennsylvania, and Cambridge, Massachusetts is a part of the global Bosch Group (www.bosch.com), a company with over 70 billion euro revenue, 400,000 employees worldwide, a very diverse product portfolio, and a history spanning over 125 years. The Research and Technology Center North America (RTC-NA) is dedicated to providing technologies and system solutions for various Bosch business fields, primarily in the field of artificial intelligence, energy technologies, internet technologies, circuit design, semiconductors and wireless, as well as advanced MEMS design. As a part of the global research, our AI research in Silicon Valley focuses on Foundation Models, Natural Language Processing, Computer Vision & Mixed Reality, Cloud Robotics, Big Data Visual Analytics, Explainable AI (XAI), Data Science, AI System Engineering, Time-series Analysis. We develop scalable, intelligent, and trustworthy AIoT solutions for Bosch products and services in application areas such as automated driving, advanced driver assistance systems (ADAS), robotics, smart manufacturing, enterprise AI, health care, smart home and building solutions. Originating from the AI research in Silicon Valley, our Foundation Model Powered AI Enablers group plays a pivotal role in shaping the future of industrial AI experiences for Bosch products and services. By fusing cutting-edge machine learning, data analysis, and interactive visualization technologies, we research and develop scalable and transparent AI & big data analytic solutions (e.g., audio, images, sensor logs) for a range of domains, including Industry 4.0 (I4.0), IoT, autonomous driving, and connected vehicles. Our award-winning team (IEEE VIS best paper & best paper runner-ups) actively collaborates with leading academic and industry groups to advance research ideas and disseminate findings in top AI conferences and journals, such as CVPR, ICCV, ICRA, ECCV, NeurIPS, ICLR, SIGGRAPH, TVCG.

Job Description

Job Responsibilities

• Develop and lead research of AI projects that label, predict, classify, cluster, describe and fuse multi-sensor data (including acoustic, telemetry timeseries signals, vibration, radar, lidar, image, Wi-Fi, and ultrasound data), to improve / enable advance driver assistance system (ADAS) functionality in vehicles and AI functionalities in other Bosch products.
• Architect, design and validate multi-modal deep learning and Timeseries Foundation Models (TSFM) to work with multivariate time series signals.
• Integrate and extend timeseries models to leverage information from other auxiliary modalities such as videos and images to enhance context understanding.
• Offer expert insights to the management team in relevant technology sectors, aiding in strategic planning, R&D trajectory, and investment decisions.
• Stay abreast of the latest technological innovations, document and disseminate research findings through high-caliber publications and/or patent submissions.

Qualifications

Basic Qualifications

• Ph.D. in Computer Science, Electrical Engineering, Information Technology or a related discipline OR Masters degree with 2-3 years of preferred professional experience
• Expertise with Time Series FMs (beyond the time series task of forecasting)
• In-depth experience in signal processing for sensor data and their integration with deep-learning methods
• Proficiency in Python, PyTorch (including libraries such as torchaudio, torchvision, torchmetrics), familiarity with PyTorch Lightning
• A strong publication record in relevant venues such as ICASSP, NeurIPS, InterSpeech, ICML, ICLR, KDD, ICRA, CVPR, ICCV, ECCV or equivalent contributions to the field such as patents or significant open-source projects
• Strong interpersonal, communication, and teamwork capabilities

Preferred Qualifications

• 3+ years of experience in industrial research
• Experience with one or more of the following areas: data-centric AI, synthetic data generation, agentic AI
• Proficiency with version control systems (Git), integrated development environment (VSCode or PyCharm) and experience with experiment tracking tools (MLFlow)
• Familiarity with high-performance computing systems and job schedulers (Slurm, LSF)
• Hands-on experience in product development in the above-mentioned areas for consumer/enterprise markets
• Experience leading projects with small teams, demonstrating the ability to mentor junior researchers and interns, manage project timelines, and deliver results within time constraints

Additional Information

Your well-being matters at Bosch! We offer a competitive compensation and a benefits package designed to empower you in every area of your life. This includes premium health coverage, a 401(k) with generous matching, resources for financial planning and goal setting, ample paid time off, parental leave, and comprehensive life and disability protection. We're investing in your success!

Equal Opportunity Employer, including disability / veterans

• Bosch adheres to Federal, State, and Local laws regarding drug-testing. Employment is contingent upon the successful completion of a drug screen and background check. Candidates who have been offered the position must pass both screenings before their start date.

The U.S. base salary range for this full-time position is $165,000 - $ 195,000. Within the range, individual pay is determined based on several factors, including, but not limited to, work experience and job knowledge, complexity of the role, job location, etc. Your Recruiter can share more details about the specific salary range for this position during the interview process.