AI Research Scientist Multimodal VLM and MLLM US or Canada

Autodesk; Toronto; Hybrid; CAD 90,000 - 130,000; Full time

Job summary

A leading design software company seeks an AI Research Scientist to conduct fundamental and applied research in machine learning. The successful candidate will develop innovative models and collaborate on projects in a diverse team setting. Requirements include a Master's or PhD in AI/ML, experience with deep learning, statistical methods, and strong Python skills. This role offers opportunities to influence design and development processes globally and engage in groundbreaking research in AI technology.

Qualifications

• A Master's or PhD in a field related to AI/ML.
• Strong background applying Deep Learning techniques.
• Familiarity in statistical methods for Machine Learning.
• Strong coding abilities in Python.

Responsibilities

• Develop new ML models and AI techniques.
• Lead on research projects within a global team.
• Review relevant AI/ML literature to identify emerging methods.
• Explore new data sources and leverage best techniques.

Skills

Deep Learning techniques

Python coding

Statistical methods for Machine Learning

Software development skills

Familiarity with PyTorch

Machine Learning frameworks

Education

Master's or PhD in AI/ML related field

Tools

PyTorch

MLOps

Git

Job description

Job Requisition ID # 25WD92007

AI Research Scientist (Multimodal)

Position Overview

As an AI Research Scientist at Autodesk Research, you will be doing fundamental and applied research that will help our customers imagine, design, and make a better world.

We are a team of scientists, researchers, engineers, and designers working together on projects that range from learning-based design systems, computer vision, graphics, robotics, human-computer interaction, sustainability, simulation, manufacturing, architectural design and construction.

This role will report to a Research Manager in the AI Lab.

Location: UK/EMEA, US or Canada

Responsibilities

• Develop new ML models and AI techniques
• Lead on research projects within a global team
• Review relevant AI/ML literature to identify emerging methods, technologies, and best practices
• Explore new data sources and discover techniques for best leveraging data

Minimum Qualifications

• A Master's or PhD in a field related to AI/ML, such as: Computer Science, Mathematics, Statistics, Physics, Linguistics, Mechanical Engineering, or related disciplines
• Strong background applying Deep Learning techniques (including implementing custom architectures, optimizing model performance, developing novel loss functions, metrics, and benchmarks, and deploying production-ready solutions)
• Familiarity in statistical methods for Machine Learning (e.g. Bayesian methods, HMMs, graphical models, dimension reduction, clustering, classification, regression techniques, etc.)
• Familiarity with PyTorch, PyTorch Lightning, or similar frameworks
• Strong coding abilities in Python
• Strong Software development skills and familiarity with GPUs, MLOps, Git, High-performance large-scale ML systems and platforms
• Experience with Transformers, LLMs, NLP, Multi-modal Deep Learning, and VLMs/MLLMs
• Publication track record in machine learning conferences and/or journals

Preferred Qualifications

• Significant post-graduate research experience, or five or more years of work experience (actual job title/position will be commensurate with experience)
• Experience with foundation and open-source models, meta/transfer learning, fine-tuning, distillation, multi-task/continual learning, RL, RLxF, and/or image/audio/video/3D generation/understanding
• Experience or familiarity with the 3D Graphics/Animation, Manufacturing, Engineering, Architecture, and/or Construction domain

At Autodesk, we're building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.