AI Research Scientist/Engineer Multimodal VLM and MLLM

Autodesk; City of Albany (NY); Remote; USD 100,000 - 150,000; Full time

Job summary

A leading design software company is seeking an AI Research Scientist/Engineer to conduct fundamental and applied research in AI and ML. This role involves developing innovative ML models, leading global research projects, and collaborating with experts in various fields. Ideal candidates should have a Master's or PhD in a related discipline and strong coding abilities in Python.

Qualifications

• Master's or PhD in a relevant field related to AI/ML.
• Strong background in Deep Learning and implementing custom architectures.
• Familiarity with PyTorch and coding in Python.

Responsibilities

• Develop new ML models and AI techniques.
• Lead on research projects within a global team.
• Review AI/ML literature to identify emerging methods.

Skills

Deep Learning techniques

Statistical methods for Machine Learning

Strong coding abilities in Python

MLOps and high-performance ML systems

Transformers and NLP

Education

Master's or PhD in AI/ML related field

Tools

PyTorch

Git

Job description

Overview

Job Requisition ID: 25WD92007

AI Research Scientist/Engineer (Multimodal)

Position Overview: As an AI Research Scientist at Autodesk Research, you will be doing fundamental and applied research that will help our customers imagine, design, and make a better world. We are a team of scientists, researchers, engineers, and designers working together on projects that range from learning-based design systems, computer vision, graphics, robotics, human-computer interaction, sustainability, simulation, manufacturing, architectural design and construction. This role will report to a Research Manager in the AI Lab.

Location: UK/EMEA, US or Canada Remote or Hybrid

Responsibilities

• Develop new ML models and AI techniques
• Lead on research projects within a global team
• Review relevant AI/ML literature to identify emerging methods, technologies, and best practices
• Explore new data sources and discover techniques for best leveraging data

Minimum Qualifications

• A Master\'s or PhD in a field related to AI/ML, such as Computer Science, Mathematics, Statistics, Physics, Linguistics, Mechanical Engineering, or related disciplines
• Strong background applying Deep Learning techniques (including implementing custom architectures, optimizing model performance, developing novel loss functions, metrics, and benchmarks, and deploying production-ready solutions)
• Familiarity in statistical methods for Machine Learning (e.g. Bayesian methods, HMMs, graphical models, dimension reduction, clustering, classification, regression techniques, etc.)
• Familiarity with PyTorch, PyTorch Lightning, or similar frameworks
• Strong coding abilities in Python
• Strong software development skills and familiarity with GPUs, MLOps, Git, high-performance large-scale ML systems and platforms
• Experience with Transformers, LLMs, NLP, Multi-modal Deep Learning, and VLMs/MLLMs
• Publication track record in machine learning conferences and/or journals

Preferred Qualifications

• Significant post-graduate research experience, or five or more years of work experience (actual job title/position will be commensurate with experience)
• Experience with foundation and open-source models, meta/transfer learning, fine-tuning, distillation, multi-task/continual learning, RL, RLxF, and/or image/audio/video/3D generation/understanding
• Experience or familiarity with 3D Graphics/Animation, Manufacturing, Engineering, Architecture, and/or Construction domain

At Autodesk, we\'re building a diverse workplace and an inclusive culture to give more people the chance to imagine, design, and make a better world. Autodesk is proud to be an equal opportunity employer and considers all qualified applicants for employment without regard to race, color, religion, age, sex, sexual orientation, gender, gender identity, national origin, disability, veteran status or any other legally protected characteristic. We also consider for employment all qualified applicants regardless of criminal histories, consistent with applicable law.

Are you an existing contractor or consultant with Autodesk? Please search for open jobs and apply internally (not on this external site). If you have any questions or require support, contact Autodesk Careers (Careers <[e-mail]>).