AI Research Scientist - Speech & Language - Generative AI

The Rundown AI, Inc.; San Francisco (CA); On-site; USD 147,000 - 208,000; Full time

Job summary

An established industry player is seeking a Research Scientist specializing in Speech and Language to join their innovative GenAI Speech team. This role involves advancing research in speech-LLMs, contributing to product development, and leveraging cutting-edge techniques in speech recognition and synthesis. The ideal candidate will have a strong academic background, including a PhD, and experience in AI research, particularly in deep learning frameworks. This is a unique opportunity to shape the future of communication technology and bring groundbreaking research to life in products that connect people across the globe.

Benefits

Bonus

Equity

Comprehensive benefits

Flexible work hours

Professional development opportunities

Qualifications

• Strong background in AI research with a focus on speech and language technologies.
• Proven ability to publish in peer-reviewed AI and speech conferences.

Responsibilities

• Work towards ambitious research goals while identifying intermediate milestones.
• Contribute research applicable to product development.

Skills

Speech Recognition

Speech Synthesis

Deep Learning

Multimodal Modeling

Reinforcement Learning

Research Communication

Education

Bachelor's degree in Computer Science

PhD in Computer Science

Equivalent practical experience

Tools

PyTorch

TensorFlow

Job description

We are looking for a Research Scientist (Speech and Language) to join the GenAI Speech team at Meta. The GenAI Speech team works on speech-LLMs, and leverages knowledge in areas like speech encoders, pre-training, post-training, reinforcement learning, LLM alignment, multimodal modeling, speech and audio processing, speech recognition, speech synthesis, and multilingual modeling.

AI Research Scientist - Speech & Language - Generative AI Responsibilities:

• Work towards long-term ambitious research goals, while identifying intermediate milestones.
• Contribute research that can be applied to Meta product development.

Minimum Qualifications:

• Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
• PhD degree in Computer Science, Mathematics, or similar quantitative field.
• Proven track record publications at peer-reviewed AI & speech conferences (e.g. NeurIPS, ICML, ICLR, ICASSP).
• Experience in training, fine-tuning, and/or experimenting with foundation models beyond black-box use.
• Familiarity with one or more deep learning frameworks (e.g. pytorch, tensorflow, …).
• Experience to communicate complex research for public audiences of peers.

Preferred Qualifications:

• 2+ years of work experience post PhD in a university, industry, or government lab(s), in a role with primary emphasis on AI research.
• High impact publications at leading AI and speech conferences and journals (e.g. NeurIPS, ICML, ICLR, ICASSP).
• Experience with interdisciplinary and/or cross-collaboration.
• Experience bringing machine learning-based products from research to production.
• The ideal candidate will have industry experience working on Speech, Language, and LLM related topics and the experience to apply relevant AI and machine learning techniques to build intelligent rich speech & language systems that improve Meta's products and experiences.
• Candidates should have an interest in taking new research findings in this area and implementing them towards product needs.

About Meta:

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today—beyond the constraints of screens, the limits of distance, and even the rules of physics.

Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at [e-mail].

$147,000/year to $208,000/year + bonus + equity + benefits. Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta.