Audio to Audio Research Scientist, DeepMind

Google DeepMind; Mountain View (CA); On-site; USD 207,000 - 300,000; Full time

Benefits offered by this job

Equity

Bonus target

Benefits

Job summary

Google DeepMind in Mountain View, CA is seeking a Research Scientist to own the development and deployment of audio-focused AI models at scale. You will set up experiments, prototype architectures, and collaborate across teams to translate fundamental research into practical, real-world dialog systems.

You will publish findings with international collaborators, contribute to open benchmarks, and help shape the direction of speech and audio modeling across products, guided by safety and ethics.

Qualifications

• PhD or equivalent practical experience in a related field.
• Experience in AI/ML, NLP, or Generative AI.
• Applied research experience with ML models and datasets.
• Ability to deploy large-scale AI experiments.

Responsibilities

• Develop audio-first models for complex dialogs with low latency.
• Leverage real and synthetic data to improve dialog capabilities.
• Collaborate with infra teams to design scalable models.
• Create benchmarks to measure audio-to-audio model performance.

Skills

AI/ML experience

NLP/Generative AI

Applied research

LLMs

Education

PhD in CS/EE or related field

Job description

Note: By applying to this position you will have an opportunity to share your preferred working location from the following: Mountain View, CA, USA; New York, NY, USA.

Minimum qualifications

• PhD degree in Computer Science, Electrical Engineering, or Computer Engineering, a related field, or equivalent practical experience.
• Experience in artificial intelligence or machine learning.
• Experience with large language models, NLP, or Generative AI.
• Experience in an applied research setting.
• Experience working with machine learning (ML) models, training methodologies, or evaluation datasets.

Preferred qualifications

• Experience with Generative Audio Modeling, Multimodal modeling, On-device AI Implementation or Fine tuning for LLMs.
• Experience in NLP, LLMs or Generative AI.
• A strong publication record in conferences or journals in the field of communications or signal processing.

About the job

As an organization, Google maintains a portfolio of research projects driven by fundamental research, new product innovation, product contribution and infrastructure goals, while providing individuals and teams the freedom to emphasize specific types of work. As a Research Scientist, you'll setup large-scale tests and deploy promising ideas quickly and broadly, managing deadlines and deliverables while applying the latest theories to develop new and improved products, processes, or technologies. From creating experiments and prototyping implementations to designing new architectures, our research scientists work on real-world problems that span the breadth of computer science, such as machine (and deep) learning, data mining, natural language processing, hardware and software performance analysis, improving compilers for mobile platforms, as well as core search and much more.

As a Research Scientist, you'll also actively contribute to the wider research community by sharing and publishing your findings, with ideas inspired by internal projects as well as from collaborations with research programs at partner universities and technical institutes all over the world.

Artificial intelligence will be one of humanity’s most transformative inventions. At Google DeepMind, we are a pioneering AI lab with exceptional interdisciplinary teams focused on advancing AI development to solve complex global challenges and accelerate high-quality product innovation for billions of users. We use our technologies for widespread public benefit and scientific discovery, ensuring safety and ethics are always our highest priority.

We are pushing the boundaries across multiple domains. Our global teams offer diverse learning opportunities and varied career pathways for those driven to achieve exceptional results through collective effort.

Individual pay is determined by factors including job-related skills, experience, and relevant education or training.

US: $207000 - $300000 (USD) + 20% bonus target + equity + benefits

Responsibilities

Learn more about benefits at Google.

• Develop audio-first models capable of orchestrating and planning complex dialogs, including leveraging external tools like search when necessary.
• Leverage new sources of data (real and synthetic) to empower new real-time dialog capabilities.
• Work with infra teams to design models suitable for open-mic conversations that are fluid and have low latency.
• Create comprehensive datasets and benchmarks to improve and measure audio-to-audio (A2A) model performance on conversationality.

Google is proud to be an equal opportunity workplace and is an affirmative action employer. We are committed to equal employment opportunity regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity or Veteran status. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Google's EEO Policy and EEO is the Law. If you have a disability or special need that requires accommodation, please let us know by completing our Accommodations for Applicants form.