AI Research Scientist

USA Tech Recruit; San Francisco (CA); On-site; USD 90,000 - 150,000; Full time

Job summary

An innovative startup is on the lookout for a passionate Research Scientist to set industry standards for evaluating large language models in enterprise environments. This role is pivotal in advancing research initiatives within a collaborative team that thrives in a fast-paced atmosphere. Join a dynamic group dedicated to pushing the boundaries of AI technology, where your contributions will shape the future of applied research. With a strong emphasis on teamwork and regular engagement, this position offers a unique opportunity to work closely with experts in the field and make a significant impact in the AI landscape.

Qualifications

• 3+ years in applied AI focusing on benchmarking LLMs.
• Experience in AI startups or research labs preferred.

Responsibilities

• Drive research initiatives for evaluating LLMs in enterprise settings.
• Collaborate with teams on development sprints and research projects.

Skills

Python

Deep Learning

Benchmarking

Evaluation Methodologies

Team Collaboration

Education

Master's or PhD in Computer Science

Bachelor's in a related field

Tools

PyTorch

TensorFlow

Git

Django

Flask

Job description

Company Overview:

We are a dynamic startup focused on commercializing research in large language models (LLMs) for enterprise-specific tasks. Our team is currently composed of 7 talented individuals who are dedicated to advancing the application of AI technologies in various industries.

Team Structure:

Our organization is divided into two key teams:

• Platform Team: Responsible for developing the web application and backend infrastructure for testing.
• Research Team: Focused on creating new datasets, benchmarks, and evaluation methodologies.

Recent Achievements:

We have experienced substantial early success, collaborating with leading AI laboratories and innovative tech startups. Our partnerships include well-known entities in the AI space and Fortune 500 companies.

Position Overview:

We are seeking a Research Scientist who is passionate about setting industry standards for evaluating LLMs in enterprise environments. This role is critical for driving our research initiatives forward.

Company Culture:

We pride ourselves on fostering a collaborative and in-person work environment. Our team works together five days a week at our San Francisco office, where we engage in regular activities such as weekly demos, team lunches, and social gatherings. We prioritize applied research and thrive in a fast-paced startup atmosphere.

Minimum Requirements:

• Seniority:
• 3+ years of experience in applied AI, focusing on benchmarking and evaluation methodologies related to language models. Experience in creating new benchmarks is highly valued.
• Work Experience:
• Research background in AI/ML, especially in benchmarking and evaluation methodologies.
• Team collaboration experience, including development sprints and familiarity with Git best practices.
• Previous roles in AI startups or research labs (e.g., Anthropic, DeepMind) are preferred. Experience as a founder or early employee is a plus.
• Research experience with published papers in NLP or benchmarking is valued but not essential; applied work is prioritized.
• Education:
• Degree in Computer Science, Machine Learning, or a related field (Master’s or PhD preferred). Candidates with a Bachelor's and 1-3 years of relevant experience may also be considered.
• Ideally from reputable tech/AI programs.
• Hard Skills:
• Proficient in Python with the ability to write clean, maintainable code.
• Experience with deep learning frameworks (PyTorch, TensorFlow) and familiarity with key AI/ML techniques.
• Interest in LLM infrastructure; experience with Django or Python-based HTTP servers (e.g., Flask) is a plus.