AI Tutor, ML Engineer Specialist (contract), Handshake AI

Handshake; San Francisco (CA); On-site; USD 200,000 - 250,000; Full time

Job summary

Handshake seeks an AI Tutor, Machine Learning Engineer Specialist for a vital remote position. In this role, you will leverage your expertise to enhance AI models through thorough evaluation and refinement of technical outputs. With an emphasis on collaboration and data integrity, you'll ensure high standards in machine learning applications while contributing to a dynamic team poised to innovate in the field of AI. This flexible contract position allows for various time commitments, making it an exceptional opportunity for professionals passionate about technology and data quality.

Qualifications

• Expertise in evaluating AI-generated outputs and refining datasets.
• Strong grasp of machine learning concepts and evaluation strategies.
• Ability to provide constructive feedback on complex technical information.

Responsibilities

• Evaluate and critique AI-generated outputs in technical domains.
• Contribute to datasets for training and refining AI models.
• Collaborate with AI teams to identify patterns and model blind spots.

Skills

Machine Learning

Data Science

Analytical Thinking

Technical Communication

Detail-oriented Feedback

Education

MS or PhD in Computer Science

3+ years of experience in Machine Learning or Data Science

Job description

Remote

Everyone is welcome at Handshake. We know diverse teams build better products and we are committed to creating an inclusive culture built on a foundation of respect for all individuals. We strongly encourage candidates from non-traditional backgrounds, historically marginalized or underrepresented groups to apply.

Your impact

As an AI Tutor, Machine Learning Engineer Specialist, you will contribute to the next generation of AI models by reviewing and refining outputs generated by cutting-edge large language models (LLMs). You'll apply your expertise in machine learning, data science, and technical domains to ensure model outputs meet high standards of technical accuracy, relevance, and consistency. This role blends analytical thinking with hands-on data quality work and research-grade insight into model evaluation and improvement.

This is a contract remote position with variable time commitments. The services to be provided by the Contractor under this agreement are supplementary and not integral to the Handshake’s primary business operations. The Contractor’s services are distinct and separate from the core business activities of Handshake.

Your role

• Use internal tools to evaluate and critique AI-generated outputs, primarily in technical and scientific domains.
• Review complex model responses and suggest improvements with a focus on clarity, correctness, and domain relevance.
• Contribute to the curation and refinement of datasets used to train and fine-tune AI/ML models.
• Work closely with cross-functional AI teams to identify data patterns, edge cases, and model blind spots.
• Stay up-to-date on model behaviors and guidelines as they evolve, applying judgment to nuanced annotation tasks.

Your experience

• MS or PhD in Computer Science, Machine Learning, Data Science, or a closely related technical field.
• Alternatively, 3+ years of professional experience as a Machine Learning Engineer or Data Scientist at a high-caliber company (e.g., FAANG, leading startups, AI labs).
• Strong grasp of core machine learning concepts, model training workflows, and evaluation strategies.
• Experience with LLMs, NLP systems, or applied ML in production settings is highly desirable.
• Ability to assess complex technical information and provide constructive, detail-oriented feedback.
• Excellent written communication skills—both technical and explanatory writing.
• Ability to operate independently with sound judgment under ambiguous conditions.
• Passion for AI development, data quality, and technological advancement.

Bonus areas of expertise

• Publications in machine learning, AI, or computer science journals/conferences.
• Experience working with human feedback loops in ML systems (e.g., RLHF, data annotation, model alignment).
• Teaching, mentoring, or technical writing experience in ML or related technical domains.
• Exposure to generative AI applications or prompt engineering.

Additional Requirements

• Availability to work evenings and weekends as needed.
• Ability to quickly adapt to new skills and evolving requirements.
• Personal device must support Windows 10 or macOS Big Sur 11.0 or later.
• Reliable access to a smartphone.
• Fully remote position.
• Not hiring in Wyoming or Illinois at this time.

Compensation range

• $40/hr - $70/hr

For cash compensation, we set standard ranges for all U.S.-based roles based on function, level, and geographic location, benchmarked against similar stage growth companies. In order to be compliant with local legislation, as well as to provide greater transparency to candidates, we share salary ranges on all job postings regardless of desired hiring location. Final offer amounts are determined by multiple factors, including geographic location as well as candidate experience and expertise, and may vary from the amounts listed above.

About us

Handshake is building the future of human data for AI.

We partner directly with top AI labs to power large language model (LLM) training and evaluation with high-quality, expert-generated data. As AI models become more sophisticated, the demand for specialized human input continues to grow—and Handshake is uniquely positioned to meet it. We power career platforms at 92% of the top U.S. universities, giving us direct access to verified expert talent across a wide range of domains.

Our AI team is rapidly building a new generation of human data products—from expert annotation platforms to AI interviewers and seamless payout infrastructure—all designed to accelerate research and improve model performance.

We’ve assembled a world-class team from YC, Notion, Scale, Coinbase, Palantir, and more, and we’re working directly with many of the world’s leading AI research labs. This is a unique opportunity to join a fast-growing team shaping the future of AI through better data, better tools, and better systems—for experts, by experts.

Handshake is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or reasonable accommodation, please let your recruiter know during initial communications.

Apply for this job

*

indicates a required field

First Name *

Last Name *

Email *

Phone *

Resume/CV *

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

Example:Oakland, California
Example: Berlin, Germany

What is your highest level of education? *

Do you have professional experience with LLM (Large Language Model) data annotation or model evaluation? If yes, please briefly describe your role, the types of tasks you worked on (e.g., data labeling, prompt evaluation, model comparisons), and list any vendors, platforms, or organizations you worked with. *

Which STEM field do you specialize in? *

Website

LinkedIn Profile (indicate N/A if you don't have one) *

How did you hear about this job? *

Stryder Corp Privacy Shield Certification Select...

For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in Handshake’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.

Select...

Voluntary Self-Identification of Disability

Form CC-305

Page 1 of 1

OMB Control Number 1250-0005

Expires 04/30/2026

Voluntary Self-Identification of Disability

Form CC-305 Page 1 of 1 OMB Control Number 1250-0005 Expires 04/30/2026
Why are you being asked to complete this form?

We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress towards this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one. People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website at www.dol.gov/ofccp .

How do you know if you have a disability?

A disability is a condition that substantially limits one or more of your “major life activities.” If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

• Alcohol or other substance use disorder (not currently using drugs illegally)
• Autoimmune disorder, for example, lupus, fibromyalgia, rheumatoid arthritis, HIV/AIDS
• Blind or low vision
• Cancer (past or present)
• Cardiovascular or heart disease
• Celiac disease
• Cerebral palsy
• Deaf or serious difficulty hearing
• Diabetes
• Disfigurement, for example, disfigurement caused by burns, wounds, accidents, or congenital disorders
• Epilepsy or other seizure disorder
• Gastrointestinal disorders, for example, Crohn's Disease, irritable bowel syndrome
• Intellectual or developmental disability
• Mental health conditions, for example, depression, bipolar disorder, anxiety disorder, schizophrenia, PTSD
• Missing limbs or partially missing limbs
• Mobility impairment, benefiting from the use of a wheelchair, scooter, walker, leg brace(s) and/or other supports
• Nervous system condition, for example, migraine headaches, Parkinson’s disease, multiple sclerosis (MS)
• Neurodivergence, for example, attention-deficit/hyperactivity disorder (ADHD), autism spectrum disorder, dyslexia, dyspraxia, other learning disabilities
• Partial or complete paralysis (any cause)
• Pulmonary or respiratory conditions, for example, tuberculosis, asthma, emphysema
• Short stature (dwarfism)
• Traumatic brain injury

Disability Status Select...

PUBLIC BURDEN STATEMENT: According to the Paperwork Reduction Act of 1995 no persons are required to respond to a collection of information unless such collection displays a valid OMB control number. This survey should take about 5 minutes to complete.