Space Science AI Evaluation Specialist

SuperAnnotate AI, Inc.; United States; Remote; USD 83,000 - 138,000; Full time

Job summary

SME Careers in the United States is seeking astronomy and space science specialists to evaluate and refine AI language models. You will apply physics-based reasoning and domain knowledge to assess accuracy, reasoning, and clarity of model outputs.

There is no immediate project; you will be contacted for relevant opportunities. Compensation up to $100/hour. Requires 4+ years in astronomy or related space science; bachelor’s degree required, Master’s/PhD preferred. English interview.

Qualifications

• 4+ years of professional experience in astronomy or related space science.
• Bachelor’s degree required; Master’s/PhD strongly preferred.
• Experience with AI data training or evaluating AI-generated content is a strong plus.
• Familiarity with Python/NumPy/SciPy, data pipelines or mission datasets is a plus.

Responsibilities

• Evaluate AI-generated responses for scientific accuracy across astronomy topics.
• Challenge models with realistic scenarios, calculations and research-style reasoning.
• Review and refine prompts, model answers, and step-by-step solutions.
• Provide structured feedback on errors, wrong assumptions, and uncertainties.
• Assess performance in orbital mechanics, astrophysics, cosmology, planetary science, and space physics.
• Help shape AI communication standards for scientific content and uncertainty.

Education

Bachelor’s degree in physics/astronomy/space science or closely related

Master’s/PhD strongly preferred

Job description

SME Careers in the United States is seeking astronomy and space science specialists to evaluate and refine AI language models. You will apply physics-based reasoning and domain knowledge to assess accuracy, reasoning, and clarity of model outputs.

There is no immediate project; you will be contacted for relevant opportunities. Compensation up to $100/hour. Requires 4+ years in astronomy or related space science; bachelor’s degree required, Master’s/PhD preferred. English interview.