Astronomy AI Quality Specialist

Parailabs; Colombia; Remote; COP 90,000,000 - 130,000,000; Full time

Job summary

Parailabs seeks seasoned space science experts to evaluate and refine AI models on astronomy topics. You’ll test model reasoning, verify calculations, and provide structured feedback to improve scientific accuracy and clarity.

Role offers access to future projects through our expert network and collaboration with leading AI labs. 4+ years in astronomy or related fields is required; PhD preferred. Remote, international opportunities available.

Qualifications

• Bachelor’s degree is mandatory; Master’s/PhD strongly preferred.
• Experience with AI data training, annotation, red-teaming, or evaluating AI-generated technical content is a strong plus.
• Familiarity with data workflows, catalog queries, photometry/spectroscopy concepts, or mission datasets is a plus.

Responsibilities

• Evaluate AI-generated responses for scientific accuracy, logical soundness, completeness, and clarity across astronomy & space science topics.
• Challenge language models with realistic scenarios, calculations, and “research-style” reasoning tasks (without overclaiming certainty).
• Review and refine AI-generated prompts, model answers, and step-by-step solutions (units, assumptions, approximations, uncertainty).
• Provide structured feedback identifying conceptual errors, bad assumptions, missing constraints, misused formulas, unit mistakes, or misleading/overconfident claims.
• Assess performance on topics such as: Orbital mechanics, Stellar/galactic astrophysics, Cosmology basics, Planetary science, Space physics, Data interpretation.
• Help shape AI communication standards for scientific content, especially how models state assumptions, uncertainty, and limits of inference.

Skills

Astronomy

Astrophysics

Orbital mechanics

Python

NumPy/SciPy

Data analysis

Statistics

Uncertainty analysis

Education

Bachelor’s degree in Physics/Astronomy/Space Science

Master’s degree or PhD in related field

Tools

Python (NumPy/SciPy)

Astropy

SQL

Jupyter

Job description

Parailabs seeks seasoned space science experts to evaluate and refine AI models on astronomy topics. You’ll test model reasoning, verify calculations, and provide structured feedback to improve scientific accuracy and clarity.

Role offers access to future projects through our expert network and collaboration with leading AI labs. 4+ years in astronomy or related fields is required; PhD preferred. Remote, international opportunities available.