Remote Python Data Scientist for AI Model Evaluation

HireHouse; United Arab Emirates; Remote; AED 120,000 - 180,000; Full time

Job summary

HireHouse is actively seeking a Data Scientist/Analyst to craft and sustain high-quality Python code for training and optimizing AI models. You will work on benchmarking performance and analyzing results, collaborating with researchers and annotators to implement reinforcement learning with human feedback and refine reward models.

You will design and execute evaluations, rank model responses, and produce clear explanations and rationales for assessments, while leading supervised fine-tuning with

Qualifications

• Proficiency in Python for data analysis and model development.
• Experience with data science and machine learning techniques.
• Ability to extract insights from public datasets using analytical methods.
• Strong debugging skills and thorough technical documentation.

Responsibilities

• Design, develop, and maintain efficient Python code to train and optimize AI models.
• Conduct evaluations to benchmark model performance and analyze results.
• Evaluate and rank AI model responses to user queries across domains.
• Develop explanations and rationales for evaluations with strong reasoning.
• Lead supervised fine-tuning with high-quality task-specific datasets.

Skills

Python

Data science

Machine learning

Insights from data

Bug fixing

Documentation

Notebooks communication

Tools

Jupyter notebooks

Job description

HireHouse is actively seeking a Data Scientist/Analyst to craft and sustain high-quality Python code for training and optimizing AI models. You will work on benchmarking performance and analyzing results, collaborating with researchers and annotators to implement reinforcement learning with human feedback and refine reward models.

You will design and execute evaluations, rank model responses, and produce clear explanations and rationales for assessments, while leading supervised fine-tuning with