Python Data Scientist — AI, RL & Model Evaluation

Hired; Pakistan; On-site; PKR 1,500,000 - 2,800,000; Full time

Job summary

Hired seeks a Data Scientist/Analyst for a full-time role to develop and maintain high-quality Python code for training and optimizing AI models, and to conduct evaluations benchmarking performance.

You will collaborate with researchers and annotators to execute reinforcement learning with human feedback and refine reward models, while leading supervised fine-tuning and dataset creation.

Qualifications

• Proficiency in Python for data analysis and model development.
• Experience with data science and ML techniques.
• Ability to extract insights from public databases.
• Strong skills in bug fixing and technical documentation.
• Excellent communication to articulate reasoning in notebooks.

Responsibilities

• Design, develop, and maintain efficient code to train and optimize AI models.
• Conduct evaluations to benchmark model performance and analyze results.
• Evaluate and rank AI model responses across domains according to criteria.
• Develop explanations and rationales for evaluations with strong reasoning.
• Lead supervised fine-tuning and create high-quality task datasets.

Skills

Python

Machine Learning

Data Analysis

Documentation

Communication

Tools

Jupyter

Git

Job description

Hired seeks a Data Scientist/Analyst for a full-time role to develop and maintain high-quality Python code for training and optimizing AI models, and to conduct evaluations benchmarking performance.

You will collaborate with researchers and annotators to execute reinforcement learning with human feedback and refine reward models, while leading supervised fine-tuning and dataset creation.