Remote Data Scientist for Frontier AI & Model Evaluation

Turing; Pakistan; Remote; PKR 7,651,000 - 22,954,000; Part time

Benefits offered by this job

Fully remote

Flexible hours

Job summary

Turing, a fast-growing AI company, seeks Data Scientists & Analysts proficient in Python to advance AI models for US clients. Work remotely on innovative AI solutions, write clear code in Jupyter notebooks, and derive insights from public datasets. Engage with researchers and stakeholders to align model outputs with business goals.

You will evaluate model performance, contribute to SFT/RLHF workflows, and document methods and results for cross-functional teams.

Qualifications

• Bachelor’s/Master’s degree in Engineering, Computer Science or equivalent experience.
• Strong data analytics abilities and business sense to draw conclusions from datasets.
• Excellent problem-solving and analytical skills.
• Excellent communication abilities with stakeholders and researchers.
• Fluent in conversational and written English.

Responsibilities

• Design, develop, and maintain efficient Python code to train and optimize AI models.
• Conduct evaluations (Evals) to benchmark model performance and analyze results.
• Evaluate and rank AI model responses to user queries across diverse domains.
• Develop explanations and rationales for evaluations, showing reasoning and technical accuracy.
• Lead efforts in Supervised Fine-Tuning (SFT), creating task-specific datasets.
• Collaborate with researchers and annotators to implement Reinforcement Learning with Human Feedback (RLHF).
• Design evaluation strategies to improve model alignment with user needs and ethical guidelines.
• Create and refine optimal responses to enhance AI performance.

Skills

Python

Data analysis

Communication

Education

Bachelor’s/Master’s in Engineering or CS

Tools

Jupyter notebooks

Job description

Turing, a fast-growing AI company, seeks Data Scientists & Analysts proficient in Python to advance AI models for US clients. Work remotely on innovative AI solutions, write clear code in Jupyter notebooks, and derive insights from public datasets. Engage with researchers and stakeholders to align model outputs with business goals.

You will evaluate model performance, contribute to SFT/RLHF workflows, and document methods and results for cross-functional teams.