Senior Python Developer (Remote)

Joblet-AI

Abu Dhabi

Remote

AED 240,000 - 320,000

Full time

44 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Joblet-AI is seeking a Senior Python Developer (Remote) to join a project with foundational LLM companies. You will design, develop and maintain high-quality Python code for training and optimizing AI models, conduct evaluations to benchmark performance and help improve model alignment with defined criteria.

You will lead SFT efforts, collaborate with researchers and annotators for RLHF, and continuously explore new tools and methodologies to enhance AI training processes.

Qualifications

  • 3 years of strong experience with Python programming language.
  • Industry experience and knowledge of code quality formatting and best practices of software development.
  • Experience with Python's testing ecosystem including unit, integration and property-based testing.
  • Knowledge of multi-threading and asynchronous programming in Python.
  • Ability to work with architectural patterns and refactor code without introducing regressions.
  • Strong debugging skills including fixing memory and concurrency issues.
  • Fluent in conversational and written English communication skills.

Responsibilities

  • Design, develop and maintain efficient high-quality Python code to train and optimize AI models.
  • Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
  • Evaluate and rank AI model responses to user queries across diverse domains ensuring alignment with predefined criteria.
  • Develop explanations and rationales for evaluations showcasing reasoning and technical expertise.
  • Lead efforts in Supervised Fine-Tuning (SFT) including creating and maintaining high-quality task-specific datasets.
  • Collaborate with researchers and annotators to execute RLHF and refine reward models.

Skills

Python programming
Debugging
Asynchronous programming
Code quality
English communication

Tools

Pytest or testing ecosystem
Python frameworks and libraries

Job description

Role Title

: Senior Python Developer (Remote)

Role Typ

e: Full-time

Location

: Remote

Role Overview:

This position is within a project with one of the foundational LLM companies. The goal is to assist these foundational LLM companies in enhancing their Large Language Models. One way we help these companies improve their models is by providing them with high-quality proprietary data. This data serves two main purposes: first as a basis for fine-tuning their models and second as an evaluation set to benchmark the performance of their models or competitor models. For example for SFT data generation you might have to put together or be provided a prompt which contains provided code and questions you will then provide the model responses and write corresponding Python code to solve the questions. For RLHF data generation you may need to create a prompt yourself or use one provided by the customer ask the model questions and evaluate the outputs generated by two versions of the LLM. You'll compare these outputs and provide feedback which is then used to fine-tune the models. Please note that this role does not involve building or fine-tuning LLMs.

What does day-to-day look like:
  1. Design develop and maintain efficient high-quality Python code to train and optimize AI models.
  2. Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
  3. Familiarity with Python frameworks and libraries
  4. Evaluate and rank AI model responses to user queries across diverse domains ensuring alignment with predefined criteria.
  5. Develop comprehensive explanations and rationales for evaluations showcasing excellent reasoning and technical expertise.
  6. Lead efforts in Supervised Fine-Tuning (SFT) including creating and maintaining high-quality task-specific datasets.
  7. Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
  8. Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
  9. Create and refine optimal responses to improve AI performance emphasizing clarity relevance and technical accuracy.
  10. Conduct thorough peer reviews of code and documentation providing constructive feedback and identifying areas for improvement.
  11. Collaborate with cross-functional teams to improve model performance and contribute to product enhancements.
  12. Continuously explore and integrate new tools techniques and methodologies to enhance AI training processes.
Requirements:
  1. 3 years of strong experience with Python programming language.
  2. Industry experience and knowledge of code quality formatting and best practices of software development
  3. Experience with Pythons testing ecosystem including unit integration and property-based testing.
  4. Knowledge of multi-threading and asynchronous programming in Python.
  5. Ability to work with architectural patterns and refactor code without introducing regressions.
  6. Strong debugging skills including fixing memory and concurrency issues.
  7. Fluent in conversational and written English communication skills
Offer Details:
  1. Commitments Required: at least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST. (We have 3 options of time commitment: 20 hrs/week 30 hrs/week or 40 hrs/week)
  2. Engagement type: Contractor assignment (no medical/paid leave)
  3. Duration of contract: 1 month; expected start date is next week
Evaluation Process (approximately 75 mins) :
  1. Two rounds of interviews (60 min technical 15 min cultural & offer discussion)
What Youll Do
  1. Design develop and maintain efficient high-quality Python code to train and optimize AI models.
  2. Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
  3. Evaluate and rank AI model responses to user queries across diverse domains ensuring alignment with predefined criteria.
  4. Develop comprehensive explanations and rationales for evaluations showcasing excellent reasoning and technical expertise.
  5. Lead efforts in Supervised Fine-Tuning (SFT) including creating and maintaining high-quality task-specific datasets.
  6. Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer (Remote)
Senior Software Engineer (Remote)

Joblet-AI • Abu Dhabi

Remote
AED 506,000 - 759,000
Senior Python AI Evaluator & SFT Lead (Remote)
Senior Python AI Evaluator & SFT Lead (Remote)

Joblet-AI • Abu Dhabi

Remote
AED 240,000 - 320,000
AI Engineer (Remote)
AI Engineer (Remote)

Joblet-AI • Abu Dhabi

Remote
AED 477,000 - 588,000
Equity compensation
Performance-based bonuses
Health-insurance premium reimbursement
+3
AI Research Engineer (Remote)
AI Research Engineer (Remote)

Joblet-AI • Abu Dhabi

Remote
AED 734,000 - 955,000
AI Research Engineer (Remote)
AI Research Engineer (Remote)

Joblet-AI • United Arab Emirates

Remote
AED 734,000 - 955,000
Equity compensation
Performance-based bonuses
Health insurance premium reimbursement
+1
NLP Engineer
NLP Engineer

Jobgether • United Arab Emirates

Remote
AED 280,000 - 460,000
Fully Remote Work
Competitive Compensation
28 days annual leave
+9
Technical Project Lead (Remote)
Technical Project Lead (Remote)

Joblet-AI • Abu Dhabi

Remote
AED 441,000 - 588,000
Equity compensation
Bonuses
Health insurance reimbursement
+2
Scientific Researcher Computational Task Author
Scientific Researcher Computational Task Author

OpenTrain AI, Inc. • United Arab Emirates

Remote
AED 417,000 - 594,000
Remote work
Senior ML Engineer (Remote)
Senior ML Engineer (Remote)

Joblet-AI • Abu Dhabi

Remote
AED 304,000 - 607,000
Data Scientist - Python (Remote) Jobs Ai Fast Track available
Data Scientist - Python (Remote) Jobs Ai Fast Track available

HireHouse • United Arab Emirates

Remote
AED 120,000 - 180,000
Top locations