Enable job alerts via email!
Generate a tailored resume in minutes
Land an interview and earn more. Learn more
A leading recruitment firm is seeking a Ruby Rail Developer for LLM Evaluation & Validation. Candidates should have over 5 years of experience in software development, with a strong focus on Ruby and familiarity with modern software pipelines. This remote contract role requires a minimum commitment of 20 hours per week and presents opportunities to lead junior engineers.
Bachelors in Computer Application(Computers)
Nationality
Any Nationality
Vacancy
1 Vacancy
Job Description
Experience: 5 - 8 Years
Location: - Permanent Remote
Job Type: Contract
Duration of contract: 3 months
Commitment required:
Minimum 20 hours per week with some overlap with PST
Employment type: Contractor assignment (no medical/paid leave)
Must Have:
Definition: These are non-negotiable requirements for the role. Candidates without these will not be considered.
5+ years of relevant software development experience.
Ruby - min 4+ yrs exp
What does day-to-day look like:
Analyze and triage GitHub issues across trending open-source libraries.
Set up and configure code repositories, including Dockerization and environment setup.
Evaluating unit test coverage and quality.
Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
Opportunities to lead a team of junior engineers to collaborate on projects.
Required Skills:
Definition: These skills are essential and candidates must possess them to be successful in the role.
Minimum 5+ years of overall experience
Strong experience with at least one of the following languages: Ruby
Proficiency with Git, Docker, and basic software pipeline setup.
Ability to understand and navigate complex codebases.
Comfortable running, modifying, and testing real-world projects locally.
Experience contributing to or evaluating open-source projects is a plus.
Nice to Have:
Definition: These skills/experiences are not essential but would be beneficial and might give candidates an edge.
Previous participation in LLM research or evaluation projects.
Experience building or testing developer tools or automation agents.
Company Industry
Department / Functional Area
Keywords
Disclaimer: Naukrigulf.com is only a platform to bring jobseekers & employers together. Applicants are advised to research the bonafides of the prospective employer independently. We do NOT endorse any requests for money payments and strictly advice against sharing personal or bank related information. We also recommend you visit Security Advice for more information. If you suspect any fraud or malpractice, email us at abuse@naukrigulf.com