A complete application in a minute
Tailored resume and cover letter, ready to send.
Careerflow.ai is seeking experienced software engineers at a tech lead level to contribute to high-quality public GitHub repositories. The role involves hands-on development, environment automation, and issue triaging, with a focus on evaluating test coverage and LLM-driven bug-fixing scenarios.
You will analyze trending open-source projects, configure repositories with Dockerization, and work closely with researchers to identify challenging tasks for LLMs.
About the Role: We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality
Analyze and triage GitHub issues across trending open-source libraries. Set up and configure code repositories, including Dockerization and environment setup. Evaluating unit test coverage and quality. Modify and run codebases locally to assess LLM performance in bug-fixing scenarios. Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
Minimum 3+ years of overall experience
Strong experience with at least one of the following languages: Python
Proficiency with Git, Docker, and basic software pipeline setup.
Ability to understand and navigate complex codebases.
Comfortable running, modifying, and testing real-world projects locally.
Experience contributing to or evaluating open-source projects is a plus.
Previous participation in LLM research or evaluation projects.
Experience building or testing developer tools or automation agents.
Work in a fully remote environment.
Opportunity to work on cutting-edge AI projects with leading LLM companies.
Commitments Required: Minimum 40 hours per week with overlap of 4 hours with PST.
Employment type : Contractor assignment (no medical/paid leave)
Duration of contract : 2-3 weeks.
Payment: $25 per approved task
Location : Argentina, Brazil, Chile, Colombia, Peru