Senior Software Engineer – Python (LLM Evaluation & Repository Validation)
Explore this software engineering opportunity. The information below summarizes the supplied role details; check the application page for the latest requirements and availability.
Role highlights & qualifications
- Software development
- About the Role: We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality
- Analyze and triage GitHub issues across trending open-source libraries.
- Evaluating unit test coverage and quality.
- Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
- Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
- Minimum 3+ years of overall experience
- Experience in at least one of the following languages: Python
- Proficiency with Git, Docker, and basic software pipeline setup.
- Experience contributing to or evaluating open-source projects is a plus.
Information is summarized from the supplied job posting. Please verify location eligibility, compensation, contractual terms and current availability on the application page.