Senior Software Engineer – LLM Evaluation & Repository Validation
Explore this software engineering opportunity. The information below summarizes the supplied role details; check the application page for the latest requirements and availability.
Role highlights & qualifications
- Software development
- PythonJavaScriptJavaGoRustCC++C#Ruby
- Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation
- About the Role: We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. You should have experience working with well-maintained, widely-used repos with 500+ stars. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality
- Analyze and triage GitHub issues across trending open-source libraries.
- Evaluating unit test coverage and quality.
- Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
- Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
- Experience in at least one of the following languages: Python, JavaScript, Java, Go, Rust, C/C++, C#, or Ruby.
- Proficiency with Git, Docker, and basic software pipeline setup.
Information is summarized from the supplied job posting. Please verify location eligibility, compensation, contractual terms and current availability on the application page.