Senior Software Engineer - AI Evaluation / Coding Agents ($100-150/hr)
Explore this software engineering opportunity. The information below summarizes the supplied role details; check the application page for the latest requirements and availability.
Role highlights & qualifications
- Software development
- PythonTypescriptJavaScriptGoJavaGitHubCI/CDOpen SourceLLMCode ReviewsCode Analysis
- Freelance · Remote · North America (only)
- Compensation: 150/hour, please provide a specific hourly rate expectation
- Availability: 20-40 hours/week, with at least 6 hours of Pacific Time overlap/day
- Type: Independent contractor
- Location: North America (Only)
- We’re looking for experienced, hands-on software engineers to help evaluate and improve AI coding models.
- Rather than primarily building production applications, you’ll work with coding agents across real-world repositories and assess the quality of their work. You’ll review generated code and agent behavior, determine whether solutions are technically correct, identify failure modes, and create the evaluation signals and feedback used to improve model performance.
- Think of the coding agent as another engineer whose work you’re reviewing: Can it understand the task? Did it choose the right approach? Is the resulting code correct, robust, and maintainable? Can you explain precisely where it succeeded or failed?
Information is summarized from the supplied job posting. Please verify location eligibility, compensation, contractual terms and current availability on the application page.