Senior Software Engineer – LLM Evaluation & Repository Validation

Senior Software Engineer – LLM Evaluation & Repository Validation

Job type: Contractor assignment (no medical/paid leave)

This listing is for Senior Software Engineer – LLM Evaluation & Repository Validation.

Day-to-day

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluating unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collabo

Bonus

• Previous participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Pay

• Start: as next week
• Commitment required: 20 hours per week with some overlap with PST
• Contractor assignment (no medical/paid leave)