Senior Software Engineer – Python (LLM Evaluation & Repository Validation)

Senior Software Engineer – Python (LLM Evaluation & Repository Validation)

Job type: Contractor assignment (no medical/paid leave)

About the projects: we are building LLM evaluation and training datasets to train LLM to work on realistic software engineering problems. You’ll be at the forefront of evaluating how LLMs interact with real code, influencing the future of AI-assisted software development.

Day-to-day

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluating unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collabo

Bonus

• Previous participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Pay

• Start: is next week]
• Contractor assignment (no medical/paid leave)