← Back to Gigs

Senior Python Developer

Code Evaluation
Apply Now β†’

Description

Senior Python Developer

Job type: Contractor assignment (no medical/paid leave)

Please note that this role does not involve building or fine-tuning LLMs. For RLHF data generation, you may need to create a prompt yourself or use one provided by the customer, ask the model questions, and evaluate the outputs generated by two versions of the LLM.

Day-to-day

  • Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models.
  • Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
  • Familiarity with Python frameworks and libraries
  • Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
  • Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
  • Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets.
  • Collabo

You bring

  • 3+ years of strong experience with Python programming language.
  • Industry experience and knowledge of code quality, formatting, and best practices of software development
  • Experience with Python’s testing ecosystem, including unit, integration, and property-based testing.
  • Knowledge of multi-threading and asynchronous programming in Python.
  • Ability to work with architectural patterns and refactor code without introducing regressions.
  • Strong debugging skills, including fixing memory and concurrency issues.
  • Fluent in conversational and written English communication skills

Pay

  • Contractor assignment (no medical/paid leave)

Details

Category

Code Evaluation

Location

Remote

Employment Type

Independent Contractor

Skills

Python

Posted

4/13/2026

Interested? Apply directly.

Apply Now β†’

Never miss a high-paying gig

Get instant alerts when new AI training opportunities are posted. Choose your ca...

Pay Data

How Much Do AI Jobs Pay?

β†’
Guide

How to Get Started

β†’