β Back to Gigs
Description
Senior Python Developer
Job type: Contractor assignment (no medical/paid leave)
Please note that this role does not involve building or fine-tuning LLMs. For RLHF data generation, you may need to create a prompt yourself or use one provided by the customer, ask the model questions, and evaluate the outputs generated by two versions of the LLM.
Day-to-day
- Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models.
- Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
- Familiarity with Python frameworks and libraries
- Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
- Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
- Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets.
- Collabo
You bring
- 3+ years of strong experience with Python programming language.
- Industry experience and knowledge of code quality, formatting, and best practices of software development
- Experience with Pythonβs testing ecosystem, including unit, integration, and property-based testing.
- Knowledge of multi-threading and asynchronous programming in Python.
- Ability to work with architectural patterns and refactor code without introducing regressions.
- Strong debugging skills, including fixing memory and concurrency issues.
- Fluent in conversational and written English communication skills
Pay
- Contractor assignment (no medical/paid leave)
Details
Category
Code Evaluation
Location
Remote
Employment Type
Independent Contractor
Skills
Python
Posted
4/13/2026
Interested? Apply directly.
Apply Now βRelated Opportunities
Pay Data
βHow Much Do AI Jobs Pay?
Guide
βHow to Get Started