- Full-time
Overview
Are you passionate about languages writing and quality evaluation We are launching an exciting language evaluation project and are looking for English-speaking experts to join our team.
What you will do:
Identify realistic search-related failures where an AI model provides inadequate responses. Create search queries test them document what went wrong and write instructions and evaluation criteria for correct answers.
Common issues: local relevance source quality outdated information language mismatches incomplete answers and region-specific inapplicability. Testing multiple queries before finding failures is expected.
Project Details:
- Start Date: ASAP
- Duration: Ongoing Project.
- Commitment: 20 hours per week.
- Job Type: Freelance contract.
- Location: Remote UK.
- Rate: $38 per hour.
Requirements:
- Research skills ability to find and verify information from multiple sources; comfort navigating different websites databases and documentation - Critical thinking Can spot contradictions between sources identify outdated information and recognize when something doesnt apply to a specific locale/context - Attention to detail Can catch nuances in language local variations (prices regulations requirements) and edge cases - Problem-solving mindset Comfortable iterating and testing when things dont work; doesnt get frustrated by trial- and-error - Domain knowledge Ideally someone with background in research quality assurance compliance or similar work that requires precision and source verification - Writing clarity Can articulate instructions and rubrics clearly so others understand the logic behind their reasoning - Locale knowledge Deep familiarity with their specific locale (local regulations business practices cultural nuances) is valuable for spotting region-specific failures
Employment Type : Full Time
Experience: years
Vacancy: 1