Talent.com
Mercor
Analytical Evaluator - AI FeedbackMercor • London, England, United Kingdom
Analytical Evaluator - AI Feedback

Analytical Evaluator - AI Feedback

Mercor • London, England, United Kingdom
20 hours ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Generalist Expert
Type: Contract
Compensation: $70/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs.
  • Provide structured written feedback to improve training data quality and downstream performance.
  • Develop clear, precise, and well-evidenced written rationales that go beyond surface-level observations.
  • Ensure consistent and honest judgment, including critical assessments when warranted.
  • Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

Must-Have

  • Bachelor's degree from a top-500 globally ranked university preferred.
  • Strong analytical and written communication skills.
  • Ability to work independently and follow detailed task guidelines.
  • Strong critical reading skills with the ability to identify nuance, implicit meaning, and gaps in reasoning.
  • Native English fluency required.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

Analytical Evaluator - AI Feedback • London, England, United Kingdom

Similar jobs

Senior Applied AI Engineer

PleoGreater London, England, United Kingdom
Full-time

Messy spend management is tricky business.And tedious processes are a lose-lose situation for all involved, not just finance.We build spend solutions that make managing money seamless, empowering, ... Show more

 • Promoted

Sr Director Analyst - Analytics & AI (Remote EU)

GartnerGreater London, England, United Kingdom
Remote
Full-time

Gartner Analysts are industry thought leaders who create must‑have research, market predictions and best practices for a broad range of world‑leading organizations.A Senior Director possesses a kee... Show more

 • Promoted

Finance AI Research Tech Lead — Senior Member

The-Voleon-GroupGreater London, England, United Kingdom
Full-time

The Voleon Group in London is seeking a Senior Member of Research Staff - Tech Lead, who will lead innovative research in statistical machine learning for financial market predictions.This role inv... Show more

 • Promoted

Senior Applied ML Engineer (Agentic Search)

NebiusGreater London, England, United Kingdom
Full-time

Nebius is leading a new era in cloud infrastructure for the global AI economy.We are building a full‑stack AI cloud platform that supports developers and enterprises from data and model training th... Show more

 • Promoted

Principal AI Quality Engineer

FourthGreater London, England, United Kingdom
Full-time

This is an exciting opportunity to define how a global technology company assures quality in the age of AI.Fourth is seeking an exceptional, strategically minded Principal AI Quality Engineer to dr... Show more

 • Promoted

Remote AI Quality Analyst: Personalization & Evaluation

TuringGreater London, England, GB
Remote
Full-time

A leading AI research company in Greater London is seeking an AI Quality Analyst to evaluate and enhance the personalization quality of AI models.In this role, you will create prompts based on pers... Show more

 • Promoted

Senior AI Engineer

Acrotrend - A NowVertical CompanyGreater London, England, United Kingdom
Full-time

Architect and lead the implementation of multi‑agent systems using Google AI SDKs (Vertex AI Agent Builder), LangGraph, CrewAI, and other emerging orchestration frameworks.Design and build stateful... Show more

 • Promoted

LLM Agent Research Lead - Foundational AI

Thomson ReutersGreater London, England, United Kingdom
Full-time

A leading research and technology firm is seeking a Research Scientist Manager to lead a global team in advancing AI systems and machine learning research.The ideal candidate will have a PhD, signi... Show more

 • Promoted

Applied AI Engineer London

Model MLGreater London, England, GB
Full-time

Model ML is the AI workflow builder transforming how major financial institutions produce and validate client-ready work.Model ML converts complex, manual processes into fully automated AI systems ... Show more

 • Promoted

Applied AI Engineer

Trafigura GroupGreater London, England, GB
Full-time

Main Purpose Trafigura is undergoing an exciting Digital Transformation, developing innovative AI technologies to change the way we work in Commodities Trading.The Document AI team is a key pillar ... Show more

 • Promoted

AI Search Engagement Lead — Mid-Market (Onsite)

ProfoundGreater London, England, United Kingdom
Full-time

Profound, the marketing platform for the AI era, is seeking an Engagement Manager to guide 45-55 mid-market customers through onboarding, adoption, and ongoing engagement with the Profound platform... Show more

 • Promoted

VP Product & AI Strategy

CheckatradeGreater London, England, United Kingdom
Full-time

Checkatrade is seeking a VP Product to shape the product strategy and execution of one of the UK’s most recognized home services brands.This role involves owning the multi-year product vision and l... Show more

 • Promoted

Applied AI Manager

PLP GroupGreater London, England, United Kingdom
Full-time

Engineering/ Product/ Tech · London · Full-time.At Cardo AI, we've been on a mission since 2018 to make Private Credit and Asset-Based Finance (ABF) markets more accessible and efficient.Today, wit... Show more

 • Promoted

Senior AI Engineer

CapcoGreater London, England, United Kingdom
Permanent

Senior AI Engineer (Principal Consultant).Technology & Engineering | Type: Permanent.Empower the next frontier of AI with Capco.Shape, build, and deliver future-ready generative systems.We’re looki... Show more

 • Promoted

Senior AI Engineer

Chubb Ltd.Greater London, England, United Kingdom
Full-time

Chubb is looking for a Senior AI Engineer to lead the design, development, and deployment of advanced generative AI solutions that improve how we operate across the insurance lifecycle — from under... Show more

 • Promoted

Senior Forward‑Deployed AI Engineer (Finance)

LGBT GreatGreater London, England, United Kingdom
Full-time

PIMCO is seeking a Senior Forward-Deployed AI Engineer to join the Tactical AI Automations team.This role combines deep AI/LLM tooling with strong communication to deploy AI solutions across Portfo... Show more

 • Promoted

Innovation Solutions Architect (AI & Data Integration) - Hybrid

Osborne ClarkeGreater London, England, United Kingdom
Full-time

Osborne Clarke Solutions (OCS) in the UK is seeking an Innovation Solutions Architect to join our growing team either in London or Bristol.You will explore and pilot AI technologies, data integrati... Show more

 • Promoted

Senior FS Data Science & AI Strategy Leader

PA ConsultingGreater London, England, United Kingdom
Full-time

PA Consulting is seeking an experienced professional in Greater London to join their management team.The role involves shaping new data science propositions, leading business development initiative... Show more