Talent.com
Mercor
AI Evaluator - Software ExpertMercor • London, England, United Kingdom
AI Evaluator - Software Expert

AI Evaluator - Software Expert

Mercor • London, England, United Kingdom
30+ days ago
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Software / AI / IT / data Evaluator
Type: Contract
Compensation: $80–$120/hour
Location: Remote

Role Responsibilities

  • Evaluate AI-generated artifacts against domain-specific quality rubrics.
  • Identify factual, aesthetic, and presentation errors in documents, spreadsheets, and slide decks.
  • Provide clear, structured written feedback to improve AI model outputs.
  • Apply deep subject-matter expertise to grade outputs for accuracy and rigor.
  • Work independently and asynchronously to meet deadlines.

Qualifications

Must-Have

  • 5+ years of relevant professional experience in Software / AI / IT / data.
  • Native or professional fluency in English.
  • Highly proficient in Microsoft Office and Google Workspace, especially Slides.

Preferred

  • Advanced degree (Master's or higher) from a reputable institution.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

AI Evaluator - Software Expert • London, England, United Kingdom

Similar jobs

Software Engineer – Autonomous Systems & AI (Equity)

algojobsCity Of London, England, GB
Full-time

A leading defence technology company in London is seeking developers to drive the development of software for autonomous systems.The role involves designing and testing software platforms and user ... Show more

 • Promoted

AI Evaluation Engineer

Gazelle GlobalGreater London, England, GB
Full-time

Location: London (Hybrid – 1 day onsite).We're looking for an AI Evaluation Engineer to help deliver and optimise cutting‑edge Generative AI solutions within a large enterprise environment.Define a... Show more

 • Promoted

Senior Software Engineer – AI-Driven Inspection Platform

PassFortGreater London, England, United Kingdom
Full-time

PassFort in London is seeking a technical specialist to design innovative inspection software.You will work closely with users to understand their needs and develop solutions that integrate AI effe... Show more

 • Promoted

Director, Search & AI Evaluation — Lead AI Quality & Strategy

ElsevierGreater London, England, United Kingdom
Full-time

Elsevier is seeking a Director of Data Science – Search & Evaluation to guide strategic direction, technical vision, and organizational growth of the Search & Evaluation function.You will lead a mu... Show more

 • Promoted

Applied AI Engineer

Trafigura GroupGreater London, England, GB
Full-time

Applied AI Engineer page is loaded## Applied AI Engineerlocations: London, United Kingdomtime type: Full timeposted on: Posted Todayjob requisition id: R-017109**Main Purpose**Trafigura is ... Show more

 • Promoted

Contract AI Software Engineer - eDV (Outside IR35)

SearchabilityGreater London, England, GB
Full-time

AI SOFTWARE ENGINEER – eDV CLEARED.BRAND NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITH A NATIONAL SECURITY SME FOR AN AI SOFTWARE ENGINEER.Contract opportunity for an AI Software Engineer.Mu... Show more

 • Promoted

RL Research Engineer: Safe, Scalable AI Systems

AnthropicGreater London, England, United Kingdom
Full-time

Anthropic is seeking a Research Engineer specializing in Reinforcement Learning to advance large language model capabilities.This role involves collaborative research and engineering, focused on op... Show more

 • Promoted

Frontier AI Security Engineer (Code Agent Evaluator)

ObsidianGreater London, England, United Kingdom
Full-time

Obsidian is seeking experienced security engineers to evaluate frontier AI coding models.The role involves using AI coding agents to identify vulnerabilities in code, ensuring the integrity of mode... Show more

 • Promoted

Applied AI Engineer: Remote AI Systems & Prototyping

Colibri DigitalGreater London, England, GB
Remote
Full-time

Colibri Digital is seeking an Applied AI Engineer to support the design and delivery of AI-powered systems for clients.This role offers the opportunity to work remotely in the UK, contributing to m... Show more

 • Promoted

Applied AI Engineer

NasstarGreater London, England, GB
Permanent

We’re looking for an Applied AI Engineer to support the design and delivery of AI-powered systems for our clients.You’ll work alongside experienced engineers, data scientists and delivery teams to ... Show more

 • Promoted

AI Product Engineer

PelagoGreater London, England, GB
Full-time

Pelago is the leading specialty substance use care provider, built on the belief that effective treatment means matching care intensity to what each member actually needs rather than defaulting to ... Show more

 • Promoted

Staff Software Engineer - AI Inference Systems

ByteSearchGreater London, England, GB
Full-time

ByteSearch in London is seeking a Member of Technical Staff to work on high-performance software for AI inference and scalable systems.You will operate at the intersection of software, systems and ... Show more

 • Promoted

AI Engineer Starter Course (Southwark)

ITonlinelearning RecruitmentSE5, ENG, GB
Full-time

AI Trainee Engineer – £45,000–£75,000 – Job Programme.This is a self-funded programme that leads to employment, fees apply.Complete the programme and get a job, or get... Show more

 • Promoted

AI Engineer

Solve IntelligenceGreater London, England, GB
Full-time

AI - we are building the proprietary algorithms that define the future of Intellectual Property.We have real paying users, massive traction, and a mission to build a billion-dollar company.We are l... Show more

 • Promoted

AI Enablement Engineer | Elevate Developer Experience with AI

ClearBankGreater London, England, GB
Full-time

ClearBank is looking for an AI Enablement Engineer to join the Developer Experience team.The successful candidate will support the responsible use of AI throughout engineering workflows and help te... Show more

 • Promoted

Senior Applied AI Engineer

ForterGreater London, England, GB
Full-time

Forter is looking for a Senior Software Engineer to join the AI Engineering team in a role focused on embedding directly with business teams to drive AI transformation.This role is outward-facing: ... Show more

 • Promoted

AI Research Engineer

PostHog EnterpriseGreater London, England, GB
Full-time

Product development used to mean manually writing code, running analysis, diagnosing bugs, and rolling out changes using dozens of tools.PostHog is the only platform that acts like a co-pilot for y... Show more

 • Promoted

AI/ML Engineer — RLHF & Model Evaluation (Remote)

ProlificGreater London, England, GB
Remote
Full-time

Prolific is looking for an AI & Machine Learning Engineer to join their team in Greater London.This role involves evaluating LLM architectures, auditing ML code, and providing feedback to enhance m... Show more

 • Promoted

AI Integration Engineer in London - Moneysupermarket.com Group PLC

Java Script WorksGreater London, England, GB
Full-time

Experience developing multi-agent systems or autonomous reasoning workflows.Familiarity with front-end tools like.Understanding of responsible AI principles, including model safety and ethical cons... Show more

 • Promoted

Investment Analyst ( Software / AI / Cyber / Defence / Physical Science)

UK Innovation & Science Seed Fund [UKI2S]Greater London, England, GB
Full-time

The UK Innovation & Science Seed Fund (UKI2S) is a £105m government‑backed seed fund managed by Future Planet Capital, investing in early‑stage companies in sectors critical to UK economic growth.W... Show more