Talent.com
Mercor
Information Systems Expert - AI EvaluatorMercor • England, United Kingdom
Information Systems Expert - AI Evaluator

Information Systems Expert - AI Evaluator

Mercor • England, United Kingdom
30+ days ago
Salary
£40.00 hourly
Job type
  • Full-time
Job description
About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark , General Catalyst , Peter Thiel , Adam D'Angelo , Larry Summers , and Jack Dorsey . Position: AI Model Evaluation Specialist Type: Contract Compensation: $40–$60/hour Commitment: 20 hours/week Role Responsibilities Write realistic prompts reflecting how professionals and consumers seek domain-specific guidance. Evaluate AI-generated responses for factual accuracy, regulatory or clinical correctness, and practical usefulness. Identify fabricated claims, incorrect references, or misleading reasoning across model outputs. Score and rank multiple model responses using structured rubrics across dimensions. Provide written justifications with specific evidence for each evaluation. Qualifications Must-Have Master’s degree or higher in Computer Science , Information Systems , or a relevant professional field. Professional experience applying domain expertise in a practitioner or advisory capacity. Familiarity with industry-specific standards, regulations, or clinical guidelines. Strong written communication and critical reasoning skills. Application Process (Takes 20–30 mins to complete) Submit your resume to begin. Complete the Model Response Evaluation assessment. Resources & Support For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome/welcome For any help or support, reach out to: support@mercor.com PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.
Create a job alert for this search

Information Systems Expert - AI Evaluator • England, United Kingdom

Similar jobs

Senior AI Engineer, IT Solutions — Innovator

Celestica Inc.England, GB
Full-time

Senior AI Engineer to lead AI and Machine Learning projects.Responsibilities include documentation of AI requirements, collaboration with data engineers, and implementation of MLOps practices.Candi... Show more

 • Promoted

Principal Applied Scientist — AI Platform & Strategy Lead

ASOSEngland, United Kingdom
Full-time

ASOS is seeking a Principal Applied Scientist to shape and scale Applied Science across the business.You will lead cross-functional teams, set technical direction and oversee federated governance t... Show more

 • Promoted

AI & Systems Architect Associate Director

PrimisEngland, GB
Full-time +1

AI Systems Architect – Agentic & Applied AI (Associate Director).Data & AI specialist consultancy.This role sits at the intersection of hands‑on architecture, client engagement, and internal capabi... Show more

 • Promoted

Physicist for AI Training & Evaluation — Remote

SME CareersEngland, GB
Remote
Full-time

A leading AI development provider is seeking physicists to enhance AI training by reviewing responses and providing expert feedback.The role is fully remote, offering flexible hours, and you will a... Show more

 • Promoted

Lead Architect, AI Data Center Solutions

Vantage Data CentersEngland, GB
Full-time

A leading technology infrastructure provider in the UK is seeking a Senior Manager Solutions Engineering.This role involves leading the design and execution of advanced technical solutions for hype... Show more

 • Promoted

AI Engineer – Agentic & Generative AI Specialist

CognizantEngland, GB
Full-time

AI Engineer – Agentic & Generative AI Specialist.We are seeking an experienced AI Engineer who specialises in delivering end-to-end AI solutions using Agentic AI frameworks and Generative AI techno... Show more

 • Promoted

RLHF AI Researcher: Generative Models & LLMs

microTECH Global LTDEngland, GB
Full-time

A leading tech consultancy is seeking an AI Researcher to develop and refine algorithms for generative models.Candidates should have a PhD in Computer Science or a related field and deep expertise ... Show more

 • Promoted

Lead AI Solutions Engineer

DeepRec.aiEngland, GB
Full-time

Principal Recruitment Consultant | ML & R&D Talent | Supporting Startups & Enterprises Across Europe and US.I am working with a high growth AI company that is building and delivering production gra... Show more

 • Promoted

Senior ML Engineer – Real-World Vision Systems

IC ResourcesEngland, GB
Full-time

IC Resources is seeking a machine learning and/or computer vision engineer to join their innovative team in the UK.This role offers the opportunity to make a significant impact by developing cuttin... Show more

 • Promoted

IT Systems Analyst

Pursuit Resources GroupEngland, GB
Full-time

Pursuit Resources Group provided pay range.This range is provided by Pursuit Resources Group.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.We ... Show more

 • Promoted

Technology Leader: Data, AI & ERP Strategy

Finisterre UK LimitedEngland, GB
Full-time

Finisterre is seeking a high‑impact Head of Technology to own the technology strategy and roadmap for a multi‑channel, purpose‑led brand.You will oversee ERP (NetSuite), Shopify, data governance an... Show more

 • Promoted

Senior Director, Data Platforms & AI Strategy

Forsyth BarnesEngland, GB
Full-time

A global technology company is seeking a Senior Director of Product Management to lead internal data strategies and oversee a team of over 15 Product Managers.This role focuses on creating a secure... Show more

 • Promoted

Forward Deployed AI Solutions Engineer (Remote UK)

PropelEngland, GB
Remote
Full-time

A fast-scaling AI SaaS company is looking for a Forward Deployed Engineer to work closely with enterprise clients in the UK.In this role, you'll engage directly with customers to design and deliver... Show more

 • Promoted

Data & Product Analyst | AI Tools & Data Quality

StotlesEngland, GB
Full-time

A leading public sector technology company in the UK is seeking a Data Analyst to enhance their data operations.You will manage processes for data cleaning and enrichment while collaborating closel... Show more

 • Promoted

Clinical Systems Analyst: EPR & Healthcare Transformation

SmartCo Future HealthEngland, GB
Full-time

A leading health consultancy in the UK is seeking a Clinical Systems Business Analyst to support the delivery of Electronic Patient Record solutions.The role involves eliciting and documenting busi... Show more

 • Promoted

Senior Systems Engineer for AI Accelerator Hardware

FractileEngland, GB
Full-time

A cutting-edge AI technology company in the UK is seeking a Senior Systems Software Engineer to develop innovative systems software for their AI accelerators.This role involves creating software fo... Show more

 • Promoted

AI Solutions Specialist (£100K)

Ingenio GlobalEngland, GB
Full-time

This range is provided by Ingenio Global.Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Direct message the job poster from Ingenio Global.The A... Show more

 • Promoted

AI-Enhanced Qualitative Insights Analyst

Connect2LutonEngland, GB
Full-time

Connect2Luton is seeking a qualitative data analyst to review resident survey responses, engagement outputs, and project documentation.You will help embed community insight into strategic decision ... Show more

 • Promoted

Director of AI Research & Innovation

Oho Group LtdEngland, GB
Full-time

A high-growth start-up in London is looking for a Head of AI Research to drive the technical vision and guide a talented team in redefining intelligent systems.Required qualifications include an MS... Show more

 • Promoted

Senior Data Science and Machine Learning Researcher

Searchability NS&DEngland, GB
Full-time

Senior Data Science and Machine Learning Researcher.A highly specialised research role within a secure, mission‑focused National Security environment.You will deliver innovative data science and ma... Show more