Talent.com
Mercor
Bilingual Language Model EvaluatorMercor • London, England, United Kingdom
Bilingual Language Model Evaluator

Bilingual Language Model Evaluator

Mercor • London, England, United Kingdom
5 hours ago
Salary
£15.00–£20.00 hourly
Job type
  • Part-time
  • Remote
  • Quick Apply
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: Generalist - English & Urdu
Type: Contract
Compensation: $15–$20/hour
Location: Remote

Role Responsibilities

  • Conduct fact-checking using trusted public sources and external tools.
  • Generate high-quality human evaluation data by identifying response strengths, areas for improvement, and factual inaccuracies.
  • Assess reasoning quality, clarity, tone, and completeness of responses.
  • Ensure model responses align with expected conversational behavior and system guidelines.
  • Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

Must-Have

  • Bachelor's degree.
  • Native speaker in Urdu.
  • Significant experience using large language models (LLMs).
  • Excellent writing skills in English.
  • Strong attention to detail.
  • Background or experience in domains requiring structured analytical thinking.

Preferred

  • Prior experience with RLHF, model evaluation, or data annotation work.
  • Experience writing or editing high-quality written content.
  • Experience comparing multiple outputs and making fine-grained qualitative judgments.

Application Process (Takes 20–30 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcome
  • For any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

Create a job alert for this search

Bilingual Language Model Evaluator • London, England, United Kingdom

Similar jobs

Lead ML Engineer, Search & Recommendation (London)

JD.comGreater London, England, United Kingdom
Full-time

Machine Learning Team Lead in London to guide a group of algorithm engineers focused on search and recommendation systems.The role blends hands-on ML work with strategic leadership to improve perso... Show more

 • Promoted

Lead ML Engineer: Search & Recommendation (London)

JD.COM INTERNATIONAL UK LTDGreater London, England, United Kingdom
Full-time

COM INTERNATIONAL UK LTD in London seeks a Machine Learning Team Lead to guide a team of algorithm engineers focused on search and recommendation systems.You will drive design, deployment, and opti... Show more

 • Promoted

Machine Learning Engineer

MazeGreater London, England, United Kingdom
Full-time

As ML Engineer at Maze, you'll be the technical leader driving our machine learning infrastructure from experimentation to production, ensuring our AI-powered cybersecurity solutions deliver measur... Show more

 • Promoted

Principal Machine Learning Engineer, Matching and Recommendations (UK Based)

BumbleGreater London, England, United Kingdom
Full-time

Define and lead the technical strategy for AI and Machine Learning systems that power recommendations, ranking, and personalization across Bumble products, delivering measurable improvements in use... Show more

 • Promoted

Staff Machine Learning Engineer (Gaia)

WayveGreater London, England, United Kingdom
Full-time

Gaia is Wayve’s video world model: trained on large-scale driving video, it predicts future frames from past context—functioning as a simulator that helps generate synthetic scenarios, including ra... Show more

 • Promoted

Remote Staff ML Efficiency Engineer — Scale & Optimize

Reddit, Inc.Greater London, England, United Kingdom
Remote
Full-time

ML platform engineer to design and optimize scalable ML training, inference, and serving systems.You will build tooling, profiling, and benchmarking capabilities to improve developer productivity a... Show more

 • Promoted

Senior ML Engineer — Remote/Hybrid with Impact at Scale

Wey Wey WebGreater London, England, United Kingdom
Remote
Full-time

Prima is seeking a Senior Machine Learning Engineer to help shape the future of motor insurance.You will lead ML lifecycle practices, influence technology choices, and ensure production readiness o... Show more

 • Promoted

Senior ML Engineer

TechTreeGreater London, England, United Kingdom
Full-time

Our client is seeking a Senior ML Engineer to lead the research, development, and deployment of their novel foundation model.This role involves defining the technical strategy and optimizing perfor... Show more

 • Promoted

Applied AI ML Lead Engineer- (NLP/LLM/Graph)

J.P. MORGANGreater London, England, United Kingdom
Full-time

NLP / LLM Scientist - Applied AI ML Lead - Machine Learning Centre of Excellence.The Machine Learning Center of Excellence invites the successful candidate to apply sophisticated machine learning m... Show more

 • Promoted

Senior AI/ML Engineer

Argus MediaGreater London, England, United Kingdom
Full-time

Great AI and machine learning capability only creates value once it runs reliably in the real world.This role exists to bridge that final, critical gap—taking the AI/ML solutions developed within o... Show more

 • Promoted

Risk ML Lead Engineer (Remote)

WayfindiGreater London, England, United Kingdom
Remote
Full-time

Cleo is seeking a Lead Machine Learning Engineer for Risk Decisioning to drive production ML models and guide a team of ML engineers and data scientists.You will own the ML roadmap, influence produ... Show more

 • Promoted

Staff Machine Learning Engineer

Neura MarketGreater London, England, United Kingdom
Full-time

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin... Show more

 • Promoted

Staff Machine Learning Engineer (TLM) (Driver Understanding and Evaluation)

WaymoGreater London, England, United Kingdom
Full-time

Waymo is an autonomous driving technology company with the mission to be the world's most trusted driver.Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on buildin... Show more

 • Promoted

Research Engineer, ML Infrastructure for RL Systems

Anthropic LimitedGreater London, England, United Kingdom
Full-time

Anthropic is seeking a Research Engineer, Machine Learning (RL Velocity) in London to own and improve the RL training infrastructure used by researchers day-to-day.You will work on core platform co... Show more

 • Promoted

Senior ML Engineer - Production AI Systems (Remote)

McGregor BoyallGreater London, England, United Kingdom
Remote
Full-time

McGregor Boyall is seeking a Senior Machine Learning Engineer for a fully remote, Europe-wide role.You will design, build and deploy production ML systems, owning the full ML lifecycle from data pr... Show more

 • Promoted

Senior AI Platform Engineer – LLM Inference Backend

JPMorgan Chase & Co.Greater London, England, United Kingdom
Full-time

Software Engineer III in London to build backend services for LLM inference and scalable production systems.You will work on routing, batching, scheduling, streaming responses, and quota management... Show more

 • Promoted

Research Engineer, Machine Learning (Reinforcement Learning)

AnthropicGreater London, England, United Kingdom
Full-time

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems that are safe and beneficial for users and society.As a Research Engineer within Reinforcement Learning, you will ... Show more

 • Promoted

Senior ML Engineer — Safety Evaluation & Synthetic Data

Grid Dynamicslondon, england, United Kingdom
Full-time

Grid Dynamics is looking for a highly skilled Senior Machine Learning Engineer to join our team in London.In this pivotal role, you will develop and scale synthetic data generation to support AI sa... Show more