Talent.com
Mercor
Systems Engineer AI Model EvaluatorMercor • London, England, UK
Systems Engineer AI Model Evaluator

Systems Engineer AI Model Evaluator

Mercor • London, England, UK
30+ days ago
Job type
  • Full-time
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: Systems Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote

Role Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex engineering tasks.
  • Review model-generated code architecture decisions and systems implementations.
  • Identify bugs edge cases performance bottlenecks and failure modes.
  • Compare outputs from multiple frontier models and assess their strengths and weaknesses.
  • Apply professional engineering judgment to realistic systems engineering scenarios.
  • Work independently and asynchronously to meet deadlines while improving AI model performance.

Qualifications

Must-Have

  • 2 years of professional systems engineering experience.
  • Experience with distributed systems networking operating systems storage systems infrastructure software or database internals.
  • Regular use of AI coding agents such as Cursor Claude Code Codex Windsurf Gemini CLI or similar tools.
  • Ability to evaluate model-generated systems designs and implementations.

Preferred

  • Experience building highly scalable and performance-critical systems.

Compensation & Legal

  • $400 per accepted task
  • Compensation is tied to accepted work.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


Employment Type : Full Time
Experience: years
Vacancy: 1
Create a job alert for this search

Systems Engineer AI Model Evaluator • London, England, UK

Similar jobs

Applied AI Engineer - Agentic Systems - Senior Associate

J.P. MorganCity Of London, England, GB
Full-time

Join us to shape the future of AI-driven business operations.You will have the opportunity to create scalable, safe, and reliable agentic solutions that transform how we work.We value your expertis... Show more

 • Promoted

Applied ML Engineer: LLM Evaluation & MLOps Specialist

OmazeGreater London, England, GB
Full-time

Omaze is seeking an Applied Machine Learning Engineer to join the Developer Publications Intelligence team.You will work with passionate engineers to build and integrate ML models into tools produc... Show more

 • Promoted

ML Projects Engineer: AI-Driven Banking Systems

Starling Bank LimitedGreater London, England, GB
Full-time

A leading digital bank in Greater London seeks a skilled software engineer to join their ML Projects team.In this role, you will design, implement, and maintain machine learning features, working c... Show more

 • Promoted

AI Evaluation Engineer

Gazelle GlobalGreater London, England, GB
Full-time

Location: London (Hybrid – 1 day onsite).We're looking for an AI Evaluation Engineer to help deliver and optimise cutting‑edge Generative AI solutions within a large enterprise environment.Define a... Show more

 • Promoted

Machine Learning Engineer - AI Models & Systems

Global OneGreater London, England, GB
Full-time

A leading AI technology company in Greater London is seeking a talented Machine Learning Engineer to develop and implement cutting-edge artificial intelligence products.The role requires designing ... Show more

 • Promoted

AI Systems Optimisation Engineer — Boost Data Center Performance

Stars ArenaGreater London, England, GB
Full-time

Stars Arena is looking for a Systems Optimisation Engineer based in Greater London.This role involves developing software for test automation, particularly using Python or C++.Candidates should als... Show more

 • Promoted

AI‑Driven Systems Engineer (Mid Level)

LegaticsGreater London, England, GB
Full-time

Legatics is looking for an Engineer to build and maintain features across their LegalTech platform.The ideal candidate will blend strong software engineering skills with a product-focused mindset a... Show more

 • Promoted

AI Systems Engineer for Clinical Trials

DelfaGreater London, England, GB
Full-time

A healthcare technology startup in London is looking for a full-stack engineer to design and build AI systems for clinical trials.The ideal candidate has over 3 years of engineering experience and ... Show more

 • Promoted

Senior AI/ML Research Engineer: Production-Scale Systems

AirswiftCity Of London, England, GB
Full-time

Airswift is seeking a Senior AI/ML Research Engineer in London to join their Data & AI team.This role focuses on designing and deploying large-scale machine learning systems and developing high-qua... Show more

 • Promoted

AI Research Engineer: Build Practical ML Systems

MediaTekGreater London, England, GB
Full-time

A global technology company is seeking a Research Engineer focused on advancing AI through practical systems.Responsibilities include implementing machine learning algorithms, building prototypes, ... Show more

 • Promoted

AI Component Modelling Engineer (Remote)

Circuit MindGreater London, England, GB
Remote
Full-time

Circuit Mind is seeking a Circuit Design Engineer (AI) to join our Library Team on a mission to build a database of electronic components.The role involves creating high-quality models using advanc... Show more

 • Promoted

AI Engineer: ML Infra & Production Systems

DRWCity Of London, England, GB
Full-time

A diversified trading firm in London is seeking an AI Engineer to develop and maintain AI-driven applications and infrastructure.You will collaborate with experts to enhance productivity using mach... Show more

 • Promoted

Applied AI Engineer: Remote AI Systems & Prototyping

Colibri DigitalGreater London, England, GB
Remote
Full-time

Colibri Digital is seeking an Applied AI Engineer to support the design and delivery of AI-powered systems for clients.This role offers the opportunity to work remotely in the UK, contributing to m... Show more

 • Promoted

Applied AI Engineer - Agentic Systems - Senior Associate

TwinThreadGreater London, England, GB
Full-time

Join us to shape the future of AI-driven business operations.You will have the opportunity to create scalable, safe, and reliable agentic solutions that transform how we work.We value your expertis... Show more

 • Promoted

Senior ML Systems Engineer — Frontier AI for Biotech

Basecamp ResearchGreater London, England, GB
Full-time

Basecamp Research is hiring a Senior Research Engineer to enhance AI research technologies at our London office.You will be pivotal in developing distributed training systems and optimizing data ha... Show more

 • Promoted

Research Engineer, AI for Bio-Analysis & LLM Systems

Hlx Life SciencesGreater London, England, GB
Full-time

Hlx Life Sciences, located in Greater London, is seeking a Research Engineer to oversee the research function.You will transform product feedback into actionable research, collaborating closely wit... Show more

 • Promoted

AI Systems Engineer for Enterprise Platform

OpenAIGreater London, England, GB
Full-time

OpenAI is seeking a Software Engineer for the Codex Enterprise team in London.You will help develop Codex into a robust tool for organizations, enhancing its capabilities and usability at scale.Thi... Show more

 • Promoted

ML Projects Engineer: AI-Driven Banking Systems

Starling BankGreater London, England, GB
Full-time

A leading digital bank in the UK is seeking a skilled software engineer to join their ML Projects team.This role involves designing and implementing machine learning features that enhance their ban... Show more

 • Promoted

Rust Systems Engineer — AI Inference (Greenfield, Hybrid)

FractileGreater London, England, GB
Full-time

Fractile, based in the United Kingdom, is looking to build a team of Rust engineers for creating greenfield software to enhance AI inference technology.The role invites candidates with strong progr... Show more

 • Promoted

AI/ML Engineer — RLHF & Model Evaluation (Remote)

ProlificGreater London, England, GB
Remote
Full-time

Prolific is looking for an AI & Machine Learning Engineer to join their team in Greater London.This role involves evaluating LLM architectures, auditing ML code, and providing feedback to enhance m... Show more