Talent.com
Mercor
DevOps Engineer AI Model EvaluatorMercor • London, England, UK
DevOps Engineer AI Model Evaluator

DevOps Engineer AI Model Evaluator

Mercor • London, England, UK
30+ days ago
Job type
  • Full-time
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote

Role Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
  • Review model-generated implementations involving cloud platforms Kubernetes CI/CD systems and infrastructure automation.
  • Identify bugs edge cases reliability issues and failure modes in model outputs.
  • Compare outputs from multiple frontier models to assess strengths and weaknesses.
  • Apply professional engineering judgment to realistic infrastructure engineering scenarios.

Qualifications

Must-Have

  • 2 years of professional DevOps SRE or Cloud Engineering experience.
  • Experience with AWS Azure GCP Kubernetes Terraform CI/CD pipelines or observability tooling.
  • Regular use of AI coding agents like Cursor Claude Code Codex Windsurf Gemini CLI or similar tools.
  • Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Preferred

  • Experience supporting production-scale systems.

Compensation & Legal

  • $400 per accepted task.
  • Compensation is tied to accepted work.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


Employment Type : Full Time
Experience: years
Vacancy: 1
Create a job alert for this search

DevOps Engineer AI Model Evaluator • London, England, UK

Similar jobs

Senior Dev/MLOps Engineer: AI Infra, CI/CD, Equity

ThehumanoidGreater London, England, GB
Full-time

Thehumanoid is hiring a Senior Dev/MLOps Engineer to join their Data & Compute Platform team in London.This role involves managing the lifecycle of ML models and infrastructure, building CI/CD pipe... Show more

 • Promoted

Lead DevOps Engineer – AI-Driven Infra & Kubernetes

Test Triangle LtdGreater London, England, GB
Full-time

Test Triangle Ltd is seeking a skilled DevOps Engineer to lead the design and build-out of a new managed container environment.The ideal candidate will manage existing VM-based infrastructure and h... Show more

 • Promoted

Senior DevOps Engineer — Hybrid AI/Cloud Pipelines

DatatonicGreater London, England, GB
Full-time

Datatonic in Greater London is seeking a skilled Senior DevOps Engineer to join their innovative team.In this role, you will establish and enhance DevOps practices, design robust pipelines, and pro... Show more

 • Promoted

ML DevOps Engineer

TalentedgeGreater London, England, GB
Full-time

An established quantitative technology firm is seeking an experienced ML DevOps Engineer to build and scale the machine learning infrastructure that powers advanced research and production trading ... Show more

 • Promoted

Forward-Deployed AI Solutions Engineer

SalesforceGreater London, England, GB
Full-time

Salesforce is seeking Forward Deployed Engineers to design, build, and deploy agentic AI solutions inside customer environments.You will partner with a Deployment Strategist to shape AI strategy an... Show more

 • Promoted

AI Evaluation Engineer

Gazelle GlobalGreater London, England, GB
Full-time

Location: London (Hybrid – 1 day onsite).We're looking for an AI Evaluation Engineer to help deliver and optimise cutting‑edge Generative AI solutions within a large enterprise environment.Define a... Show more

 • Promoted

ML Data Pipelines & Evaluation Engineer

IsidorGreater London, England, GB
Full-time

Isidor is seeking a Forward Deployed Engineer to work closely with AI labs in London.In this role, you'll design critical data workflows and systems, translating research needs into technical solut... Show more

 • Promoted

AI Platform & DevOps Engineer | AWS, Kubernetes

DGH Recruitment LtdCity Of London, England, GB
Full-time

We are partnering with a leading organisation on a high-profile AI initiative and are seeking an experienced MLOps / Platform Engineer to build and scale infrastructure supporting advanced AI solut... Show more

 • Promoted

Remote SaaS Implementation Engineer (AI Integrations)

DigitalGeniusGreater London, England, GB
Remote
Full-time

DigitalGenius, located in the UK, seeks an Implementation Engineer to lead the integration of AI-powered solutions for clients.Responsibilities include building automation flows, integrating system... Show more

 • Promoted

Senior MLOps Engineer: AWS AI Platform (On-site London)

Talenzon groupGreater London, England, United Kingdom
Temporary

Talenzon group is seeking a Senior MLOps Engineer to join our London-based on-site team for a 6-month contract.You will design and implement an enterprise MLOps platform on AWS, deploy production-r... Show more

 • Promoted

Senior DevOps Engineer – AI/ML Infra (Hybrid + Remote)

Tripledot StudiosGreater London, England, GB
Remote
Full-time

Tripledot Studios, based in Greater London, is seeking an experienced Platform Engineer to enhance their AI/ML infrastructure.You will play a key role in building and maintaining a high-performance... Show more

 • Promoted

DevOps Engineer (AI Inference)

GcoreGreater London, England, GB
Full-time

This position is available only under an employment (labor) agreement.The world’s digital experiences run on something invisible: the infrastructure and software that keep them fast, reliable, and ... Show more

 • Promoted

AI Solutions & DevOps Engineer — Cloud & ML Pipelines

DigiterreGreater London, England, GB
Full-time

Digiterre is seeking an AI Solutions & DevOps Engineer in London to provide real-time software and data engineering solutions.The ideal candidate has experience with AI frameworks like TensorFlow a... Show more

 • Promoted

AI Infra & MLOps Engineer

graphcoreGreater London, England, GB
Full-time

Graphcore in the United Kingdom is seeking a Software Infrastructure engineer to scale and manage our infrastructure.You will build essential tools and services that empower our software teams and ... Show more

 • Promoted

AI Component Modelling Engineer (Remote)

Circuit MindGreater London, England, GB
Remote
Full-time

Circuit Mind is seeking a Circuit Design Engineer (AI) to join our Library Team on a mission to build a database of electronic components.The role involves creating high-quality models using advanc... Show more

 • Promoted

Impactful AI Deployment Engineer

BeamGreater London, England, GB
Full-time

Beam, a forward-thinking social-impact tech company based in the UK, is seeking a Forward Deployed Engineer to lead AI-powered template deployment across real-world frontline settings.You will coll... Show more

 • Promoted

Frontier AI Security Engineer (Code Agent Evaluator)

ObsidianGreater London, England, United Kingdom
Full-time

Obsidian is seeking experienced security engineers to evaluate frontier AI coding models.The role involves using AI coding agents to identify vulnerabilities in code, ensuring the integrity of mode... Show more

 • Promoted

Onsite AI Deployment Engineer (Metals)

Foresight Data Machines LtdGreater London, England, GB
Full-time

A technology firm in the metals industry is seeking a Forward Deployed Engineer.This role involves on-site customer engagement to identify problems and design solutions across the tech stack.Candid... Show more

 • Promoted

DevOps Engineer – AI/ML Infra Architect & Builder

Diffractive LabsGreater London, England, GB
Full-time

Diffractive Labs in London is looking for a DevOps Engineer to build and manage cloud infrastructure for their AI-driven materials discovery platform.You will work closely with top researchers and ... Show more

 • Promoted

AI/ML Engineer — RLHF & Model Evaluation (Remote)

ProlificGreater London, England, GB
Remote
Full-time

Prolific is looking for an AI & Machine Learning Engineer to join their team in Greater London.This role involves evaluating LLM architectures, auditing ML code, and providing feedback to enhance m... Show more