Talent.com
Mercor
DevOps Engineer AI Model EvaluatorMercor • London, England, UK
DevOps Engineer AI Model Evaluator

DevOps Engineer AI Model Evaluator

Mercor • London, England, UK
30+ days ago
Job type
  • Full-time
Job description

About the job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco our investors include Benchmark General Catalyst Peter Thiel Adam DAngelo Larry Summers and Jack Dorsey.

Position: DevOps / SRE / Cloud Engineer (Coding Agent Experience)
Type: Contract
Compensation: $85/hour
Location: Remote

Role Responsibilities

  • Use frontier AI coding agents to complete and evaluate complex infrastructure engineering tasks.
  • Review model-generated implementations involving cloud platforms Kubernetes CI/CD systems and infrastructure automation.
  • Identify bugs edge cases reliability issues and failure modes in model outputs.
  • Compare outputs from multiple frontier models to assess strengths and weaknesses.
  • Apply professional engineering judgment to realistic infrastructure engineering scenarios.

Qualifications

Must-Have

  • 2 years of professional DevOps SRE or Cloud Engineering experience.
  • Experience with AWS Azure GCP Kubernetes Terraform CI/CD pipelines or observability tooling.
  • Regular use of AI coding agents like Cursor Claude Code Codex Windsurf Gemini CLI or similar tools.
  • Ability to evaluate model-generated infrastructure and reliability engineering solutions.

Preferred

  • Experience supporting production-scale systems.

Compensation & Legal

  • $400 per accepted task.
  • Compensation is tied to accepted work.

Application Process (Takes 2030 mins to complete)

  • Upload resume
  • AI interview based on your resume
  • Submit form

Resources & Support

  • For details about the interview process and platform information please check:
  • For any help or support reach out to:

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.


Employment Type : Full Time
Experience: years
Vacancy: 1
Create a job alert for this search

DevOps Engineer AI Model Evaluator • London, England, UK

Similar jobs

Senior Dev/MLOps Engineer: AI Infra, CI/CD, Equity

ThehumanoidGreater London, England, GB
Full-time

Thehumanoid is hiring a Senior Dev/MLOps Engineer to join their Data & Compute Platform team in London.This role involves managing the lifecycle of ML models and infrastructure, building CI/CD pipe... Show more

 • Promoted

Applied ML Engineer: LLM Evaluation & MLOps Specialist

OmazeGreater London, England, GB
Full-time

Omaze is seeking an Applied Machine Learning Engineer to join the Developer Publications Intelligence team.You will work with passionate engineers to build and integrate ML models into tools produc... Show more

 • Promoted

Lead DevOps Engineer – AI-Driven Infra & Kubernetes

Test Triangle LtdGreater London, England, GB
Full-time

Test Triangle Ltd is seeking a skilled DevOps Engineer to lead the design and build-out of a new managed container environment.The ideal candidate will manage existing VM-based infrastructure and h... Show more

 • Promoted

Generative AI ML Engineer for Next-Gen Dating Apps

BumbleGreater London, England, United Kingdom
Full-time

Join our team at Bumble, where we’re revolutionizing online dating through innovative AI-driven experiences.We’re seeking machine learning engineers to spearhead the development of next-generation ... Show more

 • Promoted

ML DevOps Engineer

TalentedgeGreater London, England, GB
Full-time

An established quantitative technology firm is seeking an experienced ML DevOps Engineer to build and scale the machine learning infrastructure that powers advanced research and production trading ... Show more

 • Promoted

Senior DevOps Engineer: Cloud, Kubernetes & AI Platform

SBSGreater London, England, GB
Full-time

SBS is seeking a DevOps Engineer to operate across both cloud and on‑prem environments, supporting reliability, scalability, automation, and security for Digital Engagement products while helping t... Show more

 • Promoted

AI Evaluation Engineer

Gazelle GlobalGreater London, England, GB
Full-time

Location: London (Hybrid – 1 day onsite).We're looking for an AI Evaluation Engineer to help deliver and optimise cutting‑edge Generative AI solutions within a large enterprise environment.Define a... Show more

 • Promoted

AI Platform & DevOps Engineer | AWS, Kubernetes

DGH Recruitment LtdCity Of London, England, GB
Full-time

We are partnering with a leading organisation on a high-profile AI initiative and are seeking an experienced MLOps / Platform Engineer to build and scale infrastructure supporting advanced AI solut... Show more

 • Promoted

Remote SaaS Implementation Engineer (AI Integrations)

DigitalGeniusGreater London, England, GB
Remote
Full-time

DigitalGenius, located in the UK, seeks an Implementation Engineer to lead the integration of AI-powered solutions for clients.Responsibilities include building automation flows, integrating system... Show more

 • Promoted

Senior MLOps Engineer: AWS AI Platform (On-site London)

Talenzon groupGreater London, England, United Kingdom
Temporary

Talenzon group is seeking a Senior MLOps Engineer to join our London-based on-site team for a 6-month contract.You will design and implement an enterprise MLOps platform on AWS, deploy production-r... Show more

 • Promoted

DevOps Engineer (AI Inference)

GcoreGreater London, England, GB
Full-time

This position is available only under an employment (labor) agreement.The world’s digital experiences run on something invisible: the infrastructure and software that keep them fast, reliable, and ... Show more

 • Promoted

AI Solutions & DevOps Engineer — Cloud & ML Pipelines

DigiterreGreater London, England, GB
Full-time

Digiterre is seeking an AI Solutions & DevOps Engineer in London to provide real-time software and data engineering solutions.The ideal candidate has experience with AI frameworks like TensorFlow a... Show more

 • Promoted

AI Component Modelling Engineer (Remote)

Circuit MindGreater London, England, GB
Remote
Full-time

Circuit Mind is seeking a Circuit Design Engineer (AI) to join our Library Team on a mission to build a database of electronic components.The role involves creating high-quality models using advanc... Show more

 • Promoted

Frontier AI Security Engineer (Code Agent Evaluator)

ObsidianGreater London, England, United Kingdom
Full-time

Obsidian is seeking experienced security engineers to evaluate frontier AI coding models.The role involves using AI coding agents to identify vulnerabilities in code, ensuring the integrity of mode... Show more

 • Promoted

Onsite AI Deployment Engineer (Metals)

Foresight Data Machines LtdGreater London, England, GB
Full-time

A technology firm in the metals industry is seeking a Forward Deployed Engineer.This role involves on-site customer engagement to identify problems and design solutions across the tech stack.Candid... Show more

 • Promoted

DevOps Engineer – AI/ML Infra Architect & Builder

Diffractive LabsGreater London, England, GB
Full-time

Diffractive Labs in London is looking for a DevOps Engineer to build and manage cloud infrastructure for their AI-driven materials discovery platform.You will work closely with top researchers and ... Show more

 • Promoted

Analytics Engineer (Mid-level)

ZHAGreater London, England, GB
Full-time +1

Full time, permanent contract (hybrid working).Associate Knowledge Management.ZHA is evolving its data capabilities to support world‑leading design, project delivery and decision‑making.We are seek... Show more

 • Promoted

Enterprise AI Deployment Engineer — UK (Hybrid/Remote)

CapitolGreater London, England, GB
Remote
Full-time

A leading AI solutions provider is seeking a Forward Deployed Engineer to join their team in the UK.This hybrid role involves working closely with enterprise clients to design and deploy AI applica... Show more

 • Promoted

AI/ML Engineer — RLHF & Model Evaluation (Remote)

ProlificGreater London, England, GB
Remote
Full-time

Prolific is looking for an AI & Machine Learning Engineer to join their team in Greater London.This role involves evaluating LLM architectures, auditing ML code, and providing feedback to enhance m... Show more

 • Promoted

AI-Driven Forward Deployed Engineer for Cloud Modernization

Banyan SoftwareGreater London, England, GB
Full-time

A leading software company in Greater London is seeking a skilled Forward Deployed Engineer to drive application modernization and AI adoption.This hybrid role requires strong full-stack capabiliti... Show more