Talent.com
Lifted, an Upwork Company
English-Speaking JSON & Coding Experts for Audio EvaluationsLifted, an Upwork Company • London, England, United Kingdom
No longer accepting applications
English-Speaking JSON & Coding Experts for Audio Evaluations

English-Speaking JSON & Coding Experts for Audio Evaluations

Lifted, an Upwork Company • London, England, United Kingdom
30+ days ago
Job type
  • Full-time
  • Remote
Job description

Job Description

Tasks include:

  • Participating in live, real-time conversational scenarios with AI systems
  • Reviewing and labeling conversation transcripts
  • Evaluating AI-generated responses using structured rubrics and providing written justifications
  • Assessing responses for language quality, customer experience, technical accuracy, formatting, and JSON structure
  • Capturing required session artifacts, including recordings, Session IDs, and tool-call/console logs - Environment preparation and tool verification before each session

Experts should speak naturally and spontaneously, as if responding in real time, without pre-planned, written, or scripted responses - the client is evaluating natural voice cadence.


Qualifications

To be considered for this project, experts are required to pass a basic computational concepts assessment (JSON structures, function, general reasoning, and language proficiency), which takes about 15 minutes to complete, and will not be compensated. If the expert passes the assessment, they will be provided with further onboarding steps.

“Operator” requirements:
- Strong spoken-language proficiency: C1/C2-level fluency (CEFR) in the target evaluation language, verified through a speaking/listening assessment, not just a resume claim.
- Technical literacy: JSON fluency required - reading, validating, troubleshooting, and identifying structural/formatting issues
- Audio setup: capable of producing clear audio quality with no background noise

Ideal experts will have strong attention to detail, strong written communication skills, and the ability to evaluate both the customer experience and the technical correctness of a response. A solid understanding of JSON is especially important, including the ability to read, validate, troubleshoot, and identify structural or formatting issues.



Create a job alert for this search

English-Speaking JSON & Coding Experts for Audio Evaluations • London, England, United Kingdom

Similar jobs

Senior Applied ML Engineer (Agentic Search)

NebiusGreater London, England, United Kingdom
Full-time

Nebius is leading a new era in cloud infrastructure for the global AI economy.We are building a full‑stack AI cloud platform that supports developers and enterprises from data and model training th... Show more

 • Promoted

Worldwide Specialist Solutions Architect – Analytics, Messaging Services, Data & AI GTM

Amazon Web Services (AWS)Greater London, England, GB
Full-time

Shape the future of distributed systems by helping customers design resilient, scalable messaging architectures in the cloud.Turn complex integration challenges into elegant event-driven solutions ... Show more

 • Promoted

Senior AI Software Engineer, Coding Agent

Lightspeed StudiosGreater London, England, GB
Full-time

About the Hiring Team: Tencent Overseas IT is dedicated to empowering Tencent’s rapid global growth with future‑ready, global IT platforms, applications and services.We lead the overseas IT strateg... Show more

 • Promoted

Audio Software Engineer

Antare TechnologyGreater London, England, GB
Full-time

Audio Software / Systems Engineer (Audio AI / ML / Embedded DSP).About Antare: eDo you want to join the early stages of a technology company that’s got huge ambition and vision, as well as the back... Show more

 • Promoted

Senior English Linguistics Lead

The Opportunity Hub UKGreater London, England, GB
Full-time

Lead the linguistic intelligence behind a next-generation data and analytics platform.This is an opportunity for an experienced linguist to take strategic ownership of English language expertise in... Show more

 • Promoted

AI-Driven Product Engineer - Clinical Coding

Dyad AICity Of London, England, GB
Full-time

Come work with us on the AI-driven & knowledge-guided clinical coding product for primary care.We are a small but mighty team of 3 using LiveView, Ash and doing some cool stuff with Docker.Assume e... Show more

 • Promoted

Senior Audio Quality Engineer — SDK Tools

Sony PlaystationGreater London, England, GB
Full-time

Sony Playstation is seeking a Senior Software Engineer in Audio Quality Engineering in London.You will design and maintain tools for validating audio output and ensuring the quality of PlayStation ... Show more

 • Promoted

Voice AI Researcher: Expressive TTS & Audio Synthesis

DNEGGreater London, England, GB
Full-time

Brahma is a pioneering enterprise AI company developing Astras, AI-native products built to help enterprises and creators innovate at scale.Brahma enables teams to break creative bottlenecks, accel... Show more

 • Promoted

Senior Software Engineer - Video Forensics Lead (London)

Axon EnterpriseGreater London, England, GB
Full-time

Axon Enterprise, based in London, is seeking a seasoned Software Engineer with over 8 years of experience to lead the development of advanced Video Forensics capabilities.The role involves cross-te... Show more

 • Promoted

Senior Agentic AI Engineer for Audio Orchestration

AudioStack Labs LtdGreater London, England, GB
Full-time

AudioStack Labs Ltd is seeking a Senior Agentic AI Engineer in Greater London to lead the development of automated audio production systems.You'll collaborate with a dynamic team to shape intellige... Show more

 • Promoted

Senior ML & AI Engineer - Personalization, Search & Audio (Hybrid/Remote UK)

BeatportCity of Westminster, England, GB
Remote
Full-time

For over 20 years, Beatport has been the global leader in DJ and club culture, pushing the boundaries of dance music to all corners of the world.Created by DJs for DJs, Beatport has always been ded... Show more

 • Promoted

Senior MLOps Engineer: AWS AI Platform (On-site London)

Talenzon groupGreater London, England, United Kingdom
Temporary

Talenzon group is seeking a Senior MLOps Engineer to join our London-based on-site team for a 6-month contract.You will design and implement an enterprise MLOps platform on AWS, deploy production-r... Show more

 • Promoted

Senior AI Software Engineer: Coding Agent for Game Dev

TencentGreater London, England, GB
Full-time

A leading tech company in Greater London is seeking a Sr.AI Software Engineer to architect an innovative AI Coding Agent.This role involves leading the development of a tool that accelerates game s... Show more

 • Promoted

Senior Software Engineer, Content Agent — AI-Powered Ops

Sanity CMSGreater London, England, GB
Full-time

A tech company specializing in content operations seeks a Senior Engineer for their Content Agent product.This role involves full-stack product work, primarily using TypeScript and React to design ... Show more

 • Promoted

Software Development Engineer, Video Quality Analysis (VQA)

MENA AlliancesGreater London, England, GB
Full-time

Software Development Engineer, Video Quality Analysis (VQA).Are you an experienced Software Development Engineer eager to shape the future of video quality and streaming technology? Join a fast-gro... Show more

 • Promoted • New!

Korean-Speaking Data Analyst: Dashboards & AI Evaluation

Grid DynamicsGreater London, England, GB
Full-time

A leading technology consulting firm in the UK seeks a Data Analyst with Korean language expertise.This hybrid role combines technical data analysis with cultural insights.Responsibilities include ... Show more

 • Promoted

Research Scientist, Generative Audio & Vocal Synthesis

SpotifyGreater London, England, GB
Full-time

Spotify is seeking Research Scientists across all seniority levels to join our Artist-First AI Music Lab.We pursue state-of-the-art generative audio technologies to create breakthrough listening ex... Show more

 • Promoted

Staff Engineer, Content Intelligence Infra & AI Pipelines

Spotify ABGreater London, England, GB
Full-time

Spotify AB is looking for a Backend Engineer in London to lead the design and evolution of data and ML infrastructure systems.You'll build scalable infrastructure for processing audio, video, and t... Show more

 • Promoted

Product Engineer, Transcription — Desktop Audio AI (London)

Granola incGreater London, England, GB
Full-time

Granola inc is seeking a Product Engineer in London to develop innovative transcription features.You will engage directly with users and collaborate with a team to enhance our desktop app.The ideal... Show more

 • Promoted

Senior Developer Experience Writer: API & SDK Docs

BloomReachGreater London, England, GB
Full-time

A leading tech company is seeking a Senior Technical Writer to enhance the developer experience within their Engagement Docs Team.This role offers flexibility to work remotely while playing a cruci... Show more