Senior Software Engineer – LLM Evaluation

Listed through Turing.

What the program says

As a Software Engineering evaluator, you will create cutting-edge datasets for training, benchmarking, and advancing large language models, collaborating closely with researchers. This includes curating code examples, providing precise solutions, and making corrections in Python, JavaScript (including ReactJS), C/C++,…

Pay for this job

Not disclosed

Skills this job asks for

How you'll be assessed

Turing screens per job, not platform-wide, and most jobs here end in a live 60-minute technical interview with a person, usually followed by a short cultural and offer conversation. Others replace that with a timed assessment, a work-sample review, or — on one job — an AI video interview. The posting's own "Evaluation Process" section is authoritative; read it before you apply.

01
Apply to the specific job
Turing matches you to a posting rather than a general pool, so the steps below depend on which job you picked.
02
Shortlisting
Your profile and CV are screened against the job's qualifications and relevant professional experience.
03
Technical interview, or an assessment instead
Most commonly a 60-minute live technical interview with an engineer, sometimes with live coding. Some jobs swap this for a timed assessment due within 24 hours of being sent, an automated coding challenge, a take-home, or a short work sample — hands-on and language jobs often ask for a delivery review or a 30-second demo recording.
04
Cultural and offer conversation
Where there's a second round it's short — 15 to 30 minutes covering fit, the offer and working conditions.
05
Pre-onboarding and contract
Nearly all of these are contractor assignments with a fixed duration and no paid or medical leave. Hours per week and required timezone overlap are set at this point.

How to prepare

Read the job's own "Evaluation Process" section before anything else — Turing publishes it on most postings and it genuinely differs job to job.
The most common format is a 60-minute live technical interview with a person, so prepare for a real conversation rather than an automated screen.
If your job uses the assessment route, the task is due within 24 hours of being sent. Don't start the application in a week where you can't clear that window.
These are contractor engagements with fixed end dates and no paid leave. Confirm the hours per week and the timezone overlap before you commit — many require 4 hours overlapping PST.

Other software engineering jobs

Software Engineering

Board Game Reasoning Expert (AI Training & Evaluation)

Pay for this jobNot disclosed

Game Development

Apply on Turing

Software Engineering

Dockerfile Data Validation Engineer

Pay for this jobNot disclosed

Python
Bash
Docker
+1

Apply on Turing

Software Engineering

Senior Software Engineer – LLM Evaluation (US/Canada/WEU based)

Pay for this jobNot disclosed

Python
JavaScript
Java
+2

Apply on Turing

Loading jobs…

What the program says

How you'll be assessed

Apply to the specific job

Turing matches you to a posting rather than a general pool, so the steps below depend on which job you picked.

Shortlisting

Your profile and CV are screened against the job's qualifications and relevant professional experience.

Technical interview, or an assessment instead

Most commonly a 60-minute live technical interview with an engineer, sometimes with live coding. Some jobs swap this for a timed assessment due within 24 hours of being sent, an automated coding challenge, a take-home, or a short work sample — hands-on and language jobs often ask for a delivery review or a 30-second demo recording.

Cultural and offer conversation

Where there's a second round it's short — 15 to 30 minutes covering fit, the offer and working conditions.

Pre-onboarding and contract

Nearly all of these are contractor assignments with a fixed duration and no paid or medical leave. Hours per week and required timezone overlap are set at this point.

How to prepare

Read the job's own "Evaluation Process" section before anything else — Turing publishes it on most postings and it genuinely differs job to job.
The most common format is a 60-minute live technical interview with a person, so prepare for a real conversation rather than an automated screen.
If your job uses the assessment route, the task is due within 24 hours of being sent. Don't start the application in a week where you can't clear that window.
These are contractor engagements with fixed end dates and no paid leave. Confirm the hours per week and the timezone overlap before you commit — many require 4 hours overlapping PST.