MTurk closed. Your skills didn't.

Get paid to check the machine's work.

Short review tasks from your browser or your phone: is this tag right, is this fact supported, how does this message make you feel. A published pay floor, rules you can read, and a score you can always see.

Join the waitlist Read the rules

HOW PAY WORKSrules v0 · 20 Oct 2026

pay floorPublished

first itemsPaid

measured onreal median times per task

below the floor?we reprice the task or pull it

payoutsweekly, through Stripe

§ Rules

We read the MTurk closure threads. Each complaint became a rule.

ClauseWhat went wrong elsewhereOur rule

§1Pay raced to pennies.A published floor. Every task clears a posted hourly floor, measured on real median times. Tasks that pay less in practice get repriced or pulled.

§2Work rejected, and never paid.Submitted work is paid. Companies can't reject one person's item. Verdicts come from several reviewers agreeing.

§3Banned with no explanation.Your score is visible. If your account is paused, you see the numbers behind it and how to appeal.

§4Unpaid qualification tests.Qualification is paid work. Your first items are check items with known answers, paid like any other item.

§5Unclear rules on AI tools.Every item says whether AI help is allowed. Telling us you used it never counts against you.

§6A new phone or address got good people locked out.Life happens. Changing your phone, address or bank account means re-verifying, never an automatic ban.

The work

Machines do the easy part. You get the items they doubt.

A model has already approved the obvious ones. You see what it was unsure about, and why. Check tags, fix mistakes, or share your honest reaction to a message.

Document tags · item 14 of 40AI help allowed

Halvard Air names new chief operating officer

communication_typemachine doubted · 0.41

1News Article 2Press Release

median 20 syour score 96.8%

Getting in

Invited in batches, sized to the work.

We'd rather run a waitlist than build a crowd with nothing to do. Join, and we'll invite you when there's a queue for your skills.

01Join the waitlistSkills, languages, devices.

02Get invitedIn batches, as work grows.

03Verify identityOne account per person, checked by Stripe.

04Set up payoutsStripe collects your tax form.

05Qualify, paidYour first items have known answers. Some hide a planted mistake.

06Vetted, by invitationA strong check record plus a domain test, for higher rates.

Waitlist

Save your place.

Tell us what you're good at. Finance, legal, medical and multilingual reviewers can qualify for a vetted tier with higher rates.

We'll only email you about invites and changes to how annotators.org works. We'll never ask for a password or bank details by email.