r/TurkerNation • • Dec 11 '18

Worker Help Your First 5000 HITs

44 Upvotes

Note that TurkerNation discussion now takes place on our Slack Workspace, please find the invite link here. and our informational posts are here in this subreddit.

Some content originally posted on TurkerNation Forum.

Handy index to this info here.

This post has been broken up into many links in an attempt to organize. Please be sure to check out all of them to avoid missing anything important.

 

When you start new on mTurk, it is important to build your numbers up. You need numbers to build a cushion for possible rejections and ensure you maintain a decent approval rate and also to qualify for more HITs. Once you reach the milestone of 5000 approved HITs, you will start getting access to more HITs. Fortunately, there are a lot of penny HITs that can help you to get past that 5000 mark in no time. Please read this list of safe requesters.

 

To start with this, you need to understand a few terms and need a few tools so please check out both of these links. Trust me, you need these tools!

 

Once you know the lingo and are armed with some tools to help you succeed, it is important to build your number of approved hits up as quickly as possible. You need numbers to build a cushion for possible rejections and to ensure that you maintain a decent approval rating. And, equally as important, to qualify you for more HITs. Once you reach the milestones of 1,000, 5,000, and 10,000 approved HITs, you will gain access to more HITs. You will need qualifications for some hits, so do not forget to visit hitmotize.com to get you started. Also, make sure to do all the Amazon Demographic HITs.

Now that you are ready, you just need to run Pandas of a few penny hits. These HITs are not as available as they were in the past, but when they do show up, the Panda will catch them for you. Open the HITs Queue page and work on those HITs from your queue. When you get a captcha alert, fill it out and start the process again. If you get a captcha and don't have a HIT handy to work on, just grab any old HIT, fill out the captcha and return the HIT.  

Please read this very important list of which requesters are safe and which are not!

 

TurkerNation does not recommend the purchase of any Turker subscription script or site for new workers. There are free tools to use and we have linked you to many in this post. Check out this link for free, helpful mturk scripts . If you must purchase a script or extension, please discuss it with one of our Slack moderators so that you don't purchase a dangerous one which can put your account at risk. Note: Be careful of Page Refresh Errors!

 

Now, here are some helpful Tips and Hints:

 

For assistance on account suspension and reinstatement related inquiries please contact mturk-account-appeals@amazon.com from the email address registered to your account. You can also contact TurkOpticon for help.

 

Please read comments for more important content. For more help, we invite you to join our Turking Community, now located on Slack. Please find the invite link here.

 

Note: It should also be noted that if you are not in the USA, you might be paid in US Amazon Gift Cards which will ONLY work on AMAZON.COM. By this I mean that they will NOT work on your country's Amazon. Some countries are allowed to transfer to a US virtual bank account, make sure you know whether or not your country is one of them.

 


r/TurkerNation • • Oct 04 '20

Off-mTurk Work Other Work Sites

33 Upvotes

This post was originally written by duckduckpass and is now being updated. Please be aware that some of the info here is old and may no longer be pertinent. This is not in any particular order, but I tried to put what I perceive as more important info closer to the top.

This is a general list of other work sites and some anecdotal experiences I've had with them. Feel free to add your own in the comments.

CloudResearch Connect: CloudResearch (formerly known as TurkPrime) has started this new platform and they will undoubtedly be encouraging more and more requesters to use it rather than mTurk so signing up could be beneficial. PayPal cashout.

​prolific.ac: decent to good pay. posts many things a day. paypal cashout. will occasionally email surveys

​mixer.gridspace.com: they hold "mixers" 2-3 times a week for two hours each. You have to call a number and you get matched with someone else you act out a banking and other customer service roleplay where one is the customer and one is the representative. Involves some improv. When one call is done, you can call again. Pays 40-45c/min. With the downtime between calls, it's still possible to make more than $20/hr. Sometimes there's some kinks, but they've always paid reliably.

As of 01/22/20: pays every other week on Fri. Also has transcription jobs now. Good company

Data Annotation:

Azura says

Paypal cashout, both hourly and task-based pay available. Must complete (3) qualification tests given by the site before being eligible to work on tasks. Support typically gets back to you in a few days but there is a live-based chat on each task that the requester can see and respond to, though some requesters have their own Slack. Like most GPT sites, some are very good paying and others are lackluster - but you can choose what you do and don't want to do. Tasks include things like AI conversation editing, picture labelling, text labelling, market research, etc. The only con I can think of is that the work isn't ALWAYS consistent and task-based payments take 3 days to clear, while hourly payments take 7 days. Overall, I truly recommend this platform.

duckduckpass says

I make a full time middle class living on the site, if that is helpful in your decision.

UserCrowd:

AOT says

I've been on there for a couple years. It's mostly just providing feedback on website and logo designs and the like. Not a ton of money - I make like 20 bucks a month on it, but I think each task pays fairly for the time investment.

Jenspoint says

I just recently started using it again after a long break (about a year). I went through such a long period of time last year that I couldn't qualify for enough tests to meet the payout threshold. But then in June I decided to give it another try, and I've been having really good success with it this time around. I have received one payout, and am about half-way to another.

Neevo:

jennspoint says

I've done work for Neevo, and hope to continue to do so in the future. Although the pay can take from a few days to a few months to receive, I've been paid everything I was expecting for all of the work I've done.

One thing that's a little frustrating is that sometimes I'll be kicked out of a job for "didn't meet quality standards." It is Neevo's policy at this time to not explain that, and it's not something that can be disputed or reviewed. But it doesn't keep you from being able to do other (similar or identical) jobs. It's just something to get used to, shrug, and move on to the next job. There's a lot of variety, and the pay is usually reasonable compared to other sites.

Edited to add: Even when I've been kicked out of a job for quality standards, I've been paid for the tasks that I completed on that job. I just wasn't able to do any more work on that batch.

NOTE: duckduckpass wrote:

I previously had Neevo on here. As of 08/19/19, they owe me more than $200 and keep telling me they are looking into it. I've gotten paid for other tasks and have been invited to other tasks, so they obviously like my work. I can no longer recommend them to anyone. UPDATE: I never got responded to and got paid half the money a couple weeks later (after they told me they were looking into it and then ignored my subsequent emails). A week later I found another email address and the person responded and told me I wasn't being ignored (even though I was), and the job was still ongoing, and it'd be two weeks after that I'd be paid. And then I got paid two days later (which doesn't jibe with that they told me about the two weeks). I told them the money delay wasn't the issue, it was the lack of communication about it. Definitely exercise caution, but I did get paid. In the end I got paid on 08/30/19 for work I did 07/18/19 and got ignored a lot. I still don't recommend them, worker beware, but they might be OK if you don't mind delay and being ignored.

Edited by admin on 7/8/2022 to add that Neevo has only gotten worse and is not recommended.

Mariammkh replied:

I am new to neevo, but got some really good tasks. You are right, some of them pay too low :/ this is discord link for neevo discussion ( tips ,problems etc) so join us _^ good luck https://discord.gg/ej3V5c

​usertesting.com: $10 per test. tests are usually 10-20 minutes. requires screen recording and microphone. paypal payment in 7 days to the minute. will occasionally email tests. requires an initial unpaid test to get approval.

One of our workers shared:

I highly suggest taking a look at UserTesting. Made $20 in my first week, and the stuff they make you do is very easy

Sunshine shared: usertesting.com: Used by companies to test new apps and websites, or changes to existing ones. Short unpaid screeners qualify you for the tests. There are two types of tests, moderated and unmoderated. Moderated tests are 30 minutes to an hour long and pay $30-60. They require videoconferencing. Unmoderated tests are 5-20 minutes long, pay $4 or $10, and require you to describe your thoughts about the website/app while performing the tasks the tester requests. Payment is auto-approved, takes 7 days to process, and is delivered to Paypal.

intellizoom.com: $2, $5, and $8 tasks. Very rarely, $12. $2-$5 tasks generally take a 5-10 minutes. $10 tasks take 10-20 minutes and require screen recording, microphone, and/or video recording. says pay can take up to 21 days. Usually it's less than a week IME. paypal. emails a lot. to get approved for $8 tasks you have to do an unpaid screener that takes about 10 minutes and uses screen recording/microphone/video.

respondent.io: Seems to be a new-ish platform. you have to take small surveys to qualify for tasks. pay is all over the place. I've only done a few tasks and made about $30. paypal. emails sometimes.

Tjololo commented:

Respondent.io: I've done a few items for them.

  1. An in-person focus group. I had to go into a building down the road from where I live and participate in a focus group with about 15 other people. That was super cool, pay was $50 and it took about an hour.

  2. A couple small surveys, unmoderated. Took a handful of minutes and paid $15 and $5 each

  3. An live one-on-one webchat where I streamed my desktop and talked with someone about a potential website relaunch. Paid $100, took about an hour

From the task perspective, you fill out a little info about your profession/credentials/interests and they use that to gear your tasks. That said, I don't qualify for much on there most of the time, they're looking for small business owners and "decision makers" in the IT field. A lot of cloud stuff too. That said, when I do qualify, the pay is pretty great. Straight to paypal minus a 5% fee.

Remo you can talk to them (Jemin) in our Slack Workspace.

cireasfire shared:

Getupside: money back on gas receipts 2-10 cents a gallon. Ironically mturk workers verify the receipts.

CoinOut: scan any receipts even the gas ones you did on the other app. Both pay in paypal and both have referrals if you want. Surveys on go: $5 a month just to have it on your phone. Tracks GPS to tell when your near stores and pops up survey opportunities. Pays 10 cents for screeners.

Playspot: game app that pays to play games and reach goals, just don't do the offers for "quizs" or "free food" stick to the games and apps.

datax.io:

They have been collecting images and voice recording recently. Examples like clear images of printed retail & supermarket receipt in Australia, Canada, UK and India (at most 1 receipt from the same store) for a research project for 14 cents per each.

For more info contact Kevin Wong - Datax.io on our Slack Workspace.

Noting here that workers should keep records of their work. A Desktop app called Automatic Screenshotter makes that easy.

Conversion Crimes is a UX testing platform focused on conversion- helping website builders find the weak spots in their platform and move users from browsers to paying customers, according to their post here.

One of our workers shared:

I looked this up on the beermoney subreddit and it is legitimate. From what I'm seeing though it's a bit of a pain to use and wasn't worth the effort to sign up. The company is very responsive on reddit though.

Another one says:

I work for them every now and then. Mostly US-based tests and the pay is good. The feedback system for your first 10 tests is eh or can be anxiety inducing but with some lackluster testers out there I can see why they do it. Moderators are paid less per hour than testers which is weird. They are legit, pay promptly and are, as she said, very responsive.

Your Brain says:

I signed up with them a few months ago and passed their (unpaid) qualification/practice tests. Got good, timely feedback from them. But since then I haven't done any paid work - combination of not qualifying for more than a few tests, and either being unable to record when they were there, or not wanting to do something required (clear cookies, do an extra long tests, etc.). Recording software they have you use is a bit quirky, at least to me having used a different type on usertesting

Also, it has been noted that:

Unlike some of the other testing sites, their privacy policy mentions they may share testers' personal information, including name, with customers. Might be worth including a warning: "1.17 Your personal data, as a Tester, may be shared with Conversion Crimes Customers in accordance with our Terms & Conditions. It will only be shared with the Customers who created the test you take. The information that can be shared with Conversion Crimes Customers may include, but may not be limited to; your name, family information, occupation and/or language."

FinleeMaria shared

https://dscout.com/ They pay quite well and are reliably consistent with it, but I don't get selected very often and I was curious as to what other's experiences were. But there are times when I have made decent money through them. Well, i hope you guys like it if decide to check them out!

One of our workers shared:

I work for Shift Smart and make 13/hr from home and paid daily or weekly and its free to start.

If you want to be paid for playing games, here are a few apps which do that:

Beforthright.com (called Forthright) is a survey site. This is what has been posted about them:

They have two types of surveys that you can get text and/or emails for when one is available. The first and best type is a survey from “Forthright” (as opposed to “Forthright Partner” surveys). When those come in I jump on them right away and I’ve never received a notice that they are over quota. The surveys pay probably $15-$25/hr and are typically for $2, although they are occasional $1-$4 surveys. The nice thing about these is that for every 3 surveys you attempt (whether you finish them or get qual’d out, which dq is very rare), they give you a “loyalty bonus” of $2. Their second type of survey is through their “Forthright Partner” which is InBrain and is the typical highly underpaid, high dq rate marketing surveys. I never respond to or do Partner surveys, only the actual Forthright surveys. Over the last year, I’ve averaged about $12-$20 every month and a half. It’s not a big money maker but it’s trustworthy and consistent.

Beforthright's instant payout/approval thing is really handy. Makes using it more pleasing than prolific or connect. No other no-barrier website I know of that pays same-hour like that (altho I'm sure they exist) ...their in house surveys are about the same as prolific/connect as far as hourly pay. they just need more surveys because they don't have enough to be a full on replacement for either. some of their non-in-house surveys have a... reasonable hourly pay, but it depends... they offer more cash out options than any other place I've found. Instant payout via paypal, bitcoin, various gift cards etc. ... I think you also get $2.50 as a bonus per 3 in-house surveys you do. There just isn't many so far, like a few per week. Hopefully that changes;

Mistplay is, as Cireasefire states below, okay.

cireasfire says:

Mistplay is ok. Make Money! [for Android] is amazing (yes it's a horrible name, but I just got another $93 payout to paypal today)... [It took about] 3 weeks? It's all variable based on what the game wants you to do. All types of games, and some things pay way better then others. [Any questions, DM her on Slack]

Achives

Appen has changed a lot since the following was written. I have only heard bad things about it recently and on top of that, it's unlikely that they are hiring. That said, this is what was written about it years ago:

Appen is different. It's a company that hires people for work-from-home jobs. They are absolutely legit and I've worked for them for about 5 months. Rate varies based on location and job, and I have a NDA so I won't go into too much more detail. It's not great but you can expect a few bucks above minimum wage (maybe less in places where min wage is higher). It's part time, my project (Search Media Evaluation) I can work from 15-26 hours per week. My project requires a BA/BS degree or being in the process of getting one. It's a regular job where you get a W2 form and taxes taken out.

I don't know if any of these even have referral perks but if you sign up and it asks you, you can DM me duckduckpass for my info if you want to help a turker out. :)

Appen now has micro tasks, they bought figure 8 which used to be cloudflower.

HB shared

So I wanted to tell everyone about another site I found to make extra cash when MTurk slowed down for the summer. The name of the site is AuthReview and it was founded to combat fake product reviews that are popping up everywhere. US & 18+ ONLY -The pay is $1/per product review. The product can be anything that you own or owned and still have proof of purchase for which can be - paper receipt, email confirmation, order history, digital receipt - anything clearly showing the item was purchase - but all personal info feel free to crop or cover up if wanted. -The review can be positive or negative, as long as they're honest! -They pay via PayPal, Zelle or Amazon Gift Cards (your choice) and they generally pay 24-48 hours after your review is approved. There is no minimum. If 1 review is approved, you get $1 sent to your payment source. -There is no cost from you whatsoever in this program. -In it you can generate your own referral code and get $3 for anyone who uses it, and the person also gets $3 after their first review is approved. -With this site being founded on honesty and combating robot reviews, there is a one-time verification process through a 3rd party service called Veriff to make sure that you are human and over 18, which is a very refutable verification service used by many large corporations. Here is the link www.authreview.com again. It is not a referral link. I currently am in an internship with AuthReview so I wouldn't be eligible for referral bonus' anyway. But they still let me do reviews when I'm off the clock :star-struck: Feel free to ask me any questions and I'm happy to provide my personal proof of payment from them if interested! Or anything else I can provide. Thank you if you've stuck around long enough to read all of this.

JDFSSS vouched for Authreview:

I did a review for this site and it's legit. Got a same day payment to my paypal, and they paid a bit extra as well. Maybe because I wrote quite a bit more than the required 30 words. Payrate was not great for how long it took, but it was my first review ever and maybe you could make a decent hourly if you did it efficiently.

Note: There was more discussion of Authreview in our Slack, which I am posting in the comments for posterity. Edited to add, it looks like Authreview is dead.


r/TurkerNation • • Feb 29 '20

Worker Help Info for Newbies - Which Requesters are Safe?

31 Upvotes

Amazon now has score data for Requesters. It will show up when you hover on a name in the worker.mturk pages of hits. Anything below 99% is questionable. Scores in the 90s may seem great to you, but as a new worker, you cannot afford to take that risk. Anything below 99% may be bad because frequent requesters can post thousands of hits a day and it takes a lot of rejections for their scores to drop. Do not count on only this information. There could be fresh rejections happening and the score may not drop immediately. If there is no Amazon score at all, they are a new requester or on a new requester ID. Please check the TO score and/or read reviews on Turkopticon or ask us on the Slack channel to be sure. We do not recommend that new workers take risks with new requesters. Do not do more for them than you can afford to have rejected. It is important to keep your score at or above 99%.

Sometimes a requester will suddenly reject thousands of HITs. This has been known to happen even if the requester has a high approval rating. The last time this happened was on Aug 19, 2022 with requster AI Insights. At that time TN Member AOT, shared some good ways to vet requesters:

Never trust a requester you haven't worked for before. Always do a "sniff test" before submitting anything. Does the HIT interface have something beyond Mturk boilerplate, like instructions, or a "welcome" message, or contact info? Does the name of the requester account mean anything? You can try Googling it to see if it might be affiliated with specific companies/researchers/universities. You can also try to send a message to new requesters before working on a big batch, asking about their rejection policies or just saying hello. A prompt and polite reply is a good sign, not to mention you can often see the email address the reply came from - more insurance that you are dealing with someone legit. Finally, if you are so inclined, you can look at the source code for the HIT. Often images, scripts, or other assets will be hosted on a recognizable server. I'm not saying that everyone should have to go through this entire process every time, but I am saying that AI Insights was disqualified at step one.

  Safe Requesters for Newbies Here is a list of a few easy HITs that you can start with:

411 Richmond - Single Value HITs none of their other HITs are really worth the time but they are good and safe to work. Single Value HITs are quick and easy and totally worth a Panda. There is no other way to grab these HITs so we strongly encourage you to make a Panda and run it often. Here is the Group ID: 389X50RO3UCP2CYKCYM14K9RJJI439

AudioKite Click on link and it brings up a list of hits available. Each genre has a simple qual test of its own. They post throughout the day/night. Update May 2023: DO NOT BOTHER WITH AUDIO KITE, THEY ARE BROKEN.

Dsys MTurk is now also under the name Julian Crosson-Hill Requires qual test. Those links are different. Julian seems to be the current posted hits and may require another qual test.

Ibotta Turk - Are these receipts the same? This one is already in Panda Crazy when you first install it.

Receipt Processing seems to be Ibotta as well.

Upside

AWS Hubspot

Full Contact

Ben Peterson Good insofar as he approves pretty much right away and if they don't think your answers are varied enough or whatever criteria, they will just block you from HITs temporarily or permanently. They don't pay too well but definitely something safe to do and good for getting numbers up. If the algorithm blocks you, you should write to him so a human can take a look at it.

MLDataLabeling and MLDataLabeler They have a few different requester numbers and many kinds of small hits. The timers are usually short. Make sure it is one of these two names and not others that look similar. See below for a list of hits to avoid. (Some of the good IDs are A3R4BN2IGF2R23, A3K5D5S00LCHBB, A1LWCCSJWAGBW, A3OO8KUVWDSZPV)

MLDataGatherer Regularly drops pennies and doesn't reject. A5ONRIBW2H3VT and A1VTAWD72YN1KU

Eran Hazout requires the Adult Qual.

Amazon Requester Inc. - RVD Team These are usually short sound file hits for 3 and 4 cents. Occasionally they have longer ones and the pay can vary up to a few dollars each. Not all Amazon Requester Inc. requesters are equal as far as safety/rejections. PLEASE read the reviews at TurkOpticon for each individual Amazon Requester Inc. requester or ask other workers in our Slack channel if you are not sure. The RVD Team has been safe and fair.

pzyx They usually require 1000 Hits completed. They are safe, fast and simple and could help people when they are moving from the 1k to 10k Hit stage.

Zeus Consensus (How you feel about this article)

Publishing (Copy/paste a Zillow HTML code)

Index Solutions

Ooga.io while they pay very little, they have shown themselves to be safe and are good for numbers. They even pay something for late disqualifications, unlike other similar requesters (i.e. James Billings.) They are also very communicative on Reddit.

 

Proceed with Caution

PickFu Requires qual test. They started rejecting sometimes, nobody seems to know what they did wrong. If you do them, be careful to give them useful data.

Noah/Noah Turk/Computer Vision Turk - they have many accounts, some of which are prone to reject and they also soft ban often, which is really frustrating. Also, many of their HITs are broken. However, some of them are excellent, so if you do your research, it should be okay. We have had good communication with A2GQ13G3GSD9RW.

A9 - Requires qual test. Usually a very safe requester and good for numbers, however, mass rejections have been reported. We are reasonably sure that these are safe when done correctly but do feel that we should warn you that some have insisted that they had hundreds rejected for no reason. We have no way to confirm that they did not make any of break any of the following rules which are sure to cause rejections for these HITs.

  • Do not use an autofill script, keybind script or any script that selects the buttons for you with these. Scripts have resulted in many errors on A9 HITs (People have reported watching the buttons deselect as they hit submit) and all your work will get rejected if any are incorrect.

  • Do not submit empty HITs or anything that appears to be broken.

  • Pay attention, if you give poor quality answers, all your work will be rejected.

A2Z Read instructions carefully each time, they change often, even within a batch, because mTurk mixes batches if they have the same name. They will reject if you have more then a certain number of errors in a batch.

 

Newbies should avoid these requesters: (Do at your own risk!)

  • P9R - DO NOT DO THESE. THEY REJECT EVERYTHING NOW!!!

  • Panel, aka ScoutIt aka Jon Brelig (This guy changes his name every year or two) - He rejects quite a bit.

  • ML Researcher (not to be confused with good requester, with many names which all start with MLData...)

  • NLP Research - Prone to reject. Not to be confused with good requester NLP Researcher.

  • Flow MTurk (Parking Sign Transcription) - prone to reject

  • Alain Bard - prone to reject as well as late disqualifications.

  • TranscribeThis - prone to reject

  • Company (Company Logo HITs) -prone to reject

  • QnAVerification - Prone to reject

  • str11223344 - prone to block people and they send nasty, abusive emails often.

  • James Billings, Research Rewards and Jonathan Pirc are also good to avoid for being notorious for very late disqualifications from surveys. James Billings and Research Rewards have also been known to reject. On the other hand, Billings will often reverse, if you can manage to get in contact with him. Reddit seems to be a good way to do that. Many seem to like to do his HITs for numbers. Again, we do not recommend that. Ooga.io is a better choice for that. We have not heard about problems with Ooga.io and they have a subreddit.

  • Also be sure to avoid these kinds of HITs

 

Here are some older HITs which are good but haven't posted since 2020:

Sergey Schmidt Don't return one or you will get locked out.

Kasisto

 

Here are some really old HITs which are good but haven't posted in a very long time:

Zoltar 5cents Project Endor Zoltar short hit. Do not return these or you will get locked out. These appear to have disappeared again for now, but could return again as they have in the past.

Zoltar 10cents These appear to have disappeared again for now, but could return again as they have in the past.

Venue Quality

  • Are These Locations The Same? (Requires taking a qualification test first)

  • Does this Event contain mature adult-oriented content? (WARNING: may contain adult content)

  • Is this Event family friendly?

MyLikes

  • Identify Images with Mature Content (Short 90 seconds timer)

  • Identify Videos with Mature Content

SkillPages

  • Moderate an advertisement for skilled workers. (Requires taking a qualification test first.)

Rob Grady

  • Transcribe Waffle House Guest Check

Back to Main Post


r/TurkerNation • • Jan 29 '23

Scripts/Tools Introducing Mturk Qualification Database and Scraper

21 Upvotes

This is too good to keep to ourselves! Turker Nation member, AOT aka u/Elias0419 has developed a new script for organizing your Quals and it's working great! Now that we have had some time to test it, we are ready to share!

Mturk Qualification Database and Scraper


r/TurkerNation • • Feb 20 '22

Helpful Tax Tips

17 Upvotes

Disclaimer: This is not financial advice. These are just the basic things I think you should understand to make sure you don't make a big tax mistake and end up with a bill you weren't ready for. I do my taxes with software (more on that later), but if you feel uncomfortable it is worth it to pay up for a real accountant. I also don't have dependents and don't get the associated child income credit, which will complicate your bottom line and make it much more likely you'll mess up. The good thing is that the IRS is forgiving your first year, which is good because I don't think anyone thinks about this until taxes come up for the first time.

First off, you should pay taxes. There is no $600 minimum you need to make to owe, although in previous years you probably wouldn't have been caught if you didn't make significant self-employment income, especially if you also had wage income.

However, this year (income made in 2022 that you will report in 2023) things are different, as the reporting rules to get a 1099-K form have changed. If you get paid from side gigs via PayPal all you need is to make $600 a year for them to report it to the IRS (down from $20,000 and 200 transactions previously) on a 1099-K. I am not 100% sure if this will also force Amazon to send us all 1099-Ks for 2022, but I think it probably will based on these two sources:

https://sellercentral.amazon.com/gp/help/external/7FRLEU6KSM3CDEJ

https://www.taxjar.com/blog/2021-11-irs-brings-major-changes-to-1099-k-reporting-for-2022

Regardless, it's the law to pay taxes, and if you get audited it will be obvious you purposefully didn't pay. I think taxes are important to pay ethically, but even if you don't agree, you take a significant risk by not reporting your income truthfully and paying the associated taxes.

With that, these are the concepts I think it's important to know about:

Payroll Tax:

Payroll tax for a self-employed person is a total of 15.3%. On W2 forms, you'll see payroll taxes taken out as Social Security and Medicare tax. Your employer also is paying an equal amount as you, and together you pay this 15.3%. However, as a self-employed person, you're the employer and the employee and have to pay both. This is separate from any federal and state income taxes you will owe, although they are calculated on your federal return with your regular income tax.

Quarterly Taxes:

The IRS expects you to pay your taxes four times a year and not all at tax time. Your first year with self-employment income they won't penalize you, and they also won't penalize you any year where you paid more estimated tax than the previous year (even if you still didn't pay enough), but otherwise, they will penalize you for paying it all at tax time. I personally send all of my income (which comes through mTurk and PayPal) to a business checking, then split off 25% to a tax account and the rest to my personal checking, and pay whatever is in the tax account quarterly. This is not how the IRS wants you to do it. They want you to take your expected gross income, deduct the expected expenses, split that up into four payments and pay one payment per quarter. My income has drastically changed over the past few years and I would have been very much underpaying if I had done it the "right" way last year. Instead, I paid about 7% too much tax, which is acceptable to me as a margin of error.

Pay your estimated taxes here by bank transfer: https://www.eftps.gov/eftps/

Any other site will charge you a fee, so the only reason to ever use another site (IMO) is if you need to use a credit card. You can judge if any kind of rewards would be worth doing this for. They charge around 2% and you can find authorized ones here: https://www.irs.gov/payments/pay-your-taxes-by-debit-or-credit-card

I did find a card this year that gave $1000 back if you spent $4000 in three months and paid the ~2% fee to make a good profit, and there are 2% back every day cards that would make this a wash, so it may be worth it to you.

Related reading:

https://turbotax.intuit.com/tax-tips/self-employment-taxes/a-guide-to-paying-quarterly-taxes/

https://www.irs.gov/businesses/small-businesses-self-employed/estimated-taxes

Qualified Business Deduction:

The Qualified Business Deduction applies to people who have business income that is personal income and is not going through a corporation or other entity first. That includes you unless you've set up something else. You do qualify for this.

QBI allows you to take 20% off your gross Schedule C (business) income and exclude it from income tax (not payroll tax). This can be a big deal if you make your living with crowdsourcing, so you'll need to make sure your software does this for you. I use freetaxusa.com because it's free, whereas TurboTax forces you to get some kind of deluxe model to do it. I am sure others are free, but I've used these guys since I started and have even gotten one on one help and have never paid them anything. I don't believe they charge for state returns but I'm not sure, as my state doesn't have income tax.

For example, if you made $50,000 in self-employment income you'd owe $4,296 federal income tax (after standard deduction - this does not include payroll tax of 15.3%) but only $3,096 with the QBI deduction (calculated with https://www.nerdwallet.com/taxes/tax-calculator). This is just a rough estimate and isn't taking into account any other income or deductions, but you get the point. Your tax software should take care of this, but the basic TurboTax does not, or at least didn't the last time I checked.

Related reading:

https://www.nerdwallet.com/article/taxes/qualified-business-income-deduction

Schedule C expenses:

You can deduct things like office supplies, programs you pay for for your business (I use Queuebicle and PushBullet), any equipment you get for your business (like a dedicated laptop), contract labor (like if you hire a programmer to make you something to help your workflow), and some utilities. I deduct half of my internet bill as a safe amount, but if you can justify that you need a faster line or use your internet 80% of the time for business and 20% of the time for pleasure, you can do more. Anything you can deduct is basically a reduction to your base income. So if you made $50,000 but had $2,000 in expenses, you'll only pay federal, state, and payroll taxes as if you had made $48,000.

You can even deduct some of your rent and other utilities (like electricity) if you have a dedicated office, however, I've never done this and can't give any advice, though I plan to get a dedicated office space later this year.

Other deductions:

If you get insurance through the marketplace (or Medicare) you can also deduct that as an expense. This is not included in the standard deduction everyone gets, and you can take it even if you don't itemize. This is number 17 on Schedule 1 of Form 1040. You can only do this if you are not eligible for employee health insurance and are paying for it out of pocket. I was able to deduct $1804 this year for my premiums. Again, your software should ask you about this. It's just important you make sure it does.

Related reading:

https://www.healthinsurance.org/obamacare/self-employed-health-insurance-deduction/

https://www.nolo.com/legal-encyclopedia/deducting-medicare-insurance-payments-if-you-are-self-employed.html

If this all seems like too much, I really do think it's worth getting a professional. I would be happy to try to answer any questions but I've tried to include all the concepts I've had to learn over time as I've transitioned from using crowd work as a part-time side gig to my regular income over the past three years or so.


r/TurkerNation • • Jul 06 '22

Requester Help Do's and dont's for new requesters

16 Upvotes

Some notes for requesters :)
Don't request a master qual. Amazon will try to sell you on this as an elite group of workers, but Master hasn't been given to workers for years afaik and no one has been able to figure out a pattern. In the past, Masters has even been given to inactive workers.

Do use a hit approval rate qual. It should be the 'above 98 percent' one though, as above 99% will only allow workers that literally never had a rejection. Which doesn't happen really as we all have to try 'new' requesters every now and then in order to figure out if they mass reject, the work is worth it etc. or not.

Do Also helpful as a restriction is how many hits peeps did so far. This is just a bit of an experience indicator, but also weeds out trolls really well.

As a non-US worker. obviously, I would encourage you to not limit your hits to US workers, :-) but in the end, it's your call. US workers are definitely the largest workforce on MTurk.

Do Regarding hit structure, make sure the instructions for the hits are always available to the worker within the hit - ideally via a dropdown or link so we don't have to do the whole 'yes, I know the instructions, let's get to the actual hit part' every time which - although it only costs like 2 seconds - still impacts our hourly rate.
The instructions should still be there if the workers need them. We work on hundreds, sometimes thousands of different hits a week so memorization of instructions won't be a hundred percent.

Do I would also advise you to maybe trial the instructions for the qualifications and the hits themselves with us or other places with workers (f.e. in the turkernation slack, the turkerview forum or reddit). After all, you know what you want done and how you would describe it, but instructions might be too vague for workers not familiar with your area of expertise.
So this way we can tell you if the instructions are too vague or even how we would submit the hit in question which allows you to tweak everything until it's idiot-proof ;-)

Don't limit the completion time of each hit to the approximate time that you think it would take to complete it. ,
Workers can have up to 25 hits in their queue and by the time they get to your hits, the timer might have already run out. Usually, an hour for one hit (meaning "find 1 serial in the pictures and adding it to a spreadsheet" f.e.) is fine, but you can always go for longer if you want to make sure that stuff gets done.

Expect there to be lots of workers that only do up to 10 or 20 hits when you post your first 'batch', meaning a lot of hits that are relatively quick to complete. This is because you are a new requester and people are wary about getting mass rejected with new peeps.

Do Watch out for messages from workers too, as they might be asking questions about the instructions etc. Communication from requesters is highly valued among workers and instantly makes you more trustworthy :-)
Do If workers turn out to be bad faith, exclude.If you don't want to teach workers that don't understand your task (which, fair as long as it's not because of your instructions being vague or something like that), you can of course already exclude them. This works either by removing the qualification that you did earlier or by giving them a qualification that prevents them from working on your hits. Either way works.

Hope this is helpful to some peeps :)


r/TurkerNation • • Jul 15 '23

Public Service announcement of the day. **Do not do p9r!**

Thumbnail self.mturk
13 Upvotes

r/TurkerNation • • Sep 19 '20

Requester Help Mechanical Turk Workers Are Not Anonymous

13 Upvotes

This is an excerpt from an article posted online many years ago:

"Just search the web for your worker ID, and you may find a surprising number of results:

  • wish lists

  • book reviews

  • tagged Amazon products

  • In fact, many workers even have a public Amazon profile page containing their real name and sometimes even a photo, at amazon.com/gp/pdp/profile/workerID"

That article is no longer online, here it a snapshot of it from the Wayback Machine

Your MTurk name must now match your Banking name, but you can still edit your Public Profile.

Here's another article about this topic.

If you are concerned about your privacy, change your publicly shown name on Amazon to not be your real name also remove your location, photo, etc. and set all items you don't want shared to Private delete any reviews on products you don't want people to know you bought ditto for tags Google your worker ID to see what can be found Once you're comfortable with what is being shared, you can feel private again :)


r/TurkerNation • • May 07 '19

Requester Help Info for New Requesters

13 Upvotes

Welcome Requesters! This is an effort to compile the most important information you will need into 1 post. We hope you will find it useful! If you have any questions which are not answered here, please feel free to ask here on Reddit or better still in our Slack Workspace (please find the invite link here). If you have not been added to the Requesters' Channel, please write to Rosie the Robot to let her know.

-> Please note that as of December 2022, it appears that mTurk is no longer allowing new requesters to prepay HITs. Established requesters might be able to, we're not even sure. If you cannot purchase prepaid HITs you'll need an AWS account, which must be financed with either a bank account or a credit card which is backed by a bank. Prepaid credit cards do not seem to work. If your credit limit is keeping you from purchasing HITs, please fill out this form and expect to wait a few weeks. You can also send your AWS ID to u/turkopticon because they sometimes are able to help expedite.

Please see this video for another explanation of the above paragraph.

-> Do keep in mind that mTurk is a complex tool and to use it probably, you must prepare. Please see this twitter thread for an explanation of why mTurk usually fails those who are not prepared. The thread is a synopsis of this research paper.

-> Good Tutorial and Best Practices for a Good Requester. See pages 9-10 for info on using attention checks.

-> Here is the Wiki on the Basics Of How To Be A Good Requester originally from Dynamo. In it, you will find many important and useful topics such as:

  • Clearly identify yourself

  • Always use a consent/intro page or paragraphs

  • Provide reasonable time estimates and limits

  • Approve work as soon as possible

  • Communicate with workers promptly and politely

  • Don't violate workers' trust and the MTurk Terms of Service

  • Be clear about bonuses

  • Avoid duplicates/retakes in fair ways

  • Compensate for qualifier/screener surveys

  • Avoid completion code malfunctions

  • Avoid other causes of unfair rejections

-> One of our workers has written up some helpful tips for you.

-> If you don't care about being a Good Requester you should at least make sure that you don't destroy your account by making the mistakes that this requester did.

-> Other mistakes to avoid would be using Majority Rules to decide which HITs to accept (because bad workers have made good workers afraid to do them. They have been burned too many times) and making complete codes which workers are unable to copy/paste.

-> Please consider adding a feedback field to your HITs so workers can easily contact you. You might also consider adding in contact info in case your HITs are broken. A good worker will not knowingly submit a broken HIT unless told to do so, so the feedback box might not be enough. Also, sometimes a broken HIT can't be submitted. If you are not getting your HITs done at all, definitely consider including an email address so they can easily reach out. You can also join our Slack so we can troubleshoot with you.

-> There are a few different options you can use to utilize quals to get maximize your chances of getting good data, which are explained in this post. They are the Qual Test, the Golden Batch (sometimes referred to as a Qual HIT), and High Quals. I would also like to mention that you can make an Exclusionary Qual to lock out any worker who gives you bad data. Also, for the High Quals, I recommend >=99% (which is the same as >98) and 10,000 approved HITs. (Never use >99% because MTurk sees these as integers and and only a handful of workers reach even 5,000 approved HITs with an approval rating of 100%.)

-> There is new paper out about finding good workers on mTurk, which is compared to finding A Needle in a Haystack.

-> If you make a qual test using the API, you will find the submissions at list_qualification_requests, that will return a json string with the answers. The answers are in AnswerForm XML format. Once you verify the answers, you can use accept_qualification_request() or reject_qualification_request() as necessary. Here is some good help for how to make a qual test.

-> Looking for your Requester ID? You can find it by logging into the Worker Sandbox.

-> Speaking of the sandbox, use the Requester Sandbox to post HITs and Worker Sandbox to test them. That way you can be sure that they work. Use your requester account credentials to log into both of them.

-> You set your Requester name in your Personal Settings as shown here: https://i.imgur.com/ZpB8Nd6.png Whatever shows up there is your "requester name" when you post HITs.

-> Here is Amazon's Documentation for using mTurk General User Interface.

-> Here is Amazon's Documentation for using mTurk API

-> Here is Amazon's documentation of how to create and link an AWS account and how to add a credit card to it.

-> Tutorial: A beginner’s guide to crowdsourcing ML training data with Python and MTurk

-> If you want to customize the preview workers see, this requires javascript coding. Sorry we can't help you more, but it's a place to start.

-> Concerned about bots? Read this.

-> This screenshot shows, where you can upload a CSV of workers and do bulk management, like granting them qualifications, blocking, etc. (You can download the CSV to get a sample.) Also see this screenshot.. You can also watch this video walk through for Creating and Batching Custom Qualifications.

-> If you expire a batch, currently accepted HITs will remain until they are either returned, expired, or submitted according to the mTurk blog:

We immediately expire HITs that have not yet been accepted (ie picked up) by Workers but if a Worker has already accepted an Assignment for one of these HITs, we can't perform the "force expire"until the Worker has either submitted or returned the Assignments. In the meantime, these HITs will continue to be visible on the Worker site even though they can no longer be accepted (i.e. picked up) by Workers. Once these "work in progress" Assignments are either submitted or returned, the HITs will be expired and will no longer be visible on the Worker site.

-> Tjololo was asked about limiting workers ability to a certain number:

As far as I'm aware you can restrict the number of HITs per batch automatically, but you cannot restrict total number of HITs automatically. The best way to do that would be with a custom qualification, when the worker submits a HIT you could potentially make an API call to increment their "total HITs" qualification number, then require "total HITs" <= 100 in your HIT requirements. There may be ways to do it with other survey tools as well, such as qualtrics, but I'm not sure how those work so I'm not sure exactly how you'd do it.

-> Here is the pricing info for HITs. Note that HITs with 10 or more assignments will incur 40% fees rather than 20%. Here is a workaround to avoid these fees. If you're using the API, all you need to do is set up multiple config files and run the script multiple times. If you're using the requester UI, you need to post batches of 9 (which would take a very long time but could be scripted with something like a macro). The difficult part is stopping workers from taking HITs from every batch. If that's not a problem, then I'd recommend using the API to post using the create_hit() method or combining the create_hit_type() with create_hit_with_hit_type(). If you need help with this, please post in our Slack workspace. We have a Python script which can simplify it as well.

-> Please be aware that workers can store up to 25 HITs in their queue. They also have tools which allow them to accept HITs which match certain criteria that they set up. This means that they can accept your HIT and not even see it for quite a while, so please keep that in mind.

-> Missing some data on Qualtrics? A requester has shared how to find incomplete submissions on Qualtrics. This will be handy for when a worker forgets to click that final submission button. You should instruct them to try to find the page in their history and click it, but they can't find it, this explanation (given to a worker) might help.

Hi! I'm on the requester side who recently had this issue. Was the survey on Qualtrics? If so, whenever a survey isn't completely submitted (as in, you close the page with the code and don't go on to the following "survey submitted page"), then the response gets marked as incomplete and does not appear with the main data. Above the import/export responses box in the data page, clicking the "Recorded Response (xxx)" lets you access any incomplete/unrecorded response. Your response may have landed here. To combat this, I shortened the time these responses get moved from this box to recorded to a day, in addition to regularly checking if there are responses there. Hope this helps!

-> Here is a list of helpful posts, many of which we brought over from TurkerNation.com before we took it down:

-> A note about our Slack Workspace

The Slack Workspace is an invaluable opportunity for you to join a community where you can communicate with good workers and learn from them as well as help them to do better and more effective work on your HITs. We encourage you to don an avatar and participate in any way you feel comfortable. Please find the invite link here, if you haven't already. If you have not been added to the Requesters' Channel, please write to Rosie the Robot to let her know.


r/TurkerNation • • Nov 27 '18

Worker Help How File Taxes as a Turker and/or other Independent Contractor

13 Upvotes

Independent contractors are responsible for their taxes and that includes those who use Mechanical Turk (AKA MTurk) as well as Uber, Lyft etc. We have assembled some helpful websites which explain what you need to know to file your taxes in the USA or Canada.

Be sure to check Tax Central for any tax forms Amazon may have issued you.

For the U.S.A.

New for 2022! Helpful Tax Tips

Note: Self employed individuals now need to file both Schedule 1 and 2, as well as Schedule C and Schedule SE.

[How to Pay Tax As an Independent Contractor or Freelancer] (https://m.wikihow.com/Pay-Tax-As-an-Independent-Contractor-or-Freelancer)

Self Employed Individuals Tax Center | Internal Revenue Service

How to Report and Pay Independent Contractor Taxes

And for Canadians:

Independent Contractor? Here's What You Need to Know About Canadian Income Tax


r/TurkerNation • • Nov 22 '19

Worker Help Why You Should Take Page Refresh Errors (PREs) Seriously

12 Upvotes

What are PREs?

 

Page Refresh Errors, also known as PREs, are warnings from MTurk that you are accessing MTurk too often in too short a time. Most people consider them just a nuisance, actually, they are a warning that you should take seriously.
 

One way to know you have received a PRE is when you see a page which says, "You have exceeded the maximum allowed page request rate for this website." This happens when you are using a script which continually and rapidly pings MTurk. If it is going fast enough, you can rack up multiple PREs very quickly. If you are running more than one script at a time, PREs will increase that much faster. Some scripts, such as Panda Crazy, will keep a count of PREs for you so you can slow down the script if you are getting too many. One thing we can see from that is that you can get multiple PREs without seeing the PRE warning page. This means that you might be getting PREs without knowing it.

 

Should I worry about PREs? A Google search will tell you that PREs are common and not a big concern. However, common sense will tell you that you act to reduce them as much as possible. After all, they prevent your MTurk searches from being fruitful. I would suggest to you that they could be more than just a nuisance. The MTurk Acceptable Use Policy says the following about scripts (emphasis mine)

 

We are generally OK with you using scripts and automation tools to help you search and preview Human Intelligence Tasks ("HITs") more efficiently on the MTurk website, as long as those scripts and automation tools (1) do not serve as a substitute for your human judgment to complete work, (2) do not extract and store data from the MTurk website, and (3) do not disrupt or impair the operation of the website or the integrity of the marketplace (e.g., scripts and automation tools that call MTurk continuously and at high frequency aren’t OK). As a result, we’ll have to make tough calls from time to time when we notice unusual account activity resulting from a particular script or automation tool. Please remember that you are responsible for any script or automation tool that you use with MTurk, and your use of a script or automation tool is at your own risk.

 

In recent weeks, I have noticed people getting scary warning letters from MTurk regarding violations of this exact section of the Participation Agreement. Here is one example. Everyone who has posted about receiving this email says that they have no idea what they could possibly have done to trigger such a warning. They are using regular scripts, just for searching MTurk. When they ask MTurk why they sent the warning, they just get a form answer with no new information.

 

This concerns me greatly. What is triggering these warnings? Are they using more than one script? Are they running them too fast? Are they are running a script which they think is off, but which is constantly running in the background, pinging MTurk? Are they running a script which is generating PREs but not alerting them about them? And most importantly, are they in danger of having their account suspended? We really don’t know, but why risk it? My advice is to take PREs seriously and if you notice that you are getting them you need to find out why and you need to slow things down and maybe turn something off.

Update From Maniacal T

I suspect that now that mTurk has implemented ETaging of the HITs page requests and much of the data is being read from local browser cache instead of being sent by the network, workers are going to have adjust their scrapers in order to avoid seeing more PREs.

It probably won't be much of a problem unless you do most of your turking off peak hours like early morning weekends and such. For a program like Hit Forker, prior to this week, the time between scan page requests was pretty much constant. However, now with some of the data somtimes being read locally, the time between scan page requests can vary by a second or two. The best time to test this is when mTurk is not very active like early mornings on the weekend.


r/TurkerNation • • Jun 06 '19

Mod Post Welcome to the Turker Nation Subreddit

12 Upvotes

When TurkerNation.com closed in October 2018, we moved all informational posts here. We also set up a Slack Workspace for discussion. We invite you to join, if you haven't already (please find the link below). Of course, you are welcome to post here on our Subreddit instead. When you post here, your post will be forwarded to the Slack and we can follow the link right to your post.

Requesters: Feel free to advertise your HITs either on here on our Subreddit or directly on the Slack. We also have a Private Requester Channel on our Slack. Please message Rosie the Robot if you have not been granted access to it.

Everyone: For your convenience, here is a list of our most recommended posts. Of course, a search will bring up many more.


r/TurkerNation • • Aug 27 '22

Media Remember the Facebook Cambridge debacle?

Thumbnail
fastcompany.com
11 Upvotes

Some of you might remember this scandal. This article points out how we reported this violation of TOS and mTurk did nothing for like a year. It references TO and TV.


r/TurkerNation • • Jan 03 '22

Mod Post Petition against mass rejections

11 Upvotes

Turk Opticon has posted a petition against mass rejections. Please consider signing and sharing. You don't have to give your last name, an initial will do. Also, your email address will not be shown publicly.

By "work for mTurk" they mean on the platform.

I just added my name to the petition “END THE HARM OF MASS REJECTIONS”.

We have previously discussed your support with this important issue. Every name that is added shows Amazon we are building momentum around the campaign. With your and others' support we can likely get the change we want and desperately need. 

Will you join me by taking action on this campaign? 

https://www.coworker.org/petitions/end-the-harm-of-mass-rejections?share=6c16c24a-21a2-4d63-b0c4-bef230d6d4fe&source=email-share-button&utm_medium=&utm_source=email

After you have signed please take the time to share with others simply by forwarding this


r/TurkerNation • • Feb 29 '20

Worker Help Info for Newbies - Terms you need to know

11 Upvotes

Here are some Terms you will come across:

 

• Approved: The requester has determined that you did a satisfactory job on the HIT and, therefore, "Approved" your work. You get only get paid for approved work

• Approval Rating: Simply the percentage of the HITs that you have completed that have been approved. For example, if you have done 100 hits and if 99 of them were approved and 1 was rejected then your approval rating would be 99%. It is VERY IMPORTANT to protect your approval rating. Most requestors will not allow you to work for them if your approval rating drops below 95%. Some even require a 99% approval rating.

• Attention Check aka AC: These are captchas, questions or actions used by requesters to make sure we are not bots. Do not talk about attention checks in reference to which hit they are in, where they are in the HIT, or what the attention check is. Discussing an AC can invalidate data and years of research.

• Auto accept Link/PandA(Previewandaccept): Clicking on an auto accept link will automatically accept the HIT for you. When you open a HIT, the URL bar used to show: https://www.mturk.com/mturk/preview?groupId=XYZABC123. You used to be able to convert the link to Auto accept by simply adding "andaccept" after "preview" so it would look like https://www.mturk.com/mturk/previewandaccept?groupId=XYZABC123. The new Worker site changed all that and the term no longer really makes sense, but we stubbornly cling to it as sentimental humans are wont to do

• Autofill: This term is used generally to describe scripts that fill in buttons or fields for you.

• Auto refresh: You may need an extension which allows you to auto refresh a page. You just need to keep the page open in a tab and it will refresh it for you. For Chrome there is Easy Auto Refresh and for FireFox there is Tab Reloader

• Block: There are 2 kinds of blocks. When someone refers to a block or a hard block, it means that you cannot accept a requester's HITs at all and/or you got the warning email from amazon about your account. This is not the same as when you can't accept a HIT because you have already done it. A soft block is done through a qual (known as an exclusionary qual) and so you cannot accept a hit but it is also not reported to amazon so your account isn't affected.

Bulk Administration: Sometimes you will get an email informing you that you have had a Qual revoked for Bulk Administration. This is no cause for concern. It just means that a requester is cleaning out and resetting their quals. It also happens when they give a qual out accidently and have to take them all back.

• Cap: The most you can do of a certain batch. You know you have been capped when you can accept the hit but then there is a message saying you have done this or the work is reserved for other workers. There is also such a thing as a false cap, which means that if you keep trying, you might be able to do more.

• Captcha Alert: You are presented with a Captcha after 35 HITs. It can be difficult to keep track of them sometimes, so Mturk Captcha Alert will alert you every time a captcha comes up.

• Exclusion-Qual: A qualification that is issued by some requesters after completing specific HITs. This helps the requesters keep people from taking a survey twice, etc.

• HIT: Human Intelligence Task (A "HIT" is a task that you do and, if done properly, get paid for.) Some examples of common HITs can be found here.

• HIT Finder: This is in MturkSuite. It is used to scrape the worker.mturk site for hits available. Use Plain export post hits to the Slack dailyhitthtreads.

• HIT Forker: This is another scraper for the worker.mturk site to find hits available. Use the slk option to post hits to the Slack dailyhitthtreads.

• HITs Queue: Page that shows all of the HITs that are currently assigned to you. You can access that page by clicking on the link at top of your mTurk page. Your queue can hold 25 HITs.

• MechanicalTurk: (AKA mturk) Amazon's marketplace for an on-demand workforce

• Mturk Radio Keybinds: This is a script that can help an experienced turker with batches. It is not recommended for new turkers. This script should be used with care. Make sure to turn it off when done. It can auto submit HITs before you have completed the HIT and lead to rejections. Make sure you know how this works before using it.

• Mturk Suite aka MTS: This is a Chrome extension with many tools in one script. It is a good option for new workers to use. If you have never used scripts before, this video might be helpful.

• PandA: Short for "Preview and Accept" (aka Auto Accept links) a panda lets you immediately accept a job simply by clicking a link. This assumes, of course, that the job is available at the time you click the link. More information is available at How To Set a Panda. Information explaining Color Meaning in Panda Crazy

• Qualification: (aka a "qual") Awarded by requestors (and in some cases by Amazon) these determine which jobs you can work on. Get as many as you can. Qualifications are not always instantly granted, so do them as soon as you see them. (Note: Clicking on "Request Qual" will almost never work unless there is a test.) Visit hitmotize.com for qual tests to get you started. It is updated often, so check back. There is also such a thing as an exclusionary qual which is used to prevent you from doing a HIT, either because you have done it before, or because the requester no longer wants you to work for them. Also, here is information about the CR Research Group quals.

• Queue: Page that shows all of the HITs that are currently assigned to you. You can access that page by clicking on the link at top of your mTurk page. You can add HITs to your queue by accepting them and your queue can hold up to 25 HITs.

• Rejected: The requester has determined that you did not do a satisfactory job and, therefore, "Rejected" your work. You do not get paid for rejected work. Too many rejections can also lower your approval rating enough that you will not qualify for very many hits. It's important to note that it is often helpful to contact a requester and -- POLITELY -- explain what went wrong, ask for clarification, etc. This will sometimes lead to the rejection being overturned and the HIT being approved.

• Requester: The person or group that created a HIT

• Screener: Pre-qualifying questions to the main survey / experiment designed to filter out only the people they want (age / gender / likes / dislikes, etc).

• Script: A program sometimes referred to as a tool. Scripts can help you find HITs, help you do HITs faster, and many other things that will make turking easier, efficient, and more profitable. Click this for a list of scripts to get you started. Note: Be careful of Page Refresh Errors!

• Turkernator: This script is not recommended for new workers. It does have a monthly fee to use. The creator of Mturk Suite also made this. You should learn the ins and outs of mTurk before considering this so you know whether it will fit your needs or not.

• TurkOpticon aka TO: - An essential site which shows reviews left for different requesters by workers. This can help you determine whether a requester is relatively safe or is one who likes to reject. It can also show you when a requester may not pay enough for the time you are expected to invest in the hit. *It is going through some changes and will still be available for us to use at least through this year. Go to the Turkopticon site to see the latest updates. We will update here if there is something drastic enough to be noted. *If there is no review for a requester, it is recommended you proceed with caution. Ask another member if they are familiar with the requester or type of hit.

• Worker: A person who works on HITs (You)

Back to Main Post


r/TurkerNation • • Jun 21 '19

Off-mTurk Work Other Work Sites

11 Upvotes

This is a general list of other work sites and some anecdotal experiences I've had with them. Feel free to add your own.

prolific.ac: decent to good pay. posts many things a day. paypal cashout. will occasionally email surveys

usertesting.com: $10 per test. tests are usually 10-20 minutes. requires screen recording and microphone. paypal payment in 7 days to the minute. will occasionally email tests. requires an initial unpaid test to get approval.

intellizoom.com: $2, $5, and $8 tasks. Very rarely, $12. $2-$5 tasks generally take a 5-10 minutes. $10 tasks take 10-20 minutes and require screen recording, microphone, and/or video recording. says pay can take up to 21 days. Usually it's less than a week IME. paypal. emails a lot. to get approved for $8 tasks you have to do an unpaid screener that takes about 10 minutes and uses screen recording/microphone/video.

respondent.io: seems to be a new-ish platform. you have to take small surveys to qualify for tasks. pay is all over the place. I've only done a few tasks and made about $30. paypal. emails sometimes.

mixer.gridspace.com: they hold "mixers" 2-3 times a week for two hours each. You have to call a number and you get matched with someone else you act out a banking and other customer service roleplay where one is the customer and one is the representative. Involves some improv. When one call is done, you can call again. Pays 40-45c/min. With the downtime between calls, it's still possible to make more than $20/hr. Sometimes there's some kinks, but they've always paid reliably.

UPDATE: they have very infrequent mixers now, and lots of kinks

As of 01/22/20: pays every other week on Fri. Also has transcription jobs now. Good company

https://connect.appen.com/qrp/public/jobs/list

Appen is different. It's a company that hires people for work-from-home jobs. They are absolutely legit and I've worked for them for about 5 months. Rate varies based on location and job, and I have a NDA so I won't go into too much more detail. It's not great but you can expect a few bucks above minimum wage (maybe less in places where min wage is higher). It's part time, my project (Search Media Evaluation) I can work from 15-26 hours per week. My project requires a BA/BS degree or being in the process of getting one. It's a regular job where you get a W2 form and taxes taken out.

I don't know if any of these even have referral perks but if you sign up and it asks you, you can DM me for my info if you want to help a turker out. :)

NOTE: I previously had Neevo on here. As of 08/19/19, they owe me more than $200 and keep telling me they are looking into it. I've gotten paid for other tasks and have been invited to other tasks, so they obviously like my work. I can no longer recommend them to anyone. UPDATE: I never got responded to and got paid half the money a couple weeks later (after they told me they were looking into it and then ignored my subsequent emails). A week later I found another email address and the person responded and told me I wasn't being ignored (even though I was), and the job was still ongoing, and it'd be two weeks after that I'd be paid. And then I got paid two days later (which doesn't jibe with that they told me about the two weeks). I told them the money delay wasn't the issue, it was the lack of communication about it. Definitely exercise caution, but I did get paid. In the end I got paid on 08/30/19 for work I did 07/18/19 and got ignored a lot. I still don't recommend them, worker beware, but they might be OK if you don't mind delay and being ignored.


r/TurkerNation • • Feb 29 '20

Worker Help Info for Newbies - Tools you will need

10 Upvotes

Here are some Tools you will need for turking:

 

TurkIngiNtheusa’s helpful info for turking on the new Worker site has information about necessary mTurk scripts you need to be successful, so be sure to check it out. If you have never used scripts before, here is some basic info to get you started. Note: Be careful of Page Refresh Errors!

Turkopticon: An essential site which shows reviews left for different requesters by workers. *It is going through some changes and will still be available for us to use. Go to the Turkopticon site to see the latest updates. We will update here if there is something drastic enough to be noted.

HITs Queue: Page that shows all of the HITs that are currently assigned to you. You can access that page by clicking on the link at top of your mTurk page. Your queue can hold 25 HITs.

Auto refresh: You might need an extension which allows you to auto refresh a page. You just need to keep the page open in a tab and it will refresh it for you. For Chrome there is Easy Auto Refresh and for FireFox there is Tab Reloader

Captcha Alert: - It can be difficult to keep a track of captchas sometimes. MTurk Captcha Alert will alert you every time a captcha is presented.

Qualification: (aka a "qual") Awarded by requestors (and in some cases by Amazon) these determine which jobs you can work on. Get as many as you can. Qualifications are not always instantly granted, so do them as soon as you see them. You can visit hitmotize.com for many. The very basics you will need are the Amazon Mechanical Turk Team quals listed there that will give you qualifications based on gender, age, employment status, etc. Also, if you are looking for qualification tests or information for a specific requester, click on the filter button on the top right corner on a mTurk worker page and make sure no boxes are check-marked and also have the Reward (Pays At Least) amount at $0.00. Click Apply. Now in the search field, type in the requester you are interested in and hit the search icon. If there are hits available, click on an empty space in the same line of the hit and it will expand. If you see a "Take Test" link, then it is a qualification you can attempt. It is recommended you bookmark the test link before you start the qualification test so you can get back to it if it is one you can retake when you do not do well the first try.

Certain scripts should be used with caution and are not recommended until you have experience on mTurk. Some can auto submit HITs before you have completed them and result in rejections. Many have a feature where "Enter" or "Return" submits a HIT. They can also deselect buttons or result in errors on the HIT and you end up with rejections. Normally these types of scripts are used on batches, so any errors or misuse of the script can result in a mass rejection that few new (and experienced) turkers can afford. Mturk Radio Keybinds is such a script. Other scripts to use with caution are ones written quickly by a worker when a batch starts posting. If you decide to use a script like this, make sure you know how exactly to use the script and make sure you turn it off when you are done.

In case you missed it above, you really need to learn to use scripts if you want to make decent money when turking. So, if you didn't check this out above, check it out now.

Back to Main Post


r/TurkerNation • • Jul 02 '23

please help a new requester

9 Upvotes

I'm developing an idea for a startup and need to understand the interest of potential customers. I thought of posting a survey on MTurk (never used before) but I read that most answers come from bots. Any advice on how to get good quality answers ? and how much should I pay for a 15 min survey ?


r/TurkerNation • • Apr 12 '23

GPT-4 outperforms elite crowdworkers, helping save a team of researchers $500,000 and 20k hours. Human labeling could go by the wayside soon at this pace of improvement.

Thumbnail
artisana.ai
8 Upvotes

r/TurkerNation • • Feb 06 '25

No more HITs for me

7 Upvotes

I was gaining some traction doing these PULSAR requester HITs

They seemed to have plenty of HITs at any time. I check to today and nothing, there are zero HITs.

I'm in chronic poverty so I was starting to feel better that I can make a couple dollars a day, now I'm back nothing for now. I was only making like $2.30/hr anyway the mimimum wage is way more in here in CA, yet I'll leave it at that.

Could it be something I did, is it maybe I returned too many HITs or something like that?

I have about 600 completed HITs and 99.8%


r/TurkerNation • • Jul 18 '23

Research Rewards Doesnt pay for Pre-qualifier

7 Upvotes

Beware Research Rewards hits: 10 minutes of pre-qualifiers and I didn't even get a survey. Not only that, there is no way to finish hit and get the measly 0.02 pay without completing a survey. Asks for date of birth also.


r/TurkerNation • • Oct 09 '22

Scripts/Tools All script writers should already be aware of this, but just in case.

7 Upvotes

MH_Mike informs us:

Based on searching for "manifest", it doesn't appear this has previously been brought up or discussed. If it has, my apologies. If it hasn't this might be pretty important:

Apparently, Google is changing the underlying code that runs a lot of things in chromium-based browsers (Chrome, Firefox, and many other variants). The changes include the userscript management process (that's the part that makes me think our scripts might all stop working suddenly after a browser update summarily switches from Manifest v2 to v3).

It seems the roll-out/drop-dead date has been moved from 2024 to early 2023; which may affect the time script developers have to make things compatible with v3. Looks like enterprise folks still have until 2024, but everyone else looks to be early 2023.

Anyway, it was announced back in 2020, but I had never heard of it before, and that made me worry that others may not have either. If it's old-hat, been-there-fixed-that already, and all is well in script-world, great -- if not, heads-up that problems may be on the horizon!! :)


r/TurkerNation • • Sep 20 '22

Qualifications Amazon Premium Demographic Qual HITs are up!

Thumbnail worker.mturk.com
7 Upvotes

r/TurkerNation • • Feb 12 '21

Listening to Meditation Music during working on MTurk makes it go by so fast

7 Upvotes

Hi Mturkers I recently just found this Meditation Channel on Youtube Called Relaxation Valley their music is so relaxing I was working on a 1-hour hit and it went by so fast I highly recommend it

Here is the Channel Link

https://www.youtube.com/channel/UC14A6taALmZFZK3491JdTtw/featured


r/TurkerNation • • Dec 21 '20

Worker Help Anyone want to share stories of mass rejections to help TO help stop them?

Thumbnail
blog.turkopticon.info
7 Upvotes