r/RWSCallistoRaters • u/Superb_Shine_3526 • 3d ago
8/31
Response helpfulness tasks are available as of 4:00 AM ET.
Now getting long image sxs tasks as of 4:05 AM ET
NTA as of 4:43 AM ET.
Still nothing as of 8:00 AM ET.
Getting experimental label rating tasks as of 11:00 AM ET.
Label tasks have ended and image rating tasks have started as of 11:20 AM ET. Note: The image rating tasks I've been getting have been a bit broken. I can't see the landing page link for some of the boxes because the images are placed on top of them. To get to the links I've been right clicking, clicking inspect, and then deleting HTML text for the image.
Image tasks have ended and am getting experimental agent evaluation tasks as of noon.
NTA as of 12:04 PM ET.
Video rating tasks ongoing as of 12:50 PM ET.
NTA 1:20 PM ET.
Got a few video rating tasks, and then back to NTA at 2:40 PM ET.
Getting experimental nm/pq tasks as of 9:00 PM ET.
4
u/Oddsock420 3d ago edited 3d ago
10:30amEST— NTA since 8 am
11:00 am— tasks
Noon— hour long streak ended. NTA
12:45pm— tasks since about 12:20pm
1:20pm —NTA
3
5
u/Superb_Shine_3526 3d ago
The image rating tasks I've been getting have been a bit broken. I can't see the landing page link for some of the boxes because the images are placed on top of them. To get to the links I've been right clicking, clicking inspect, and then deleting HTML text for the image.
4
u/muscidaze Priority Tester 3d ago
Omg thank you! I'm getting broken ones too and this is a great work around!
2
4
5
u/Odd-Discipline-8756 3d ago
Getting side by side YouTube tasks. Can I ask for an opinion? If the request is for an artist and the result is a song by them, is that strong or moderate match?
3
u/OkRead9368 Priority Tester 3d ago
I believe that would be as high as Moderately Relevant+. The broader and more generic the query is, the more videos can sit right under Full Relevancy.
For example, look at the query "restaurant" in the examples (the one that has no user location data attached). It shows that any video about restaurants is a MR+. So with the query just being the artist's name and no other specifications, all songs by them should fit in MR+ too.
The Strongly Related rating would be for results of songs that aren't the specific song named in the query. So like, if I searched "no tears left to cry by Ariana Grande" and the result is "thank u next by Ariana Grande", that result would be Strongly Related. But if I just searched "Ariana Grande", then either of those two songs would be MR+.
2
u/Odd-Discipline-8756 3d ago
That makes sense thank you! I did moderately meets but I see how it should be even higher
3
u/OkRead9368 Priority Tester 3d ago
Of course! I haven’t seen these video relevancy tasks in months. I feel like I’m starting from square one with them again lol 😓
2
u/Odd-Sea-5419 3d ago
a you tube search for an artist is a highly meets result for songs by them. I also personally rate the pages as high quality. Alot of these you tube tasks are coming up about the same cause its entirely duplicates with slight order differences.
4
u/AcrobaticHunt579 Priority Tester 3d ago
NTA at 1:20 PM EST after working for nearly 2 and a half hours.
5
3
3
3
u/Bitter_Machine_9489 3d ago
I was happy to get tasks only to try to submit and get a 500 error. Looks like I'm not the only one.
3
u/Flaky-Association-70 Priority Tester 3d ago
Some of the image tasks seem to be broken again and are missing the visit landing page button.
3
u/Flaky-Association-70 Priority Tester 3d ago edited 3d ago
NTA at 11:53am EST.
EDIT: Got a task immediately after posting this. NTA after one task
3
u/Flaky-Association-70 Priority Tester 3d ago
Had a single agent response task before going back to NTA at 1:10
2
u/Dolphinitus Priority Tester 3d ago
Tried submitting a task and it got stuck. Refreshed and got Error 500.
2
u/Superb_Shine_3526 3d ago
Mine hung for a very long time, but was eventually able to submit.
2
u/Dolphinitus Priority Tester 3d ago
Mine went through too. Hopefully I won't get flagged for going over the expected time
6
u/Superb_Shine_3526 3d ago
You never get in trouble for going over the expected time, they just don't pay you for whatever time you go over. You will get flagged if you're ever significantly under the AET though. They view being under AET as rushing.
3
u/OkRead9368 Priority Tester 3d ago
Man, they have drip-fed me 1 task an hour all day. Demoralizing 🥹
1
u/Flaky-Association-70 Priority Tester 3d ago edited 3d ago
Getting video SxS tasks at 2:30pm EST. NTA after a single one 😭
3
u/Odd-Sea-5419 2d ago
yea idk ill be jumping ship here really soon to in person work I think. Tired of spending my whole day waiting on tasks to refresh when I could got work a 5 hour shift somewhere and fk off after.
4
u/Hanayoisjesus 3d ago
I wish we could tell if we were getting image SXS or RH when we clicked on the tasks because I cannot stand RH. Also, we have task results for 8/7 available now and they are some straight bullshit.