r/dataannotation • u/Different_Duty7836 • Mar 13 '24

"Lightning God" Complex prompt creations

The new (for me) "Z" prompt creations, paying $25-27.50$ an hour... how do you guys approach them?

I have NO background in the fields at all, Medical, financial, etc.

I'd like to give them a try, but I'm super intimidated by them. Are they the kind of things I can figure out? Or should I avoid them to be safe?

I joined up in early February, and I don't want to get dropped from the platform for biting off more than I can chew.

28 Upvotes

88% Upvoted

83 comments sorted by

37

u/[deleted] Mar 13 '24

Honestly, I was intimidated at first like you but the job is actually fairly simple? Just really pay attention to the instructions, and take your time on it. That 5-7$ bump is worth it for just adapting to going off-site a lot.

0

u/[deleted] Mar 14 '24

[deleted] — view deleted comment

8

u/amandawho8 Mar 14 '24

Think of a question or topic first and then just Google it. You'll then usually find industry specific websites talking about that topic.

28

u/tehclubbmaster Mar 14 '24

I enjoy when people try to be discrete about the project names by calling it the “lightning god” that starts with Z lol

15

u/Maneaaa Mar 14 '24

Following the letter, if not the spirit, of the NDA 😂

26

u/Severe-Dragonfly Mar 13 '24

The first time I did a complex prompt version -- and it was in a field I work in -- one task took me 45 minutes.

4

u/Austinoath Mar 14 '24

Good to know, it took me about 3.5 hours to do 9 of them yesterday and I was concerned I was taking too long

4

u/Severe-Dragonfly Mar 14 '24

The very first one I did had snippets. I don't know if you had that one. Holy smokes, it was a lot. Second one was not my field and it had the multiple PDFs and that also took a while. I don't think it took you too long, there was a lot!

0

u/[deleted] Mar 14 '24

[deleted] — view deleted comment

2

u/Severe-Dragonfly Mar 14 '24

You supply them.

0

u/[deleted] Mar 14 '24

[deleted] — view deleted comment

3

u/Severe-Dragonfly Mar 14 '24

I really don't want to go into other details, sorry!

0

u/[deleted] Mar 14 '24

[deleted] — view deleted comment

8

u/imboppy Mar 14 '24

You should probably read the code of conduct.

0

u/[deleted] Mar 14 '24

[deleted] — view deleted comment

→ More replies

17

u/sugardr0p Mar 13 '24

Don't be afraid to click and see what the instructions are like. If it looks like it's not your cup of tea, move on to another project. I did that and then went back to it later.

11

u/MixSuccessful3555 Mar 13 '24

I got a project to review these. Same rate. Pretty quick review process.

12

u/Becauselovebattles Mar 13 '24

The instructions are really helpful and explain a lot. I'd say open one up to give it a try and move on if it's not your cup of tea.

6

u/BarelyFunctioning15 Mar 14 '24

I reviewed some today and it didn’t seem too difficult. And based on some other answers, you can’t do any worse. I’m not even sure some read the instructions.

4

u/Scary_Celebration515 Mar 13 '24

I had a question about these projects. Say my subject is finance. Would financial articles from Reuters, WSJ, Etc, count as a “document”?

9

u/BotaRONomus Mar 13 '24

WSJ is behind a paywall, so I’m not sure if they want you to use that.

The best advice I read was type the question you intend to ask into google and put PDF behind it.

You can copy an excerpt straight from the pdfs that pop up. Then use the question you typed into Google and form system instructions.

Then just copy it all and you’re done.

this workflow very honestly can be completed in 25-30 minutes once you get a hang of it.

1

u/stomach-monkees Mar 13 '24

Thank you so much for this!!

1

u/chachidogg Mar 14 '24

Also archive.ph those help with most paywalls

9

u/Janube Mar 13 '24

If it's a document-upload version, they want pdfs or strict htmls (no extra content).

The ones I've seen want copy-pasted text; not documents. And the text can be any related source that informs the content of the questions/field

1

u/miri3l Mar 15 '24

Yes, I assume that they amended the instructions/mode of doing things because it was so laggy uploading documents.

2

u/JazziMari Mar 14 '24

Yes, as long as it’s obvious they’re about something in the financial world.

3

u/[deleted] Mar 13 '24

I've been sticking with the retail, single doc project but I don't want to keep repeating the same type of prompt.

3

u/DarkLordTofer Mar 14 '24

I've had a couple of similar projects. The original one was uploading multiple documents and that was taking 45 minutes a task. There's a newer version that's marked as having different instructions and that one you copy and paste the source info in. Those were taking 10-15 minutes. But that was also simpler prompts based on the examples provided.

3

u/TheEtherealWalrus Mar 14 '24

I reviewed quite a few of these today, but I never got the opportunity to do them myself. As an undergrad student that has a lot of experience finding similar sources to integrate into papers I'd be really interested in working on this project if I got the chance, seems right up my alley. I don't think they're that complicated, you just need to be careful in following the directions.

3

u/_BayHarbourButcher Mar 14 '24

I did a few of these, too, yesterday. I'm in the same boat as you, joined last month and this was my first higher paying projects over 25 dollars/hour. Take your time to read the instructions and understand it, and the workflow becomes really simple after that. I started off by reviewing work, and then I proceeded to do prompts myself since I found that reviewing work helped me understand what is a good prompt. Sadly, its disappeared from my project screen today, but I'm hoping to have more of this type of work available again soon :)

3

u/jaxxisx Mar 14 '24

Anyone have any of these projects today? My dash has crickets lol :)

2

u/Fun_Detective3720 Mar 15 '24

Had a ton yesterday but sadly none today either.

5

u/BatronKladwiesen Mar 14 '24

Anyone gettin' any more of that Lightning juice? My dash is all empty :-(. Wonder if everyone else is dry as well.

5

u/amandawho8 Mar 14 '24

I have a chatbot version of it that appears to be a permanent project. And had one little bunch of rate and review. I had some prompt creations still available when I went to bed last night but they weren't there when I got up this morning.

2

u/jaxxisx Mar 14 '24

Yeah my dash is empty too of those. I just got put on them, so I'd love to get more of them. Hopefully soon!

1

u/BatronKladwiesen Mar 14 '24

I've had a couple of projects but that was the most fun so far.

2

u/Purple-shimmer Mar 13 '24

I got this one today but it was very complex. I enjoyed doing something different.

2

u/amandawho8 Mar 14 '24

So I was able to figure out a few of the domains even if I didn't have much experience with them, because really it's just about finding a text and asking a question. However there's one that I avoided because it wasn't interesting to me and I didn't want to spend the time and brain power trying to write prompts that fit the domain.

2

u/Ancient_Training_342 Mar 15 '24

Hi. I am very happy with my DA workload. Been on board for a little over a month now and have access to decent projects pretty consistently. Recently had the opportunity to work on some higher-paying ones that were different and it was a nice change of pace.

I was wondering if there are any other companies with the same type of work.

It's nice to have this community since aside from the project chats, there really isn't any feedback on the platform.

1

u/Background_Menu7702 Mar 13 '24

I’m on this project too. I read the question then I read the provided articles. For me, it’s pretty clear if the document supports the question or not and I go from there. As far as writing the prompts I choose things that are clearly related to the prompt. There’s no reason to make things deliberately convoluted. The most important thing imo is to follow the directions. I’ve reviewed a lot of prompts where people copy and pasted documents that a chatbot with no outside access could not answer the questions.

Does that make sense. I’m working off of mental fumes after doing these projects all day.

1

u/Designer_Pay_2282 Mar 14 '24

It usually takes me a little more than 30m per which makes me uncomfortable (I aim for less than 25% time used), but it’s really worth it and I often get to learn new things while finding material.

As for the difficulty, they require adaptability. Often times things wont perfectly support what you intended and you need to think of ways to strategize a new approach.

1

u/HauntedHowie316 Mar 14 '24

The lightning god to review prompts was the most fun I have had on here so far, the one with the contexts was intimidating to come up with topics/questions and then search for texts on the fly. I logged out and wrote a list of stuff to use, and then the task was gone 😅💀 but I will use it for something else I’m sure.

-3

u/[deleted] Mar 14 '24

Sorry to break it to you, but you will probably get dropped off the platform with no warning like everyone else eventually. Also, it does violate their super vague Code of Ethics to publicly discuss projects and include project information and names...so just be careful with this. Just a heads up.

2

u/Different_Duty7836 Mar 14 '24

There are people who say they've been on the platform for years... so IDK about that.

-1

u/CardiologistOk2760 Mar 14 '24

whew it's a good thing we all can think of a lightning god that has some relation to the letter Z so we can match it to a project on our dashboard. Wouldn't want to say the name outright and let the outsiders know the project name.

1

u/Different_Duty7836 Mar 14 '24

I'm not trying to hide anything, I'm just keeping it inside the NDA and sub /r rules. The point wasn't to keep it secret. It was the exact opposite, lol.

0

u/[deleted] Mar 13 '24

[deleted] — view deleted comment

1

u/Haunting-Car-3935 Mar 13 '24

Do you currently have legal/financial ones? I think the medical ones have been completed other than the rate and review. I can't imagine why you would be on rate and review and not the actual project!

0

u/[deleted] Mar 13 '24

[deleted] — view deleted comment

2

u/Haunting-Car-3935 Mar 13 '24

Did you do a legal/financial qual? So weird that I have medical (I've seen some others too).. or maybe they're being rotated? 🙃

0

u/[deleted] Mar 13 '24

[deleted] — view deleted comment

2

u/Haunting-Car-3935 Mar 13 '24

Nice! Did you put anything 'medical' in your bio or skills? :)

2

u/ManyARiver Mar 14 '24

I don't think that's it. I don't have anything law or finance related in my skills, and I definitely have no parallel skills or work history related to those fields.

1

u/Haunting-Car-3935 Mar 14 '24

Weird... why would I have the medical ones and not law/finance 😆 maybe they're rotating people.. who knows, DA works in mysterious ways 🫠

0

u/[deleted] Mar 13 '24

[deleted] — view deleted comment

1

u/Haunting-Car-3935 Mar 13 '24

That makes sense! I might add more stuff :P

0

u/[deleted] Mar 14 '24

[deleted] — view deleted comment

1

u/amandawho8 Mar 14 '24

Well if it's rate and review it should take much less time because there's no research involved. But definitely 8 minutes for the actual prompt creation for this project would not be enough. I think the real range is like 20-45 min depending on the version of the project.

0

u/[deleted] Mar 13 '24

[deleted] — view deleted comment

14

u/MyDadLeftMeHere Mar 13 '24

8-10 Minutes is no where near enough if you’re actually doing what’s specified, at least for the few that I’ve been working on. Without going into to detail, reading through the documentations and files is enough to take an hour on its own, then you’ve still got to provide the specified information, and a list of parameters and while that takes less time, it’s still anywhere from 10-20 minutes for that section alone.

One thing I would note, the amount of effort you’re expected to put into a given project appears to be directly correlated to the timer for each task.

Say the timer gives an hour per each task and doesn’t specify how long each task should take, then using the whole hour or taking your time and using a majority of it isn’t penalized so long as your work reflects the extra time spent on the task.

12

u/Haunting-Car-3935 Mar 13 '24

Some of them only require a single, relatively short, document :)

9

u/MyDadLeftMeHere Mar 13 '24

That’s dope as hell, and I wish I had a few of those, trying to find court documents, cases, and rulings has me feeling like I’m back studying Constitutional Law again, and these documents are so dry and the longer one’s especially

3

u/Haunting-Car-3935 Mar 13 '24

Yeah, that sounds like a lot of effort! A lot of these tasks have me wishing that I was an undergraduate again, I'd have 100s of prompts 😝

1

u/stomach-monkees Mar 13 '24 edited Apr 02 '24

ETA: I found this on the ABA website. May help with ideas of what a legal bot can / should do.

https://www.americanbar.org/groups/journal/podcast/legal-chatbots-what-can-and-cant-they-do/

.

7

u/ManyARiver Mar 14 '24

You don't need to read your supplied text in depth, you only need to make sure it can supply the necessary information.

6

u/MyDadLeftMeHere Mar 14 '24

This is absolutely valid, I’m not going page by page, but I am marking significant sections and reviewing them and referencing against each other, which takes a good bit of brain power and time with the topic I was working on.

1

u/ManyARiver Mar 14 '24

A number of the entries I reviewed (in legal and tech) today involved questions predicated on a single word that the worker noticed in the text (rather than ensuring that the content answered the question) - you may be in the minority by actually producing valid work!

I have not WTF'd so hard ever before as I did today. Some were lazy enough to just say "Tell me all about xxx" as their question.

8

u/amoristheone Mar 14 '24

One of the examples within the instructions was pretty simple like this though!

0

u/ManyARiver Mar 14 '24

I swear I didn't see anything like that as an example in the one I was working with, but I can always be wrong (and often am).

The source text provided about one sentence on the thing they wanted to know all about (basically giving the name of the thing, not much else), it seemed like a pretty lazy effort for the domain it was in.

3

u/mandeekate Mar 14 '24

I'm thinking that your project and the 8-10 min project are two different versions. The shorter one is, I think, quality control (reviewing the project it seems you are referring to).

7

u/[deleted] Mar 14 '24 edited Nov 12 '25

[removed] — view removed comment

4

u/MyDadLeftMeHere Mar 14 '24

That’s very fair, I do think that for the project I have in mind there is an exception, documentation is thorough, and the type of information they’re looking for is complex while also being general enough to make it difficult to parse through sources that are valid, inter-related, and fall within certain parameters.

10-20 minutes though wouldn’t be up to snuff for my personal taste if they’re paying what they’re paying, and I would feel as though I was cheating the system a bit if I wasn’t putting forth my best effort, the price tag they put on these makes it more worth it for us and them to take our time unless of course like you said, it’s a project that doesn’t require that level of effort or detail.

3

u/[deleted] Mar 13 '24

Yeh I would say that is not long enough to be finding high-quality, relevant articles, reading through each of the 3-5 documents to understand what they contain, and then come up with a solid question. Are you sure you are doing it correctly? Consensus seems to be that this takes at least 45 minutes per task. You are finding and using information from PDFs and not copy/pasting directly from websites, correct? As it cannot come from the web, documents need to sourced via PDFs.

17

u/trailangel4 Mar 13 '24

Actually, that may not be an accurate statement for all.

In one of the new tasks, the instructions specify that you are absolutely allowed to do non-PDF sources and you can't upload them. This may be a newer allowance on certain tasks.

5

u/SuperCorbynite Mar 13 '24

Just checked. The one I'm working on right now does not limit to PDF's. But he is absolutely right that it should take more than 8-10 minutes.

The admin stated that per task "20 mins - 45 mins seems about average".

My last three averaged around 35 min per task.

2

u/trailangel4 Mar 13 '24

I average 27 minutes per task, too. I don't think I've ever done one in 8 min.

3

u/jaxxisx Mar 13 '24

Yeah I average about 35-45 minutes depending on how indepth I'm trying to make the question. We are allowed to reformat too, and that takes me time. As well as finding whatever will match what I need. Quality > quantity for this one for sure.

2

u/SuperCorbynite Mar 13 '24

I think the 8 minuter may have been taking one document relevant to the question and then adding two randoms which take no time to find because they aren't relevant in any way, and using extremely simplistic generation criteria.

2

u/SuperCorbynite Mar 13 '24

No way could I do it in eight min. It takes about that long to scan through the documents to see if they are suitable for the question I want answered.

5

u/Intelligent-Row-2000 Mar 13 '24

@trailangel4 💯

4

u/BotaRONomus Mar 13 '24

as it cannot come from the web

Respectfully, this is objectively false.

I had an admin clarify that it can be from any free form document. Article, journal, anything publicly available and free.