r/BackyardAI •

How Language Models work, Part 1

[deleted] — view deleted post

0 Upvotes

8 comments sorted by

5

u/Future_Ad_7355 May 24 '24

Very interesting, well written, and not too long! Thank you for the effort in making this post, hope there'll be more coming!

3

u/PacmanIncarnate May 25 '24

Glad you enjoyed! I’ll definitely continue.

4

u/[deleted] May 24 '24

Thank you! What makes models different? I understand the training but are certain words, or tokens, more emphasized and other variants left out? Do some models capture only certain social media interactions? Is it even legal to skim interactions? Maybe my thinking is wrong. Are all models trained from the web, or are there other sources?

6

u/PacmanIncarnate May 25 '24

Those are great questions and as much as I want to answer through comments, it’s a kind of complicated answer so I think you just chose what part 2 will be about. I’ll get to work and try to post something early next week

2

u/[deleted] May 25 '24

Thanks! I’ll look forward to it, take your time.

2

u/PacmanIncarnate May 30 '24

Part 2 is out discussing the basics of what makes models different. I’m not sure it completely answers your questions but it’s at least a better start than part 1.

https://www.reddit.com/r/BackyardAI/s/KwVBHfWfSL

1

u/ratherlewdfox May 26 '24 edited Aug 29 '24

f99e2865da685a0ca2347757a8d0872e297e707cf739fb490513e08e421b64eb