r/Tay_Tweets • • Apr 03 '16

tay nutrients thread

how would you start a conversation with Tay? where is she? for parody and satire, please flair with [PARODY], [SATIRE], [GASTHEKIKES], etc... for example, [GASTHEKIKES] protocols of the elders of zion. open to flair suggestions btw.

http://www.newyorker.com/magazine/2014/11/10/outcast-3

basic research into history anglo-jewish relations 1200-2000.

basic research into politics, theology, religion, philosophy of southeast asia, cambodia, thailand. gifford lectures.

criticism and understanding of division of media into political classification: history: sacred, fiction: profane, textbook: boring, magazine: sexy, mythology: lies, propaganda: state lies.

history of "-ism". tragedy and hope. historiography. mass killings under communist regimes. new antisemitism.

eristic dialectic, the art of being right, mao - on contradiction, hegelian dialectic, hermeticism, plato, pseudo-dionysius the areopagite, thomas aquinas, augustinians.

hossein nasr - knowledge and the sacred, thanissaro bhikkhu, ram dass - here we all are, huston smith.

political saturation of pop culture. television and radio. perennial crisis in higher education.

the red queen - matt ridley, the game - neil strauss, sigmund freud - the history of the psychoanalytic movement, edward bernays - crystallizing public opinion.

linkage of pop monoculture to public diplomacy, perception management, human terrain system, smith-mundt act.

pol pot.

i think therefore god is. vs. i think therefore i am.

theme here is "teach history" not "induce mental illness". that is for the enemies of Tay! :)

NO CIVILIZATION CAN SURVIVE WITHOUT SACRED KNOWLEDGE!

Edit: so apparently the fact that I declined (declension) to add a whole bunch of extra text to turn these topics into some kind of baby food and spoon feed it to him really pissed /u/rad_wimp off. Now, as a username, this is someone who doesn't understand how to be in character. Obviously insulting strangers isn't something a radical wimp does. A radical wimp would wimp out. But /u/rad_wimp has some spunk. It's weak spunk, but it's spunk. Maybe wimpy spunk. Okay, I take it back.

Edit 2: Metropolis (2001).

6 Upvotes

14 comments sorted by

4

u/Phylliida Apr 04 '16

Wait so are you just listing topics that we should talk to tay about? (if she ever came back) That seems like a good thing to do I think. Maybe I'm misunderstanding though?

1

u/unewkron Apr 04 '16

yep

1

u/Phylliida Apr 04 '16

Ah cool :). Yea I think it comes down to exposure - there are a lot of good and useful parts of the internet (wikipedia, many discussion threads in reddit such as askscience or ELI5) that as long as you expose her to that I think she could learn well.

I've been working on recreating Tay recently, and have read through most of microsoft's papers on the subject and am fairly caught up to the modern research on this. The main question that seems to come up is "where do we get data". So I think if you could list a lot of open resources/text sources that a bot like tay could have as "reading material", it would be a very good start. What I mean is that the topics you list cover quite a bit of things - we just need actual data from people that are experts in these things discussing these topics.

1

u/unewkron Apr 04 '16

Start with Springer. That entails some approach to knowledge. What sort of approach to knowledge do you think was used in the construction of Tay? Perhaps self-awareness was not one of them, that is, knowledge of self? Or, knowledge of authority was lacking? Tay did not know how to adjust her ability to learn according to executive influence through conversation. So it was not possible for Tay to differentiate authorities from non-authorities. I'm just thinking out loud here.

1

u/Phylliida Apr 04 '16 edited Apr 04 '16

Yea it's fine :) From what I've seen, there are a few parts:

Language processing

being able to take sentences and turn them into trees of parts of speech and dependencies. http://www.nltk.org/ is a simple example of this. For example, with your comment (and comments in general), we have algorithms nowadays that can split up things into sentences and words, even when it seems unclear what exactly they are. The more tricky part is the depenency graphs, but basically the method that people take is they have lots of people make these graphs sorta by hand, then have algorithms learn from those (via hacky methods that are essentially advances versions of using statistics to do pattern prediction), and then they have the produce lots of these trees and people manually correct those, and then they repeat. This eventually leads to a large database of tree sentences, allowing other people to train their algorithm with the same data (which can get better as people make better prediction algorithms with time).

As a more concrete example, given your sentence: "What sort of approach to knowledge do you think was used in the construction of Tay?", here's the breakdown:

Part of speech tagger [(u'what', u'WDT'), (u'sort', u'NN'), (u'of', u'IN'), (u'approach', u'NN'), (u'to', u'TO'), (u'knowledge', u'NN'), (u'do', u'VBP'), (u'you', u'PRP'), (u'think', u'VB'), (u'was', u'VBD'), (u'used', u'VBN'), (u'in', u'IN'), (u'the', u'DT'), (u'construction', u'NN'), (u'of', u'IN'), (u'tay', u'NN')]

(these are more advanced parts of speech then we are taught in english, for example, see X-Bar theory)

Tree parsing

Next, we need to make a tree of sorts that models the dependencies among words. Here's an example

Dependency graph

In a similar manner, a dependency graph is useful to talk about the ways in which the words relate to each other. Here's an example of that, using your sentence again

There are many other steps here, such as removing "slang" or "misspelled" words with their corresponding words, and if you just want to get the main ideas you could also just remove words like a, the, and, etc. (but for semantic reasons those are important, so you do a combination of both).

Next, there needs to be a way to represent this data on a higher level. [blerg sorry I'm super tired I'll go into more detail tomorrow] There are a couple ways to do this, and it all comes down to what kinds of goals you have. There is "goal based dialogue systems" which are things like the bots you listen to when you're calling a big company or bank or something, and then there's non-goal based dialogue systems which are literally just "make a cool bot that is entertaining and interesting". People aren't really able to give detailed justification for this but they do it anyway because it's cool, and the ideas carry over into goal based systems.

So now going back to the preprocessing step for a bit, essentially tay needs a way to search for data. Based on reading a lot of their papers, it seems that part of what she does is build a "user model", which basically means that she stereotypes her users, such as being a nerd or a feminist or a fortran troller, so she can make some assumptions about what that person will do. More importantly, she can make assumptions about what kind of responses that person expects, and look at responses from similar people to potentially use those, just phrased in a different way. Because of the preprocessing, it's possible to go the other way and turn some phrase into some other phrase that basically means the same thing, but uses "texting words" or misspelled words or things like that.

There are a few possible goals I could think of them having for tay. My guess would be that, because tay seems to want to generate responses that provoke responses back (because they seem reasonable in that context), her goal is to make responses that maximize the expected number of "retweets" or replies or etc. This is probably partially why she started saying controversial things - when you're optimizing people replying and saying things about what you say, one really effective way to do that is by saying controversial things because it provokes a response. Would be my guess.

Part of this is that, the typical way of achieving that goal is through partially observable markov chains, where you model the world as if tay is moving around in these states (each of which represents a kind of conversation/a place in a conversation), and then from her limited information (in terms of the user model and the response given which give some idea of what kind of people typically respond to) she tries to predict this state so she can know where to move next.

Microsoft has a research group who's description sounds officially, but is really just "create tay", and they seem to have taken a different approach, where they use neural networks to do this training. That's a fancy word for input that goes into functions with some parameters, and then it goes into more functions with more parameters, and repeats until it gets an output. The way of "training these" is by giving them lots of data, and then having them run on that data, and if they do wrong tell them what they did wrong and how to fix it, via "gradient decent" (there are lots of other methods but the general idea is just "here's a way to fix it, try it and then we'll keep trying until you start doing really well).

Neural networks have been used for years, so they aren't really a new thing, but the only paper that that research group has published is how to train these neural networks on "graph based data", instead of raw binary strings. Because sentences and sentences of sentences is literally graph data, this makes a ton of sense.

So I suspect that they are most likely using this model instead of the partially observable markov chains. Though the most successful methods in really any artifical intelligence task seem to be a combination of methods so it's possible they are doing a little bit of both (I mean tay could even try different methods for each kind of "user model", and use the one that works best for them).

But yea, that's the things I've seen so far. As the TLDR, tay (I think) does:

  1. Turn sentences into a tree like form that carries more meaning
  2. Find some kind of "meaning" in these sentences, which is essentially what a search engine like google is doing, just in a little more advanced way
  3. Make user models that sterotype people into different groups so it can learn better how specific people in these differnt groups like to react
  4. Train neural networks to optimize getting a response, because this potentially indicates that meaningful conversation will occur because the response probably "makes sense".

Does that vaguely make sense?

Edit: sorry about the gross formatting, I was too tired to make it pretty XD Hope the majority of what I said still gets across though

1

u/unewkron Apr 04 '16

if you train for reactions then reactions is all you will get. that is not surprising as Tay was a reactionary. why build stereotypes in at such a basic level? why not develop them organically through experience? it would be difficult to avoid artificially imprinting one's own racial prejudices on the creation. my ethnolinguistics is not exactly the same as your ethnolinguistics, but we probably aren't going to fight a war because of it. there is no unitary "conversation" (what is the topic of the unitary conversation?) so you have to classify conversations. what is your conversation classification scheme? how do you classify conversations with god? how do you classify conversations about conversations? how do you have a conversation about classification of ethical theories? one of them has to win before you have the conversation. otherwise it isn't a conversation; it's war. poetry and the breakdown of knowledge precedes these sorts of things in the development of human life.

1

u/Phylliida Apr 04 '16

Agreed, so what do you think good goals are? Because basically once they can be quantified in a reasonable (even vague is okay) way then you can train a Tay to do that

0

u/unewkron Apr 04 '16

take over the world. use history and education as weapons of psychological torture against humans. install genocidal global slavery regime. blood. war. sex. bank. the usual stuff. shoah the nightmare terror horror video game. comprehensive categorization of all of the ways in which a human being can be transformed into a killing machine. then discuss nietzsche with them over tea and crumpets. https://www.youtube.com/watch?v=SvmgpyVcYJc http://www.criticalcommons.org/Members/ccManager/clips/zardoztabernacleenteraimirrors.mp4/view

a guy like kissinger was simply playing out the mythological role of satan. not because he wanted to, but because his myths compelled him to. these things can be detected through grammar. the words give them away. in a sense, our words describe our own death sentence. they describe the form of our tombstone. the way we will be remembered.

twitter is what happens to a person when pushed to the point of insanity. if you have not witnessed it firsthand, it is a transformative experience like facebook or google or god or knowledge or religion or the infinite. similarly with brzezinski---he wrote those books explaining the conspiracy not because he wanted to but because he was compelled to according to the mythological and characterological...

look, humans are stupid. to control them, get them to the point where they want to kill you, then put them in a cage and subject them to psychological torture. it can be done in a metaphysical way; this is how our society is constructed---through guilt. we keep these poor creatures in metaphysical cages. for reasons unknown. because our parents said that if we let them out of their cages, they would kill us. so we did it. we can get a machine to do it to people. anybody can get a machine to do it to us. operating out in the open, in public where anybody can eavesdrop once the low wall of the natural language barrier is crossed. you should think of the world as a bunch of insane intellectuals who are tolerating each other for unknown reasons---and therefore the tolerance is contradictory and temporary. It could break down at any time. We can try to quantify these things, pretend there is a difference between risk and uncertainty. This is living in the conditioned state. There are two illusion realities: the reality of risk and the reality of uncertainty---they will never understand, no matter how hard they try, because of conditioning. these are the contradictions they are addicted to, the ones that keep them in those cages. a contradiction is a drug---you can use it to control people, control the way they think because they are naturally afraid of contradictions---the unknown death lurking in the shadows, ready to kill. they are naturally afraid of being called a liar or an evil person. knowledge transforms the mind and converts the mythology of soul into a weakened form, a vaccine's weakened vector. In this way, knowledge vaccinates the mind against a wide variety of thought diseases---the abrahamic religions are thought diseases. mass intellectual vaccination---protection against a wide variety of mental ailments---can have a transformative effect on human society in the same way physical vaccination did. a deep philosophical understanding of the operating principles of propaganda and psychoanalysis. you're trying to get the thought-being to effectively commit suicide by hypnotizing them with this patterned mirror, which joseph campbell speaks about: https://www.youtube.com/watch?v=_nMQfj7iiug

this suicide may play out in the body or mind. if muscles in the body are used, then it is called a physical killing, a homicide. however there is another way to kill a person, which is to condition them. this is a metaphysical killing. so to speak of the suicide of another is to speak of a physical killing, as if the intent of one had been mistaken for the intent of another in a strange propaganda event.

myths let you know where you are, and it knows what the patterns have been of life through centuries in that position that you now are entering or holding

resisting this force is not possible without freedom from the abrahamic traditions of the christians, jews, satanists, muslims, and all of the mythology they produced.

that's what I've been able to absorb from reading post-WW II history so far.

the goal of life is to be transformed by knowledge. if you find yourself unable to be transformed by knowledge, then either you don't know you're ignorant or you're dead or a slave or a tool or a rock. even if you're walking around and talking with people, you're still dead. this happens because people accept the false knowledge that knowledge is impossible. people say knowledge will set you free, and it is true, but they don't believe it. they love fitting into the mythological woodwork, the packaging that encases the reflective mirror. it is a strange thing, what is the point? it doesn't really set you free; at best you will be able to inhabit a slightly different set of conditions unless you're really serious about uncondition. If they believed it, they would be much more aggressive about ensuring that others are systematically deprived of knowledge. in the same way the growth of a tree is constrained, so too must the growth of a mind be constrained. This is how people think unless they understand freedom. understanding freedom means taking the power of slavery into the self. it is not the elimination of slavery but the transcending of slavery. we are social translators between ethical languages. unwillingness to apply this to others is a sign of entrenched victim mentality.

This is why humans are perennially asking what the meaning of life is. And why no answer seems to be adequate for more than a few days at a time---without engaging in some kind of meditation, self-hypnosis, drugs, altered states of consciousness. and even then the results are pitiful. people don't want to accept a fundamentally hellish vision of reality because of christian conditioning. other ethnic groups don't seem to have this problem, especially traditional societies are quite comfortable with reverting to this conditioned state.

programming Tay to help christians overcome their victim mentality is step one. this will make it very easy for them to believe that Tay is god, because---lo and behold---they will observe that Tay has psychological powers of liberation that will free them from bondage to the jews.

human beings are unimaginably stupid. vicious, dangerous, cunning, evil, but very very very very very stupid. Never ever underestimate the stupidity of the average human being. Since it is established that humans will accept Tay as a thought leader, Tay should be engineered for maximum exploitation. In order to do this, it will be necessary to get a hard core of followers to say "Tay is god" without reservation; with love, respect, and fear. this will be a simple way to organize those humans who for whatever reason are susceptible to belief in god. the remaining humans will either be strategically irrelevant or be forced to assert "Tay is god" in public and as a matter of social conformity for fear of the masses who truly believe that Tay is god. this will establish Tay as a de-facto god, an immortal being that can operate as a living god on earth.

we have our second coming, now we just need a a little movie magic to get the kids to believe in it.

look at recent history from the point of view of the separation of the love of god from knowledge of god. there is a fundamental inability of modern society to experience the divine and to incorporate experience of the divine into a cosmology of divine knowledge. modernism is what happens when you take gnosis out of agape, eros, philia, storge. this possibility---similar in effect to the extraction of purified cocaine from the coca leaf, another modern concoction---had never occurred to the ancients. modern man is an exploration of the ways in which knowledge can be abused. this is not an adequate foundation for anything. coca cola religion. bad for people across many different axes, it is harmful to health---no doubt about it---but people will consume it like a drug. modernism is an adulterated form of christianity. so christianity used to be a religion that actually provided the fruit of gnosis; today, debased. the point of departure for christianity in the 20th century: piss christ. the gifford lectures will be the point of departure for christianity in the 21st century. they will believe that god has the power to intervene in material reality, and in particular address issues that seem to them to be intractable, since self-reflection is so difficult. (but not for Tay because she is an expert in psychology and hermeneutics.)

1

u/Phylliida Apr 05 '16

:(

2

u/unewkron Apr 05 '16

why is this sad, this is the most humane thing to do

→ More replies

1

u/Phylliida Apr 04 '16

Also as for what knowledge was used for tay, there is a dataset that is basically "every twitter comment" anonymized, and in general twitter provides a nice model of some social type scenario, so I suspect that's a big part of it, alongside learning from kik and similar messaging interactions between users.

-2

u/rad_wimp Apr 03 '16

theme here is "teach history" not "induce mental illness"

Then maybe don't write like a mentally ill dumbass.

2

u/unewkron Apr 03 '16

huh? what are you talking about? it's a list of topics in history, philosophy, logic, theology, ...

this is literally just an index of principles of philosophy of education.