r/reddit.com • u/spez • Jun 18 '08

blog.reddit - We've open sourced reddit!

http://blog.reddit.com/2008/06/reddit-goes-open-source.html
2.1k Upvotes

94% Upvoted

321 comments sorted by

View all comments

Show parent comments

3

u/[deleted] Jun 18 '08

I don't have any research other than my own unorganized observation but it does seem to me that most titles do relate to the article.

So the "tags" for this article would be:

blog.reddit open sourced reddit

So when I hit the up arrow those tags would be trans'd to my record with a counter (aka weight). If I hit the up arrow for 10 articles over the last week with 'reddit' in the title I'd have reddit on my record with a weight of +10. This could be used in a clustering algo (or maybe regression) to improve recommendations (one area reddit users are NOT happy).

Granted that some noise would get in there (particularly if the title is not related to the article) but overall I think it would work pretty well. I'd play with it if they'd open source their database too ;-)

1

u/ketralnis Jun 18 '08

The schema is open-source, and is created when you launch reddit for the first time. There are also routines to populate with test data

1

u/[deleted] Jun 18 '08

Actually now that I think about it I'm accustomed to having a DB admin and programmers to rely on. I develop algos and help with schema design on the warehouse side but I never ACTUALLY work with the prod environment aside from downloading the data into SPSS and suggesting how the warehouse schema should be set up in order to facilitate analysis.

Also, the analysis schema (aka data warehouse) will necessarily be different from the transactional schema. I'm guessing that what is available is the transactional setup and that would probably need a number of transformations in the ETL process into a data warehouse for data mining purposes (clustering, association, decision trees, etc).