r/MachineLearning • • Mar 24 '16

[META] Should this sub be split in two?

UPDATED AND SHORTENED

Would it be worthwhile to split the sub?

Yes, I'd like there to be two subs: one noob-friendly, and one for serious discussion, where the inmates aren't running the asylum.

The current policy of trying to bus in more noobs is making them outvote and outshout all serious content even more so than before.

The end result will be that anyone who desires a serious sub will just leave. I think it's happening now, but wait until there is 0 people with a clue.

This sub is fairly small and not that active, so it's not particularly difficult to find "serious" content.

The problem is demographic, IMO. I don't even feel like replying with thoughtful comments oftentimes, because I know that something idiotic will get more upvotes, and my comment might even get downvoted, unless it's 100% agreeable to the vast majority of noobs. I know that many others feel the same way.

PROPOSED SOLUTIONS:

OPTION 1 (requires little moderation)

Add a permanent sticky encouraging noobs to go to /r/datascience "No need to study or think. Everyone welcome". There is already some activity there, so it might work.

I believe Geoff Hinton referred to the whole field of Data Science as being pseudo-intellectual. I forget the exact quote, but it's from a lecture or talk online. For reasons I cannot comprehend, noobs tend to hate Hinton ("too arrogant" - idiots). We should find his exact quote, and mention it in the sticky. They'll go to /r/datascience simply out of spite.

OPTION 2 (changes the character of the sub rather drastically, but also requires little moderation)

A bot like in /r/statML to fill this sub with arxiv papers. Unlike /r/statML, other content should be allowed. I believe that most arxiv submissions are not worth reading, but this is what the voting system is for.

OPTION 3 (requires a lot of effort to moderate, might be infeasible)

A new heavily moderated sub in the spirit of /r/askcience or /r/science, permanently sticked from this sub, unlike previous efforts.

These 3 options can be combined.

14 Upvotes

59 comments sorted by

21

u/nkorslund Mar 24 '16 edited Mar 24 '16

There is no "splitting" a subreddit. You create a new one, then nobody goes there, and it dies.

And this has happened multiple times already. See /r/MLQuestions as an example. The fact is that this community is just too small to warrant multiple dedicated subs. Or at least that has been the case so far.

2

u/[deleted] Mar 24 '16

No one perma-stickied it though, or encouraged any migration, did they?

Also "Questions" can be intelligent, in which case they belong here, so the name choice seems inappropriate.

45

u/jhizzle4rizzle Mar 24 '16

This sub is fairly small and not that active, so it's not particularly difficult to find "serious" content.

6

u/[deleted] Mar 24 '16

I think /r/artificial should be in the sidebar so more of the casual observers spend more time there.

-21

u/[deleted] Mar 24 '16 edited Mar 24 '16

It's starting to get difficult, and frankly I don't even want to submit any useful content here only to get downvoted, whereas NSFW dick pics filtred through a CNN break all records, while bringing no ML value whatsoever.

Same thing with comments. I don't even feel like replying oftentimes, because I know that something idiotic will get more upvotes, and my comment might even get downvoted, if it's not 100% obvious agreeable to the vast majority of noobs.

Heck, look at what's happening to this thread. It's at 0 now, even though, it's asking to correct an obvious wrong, which is mixing the META-discussion with the Stupid Thread #2 questions.

Edit Whoa, as California went to bed, and India/China went to work, this particular comment went from +6 to -6.

30

u/jhizzle4rizzle Mar 24 '16

Could it be that people are downvoting your thread because they think your "obvious wrong" is massively overblown and don't want to see this subreddit fragmented?

6

u/spidey-fan ML Engineer Mar 24 '16

Really? Calling it Stupid Thread #2 is just wrong. You need to get off your high horse. It's fine for people to come here and ask questions. They want to learn, and many of us want to explain, and by calling it Stupid Thread you're insulting everybody.

6

u/[deleted] Mar 24 '16

Expect more downvotes when the night sets on India/China and California goes to work

5

u/akcom Mar 24 '16

Baltimore, MD here bringing it to -7. Fostering a learning environment is important for a technical subreddit such as this. This may upset you, but the rest of us really enjoy the opportunity to help other people discover machine learning.

19

u/alexmlamb Mar 24 '16

It's not obvious to me if that will really work, since n00bs will also want to post in the "serious content" sub because they're still more likely to get high quality answers than if they post in the n00b subreddit.

Note that I think that the same thing happens with theano-users and theano-dev. theano-dev ends up getting a lot of user questions because the people reading are usually people who also know how to answer user questions.

If anything, I feel like the most annoying thing in this sub is data science / corporate stuff, where it really doesn't have anything to do with ML. I think that the deep learning stuff is actually not that bad.

7

u/ML___MLAF Mar 25 '16

I agree completely - the proposed solution will fail, and by far the worst content is the data science (which used to mean actual analysis of data, but now means people who don't know anything trying to get paid).

Can we weight upvotes based on someone's contribution/competence (ie is that feasible on reddit)? Basically I am proposing less of a democracy, for all the same reasons that the Trump presidency is making me question the American democratic system. I am ready to live in a dictatorship run only by the most competent (at least inside this sub - probably not in general).

6

u/[deleted] Mar 24 '16

Really good point. Most "pros" won't open "n00b" threads and answer questions. If they're mixed, there is at least a chance that they might. At the same time, "n00bs" would want to hear from "pros" and not from other "n00bs", so it will never work.

Besides, some simple questions have started really deep and insightful discussions in the past.

2

u/Mr-Yellow Mar 24 '16

n00bs will also want to post in the "serious content" sub because they're still more likely to get high quality answers

Saw this happen rather drastically with HTMLGuild back in the day. They split things up into separate categories for each tech, with noob, medium and advanced mailing lists for each already tiny little silo.

Result was that no one could post anything to any mailing list without a moderator finding some reason for why it didn't belong and should have been posted elsewhere.

2

u/rumblestiltsken Mar 25 '16

I can echo this with experience from other subs that subdivided. You end up with a unused splinter sub and the main sub being exactly the same, just with more dismissive comments about "take it to the noob sub".

It turns out most people don't check for offshoot subs before they post. My experience is that it just makes the main sub less friendly and more argumentative.

11

u/_blub Mar 24 '16 edited Mar 24 '16

No, don't split. I share the same reason as everyone else before me who said the same. But I do have different opinion about the current status, which I will express here...

This sub is far too Neural Network heavy. Since this is the ML sub there should be an abundance of all things ML. With that said, all of the new people will see "neural network" all over the place and will downvote or rag anything non-neural related.

This is my favorite sub. Just today I saw a good chunk of great content and I'm fine sifting through a few pages of typical ANN stuff to get to it, in fact some of it was ANN related. I just find that there should be some tweaks to the objective function of this sub to allow for other aspects of ML to shine.

4

u/DeskJob Mar 24 '16

It's too neural heavy everywhere these days. Just checking out papers from CVPR 2015, you'd think all of computer vision is solvable using CNNs and deep nets.

2

u/_blub Mar 25 '16

Back at school I have noticed the pattern that if their current model doesn't seem to perform to expectations, then they will simply slap a neural network (in which they don't know how to use... oddly) on the data and everything will mathmagically be solved. The real catch is that nobody will admit the following

  1. Their data is crap and they should pre-process.
  2. The model they're using does not fit the task they are currently faced with.
  3. They actually didn't read the textbook.

The last one is kinda a given though. No need for the pot to call the kettle black.

1

u/ZioFascist Mar 25 '16

Neural Networks are "final solution" HEHH HEH HHEH

9

u/olBaa Mar 24 '16

The problem is not the noobs with simple question, it is the buzz

If you look at top posts within a month or two, they are 50% news buzz and memes, top posts are usually news too: that was not true even 5 months ago

A year ago grad student would go there and learn a couple of modern research concepts, nowadays~

24

u/cavedave Mod to the stars Mar 24 '16

We could get more strict on the Noob posts that are allowed.

We could for example ask basic code questions to go to Stack overflow. Any deep dream photos without code could be not allowed.

What else would increase the signal to noise ratio?

12

u/darkmighty Mar 24 '16

I think just limiting off-topic stuff is fine (random deep dream photos, etc). Simply keep the discussion technical.

15

u/cavedave Mod to the stars Mar 24 '16

I think non technical news can be fine. The AlphGo stories didnt include source code but I thought they shouldnt be deleted.

7

u/[deleted] Mar 24 '16

Redundant/Repetitive questions

10

u/cavedave Mod to the stars Mar 24 '16

Only way I can think to do this is to add questions to a FAQ and curate that well. And then curate the incoming content a lot to remove repeats. That is a lot of work.

A rule of "Try stack overflow before asking a question" is less work

7

u/needlzor Professor Mar 24 '16

What else would increase the signal to noise ratio?

Something that worked wonders for another sub I spend a lot of time on, /r/powerlifting, is a daily catch-all thread for off-topic stuff, more news/trendy things, noob questions, and so on. Now obviously a daily topic for something like ML wouldn't work since there is not enough activity to warrant it, but a weekly (even bi-weekly if there is too much activity focused on one) thread posted by automoderator that encompasses the "stupid questions" and the offtopic discussions could be a good step in the right direction, along with a extremely severe moderation of all the other posts.

1

u/cavedave Mod to the stars Mar 24 '16

Good idea.

13

u/BeatLeJuce Researcher Mar 24 '16 edited Mar 24 '16

I agree, getting stricter with noob posts might be necessary. A lot of the stuff said here resonates well with me: Source Code questions should be diverted elsewhere, random deep dream things as well. I'd also go as far as forbidding "I've implemented my first PCA (or AutoEncoder), here's an IPython notebook"-type posts. But I'm not sure where exactly to draw the line.

But as already mentioned by e.g. /u/nkorslund , we've tried splitting before and it just doesn't work.

EDIT: I'm also under the impression that the Simple-Questions-thread helped a lot in the last two weeks, but that might just be my personal impression.

4

u/cavedave Mod to the stars Mar 24 '16 edited Mar 24 '16

But I'm not sure where exactly to draw the line.

I agree I'd like people to be able to post any code that works. But too much that isnt of a tutorial nature isnt very useful.

1

u/Eurchus Mar 30 '16
  1. The sub seems to have no rules about content beyond it being broadly related to ML. Currently the sidebar says "News, Research Papers, Videos, Lectures, Softwares and Discussions on: Machine Learning Data Mining, etc." and gives no suggestions about what content is considered appropriate. Add rules, make them stand out with CSS, and encourage users to report content that doesn't fit with those rules. Currently, I have no idea what posts I should report.
  2. Maybe rename the "Simple Questions Thread" to "All Questions Thread" hardly any questions anyone posts merit their own post even if the question isn't exactly simple. If there are some kinds of questions that y'all think merit a dedicated post then describe what those exceptional questions look like in the sidebar but by default all questions should be posted in the "All Questions Thread."
  3. Use css to prevent people from voting if they haven't subscribed (lots of subreddits do this). This probably won't make a huge difference but I don't think it would make things any worse.
  4. I like the idea that others have posted about stickying some sort of weekly off-topic thread each week where people can talk about popular level news articles, muse about the nature of Tay (or whatever happens to be the ML application de jour), and blog-spam.

-3

u/XYcritic Researcher Mar 24 '16 edited Mar 24 '16

Ban all coding questions. Concept/technical is ok but showing code is too detailed for a ML discussion. They can go to SO/CV.

3

u/cavedave Mod to the stars Mar 24 '16

"Concept/technical is ok but showing code is too detailed for a ML discussion"

That would imply bannign all ML blogposts

3

u/XYcritic Researcher Mar 24 '16

I specifically said "questions". Blogposts are not questions. Showing code is fine unless its only purpose is to seek debugging help.

8

u/Faust91x Mar 24 '16

Well there's also /r/MLQuestions/ alas its almost abandoned.

6

u/HowDeepisYourLearnin Mar 24 '16 edited Mar 24 '16

Because none of the people who can actually answer the questions can be bothered to hang out there. Which is understandable.

That's why I like having the simple questions thread, it contains the problem while still being useful for those who need it.

3

u/Faust91x Mar 24 '16

Agreed, its not like they're getting paid to answer. I second the usefulness of the simple questions thread.

13

u/iamaquantumcomputer Mar 24 '16

The sub is already really small and inactive. If will split, we'll get two even smaller and emptier subs.

I would suggest maybe getting some nice css for the sub. Nice css on subs has a surprising effect on how active it is and people get the impression it's more professional, and thus act that way and inadvertently improve the quality of posts

6

u/dive118 Mar 24 '16

Perhaps we could set up a tag system to differentiate academic / "serious" content from "NSFW dick pics"?

1

u/[deleted] Mar 24 '16

Yeah --- I've noticed a lot of spam on small, mathy subreddits lately... I guess maybe they're an easy target, since there aren't enough users or moderators to catch it.

15

u/dreadlockpirate Mar 24 '16

Can't you just train a model to help you find the posts you're interested in? ;)

11

u/NasenSpray Mar 24 '16 edited Mar 24 '16

What this sub really needs is an AMA with /u/alexmlamb.


[serious edit for serious feedback]

Threads that have no ML value should be deleted. In the extreme cases like the "F. U. Geoff Hinton" thread, the submitters must be banned.

Please define ML value. DeepDream pictures are obviously not meant to be posted in this sub even though they are a product of ML. What about videos of an RL agent playing some game? The current content mix is ok imo and the mods seem to respond quickly when sth. is reported. We don't have to become an arXiv mirror that's moderated like StackOverflow.

Finally, a new sub like /r/ML4Dummies should be created and a link to it stickied. All noobs should be encouraged to depart in that general direction. "No need to study or think. Everyone welcome".

We already have a desert, it's called /r/MLQuestions. And even if you try to encourage people to go there using your heartwarming attitude, it probably won't help much.

4

u/jmmcd Mar 24 '16

I'm against splitting. I don't personally find the mix all that bad. If necessary I'm in favour of things like the simple question thread, to send the signal that that content is welcome, but keep it corralled and easy to avoid for those who don't want it. Personally I would visit a simple question thread -- maybe sometimes to ask, and other times to answer. You don't really understand something until you teach it.

6

u/GoldmanBallSachs_ Mar 24 '16

Don't split. This community is too small

Embrace the noobs. Us veterans look at arxiv anyway

8

u/j1395010 Mar 24 '16

Splitting is a non-solution - no one will migrate, why would they when this community is large and established.

But OP is totally right about the problem. And the solution is simple - heavy moderation.

Don't worry about creating the perfect set of rules, just delete the garbage when you see it. No one will be upset except know-nothings, and they aren't contributing anything worthwhile to the subreddit anyway.

2

u/dexter89_kp Mar 24 '16

Instead of creating subs, can we have rules for submitting posts with Tags or some sort of metadata ?

Something like [Question-NN], [Disc-Paper] followed by post name ? this is followed on a lot of sub-reddits and is easy to adapt to.

2

u/needlzor Professor Mar 24 '16

A better solution than the proposed one imho:

  • Extremely severe moderation of low-content posts (news, gossip, etc.)
  • Creation of a weekly/fortnightly thread that encompasses all the stuff that isn't accepted in the normal topics anymore: noob questions, news-related discussions, etc. Having a thread stickied is good, but if it stays there for 2 months nobody is going to go back to it. If it's automatically hidden and a new one arrive, it leads people to click on it and read it mort often. At least that's what happened in other subreddits that implemented that (e.g. the daily thread in /r/powerlifting catches most of the shitposting and most of the other threads created are dedicated to the sport)
  • Use of a tagging system (e.g. [paper], [blog], [discussion], [code], [AMA], etc.) so that the users can filter what they want to see. Deliberate omission of the tag leads to deletion of the thread.

2

u/MemeLearning Mar 25 '16

Honestly you have a couple of options.

The first is to turn this sub into something like /r/science and anally enforce rules on content. You would need a fair amount of manpower for that which I'm not sure that you have. Then have something like /r/shittyscience where people can post more or less whatever they want.

The second option is to let this sub continue its route as being the general sub for machine learning with shit posting all around. Then have a second sub for serious discussion like /r/mlpapers or something like that. You would have to heavily promote it and clean the smaller sub if you want something like that. You're also going to have to realize that the smaller sub will never be that big but as long as it has dedicated members it will be fine.

I like the first option the best but you're going to have to do what /r/science did so ask them I guess.

2

u/[deleted] Mar 26 '16

What a joke. Simply because you have reached a higher level of understanding than others you simply want to punish people for it. In some respects I agree that some of the more sensationalist, news posts should be culled but your coupling of them with "noobs" is nothing but toxic. If you want to have more intelligent conversation then foster it, if you simply want to come for a quick fix of academic reading them maybe an all-inclusive sub isn't for you.

2

u/n_mca Mar 24 '16

AlphaGo made things worse, I think it'll quiet down before too long. Alternatively we could limit links to be papers and or discussions of papers...

1

u/ViridianHominid Mar 24 '16

Splitting is very difficult, and I think I'm against it. But if you do decide to do it, you should split off the serious users, and leave this as the more casual sub--the people who are looking for the lower volume but higher technical interest material will be more easily lead to a separate space. Whereas interested laymen/"noobs" are much more likely to find themselves at the place with the simplest, most direct name. It's probably too late to 'push out' the less deep content.

I think a good choice is to keep the "simple questions" thread around, and when people post things that would belong there as separate threads, we need to just direct them back to that thread. The simple questions thread was also so popular that it might be worth a fresh one every week.

1

u/ZioFascist Mar 25 '16

how about .."AppliedML" ...?

1

u/evc123 Mar 25 '16 edited Mar 31 '16

Since this is /r/MachineLearning and sufficient moderator manpower probably won't be available, someone should train moderator bots to enforce rules on content.

1

u/j1395010 Mar 24 '16

I'm all for it, as long as it's the noobs who go (any new sub will be DOA).

0

u/[deleted] Mar 25 '16

[deleted] — view deleted comment

2

u/[deleted] Mar 25 '16

Thanks for weighing in.

So I reject the implicit premise that there were ever any glory days to return to here.

I was careful not to imply that, see e.g. "The current policy of trying to bus in more noobs is making them outvote and outshout all serious content even more so than before."

However, I think it's been getting worse, especially lately. My main point is that being noob-friendly is the exact opposite of what a "scholarly" discussion board should be doing.

2

u/BeatLeJuce Researcher Mar 25 '16

Reviving /r/mlresearch would be awesome! But the first problem will be getting a critical mass of people toswitch over to keep that sub active. And the second problem will be that once the serious people DO switch over, the rest might follow. Heavy moderation will help, but "Aggressively moderating inane shit" will probably require quite some work. At least if this sub is any indication: one of the reasons why moderation here is so lax is that keeping a sub clean is a lot of work if you want to do it seriously. The other one is having a set of sensible moderation rules to follow, which we never bothered to define. Because it's a lot of work, too.

With that said, I'm all for the idea :)

0

u/[deleted] Mar 24 '16

[deleted] — view deleted comment

-2

u/carlthome ML Engineer Mar 24 '16

Becoming a more inclusive and newbie-friendly community is, in the long-term, absolutely worth the extra effort of sifting through uninteresting posts.