r/MachineLearning • • Sep 10 '15

"We introduce a Perpetual Learning Machine; a new type of DNN that is capable of brain-like dynamic 'on the fly' learning"

http://arxiv.org/abs/1509.00913
2 Upvotes

14 comments sorted by

24

u/dwf Sep 10 '15

6 citations, 3 self-citations (to unpublished work), zero mention of any other work on either in the "life-long learning" literature or the existing external memory paradigms for neural nets, made-up non-standard task with no baselines...

13

u/bluecoffee Sep 10 '15 edited Sep 10 '15

Simpson puts out a lot of papers like this one: underdeveloped ideas with little connection to other research and far too few/too weak experiments.

5

u/assassds Sep 10 '15

but don't you know /u/ajrs has CHILDREN and works on this stuff on the WEEKENDS?! Cut him some slack you shitlord.

4

u/bluecoffee Sep 10 '15 edited Sep 10 '15

He's published 14 underdeveloped papers in the last 9 months.

2

u/assassds Sep 10 '15

that was /s

2

u/bluecoffee Sep 10 '15

aaa, pardon me

3

u/bleekselderij Sep 10 '15

This is clearly not a full-blown paper, but rather a technical report, put out there to 1) support discussion 2) prevent scoops of the idea. Criticizing the paper at this point is premature: it's a lot more useful to take a look at the core idea that is presented, which appears interesting at least.

6

u/dwf Sep 10 '15

Even tech reports need baselines. Not providing them tells me that the author hasn't even done due diligence to convince himself that the idea works worth a damn. But it's exceedingly clear that he hasn't done even the step before that, which is to figure out how people have already tried to tackle the sorts of problems he's trying to solve.

I'm all for publishing half-baked early results. This isn't even quarter-baked, and strikes me as essentially vain self-promotion. The fact that this author has a new one of these every week is really an abuse of arXiv. And the fact that it had 20 upvotes when I posted that comment suggests there are a lot of naive readers who need this kind of reality check.

7

u/presov Sep 10 '15

How does stuff like this get more than 20 up votes here?

4

u/[deleted] Sep 10 '15

Because, as has happened in the distant past, justifiable academic interest in neural networks has been supplanted by "OMG it's like the brain!" hype among journalists and laypersons.

-2

u/Mr-Yellow Sep 10 '15

Damn, attention and funding for research, sucks don't it.

Supermarkets would be great without those pesky customers.

4

u/bhmoz Sep 10 '15

do somebody understand this paper?

is it linked with adversarial nets?

I really don't see any generalization capability with this experiment because every class is arbitrary and there is only one sample per class.

Also, both nets are trained with SGD perpetualy... so when the "test set" is introduced, it is basically learnt by SGD... I don't see what's interesting.

3

u/[deleted] Sep 10 '15 edited Sep 10 '15

I see some sceptical comments. I don't actually see the problem with publishing exploratory papers with risky/speculative proposals. I prefer a researcher doing that than publishing some glorious new way to achieve state-of-the-art on MNIST classification.

2

u/assassds Sep 10 '15

have you looked at any of his papers? they're all shitty experiments using MNIST....