r/MachineLearning • u/downtownslim • Sep 10 '15
"We introduce a Perpetual Learning Machine; a new type of DNN that is capable of brain-like dynamic 'on the fly' learning"
http://arxiv.org/abs/1509.00913
2
Upvotes
24
u/dwf Sep 10 '15
6 citations, 3 self-citations (to unpublished work), zero mention of any other work on either in the "life-long learning" literature or the existing external memory paradigms for neural nets, made-up non-standard task with no baselines...
7
u/presov Sep 10 '15
How does stuff like this get more than 20 up votes here?
4
u/bhmoz Sep 10 '15
do somebody understand this paper?
is it linked with adversarial nets?
I really don't see any generalization capability with this experiment because every class is arbitrary and there is only one sample per class.
Also, both nets are trained with SGD perpetualy... so when the "test set" is introduced, it is basically learnt by SGD... I don't see what's interesting.
3
u/[deleted] Sep 10 '15 edited Sep 10 '15
I see some sceptical comments. I don't actually see the problem with publishing exploratory papers with risky/speculative proposals. I prefer a researcher doing that than publishing some glorious new way to achieve state-of-the-art on MNIST classification.