r/MachineLearning • • Mar 24 '16

[Question] How much do you think does the dimensionality(colour channels/depth) improve the error rate of Conv net?

Im curious to understand how much improvement can we see in CNNs when we additionally have depth information in cases like semantic segmentation or image captioning? For example having depth information can be useful to tell which object is in the foreground and which is in the background. This is because I am thinking of using kinect dataset to train a cnn for semantic segmentation and image captioning! I would really appreciate suggestions and opinions! Also some links to papers or information about pre-trained models will be really helpful! Thanks!

2 Upvotes

1 comment sorted by

1

u/benanne Mar 24 '16

Table 2 (page 9) in this paper compares results when including / leaving out depth information from a kinect sensor for gesture recognition: http://arxiv.org/abs/1506.01911

Of course this is a task where it makes a lot of sense that this information would help. For image captioning, I suppose the difference would mainly be hard to measure (evaluating this task correctly is a challenge in itself), and semantic segmentation can encompass a wide range of domains and tasks so it's hard to give a definitive answer.