recurrent neural networks for semantic instance segmentation
TRANSCRIPT
Recurrent Neural Networks for Semantic Instance Segmentation
Amaia Salvador Jordi Torres Xavier Giró-i-Nieto Ferran MarquésManel BaradadMíriam Bellver
Motivation
2
Semantic Instance Segmentation
- Proposal-based solutions: - Hundreds/Thousands of redundant predictions- Post-processing needed (NMS)
- Holistic & class-agnostic methods- Reduced set of predictions- Separate network for semantics
Motivation
3
- Our solution: - Recurrent model that sequentially predicts binary masks and
categorical labels for each object in an image.- Learns to stop once all objects have been found.- Does not need post-processing on its output.
Semantic Instance Segmentation
Encoder ActivationsCorrelation with convolutional activations in the encoder before and after training