Texton clustering for local classification using scene-context scale

Scene-context plays an important role in scene analysis and object recognition. Among various sources of scene-context, we focus on scene-context scale, which means the effective region size of local context to classify an image pixel in a scene. This paper presents texton clustering for local classification using scene-context scale. The scene-context scale can be estimated by the entropy of the leaf node in multi-scale texton forests. The multi-scale texton forests efficiently provide both hierarchical clustering into semantic textons and local classification depending on different scale levels. In our experiments, we use MSRC21 segmentation dataset to assess our clustering algorithm and show that the usage of the scene-context scale improves recognition performance.