Add ability to generate superpixels and label each superpixel

[rsnk96]

It would be nice to have a feature to generate superpixels, and label superpixels in one mouse-click (sort of like a brush, but it labels the superpixel if the mouse has hovered over with the Mouse Button pressed down). An easy idea for this is to run K-means in RGB+(x,y) space, like the SLIC/SLIC-zero algorithm does

A sample implementation of SLIC in C++ is available here, this can be ported to OpenCV.js

[nmanovic]

@rsnk96 , did you try to annotate data using the approach? What is the annotation speed in the case? I like new features but I need some information how to prioritize them. Does the approach give better quality or better speed than traditional methods?

[rsnk96]

This is a feature that is available in LabelBox, sample usage:

I believe this would give better speed in the following cases:

1. Where the objects do not have clear boundaries (hence creating problems in DEXTR/grabcut(not implemented yet)/traditional approaches )
2. When the object has a very non-smooth error (hence drawing a polygon would be painful)
3. In cases where an object has enclaves in between which belong to a different class/no-class

[jrreyes29]

here

How do you can port this to opencvjs because opencvjs don't support this method createSuperpixelLSC()

[rsnk96]

I'm not quite sure I followed you @jrreyes29. Where is that method being called?

[jrreyes29]

Hi @rsnk96 the method in opencv is this one https://docs.opencv.org/4.1.2/df/d6c/group__ximgproc__superpixel.html#gga0024d8bac96a9f0d49bd97665d76ae08a9b397d2eb2d75580b3a481bf8e0edef1

[rsnk96]

Ah, didn't know that it comes as a part of ximgproc now.

I guess that leaves us with no option but to implement the superpixel method in JS from scratch...

[jrreyes29]

but implement that in js from scratch take long time hahahaha that is the idea about opencvjs

[luiztauffer]

superpixel annotation would be awesome!

[patzhang]

Here is an implementation in javascript for Superpixels using SLIC. It has a nice demo that you can try online.

@nmanovic Is the demo good enough to compare?

Also, the COCO-Stuff dataset used superpixels (shown in the paper) in their annotation tool.

[Hommus]

@nmanovic
Any ETA on this feature?

How would one go about implementing a new tool / feature like this? I have created it in Python, I'm just struggling to re-implement it in javascript.