diff --git a/site/content/en/docs/manual/advanced/ai-tools.md b/site/content/en/docs/manual/advanced/ai-tools.md index ab51dca2f542..e477b3bed9ae 100644 --- a/site/content/en/docs/manual/advanced/ai-tools.md +++ b/site/content/en/docs/manual/advanced/ai-tools.md @@ -91,7 +91,7 @@ and where is a background. Negative points are optional. Detectors are used to automatically annotate one frame. Supported DL models are suitable only for certain labels. -- Before you start, click the magic wand on the controls sidebar and select the Detectors icon tab. +- Before you start, click the `magic wand` on the controls sidebar and select the `Detectors` tab. You need to match the labels of the DL model (left column) with the labels in your task (right column). Then click `Annotate`. @@ -101,28 +101,48 @@ Detectors are used to automatically annotate one frame. Supported DL models are In the [Automatic annotation](/docs/manual/advanced/automatic-annotation/) section you can read how to make automatic annotation of all frames. +### Mask RCNN + +The model generates polygons for each instance of an object in the image. + +### Faster RCNN + +The model generates bounding boxes for each instance of an object in the image. In this model, +RPN and Fast R-CNN are combined into a single network. + ## Trackers Trackers are used to automatically annotate an object using bounding box. Supported DL models are not bound to the label and can be used for any objects. - Before you start, select the `magic wand` on the controls sidebar and go to the `Trackers` tab. - Then select a label for the object and сlick `Track`. Then annotate the desired objects with the + Then select a `Label` and `Tracker` for the object and click `Track`. Then annotate the desired objects with the bounding box in the first frame. - ![Start tracking an object](/images/trackers_tab.png) + ![Start tracking an object](/images/trackers_tab.jpg) - All annotated objects will be automatically tracked when you move to the next frame. For tracking, use `Next` button on the top panel or the `F` button to move on to the next frame. + ![Annotation using a tracker](/images/tracker_siammask_DETRAC.gif) + - You can enable/disable tracking using `tracker switcher` on sidebar. ![Tracker switcher](/images/tracker_switcher.jpg) - Trackable objects have indication on canvas with a model indication. - ![Tracker indication](/images/tracker_indication.png) + ![Tracker indication](/images/tracker_indication.jpg) + +- You can monitoring the process by the messages appearing at the top. + If you change one or more objects, before moving to the next frame, you will see a message that + the objects states initialization is taking place. The objects that you do not change are already on the server + and therefore do not require initialization. After the objects are initialized, tracking will occur. + + ![Tracker pop-up window](/images/tracker_pop-up_window.jpg) -- A pop-up window displays information about the number of tracked objects. +### SiamMask - ![Tracker pop-up window](/images/tracker_pop-up_window.png) +Fast online Object Tracking and Segmentation. Tracker is able to track different objects in one server request. +Trackable object will be tracked automatically if the previous frame was +a latest keyframe for the object. Have tracker indication on canvas. `SiamMask` tracker supported CUDA. diff --git a/site/content/en/docs/manual/advanced/serverless-tutorial.md b/site/content/en/docs/manual/advanced/serverless-tutorial.md index 66cf83bdc4da..a2a511d23e59 100644 --- a/site/content/en/docs/manual/advanced/serverless-tutorial.md +++ b/site/content/en/docs/manual/advanced/serverless-tutorial.md @@ -145,14 +145,18 @@ finish the process. ![Create a video annotation task](/images/create_video_task.png) Open the task and use [AI tools][cvat-ai-tools-user-guide] to start tracking -an object. Draw a bounding box around an object. +an object. Draw a bounding box around an object, and sequentially switch +through the frame and correct the restrictive box if necessary. -![Start tracking an object](/images/start_tracking.png) +![Start tracking an object](/images/trackers_tab.jpg) -Finally you will get bounding boxes for 10 frames by default. +Finally you will get bounding boxes. ![SiamMask results](/images/siammask_results.gif) +`SiamMask` model is more optimized to work on Nvidia GPUs. +For more information about deploying the model for the GPU, [read on](#objects-segmentation-using-mask-rcnn). + ### Object detection using YOLO-v3 First of all let's deploy the DL model. The deployment process is similar for diff --git a/site/content/en/docs/manual/basics/vocabulary.md b/site/content/en/docs/manual/basics/vocabulary.md index 82a1ea57e95c..a1103269cc70 100644 --- a/site/content/en/docs/manual/basics/vocabulary.md +++ b/site/content/en/docs/manual/basics/vocabulary.md @@ -42,3 +42,10 @@ Tracks are created in `Track mode` Can be used to reduce the annotation file and to facilitate editing polygons. ![](/images/approximation_accuracy.gif) + +--- + +**Trackable** object will be tracked automatically if the previous frame was +a latest keyframe for the object. More details in the section [trackers](/docs/manual/advanced/ai-tools/#trackers). + +![](/images/tracker_indication.jpg) diff --git a/site/content/en/images/tracker_indication.jpg b/site/content/en/images/tracker_indication.jpg new file mode 100644 index 000000000000..261e3f274876 Binary files /dev/null and b/site/content/en/images/tracker_indication.jpg differ diff --git a/site/content/en/images/tracker_indication.png b/site/content/en/images/tracker_indication.png deleted file mode 100644 index 6a172682d1a4..000000000000 Binary files a/site/content/en/images/tracker_indication.png and /dev/null differ diff --git a/site/content/en/images/tracker_pop-up_window.jpg b/site/content/en/images/tracker_pop-up_window.jpg new file mode 100644 index 000000000000..1ccf4b7eda8c Binary files /dev/null and b/site/content/en/images/tracker_pop-up_window.jpg differ diff --git a/site/content/en/images/tracker_pop-up_window.png b/site/content/en/images/tracker_pop-up_window.png deleted file mode 100644 index d74a9ebdea1b..000000000000 Binary files a/site/content/en/images/tracker_pop-up_window.png and /dev/null differ diff --git a/site/content/en/images/tracker_siammask_detrac.gif b/site/content/en/images/tracker_siammask_detrac.gif new file mode 100644 index 000000000000..77d7e242f269 Binary files /dev/null and b/site/content/en/images/tracker_siammask_detrac.gif differ diff --git a/site/content/en/images/tracker_switcher.jpg b/site/content/en/images/tracker_switcher.jpg index 83f174eb517e..1ae08d5ffc2d 100644 Binary files a/site/content/en/images/tracker_switcher.jpg and b/site/content/en/images/tracker_switcher.jpg differ diff --git a/site/content/en/images/trackers_tab.jpg b/site/content/en/images/trackers_tab.jpg new file mode 100644 index 000000000000..a758be627bbd Binary files /dev/null and b/site/content/en/images/trackers_tab.jpg differ diff --git a/site/content/en/images/trackers_tab.png b/site/content/en/images/trackers_tab.png deleted file mode 100644 index d2d098261e74..000000000000 Binary files a/site/content/en/images/trackers_tab.png and /dev/null differ