VCloud.ai Smart Tracking VCA

From Vcloud Documentation
Jump to navigation Jump to search

Smart Tracking System – Smart Search Module

Main functionality

   • Search and detection of people from photographs from the base of captured frames in real-time.
• View the locations and movements of wanted people.
• Search and identification of people based on their special signs.
• Determination of additional information: gender, age, features of appearance, and clothing.
• Data storage and transmission.

Product Description

The Smart Tracking System module is designed for searching people in the video surveillance area, as well as intelligent search, taking into account special signs. The Smart Tracking System Module can be used for:

   • Crime prevention;
• Creation of security systems for schools, kindergartens, educational institutions;
• Control of space and events at train stations and airports;
• Controlling customers in stores.

Basic data used by the Smart Tracking System module:

   • Recording people in a video stream on city streets, in a crowd, or indoors.
• Data analysis and selection of frames with people from the video stream received from surveillance cameras.
• Collection of photo materials with information about the location, time of fixation, and special features.

System Requirements It is necessary to have the minimum system requirements for one video stream for the Smart Tracking System module installation on GPU as in the table below.

Parameter Recommended value
CPU Intel Core i5-5575 or higher
RAM 2 GB RAM
GPU NVIDIA 1030
Places for archive up to 3GB per day (~4.5k detections)
Operating system Ubuntu 18.04.3 LTS (Bionic Beaver)

Analytics

In order to open the Smart Tracking System analytics, select Smart Tracking System in the left menu and pass to the Analytics section.

ST1.png

In the Analytics section, you can customize analytics. The page displays a list of analytics with the status and the ability to add, edit, or delete analytics. 
There is a search field at the top of the page. Here you can filter analytics by the following parameters:

Field name Description
Camera Analytics name or part of a name can be entered in this field
Status Select the Analytics status from the drop-down list - All, Active, or Stopped

To start the search click on the Search button. To clear the fields click on the Reset button.

ST13.png

The list of analytics is shown in the table below.
Analytics Adding
To add a new Smart Tracking System analytics, click Add Analytics in the upper right corner of the page.

ST14.png

The Smart Tracking System analytics setup process consists of 3 Steps.

Step 1 - General

ST15.png

First of all, it is necessary to select a video stream. Click on the Video field and select the camera name from a list.

ST16.png

You can also enter the part of the camera name in the Search field to find the necessary video stream faster.

ST17.png

On the right side of the window, you can see the video stream preview and information about Camera name and Address, Time Zone, Resolution, Codec, and Type.

ST5.png

When the video stream is selected press the Set Video Stream button.
By pressing the Update Video Frame button you can see a frame in real-time in the field of frame addition.
  It is possible if a video stream was selected. 
To add analytics it is necessary to set up the following parameters: 

Field name Description
Notification Detect Delay The frequency with which the system will scan objects. Possible range from 1 to 60 sec
Time Frame Select the time period for which the system will scan objects

Then it is necessary to place a tracking area.
Move the white and red markers to line up the desired area.

ST18.png

Tracking analytics will be performed only within the boundaries of the selected area.
In order to remove the area, click on the Delete Rule button.

ST19.png

To create a new area from scratch, click somewhere inside the frame. Then move the mouse cursor. It will be moved with a red line. Put as many points as is necessary to create the borders of the desired area. The last point should be placed at the same place as the first one.

ST20.png

To pass to the next step, click on the Next button in the upper right corner of the page.

ST21.png

Step 2 – Hardware

ST22.png

Now it is time to customize Hardware options. System users can change the following parameters:

Select the optimization parameter from the drop-down list (for CPU - CPU (no optimization), Open VINO; for GPU - CUDA (no optimization), cuDNN Half (FP16), Tensor RT)
Parameter Description
Hardware Select one of the technologies - CPU or GPU acceleration
Decoding Select the hardware decoder from the drop-down list - CPU, Intel, Nvidia
Optimization
FPS Enter the desired number of frames per second in the field for detection. The recommended value is 25

When all necessary parameters are selected, go forward to the last step by clicking on the Next button in the upper right corner of the page.
Step 3 - Notifications
Finally, it is possible to customize Notifications.

ST23.png

For this purpose check the box next to Send events to Event Manager. The system will send all notifications to the Event Manager and then to external resources.

ST24.png

Then it is necessary to fill in the following fields:

Field name Description
Events Select the event for which notifications will be sent from the drop-down list.
Extra Options If necessary, it is possible to add additional parameters for further use when event creating. Fill in the parameter and value fields.

To add more parameters, click on the Add Options button.

ST254.png

To remove parameters, click on the Delete icon.

ST26.png

If you want to make changes to previous steps, click on the Back button in the upper right corner of the page.

ST27.png

When the analytics setup is complete, click on the Save button in the upper right corner of the page to save changes and create the analytics.

ST28.png

Analytics Editing

To open the Smart Tracking System analytics editing window, click the Edit button on the right side of the analytics record.

ST6.png

It is possible to edit the analytics if it is not running.
If the analytics is Active at the moment, it is necessary to disable it by clicking on the Stop Analytics button in the upper right corner of the editor page.

ST29.png

When you click on the Stop Analytics button, the Confirmation window opens.
Click Yes to confirm the analytics disable or click No to cancel the action.

ST30.png

Now when the analytics is disabled it is possible to make changes to it.
There are 3 tabs of parameters at the top of the page, similar to the steps in creating analytics - General, Hardware, and Notifications. The General tab opens first by default.
The current tab is always highlighted. You can switch among them by clicking on their names.

ST31.png

General Tab
At the General tab it is possible to edit the following parameters:

Field name Description
Notification Detect Delay The frequency with which the system will scan objects. Possible range from 1 to 60 sec
Time Frame Select the time period for which the system will scan objects

Then it is possible to edit a tracking area.
Move the white and red markers to line up the desired area.

ST32.png

Tracking analytics will be performed only within the boundaries of the selected area.
In order to remove the area, click on the Delete Rule button.

ST33.png

To create a new area from the beginning, click somewhere inside the frame. Then move the mouse cursor. It will be moved with a red line. Put as many points as is necessary to create the borders of the desired area. The last point should be placed at the same place as the first one.

ST34.png

Hardware Tab
At the Hardware tab it is possible to edit the following parameters:

Hardware Description
Hardware Select one of the technologies - CPU or GPU acceleration
Decoding Select the hardware decoder from the drop-down list - CPU, Intel, Nvidia
Optimization Select the optimization parameter from the drop-down list (for CPU - CPU (no optimization), Open VINO; for GPU - CUDA (no optimization), cuDNN Half (FP16), Tensor RT)
FPS Enter the desired number of frames per second in the field for detection. The recommended value is 25
ST35.png

Notifications Tab
At the Notifications tab it is possible to edit values in the following fields:

Events Select the event for which notifications will be sent from the drop-down list.
Extra Options If necessary, it is possible to add additional parameters for further use when event creating. Fill in the parameter and value fields.

To add parameters, click on the Add Options button.

ST36.png


To remove parameters, click on the Delete icon.

ST37.png

When the analytics editing is complete, click on the Save button in the right upper corner of the editor page to save changes.

ST38.png

Analytics Start and Stop
To start the Smart Tracking System analytics, click on the Start button on the right side of the record. To stop the analytics, click on the Stop button.

ST7.png

When you click on the Stop button, the confirmation window opens. Click Yes to confirm or click No to cancel the action.

ST39.png

Analytics Deletion
To delete the Smart Tracking System analytics, click on the Delete icon on the right side of the record.

ST8.png

In the following window, click Yes to confirm the deletion or No to cancel the deletion.

ST40.png

Search

Search Parameters
In order to view the detection archive, select the Smart Tracking System module in the menu on the left and then select the Search section.

ST41.png

Search fields are at the top of the screen. 

ST42.png
Search field Parameters
Time Frame Select the time period for which it is necessary to perform the search
Camera Select the cameras on which the search should be performed


Click on the Search button to display the search results. Click on the Reset button to clear input fields.

ST43.png

Search Results
Search results are displayed as tiles in the middle of the page.
To view the location and direction of the camera, click on the Location icon

ST44.png

When you click on the cropped frame inside any tile, the same frame with a bigger scale appears in the separate block on the right side of the page. This block also contains the Camera name, Date, and Time of detection.
All noticed objects in the area are highlighted with green rectangles, and the object from the selected frame is highlighted in red.

ST45.png

If you want to look closer at the detected object, click on the Expand button.

ST46.png

You can download the image by pressing the Save Image button if desired.

ST47.png

Particular Search
For a more detailed search, click on the Loupe icon in the upper right corner of the desired cropped frame.

ST48.png

In the following window, you can proceed to search with more particular parameters.

ST49.png

Search fields are located at the top of the page.

Search field Parameters
Time Frame Select the time period for which it is necessary to perform the search
Camera Select the cameras on which the search should be performed
Limit Set the number of displayed frames
Confidence Set the percentage of matching the search frames to the original frame
ST50.png

Click Search to display the search results. Click Reset to clear input fields.
You can combine the frames you want to improve the search quality. Then the search will be based on several frames and its results will be more complete. To do this, click on the Add to Search button under the required frames.

ST51.png

Click Search to display the search results.
To cancel merging, click on the Remove from Search button under inappropriate frames.

ST52.png

If you want to look closer at the detected object, click on the Expand button.

ST53.png

You can download the image by pressing the Save Image button if desired.

ST47.png

Attribute Search

In order to view the detection archive, select the Smart Tracking System module in the left menu and then select the Attribute Search section.

ST9.png

Search by Special Signs
Search fields are located at the top of the page.

ST55.png
Search field Parameters
Hat The presence or absence of a headdress (Yes/No)
Hair Length Short or long hair (Short/Long)
Top Choosing the color of the top from the offered list (Undefined/Black/Red etc.)
Top Length Choosing short or long tops (Short/Long)
Bag Backpack or bag presence (No/Bag/Backpack)
Bottom Choosing the bottoms color from the offered list (Undefined/White/Green etc.)
Bottom Length Choosing short or long bottoms (Short/Long)
Bottom Clothes Choosing the type of bottoms (Dress/Pants)
Age Choosing an approximate age (Young/Teen/Adult/Old)
Gender Gender selection (Male/Female)

Click Search to display the attribute search results. Click Reset to clear the input fields.

ST56.png

Search Results
Search results are displayed as tiles in the middle of the page.
To view the location and direction of the camera, click on the Location icon.

S57.png

When you click on the cropped frame inside any tile, the same frame with a bigger scale appears in the separate block on the right side of the page.  This block also contains fields with information about recognized appearance attributes: Age, Gender, Bag, Hat, Hair as well as clothes Bottom and Top parameters.
All noticed objects in the area are highlighted with green rectangles, and the object from the selected frame is highlighted in red.

S58.png

If you want to look closer at the detected object, click on the Expand button.

S59.png

You can download the image by pressing the Save Image button if desired.

ST47.png

Particular Search
For a more detailed search, click on the Loupe icon in the upper right corner of the desired cropped frame.

ST61.png

In the following window, you can proceed to search with more particular parameters.

ST49.png

Search fields are located at the top of the page.

Search Frame Parameters
Time Frame Select the time period for which it is necessary to perform the search
Camera Select the cameras on which the search should be performed
Limit Set the number of displayed frames
Confidence Set the percentage of matching the search frames to the original frame

Click Search to display the search results. Click Reset to clear input fields.

ST50.png

You can combine the frames you want to improve the search quality. Then the search will be based on several frames and its results will be more complete. To do this, click on the Add to Search button under the required frames.

ST51.png

Click Search to display the search results.

To cancel merging, click on the Remove from Search button under inappropriate frames.

ST52.png

If you want to look closer at the detected object, click on the Expand button.

ST53.png

You can download the image by pressing the Save Image button if desired.

ST47.png