VCloud.ai Smart Tracking VCA

Smart Tracking System – Smart Search Module

Main functionality

   • Search and detection of people from photographs from the base of captured frames in real-time.

   • View the locations and movements of wanted people.

   • Search and identification of people based on their special signs.

   • Determination of additional information: gender, age, features of appearance, and clothing.

   • Data storage and transmission.

Product Description

The Smart Tracking System module is designed for searching people in the video surveillance area, as well as intelligent search, taking into account special signs. The Smart Tracking System Module can be used for:

   • Crime prevention;

   • Creation of security systems for schools, kindergartens, educational institutions;

   • Control of space and events at train stations and airports;

   • Controlling customers in stores.

Basic data used by the Smart Tracking System module:

   • Recording people in a video stream on city streets, in a crowd, or indoors.

   • Data analysis and selection of frames with people from the video stream received from surveillance cameras.

   • Collection of photo materials with information about the location, time of fixation, and special features.

System Requirements It is necessary to have the minimum system requirements for one video stream for the Smart Tracking System module installation on GPU as in the table below.

Parameter	Recommended value
CPU	Intel Core i5-5575 or higher
RAM	2 GB RAM
GPU	NVIDIA 1030
Places for archive	up to 3GB per day (~4.5k detections)
Operating system	Ubuntu 20.04

Analytics

In order to open the Smart Tracking System analytics, select Smart Tracking System in the left menu and pass to the Analytics section.

In the Analytics section, you can customize analytics. The page displays a list of analytics with the status and the ability to add, edit, or delete analytics. 
There is a search field at the top of the page. Here you can filter analytics by the following parameters:

Field name	Description
Camera	Analytics name or part of a name can be entered in this field
Status	Select the Analytics status from the drop-down list - All, Active, or Stopped

To start the search click on the Search button. To clear the fields click on the Reset button.

The list of analytics is shown in the table below.
Analytics Adding
To add a new Smart Tracking System analytics, click Add Analytics in the upper right corner of the page.

The Smart Tracking System analytics setup process consists of 3 Steps.

Step 1 - General

First of all, it is necessary to select a video stream. Click on the Video field and select the camera name from a list.

You can also enter the part of the camera name in the Search field to find the necessary video stream faster.

On the right side of the window, you can see the video stream preview and information about Camera name and Address, Time Zone, Resolution, Codec, and Type.

When the video stream is selected press the Set Video Stream button.
By pressing the Update Video Frame button you can see a frame in real-time in the field of frame addition.
  It is possible if a video stream was selected. 
To add analytics it is necessary to set up the following parameters: 

Field name	Description
Notification Detect Delay	The frequency with which the system will scan objects. Possible range from 1 to 60 sec
Time Frame	Select the time period for which the system will scan objects

Then it is necessary to place a tracking area.
Move the white and red markers to line up the desired area.

Tracking analytics will be performed only within the boundaries of the selected area.
In order to remove the area, click on the Delete Rule button.

To create a new area from scratch, click somewhere inside the frame. Then move the mouse cursor. It will be moved with a red line. Put as many points as is necessary to create the borders of the desired area. The last point should be placed at the same place as the first one.

To pass to the next step, click on the Next button in the upper right corner of the page.

Step 2 – Hardware

Now it is time to customize Hardware options. System users can change the following parameters:

Select the optimization parameter from the drop-down list (for CPU - CPU (no optimization), Open VINO; for GPU - CUDA (no optimization), cuDNN Half (FP16), Tensor RT)

Parameter	Description
Hardware	Select one of the technologies - CPU or GPU acceleration
Decoding	Select the hardware decoder from the drop-down list - CPU, Intel, Nvidia
Optimization
FPS	Enter the desired number of frames per second in the field for detection. The recommended value is 25

When all necessary parameters are selected, go forward to the last step by clicking on the Next button in the upper right corner of the page.
Step 3 - Notifications
Finally, it is possible to customize Notifications.

For this purpose check the box next to Send events to Event Manager. The system will send all notifications to the Event Manager and then to external resources.

Then it is necessary to fill in the following fields:

Field name	Description
Events	Select the event for which notifications will be sent from the drop-down list.
Extra Options	If necessary, it is possible to add additional parameters for further use when event creating. Fill in the parameter and value fields.

To add more parameters, click on the Add Options button.

To remove parameters, click on the Delete icon.

If you want to make changes to previous steps, click on the Back button in the upper right corner of the page.

When the analytics setup is complete, click on the Save button in the upper right corner of the page to save changes and create the analytics.

Analytics Editing

To open the Smart Tracking System analytics editing window, click the Edit button on the right side of the analytics record.

It is possible to edit the analytics if it is not running.
If the analytics is Active at the moment, it is necessary to disable it by clicking on the Stop Analytics button in the upper right corner of the editor page.

When you click on the Stop Analytics button, the Confirmation window opens.
Click Yes to confirm the analytics disable or click No to cancel the action.

Now when the analytics is disabled it is possible to make changes to it.
There are 3 tabs of parameters at the top of the page, similar to the steps in creating analytics - General, Hardware, and Notifications. The General tab opens first by default.
The current tab is always highlighted. You can switch among them by clicking on their names.

General Tab
At the General tab it is possible to edit the following parameters:

Field name	Description
Notification Detect Delay	The frequency with which the system will scan objects. Possible range from 1 to 60 sec
Time Frame	Select the time period for which the system will scan objects

Then it is possible to edit a tracking area.
Move the white and red markers to line up the desired area.

Tracking analytics will be performed only within the boundaries of the selected area.
In order to remove the area, click on the Delete Rule button.

To create a new area from the beginning, click somewhere inside the frame. Then move the mouse cursor. It will be moved with a red line. Put as many points as is necessary to create the borders of the desired area. The last point should be placed at the same place as the first one.

Hardware Tab
At the Hardware tab it is possible to edit the following parameters:

Hardware	Description
Hardware	Select one of the technologies - CPU or GPU acceleration
Decoding	Select the hardware decoder from the drop-down list - CPU, Intel, Nvidia
Optimization	Select the optimization parameter from the drop-down list (for CPU - CPU (no optimization), Open VINO; for GPU - CUDA (no optimization), cuDNN Half (FP16), Tensor RT)
FPS	Enter the desired number of frames per second in the field for detection. The recommended value is 25

Notifications Tab
At the Notifications tab it is possible to edit values in the following fields:

Events	Select the event for which notifications will be sent from the drop-down list.
Extra Options	If necessary, it is possible to add additional parameters for further use when event creating. Fill in the parameter and value fields.

To add parameters, click on the Add Options button.

To remove parameters, click on the Delete icon.

When the analytics editing is complete, click on the Save button in the right upper corner of the editor page to save changes.

Analytics Start and Stop
To start the Smart Tracking System analytics, click on the Start button on the right side of the record. To stop the analytics, click on the Stop button.

When you click on the Stop button, the confirmation window opens. Click Yes to confirm or click No to cancel the action.

Analytics Deletion
To delete the Smart Tracking System analytics, click on the Delete icon on the right side of the record.

In the following window, click Yes to confirm the deletion or No to cancel the deletion.

Search

Search Parameters
In order to view the detection archive, select the Smart Tracking System module in the menu on the left and then select the Search section.

Search fields are at the top of the screen. 

Search field	Parameters
Time Frame	Select the time period for which it is necessary to perform the search
Camera	Select the cameras on which the search should be performed

Click on the Search button to display the search results. Click on the Reset button to clear input fields.

Search Results
Search results are displayed as tiles in the middle of the page.
To view the location and direction of the camera, click on the Location icon

When you click on the cropped frame inside any tile, the same frame with a bigger scale appears in the separate block on the right side of the page. This block also contains the Camera name, Date, and Time of detection.
All noticed objects in the area are highlighted with green rectangles, and the object from the selected frame is highlighted in red.

If you want to look closer at the detected object, click on the Expand button.

You can download the image by pressing the Save Image button if desired.

Particular Search
For a more detailed search, click on the Loupe icon in the upper right corner of the desired cropped frame.

In the following window, you can proceed to search with more particular parameters.

Search fields are located at the top of the page.

Search field	Parameters
Time Frame	Select the time period for which it is necessary to perform the search
Camera	Select the cameras on which the search should be performed
Limit	Set the number of displayed frames
Confidence	Set the percentage of matching the search frames to the original frame

Click Search to display the search results. Click Reset to clear input fields.
You can combine the frames you want to improve the search quality. Then the search will be based on several frames and its results will be more complete. To do this, click on the Add to Search button under the required frames.

Click Search to display the search results.
To cancel merging, click on the Remove from Search button under inappropriate frames.

If you want to look closer at the detected object, click on the Expand button.

You can download the image by pressing the Save Image button if desired.

Attribute Search

In order to view the detection archive, select the Smart Tracking System module in the left menu and then select the Attribute Search section.

Search by Special Signs
Search fields are located at the top of the page.

Search field	Parameters
Hat	The presence or absence of a headdress (Yes/No)
Hair Length	Short or long hair (Short/Long)
Top	Choosing the color of the top from the offered list (Undefined/Black/Red etc.)
Top Length	Choosing short or long tops (Short/Long)
Bag	Backpack or bag presence (No/Bag/Backpack)
Bottom	Choosing the bottoms color from the offered list (Undefined/White/Green etc.)
Bottom Length	Choosing short or long bottoms (Short/Long)
Bottom Clothes	Choosing the type of bottoms (Dress/Pants)
Age	Choosing an approximate age (Young/Teen/Adult/Old)
Gender	Gender selection (Male/Female)

Click Search to display the attribute search results. Click Reset to clear the input fields.

Search Results
Search results are displayed as tiles in the middle of the page.
To view the location and direction of the camera, click on the Location icon.

When you click on the cropped frame inside any tile, the same frame with a bigger scale appears in the separate block on the right side of the page.  This block also contains fields with information about recognized appearance attributes: Age, Gender, Bag, Hat, Hair as well as clothes Bottom and Top parameters.
All noticed objects in the area are highlighted with green rectangles, and the object from the selected frame is highlighted in red.

If you want to look closer at the detected object, click on the Expand button.

You can download the image by pressing the Save Image button if desired.

Particular Search
For a more detailed search, click on the Loupe icon in the upper right corner of the desired cropped frame.

In the following window, you can proceed to search with more particular parameters.

Search fields are located at the top of the page.

Search Frame	Parameters
Time Frame	Select the time period for which it is necessary to perform the search
Camera	Select the cameras on which the search should be performed
Limit	Set the number of displayed frames
Confidence	Set the percentage of matching the search frames to the original frame

Click Search to display the search results. Click Reset to clear input fields.

You can combine the frames you want to improve the search quality. Then the search will be based on several frames and its results will be more complete. To do this, click on the Add to Search button under the required frames.

Click Search to display the search results.

To cancel merging, click on the Remove from Search button under inappropriate frames.

If you want to look closer at the detected object, click on the Expand button.

You can download the image by pressing the Save Image button if desired.