Pre-trained Free AI Application Libraries for RZ/V2L: Difference between revisions

From Renesas.info
(→‎Sample Videos: Added more statistics)
Line 26: Line 26:


= Sample Videos =
= Sample Videos =
''NOTE: Memory Usage includes the Image Input, Inference Output, Inference Weights and Inference Parameters. Applications that use multiple AI Models are run sequentially''
{| style="width: 100%; border-style: none;"
{| style="width: 100%; border-style: none;"
|- style="vertical-align: top;"
|- style="vertical-align: top;"
Line 36: Line 37:
=== Line Crossing Object Counting ===  
=== Line Crossing Object Counting ===  
  <br> Model : TinyYoloV2 <br> Memory Usage: 52MB <br> Inference Input Shape : 416,416,3
  <br> Model : TinyYoloV2 <br> Memory Usage: 52MB <br> Inference Input Shape : 416,416,3
|  <br> <youtube width="480" >-fZypjgsBYo</youtube> <br> '''Line Count'''
|  <br> <youtube width="480">-fZypjgsBYo</youtube> <br> '''Line Count'''
|- style="vertical-align: top;"
|- style="vertical-align: top;"
|  <br>
|  <br>
Line 42: Line 43:
  <br> Model : Tiny Yolov2 <br> Memory Usage: 52MB <br> Inference Input Shape : 256, 192, 3
  <br> Model : Tiny Yolov2 <br> Memory Usage: 52MB <br> Inference Input Shape : 256, 192, 3
  <br> Model : HRNET <br> Memory Usage: 129MB <br> Inference Input Shape : 256, 192, 3
  <br> Model : HRNET <br> Memory Usage: 129MB <br> Inference Input Shape : 256, 192, 3
|  <br> <youtube width="480" >4ALde_vP1lo</youtube> <br> '''Fall Detection'''
|  <br> <youtube width="480">4ALde_vP1lo</youtube> <br> '''Fall Detection'''
|- style="vertical-align: top;"
|- style="vertical-align: top;"
|  <br>
|  <br>
Line 49: Line 50:
  <br> Model : Custom gender <br> Memory Usage: 87MB <br> Inference Input Shape : 224,224,3
  <br> Model : Custom gender <br> Memory Usage: 87MB <br> Inference Input Shape : 224,224,3
  <br> Model : Tiny YoloV2 <br> Memory Usage: 52MB <br> Inference Input Shape : 416,416,3
  <br> Model : Tiny YoloV2 <br> Memory Usage: 52MB <br> Inference Input Shape : 416,416,3
|  <br> <youtube width="480" >-DpAGb7q4pM</youtube> <br> '''Age and Gender Detection'''
|  <br> <youtube width="480">-DpAGb7q4pM</youtube> <br> '''Age and Gender Detection'''
|- style="vertical-align: top;"
|- style="vertical-align: top;"
|  <br>
|  <br>
=== Face Recognition, Spoofing, and Registration ===  
=== Face Recognition, Spoofing, and Registration ===  
  <br> Model : Resnet50 <br> Memory Usage: 88MB <br> Inference Input Shape : 224,224,3
  <br> Model : Resnet50 <br> Memory Usage: 88MB <br> Inference Input Shape : 224,224,3
|  <br> <youtube width="480" >BOFdP1u-L7k</youtube> <br> '''Face Recognition'''
|  <br> <youtube width="480">BOFdP1u-L7k</youtube> <br> '''Face Recognition'''
|- style="vertical-align: top;"
|- style="vertical-align: top;"
|  <br>
|  <br>
=== Animal Detection ===  
=== Animal Detection ===  
  <br> Model : YoloV3 <br> Memory Usage: 236MB <br> Inference Input Shape : 416,416,3
  <br> Model : YoloV3 <br> Memory Usage: 236MB <br> Inference Input Shape : 416,416,3
|  <br> <youtube width="480" >sJgDmCYcef4</youtube> <br> '''Animal Detection'''
|  <br> <youtube width="480">sJgDmCYcef4</youtube> <br> '''Animal Detection'''
|- style="vertical-align: top;"
|- style="vertical-align: top;"
|  <br>
|  <br>
=== Hand Gesture Recognition ===  
=== Hand Gesture Recognition ===  
  <br> Model : Custom Pose Detector for Hand <br> Memory Usage: 91MB <br> Inference Input Shape : 256,256,3
  <br> Model : Custom Pose Detector for Hand <br> Memory Usage: 91MB <br> Inference Input Shape : 256,256,3
|  <br> <youtube width="480" >hP-Gr_Sq8a8</youtube> <br> '''Hand Gesture Recognition'''
|  <br> <youtube width="480">hP-Gr_Sq8a8</youtube> <br> '''Hand Gesture Recognition'''
|- style="vertical-align: top;"
|- style="vertical-align: top;"
|  <br>
|  <br>
Line 70: Line 71:
  <br> Model : Resnet18 <br> Memory Usage: 38MB <br> Inference Input Shape : 416,416,3
  <br> Model : Resnet18 <br> Memory Usage: 38MB <br> Inference Input Shape : 416,416,3
  <br> Model : Tiny YoloV2 <br> Memory Usage: 52MB <br> Inference Input Shape : 416,416,3
  <br> Model : Tiny YoloV2 <br> Memory Usage: 52MB <br> Inference Input Shape : 416,416,3
|  <br> <youtube width="480" >X_eH5UcThrc</youtube> <br> '''Gaze Recognition'''
|  <br> <youtube width="480">X_eH5UcThrc</youtube> <br> '''Gaze Recognition'''
|}
|}

Revision as of 19:22, 19 April 2023

General Information

  • Free, open-source based library of pre-trained AI applications available on github.
  • ⭐Source Code: https://github.com/Ignitarium-Renesas/RZV2L_AiLibrary
  • This Library has API functions for leveraging AI applications that will run on Renesas RZ/V2L Board. Currently this library has following sample applications:
    • Human Head Counter
    • Line crossing object Counter
    • Elderly people fall detection (Work in progress)
    • Safety helmet and vest detection
    • Human age and gender detection (Work in progress)
    • Face recognition and spoof detection (Work in progress

Pre-Trained AI Article

Addition Notes

The Pre-trained models include pre-compiled applications as well as AI Models translated to run on the DRP-AI hardware. These files are located in the "exe" folder for each Pre-trained Application. These precompiled application are compiled for the Renesas RZV2L EVK using the Coral MIPI Camera. This folder can be simple copied to the board using SCP recursive command. NOTE : Some Pre-trained Applicatino

Support USB Camera

By default the Pretrained Applications are compiled to use the MIPI camera. The Pre-trained applications can be modified to use USB camera. This modification is only relevant to applications that support video.

  1. Open the application folder src folder. For example 01_Head_count/Head_count_cam/src
  2. Open the define.h header file.
  3. Find the following line. Comment out the macro that defines INPUT_CORAL.
/* Coral Camera support */
#define INPUT_CORAL

Sample Videos

NOTE: Memory Usage includes the Image Input, Inference Output, Inference Weights and Inference Parameters. Applications that use multiple AI Models are run sequentially


Head Count Application


Model : YoloV3
Memory Usage: 235MB
Inference Input Shape : 416,416,3


Head Count

Line Crossing Object Counting


Model : TinyYoloV2
Memory Usage: 52MB
Inference Input Shape : 416,416,3


Line Count

Fall Detection


Model : Tiny Yolov2
Memory Usage: 52MB
Inference Input Shape : 256, 192, 3
Model : HRNET
Memory Usage: 129MB
Inference Input Shape : 256, 192, 3


Fall Detection

Age and Gender Detection


Model : Custom age
Memory Usage: 24MB
Inference Input Shape : 416,416,3
Model : Custom gender
Memory Usage: 87MB
Inference Input Shape : 224,224,3
Model : Tiny YoloV2
Memory Usage: 52MB
Inference Input Shape : 416,416,3


Age and Gender Detection

Face Recognition, Spoofing, and Registration


Model : Resnet50
Memory Usage: 88MB
Inference Input Shape : 224,224,3


Face Recognition

Animal Detection


Model : YoloV3
Memory Usage: 236MB
Inference Input Shape : 416,416,3


Animal Detection

Hand Gesture Recognition


Model : Custom Pose Detector for Hand
Memory Usage: 91MB
Inference Input Shape : 256,256,3


Hand Gesture Recognition

Human Gaze Recognition


Model : Resnet18
Memory Usage: 38MB
Inference Input Shape : 416,416,3
Model : Tiny YoloV2
Memory Usage: 52MB
Inference Input Shape : 416,416,3


Gaze Recognition