DRP-AI Demos: Difference between revisions

From Renesas.info
No edit summary
 
(12 intermediate revisions by 3 users not shown)
Line 14: Line 14:
** Refer to DRP-AI Translator page for other models.
** Refer to DRP-AI Translator page for other models.


= DRP-AI Demo Pre-built Images =
= DRP-AI Demo Binary =
You can evaluate the following AI demos soon after you get RZ/V2L-EVKIT[https://www.renesas.com/us/en/products/microcontrollers-microprocessors/rz-mpus/rzv2l-evkit-rzv2l-evaluation-board-kit]
[[File:RZV2L_DRP-AIDemoPre-builtImage.png|right|400px]]
 
* You can evaluate the AI demos such as '''Object Detection''' and '''Pose Estimation''' very easy after you get a RZ/V2L-EVKIT[https://www.renesas.com/us/en/products/microcontrollers-microprocessors/rz-mpus/rzv2l-evkit-rzv2l-evaluation-board-kit]
Download Link:(1.23GB)
<br>
* '''https://www.renesas.com/document/sws/rzv2l-drp-ai-usbcamera-http-demo-sd-image-version '''
* There is a pre-built '''Linux SD Card Image''' posted on renesas.com.
 
* No Yocto building required.
* '''Object Detection''' / '''Pose Estimation''' / '''Classification'''
* No Linux PC required.
[[File:RZV2L DRP-AIDemoPre-builtImage.png|left|thumb|500x500px]]
<br>
 
* 💾 [https://www.renesas.com/document/sws/rzv2l-drp-ai-object-detection-and-pose-estimation-demo Download Link (2.5GB）]
 
 
 


=Pre-trained Free AI Application Libraries for RZ/V2L=


<font size=16>⏳</font> Don't want to spend time training???


<font size=16>🆕</font> Renesas Offers Custom Pretrained models that can be used by customers for end products!


For more information go [[Pre-trained Free AI Application Libraries for RZ/V2L]].
<br>
<br>


=DRP-AI Sample Application Demos =
=DRP-AI Sample Application Demos =
The RZV2L, RZV2MA, and RZV2M DRP-AI Sample Application Demos are included in the DRP-AI Support Package.
The RZV2L, RZV2MA, and RZV2M DRP-AI Sample Application Demos are included in the DRP-AI Support Package.
* [https://www.renesas.com/us/en/products/microcontrollers-microprocessors/rz-arm-based-high-end-32-64-bit-mpusl/rzv2m-drp-ai-support-package RZ/V2M DRP-AI Support Package]
* [https://www.renesas.com/us/en/products/microcontrollers-microprocessors/rz-arm-based-high-end-32-64-bit-mpus/rzv2l-drp-ai-support-package#overview RZ/V2L DRP-AI Support Package]
<pre>
<pre>
Example for the RZV2M DRP-AI Support Package
r11an0530ej0730-rzv2m-drpai-sp
r11an0530ej0730-rzv2m-drpai-sp
    ├───rzv2m_drpai-driver
    ├───rzv2m_drpai-driver
    ├───rzv2m_drpai-sample-application  <- DRP-AI Demos
    ├───rzv2m_drpai-sample-application  <- DRP-AI Demos
Line 47: Line 54:
    │   └───pytorch_resnet
    │   └───pytorch_resnet
    └───rzv_drpai-report
    └───rzv_drpai-report
</pre?
</pre>
=DRP-AI Evaluation Software=
 
== DRP-AI Evaluation Software ==
The AI Evaluation Software is a precompiled application software that evaluates any DRP-AI inferences generated from the DRP-AI Translator.. The software loads and runs the DRP-AI inference in the DRP-AI hardware for evaluation. Runtime performance of the inference is provided. There is no post processing. Instead a raw binary is generated for post processing later.
The AI Evaluation Software is a precompiled application software that evaluates any DRP-AI inferences generated from the DRP-AI Translator.. The software loads and runs the DRP-AI inference in the DRP-AI hardware for evaluation. Runtime performance of the inference is provided. There is no post processing. Instead a raw binary is generated for post processing later.


Line 58: Line 66:
**rzv2l_ai-evalutation-software
**rzv2l_ai-evalutation-software


= DRP-AI Implementation Software=
== DRP-AI Implementation Software ==
The Implementation Software are development tools that provide the following support.
The Implementation Software are development tools that provide the following support.


Line 73: Line 81:
**rzv2l_ai-implementaion-guide
**rzv2l_ai-implementaion-guide


=DRP-AI Application Software=
== DRP-AI Application Software ==
The DRP AI Application Software are  C language make file projects. These demos provide examples for running DRP-AI inference, Camera API ( USB and MIPI ), Weston Display API, H.264 network streaming, AI Preprocessing, and AI post processing.  For detailed information refer to the documentation included in the package.
The DRP AI Application Software are  C language make file projects. These demos provide examples for running DRP-AI inference, Camera API ( USB and MIPI ), Weston Display API, H.264 network streaming, AI Preprocessing, and AI post processing.  For detailed information refer to the documentation included in the package.


Line 83: Line 91:
*'''RZ/V2L'''
*'''RZ/V2L'''
**rzv2l_ai-sample-application
**rzv2l_ai-sample-application
**'''NOTE''': The TinyYoloV2 demo "app_tinyyolov2_cam" does not use the RZV2L ISP. The ISP should not be installed for this demo because the ISP package removes the camera ISP  AE. functionality.
**'''NOTE''': The TinyYoloV2 demo "app_tinyyolov2_cam" does not use the RZV2L ISP.  


=DRP-AI and ISP Demos=
=DRP-AI and ISP Demos=
This software is included in the DRP-AI Application Software. This software requires that the ISP has been installed. Below is a list of the application projects for each target machine. For details on compile, target deployment, and running the demos refer to the documents included in the package.  
This software is included in the DRP-AI Application Software. This software requires that the ISP has been installed. Below is a list of the application projects for each target machine. For details on compile, target deployment, and running the demos refer to the documents included in the package.
*'''RZ/V2M (''' ''all mipi camera demos use ISP, see ISP page for more info.'' ''')'''
**app_tinyyolov2_cam_vcd
**app_tinyyolov2_cam_hdmi
**app_hmet_cam_hdmi
**app_hmet_pre-yolov3_cam_hdmi
***
*'''RZ/V2L'''
** app_tinyyolov2_isp
 
=Pre-trained Free AI Application Libraries for RZ/V2L=
*'''Free''', open-source based library of '''pre-trained''' AI applications available on github.
* ⭐ '''https://github.com/Ignitarium-Renesas/RZV2L_AiLibrary'''
* This Library has API functions for leveraging AI applications that will run on Renesas RZ/V2L Board. Currently this library has following sample applications:
**Human Head Counter
**Line crossing object Counter
**Elderly people fall detection (Work in progress)
**Safety helmet and vest detection
**Human age and gender detection (Work in progress)
**Face recognition and spoof detection (Work in progress

Latest revision as of 18:59, 31 May 2023

RZV2 Reference Application Demos can be found in the links below. The links to the DRP and ISP Driver Package ZIP files include the demo code listed on this page. The Evaluation Software, Implementation Software, and Application Demos are included in the DRP-AI Package. The ISP demos are included in both the DRP-AI and and ISP package..

  • Renesas Implemented AI Models
    • YoloV2/V3. TInyYolov2/v3, Resnet, Moblenet, mmpose, and DeepLabv3
    • Refer to DRP-AI Translator page for other models.

DRP-AI Demo Binary

RZV2L DRP-AIDemoPre-builtImage.png
  • You can evaluate the AI demos such as Object Detection and Pose Estimation very easy after you get a RZ/V2L-EVKIT[1]


  • There is a pre-built Linux SD Card Image posted on renesas.com.
  • No Yocto building required.
  • No Linux PC required.


Pre-trained Free AI Application Libraries for RZ/V2L

⏳ Don't want to spend time training???

🆕 Renesas Offers Custom Pretrained models that can be used by customers for end products!

For more information go Pre-trained Free AI Application Libraries for RZ/V2L.

DRP-AI Sample Application Demos

The RZV2L, RZV2MA, and RZV2M DRP-AI Sample Application Demos are included in the DRP-AI Support Package. 

Example for the RZV2M DRP-AI Support Package

r11an0530ej0730-rzv2m-drpai-sp
    ├───rzv2m_drpai-driver
    ├───rzv2m_drpai-sample-application   <- DRP-AI Demos
    ├───rzv_ai-evaluation-software       <- DRP-AI Evaluation Software
    ├───rzv_ai-implementation-guide      <= DRP-AI Implementation Guide
    │   ├───appendix
    │   ├───darknet_yolo
    │   ├───mmpose_hrnet
    │   ├───pytorch_deeplabv3
    │   ├───pytorch_mobilenet
    │   └───pytorch_resnet
    └───rzv_drpai-report

DRP-AI Evaluation Software

The AI Evaluation Software is a precompiled application software that evaluates any DRP-AI inferences generated from the DRP-AI Translator.. The software loads and runs the DRP-AI inference in the DRP-AI hardware for evaluation. Runtime performance of the inference is provided. There is no post processing. Instead a raw binary is generated for post processing later.

NOTE: Source Code is not provided but the Application Software code that loads and runs the DRP-AI inference is the same. Please refer to the Application Software

  • RZ/V2M
    • rzv2m_ai-evalutation-software
  • RZ/V2L
    • rzv2l_ai-evalutation-software

DRP-AI Implementation Software

The Implementation Software are development tools that provide the following support.

  • PyTorch Scripts of Supported Renesas AI Models.
  • Python script example for converting PyTorch script to onnx
  • DRP-AI Translator configuration YAML files
  • Post Processing of the Evaluation Software for Supported Renesas AI Models.
  • Pre generated ONNX file and DRP-AI inference files.

Implementation Software can be found in the sub folder shown below of the RZ/V2L and RZ/V2M DRP-AI Support Package.

  • RZ/V2M
    • rzv2m_ai-implementaion-guide
  • RZ/V2L
    • rzv2l_ai-implementaion-guide

DRP-AI Application Software

The DRP AI Application Software are C language make file projects. These demos provide examples for running DRP-AI inference, Camera API ( USB and MIPI ), Weston Display API, H.264 network streaming, AI Preprocessing, and AI post processing. For detailed information refer to the documentation included in the package.

NOTE: Applications ending with _img do not use the camera or display. They read the image file, that is in the same directory as the demo executable then outputs the inference results to Terminal.

Application Software can be found in the sub folder shown below of the RZ/V2L and RZ/V2M DRP-AI Support Package.

  • RZ/V2M
    • rzv2m_drpai-sample-application
  • RZ/V2L
    • rzv2l_ai-sample-application
    • NOTE: The TinyYoloV2 demo "app_tinyyolov2_cam" does not use the RZV2L ISP.

DRP-AI and ISP Demos

This software is included in the DRP-AI Application Software. This software requires that the ISP has been installed. Below is a list of the application projects for each target machine. For details on compile, target deployment, and running the demos refer to the documents included in the package.

Retrieved from "https://renesas.info/w/index.php?title=DRP-AI_Demos&oldid=2364"