DRP-AI Demos: Difference between revisions

From Renesas.info
Β 
(5 intermediate revisions by 3 users not shown)
Line 14: Line 14:
** Refer to DRP-AI Translator page for other models.
** Refer to DRP-AI Translator page for other models.


= DRP-AI Demo Pre-built Images =
= DRP-AI Demo Binary =
You can evaluate the following AI demos soon after you get RZ/V2L-EVKIT[https://www.renesas.com/us/en/products/microcontrollers-microprocessors/rz-mpus/rzv2l-evkit-rzv2l-evaluation-board-kit]
[[File:RZV2L_DRP-AIDemoPre-builtImage.png|right|400px]]
* You can evaluate the AI demos such as '''Object Detection''' and '''Pose Estimation''' very easy after you get a RZ/V2L-EVKIT[https://www.renesas.com/us/en/products/microcontrollers-microprocessors/rz-mpus/rzv2l-evkit-rzv2l-evaluation-board-kit]
<br>
* There is a pre-built '''Linux SD Card Image''' posted on renesas.com.
* No Yocto building required.
* No Linux PC required.
<br>
* πŸ’Ύ [https://www.renesas.com/document/sws/rzv2l-drp-ai-object-detection-and-pose-estimation-demo Download Link (2.5GBοΌ‰]


This is a Linux SD Image. No Yocto required.
=Pre-trained Free AI Application Libraries for RZ/V2L=


Download Link:(1.23GB)
<font size=16>⏳</font> Don't want to spend time training???
* '''https://www.renesas.com/document/sws/rzv2l-drp-ai-usbcamera-http-demo-sd-image-version '''


* '''Object Detection''' / '''Pose Estimation''' / '''Classification'''
<font size=16>πŸ†•</font> Renesas Offers Custom Pretrained models that can be used by customers for end products!
[[File:RZV2L DRP-AIDemoPre-builtImage.png|thumb|500x500px|none]]


=Pre-trained Free AI Application Libraries for RZ/V2L=
For more information go [[Pre-trained Free AI Application Libraries for RZ/V2L]].
*'''Free''', open-source based library of '''pre-trained''' AI applications available on github.
<br>
* ⭐ '''https://github.com/Ignitarium-Renesas/RZV2L_AiLibrary'''
<br>
* This Library has API functions for leveraging AI applications that will run on Renesas RZ/V2L Board. Currently this library has following sample applications:
**Human Head Counter
**Line crossing object Counter
**Elderly people fall detection (Work in progress)
**Safety helmet and vest detection
**Human age and gender detection (Work in progress)
**Face recognition and spoof detection (Work in progress
* Sample Videos
** Headf Count : https://youtu.be/YNcCCiSx9YM
** Line Crossing : https://youtu.be/-fZypjgsBYo
** Fall Detection : https://youtu.be/4ALde_vP1lo
** Age/Gender Detection : https://youtu.be/-DpAGb7q4pM
** Face recognition and spoof detection : https://youtu.be/BOFdP1u-L7k


=DRP-AI Sample Application Demos =
=DRP-AI Sample Application Demos =

Latest revision as of 18:59, 31 May 2023

RZV2 Reference Application Demos can be found in the links below. The links to the DRP and ISP Driver Package ZIP files include the demo code listed on this page. The Evaluation Software, Implementation Software, and Application Demos are included in the DRP-AI Package. The ISP demos are included in both the DRP-AI and and ISP package..

  • Renesas Implemented AI Models
    • YoloV2/V3. TInyYolov2/v3, Resnet, Moblenet, mmpose, and DeepLabv3
    • Refer to DRP-AI Translator page for other models.

DRP-AI Demo Binary

RZV2L DRP-AIDemoPre-builtImage.png
  • You can evaluate the AI demos such as Object Detection and Pose Estimation very easy after you get a RZ/V2L-EVKIT[1]


  • There is a pre-built Linux SD Card Image posted on renesas.com.
  • No Yocto building required.
  • No Linux PC required.


Pre-trained Free AI Application Libraries for RZ/V2L

⏳ Don't want to spend time training???

πŸ†• Renesas Offers Custom Pretrained models that can be used by customers for end products!

For more information go Pre-trained Free AI Application Libraries for RZ/V2L.

DRP-AI Sample Application Demos

The RZV2L, RZV2MA, and RZV2M DRP-AI Sample Application Demos are included in the DRP-AI Support Package.

Example for the RZV2M DRP-AI Support Package

r11an0530ej0730-rzv2m-drpai-sp
    β”œβ”€β”€β”€rzv2m_drpai-driver
    β”œβ”€β”€β”€rzv2m_drpai-sample-application   <- DRP-AI Demos
    β”œβ”€β”€β”€rzv_ai-evaluation-software       <- DRP-AI Evaluation Software
    β”œβ”€β”€β”€rzv_ai-implementation-guide      <= DRP-AI Implementation Guide
    β”‚   β”œβ”€β”€β”€appendix
    β”‚   β”œβ”€β”€β”€darknet_yolo
    β”‚   β”œβ”€β”€β”€mmpose_hrnet
    β”‚   β”œβ”€β”€β”€pytorch_deeplabv3
    β”‚   β”œβ”€β”€β”€pytorch_mobilenet
    β”‚   β””───pytorch_resnet
    └───rzv_drpai-report

DRP-AI Evaluation Software

The AI Evaluation Software is a precompiled application software that evaluates any DRP-AI inferences generated from the DRP-AI Translator.. The software loads and runs the DRP-AI inference in the DRP-AI hardware for evaluation. Runtime performance of the inference is provided. There is no post processing. Instead a raw binary is generated for post processing later.

NOTE: Source Code is not provided but the Application Software code that loads and runs the DRP-AI inference is the same. Please refer to the Application Software

  • RZ/V2M
    • rzv2m_ai-evalutation-software
  • RZ/V2L
    • rzv2l_ai-evalutation-software

DRP-AI Implementation Software

The Implementation Software are development tools that provide the following support.

  • PyTorch Scripts of Supported Renesas AI Models.
  • Python script example for converting PyTorch script to onnx
  • DRP-AI Translator configuration YAML files
  • Post Processing of the Evaluation Software for Supported Renesas AI Models.
  • Pre generated ONNX file and DRP-AI inference files.

Implementation Software can be found in the sub folder shown below of the RZ/V2L and RZ/V2M DRP-AI Support Package.

  • RZ/V2M
    • rzv2m_ai-implementaion-guide
  • RZ/V2L
    • rzv2l_ai-implementaion-guide

DRP-AI Application Software

The DRP AI Application Software are C language make file projects. These demos provide examples for running DRP-AI inference, Camera API ( USB and MIPI ), Weston Display API, H.264 network streaming, AI Preprocessing, and AI post processing. For detailed information refer to the documentation included in the package.

NOTE: Applications ending with _img do not use the camera or display. They read the image file, that is in the same directory as the demo executable then outputs the inference results to Terminal.

Application Software can be found in the sub folder shown below of the RZ/V2L and RZ/V2M DRP-AI Support Package.

  • RZ/V2M
    • rzv2m_drpai-sample-application
  • RZ/V2L
    • rzv2l_ai-sample-application
    • NOTE: The TinyYoloV2 demo "app_tinyyolov2_cam" does not use the RZV2L ISP.

DRP-AI and ISP Demos

This software is included in the DRP-AI Application Software. This software requires that the ISP has been installed. Below is a list of the application projects for each target machine. For details on compile, target deployment, and running the demos refer to the documents included in the package.