RZ-G/RZ-G2 ai: Difference between revisions

From Renesas.info
No edit summary
(Updated supported frameworks and added shopping basket demo video link.)
Line 10: Line 10:
Currently the following frameworks are supported:
Currently the following frameworks are supported:
* ArmNN SDK
* ArmNN SDK
* Caffe2
* ONNX Runtime
* ONNX Runtime
* OpenCV
* PyTorch
* TensorFlow
* TensorFlow Lite
* TensorFlow Lite


Line 37: Line 33:


Source code: [https://github.com/renesas-rz/meta-renesas-ai-demos/tree/master/meta-shopping-basket-demo meta-shopping-basket-demo]
Source code: [https://github.com/renesas-rz/meta-renesas-ai-demos/tree/master/meta-shopping-basket-demo meta-shopping-basket-demo]
Video: [https://www2.renesas.cn/eu/en/video/rzg-foss-ai-shopping-basket-demo RZ/G FOSS AI Shopping Basket Demo]

Revision as of 12:43, 9 December 2021

🧠 RZ/G Artificial Intelligence and Machine Learning

RZ-G

RZ/G FOSS AI BSP

rzg ai bsp.png

Renesas has created an "AI BSP" for the RZ/G family of SoCs and reference platforms.

This "BSP" adds support for a number of popular machine learning frameworks allowing users to run AI inference natively on an embedded platform.

Currently the following frameworks are supported:

  • ArmNN SDK
  • ONNX Runtime
  • TensorFlow Lite

Support is added to the RZ/G BSP using Yocto/OpenEmbedded meta-layers. The source code can be found on GitHub: https://github.com/renesas-rz/meta-renesas-ai.

RZ/G FOSS AI Demos

Renesas have created a number of simple demo applications that make use of the RZ/G AI BSP.

Each demo can be added to the RZ/G BSP by using an Yocto/OpenEmbedded meta-layer. These meta-layers can be found on GitHub: https://github.com/renesas-rz/meta-renesas-ai-demos

Object Detection Demo

This demo showcases simple Object Detection using TensorFlow Lite and mobilenet SSD models.

It will draw boxes around detected objects and identify them. Image or video files can be loaded from storage, or a USB webcam can be used.

Source code: meta-object-detection-demo

Shopping Basket Demo

This demo builds upon the Object Detection demo, but has a specific use case - an automated shopping checkout.

A custom model has been trained to recognise a number of common food items such as a can of Coke. A whole shopping basket can be placed in front of a camera and the application will identify the items and total up the cost of the shopping.

Source code: meta-shopping-basket-demo

Video: RZ/G FOSS AI Shopping Basket Demo