🧠 RZ/G Artificial Intelligence and Machine Learning

RZ/G FOSS AI BSP

Renesas has created an "AI BSP" for the RZ/G family of SoCs and reference platforms.

This "BSP" adds support for a number of popular machine learning frameworks allowing users to run AI inference natively on an embedded platform.

Currently the following frameworks are supported:

ArmNN SDK
Caffe2
ONNX Runtime
OpenCV
PyTorch
TensorFlow
TensorFlow Lite

Support is added to the RZ/G BSP using Yocto/OpenEmbedded meta-layers. The source code can be found on GitHub: https://github.com/renesas-rz/meta-renesas-ai.

RZ/G FOSS AI Demos

Renesas have created a number of simple demo applications that make use of the RZ/G AI BSP.

Each demo can be added to the RZ/G BSP by using an Yocto/OpenEmbedded meta-layer. These meta-layers can be found on GitHub: https://github.com/renesas-rz/meta-renesas-ai-demos

Object Detection Demo

This demo showcases simple Object Detection using TensorFlow Lite and mobilenet SSD models.

It will draw boxes around detected objects and identify them. Image or video files can be loaded from storage, or a USB webcam can be used.

Source code: meta-object-detection-demo

Shopping Basket Demo

This demo builds upon the Object Detection demo, but has a specific use case - an automated shopping checkout.

A custom model has been trained to recognise a number of common food items such as a can of Coke. A whole shopping basket can be placed in front of a camera and the application will identify the items and total up the cost of the shopping.

Source code: meta-shopping-basket-demo