Deep Neural Networks – only in combination with traditional computer vision: Page 6 of 7

November 15, 2018 // By Cyril Cordoba, Renesas
It will still take some time before fully-autonomous vehicles come onto the streets - even though the automotive industry is currently discussing automated driving intensively. Developments are evolutionary. Step by step, the technologies must emerge that are powerful enough, require little energy and meet the ISO 26262 standards.

Revolutionary acceleration can be achieved by integrating dedicated hardware IPs based on the state of the art algorithms to achieve the best performance/power efficiency.


Fig. 6: Architecture improvements leading to new IPs

As a result, Renesas continues to rely on ARM cores for standard computing tasks and on the IMP-X5, a heterogeneous computing subsystem for specialised processing. This is composed of a hard-wired part (for the computer-intensive portion and established parts of the DNN algorithms) and on programmable architecture for future-proof, flexible and programmable use with the CV engine.


Fig. 7: Heterogeneous accelerators: efficiency + flexibility
– a must-have for efficient performance

The IMP-X5 uses approaches from the IMP core, which the company launched in 2009 and has been integrated in Renesas products for more than 10 years. One of the first applications for this hardware accelerator was a neural network. Already in 2009, Renesas was able to show that the core performs much better than a standard CPU: to process NN algorithms the CPU needed 204 ms, while the IMP core took only 8.9 ms.

The hard-wired IMP core (8-/16-bit integer) is a computing unit with pixel and line interconnects. Thanks to the memory-centric architecture - the data is almost streamed by feeding the pipeline with one pixel per cycle and one pixel per cycle is stored - the memory accesses are minimised.

In the near future, the IMP core and the CV engine will be expanded by additional IPs, which enable, for example, a high-performance, energy-saving implementation of CNNs.

Design category: 

Vous êtes certain ?

Si vous désactivez les cookies, vous ne pouvez plus naviguer sur le site.

Vous allez être rediriger vers Google.