Renesas Electronics and StradVision with expertise in deep learning have teamed up to jointly develop a deep-learning-based object-recognition system for smart cameras for next-generation advanced driver assistance systems (ADAS) and cameras for ADAS Level-2 and above.

To avoid hazards in urban areas, next-generation ADAS implementations require high-precision object recognition capable of detecting so-called vulnerable road users (VRUs) such as pedestrians and cyclists. At the same time, for mass-market mid-tier to entry-level vehicles, these systems must consume very low power. The new solution from Renesas and StradVision achieves both and is designed to accelerate the widespread adoption of ADAS.

StradVision’s deep learning–based object recognition software delivers high performance in recognising vehicles, pedestrians and lane markings. This high-precision recognition software has been optimized for Renesas R-Car automotive system-on-chip (SoC) products R-Car V3H and R-Car V3M, which have an established track record in mass-produced vehicles. These R-Car devices incorporate a dedicated engine for deep learning processing called CNN-IP (Convolution Neural Network Intellectual Property), enabling them to run StradVision’s SVNet automotive deep learning network at high speed with minimal power consumption. The object recognition solution resulting from this collaboration realizes deep learning–based object recognition while maintaining low power consumption, making its use suitable in mass-produced vehicles, encouraging ADAS adoption.