Ultra fast cnn based Hardware Computing Platform Concepts for adas visual Sensors and Evolutionary Mobile Robots




Download 3,22 Mb.
Pdf ko'rish
bet45/81
Sana16.05.2024
Hajmi3,22 Mb.
#238917
1   ...   41   42   43   44   45   46   47   48   ...   81
Bog'liq
Alireza Fasih

7.2
 
A framework for FPGA based real-time machine vision: direct 
convolution versus CNN
 
 
In this Chapter we compare two different frameworks for real-time image processing, 
namely (a) a convolution based framework, and (b) a CNN (Cellular Neural Network) 
based framework. Hereby, a key focus is related to the main factor in image processing and 
machine vision that is the “processing time”. For real
-time applications this time must be 
the shortest possible. Due to the CPU structures (von Neuman architecture), in the classical 
image processing only a sequential processing of the pixels is possible. In such a context, 
convolution operations on images, which are very time consuming, will constitute a 
bottleneck for the whole sequential system. At the end, the experimental results of 
implementation of a hardware-based processing arc
hitecture for both the “CNN based
image processing” and the “direct convolution method” on
Field Programming Gate Array 
(FPGA) are presented and discussed. Thereby a systematic comparison of the performance 
achieved by each of the approaches is conducted.
7.3
 
Introduction to video processing platform
FPGA and dedicated video processing systems have been widely used since many years in 
video and image processing systems and machine vision application such as areal image 
processing, surveillance, medical imaging, vehicle automation and quality control in 


 
71 
industrial systems [26, 49, 50]. In the classical video processing platforms we can use DSP 
or CPU core for manipulating/processing pixels. For process one frame of data, the system 
generally has to fetch both the data and the program to either CPU or DSP, perform 
required mathematical operations and then store the result(s) back into the memory. The 
system must handle the high priority interrupts at the same time. And all these extra cycles 
will add to the total number of cycles involved in the processing each pixel of image [121]. 
The main weakness of these traditional systems is clearly the low speed related to the high 
processing time. Due to the sequential architecture and the programs, the system cannot 
manipulate pixels in a real pipeline model. Therefore, we must design a suitable 
architecture with a pipelining potential. FPGA is one the best candidates for pipelining 
video processing. With newest FPGA technologies it is possible to design a multi-functional 
and high performance video processing system. New FPGA technologies have made them 
much faster and denser than before. XILINX Vertex technology provides a large two-
dimensional array of logic and programmable block sets, which contain lot of dedicated 
memories and flip-flops. Having such facilities and infrastructures, one can easily map the 
image on this grid for further image processing[49]. This implementation presents a real-
time video processing platform involving two concepts: a) direct convolution based image 
processing, and (b) CNN based image processing. Designing a proper image processing 
platform is extremely significant. Thus, we have to design a robust and flexible 
architecture. The main parts of a real-time platform are knowingly capturing video, 
buffering video streams, video stream processing and finally video output controller. All 
these parts are considered in the platform design of this implementation. 

Download 3,22 Mb.
1   ...   41   42   43   44   45   46   47   48   ...   81




Download 3,22 Mb.
Pdf ko'rish

Bosh sahifa
Aloqalar

    Bosh sahifa



Ultra fast cnn based Hardware Computing Platform Concepts for adas visual Sensors and Evolutionary Mobile Robots

Download 3,22 Mb.
Pdf ko'rish