You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: documentation/asciidoc/accessories/ai-camera/details.adoc
+7-7Lines changed: 7 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -9,15 +9,15 @@ image::images/imx500-comparison.svg[Traditional versus IMX500 AI camera systems]
9
9
10
10
The left side demonstrates the architecture of a traditional AI camera system. In such a system, the camera delivers images to the Raspberry Pi. The Raspberry Pi processes the images and then performs AI inference. Traditional systems may use external AI accelerators (as shown) or rely exclusively on the CPU.
11
11
12
-
The right side demonstrates the architecture of a system that uses IMX500. The camera module contains a small Image Signal Processor (ISP) which turns the raw camera image data into an **input tensor**. The camera module sends this tensor directly into the AI accelerator within the camera, which produces an **output tensor** that contains the inferencing results. The AI accelerator sends this tensor to the Raspberry Pi. There is no need for an external accelerator, nor for the Raspberry Pi to run neural network software on the CPU.
12
+
The right side demonstrates the architecture of a system that uses IMX500. The camera module contains a small Image Signal Processor (ISP) which turns the raw camera image data into an **input tensor**. The camera module sends this tensor directly into the AI accelerator within the camera, which produces **output tensors** that contain the inferencing results. The AI accelerator sends these tensors to the Raspberry Pi. There is no need for an external accelerator, nor for the Raspberry Pi to run neural network software on the CPU.
13
13
14
14
To fully understand this system, familiarise yourself with the following concepts:
15
15
16
16
Input Tensor:: The part of the sensor image passed to the AI engine for inferencing. Produced by a small on-board ISP which also crops and scales the camera image to the dimensions expected by the neural network that has been loaded. The input tensor is not normally made available to applications, though it is possible to access it for debugging purposes.
17
17
18
18
Region of Interest (ROI):: Specifies exactly which part of the sensor image is cropped out before being rescaled to the size demanded by the neural network. Can be queried and set by an application. The units used are always pixels in the full resolution sensor output. The default ROI setting uses the full image received from the sensor, cropping no data.
19
19
20
-
Output Tensor:: The results of inferencing performed by the neural network. The precise number and shape of the outputs depend on the neural network. Application code must understand how to handle the tensor.
20
+
Output Tensors:: The results of inferencing performed by the neural network. The precise number and shape of the outputs depend on the neural network. Application code must understand how to handle the tensors.
21
21
22
22
=== System architecture
23
23
@@ -43,13 +43,13 @@ Once `libcamera` dequeues the image and inference data buffers from the kernel,
43
43
| Description
44
44
45
45
| `CnnOutputTensor`
46
-
| Floating point array storing the output tensor.
46
+
| Floating point array storing the output tensors.
47
47
48
48
| `CnnInputTensor`
49
49
| Floating point array storing the input tensor.
50
50
51
51
| `CnnOutputTensorInfo`
52
-
| Network specific parameters describing the output tensors structure:
52
+
| Network specific parameters describing the output tensors' structure:
53
53
54
54
[source,c]
55
55
----
@@ -67,7 +67,7 @@ struct CnnOutputTensorInfo {
67
67
----
68
68
69
69
| `CnnInputTensorInfo`
70
-
| Network specific parameters describing the input tensors structure:
70
+
| Network specific parameters describing the input tensor's structure:
0 commit comments