Runs a neural inference on input data. Neural network has to be a
.blob type. Instructions on how to compile your neural network (NN) to
can be found at Local OpenVINO Model Conversion.
How to place it¶
Inputs and Outputs¶
┌───────────────────┐ │ │ out │ ├───────────► │ │ │ NeuralNetwork │ input │ │ passthrough ───────────►│-------------------├───────────► │ │ └───────────────────┘
The passthrough mechanism is very useful when a node specifies its input to be non-blocking, where messages can be overwritten. There we don’t know on which message the node performed its operation (eg NN, was inference done on frame 25 or skipped 25 and performed inference on 26). At the same time means that if: xlink and host input queues are blocking, and we receive both say passthrough and output we can do a blocking get on both of those queues and be sure to always get matching frames. They might not arrive at the same time, but both of them will arrive, and be in queue in correct spot to be taken out together.