RGB & Mono Encoding

This example shows how to set up the encoder node to encode the RGB camera and both grayscale cameras (of DepthAI/OAK-D) at the same time. The RGB is set to 1920x1080 and the grayscale are set to 1280x720 each, all at 30FPS. Each encoded video stream is transferred over XLINK and saved to a respective file.Pressing Ctrl+C will stop the recording and then convert it using ffmpeg into an mp4 to make it playable. Note that ffmpeg will need to be installed and runnable for the conversion to mp4 to succeed.Be careful, this example saves encoded video to your host storage. So if you leave it running, you could fill up your storage on your host.

Similar samples:

Demo

Setup

Please run the install script to download all required dependencies. Please note that this script must be ran from git context, so you have to download the depthai-python repository first and then run the script

Command Line

1git clone https://github.com/luxonis/depthai-python.git
2cd depthai-python/examples
3python3 install_requirements.py

For additional information, please follow the installation guide.

Source code

Python

C++

Python

GitHub

1#!/usr/bin/env python3
2
3import depthai as dai
4
5# Create pipeline
6pipeline = dai.Pipeline()
7
8# Define sources and outputs
9camRgb = pipeline.create(dai.node.ColorCamera)
10monoLeft = pipeline.create(dai.node.MonoCamera)
11monoRight = pipeline.create(dai.node.MonoCamera)
12ve1 = pipeline.create(dai.node.VideoEncoder)
13ve2 = pipeline.create(dai.node.VideoEncoder)
14ve3 = pipeline.create(dai.node.VideoEncoder)
15
16ve1Out = pipeline.create(dai.node.XLinkOut)
17ve2Out = pipeline.create(dai.node.XLinkOut)
18ve3Out = pipeline.create(dai.node.XLinkOut)
19
20ve1Out.setStreamName('ve1Out')
21ve2Out.setStreamName('ve2Out')
22ve3Out.setStreamName('ve3Out')
23
24# Properties
25camRgb.setBoardSocket(dai.CameraBoardSocket.CAM_A)
26monoLeft.setCamera("left")
27monoRight.setCamera("right")
28# Create encoders, one for each camera, consuming the frames and encoding them using H.264 / H.265 encoding
29ve1.setDefaultProfilePreset(30, dai.VideoEncoderProperties.Profile.H264_MAIN)
30ve2.setDefaultProfilePreset(30, dai.VideoEncoderProperties.Profile.H265_MAIN)
31ve3.setDefaultProfilePreset(30, dai.VideoEncoderProperties.Profile.H264_MAIN)
32
33# Linking
34monoLeft.out.link(ve1.input)
35camRgb.video.link(ve2.input)
36monoRight.out.link(ve3.input)
37ve1.bitstream.link(ve1Out.input)
38ve2.bitstream.link(ve2Out.input)
39ve3.bitstream.link(ve3Out.input)
40
41# Connect to device and start pipeline
42with dai.Device(pipeline) as dev:
43
44    # Output queues will be used to get the encoded data from the outputs defined above
45    outQ1 = dev.getOutputQueue(name='ve1Out', maxSize=30, blocking=True)
46    outQ2 = dev.getOutputQueue(name='ve2Out', maxSize=30, blocking=True)
47    outQ3 = dev.getOutputQueue(name='ve3Out', maxSize=30, blocking=True)
48
49    # The .h264 / .h265 files are raw stream files (not playable yet)
50    with open('mono1.h264', 'wb') as fileMono1H264, open('color.h265', 'wb') as fileColorH265, open('mono2.h264', 'wb') as fileMono2H264:
51        print("Press Ctrl+C to stop encoding...")
52        while True:
53            try:
54                # Empty each queue
55                while outQ1.has():
56                    outQ1.get().getData().tofile(fileMono1H264)
57
58                while outQ2.has():
59                    outQ2.get().getData().tofile(fileColorH265)
60
61                while outQ3.has():
62                    outQ3.get().getData().tofile(fileMono2H264)
63            except KeyboardInterrupt:
64                # Keyboard interrupt (Ctrl + C) detected
65                break
66
67    print("To view the encoded data, convert the stream file (.h264/.h265) into a video file (.mp4), using commands below:")
68    cmd = "ffmpeg -framerate 30 -i {} -c copy {}"
69    print(cmd.format("mono1.h264", "mono1.mp4"))
70    print(cmd.format("mono2.h264", "mono2.mp4"))
71    print(cmd.format("color.h265", "color.mp4"))

Need assistance?

Head over to Discussion Forum for technical support or any other questions you might have.