Open Source Video Processing Pipelines

Video processing pipelines are a huge topic; there are many cameras, protocols, processors and processes for video. When building a video pipeline, it is hard to know which Open Source pieces can be used, and which closed-source pieces have to be used. This article surveys the landscape, and recommends when to use what. Particular attention is paid to European and Open Source components, and to freely available protocols. Needed applications and hardware are identified. The article reviews: 1 Drone applications. 2 Other example applications. 3 Camera components. 4 Multi-camera systems. 5 Camera communication protocols. 6 24 image processing blocks. 7 Cameras. 8 Longer range protocols. 9 FPGAs supported by Yosys and Nextpnr. 10 FPGAs with MIPI. 11 European FPGAs. 12 Verilog and VHDL libraries. 13 Microcontrollers processing video. 14 Libmpix on Zephyr OS. 15 Protocol bridge chips.