GPU Image Processing for XIMEA xiQ cameras with USB-3.0 interface

There are quite a lot of image sensors with high resolution and high speed capabilities at the same time. All of them can generate significant amounts of raw data and it's a complicated problem how to perform image processing and save recorded data in realtime. One can choose simple solution - just use fast SSD drive or RAID to record and save all raw data. In that approach one could quickly ran out of disk space and you will need much time to do image processing to get high quality images from raw data.

Image sensors of color cameras are covered with Bayer filter arrays to recover color information later at post processing stage. So after demosaicing (debayering) the amount of data will be tripled. Trying to do that even on the fastest CPU we will see that performance for image processing would be far from realtime due to high frame rate or high resolution of image sensors. Below we list some frequently used image sensors to deal with:

Image sensors for XIMEA xiQ cameras

• CMV300: 640×480, 500 fps (8-bit), 250 fps (10-bit)
• CMV2000: 2048×1088, 340 fps (10-bit), 70 fps (12-bit)
• CMV4000: 2048×2048, 180 fps (10-bit), 37 fps (12-bit)
• e2V EV76C560: 1280×1024, 60 fps (10-bit)
• Onsemi PYTHON 1300: 1280×1024, 210 fps (10-bit)

FastVCR software for realtime image processing on GPU for xiB cameras

• Image acquisition
• Frame unpacking for 10-bit and 12-bit modes
• Image linearization
• Dark frame subtraction (FPN)
• Flat-Field Correction (shading correction)
• Bad pixel removal
• White Balance / AWB
• Adaptive Exposure and Gain control
• High quality demosaicing with MG algorithm
• Color correction with matrix profile or DCP profile
• Highlight recovery
• Exposure correction (brightness control)
• Curves and Levels
• Denoising
• Rotation to 90/180/270 degrees and flip/flop
• Crop
• Resize (downscale and upscale)
• Rotation to an arbitrary angle
• Sharpening (local contrast)
• Gamma transform
• JPEG compression and storage on SSD
• Optional conversion to NV12 and h264/h265/av1 video encoding
• Automatic realtime partitioning of AVI/MP4 video files to the specified file size

Compatibility

• CUDA-12.3 for Windows/Linux, NVIDIA GeForce, Quadro, Tesla
• CUDA-11.4 for NVIDIA Jetson NX, AGX Xavier, Orin
• XIMEA USB3 and PCIe cameras
• Processing of 8-12-bit RAW/PGM/TIFF images from SSD

Advantages of GPU image processing for xiQ cameras

• Per-pixel offset and shading correction
• High quality demosaicing
• Low latency output to monitor via OpenGL
• Fast image processing at very high fps
• Realtime image processing for multiple camera systems
• Low CPU usage

Software downloads

• FastVCR software for XIMEA cameras on Windows and CUDA-12.6. The software can also work with PGM/RAW/TIFF frames from SSD on Windows.
• FastVCR software for XIMEA cameras on Jetson Nano and CUDA-10.2
• FastVCR software for XIMEA cameras on Jetson NX/AGX Xavier and Orin on CUDA-11.4
• PDF manual for FasVCR software
• XIMEA SDK for Windows/Linux/ARM