JPEG2000 lossless raw encoding on Jetson Orin AGXThe NVIDIA Jetson Orin AGX hardware is highly promising for imaging and other embedded applications. This high-performance, low-power hardware is used in a variety of autonomous solutions. We have completed numerous projects in the following fields: Applications for realtime lossless J2K raw encoding on Jetson Orin
It's worth mentioning that a lossless encoding algorithm is often essential for these applications. We usually need to process 12-bit raw data from monochrome, infrared or Bayer cameras. The final RAW-to-RGB or RAW-to-Grayscale conversion can be done later; for now, we just need to capture and to compress the input raw frames using a lossless algorithm, and that should be done at real time. You can find detailed information about our testing approach and the latest benchmarks for JPEG2000 encoding and decoding on desktop/server NVIDIA GPUs you can find at the corresponding links. The procedure is exactly the same, but it is applied to the NVIDIA Jetson Orin hardware.
JPEG2000 lossless raw encoding parameters
Our lossless encoding benchmarks for that particular image are intended to demonstrate the level of performance that can be achieved with Jetson Orin hardware. However, as image compression ratio is content-dependent, you may get different results for your images. Nevertheless, the encoding performance level should remain consistent. Clearly, the compression ratio for lossy (visually lossless) encoding could be much higher for the JPEG2000 algorithm than for exact lossless compression. Therefore, we recommend testing different parameters to achieve the best compression ratio with acceptable image quality. Decreasing the quality coefficient not only improves compression, but also increases the framerate for both encoding and decoding. Our benchmarks show the performance results for the above images and parameters. Hardware and software
JPEG 2000 encoding benchmarks on NVIDIA Jetson Orin AGX for 12-bit 24-MPix raw bayer image
As we can see, we've achieved J2K lossless encoding performance of around 650 MPix/s for that particular 12-bit raw image at a 2-thread application. This is much higher than the performance requirements for various applications in a project. Please note that we can also offer lossy JPEG2000 raw encoding on Jetson Orin. This solution provides superior performance and a better compression ratio, albeit at the expense of some image quality distortion due to the lossy nature of the encoding process. This trade-off should be considered for each task separately. For applications requiring super-high performance in terms of raw image capture and encoding, we also have our 12-bit JPEG algorithm on CUDA, which is approximately more than ten times faster than the JPEG2000 encoder. For our test image, we've achieved a raw encoding frame rate of around 230 fps for 12-bit JPEG encoding on the Jetson Orin AGX with a jpg quality of 100 (meaning minor quality distortion). In this case, the compression ratio is around 15% lower than that of JPEG2000, but it is still very interesting and promising. With this algorithm, we also have the option of splitting the Bayer channels into four different planes and encoding them separately. This improves the compression ratio at the expense of some performance decrease. We can offer an evaluation of our Jetson ISP software by request. Please fill in the form below and send it to us. Other info from Fastvideo concerning JPEG2000 and Jetson |