JPEG Decoder

JPEG Bitmap Converter

Feature Description

The Traveo 2 JPEG Bitmap Converter allows the user to import compressed JPEG images directly into the solution using the JPEG bitmap profile. These JPEG images are then decoded by the onboard JPEG decoder at runtime. This means that the decompressed bitmaps need not be included in the assets, reducing the overall asset size.

Supported Platforms

At present, the JPEG Bitmap Converter is exclusively supported on the Infineon Traveo 2 platform.

Limitations

The JPEG Bitmap Converter currently has the following limitations.

Enabling the JPEG Decoder feature

If the JPEG Bitmap Converter feature is being used, ensure that the JPEG Decoder feature has been enabled in the CMAKE options. While generating the project for target, turn on the CMAKE flag CGIDEVICE_TRAVEO2_JPEG_DECODER_ENABLED or add this flag to the toolchain file.

drawing-7-1763097075.png

How to use the JPEG Bitmap Converter

  1. Import the JPEG image: Using the import menu, select "Import Resources"
    drawing-7-1763096261.png

  2. Choose a JPEG image and click "Open".
    drawing-7-1763096332.png


     

  3. In the import dialog box, create a new JPEG bitmap profile by checking the “Set bitmap profile” checkbox and then click the “Browse” button as shown in the image below. This only needs to be done once for a new solution, if a JPEG bitmap profile already exists, skip to Step 7.
    drawing-7-1763096393.png

  4. In the Bitmap Profile Palette window that opens, click on the add button as shown in the image below. If the Default Bitmap Profile is not populated on the right-hand side, populate it as shown below.
    drawing-7-1763096814.png

  5. In the Add new Bitmap Profile dialog that opens, populate the fields as shown in the image below. Click “Ok” once done.
    drawing-7-1763096861.png

  6. On the Bitmap Profile Palette, confirm that the JPEG Bitmap Converter has been added as shown in the image below and press Ok.
    drawing-7-1763096889.png

  7. Select the JPEG Bitmap Profile from the dropdown menu if it is not already selected as shown in the image below. Click Ok.
    drawing-7-1763096933.png

  8. Add the image to the scene by dragging and dropping it into the scene editor.
  9. Select “Generate Asset Library” option in File menu to generate the asset and check if the compressed JPEG images have been put into the asset.
  10. The asset generation export report should show the image of the encoded JPEG image. In the image below it is visible that the image is only 33kb which is much lesser than the decompressed bitmap size for the same image.
    drawing-7-1763096979.png

JPEG Decoder Behavior

Feature Description

The JPEG Decoder behavior allows the user to decode JPEG images at runtime using the hardware decoder. This means that the pre-decoded bitmaps need not be included in the assets, reducing the overall asset size. JPEG images are compressed, making them smaller in size, and they can be decoded by supported platforms.

Supported Platforms

At present, the JPEG decoder is exclusively supported on the Infineon Traveo 2 platform.

Limitations

The JPEG Decoder Behavior currently has the following limitations.

Enabling the JPEG Decoder feature

If the JPEG Decoder Behavior is being used, ensure that the JPEG Decoder feature has been enabled in the CMAKE options. While generating the project for target, turn on the CMAKE flag CGIDEVICE_TRAVEO2_JPEG_DECODER_ENABLED or add this flag to the toolchain file.

drawing-7-1763105200.png
How to use the JPEG Decoder
  1. Import the jpeg image as raw resource: Using the import menu select “Import Raw Resources”. This ensures that the image is available in its original format for further processing
    drawing-7-1763105227.png

  2. Add the Bitmap node to the scene: Add a bitmap node to a 2D scene.
  3. Add the Behavior to a Bitmap Node: Place the JPEG Decoder behavior onto a Bitmap Node in the scene.
    drawing-7-1763105255.png

  4. Set the Resource Candera Name: Paste the Candera Name of the raw JPEG image into the Resource Candera Name property using the steps below.
    a. Step 1: Copy the Candera Name of the raw JPEG image from the Solution Explorer under the Asset properties of the JPEG resource.
    drawing-7-1763105284.png

    b. Step 2: Paste the Candera Name into the ResourceCanderaName property of the JPEG Decoder Behavior in the Properties panel.
    drawing-7-1763105308.png

MJPEG Stream Behavior

Feature Description

The MJPEG Stream behavior allows the user to decode and play an MJPEG video stream. The MJPEG Stream behavior uses the onboard JPEG Decoder hardware to decode the JPEG frames and display them on a bitmap node.

Refer to the Video Format Conversion documentation to convert any video to MJPEG format.

Supported Platforms

At present, the Motion JPEG decoder is exclusively supported on the Infineon Traveo 2 platform.

Limitations

The Motion JPEG Decoder Behavior currently has the following limitations.

Enabling the JPEG Decoder feature

If the MJPEG Decoder Behavior is being used, ensure that the JPEG Decoder feature has been enabled in the CMAKE options. While generating the project for target, turn on the CMAKE flag CGIDEVICE_TRAVEO2_JPEG_DECODER_ENABLED or add this flag to the toolchain file.

drawing-7-1763105526.png

How to use the Motion - JPEG Decoder

  1. Import the video as raw resource: Using the import menu select “Import Raw Resources”. This ensures that the video is available in its original format for further processing.
    drawing-7-1763105557.png

  2. Add the Bitmap node: Add a bitmap node to a 2D scene.
  3. Add the Behavior to a Bitmap Node: Place the Motion - JPEG Decoder behavior onto a Bitmap Node in the scene. 
    drawing-7-1763105604.png
  4. Set the Resource Candera Name: Paste the Candera Name of the raw MJPEG video into the ResourceCanderaName property using the steps below.
    Step 1: Copy the Candera Name of the raw MJPEG video from the Solution Explorer under the Asset properties of the JPEG resource.
    drawing-7-1763105627.png

    Step 2: Paste the Candera Name into the ResourceCanderaName property of the Motion - JPEG Decoder Behavior in the Properties panel.
    drawing-7-1763105646.png

  5. Playing in Loop: The video can be configured to play continuously in a loop, if required.

  6. Initial State: The initial playback state of the video can be selected from the dropdown menu, as shown below.
    drawing-7-1763105673.png

  7. Frame Rate: Ensure that the frame rate is set to match the actual frame rate of the imported MJPEG video.
    drawing-7-1763105696.png

The properties for the Motion JPEG Decoder behavior are bindable and therefore can be modified at runtime as well.

Video Format Conversion

Introduction to ffmpeg

ffmpeg is a free and opensource tool that can be used to convert images and videos to different formats. The tool can be used to convert any video file to MJPEG format so that it can be imported and played by the MJPEG decoder behavior.

Installing ffmpeg

Using the ffmpeg tool to convert MP4 videos to MJPEG

The following command can be used to convert an mp4 file into MJPEG format:

ffmpeg -i input.mp4 -c:v mjpeg -q:v 2 -pix_fmt yuvj420p -huffman optimal -vf "scale=400:225" -f mjpeg -t 10 -r 15 output.mjpeg

The breakdown of the arguments in the command is as follow: