Create Custom Masks in Aura

Prev Next

This article explains how to create a custom image mask for use in 360 image extraction or colorization in Aura. The result is a PNG mask file that can be loaded into the Mask template list and applied to extracted frames.

When processing a dataset with 360 video for image extraction or colorization, a mask is applied to the extracted frames to hide areas that should not be shown. Aura includes several pre-defined masks for common camera mount configurations. If none are suitable for the dataset, a custom mask can be created using any image editing software.

What you will need

  • A processed scan with 360 video data, open in Aura.

  • Image editing software. This article uses GIMP (free); the techniques apply to any image editor.

  • Access to the Aura predefined mask folder at Program Files > Aura > Aura > Plugins > EmtProcessWorkflows > Content > ProcessWorkflows > ImageMasks.

Procedure

Step 1: Extract frames without masking

  1. Run an Extract 360 images workflow with Image masking turned off.

    Extract 360 images workflow with Image masking turned off

  2. Once the frame extraction process is completed, navigate to the extracted frames folder.

For large videos, sub-sample first by setting a high Frame interval (e.g. 250) to reduce processing time.

Step 2: Open a frame in GIMP

  1. Select a frame to create a mask for and open it in GIMP.

    Context menu showing options to open files with GIMP or other applications

  2. Adjust the display to ensure the image fits the screen properly.

    Frame loaded in GIMP with display adjusted to fit screen

Step 3: Load a predefined mask as a starting layer

Start with an existing mask instead of creating one from scratch.

  1. Open the folder containing the predefined masks: Program Files > Aura > Aura > Plugins > EmtProcessWorkflows > Content > ProcessWorkflows > ImageMasks.

  2. Select a suitable mask from either the Colourise or FrameExtract folder.

  3. Drag the mask onto the current image in GIMP. It appears as a new layer.

    Predefined mask dragged onto image in GIMP as a new layer

Step 4: Select the masked area

  1. Use the Fuzzy Select Tool (also known as the Magic Wand) and click the black area of the mask layer to select it.

    Fuzzy Select Tool used to select the black area of the mask

  2. In the Layer panel on the right, click the Eye icon before the mask layer to hide the mask. Each layer appears as a thumbnail, and the upper layer in the list is the first one visible.

    Eye icon in the Layer panel used to hide the mask layer

    The selected mask area is now visible on top of the image.

    Selected mask area visible on top of the underlying image

Step 5: Refine the mask selection

  1. Use the Free Select Tool to add or refine areas as needed.

  2. Ensure the Mode is set to Add to the current selection. Click the second mode icon or hold the Shift key while selecting.

  3. Press Enter to add each area to the current selection.

    Free Select Tool used to add areas to the mask selection

  4. Keep the frames folder handy and add more frames if necessary. Review each added frame, adjusting the mask to ensure proper coverage, especially around challenging areas like hands or cables.

Step 6: Convert the selection to a mask image

  1. Ensure the active background color is set to black.

    GIMP foreground and background color swatches with black background active

  2. In the Layer panel, select the base layer containing the extracted image.

    Base image layer selected in the Layer panel

  3. Press Delete on the keyboard.

    Base layer mask area cleared to background colour

  4. Go to Select > Invert, then press Delete again. The entire image is now black.

    Entire image filled with black after invert and delete

  5. Click the Bucket Fill Tool and ensure the active foreground color is white.

    Bucket Fill Tool selected with white set as the foreground colour

  6. Click the top area to fill it with the active foreground color (white).

    Top area filled with white to complete the mask

Step 7: Export the mask as a PNG

  1. Go to File > Export As.

  2. Save the mask in PNG format to avoid the lossy compression issues associated with JPG files.

    Export As dialog in GIMP with PNG format selected

  3. Click Export.

  4. Close GIMP and return to Aura.

If using Aura 1.5 or earlier, change the pixel format to 8bpc RGB before exporting.

Step 8: Add the custom mask to Aura

  1. Run a Colorize or Extract 360 images workflow.

  2. Click Processing Settings.

  3. In the Colorize or Extract 360 images tab, enable Image masking.

    Image masking option enabled in Processing Settings

  4. In Mask template, click the + icon.

  5. Enter a name for the new mask, click Create, then browse for the newly created mask file.

    Mask template dialog with the new mask name entered and file selected

  6. Click Save to finish adding the custom mask to Aura.

    Custom mask loaded and visible in the Mask template list

Outcome

The custom mask is saved as a PNG file and loaded into Aura's Mask template list. It can now be selected when running Colorize or Extract 360 images workflows.

Additional information