Working with colorization

Contents

• Introduction
• Concepts
• Requirements
• Scanning Tips and Techniques
• Setting up the GoPro
  • Pair the GoPro camera
  • Update the camera firmware
  • Adjust the camera settings
• Hardware Setup and Mounting
  
  • Mount the camera
• Scan Collection
  
  • Start scanning
  • Remotely start the camera
  • Stop your scan
• Process your Hovermap dataset

Introduction

Hovermap can create world-class true color point clouds, providing additional context for visualization and analysis. This builds on the incredible data that Hovermap already produces to create rich, accurate digital twins and surveys.

The colorization feature uses a calibrated GoPro camera that attaches to Hovermap. This modular approach allows you to attach the camera only when colorized scans are needed.

You can use the perspective-based GoPro Hero cameras or the 360° field of view GoPro Max for colorization. Emesent recommends using the 360 GoPro Max when capturing a larger amount of colorization data. However, the perspective Hero cameras may be more suitable in certain cases.

GoPro Hero cameras have a restricted field of vision, which means only the area within the camera's view will be colorized. To ensure optimal results, it is essential to point the GoPro directly toward the specific subject you are interested in capturing.

Concepts

Hovermap colorization is delivered as a complete hardware and software solution.

• Camera: A GoPro is supplied with the colorization option, with a memory card and USB cable for data transfer.

• Camera mount: A rigid mount is installed that allows the camera to be installed and removed in a repeatable fashion.

• Calibration: Factory calibration is performed on your Hovermap to ensure alignment between LiDAR data and video recording.

• Software: The latest version of Emesent Aura.

• License: A valid Colorization license.

Requirements

• Factory-installed and calibrated camera hardware

• Emesent Aura

• Updated license dongle for colorization

• Hovermap scan file

• GoPro video file

Scanning Tips and Techniques

There are a number of considerations that will improve the quality of the colorization.

• Follow the recommended settings for your GoPro.

• Ensure that the GoPro lens is clean and free of dust and other material.

• Only points that fall into the camera’s field of view will be colored.

• Keep the Hovermap still for the first 10 seconds after the LiDAR starts to spin, then perform at least three vigorous side-to-side synchronization rotations.

• If using a GoPro Hero perspective camera, we recommend using a “painting” motion to capture as much of the area as possible.

• Minimize vibrational movement to avoid blurry video frames. Move slowly and avoid sharp turns and jerky movements.

• Keep your scanning distance to around 20 m / 65 ft. If you go further than this, the matching of the pixels and points deviates, and you will see a slight decrease in quality.

• It is important to have sufficient lighting in the area being colorized. While Hovermap can operate in complete darkness, the GoPro requires adequate lighting.

• Spend time on subjects to be colorized to improve colorization quality.

• For the best results, make sure to capture each object in the scene from multiple angles using the GoPro camera.

• Limit any movement of objects in the scene being captured, including people walking through the frame.

• Avoid tampering with, or removing, the GoPro mounting bracket. Its exact position has been accounted for during the calibration process.

• Only use colorization when necessary as scanning and processing colorized scans can take longer than a normal scan.

• Each GoPro is calibrated to a specific Hovermap. Do not use a GoPro that has not been calibrated to your Hovermap. Contact your local reseller or Customer Success if you need a new GoPro.

• To help keep your scans and videos in sync, hold your phone in front of the camera after starting the scan and the recording to capture the name of the current scan in the Hovermap web UI.

Setting up the GoPro

Prior to using the colorization software, make sure the GoPro is up to date and video capture settings have been set in the required configuration.

Pair the GoPro camera

The Quick app allows you to start and stop recording remotely. This can be useful in some situations where the camera and Hovermap must be started from a distance.

The steps vary depending on the camera model. The following instructions only apply to the MAX, Hero 8, and Hero 7 models. Refer to the GoPro Support page for other camera-specific pairing instructions.

1. Put your camera in pairing mode:

   1. Power on your camera by holding down the Mode button.

   2. Open the utility drawer by swiping from the top to the bottom of the touch display, then select Preferences.

   3. Select Connections > Connect to GoPro App.

2. Open the Quik app:

   1. Select the GoPro icon in the top left corner and tap Connect a GoPro.

   2. The app will search for and display a list of cameras. Select your camera.

   3. Select My Camera is On and tap Pair Camera.

   4. When you see the message that your camera has been found, tap Connect camera.

   5. Enter a name for the camera or leave the default name.

   6. When you see the message that your camera is ready, tap Let's Go.

Update the camera firmware

Make sure the camera firmware is updated to the latest version. The Quik app automatically notifies you of firmware upgrades. Follow the on-screen instructions as shown below to upgrade the camera firmware.

1. Make sure that the GoPro general settings are correct. These settings vary depending on the camera model. Refer to GoPro Settings for Colorization for the specific settings to be used.

2. Once you have configured the settings, Accept all changes and Save settings into the Custom profile.

Hardware Setup/Mounting

Emesent or an authorized service agent will supply and install the GoPro mount for your Hovermap. The following instructions are provided in cases where you need to remove and reinstall the mounting system.

Mount the camera

1. Mount the camera bracket to the Hovermap unit using the four supplied screws. The front end of the bracket should be facing toward the Hovermap LiDAR.
   Note: It is recommended to apply a small amount of Loctite 222 to all of the screws.

2. Once attached, lift the blue retention latch on the camera bracket then insert your GoPro camera. Insert the camera with the main screen facing away from the Hovermap LiDAR.

3. Pull the retention latch down to secure the GoPro in place. Ensure it is sitting securely. It should not be able to move laterally when in the mount.

Scan Collection

This section details how to start/stop a scan including the remote start and stop procedures.

 

In order the capture good data for colorization, there is a number of things that must be considered.

1. Press Record on the GoPro and Start on Hovermap at the same time.

2. Allow Hovermap to remain still for at least 10 seconds after the LiDAR starts spinning (about five slow green pulses).

3. Perform at least three vigorous side-to-side synchronization rotations.

To remotely start the recording using the GoPro App:

1. Open the Quick app on your tablet or smartphone.

2. Connect to your GoPro.

3. Press the middle circle button to Start recording.

1. Re-open the Quick app.

2. Press the middle circle button to Stop recording.

Stop your scan

Press Record on the GoPro and Stop on Hovermap at the same time.

1. While the Hovermap dataset is processing to generate the point cloud, begin gathering the corresponding video from the GoPro memory card.

   1. Insert the supplied USB-C to USB data cable into the GoPro and your computer.

   2. Navigate to your GoPro. Video files are located in GoProMTP Client Disk Volume\DCIM\100GOPRO.

   3. Copy the video file that corresponds to the scan into the Hovermap scan folder.
      Note: Files can also be transferred by removing the memory card from, and inserting into, a Micro SD card reader connected to your computer.
      Note: For longer scans, the GoPro may split the recording into multiple video files. Ensure all relevant files are copied to the scan folder.
      Warning: If the GoPro has split the video captured into multiple files, ensure that the file sequence (by filename) is not lost if renaming the video files.

2. Wait for all video files to be transferred and for the initial point cloud processing to complete.

Process your Hovermap dataset

Go to the Colorization section in the Emesent Aura user manual for more information on processing your colorized dataset.