RealityCapture tutorial: Image Layers

February 26, 2020 posted by

Hello my name is Tomas and I am from
Capturing Reality. Today we will take a look at Image Layers. I will talk about what they are and how you can use them. We will also learn about importance of
naming schemes of images and folders. There are many use cases how you can use image layers. For example, you can use them to achieve better geometry in
alignment and machine, create multiple texture maps for loop development, to add textures from external cameras, depth maps, masks and so on. In this episode we will use full body scanning dataset provided by This one was captured with and without structured light patterns. These images like this one are reduced to enhanced detail of geometry, and simplify alignment and meshing process. You can see these projected light patterns on her face, using this method. Quick tip to toggle between multiple textures click on 2D view and press tab to view the next texture and Shift Tab to view the
previous one. Let’s take a look at how naming of images works. You have to use this renaming method so RealityCapture can automatically determine how we want to use our data set. You have two options how to name them. You can rename folders
or rename images. You can learn more about renaming images inside RealityCapture Help Section. Today I will show you only the easier option, which is renaming
folders. Here I created this messy image structure . Let’s rename and separate images to folders and rename them so every image from the same camera
position will have the same name. Ok, I’ve created and named these free
folders to underscore geometry, underscore texture 01, underscore
texture 02. Using names geometry and texture is required however instead of underscore suffix you can use comma, @ symbol, hashtag or exclamation mark. In this example underscore geometry folder stands for main folder with images I’ve
chosen for alignment and meshing. Underscore 01 stands for folder with images for creating diffuse texture. If you only want to create one texture you can also name it underscore texture. RealityCapture can use either or another one and here is underscore texture 02 which I’ve
chosen for folder with images are creating diffuse texture with projected
line patterns. Now I’ll open these folders for you. In this folder underscore geometry you can see I renamed these photos with a counter from 101 to 223. This is the naming scheme you want to perceive through all three folders, so one camera position will have the same name in all of three folders. For example, look at this image and all of these folders. It’s the camera angle taken from the same camera position. Speaking of JPG, you can also use EXR, HDR, TIF or any other supported format. In this folder underscore texture 01, there
are photos taken with usual flat lighting setup and in this folder underscore texture 02 there are copy pasted photos from
underscore geometry folder because I also want to create a texture with
projected line patterns. I could also create the folder with underscore texture 0 free with thermal images, as I told in the intro of the video. When I have verified that all camera
positions have the same name, I can now open new project in RealityCapture. Now I can drag and drop these folders to RealityCapture Quick tip. If you have followed aiming skill correctly you can also drag and drop parent folder, where
are all of these subfolders with images and RealityCapture will automatically
assign texture layers to geometry later. In this tutorial, I am using PPI license.
You can download it for free and link is in the description below. Here we can see
there are only 116 images. All of these texture layers are assigned to the
geometry layer. This is great with using PPI licensing model. You only need to license the input from geometry layer and use as many image texture layers as
you need without extra charge. If you want to verify all of desired image
layers were imported, select one photo in 1D view, click on 2D view, press Tab to
go to the next image texture and Shift Tab to go back to previous one. Ok everything is imported as intended, so let’s align images, create a mesh, and
create two desired textures. Let’s fast forward it. Textures were created automatically for every image texture layer as you can see here. Look at this model in 3D view. If you want to toggle this projected light pattern texture to clean diffuse texture just open model tree and under model textures you can
see color layer 1 and color layer 2. Click on eye icon here, to show texture
layer you want to see. Okay let’s recap what we have learned today. Name photos with the same file name across all camera positions in geometry and texture
folders. Name folders, geometry and texture, using underscore, coma, @, hashtag, exclamation mark and use numbers for texture layers. Verify they aren’t any mistakes and image positions are named with the correct file name. Drag and drop parent folder with all the contents to RealityCapture. Verify that every desired texture was edited with Tab and Shift Tab into 2D view. Starts alignment, mashing, texturing and export or share it directly to the world. If you liked this episode please like, subscribe and comment what you want to see next. Also, follow us on Facebook, Instagram, Twitter and LinkedIn. I’m Tomas and thank you for using Reality Capture.

No Comments
Tags: , ,

Leave a Comment

Your email address will not be published. Required fields are marked *