Home

Awesome

AR Population:

Visualization of GAMMA: The Wanderings of Odysseus in 3D Scenes in AR on the hololens 2.

cite this work when using the content.

@inproceedings{zhang2022wanderings,
  title={The Wanderings of Odysseus in 3D Scenes},
  author={Zhang, Yan and Tang, Siyu},
  booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
  pages={20481--20491},
  year={2022}
}

Installation

The latest build together with demo videos can be found here: https://polybox.ethz.ch/index.php/s/KU0BVeec2ToCxlq.

To install, copy the build to the hololens with a USB stick or over the device portal. On the holelens open the bundle with the App Installer.

To run the app, the GAMMA server has to be set up: This can be done locally or in the cloud. See here for setup instructions both on the google cloud and on a local server.

Usage

Start the app and open the hand menu by turning the palm of your hand upwards. Press on the server settings button to open the server menu. There the connection to the server can be setup and tested. To enter a different host address, point at the field and perform an air tap. If the test connection button is green, everything works. Alternatively one can edit the config.json file in the hololens device portal under LocalAppData/ar-population/LocalState/config.json

Close the menu and watch around. The white lines visualize the spatial mesh. Air tap on the floor to create a way point, which will be visible as a green sphere. Air tap on a different part of the floor to create a second waypoint. Now a path was created. This path can be extended by any amount of way points. Now open the menu and click create animation. The path will turn blue, which indicates that the application is waiting for a response form the gamma server. This can take up to 30 seconds. Afterwards an animation is generated and played. A different path can be created in the same way.

With the destroy animation button the last generated animation is destroyed. The reset path button resets the current path if clicked at a wrong position. With the two switches, the spatial mesh visualization and the paths can be enabled and disabled.

The holograms are stored persistently (LocalAppData/ar-population/LocalState/animations) and locked to the place where they were created. To ensure this also works when bringing the hololens to a different place, the application should be closed with the close button of the menu.

Project Build Instructions

Requirements

Setup

Build

Setting NameValue
ArchitectureARM 64 bit
Build TypeD3D Project
Target SDKLatest installed
Minimum Platform VersionDefault value
Visual StudioLatest installed
Build and Run onRemote Device(via Device Portal)
Build configurationRelease
Remaining pointsDefault values

Packaging