In-call interaction on the HoloLens

The gestures, voice commands and command-bar interactions for RemoteSpark when in a video call

In this article:

HoloLens gestures used in RemoteSpark
Voice commands
The command bar

 

HoloLens gestures used in RemoteSpark

Note: currently the only supported gestures in RemoteSpark video calls are the same as those used on the 1st-generation HoloLens (gaze, air tap, air tap and hold, etc.). For further information, see Microsoft's article on HoloLens (1st generation) gestures.

Tip: make sure all gestures are performed within the hand-tracking frame of the HoloLens.

 

Image: Microsoft

To make sure the hand-tracking sensors on the HoloLens can see your hand: do not place your hand too far to either side of you, up above the HoloLens, or too far down towards your waistline. Make sure your hand and arm are straight out front of you. Your arm does not need to be fully extended but can be.

Keep in mind that as you move your head, the frame will adjust as well.

Supported gestures

  1. Gaze cursor
    1. The gaze cursor is locked to the centre of your view (head gaze)
      Gaze cursor 4
    2. To select something, you will need to point your gaze at the object
    3. When your index finger is in the ready position, the cursor will be shown as open. This means it's ready for a gesture input
      Gaze cursor ready position 4
  2. Air tap 
    1. Point your finger towards the celing (think: making a number one with your finger)
    2. Lower your finger straight down (toward the ground or your thumb)
    3. Quickly raise your finger back toward the ceiling
      Air tap GIF
  3. Air tap and hold
    1. Point your index finger up toward the ceiling (think: making a number one with your finger)
    2. Lower your finger straight down (toward the ground or your thumb)
    3. Hold your index finger in the lowered position
    4. Point your finger toward the ceiling to release

      Air tap and hold GIF

 Tip: Keep your hand within view of the HoloLens, even as you move your head to do an air tap and hold.

4. How not to air tap / air tap and hold
    1. Do not make a small pinch with your fingers
    2. Do not point your finger at the wall in front of you or to the side
      How not to air tap GIF

Voice Commands

Command: Function:
Face Me

All photos and documents tilt to face the user

Take Photo

Captures a photo

Collect Images

Collect Photos

Gather Images

Gather Photos

All photos are arranged in front of the user

Larger*

Smaller*

The object’s size is doubled or halved

Next*

Previous*

Navigates through the document in focus

Remove*

Delete Hologram*

Permanently deletes the object out of the session

Adjust*

Resize*

Turns on the bounding box on the focused hologram

Done*

Toggles the bounding box ON on a hologram

Rotate All

Move All

Selects all 3D models in the session so they can be rotated or moved together

Play Animation*

Reset Animation*

Play or reset an animation on a 3D model / play the next or previous step on a multi-step animated 3D model

Toggle Play All*

Toggle the play all function on a Multi-Step animated 3D model

End Session

Exit RemoteSpark

Followed by ‘yes’ when prompted ends the session and exits RemoteSpark

Hang Up

Followed by ‘yes’ when prompted disconnects from the SME but the HoloLens remains in the call

Hide Cursor

Show Cursor

Shows or hides the cursor from field of view

Status

Toggles the call status display to see the health of the call; shows battery life and wifi strength

Note: starred object* means the user must be gazing at the object to perform the command.

The command bar

The command bar allows HoloLens users to perform a variety of interactive commands with holograms, documents or photos.

Button: Applies to: Function:
delete button

Photos, documents, 3D models

Deletes the object out of the session
hide button

Photos, documents, 3D models

Toggles the visibility of the buttons on the command bar

face me button Photos, documents

All photos and documents tilt to face the user

2x size

Photos, documents, 3D models

The object’s size is doubled

0.5 size

Photos, documents, 3D models

The object’s size is reduced by 50%

collect images button Photos

All photos are arranged in front of the user

forward arrow button Documents Go forward one page
backward arrow button Documents Go back one page
bounding box button 3D models Toggles the bounding box on a 3D model
play button 2 3D models Play an animation on a 3D model/ play the next step on a Multi Step animated 3D model
reset button 2 3D models

Reset an animation / go back a step on a Multi-Step animated 3D model

play all animation 3D models

Toggle the play all function on a Multi-Step animated 3D model

 

Activating the command bar

When the HoloLens user has their finger in the ready position the command bar will snap to the object (3D model, document, photo), that they are gazing at.

Command Bar