In-call interaction on the HoloLens

The gestures, voice commands and command-bar interactions for RemoteSpark when in a video call

In this article:

HoloLens gestures used in RemoteSpark
Voice commands
The command bar

 

HoloLens gestures used in RemoteSpark

Note: currently the only supported gestures in RemoteSpark video calls are the same as those used on the 1st-generation HoloLens (gaze, air tap, air tap and hold, etc.). For further information, see Microsoft's article on HoloLens (1st generation) gestures.

Tip: make sure all gestures are performed within the hand-tracking frame of the HoloLens.

 

Image: Microsoft

To make sure the hand-tracking sensors on the HoloLens can see your hand: do not place your hand too far to either side of you, up above the HoloLens, or too far down towards your waistline. Make sure your hand and arm are straight out front of you. Your arm does not need to be fully extended but can be.

Keep in mind that as you move your head, the frame will adjust as well.

Supported gestures

  1. Gaze cursor
    1. The gaze cursor is locked to the centre of your view (head gaze)
      Gaze cursor 4
    2. To select something, you will need to point your gaze at the object
    3. When your index finger is in the ready position, the cursor will be shown as open. This means it's ready for a gesture input
      Gaze cursor ready position 4
  2. Air tap 
    1. Point your finger towards the celing (think: making a number one with your finger)
    2. Lower your finger straight down (toward the ground or your thumb)
    3. Quickly raise your finger back toward the ceiling
      Air tap GIF
  3. Air tap and hold
    1. Point your index finger up toward the ceiling (think: making a number one with your finger)
    2. Lower your finger straight down (toward the ground or your thumb)
    3. Hold your index finger in the lowered position
    4. Point your finger toward the ceiling to release

      Air tap and hold GIF

 Tip: Keep your hand within view of the HoloLens, even as you move your head to do an air tap and hold.

4. How not to air tap / air tap and hold
    1. Do not make a small pinch with your fingers
    2. Do not point your finger at the wall in front of you or to the side
      How not to air tap GIF

Voice Commands

Command: Function:
Face Me

All photos and documents tilt to face the user

Take Photo

Captures a photo

Collect Images

All photos are arranged in front of the user

Collect Photos

All photos are arranged in front of the user

Gather Images

All photos are arranged in front of the user

Gather Photos

All photos are arranged in front of the user

Larger* The object’s (document or hologram) size is doubled
Smaller*

The object’s (document or hologram) size is reduced by 50%

Next*

Go forward one page on a document

Previous*

Go back one page on a document

Remove*

Deletes the object out of the session

Delete Hologram*

Deletes the object out of the session

Adjust*

Turns the bounding box ON on a hologram

Resize*

Toggles the bounding box ON on a hologram

Done*

Removes the bounding box on a hologram

Rotate All

Selects all holograms in the session so they can be rotated together

Move All

Selects all holograms in the session so they can be moved together

Play Animation*

Play an animation on a hologram / play the next step on a Multi Step animated hologram

Reset Animation*

Reset an animation / go back a step on a Multi-Step animated hologram

Toggle Play All*

Toggle the play all function on a Multi-Step animated model

End Session (followed by 'yes' when prompted)

Ends the Session and exits RemoteSpark

Exit RemoteSpark (followed by 'yes' when prompted)

Ends the Session and exits RemoteSpark.

Hang Up (followed by 'yes' when prompted)

Disconnects from the Expert, but the HoloLens remains in the call

Hide Cursor

The cursor is hidden from view

Show Cursor (after Hide Cursor is used)

The cursor is shown in view

Note: starred object* means the user must be gazing at the object to perform the command.

The command bar

The command bar allows HoloLens users to perform a variety of interactive commands with holograms, documents or photos.

Button: Applies to: Function:
delete button

Photos, documents, holograms

Deletes the object out of the session
hide button

Photos, documents, holograms

Toggles the visibility of the buttons on the command bar

face me button Photos, documents

All photos and documents tilt to face the user

2x size

Documents, holograms

The object’s size is doubled

0.5 size

Documents, holograms

The object’s size is reduced by 50%

collect images button Photos

All photos are arranged in front of the user

forward arrow button Documents Go forward one page
backward arrow button Documents Go back one page
bounding box button Holograms Toggles the bounding box on a hologram
play button 2 Holograms Play an animation on a hologram / play the next step on a Multi Step animated hologram
reset button 2 Holograms

Reset an animation / go back a step on a Multi-Step animated hologram

play all animation Holograms

Toggle the play all function on a Multi-Step animated model

 

Activating the command bar

When the HoloLens user has their finger in the ready position the command bar will snap to the object (hologram, document, photo), that they are gazing at.

Command Bar