The gestures, voice commands and command-bar interactions for RemoteSpark when in a video call
In this article: |
HoloLens gestures used in RemoteSpark |
Voice commands |
The command bar |
HoloLens gestures used in RemoteSpark
Note: currently the only supported gestures in RemoteSpark video calls are the same as those used on the 1st-generation HoloLens (gaze, air tap, air tap and hold, etc.). For further information, see Microsoft's article on HoloLens (1st generation) gestures.
Tip: make sure all gestures are performed within the hand-tracking frame of the HoloLens.
Image: Microsoft
To make sure the hand-tracking sensors on the HoloLens can see your hand: do not place your hand too far to either side of you, up above the HoloLens, or too far down towards your waistline. Make sure your hand and arm are straight out front of you. Your arm does not need to be fully extended but can be.
Keep in mind that as you move your head, the frame will adjust as well.
Supported gestures
- Gaze cursor
- The gaze cursor is locked to the centre of your view (head gaze)
- To select something, you will need to point your gaze at the object
- When your index finger is in the ready position, the cursor will be shown as open. This means it's ready for a gesture input
- The gaze cursor is locked to the centre of your view (head gaze)
- Air tap
- Point your finger towards the celing (think: making a number one with your finger)
- Lower your finger straight down (toward the ground or your thumb)
- Quickly raise your finger back toward the ceiling
- Air tap and hold
- Point your index finger up toward the ceiling (think: making a number one with your finger)
- Lower your finger straight down (toward the ground or your thumb)
- Hold your index finger in the lowered position
- Point your finger toward the ceiling to release
Tip: Keep your hand within view of the HoloLens, even as you move your head to do an air tap and hold.
-
- Do not make a small pinch with your fingers
- Do not point your finger at the wall in front of you or to the side
Voice Commands
Command: | Function: |
Face Me |
All photos and documents tilt to face the user |
Take Photo |
Captures a photo |
Collect Images |
All photos are arranged in front of the user |
Collect Photos |
All photos are arranged in front of the user |
Gather Images |
All photos are arranged in front of the user |
Gather Photos |
All photos are arranged in front of the user |
Larger* | The object’s size is doubled |
Smaller* |
The object’ size is reduced by 50% |
Next* |
Go forward one page on a document |
Previous* |
Go back one page on a document |
Remove* |
Deletes the object out of the session |
Delete Hologram* |
Deletes the object out of the session |
Adjust* |
Turns the bounding box ON on a hologram |
Resize* |
Toggles the bounding box ON on a hologram |
Done* |
Removes the bounding box on a hologram |
Rotate All |
Selects all 3D models in the session so they can be rotated together |
Move All |
Selects all 3D models in the session so they can be moved together |
Play Animation* |
Play an animation on a 3D model / play the next step on a Multi Step animated 3D model |
Reset Animation* |
Reset an animation / go back a step on a Multi-Step animated 3D model |
Toggle Play All* |
Toggle the play all function on a Multi-Step animated 3D model |
RemoteSpark, what is this? |
Attempts to do an object recognition using RemoteSpark AI service |
End Session (followed by 'yes' when prompted) |
Ends the Session and exits RemoteSpark |
Exit RemoteSpark (followed by 'yes' when prompted) |
Ends the Session and exits RemoteSpark. |
Hang Up (followed by 'yes' when prompted) |
Disconnects from the Expert, but the HoloLens remains in the call |
Hide Cursor |
The cursor is hidden from view |
Show Cursor (after Hide Cursor is used) |
The cursor is shown in view |
Note: starred object* means the user must be gazing at the object to perform the command.
The command bar
The command bar allows HoloLens users to perform a variety of interactive commands with holograms, documents or photos.
Button: | Applies to: | Function: |
![]() |
Photos, documents, 3D models |
Deletes the object out of the session |
![]() |
Photos, documents, 3D models |
Toggles the visibility of the buttons on the command bar |
![]() |
Photos, documents |
All photos and documents tilt to face the user |
![]() |
Photos, documents, 3D models |
The object’s size is doubled |
![]() |
Photos, documents, 3D models |
The object’s size is reduced by 50% |
![]() |
Photos |
All photos are arranged in front of the user |
![]() |
Documents | Go forward one page |
![]() |
Documents | Go back one page |
![]() |
3D models | Toggles the bounding box on a 3D model |
![]() |
3D models | Play an animation on a 3D model/ play the next step on a Multi Step animated 3D model |
![]() |
3D models |
Reset an animation / go back a step on a Multi-Step animated 3D model |
![]() |
3D models |
Toggle the play all function on a Multi-Step animated 3D model |
Activating the command bar
When the HoloLens user has their finger in the ready position the command bar will snap to the object (3D model, document, photo), that they are gazing at.