In-Call Features
      Back to home
      1. RemoteSpark Help Desk
      2. Product Features
      3. In-Call Features

      In-call interaction on the HoloLens

      The gestures, voice commands and command-bar interactions for RemoteSpark when in a video call

      In this article:
      HoloLens gestures used in RemoteSpark
      Voice commands
      The command bar

       

      HoloLens gestures used in RemoteSpark

      Note: currently the only supported gestures in RemoteSpark video calls are the same as those used on the 1st-generation HoloLens (gaze, air tap, air tap and hold, etc.). For further information, see Microsoft's article on HoloLens (1st generation) gestures.

      Tip: make sure all gestures are performed within the hand-tracking frame of the HoloLens.

       

      Image: Microsoft

      To make sure the hand-tracking sensors on the HoloLens can see your hand: do not place your hand too far to either side of you, up above the HoloLens, or too far down towards your waistline. Make sure your hand and arm are straight out front of you. Your arm does not need to be fully extended but can be.

      Keep in mind that as you move your head, the frame will adjust as well.

      Supported gestures

      1. Gaze cursor
        1. The gaze cursor is locked to the centre of your view (head gaze)
          Gaze cursor 4
        2. To select something, you will need to point your gaze at the object
        3. When your index finger is in the ready position, the cursor will be shown as open. This means it's ready for a gesture input
          Gaze cursor ready position 4
      2. Air tap 
        1. Point your finger towards the celing (think: making a number one with your finger)
        2. Lower your finger straight down (toward the ground or your thumb)
        3. Quickly raise your finger back toward the ceiling
          Air tap GIF
      3. Air tap and hold
        1. Point your index finger up toward the ceiling (think: making a number one with your finger)
        2. Lower your finger straight down (toward the ground or your thumb)
        3. Hold your index finger in the lowered position
        4. Point your finger toward the ceiling to release

          Air tap and hold GIF

       Tip: Keep your hand within view of the HoloLens, even as you move your head to do an air tap and hold.

      4. How not to air tap / air tap and hold
        1. Do not make a small pinch with your fingers
        2. Do not point your finger at the wall in front of you or to the side
          How not to air tap GIF

      Voice Commands

      Command: Function:
      Face Me

      All photos and documents tilt to face the user
      Take Photo

      Captures a photo
      Collect Images

      All photos are arranged in front of the user
      Collect Photos

      All photos are arranged in front of the user
      Gather Images

      All photos are arranged in front of the user
      Gather Photos

      All photos are arranged in front of the user
      Larger* The object’s size is doubled
      Smaller*

      The object’ size is reduced by 50%
      Next*

      Go forward one page on a document
      Previous*

      Go back one page on a document
      Remove*

      Deletes the object out of the session
      Delete Hologram*

      Deletes the object out of the session
      Adjust*

      Turns the bounding box ON on a hologram
      Resize*

      Toggles the bounding box ON on a hologram
      Done*

      Removes the bounding box on a hologram
      Rotate All

      Selects all 3D models in the session so they can be rotated together
      Move All

      Selects all 3D models in the session so they can be moved together
      Play Animation*

      Play an animation on a 3D model / play the next step on a Multi Step animated 3D model
      Reset Animation*

      Reset an animation / go back a step on a Multi-Step animated 3D model
      Toggle Play All*

      Toggle the play all function on a Multi-Step animated 3D model
      RemoteSpark, what is this?

      Attempts to do an object recognition using RemoteSpark AI service
      End Session (followed by 'yes' when prompted)

      Ends the Session and exits RemoteSpark
      Exit RemoteSpark (followed by 'yes' when prompted)

      Ends the Session and exits RemoteSpark.
      Hang Up (followed by 'yes' when prompted)

      Disconnects from the Expert, but the HoloLens remains in the call
      Hide Cursor

      The cursor is hidden from view

      Show Cursor (after Hide Cursor is used)

      		 The cursor is shown in view

      Note: starred object* means the user must be gazing at the object to perform the command.

      The command bar

      The command bar allows HoloLens users to perform a variety of interactive commands with holograms, documents or photos.

      Button: Applies to: Function:
      delete button

      Photos, documents, 3D models

      		 Deletes the object out of the session
      hide button

      Photos, documents, 3D models

      Toggles the visibility of the buttons on the command bar
      face me button Photos, documents

      All photos and documents tilt to face the user
      2x size

      Photos, documents, 3D models

      The object’s size is doubled
      0.5 size

      Photos, documents, 3D models

      The object’s size is reduced by 50%
      collect images button Photos

      All photos are arranged in front of the user
      forward arrow button Documents Go forward one page
      backward arrow button Documents Go back one page
      bounding box button 3D models Toggles the bounding box on a 3D model
      play button 2 3D models Play an animation on a 3D model/ play the next step on a Multi Step animated 3D model
      reset button 2 3D models

      Reset an animation / go back a step on a Multi-Step animated 3D model
      play all animation 3D models

      Toggle the play all function on a Multi-Step animated 3D model

       

      Activating the command bar

      When the HoloLens user has their finger in the ready position the command bar will snap to the object (3D model, document, photo), that they are gazing at.

      Command Bar