Voice Commands (MR)

General

The following list outlines the available voice commands to holo|one sphere MR clients. In order for these to work, the user must have enabled “Voice Commands” in the settings panel.

Once voice commands have been enabled in the settings, the user must also turn on active listening mode, where sphere listens for all the words that the user speaks. These are triggered by two key phrases:

“Hey Sphere” - enables active listening
“Sphere Stop” - disables active listening

This allows the user keep the setting active but still quickly switch in and out of active listening if they are on a remote expert call or there is lots of background noise.

Spoken commands must match exactly with the listed command in order to be correctly recognized.

When speaking voice commands, you will see the current listening attempt being populated on the screen. Once the user stops speaking, sphere tries to recognize that speech. After processing, the text will change color to reflect 1 of 3 possible results.

GREEN - successful recognition and execution
YELLOW - preconditions for executing the command are not met, but it is a valid command
RED - not a valid command contained in command list

Commands List

Command	Description	Context & Prerequisites	Additional Notes
GENERAL
Select workflow	Launches a task session from the lobby or opens the workflow selection panel	User is in the lobby or in an active session
Setup call	Opens the call panel	User is in the lobby or in an active session
Add user	Opens the call panel	User is in an active session
Start workspace	Opens the workspace panel	User is in the lobby
Open settings	Opens the settings panel
End session	Tries to exit the current call or workspace session and return to the lobby.	User is in an active session	If there are snapshots active that need to be saved before exiting, this will be prompted and user will not exit immediately
Mute microphone Unmute microphone	Mutes and unmutes the users microphone	User is in an active session
Mute speaker Unmute speaker	Mutes and unmutes the session speaker output	User is in an active session
Enable camera Disable camera	Enables and disables the outgoing camera stream	User is in an active session
Show chat	Opens the session panel	User is in an active session
Enter scribbling mode	Activates the scribble tool	User is in an active session
Enter eraser mode	Activates the eraser tool	User is in an active session
Enter measurement mode	Activates the ruler tool	User is in an active session
Enter grouping mode	Activates the grouping/magnet tool	User is in an active session
Capture media	Opens the media capture panel	User is in an active session
PANELS
Move closer	Moves the panel slightly closer (there is a fixed range)	Panel is already open and in focus of gaze
Move further	Moves the panel slightly further away (there is a fixed range)	Panel is already open and in focus of gaze
Close panel	Closes the open panel	Panel is already open and in focus of gaze
Follow me	Activates tagalong for the panel	Panel is already open and in focus of gaze
Stop following me	Deactivates tagalong for the panel and pins it in the current position	Panel is already open and in focus of gaze
Scroll up Scroll down	Scrolls up or down in the list section	Scrollable area of the panel is in the focus of gaze
HOLOGRAMS
Face me	Turns the hologram to face the user	Hologram is in the focus of gaze Does not apply to model holograms
Adjust	Enters the hologram adjustment mode	Hologram is in the focus of gaze
Rotate up Rotate down Rotate left Rotate right	Rotates the hologram by 10 degrees in specified direction (relative to how the hologram faces the user)	Hologram is in the focus of gaze Hologram is in adjustment mode Does not apply for PDF holograms
Scale up Scale down	Scales the hologram up or down slightly	Hologram is in the focus of gaze Hologram is in adjustment mode
Delete	Deletes the hologram	Hologram is in the focus of gaze
VIDEO OR AUDIO HOLOGRAMS
Play	Start playback of video or audio hologram	Video/audio hologram is in the focus of gaze Playback is paused or stopped
Pause	Pauses playback of video or audio hologram	Video/audio hologram is in the focus of gaze Playback is active
Stop	Stops playback of video or audio hologram and jumps to the beginning of the clip	Video/audio hologram is in the focus of gaze Playback is active
Skip forward Skip backward	Skips the current video or audio hologram forward or backward by 15 seconds	Video/audio hologram is in the focus of gaze
Mute media Unmute media	Mutes or unmutes the audio or video hologram	Video/audio hologram is in the focus of gaze
PDF HOLOGRAMS
Next page	Jumps to the beginning of the next page	PDF hologram is in the focus of gaze
Previous page	Jumps to the beginning of the previous page	PDF hologram is in the focus of gaze
Zoom in Zoom out	Zooms in or out of the document by 10%	PDF hologram is in the focus of gaze
Scroll up Scroll down Scroll left Scroll right	Scrolls in the specified direction by a small amount	PDF hologram is in the focus of gaze
TASK & WORKFLOWS
Start workflow	Opens workflow panel or starts the selected workflow in an open panel	User is in an active session
Find by QR code	Tries to find a workflow based on a QR Code	Workflow selection panel is open
Next step	Tries to move the user to the next step in the workflow	Workflow step panel is open and in focus of gaze
Previous step	Moves the user to the previous step of the workflow	Workflow step panel is open and in focus of gaze
Skip step	Skips the current step of the workflow (if possible)	Workflow step panel is open and in focus of gaze
Capture photo	Starts a photo capture attempt. Will override the existing captured media if present.	User is currently on a photo input step
Capture video Record video	Starts a video capture attempt. Will override the existing captured media if present.	User is currently on a video input step
Capture audio Record audio	Starts an audio capture attempt. Will override the existing captured media if present.	User is currently on an audio input step
Capture barcode Scan barcode	Starts a barcode capture attempt. Will override the existing captured barcode if present.
Cancel capture	Cancels the current video or audio capture	User is actively capturing a barcode or audio or video input for a workflow step
Stop capture	Stops the current video or audio capture	User is actively capturing a barcode or audio or video input for a workflow step
Preview media input Preview media answer	Shows and hides the preview of the captured media input answer of a workflow step	User is on a media capture step and has already captured a media answer
Delete media input Delete media answer Remove media input Remove media answer	Deletes the current captured media input answer of a workflow step	User is on a media capture step and has already captured a media answer
Read description	Reads the title and description of the workflow step out loud	Workflow step panel is open
Stop reading description	Stops current text-to-speech playback of workflow step title/description