JAWS/Zoomtext/Fusion use a voice assistant feature belowq are frequently asked questions/answers for this feature.
About voice assistant:
The voice assistant is a feature where you can use and control various screen reader/magnification features using natural speech. It listens to a user's spoken utterances, analyzes them for meaning, and then performs one or more supported actions in response to the utterance's intent.
How does one use the Voice Assistant?
One can either speak a wake word or activate it using a keystroke. The wake word is the default and most popular.
How does the wakeword mode work?
ZoomText and Fusion listens for "Zoomy" or "Hey Zoomy," while JAWS listens for "Sharky" or "Hey Sharky." When the wake word is uttered, the software considers the next five seconds of speech spoken as a request for action.
How does the keystroke mode work?
When the user presses the keystroke, ALT+CAPS LOCK+SPACEBAR, the fusion Suite product listens for the next five seconds of speech spoken as a request for action.
How is the speech recognition and utterance intent recognition done?
We use Microsoft Cognitive Services – an internet connected cloud service which performs speech and intent recognition. (azure.microsoft.com/en-us/services/cognitive-services)
Does it mean that everything I speak is processed by Microsoft Cognitive services in the wake word mode?
No. Wake word recognition happens locally, and no data is sent anywhere until the wake word is uttered. After the wake word is uttered, five seconds work of speech input is sent to the cloud for processing.
Does it mean one needs the internet for the Voice assistant to work?
Yes.
What are the privacy standards of Microsoft Cognitive services?
Microsoft Cognitive services offers strong privacy transparency policies. (azure.microsoft.com/en-us/support/legal/cognitive-services-compliance-and-privacy)
Does Freedom Scientific or Microsoft Cognitive services record the voice of the user?
No. The voice data is automatically deleted after processing.
Does Freedom Scientific or Microsoft Cognitive services record the IP address from where the user is issuing voice commands?
No – neither we nor Microsoft Cognitive services record the IP address of any user or associate any user specific data with a voice command.
Does Freedom Scientific know which user asked for what command?
No. Freedom Scientific does not associate any user specific data with a voice command.
What does Freedom Scientific record and maintain?
Freedom Scientific records the list of utterances users have requested and the actions the voice assistant took in response. Freedom Scientific uses it to improve the voice assistant.
Are calls to Microsoft cognitive services encrypted?
Yes, we use the HTTPS protocol to communicate with Microsoft cognitive services at well-known URLs.