In Virtual Reality, where you truly “inhabit” the space, speech can feel like a more natural interface than other methods. Providing speech controls allows developers to create more immersive experiences. The HTC Vive is the 3rd most popular head-mounted VR devices (not including Google Cardboard) and an ideal candidate for Speech interaction, selling roughly 400 thousand units in 2016.
When the reader has completed this Code Pattern, they will understand how to:
On your local machine:
git clone https://github.com/IBM/vr-speech-sandbox-vive.git cd vr-speech-sandbox-vive
In IBM Cloud:
Choose JSON file, go to your cloned repo dir, and
Openthe workspace.json file in
To find the
WORKSPACE_ID for Watson Assistant:
IBM Speech Sandbox Vive.
View API Details.
Workspace IDGUID. Save it configuration later.
Note: This has been compiled and tested using Unity 2018.2.14f1 and Watson Unity SDK from the Unity asset Store as of July 24, 2018 and tested with the
developbranch of the github unity-sdk as of
commit d1ce5607ebb77 Nov 1 2018.
Note: If you are in any IBM Cloud region other than US-South you must use Unity 2018.2 or higher. This is because Unity 2018.2 or higher is needed for TLS 1.2, which is the only TLS version available in all regions other than US-South.
git clone https://github.com/watson-developer-cloud/unity-sdk.git
Make sure you are on the develop branch.
Navigate to where you cloned this repository and open the
Creation Sandbox directory.
If prompted to upgrade the project to a newer Unity version, do so.
Follow these instructions to add the Watson Unity SDK downloaded in step 1 to the project.
Follow these instructions to create your Speech To Text and Watson Assistant services and find their credentials (using IBM Cloud
You can find your workspace ID by selecting the expansion menu on your assistant workspace and selecting
In the Unity Hierarchy view, click on
MainMenu and then the
In the Inspector you will see Variables for
Speech To Text and
Watson Assistant and either
CF Authentication for the Cloud Foundry username and password, or the
IAM Authentication if you have the IAM apikey. Since you only have only one version of these credentials, fill out only one of the two for each service.
Fill out the
Speech To Text Service Url, the
Assistant Service Url, the
Assistant Workspace Id, and the
Assistant Version Date. There are tool tips which will show help and any defaults.
MainMenuand double click to load the scene.
This code pattern is licensed under the Apache Software License, Version 2. Separate third party code objects invoked within this code pattern are licensed by their respective providers pursuant to their own separate licenses. Contributions are subject to the Developer Certificate of Origin, Version 1.1 (DCO) and the Apache Software License, Version 2.