How To Setup Voice Controls on Console

Show Transcript

cross, triangle. Here at SpecialEffect we are always looking at new ways for people to play games if using a standard controller is difficult. In this video we are going to show you how you can set up voice controls on consoles to emulate button presses using a free piece of software called GAVPI and a Titan Two Adapter. We are using a PlayStation 4 for this video, but this setup will also work for Nintendo Switch and Xbox One. The equipment that you will need to set this up include: A Windows PC, a PS4 console and controller, a Titan Two, and a headset with a microphone, the headphones that we are using are called Turtle Beach P11. You will also need three micro USB cables, one of which is included with the Titan Two. First we will have a look at getting the hardware set up, and then we will have a look at the software. Before we start, remember to make sure your console is configured to use USB Communication for controllers, to ensure that it works with the Titan Two. Plug the Titan Two’s micro USB cable into the output slot on the Titan itself, and then plug the other end of this cable into the controller port on your PS4 console. Now connect your PC to the Titan Two via the Prog slot on the back of the Titan using your second micro USB cable. Now connect your PS4 controller to Input A on the front of the Titan Two with your last micro USB cable. Even if you aren’t going to be using the controller itself you do need to do this as the PS4 needs an official PS4 controller plugged into the Titan to be able to verify. Now plug your headset into the PC. Your hardware setup will look something like this. Now we will have a look at the software. The First thing you need to do is set up your mic for speech recognition. Now let’s have a look at GAVPI software, the link to the website is in the description of this video. First you need to make a new profile. Now add a phrase by right clicking under Triggers. We would recommend saying the name of a button to activate that button, for example saying “cross” to press Cross. However you can use any word that you can easily and reliably say. Now we are going to create an Action Sequence. Give the sequence a name such as “Press Cross”. Now add a new action to the sequence. Click the From Press button, and now select which keyboard key you want the sequence to activate. In this case we will use X. This action is for KeyDown.
We now need to time how long the button is going to be pressed down for. So change the action type to Timing and add a timing action of 100 milliseconds. We now need a KeyUp to release the button. So change the action type back to KeyPress, add a new action, and this time set the Press Type to KeyUp. Now you could add a comment to help you remember which keyboard key you will be pressing. Now we need to link the sequence to the phrase trigger. Right click the Action Sequence and select Add to Trigger. Let’s try this one more time. This time we will set up the word “triangle” and the keyboard press T to activate the Triangle button on the PS4 controller. Now we will save the profile as “PS4Controller”. And now you can close the profile page. Click the Listen button to set GAVPI to listen for the commands we just made. If you get this error message, just go to the Settings and press Save. Let’s have a look at using the cross command out of game. So when I say the word, cross, the software displays that it has picked up the word and presses the X key, and likewise when I say, triangle, T is pressed. Now we need to have a look at the Titan Two software which is called GtunerIV. First you need to download Gtuner, the link to the software is available in the description for this video. Now open the software, you need to make a New Input Translator. You need to name the file, we are calling ours “PS4Controller”. Go to Meta Information and also name this “PS4 Controller”. Now go to keyboard mapping, create new key. You now need to map whichever keys you used for GAVPI, for example we used X for Cross and T for Triangle. To find out which button is the Cross key on a PS4 controller, click Help, and then click GPC Input Reference. Or you can do this by pressing F1. This brings up the button list for the controller. Look down the PS4 list and find the button you want to map. For us we are using Cross button, which is BUTTON_16. So now we close the list and go back to the second drop down menu, and select BUTTON_16. Now we are going to do the same for Triangle. Now click Save, you also need to copy the profile onto the Titan Two. Click the Install to memory slot icon and select Memory Slot 1. Now load the profile by right clicking the profile and selecting Load Memory Slot, or by clicking the number to the left of the profile name. Now open GAVPI and set it to Listen. Now go back to Gtuner, click Tools, and Select KMG capture. Press Enter In Capture Mode so that Gtuner and the Titan will convert keyboard keys into button presses according to the profile we created. Now we can have a look at the commands working in-game Here we are having a look at Overwatch. So when I say, cross, the character jumps. When I say, triangle, the character uses their Ultimate ability. When you have stopped playing you need to do the following: To exit Capture Mode, press CTRL and ESC keys, on GAVPI now select stop listening. Select “Modify” to add more commands to your profile. For some commands you will need to hold a button down, such as using a command for walking forwards. We will use the trigger name and phrase “forward”, and the keyboard key W. When making the sequence we will have a key down but not a key up. To make the sequence stop, you will instead need a stop command. The stop command will release the walk forward key. Remember to link the Action Sequences to the corresponding phrases. Save your profile after making any changes. We are going to use the same profile in Gtuner that we used for button presses. Create a new key map. Select W in keyboard mapping. For the controller input, it will be the vertical axis on the left stick, which is “STICK_2_Y”. Then click inverted to make sure it emulates pushing the stick forward. Now save the profile and install it onto memory slot one on the Titan Two. Remember to reload the profile after making any changes. Now as before set GAVPI to listen, and put Gtuner into Capture Mode. Now let’s have a look at walk forward and stop in-game. When I say, forward, the character walks, when I say stop, the character stops walking. A walk forwards command can work well, but in many games you will need access to one joystick to control the camera. Thank you for watching this video. If you would like to discuss voice controls or any of the other work that we do then please do get in touch. cross, stop, triangle, forward.

In this video we have a look setting up voice controls to play games on PS4. This setup will also work for Nintendo Switch and Xbox One.

We’ll create our own profile for a piece of voice control software called GAVPI using a Windows 10 Laptop. We’ll also be using a Titan Two adapter to connect the Laptop to the PS4, and creating a script for the Titan that converts voice commands into inputs on a PS4 controller. We’ll then take a brief look at using the setup to perform some of the actions in Overwatch.

For a look at a ready made script that aims to provide access to the full controller, please see this post which will also show you how to incorporate it into your own setup.

Any questions, get in touch via the Contact Us page.