Assistive Technology in Gaming

Introduction

Assistive Technology devices and equipment increase the ability of an individual living with disabilities to perform the tasks they want. Over 80% of people will use assistive technology at some point in their life and cost is often cited as the main barrier to not receiving the devices they need; gaming is no exception to this. There are many assistive technology options in gaming that will be discussed in this resource. Modifying a gamer’s current controller or providing alternative access to the game through adaptive switch access, voice, or changing the settings can allow many more people to join the gaming community. The following topics are covered in this resource:

1. Open Source Technology in Gaming
2. Switch and Joystick Access in Gaming
3. Accessible Controller Modifications
4. Accessible Software Options

This page is a part of a series on adaptive gaming. Please visit the other resources in the series if you are looking to learn more:

1. Introduction to Adaptive Gaming 
2. Assistive Technology in Gaming (you are here)
3. Accessibility in Video Games and Gaming Goals
4. Adaptive Gaming Demos and Recommendations

Open Source Technology in Gaming

Makers Making Change specializes in open-source assistive technology. This means that all of the devices are licensed under an open-source license which allows anyone to access the original design files to customize or create themselves. This results in low-cost devices as the user only has to reimburse the volunteer maker for the material cost. At MMC, we host a library of open source assistive technology where devices can be requested by users or volunteer makers can access the files and documentation necessary to build the device for the requester.

[1] – See Attribution

Video games can be made more accessible in many ways, such as introducing switch access, controller modifications, software modifications, and using built-in accessibility settings if the system or game provides them. This resource will detail these options through a gaming lens.

Helpful AT Resources

The two resources below are great options if you are looking for more information regarding assistive technology.

Intro to assistive tech – https://www.ocali.org/up_doc/AT_Resource_Guide_1.pdf

What is AT? From ATIA – https://www.atia.org/home/at-resources/what-is-at/

Types of Gaming AT

This section will detail specific types of access for video games, but it is important to remember that there are many ways to make video games more accessible and that these methods can “stack.”. For example, someone who is unable to play games with a standard controller may use one or more options for access to control the game. An example of this is, using switch access to give inputs to the game but also using software modifications to make the game more visually accessible.

[1] – See Attribution

Switch and Joystick Access

Adaptive switches are used to create access for users living with mobility differences. Instead of controlling the device with the standard setup that may not be accessible, switches and joysticks can be added. This covers a wide range of use cases such as access to devices such as toys, environmental control units, computers/tablets, and communication devices. Although, many of these devices do not have the correct ports (3.5 mm cable jacks) to allow for switch access. So devices like switch interfaces or devices specific for gaming like the Xbox Adaptive Controller can be used.

Adaptive Switches and Joysticks

Adaptive switch access can be the solution to be able to create an effective gaming setup for someone that is not able to use a standard controller or keyboard and mouse. Instead of using those traditional inputs, switches that are mounted near the user can instead be used to control the video game. Think of the switches replacing the buttons and triggers of a controller or the keys on a keyboard (seen in the image below). Switches are either wireless or use a 3.5 mm cable to connect to a host device. But many host devices like tablets, phones, computers, or gaming consoles do not have the 3.5 mm jacks to directly connect adaptive switches. Therefore, for gaming, switch access must be done through either a switch interface or an Xbox Adaptive Controller. Adapted switches also come in many different shapes, sizes, and activation forces. MMC has created a switch selection guide as a separate resource to help guide a user in choosing a switch that is right for them.

[1] – See Attribution

[1] – See Attribution

There is a secondary type of joysticks that can be mouth operated. These joysticks use sip and puff technology, and the user controls the joystick with one’s mouth to move and interact with the game. Makers Making Change has an open source low-cost option for this called the LipSync Gaming. There are market solutions as well, such as the Quadstick.

[1] – See Attribution

Switch Interfaces

Think of a switch interface as an adapter, allowing the user to connect the switches to a computer, tablet, or smartphone using USB or Bluetooth. A switch interface provides a way to connect the adaptive switch to the computing device and allows for multiple switches to be used at once. MMC has created a Switch Interface Selection Guide to assist in users selecting a switch interface that works best for them. Switch interfaces on the MMC library currently do not allow for direct connection to consoles. Therefore, they can only be used for mobile and PC gaming. This allows the interface to communicate to the computer that the switches are acting as a gamepad. Switch interfaces also can include many other features such as button mapping (described below) and advanced techniques like creating macros. Macros are like shortcuts that can eliminate the need for multiple switches.

[1] – See Attribution

Xbox Adaptive Controller

The Xbox Adaptive Controller (XAC) is a controller that was developed by Microsoft to allow for alternative access in gaming. Think of this device as an on-the-market version of a switch interface that is specifically for gaming.

[1] – See Attribution

PC/Xbox One and newer consoles also feature an application called Xbox Accessories that allows for button mapping and co-pilot mode. Co-pilot mode is exclusive to Xbox and PC, but button mapping may be a feature of some switch interfaces.

Co-pilot mode

Xbox’s Co-pilot mode allows two controllers to control the same game. This is accessed through the Xbox Accessories application. This is a great tool for two gamers that want to play together and may not be able to use control options given to them in a game. This can also be a powerful tool to add more options for input to an individual’s setup to include switch access alongside standard controller access.

[1] – See Attribution

A video showing the possibilities of the co-pilot mode and how to set it up on PC and console are shown below:

Co-pilot mode video: https://www.youtube.com/watch?v=ol6VbnnTGRQ

Set up Copilot Mode with Xbox One and Windows 10: https://gameaccess.info/how-to-set-up-copilot-on-xbox-one-windows-10/

Button Mapping

The technique called “button mapping” allows for the user to choose which inputs (switches, joysticks, etc.) relate to an action in the video game. This also works on standard controllers to choose which buttons on the controller relate to the actions in the game. This can be very useful in customizing a gaming setup to be more effective for the gamer. Button mapping can be available on the switch interfaces themselves, in-game, or on PC launching platforms like Steam.

XAC or Switch Interface

Button Mapping is available on the XAC through the Xbox Accessories application and available on most switch interfaces. Most recently developed games also feature in-game button mapping options. This is an important concept to understand when discussing switch access for video games as it allows the customization of the gamer’s switch setup.

Here is a resource for how to go through the process of button mapping on the XAC: https://gameaccess.info/how-to-create-a-profile-for-the-xbox-adaptive-controller/

In-Game

As mentioned before, button mapping is sometimes an in-game option for games with accessibility options. To check this, go to the settings in the game and try to find either a “controls” section or an “accessibility section.”. You are looking for an option that will allow you to change the input relating to a certain movement. For example, in Brawlhalla this setting is found under the “controls” option in the settings.

Steam

Steam, a platform to purchase and launch games on PC and Mac, also has its own unique set of button mapping. Steam is a powerful tool when playing games on a PC while using an XAC for switch access. Some games that an individual may want to play on the computer will not be available on Steam. For example, Rocket League and magic the gathering are bought on the Epic Games store and browser, respectively. But once the game is installed on the system. Using the “add non Steam game” feature built within Steam, these games can be launched through Steam. What this allows is to connect the XAC to steam and be able to remap the controls to suit the game.

Steam should be the primary launcher of any game that is being used with the XAC. Using Steams “big screen mode” and with a controller connected, the user can independently access, remap, and launch games using the XAC. Although this tutorial is for how to connect an Xbox One controller to steam using the “big screen mode,” the process is the same for the XAC.

Controller Modifications

Controller adaptations or modifications can be a great inexpensive option to allow for alternative access to a standard controller.  Controller modifications can be broken down into DIY controller modifications and ones that are on the market solutions.

[1], [2] – See Attribution

DIY Controller Mods

DIY open-source controller modifications can be found in many online libraries online. Of course, on the Makers Making Change library under gaming we continue to add controller modifications. Another great resource is The Controller Project, where controller modifications are hosted. Controller modifications can be done by adding physical components such as 3D printed components to a standard controller to make pressing the buttons, triggers, and joysticks easier. Controller modifications also can allow for easier mounting for individuals that are unable to hold a standard controller but can access all the buttons.

DIY controller modifications that are featured on MMC and The Controller Project can sometimes run into the case where the modification is for a controller that is different from the system the user wants to play on. For example, if the modification that works for the user was created for a PlayStation controller, but the user wants to play on an Xbox, an adapter can be used to make this happen. Common adapters are the These adapters have different compatibilities but can make the connection between controllers easily. It is also important to note that the Bluetooth Xbox and PlayStation controllers can be connected to Windows PC’s for controller-compatible PC games.

Market Controller Mods

There are a few companies creating accessible controllers by modifying them for switch access, alternative joystick access, and changing the layouts. This can mean adding additional switches built into the device or adding ports for switch access to the controller. These options can be explored as possible components of an accessible gaming setup. Links to some commercial controller modifications can be found in the “Market AT Solutions for Gaming” section below.

Software

[1], [3] – See Attribution

• Brightness
• Contrast
• Color Blind Mode
• Subtitles
• Difficulty options
• Button Remapping
• Narration and Descriptive Audio
• “Slow Motion” or Reduced Reaction Time
• Aim Assist (automatically aims the weapon at the target)
• Reduced Screen Effects (i.e. motion blur, depth of field, screen shake, etc.)
• Heads Up Display (gives direction or waypoint to the gamer)
• Simplified Controls (reducing the number of inputs to play)
• Setting Controller Vibration
• Customizing Audio Levels

In-Game software changes can make a game playable for many. The two main options where software is used frequently in gaming are for people living with visual differences and voice control in gaming.

Visual Differences

People who are blind or low vision often use software to make video games more accessible. This often results in magnifying the screen or using screen readers to play video games. AbleGamers has a fantastic resource on gaming with visual differences. They note that frequently, side scroller fighting games are a good first choice for gaming if this is an individual’s accessibility needs. This is due to each character in the game having unique sounds for each input in the game.

Can I Play That? has compiled a list of games for blind and visually impaired players that may be a good option for some: https://caniplaythat.com/2021/10/21/5-games-for-blind-and-visually-impaired-players/

Voice Control

Adding voice control in gaming can eliminate the number of physical inputs a gamer needs or be the sole input for the game. This is often done with additional software that has been added to the system. Voice control is mainly used on PC gaming using free or paid-for software but can also be used on consoles with the addition of an adapter. SpecialEffect’s has a full video series and guides on how to use the free voice control software GavPI and the paid software VoiceAttack. They have also made a tutorial on how to use the Titan 2 adapter with voice control software for console gaming.

There is also a market device called the Enabled Play Controller that allows for multiple inputs such as voice control, facial expressions, head positioning, hand gestures, tilt controls, and shake detection. This is a fantastic option for some gamers that want to use voice control as the lag when using voice is significantly limited.

Market AT Solutions for Gaming

The following tables give links to where commercial options for adaptive gaming can be found. In this section, switches, joysticks, controllers, keypads, adapters and mounting will be discussed.

Switches

We have also created separate resources to help users select adaptive switches and switch interfaces.

Joysticks

We have also created a separate analog joystick selection guide to help users select the joysticks for them.

Accessible Gaming Controllers

Keypads

Adapters

Adapters can be used to connect different controllers, mouses, keyboards, and other accessories to a given gaming console. These adapters may be beneficial to someone who may want to game using a keyboard, mouse or a different controller than the commercial one for the particular console they are using. The compatibility of these adapters is very important to consider. Please visit the manufacturers website to see if an adapter will work in your use case.

Mounting

Mounting can be used in order to position devices in any place the user wants. The mounting is most commonly used for assistive switches but could also be used for other devices. The following is a list of different mounting systems commercially available.

Attribution

[1] – These graphics were created using the help of icons from Canva

[2] – Image of Evil Controller from: https://www.evilcontrollers.com/store/accessible-controllers

[3] – Image of The Last of Us 2 with high contrast mode from: https://www.theverge.com/21274923/the-last-of-us-part-2-accessibility-features-naughty-dog-interview-ps4