LipSync

The LipSync is a mouth-operated sip-and-puff joystick that can emulate a mouse, a wireless Bluetooth mouse, or a gamepad. It enables people with disabilities that have limited upper body mobility to control a computer, gaming console, smart phone, or tablet. 

The most recent version, the LipSync 4.0, is made up of the LipSync Joystick and LipSync Hub. The Joystick is the primary user interface, and contains a low-force joystick and sip and puff sensors. The Hub has a display that provides a graphical interface for independently adjusting settings, as well as it provides the connection to the host device and up to three external assistive switches with 3.5 mm jacks.

The device is comprised of off-the-shelf electronics and hardware, a custom PCB and 3D printed parts. The overall cost of materials (including materials required in bulk) for a single build is about $325 (plus shipping). In larger quantities, the cost of materials is closer to $175.

The LipSync is compatible with a range of host devices that are able to support a USB Mouse, a USB Gamepad and/or a Bluetooth Mouse. Compatible devices include PC and Mac computers and laptops, Android, iOS, and Windows smartphone and tablets, and the Xbox Adaptive Controller.

The LipSync is Open Assistive Technology (OpenAT) and is certified as Open Source Hardware by the Open Source Hardware Association under the OSHWA UID CA000046. Under the terms of the open source hardware licenses, the LipSync may be built, used, and improved by anyone.

Older versions of the LipSync are no longer able to be requested, but the information is still available on GitHub:

• LipSync Classic (USB Mouse)
• LipSync Wireless (Wireless Bluetooth® Mouse.) This version is no longer able to be built due to discontinued components.
• LipSync Gaming (USB joystick / USB gamepad)
• LipSync Macro (USB Keyboard) 
• LipSync Switch Input Module. Used to modify one of the above versions so that a user can use switches instead of sip and puff. This can be a useful option for those unable to form their lips around mouthpiece or apply the positive / negative pressure to generate sips and puffs.

A brief Quickstart Guide, and detailed User Guide are available on GitHub.

Compatibility

The LipSync can emulate a USB Mouse, USB Gamepad, or Wireless Bluetooth Mouse. It is compatible with a variety of host devices:

• Phone: Android 4.0+, iOS 13+*, Windows
• Tablet: Android 4.0+, iOS 13+*, Windows
• Computer & Laptop: Windows, MacOS

*iPhones and iPads running on iOS 13+ require a USB hub for the iOS device to recognize the LipSync.

Setup

The LipSync Joystick should be mounted in a stable position near the user’s face, close enough to their mouth so they can move the mouthpiece. The LipSync Hub should be mounted so that the display is visible and ideally close to the host device. The LipSync Joystick is connected to the LipSync Hub using the LipSync Interface Cable.

The LipSync Hub needs to be powered through the USB cable by a USB port on the host device, or a USB power pack.

Connection to Host Device

The LipSync requires both a data connection and a power connection. The setup will differ depending on whether it is a wired host device for USB Mouse Mode or USB Gamepad Mode or a wireless host device for Bluetooth Mouse Mode.

Connection to Wired Host Device

For a wired connection, a USB cable must be connected from the USB-C port on the LipSync Hub to the host device. By default, the LipSync is supplied with a USB-C to USB-A cable. Depending on the host device, a different cable, adaptor, or powered USB Hub may be required. Refer to the User Guide.

Connection to Wireless Host Device

For wireless connections, the LipSync Hub only needs to be connected to a power source. Connect the USB cable to a suitable USB port

Usage

The LipSync will produce different outputs depending on whether the operating mode is USB Mouse, USB Gamepad, or Wireless Bluetooth Mouse. Moving the mouthpiece will move the cursor or joystick. Applying sips and puffs to the mouthpiece will generate mouse clicks, touchscreen gestures or gamepad button presses. The buttons on the Hub or attached assistive switches can also be used to provide input to the LipSync.

Changing Settings

A visual menu on the Hub can be accessed using sip and puff, the Hub buttons, or assistive switches. This menu can be navigated using two inputs to change various settings, including changing the operating mode, activating calibration, adjusting cursor speed, and restarting the device.

This device may be beneficial for users with limited upper body dexterity or hand use, such as those with spinal cord injury, quadriplegia, multiple sclerosis (MS), or amyotrophic lateral sclerosis (ALS) .

This build involves an intermediate level of 3D printing, soldering and assembly.

The LipSync hardware consists of off-the-shelf electronics and hardware components, 3D printed components, and a single custom printed circuit board (PCB). It is divided into two main parts: the LipSync Joystick and the LipSync Hub. The LipSync Joystick contains the joystick and pressure sensing components in a 3D printed enclosure and utilizes plug and play STEMMA QT / Qwiic breakout boards to streamline the building process. The Hub is a PCB and plug and play display mounted in a 3D printed enclosure.

Refer to the Maker Guider and video build tutorial for detailed instructions.

CERN OHL-W_old