Virtual reality (VR) is not only about immersing ourselves in digital worlds, but also about exploring new ways of interacting with them. One of the most intriguing and novel methods of VR input is tongue-tracking, which allows users to control VR applications with their tongues. Tongue-tracking in VR has arrived, and it could revolutionize the VR industry and beyond.
Tongue-tracking is a technology that uses sensors or cameras to track the position and movement of the user’s tongue. The tongue is then mapped to a virtual representation, such as a cursor, a menu, or an avatar. The user can then use their tongue to perform various actions in VR, such as selecting, clicking, dragging, or manipulating objects.
Tongue-tracking can be implemented in different ways, depending on the type of VR headset and the level of accuracy required. Some examples of tongue-tracking devices are:
- Tongue Drive System (TDS): A wireless device that attaches to the user’s tongue piercing and detects the tongue’s magnetic field. The device communicates with a smartphone or a computer via Bluetooth and translates the tongue’s movements into commands. TDS was originally developed for people with disabilities, but it can also be used for VR applications.
- Tongue Mouse: A device that consists of a mouthpiece with a camera and a light source. The camera captures the tongue’s movements and sends them to a computer, where they are processed and converted into commands. Tongue Mouse can be used for VR applications that require high precision, such as drawing or painting.
- Tongue Interface Device (TiD): A device that uses a flexible printed circuit board with electrodes to measure the tongue’s electrical activity. The device is placed inside the user’s mouth and connects to a VR headset via a cable. TiD can be used for VR applications that require simple and intuitive interactions, such as navigation or selection.
Why use tongue-tracking in VR?
Tongue-tracking in VR has several advantages over other forms of VR input, such as hand controllers, gestures, or eye-tracking. Some of the benefits of tongue-tracking are:
- Natural and intuitive: The tongue is one of the most agile and versatile organs in the human body, capable of performing complex and precise movements. Using the tongue to interact with VR is natural and intuitive, as we already use it for various purposes, such as speaking, eating, or kissing.
- Hands-free and eyes-free: Tongue-tracking does not require the use of hands or eyes, which are often occupied or obstructed in VR. This frees up the user’s hands and eyes for other tasks, such as holding objects, manipulating tools, or looking around. Tongue-tracking also reduces the cognitive load and fatigue associated with using hand controllers or eye-tracking.
- Hygienic and comfortable: Tongue-tracking does not involve touching or wearing external devices, which can be unhygienic, uncomfortable, or inconvenient. Tongue-tracking devices are either attached to the user’s tongue piercing or placed inside the user’s mouth, which are both clean and comfortable locations. Tongue-tracking also avoids the issues of occlusion, calibration, or interference that may affect other VR input methods.
What are the applications of tongue-tracking in VR?
Tongue-tracking in VR has a wide range of applications, spanning from entertainment to education, from health care to social interaction. Some of the possible uses of tongue-tracking in VR are:
- Gaming: Tongue-tracking can enhance the gaming experience in VR by adding a new dimension of interaction and immersion. For example, tongue-tracking can be used to control the direction and speed of a car, to shoot or reload a weapon, or to cast spells or use abilities. Tongue-tracking can also create more realistic and expressive avatars, such as making them stick out their tongues, lick their lips, or smile.
- Art and creativity: Tongue-tracking can enable new forms of art and creativity in VR by allowing users to draw, paint, or sculpt with their tongues. For example, tongue-tracking can be used to create 3D models, to apply textures or colors, or to modify shapes or sizes. Tongue-tracking can also inspire new artistic expressions, such as tongue graffiti, tongue poetry, or tongue music.
- Education and training: Tongue-tracking can facilitate education and training in VR by providing a more engaging and effective way of learning. For example, tongue-tracking can be used to teach languages, to practice pronunciation, or to learn vocabulary. Tongue-tracking can also be used to train skills, such as driving, flying, or surgery, by simulating realistic scenarios and feedback.
- Health and wellness: Tongue-tracking can improve health and wellness in VR by offering a more accessible and enjoyable way of exercising. For example, tongue-tracking can be used to motivate users to move their tongues, to burn calories, or to strengthen their muscles. Tongue-tracking can also be used to treat conditions, such as dysphagia, aphasia, or stroke, by stimulating the tongue’s nerves and muscles.
- Social and communication: Tongue-tracking can enhance social and communication in VR by creating a more intimate and expressive way of interacting. For example, tongue-tracking can be used to send messages, to make gestures, or to share emotions. Tongue-tracking can also be used to experience new sensations, such as kissing, licking, or biting.
What are the challenges and limitations of tongue-tracking in VR?
Tongue-tracking in VR is not without challenges and limitations, which need to be addressed and overcome before it can become mainstream. Some of the main challenges and limitations are:
- Technical: Tongue-tracking devices need to be accurate, reliable, and robust, as well as compatible with different VR headsets and platforms. Tongue-tracking devices also need to be wireless, battery-powered, and low-cost, as well as easy to use, maintain, and clean. Tongue-tracking devices also need to ensure the user’s privacy and security, as well as comply with ethical and legal standards.
- User: Tongue-tracking users need to be comfortable, confident, and motivated to use their tongues in VR, as well as aware of the benefits and risks. Tongue-tracking users also need to be trained, guided, and supported to use their tongues effectively and efficiently, as well as to avoid fatigue, injury, or discomfort. Tongue-tracking users also need to be respectful, responsible, and considerate of other users and the environment, as well as to follow social and cultural norms.
Tongue-tracking in VR is a novel and innovative technology that has the potential to transform the VR industry and beyond. Tongue-tracking in VR offers a natural, intuitive, hands-free, eyes-free, hygienic, and comfortable way of interacting with VR applications, as well as a wide range of applications, from gaming to health, from art to social. Tongue-tracking in VR also faces several challenges and limitations, such as technical, user, and ethical issues, which need to be solved and improved. Tongue-tracking in VR has arrived, and it is here to stay.
