A team of researchers from the National University of Singapore’s CUTE (Connective Ubiquitous Technology for Embodiments) Center announced that they have developed a novel multisensory mixed reality game that gives players a unique sense of realism.
Called “The Lost Foxfire,” the 10-minute game engages a player’s senses of vision, audition (sense of hearing), olfaction (sense of smell), somatosensation (sense of touch) and thermoception (ability to sense intensity of heat). Besides relying on their vision and hearing, game players will also need to take cues from their senses of smell and touch to successfully complete the game.
Most conventional VR games use headsets and haptic bodysuits to mimic and amplify sensory feedback, for instance, to deliver the sensation of a cool breeze to match the visual scene of the moment. In contrast, this game brings VR multisensory bodysuits to a new level where real-time, life-like sensory feedback is used by players to make decisions that will directly impact the outcome of the gameplay.
The Gameplay
In “The Lost Foxfire,” players take on the role of a caretaker who is left in charge of looking after an old Japanese temple for one night. However, a Foxfire spirit bride who is on her way to her wedding got lost in the temple. She wanders about the temple grounds and has the tendency to set fire to everything she touches. Players will need to save the temple from burning down by putting out the fires that the distressed Foxfire spirit has started, and catching the original spirit from its numerous decoys to stop it from starting more fires.
Haptic Hardware
The system includes a VR headset that is paired with a configurable multisensory suit that delivers thermal, wind and olfactory stimuli to the players in order to assist them in finding and, subsequently, stopping the Foxfire spirit from burning down the temple.
The adjustable suit is equipped with five heat modules that enable players to sense heat on the front, back and the sides of their necks, as well as on their faces. The thermal stimuli can be calibrated and customized to an individual’s tolerance of warmth. As players spray the original Foxfire spirit with a fire extinguisher, they will catch a whiff of the scent of apples, a favorite fruit of foxes. As players get close to the real Foxfire, they can feel the heat it emits.
“The set up for ‘The Lost Foxfire’ game system is entirely portable so it can be put up in any room. The additional sensory cues in the form of heat and smell create a more immersive gameplay environment for the players, something rarely seen in current games,” said Associate Professor Yen Ching-Chiuan, co-director of the Keio-NUS CUTE Center who supervises on the project.
The team comprising hardware and product engineers, artists, technology researchers and designers took nine months to develop the experimental game – from its conception, coding and building of special hardware, to graphic designing and animating. A patent has been filed for the technology behind the configurable multisensory suit.
'The Lost Foxfire' debuted at the Tokyo Game Show 2019 in September 2019 as one of the 86 projects that were chosen from 320 independent projects around the world for the Sense of Wonder Night showcase.
Potential Applications
Although the game was developed as an experimental game, its immersive simulation and experiential technology can be potentially extended to other applications. Besides paving the way for more immersive gaming experience to come, it could, for instance, be used to simulate unique scenarios for training purposes or to demonstrate fire safety so that users can safely experience a first-hand feel of the full scenario without the danger.
