Sooner or later you will start accepting calls on your mobile phone with just a smile, cough or wink. Thanks to scientists who have developed an earplug that can easily detect facial gestures to control smartphones. The modern smartphones are always controlled by just touching the screen. However, there are some situations in which this type of innovation cannot be implemented. Scientists at the Fraunhofer Institute for Computer Graphics Research IGD in Rostock in Germany have developed the Smart Earpiece called EarFieldSensing (EarFS), that recognises facial gestures via a special ear plug.
The researchers of this new innovation evaluated various technologies with which the movements of a person's head and face can be interpreted. In this process, great importance was placed on practical use in everyday life. For instance, systems that read gestures using sensors directly on one's face are very accurate and able to recognise a large number of gestures. However, the disadvantage is that they are so conspicuous and unpleasant to wear, though, that they are not suitable for daily use in public.
Instead, systems are needed which are as inconspicuous as possible. The new EarFS ear plug measures the muscular currents and distortions of the ear canal which occur during facial movements. The sensor detects even the smallest movements in the face through the way the shape of the ear canal changes and measures muscle currents that arise during the movement of the face or head. “The challenge was that these currents and movements are sometimes very small and need to be intensified,” said Denys Matthies, a scientist at the Fraunhofer IGD.
“In addition, the sensors cannot be interfered with by other movements of the body, such as vibrations during walking or external interferences, Matthies said. “To solve this problem, an additional reference electrode was applied to the earlobe which records the signals coming from outside,” he said. The signals detected inside the ear are matched with the signals coming from the outside? the remaining useful signal enables clear facial gesture identification, even if the person wearing the EarFS is in motion.
EarFS not only allows micro-interactions with a smartphone, such as accepting and rejecting phone calls or operating the music player. The evaluation of facial movements also allows conclusions about weariness, exertion and other emotional states of the user. As a result, smartphones could warn drivers when signs of weariness and fatigue are registered or could switch automatically to mute when drivers are concentrating attentively. The use of the technology is also imaginable in the medical field.
For example, it could help people with locked-in syndrome to communicate more easily by allowing them to operate computers with facial movements which is a very good advantage.
 |
| image by researchers: Denys Matthies |
The researchers of this new innovation evaluated various technologies with which the movements of a person's head and face can be interpreted. In this process, great importance was placed on practical use in everyday life. For instance, systems that read gestures using sensors directly on one's face are very accurate and able to recognise a large number of gestures. However, the disadvantage is that they are so conspicuous and unpleasant to wear, though, that they are not suitable for daily use in public.
Read this: WhatsApp adds "Night Mode" Feature to Enhance Selfie Taking Under Low Light
Instead, systems are needed which are as inconspicuous as possible. The new EarFS ear plug measures the muscular currents and distortions of the ear canal which occur during facial movements. The sensor detects even the smallest movements in the face through the way the shape of the ear canal changes and measures muscle currents that arise during the movement of the face or head. “The challenge was that these currents and movements are sometimes very small and need to be intensified,” said Denys Matthies, a scientist at the Fraunhofer IGD.
“In addition, the sensors cannot be interfered with by other movements of the body, such as vibrations during walking or external interferences, Matthies said. “To solve this problem, an additional reference electrode was applied to the earlobe which records the signals coming from outside,” he said. The signals detected inside the ear are matched with the signals coming from the outside? the remaining useful signal enables clear facial gesture identification, even if the person wearing the EarFS is in motion.
Recommended: How to Block Pop up Ads on Android Phone
EarFS not only allows micro-interactions with a smartphone, such as accepting and rejecting phone calls or operating the music player. The evaluation of facial movements also allows conclusions about weariness, exertion and other emotional states of the user. As a result, smartphones could warn drivers when signs of weariness and fatigue are registered or could switch automatically to mute when drivers are concentrating attentively. The use of the technology is also imaginable in the medical field.
For example, it could help people with locked-in syndrome to communicate more easily by allowing them to operate computers with facial movements which is a very good advantage.
