Journal Article10.1038/S41586-019-1687-0
Skin-integrated wireless haptic interfaces for virtual and augmented reality.
Xinge Yu,Zhaoqian Xie,Yang Yu,Yang Yu,Jungyup Lee,Abraham Vázquez-Guardado,Haiwen Luan,Jasper Ruban,Xin Ning,Aadeel Akhtar,Dengfeng Li,Bowen Ji,Bowen Ji,Yiming Liu,Rujie Sun,Jingyue Cao,Qingze Huo,Yishan Zhong,Chan Mi Lee,Seung Yeop Kim,Philipp Gutruf,Changxing Zhang,Yeguang Xue,Qinglei Guo,Aditya Chempakasseril,Peilin Tian,Wei Lu,Ji Yoon Jeong,Yong Joon Yu,Jesse Cornman,Chee Sim Tan,Bong Hoon Kim,Bong Hoon Kim,Kun Hyuk Lee,Xue Feng,Yonggang Huang,John A. Rogers,John A. Rogers +37 more
821
TL;DR: A wireless, battery-free platform of electronic systems and haptic interfaces capable of softly laminating onto the curved surfaces of the skin to communicate information via spatio-temporally programmable patterns of localized mechanical vibrations is presented.
read more
Abstract: Traditional technologies for virtual reality (VR) and augmented reality (AR) create human experiences through visual and auditory stimuli that replicate sensations associated with the physical world. The most widespread VR and AR systems use head-mounted displays, accelerometers and loudspeakers as the basis for three-dimensional, computer-generated environments that can exist in isolation or as overlays on actual scenery. In comparison to the eyes and the ears, the skin is a relatively underexplored sensory interface for VR and AR technology that could, nevertheless, greatly enhance experiences at a qualitative level, with direct relevance in areas such as communications, entertainment and medicine1,2. Here we present a wireless, battery-free platform of electronic systems and haptic (that is, touch-based) interfaces capable of softly laminating onto the curved surfaces of the skin to communicate information via spatio-temporally programmable patterns of localized mechanical vibrations. We describe the materials, device structures, power delivery strategies and communication schemes that serve as the foundations for such platforms. The resulting technology creates many opportunities for use where the skin provides an electronically programmable communication and sensory input channel to the body, as demonstrated through applications in social media and personal engagement, prosthetic control and feedback, and gaming and entertainment. Interfaces for epidermal virtual reality technology are demonstrated that can communicate by programmable patterns of localized mechanical vibrations.
read more
Chat with Paper
AI Agents for this Paper
Find similar papers on Google Scholar, PubMed and Arxiv
Write a critical review of this paper
Analyze citations of this paper to find unaddressed research gaps
Citations
A breathable, biodegradable, antibacterial, and self-powered electronic skin based on all-nanofiber triboelectric nanogenerators
Xiao Peng,Kai Dong,Cuiying Ye,Yang Jiang,Siyuan Zhai,Renwei Cheng,Di Liu,Xiaoping Gao,Jie Wang,Zhong Lin Wang,Zhong Lin Wang +10 more
TL;DR: A breathable, biodegradable, antibacterial, and self-powered e-skin based on all-nanofiber triboelectric nanogenerators, which is fabricated by sandwiching silver nanowire between polylactic-co-glycolic acid (PLGA) and polyvinyl alcohol (PVA).
740
Sign-to-speech translation using machine-learning-assisted stretchable sensor arrays
Zhihao Zhou,Zhihao Zhou,Kyle Chen,Xiaoshi Li,Songlin Zhang,Yufen Wu,Yihao Zhou,Keyu Meng,Chenchen Sun,Qiang He,Wenjing Fan,Endong Fan,Zhiwei Lin,Xulong Tan,Weili Deng,Jin Yang,Jun Chen +16 more
- 29 Jun 2020
TL;DR: It is shown that a wearable sign-to-speech translation system, assisted by machine learning, can accurately translate the hand gestures of American Sign Language into speech.
697
Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications
Minglu Zhu,Zhongda Sun,Zixuan Zhang,Qiongfeng Shi,Tianyiyi He,Huicong Liu,Tao Chen,Chengkuo Lee +7 more
TL;DR: Through the integrated demonstration of multidimensional manipulation, haptic feedback, and AI-based object recognition, the haptic-feedback glove reveals its potential as a promising solution for low-cost and advanced human-machine interaction, which can benefit diversified areas, including entertainment, home healthcare, sports training, and medical industry.
602
Wearable Sensors-Enabled Human–Machine Interaction Systems: From Design to Application
TL;DR: The construction of a wearable HMI system that utilizes sensors, communication modes, and actuators is reviewed, and the mechanisms and strategies for designing various flexible sensors based on different mechanisms are analyzed and discussed.
513
Progress in wearable electronics/photonics—Moving toward the era of artificial intelligence and internet of things
Qiongfeng Shi,Bowei Dong,Tianyiyi He,Zhongda Sun,Jianxiong Zhu,Zixuan Zhang,Chengkuo Lee +6 more
- 01 Nov 2020
TL;DR: According to the development in recent years, the next-generation wearable electronics and photonics are advancing rapidly toward the era of artificial intelligence (AI).
477
References
Materials and mechanics for stretchable electronics
TL;DR: Inorganic and organic electronic materials in microstructured and nanostructured forms, intimately integrated with elastomeric substrates, offer particularly attractive characteristics, with realistic pathways to sophisticated embodiments, and applications in systems ranging from electronic eyeball cameras to deformable light-emitting displays are described.
4.6K
Neural stimulation and recording electrodes.
TL;DR: Techniques for characterizing electrochemical properties relevant to stimulation and recording are described with examples of differences in the in vitro and in vivo response of electrodes.
2.1K
A bioinspired flexible organic artificial afferent nerve
Yeongin Kim,Alex Chortos,Wentao Xu,Wentao Xu,Yuxin Liu,Jin Young Oh,Jin Young Oh,Dong Hee Son,Jiheong Kang,Amir M. Foudeh,Chenxin Zhu,Yeongjun Lee,Simiao Niu,Jia Liu,Raphael Pfattner,Zhenan Bao,Tae-Woo Lee +16 more
TL;DR: Flexible organic electronics are used to mimic the functions of a biological afferent nerve and construct a hybrid bioelectronic reflex arc to actuate muscles that has potential applications in neurorobotics and neuroprosthetics.
1.1K
Digital cameras with designs inspired by the arthropod eye
Young Min Song,Y. Xie,Viktor Malyarchuk,Jianliang Xiao,Inhwa Jung,Ki Joong Choi,Zhuangjian Liu,Hyunsung Park,Chaofeng Lü,Chaofeng Lü,Rak-Hwan Kim,Rui Li,Rui Li,Kenneth B. Crozier,Yonggang Huang,John A. Rogers +15 more
TL;DR: The devices combine elastomeric compound optical elements with deformable arrays of thin silicon photodetectors into integrated sheets that can be elastically transformed from the planar geometries in which they are fabricated to hemispherical shapes for integration into apposition cameras.
1K
Learning the signatures of the human grasp using a scalable tactile glove.
Subramanian Sundaram,Petr Kellnhofer,Yunzhu Li,Jun-Yan Zhu,Antonio Torralba,Wojciech Matusik +5 more
TL;DR: Tactile patterns obtained from a scalable sensor-embedded glove and deep convolutional neural networks help to explain how the human hand can identify and grasp individual objects and estimate their weights.
971
Related Papers (5)
Sihong Wang,Jie Xu,Weichen Wang,Ging-Ji Nathan Wang,Reza Rastak,Francisco Molina-Lopez,Jong Won Chung,Jong Won Chung,Simiao Niu,Vivian R. Feig,Jeffery Lopez,Ting Lei,Soon-Ki Kwon,Yeongin Kim,Amir M. Foudeh,Anatol Ehrlich,Andrea Gasperini,Youngjun Yun,Youngjun Yun,Boris Murmann,Jeffery B.-H. Tok,Zhenan Bao +21 more
Wei Gao,Wei Gao,Sam Emaminejad,Sam Emaminejad,Sam Emaminejad,Hnin Yin Yin Nyein,Hnin Yin Yin Nyein,Samyuktha Challa,Kevin Chen,Kevin Chen,Austin J Peck,Hossain M. Fahad,Hossain M. Fahad,Hiroki Ota,Hiroki Ota,Hiroshi Shiraki,Hiroshi Shiraki,Daisuke Kiriya,Daisuke Kiriya,Der Hsien Lien,George A. Brooks,Ronald W. Davis,Ali Javey,Ali Javey +23 more
Alex Chortos,Jia Liu,Zhenan Bao +2 more