Head-mounted display-based intuitive virtual reality training system for the mining industry

Virtual reality(VR) training technology in the mining industry is a new field of research and utilization.The successful application of VR training system is critical to mine safety and production. Through the statistics of the current research and applications of VR training systems in mining industry, all the input/output devices are classified. Based on the classifications of the input/output devices that are used in the VR system, the current VR training systems for the mining industry could be divided into three types: screen-based general type, projector-based customized type, and head-mounted display(HMD)-based intuitive type. By employing a VR headset, a smartphone and a leap motion device, an HMDbased intuitive type VR training system prototype for drilling in underground mines has been developed.Ten trainees tried both the HMD-based intuitive system and the screen-based general control system to compare the experiences and training effects. The results show that the HMD-based system can give a much better user experience and is easy to use. Three of the five components of a VR training system,namely, the user, the tasks, and software and database should be given more attention in future research.With more available technologies of input and output devices, VR engines, and system software, the VR training system will eventually yield much better training results, and will play a more important role in as a training tool for mine safety.

VEGO:A novel design towards customizable and adjustable head-mounted display for VR

Background Virtual Reality(VR)technologies have advanced fast and have been applied to a wide spectrum of sectors in the past few years.VR can provide an immersive experience to users by generating virtual images and displaying the virtual images to the user with a head-mounted display(HMD)which is a primary component of VR.Normally,an HMD contains a list of hardware components,e.g.,housing pack,micro LCD display,microcontroller,optical lens,etc.Settings of VR HMD to accommodate the user's inter-pupil distance(IPD)and the user's eye focus power are important for the user's experience with VR.Methods Although various methods have been developed towards IPD and focus adjustments for VR HMD,the increased cost and complexity impede the possibility for users who wish to assemble their own VR HMD for various purposes,e.g.,DIY teaching,etc.In our paper,we present a novel design towards building a customizable and adjustable HMD for VR in a cost-effective manner.Modular design methodology is adopted,and the VR HMD can be easily printed with 3D printers.The design also features adjustable IPD and variable distance between the optical lens and the display.It can help to mitigate the vergence and accommodation conflict issue.Results A prototype of the customizable and adjustable VR HMD has been successfully built up with off-the-shelf components.A VR software program running on Raspberry Pi board has been developed and can be utilized to show the VR effects.A user study with 20 participants is conducted with positive feedback on our novel design.Conclusions Modular design can be successfully applied for building up VR HMD with 3D printing.It helps to promote the wide application of VR at affordable costs while featuring flexibility and adjustability.

Light field head-mounted display with correct focus cue using micro structure array

A new type of light fiehl display is proposed using a head-mounted display （HMD） and a micro structure array （MSA, lens array or pinhole array）. Each rendering point emits abundant rays from different directions into the viewer＇s pupil, and at one time the dense light field is generated inside the exit pupil of the HMD through the eyepiece. Therefore, the proposed method not only solves the problem of accommodation and convergence conflict in a traditional HMD, but also drastically reduces the huge data in real three-dimensional （3D） display. To demonstrate the proposed method, a prototype is developed, which is capable of giving the observer a real perception of depth.

Efficiency balance of a light guide plate with microstructures for a see-through head-mounted display

The efficiency balance phenomenon for see-through head-mounted displays with different microstructure con- ditions can be found both theoretically and using optical simulation software. A simple mathematical calculation is used to determine the relationship between the real image （see-through function） energy and the virtual image energy. The simulation is based on factors taken from previous research studies. It is found that the balance value of the optical efficiency remains almost constant （66.63% to 67.38%） under different microstructure conditions. In addition, suitable conditions for the microstructures in see-through head-mounted displays for daily applications can be predicted.

Lightweight spatial-multiplexed dual focal-plane head-mounted display using two freeform prisms

Accommodation and convergence play critical roles in the natural viewing of three-dimensional （3D） scenes, and these must be accurately matched to avoid visual fatigue. However, conventional stereoscopic head- mounted displays lack the ability to adjust accommodation cues. This is because they only have a single, fixed image plane, but the 3D virtual objects generated by a pair of stereoscopic images are displayed at different depths, either in front or behind the focal plane. Therefore, in order to view objects clearly, the eyes are forced to converge on those objects while maintaining accommodation fixed on the image plane. By employing freeform optical surfaces, we design a lightweight and wearable spatial-multiplexed dual focal-plane head-mounted display. This display can adjust the accommodation cue in accordance with the convergence cue as well as generate the retinal blur cue. The system has great potential applications in both scientific research and commercial market.

Retinal projection head-mounted display

Retinal projection displays （RPDs） are an important development direction for head-mounted dis- plays （HMDs）. This paper reviews the literature on optical engineering aspects based on the data on advanced technology in RPD design and development. The review includes the principles and applications of four theories, e. g., the Maxwellian view and its modified modality and the monocular and binocular depth cues of stereoscopic objects in the physiology of the human visual system. To support the Maxwellian view and achieve retinal projec- tion systems with depth cues, results of previous design works were summarized using different methods and their advantages and disadvantages are analyzed. With an extremely long focal depth, a prototype of a full-color stereoscopic see-through RPD system was discussed. Finally, a brief outlook of the future development trends and applications of the RPDs was presented

Dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates

Interactive holography offers unmatched levels of immersion and user engagement in the field of future display.Despite of the substantial progress has been made in dynamic meta-holography,the realization of real-time,highly smooth interactive holography remains a significant challenge due to the computational and display frame rate limitations.In this study,we introduced a dynamic interactive bitwise meta-holography with ultra-high computational and display frame rates.To our knowledge,this is the first reported practical dynamic interactive metasurface holographic system.We spa-tially divided the metasurface device into multiple distinct channels,each projecting a reconstructed sub-pattern.The switching states of these channels were mapped to bitwise operations on a set of bit values,which avoids complex holo-gram computations,enabling an ultra-high computational frame rate.Our approach achieves a computational frame rate of 800 kHz and a display frame rate of 23 kHz on a low-power Raspberry Pi computational platform.According to this methodology,we demonstrated an interactive dynamic holographic Tetris game system that allows interactive gameplay,color display,and on-the-fly hologram creation.Our technology presents an inspiration for advanced dynamic meta-holography,which is promising for a broad range of applications including advanced human-computer interaction,real-time 3D visualization,and next-generation virtual and augmented reality systems.

Flexible perovskite light-emitting diodes for display applications and beyond

The flexible perovskite light-emitting diodes(FPeLEDs),which can be expediently integrated to portable and wearable devices,have shown great potential in various applications.The FPeLEDs inherit the unique optical properties of metal halide perovskites,such as tunable bandgap,narrow emission linewidth,high photoluminescence quantum yield,and particularly,the soft nature of lattice.At present,substantial efforts have been made for FPeLEDs with encouraging external quantum efficiency(EQE)of 24.5%.Herein,we summarize the recent progress in FPeLEDs,focusing on the strategy developed for perovskite emission layers and flexible electrodes to facilitate the optoelectrical and mechanical performance.In addition,we present relevant applications of FPeLEDs in displays and beyond.Finally,perspective toward the future development and applications of flexible PeLEDs are also discussed.

Non-volatile dynamically switchable color display via chalcogenide stepwise cavity resonators

High-resolution multi-color printing relies upon pixelated optical nanostructures,which is crucial to promote color display by producing nonbleaching colors,yet requires simplicity in fabrication and dynamic switching.Antimony trisulfide(Sb_(2)S_(3))is a newly rising chalcogenide material that possesses prompt and significant transition of its optical characteristics in the visible region between amorphous and crystalline phases,which holds the key to color-varying devices.Herein,we proposed a dynamically switchable color printing method using Sb_(2)S_(3)-based stepwise pixelated Fabry-Pérot(FP)cavities with various cavity lengths.The device was fabricated by employing a direct laser patterning that is a less timeconsuming,more approachable,and low-cost technique.As switching the state of Sb_(2)S_(3) between amorphous and crystalline,the multi-color of stepwise pixelated FP cavities can be actively changed.The color variation is due to the profound change in the refractive index of Sb_(2)S_(3) over the visible spectrum during its phase transition.Moreover,we directly fabricated sub-50 nm nano-grating on ultrathin Sb_(2)S_(3) laminate via microsphere 800-nm femtosecond laser irradiation in far field.The minimum feature size can be further decreased down to~45 nm(λ/17)by varying the thickness of Sb_(2)S_(3) film.Ultrafast switchable Sb_(2)S_(3) photonic devices can take one step toward the next generation of inkless erasable papers or displays and enable information encryption,camouflaging surfaces,anticounterfeiting,etc.Importantly,our work explores the prospects of rapid and rewritable fabrication of periodic structures with nano-scale resolution and can serve as a guideline for further development of chalcogenide-based photonics components.

Time-sequential color code division multiplexing holographic display with metasurface

Color metasurface holograms are powerful and versatile platforms for modulating the amplitude,phase,polarization,and other properties of light at multiple operating wavelengths.However,the current color metasurface holography can only realize static manipulation.In this study,we propose and demonstrate a multiplexing metasurface technique combined with multiwavelength code-division multiplexing(CDM)to realize dynamic manipulation.Multicolor code references are utilized to record information within a single metasurface and increase the information capacity and security for anticracks.A total of 48 monochrome images consisting of pure color characters and multilevel color video frames were reconstructed in dual polarization channels of the birefringent metasurface to exhibit high information density,and a video was displayed via sequential illumination of the corresponding code patterns to verify the ability of dynamic manipulation.Our approach demonstrates significant application potential in optical data storage,optical encryption,multiwavelengthversatile diffractive optical elements,and stimulated emission depletion microscopy.

Metasurfaces for near-eye display applications

Virtual reality(VR)and augmented reality(AR)are revolutionizing our lives.Near-eye displays are crucial technologies for VR and AR.Despite the rapid advances in near-eye display technologies,there are still challenges such as large field of view,high resolution,high image quality,natural free 3D effect,and compact form factor.Great efforts have been devoted to striking a balance between visual performance and device compactness.While traditional optics are nearing their limitations in addressing these challenges,ultra-thin metasurface optics,with their high light-modulating capabilities,may present a promising solution.In this review,we first introduce VR and AR near-eye displays,and then briefly explain the working principles of light-modulating metasurfaces,review recent developments in metasurface devices geared toward near-eye display applications,delved into several advanced natural 3D near-eye display technologies based on metasurfaces,and finally discuss about the remaining challenges and future perspectives associated with metasurfaces for near-eye display applications.

Integral imaging-based tabletop light field 3D display with large viewing angle

Light field 3D display technology is considered a revolutionary technology to address the critical visual fatigue issues in the existing 3D displays.Tabletop light field 3D display provides a brand-new display form that satisfies multi-user shared viewing and collaborative works,and it is poised to become a potential alternative to the traditional wall and portable display forms.However,a large radial viewing angle and correct radial perspective and parallax are still out of reach for most current tabletop light field 3D displays due to the limited amount of spatial information.To address the viewing angle and perspective issues,a novel integral imaging-based tabletop light field 3D display with a simple flat-panel structure is proposed and developed by applying a compound lens array,two spliced 8K liquid crystal display panels,and a light shaping diffuser screen.The compound lens array is designed to be composed of multiple three-piece compound lens units by employing a reverse design scheme,which greatly extends the radial viewing angle in the case of a limited amount of spatial information and balances other important 3D display parameters.The proposed display has a radial viewing angle of 68.7°in a large display size of 43.5 inches,which is larger than the conventional tabletop light field 3D displays.The radial perspective and parallax are correct,and high-resolution 3D images can be reproduced in large radial viewing positions.We envision that this proposed display opens up possibility for redefining the display forms of consumer electronics.

Recent progress in microbial cell surface display systems and their application on biosensors

Microbial cell surface display technology is a recombinant technology to express target proteins on the cell membrane,which can be used to redesign the cell surface with functional proteins and peptides.Bacterial and yeast surface display systems are the most common cell surface display systems of prokaryotic and eukaryotic proteins,that are widely applied as the core elements in the field of biosensors due to their advantages,including enhanced stability,high yield,good safety,expression of larger and more complex proteins.To further promote the performance of biosensors,the biomineralized microbial surface display technology was proposed.This review summarized the different microbial surface display systems and the biomineralized surface display systems,where the mechanisms of surface display and biomineralization were introduced.Then we described the recent progress of their applications on biosensors for different types of detection targets.Finally,the outlooks and tendencies were discussed and forecasted with the expectation to provide some general functions and enlightenments to this aspect of research.

Accuracy of Mean Value of Central Venous Pressure from Monitor Digital Display: Influence of Amplitude of Central Venous Pressure during Respiration

Background A simple measurement of central venous pressure(CVP)-mean by the digital monitor display has become increasingly popular.However,the agreement between CVP-mean and CVP-end(a standard method of CVP measurement by analyzing the waveform at end-expiration)is not well determined.This study was designed to identify the relationship between CVP-mean and CVP-end in critically ill patients and to introduce a new parameter of CVP amplitude(ΔCVP=CVPmax-CVPmin)during the respiratory period to identify the agreement/disagreement between CVP-mean and CVP-end.Methods In total,291 patients were included in the study.CVP-mean and CVP-end were obtained simultaneously from each patient.CVP measurement difference(|CVP-mean-CVP-end|)was defined as the difference between CVP-mean and CVP-end.TheΔCVP was calculated as the difference between the peak(CVPmax)and the nadir value(CVPmin)during the respiratory cycle,which was automatically recorded on the monitor screen.Subjects with|CVP-mean-CVP-end|≥2 mm Hg were divided into the inconsistent group,while subjects with|CVP-mean-CVP-end|2 mm Hg were divided into the consistent group.ResultsΔCVP was significantly higher in the inconsistent group[7.17(2.77)vs.5.24(2.18),P0.001]than that in the consistent group.There was a significantly positive relationship betweenΔCVP and|CVP-mean-CVP-end|(r=0.283,P 0.0001).Bland-Altman plot showed the bias was-0.61 mm Hg with a wide 95%limit of agreement(-3.34,2.10)of CVP-end and CVP-mean.The area under the receiver operating characteristic curves(AUC)ofΔCVP for predicting|CVP-mean-CVP-end|≥2 mm Hg was 0.709.With a high diagnostic specificity,usingΔCVP3 to detect|CVP-mean-CVP-end|lower than 2mm Hg(consistent measurement)resulted in a sensitivity of 22.37%and a specificity of 93.06%.UsingΔCVP8 to detect|CVP-mean-CVPend|8 mm Hg(inconsistent measurement)resulted in a sensitivity of 31.94%and a specificity of 91.32%.Conclusions CVP-end and CVP-mean have statistical discrepancies in specific clinical scenarios.ΔCVP during the respiratory period is related to the variation of the two CVP methods.A highΔCVP indicates a poor agreement between these two methods,whereas a lowΔCVP indicates a good agreement between these two methods.

Fast and Stable Zinc Anode‑Based Electrochromic Displays Enabled by Bimetallically Doped Vanadate and Aqueous Zn^(2+)/Na^(+)Hybrid Electrolytes

Vanadates are a class of the most promising electrochromic materials for displays as their multicolor characteristics.However,the slow switching times and vanadate dissolution issues of recently reported vanadates significantly hinder their diverse practical applications.Herein,novel strategies are developed to design electrochemically stable vanadates having rapid switching times.We show that the interlayer spacing is greatly broadened by introducing sodium and lanthanum ions into V_(3)O_(8)interlayers,which facilitates the transportation of cations and enhances the electrochemical kinetics.In addition,a hybrid Zn^(2+)/Na^(+)electrolyte is designed to inhibit vanadate dissolution while significantly accelerating electrochemical kinetics.As a result,our electrochromic displays yield the most rapid switching times in comparison with any reported Zn-vanadate electrochromic displays.It is envisioned that stable vanadate-based electrochromic displays having video speed switching are appearing on the near horizon.

Humanoid Intelligent Display Platform for Audiovisual Interaction and Sound Identification

This study proposes a rational strategy for the design,fabrication and system integration of the humanoid intelligent display platform(HIDP)to meet the requirements of highly humanized mechanical properties and intelligence for human-machine interfaces.The platform’s sandwich structure comprises a middle lightemitting layer and surface electrodes,which consists of silicon elastomer embedded with phosphor and silk fibroin ionoelastomer,respectively.Both materials are highly stretchable and resilient,endowing the HIDP with skin-like mechanical properties and applicability in various extreme environments and complex mechanical stimulations.Furthermore,by establishing the numerical correlation between the amplitude change of animal sounds and the brightness variation,the HIDP realizes audiovisual interaction and successful identification of animal species with the aid of Internet of Things(IoT)and machine learning techniques.The accuracy of species identification reaches about 100%for 200 rounds of random testing.Additionally,the HIDP can recognize animal species and their corresponding frequencies by analyzing sound characteristics,displaying real-time results with an accuracy of approximately 99%and 93%,respectively.In sum,this study offers a rational route to designing intelligent display devices for audiovisual interaction,which can expedite the application of smart display devices in human-machine interaction,soft robotics,wearable sound-vision system and medical devices for hearing-impaired patients.

Identification and epitope mapping of anti-p72 single-chain antibody against African swine fever virus based on phage display antibody library

African swine fever virus(ASFV)is a lethal pathogen that causes severe threats to the global swine industry and it has already had catastrophic socio-economic effects.To date,no licensed prophylactic vaccine exists.Limited knowledge exists about the major immunogens of ASFV and the epitope mapping of the key antigens.As such,there is a considerable requirement to understand the functional monoclonal antibodies(mAbs)and the epitope mapping may be of utmost importance in our understanding of immune responses and designing improved vaccines,therapeutics,and diagnostics.In this study,we generated an ASFV antibody phage-display library from ASFV convalescent swine PBMCs,further screened a specific ASFV major capsid protein(p72)single-chain antibody and fused with an IgG Fc fragment(scFv-83-Fc),which is a specific recognition antibody against ASFV Pig/HLJ/2018 strain.Using the scFv-83-Fc mAb,we selected a conserved epitope peptide(221MTGYKH226)of p72 retrieved from a phage-displayed random peptide library.Moreover,flow cytometry and cell uptake experiments demonstrated that the epitope peptide can significantly promote BMDCs maturation in vitro and could be effectively uptaken by DCs,which indicated its potential application in vaccine and diagnostic reagent development.Overall,this study provided a valuable platform for identifying targets for ASFV vaccine development,as well as to facilitate the optimization design of subunit vaccine and diagnostic reagents.

Design Strategy of Digital Display Based on the Concept of Service Design

Based on the analysis of the concept,core,research content and method of service design,this paper explains the necessity of service design to participate in digital display,and further discusses how service design integrates with digital display,how to redesign the digital display system under the intervention of service design,and how to integrate user needs into it at all times.Finally,the design strategy of digital display under the concept of service design is proposed.

Laser patterning of large-scale perovskite single-crystal-based arrays for single-mode laser displays

Lead halide perovskites have attracted considerable attention as potential candidates for high-performance nano/microlasers,owing to their outstanding optical properties.However,the further development of perovskite microlaser arrays(especially based on polycrystalline thin films)produced by the conventional processing techniques is hindered by the chemical instability and surface roughness of the perovskite structures.Herein,we demonstrate a laser patterning of large-scale,highly crystalline perovskite single-crystal films to fabricate reproducible perovskite single-crystal-based microlaser arrays.Perovskite thin films were directly ablated by femtosecond-laser in multiple low-power cycles at a minimum machining line width of approximately 300 nm to realize high-precision,chemically clean,and repeatable fabrication of microdisk arrays.The surface impurities generated during the process can be washed away to avoid external optical loss due to the robustness of the single-crystal film.Moreover,the high-quality,large-sized perovskite single-crystal films can significantly improve the quality of microcavities,thereby realizing a perovskite microdisk laser with narrow linewidth(0.09 nm)and low threshold(5.1µJ/cm2).Benefiting from the novel laser patterning method and the large-sized perovskite single-crystal films,a high power and high color purity laser display with single-mode microlasers as pixels was successfully fabricated.Thus,this study may offer a potential platform for mass-scale and reproducible fabrication of microlaser arrays,and further facilitate the development of highly integrated applications based on perovskite materials.

An Investigation of the Effects of Thermal Interference between Adjacent Nitinol Spring Actuators in a Tactile Display

Over the years, there has been increased research interest in the application of Nitinol as an actuator, due to its shape memory behaviour, simplicity, high power-to-weight ratio, compactness, and extreme high fatigue resistance to cyclic motion, and noiseless operation. Nitinol has found application in tactile displays which reproduce tactile parameters such as texture and shape, depending on the application. This paper presents the effects of thermal interference between adjacent Nitinol spring actuators in a tactile display. The tactile display is made of a 3 by 3 pin array whose spatial resolution was varied from 4 mm to 6 mm in steps of 1 mm while a current of 1.5 A was used to actuate 8 of the springs, and the centre spring was left unactivated to observe the thermal effects on it due to the heat gradient formed. A Finite Element (FE) model was developed using COMSOL Multiphysics and the results were further verified through experimentation. In both cases, there was visible thermal interference between actuators. The increase in spatial resolution saw a decrease in thermal interference by 12.7%. Using a fan to introduce forced convection, reduced the thermal interference in the simulation by 20% and during experimentation by 11%. The results of this research indicate a spatial resolution of 6 mm reduced the thermal inference to a negligible rate. However, thermal interference could not be eliminated with these two methods.