Two-dimensional endoscopic images are susceptible to interferences such as specular reflections and monotonous texture illumination,hindering accurate three-dimensional lesion reconstruction by surgical robots.This st...Two-dimensional endoscopic images are susceptible to interferences such as specular reflections and monotonous texture illumination,hindering accurate three-dimensional lesion reconstruction by surgical robots.This study proposes a novel end-to-end disparity estimation model to address these challenges.Our approach combines a Pseudo-Siamese neural network architecture with pyramid dilated convolutions,integrating multi-scale image information to enhance robustness against lighting interferences.This study introduces a Pseudo-Siamese structure-based disparity regression model that simplifies left-right image comparison,improving accuracy and efficiency.The model was evaluated using a dataset of stereo endoscopic videos captured by the Da Vinci surgical robot,comprising simulated silicone heart sequences and real heart video data.Experimental results demonstrate significant improvement in the network’s resistance to lighting interference without substantially increasing parameters.Moreover,the model exhibited faster convergence during training,contributing to overall performance enhancement.This study advances endoscopic image processing accuracy and has potential implications for surgical robot applications in complex environments.展开更多
The electroencephalogram（EEG）characters value of observers can be deduced by collecting brain electrical information when the observers are watching parallax stereo video.The characters value will change clearly whe...The electroencephalogram（EEG）characters value of observers can be deduced by collecting brain electrical information when the observers are watching parallax stereo video.The characters value will change clearly when watching asthenopia appear.To investigate the characters of parallax stereo watching asthenopia,the EEG of observers were recorded through the whole watching process of parallax stereo films until watching asthenopia appeared.The recorded EEG data of observers belongs to time-domain information.Fourier transform can process these data to frequency spectrum information.Theαandβwaves average power can be got by Newton-Cotes equation from the information.The ratio ofβpower to the sum ofαandβpower,CV,can be defined as EEG characters value of parallax stereo watching asthenopia and used to estimate the asthenopia degree of observers.Our experiments show that the smaller the CVis,the more serious the asthenopia is.展开更多
This work is a discussion on the energy parallax theory developed in [1] [2] based on the multiplicity of the solutions theorem. This theory is compared with the perturbation theory in mathematical physics. The pertur...This work is a discussion on the energy parallax theory developed in [1] [2] based on the multiplicity of the solutions theorem. This theory is compared with the perturbation theory in mathematical physics. The perturbation theory uses the increment of a solution which can be formalized with a Taylor series development. With the energy parallax theory, the convergence property of the Taylor series of the energy of a system is the key to decide to include additional solutions, defined on the so-called energy spaces [2]. The development is supported using various examples in quantum mechanics (i.e. Rayleigh-Schrödinger perturbation theory) and wave theory with the Electromagnetic (EM) energy density (i.e. evanescent waves within the skin layer of a dielectric material). Finally, we discuss the Woodward effect [3] and the application of the energy parallax when assuming that the variations of EM energy density can trigger such effect within asymmetric cavities.展开更多
基金Supported by Sichuan Science and Technology Program(2023YFSY0026,2023YFH0004)Supported by the Institute of Information&Communications Technology Planning&Evaluation(IITP)grant funded by the Korean government(MSIT)(No.RS-2022-00155885,Artificial Intelligence Convergence Innovation Human Resources Development(Hanyang University ERICA)).
文摘Two-dimensional endoscopic images are susceptible to interferences such as specular reflections and monotonous texture illumination,hindering accurate three-dimensional lesion reconstruction by surgical robots.This study proposes a novel end-to-end disparity estimation model to address these challenges.Our approach combines a Pseudo-Siamese neural network architecture with pyramid dilated convolutions,integrating multi-scale image information to enhance robustness against lighting interferences.This study introduces a Pseudo-Siamese structure-based disparity regression model that simplifies left-right image comparison,improving accuracy and efficiency.The model was evaluated using a dataset of stereo endoscopic videos captured by the Da Vinci surgical robot,comprising simulated silicone heart sequences and real heart video data.Experimental results demonstrate significant improvement in the network’s resistance to lighting interference without substantially increasing parameters.Moreover,the model exhibited faster convergence during training,contributing to overall performance enhancement.This study advances endoscopic image processing accuracy and has potential implications for surgical robot applications in complex environments.
基金Supported by the National Natural Science Fonudation of China(60674052)
文摘The electroencephalogram（EEG）characters value of observers can be deduced by collecting brain electrical information when the observers are watching parallax stereo video.The characters value will change clearly when watching asthenopia appear.To investigate the characters of parallax stereo watching asthenopia,the EEG of observers were recorded through the whole watching process of parallax stereo films until watching asthenopia appeared.The recorded EEG data of observers belongs to time-domain information.Fourier transform can process these data to frequency spectrum information.Theαandβwaves average power can be got by Newton-Cotes equation from the information.The ratio ofβpower to the sum ofαandβpower,CV,can be defined as EEG characters value of parallax stereo watching asthenopia and used to estimate the asthenopia degree of observers.Our experiments show that the smaller the CVis,the more serious the asthenopia is.
文摘This work is a discussion on the energy parallax theory developed in [1] [2] based on the multiplicity of the solutions theorem. This theory is compared with the perturbation theory in mathematical physics. The perturbation theory uses the increment of a solution which can be formalized with a Taylor series development. With the energy parallax theory, the convergence property of the Taylor series of the energy of a system is the key to decide to include additional solutions, defined on the so-called energy spaces [2]. The development is supported using various examples in quantum mechanics (i.e. Rayleigh-Schrödinger perturbation theory) and wave theory with the Electromagnetic (EM) energy density (i.e. evanescent waves within the skin layer of a dielectric material). Finally, we discuss the Woodward effect [3] and the application of the energy parallax when assuming that the variations of EM energy density can trigger such effect within asymmetric cavities.
