Spatial-Spectral Joint Network for Cholangiocarcinoma Microscopic Hyperspectral Image Classification

Accurate histopathology classification is a crucial factor in the diagnosis and treatment of Cholangiocarcinoma(CCA).Hyperspectral images(HSI)provide rich spectral information than ordinary RGB images,making them more useful for medical diagnosis.The Convolutional Neural Network(CNN)is commonly employed in hyperspectral image classification due to its remarkable capacity for feature extraction and image classification.However,many existing CNN-based HSI classification methods tend to ignore the importance of image spatial context information and the interdependence between spectral channels,leading to unsatisfied classification performance.Thus,to address these issues,this paper proposes a Spatial-Spectral Joint Network(SSJN)model for hyperspectral image classification that utilizes spatial self-attention and spectral feature extraction.The SSJN model is derived from the ResNet18 network and implemented with the non-local and Coordinate Attention(CA)modules,which extract long-range dependencies on image space and enhance spatial features through the Branch Attention(BA)module to emphasize the region of interest.Furthermore,the SSJN model employs Conv-LSTM modules to extract long-range depen-dencies in the image spectral domain.This addresses the gradient disappearance/explosion phenom-ena and enhances the model classification accuracy.The experimental results show that the pro-posed SSJN model is more efficient in leveraging the spatial and spectral information of hyperspec-tral images on multidimensional microspectral datasets of CCA,leading to higher classification accuracy,and may have useful references for medical diagnosis of CCA.

Spatial-spectral identication of abnormal leukocytes based on microscopic hyperspectral imaging technology

Screening and diagnosing of abnormal Leukocytes are crucial for the diagnosis of immune diseases and Acute Lymphoblastic Leukemia(ALL).As the deterioration of abnormal leukocytes is mainly due to the changes in the chromatin distribution,which signicantly affects the absorption and reflection of light,the spectral feature is proved to be important for leukocytes classication and identication.This paper proposes an accurate identication method for healthy and abnormal leukocytes based on microscopic hyperspectral imaging(HSI)technology which combines the spectral information.The segmentation of nucleus and cytoplasm is obtained by the morphological watershed algorithm.Then,the spectral features are extracted and combined with the spatial features.Based on this,the support vector machine(SVM)is applied for classication ofve types of leukocytes and abnormal leukocytes.Compared with different classication methods,the proposed method utilizes spectral features which highlight the differences between healthy leukocytes and abnormal leukocytes,improving the accuracy in the classication and identication of leukocytes.This paper only selects one subtype of ALL for test,and the proposed method can be applied for detection of other leukemia in the future.

Microscopic hyperspectral imaging studies of normal and diabetic retina of rats

A microscopic hyperspectral imager was developed based on the microscopic technology and the spectral imaging technology. Some microscopic hyperspectral images of retina sections of the normal, the diabetic, and the treated rats were collected by the new imager. Single-band images and pseudo-color images of each group were obtained and the typical transmittance spectrums were ex-tracted. The results showed that the transmittance of outer nuclear layer cells of the diabetic group was generally higher than that of the normal. A small absorption peak appeared near the 180th band in the spectrum of the diabetic group and this peak weakened or disappeared in the spectrum of the treated group. Our findings indicate that the microscopic hyperspectral images include wealthy information of retina sections which is helpful for the ophthalmologist to reveal the pathogenesis of diabetic reti-nopathy and explore the therapeutic effect of drugs.

PCA-U-Net based breast cancer nest segmentation from microarray(jj)hyperspectral images

The incidence of breast cancer is tending younger globally,and tumor development,clinical treatment,and prognosis are largely influenced by histopathological diagnosis.For diagnosed patients,the distinction between the cancer nests and normal tissue is the basis of breast cancer treatment.Microscopic hyperspectral imaging technology has shown its potential in auxiliary pathological examinations due to the superior imaging modality and data characteristics.This paper presents a method for cancer nest segmentation from hyperspectral images of breast cancer tissue microarray samples.The scheme combines the strengths of the U-Net neural network and unsupervised principal component analysis,which reduces the amount of calculation and improves the recognition accuracy.The experimental accuracy of cancer nest segmentation reaches 87.14%.Furthermore,a set of quantitative pathological characteristic parameters reflects the degree of breast cancer lesions from multiple angles,providing a relatively comprehensive reference for the pathologist’s diagnosis.In-depth exploration of the combined development of deep learning and microscopic hyperspectral imaging technology is worthy to promote efficient diagnosis of breast tumors and concern for human health.