Bridge the Gap Between Full-Reference and No-Reference:A Totally Full-Reference Induced Blind Image Quality Assessment via Deep Neural Networks

Blind image quality assessment(BIQA)is of fundamental importance in low-level computer vision community.Increasing interest has been drawn in exploiting deep neural networks for BIQA.Despite of the notable success achieved,there is a broad consensus that training deep convolutional neural networks(DCNN)heavily relies on massive annotated data.Unfortunately,BIQA is typically a small sample problem,resulting the generalization ability of BIQA severely restricted.In order to improve the accuracy and generalization ability of BIQA metrics,this work proposed a totally opinion-unaware BIQA in which no subjective annotations are involved in the training stage.Multiple full-reference image quality assessment(FR-IQA)metrics are employed to label the distorted image as a substitution of subjective quality annotation.A deep neural network(DNN)is trained to blindly predict the multiple FR-IQA score in absence of corresponding pristine image.In the end,a selfsupervised FR-IQA score aggregator implemented by adversarial auto-encoder pools the predictions of multiple FR-IQA scores into the final quality predicting score.Even though none of subjective scores are involved in the training stage,experimental results indicate that our proposed full reference induced BIQA framework is as competitive as state-of-the-art BIQA metrics.

Blind Image Quality Assessment by Pairwise Ranking Image Series

Image quality assessment(IQA)is constantly innovating,but there are still three types of stickers that have not been resolved:the“content sticker”-limitation of training set,the“annotation sticker”-subjective instability in opinion scores and the“distortion sticker”-disordered distortion settings.In this paper,a No-Reference Image Quality Assessment(NR IQA)approach is proposed to deal with the problems.For“content sticker”,we introduce the idea of pairwise comparison and generate a largescale ranking set to pre-train the network;For“annotation sticker”,the absolute noise-containing subjective scores are transformed into ranking comparison results,and we design an indirect unsupervised regression based on EigenValue Decomposition(EVD);For“distortion sticker”,we propose a perception-based distortion classification method,which makes the distortion types clear and refined.Experiments have proved that our NR IQA approach Experiments show that the algorithm performs well and has good generalization ability.Furthermore,the proposed perception based distortion classification method would be able to provide insights on how the visual related studies may be developed and to broaden our understanding of human visual system.

Image quality assessment based on perceptual grouping

To further explore the human visual system（ HVS）,the perceptual grouping（ PG）, which has been proven to play an important role in the HVS, is adopted to design an effective image quality assessment（ IQA） model. Compared with the existing fixed-window-based models, the proposed one is an adaptive window-like model that introduces the perceptual grouping strategy into the IQA model. It works as follows： first,it preprocesses the images by clustering similar pixels into a group to the greatest extent; then the structural similarity is used to compute the similarity of the superpixels between reference and distorted images; finally, it integrates all the similarity of superpixels of an image to yield a quality score. Experimental results on three databases（ LIVE, IVC and MICT） showthat the proposed method yields good performance in terms of correlation with human judgments of visual quality.

Semi-reference image quality metric for virtual view images in free-viewpoint television

A semi-reference image quality assessment metric based on similarity measurement for synthesized virtual viewpoint image （VVI） in free-viewpoint television system （FFV） is proposed in this paper. The key point of the proposed metric is taking resemblant information between VVI and its neighbor view images for quality assessment to make our metric to be extended to multi-semi-reference image quality assessment easily. The proposed metric first extracts impact factors from image features, then combines an image synthesis technique and similarity functions, in which, disparity information are taken into account for registering the resemblant regions. Experiments are divided into three phases. Phase I is to verify the validation of the proposed metric by taking impaired images and original reference into account. The experimental results show the agreement between evaluation scores and bio-characteristic of human visual system. Phase II shows the accordance with Phase I by taking neighbor view as reference. The proposed metric can be taken as a full reference one to evaluate the image quality even though the original reference is absent. Phase III is then performed to evaluate the quality of WI. Evaluation scores in the experimental results are able to evaluate the quality of VVI.

Effect of erythromycin on image quality and transit time of capsule endoscopy: A two-center study

AIM: To compare the effect of oral erythromycin vs no preparation with prokinetics on the transit time and the image quality of capsule endoscopy (CE) in evaluating small bowel (SB) pathology. METHODS: We conducted a retrospective, blinded (to the type of preparation) review of 100 CE studies, 50 with no preparation with prokinetics from one medical center (Group A) and 50 from another center with administration of a single dose of 200 mg oral erythromycin 1 h prior to CE (Group B). Gastric, SB and total transit times were calculated, the presence of bile in the duodenum was scored, as was cleanliness within the proximal, middle and distal intestine. RESULTS: The erythromycin group had a slightly shorter gastric transit time (21 min vs 28 min, with no statistical significance). SB transit time was similar for both groups (all P > 0.05). Total transit time was almost identical in both groups. The rate of incomplete examination was 16% for Group A and 10% for Group B (P = 0.37). Bile and cleanliness scores in different parts of the intestine were similar for the two groups (P > 0.05). CONCLUSION: Preparation for capsule endoscopy with erythromycin does not affect SB or total transit time. It tends to reduce gastric transit time, but it does not increase the cecum-reaching rate. Erythromycin does not adversely affect image quality. We consider the routine use of oral erythromycin preparation as being unjustified, although it might be considered in patients with known prolonged gastric emptying time.

Effects of Saline Administration, Abdominal Compression, and Prolongation of Acquisition Delay on Image Quality Improvement of CT Urography

Objective To retrospectively evaluate the effects of saline administration following contrast material injection, abdominal compression and two delay phase acquisition on image quality improvement of computed tomographic urography (CTU). Methods Medical records and informed consents of patients were obtained. In totally 122 patients (50 men, 72 women), two delay phase images with CTU were performed. Scans began simultaneously with a contrast bolus injection of 100 mL (300 mgI/mL) followed by a saline bolus injection of 100 mL at a rate of 5 mL/s. Two delay phase images were taken at 400 and 550 seconds for each patient. Examinations were taken by using abdominal compression or not. The distention and opacification of the urinary tract were evaluated by two interpreters together on transverse images and post-processing images. Effects of four techniques (saline administration and abdominal compression, saline administration only, compression only, and neither saline administration nor compression) and two delay phase acquisition on image quality improvement were analysed by using ANOVA and Chi-square test. Results Saline administration improved opacification (P<0.05) and increased overall image quality (P<0.01) of the intrarenal collecting system and proximal ureter. Abdominal compression (P<0.05) and delayed phase image acquisition of 550 seconds (P<0.01) all improved distention of the intrarenal collecting system and proximal ureter but did not improve opacification. No statistically significant effects on the distal ureter were found. However, there were more visualized distal ureteral segments with the longer imaging delay. Conclusion Saline administration, abdominal compression and longer imaging delays are all effective in improving image quality of 64-detector row CTU.

Image Tampering Detection Using No-Reference Image Quality Metrics

In this paper,a new approach is proposed to determine whether the content of an image is authentic or modified with a focus on detecting complex image tampering.Detecting image tampering without any prior information of the original image is a challenging problem since unknown diverse manipulations may have different characteristics and so do various formats of images.Our principle is that image processing,no matter how complex,may affect image quality,so image quality metrics can be used to distinguish tampered images.In particular,based on the alteration of image quality in modified blocks,the proposed method can locate the tampered areas.Referring to four types of effective no-reference image quality metrics,we obtain 13 features to present an image.The experimental results show that the proposed method is very promising on detecting image tampering and locating the locally tampered areas especially in realistic scenarios.

Color Image Quality Assessment Based on Structural Similarity

It is well-known that classical quality measures,such as Mean Squared Error(MSE),Weighted Mean Squared Error(WMSE)or Peak Signal-to-Noise Ratio(PSNR),are not always corresponding with visual observations.Structural similarity based image quality assessment was proposed under the assumption that the Human Visual System(HVS)is highly adapted for extracting structural information from an image.While the demand on high color quality increases in the media industry,color loss will make the visual quality different.In this paper,we proposed an improved quality assessment(QA)method by adding color comparison into the structural similarity(SSIM)measurement system for evaluating color image quality.Then we divided the task of similarity measurement into four comparisons:luminance,contrast,structure,and color.Experimental results show that the predicted quality scores of the proposed method are more effective and consistent with visual quality than the classical methods using five different distortion types of color image sets.

NEW VISUAL PERCEPTUAL POOLING STRATEGY FOR IMAGE QUALITY ASSESSMENT

Most of Image Quality Assessment (IQA) metrics consist of two processes. In the first process, quality map of image is measured locally. In the second process, the last quality score is converted from the quality map by using the pooling strategy. The first process had been made effective and significant progresses, while the second process was always done in simple ways. In the second process of the pooling strategy, the optimal perceptual pooling weights should be determined and computed according to Human Visual System (HVS). Thus, a reliable spatial pooling mathematical model based on HVS is an important issue worthy of study. In this paper, a new Visual Perceptual Pooling Strategy (VPPS) for IQA is presented based on contrast sensitivity and luminance sensitivity of HVS. Experimental results with the LIVE database show that the visual perceptual weights, obtained by the proposed pooling strategy, can effectively and significantly improve the performances of the IQA metrics with Mean Structural SIMilarity (MSSIM) or Phase Quantization Code (PQC). It is confirmed that the proposed VPPS demonstrates promising results for improving the performances of existing IQA metrics.

A METHOD OF IMAGE QUALITY ASSESSMENT FOR COMPRESSIVE SAMPLING VIDEO TRANSMISSION

Based on compressive sampling transmission model, we demonstrate here a method of quality evaluation for the reconstruction images, which is promising for the transmission of unstructured signal with reduced dimension. By this method, the auxiliary information of the recovery image quality is obtained as a feedback to control number of measurements from compressive sampling video stream. Therefore, the number of measurements can be easily derived at the condition of the absence of information sparsity, and the recovery image quality is effectively improved. Theoretical and experimental results show that this algorithm can estimate the quality of images effectively and is in well consistency with the traditional objective evaluation algorithm.

Multi-Scale Blind Image Quality Predictor Based on Pyramidal Convolution

Traditional image quality assessment methods use the hand-crafted features to predict the image quality score,which cannot perform well in many scenes.Since deep learning promotes the development of many computer vision tasks,many IQA methods start to utilize the deep convolutional neural networks(CNN)for IQA task.In this paper,a CNN-based multi-scale blind image quality predictor is proposed to extract more effectivity multi-scale distortion features through the pyramidal convolution,which consists of two tasks:A distortion recognition task and a quality regression task.For the first task,image distortion type is obtained by the fully connected layer.For the second task,the image quality score is predicted during the distortion recognition progress.Experimental results on three famous IQA datasets show that the proposed method has better performance than the previous traditional algorithms for quality prediction and distortion recognition.

Toward a Neurophysiological Measure of Image Quality Perception Based on Algebraic Topology Analysis

The bandwidth of internet connections is still a bottleneck when transmitting large amounts of images,making the image quality assessment essential.Neurophysiological assessment of image quality has highlight advantages for it does not interfere with natural viewing behavior.However,in JPEG compression,the previous study is hard to tell the difference between the electroencephalogram(EEG)evoked by different quality images.In this paper,we propose an EEG analysis approach based on algebraic topology analysis,and the result shows that the difference between Euler characteristics of EEG evoked by different distortion images is striking both in the alpha and beta band.Moreover,we further discuss the relationship between the images and the EEG signals,and the results implied that the algebraic topological properties of images are consistent with that of brain perception,which is possible to give birth to braininspired image compression based on algebraic topological features.In general,an algebraic topologybased approach was proposed in this paper to analyze the perceptual characteristics of image quality,which will be beneficial to provide a reliable score for data compression in the network and improve the network transmission capacity.

Geometric Calibration and Image Quality Assessment of High Resolution Dual-Camera Satellite

The evaluation of geometric calibration accuracy of high resolution satellite images has been increasingly recognized in recent years.In order to evaluate geometric accuracy for dual-camera satellite images based on the ground control points(GCP),a rigorous geometric imaging model,which was based on the collinear equation of the probe directional angle and the optimized tri-axial attitude determination(TRIAD)algorithm,is presented.Two reliable test fields in Tianjin and Jinan(China)were utilized for geometric accuracy validation of Pakistan Remote Sensing Satellite-1.The experimental results demonstrate a certain deviation of the on-orbit calibration result from the initial design values of the calibration parameters.Therefore,on-orbit geometric calibration is necessary for optical satellite imagery.Within this research,the geometrical performances including positioning accuracy without/with GCP and band registration of the dual-camera satellite were analyzed in detail,and the results of geometric image quality are assessed and discussed.As a result,it is feasible and necessary to establish such a geometric calibration model to evaluate the geometric quality of dual-camera satellite.

Image Quality Improvement for Underwater Visual Inspections of Nuclear Power Plants

Visual inspection of the key components of nuclear power plants(NPPs)is important for NPP operation and maintenance. However,the underwater environment and existing radiation will lead to image degradation,thus making it difficult to identify surface defects. In this study,a method for improving the quality of underwater images is proposed.By analyzing the degradation characteristics of underwater detection image,the image enhancement technology is used to improve the color richness of the image,and then the improved dark channel prior(DCP)algorithm is used to restore it. By modifying the estimation formula of transmittance and background light,the correction of insufficient brightness in DCP restored image is realized. The proposed method is compared with other state-of-the-art methods. The results show that the proposed method can achieve higher scores and improve the image quality by correcting the color and restoring local details,thus effectively enhancing the reliability of visual inspection of NPPs.

Blind Image Quality Assessment Based on Hybrid Fuzzy-Genetic Technique

A new method for no-reference image quality assessment based on hybrid fuzzy-genetic technique is proposed. Noise variance and edge sharpness level of the restored image are two basic metrics for assessing the performance of the restoration algorithm, then a fuzzy if-then inference system is developed to combine the two metrics to get a final quality score, and the parameters of the fuzzy membership function are trained with genetic algorithms. Experiments results show that the image quality score correlates well with mean opinion score and the proposed approach is robust and effective.

Blind Image Quality Assessment Based on Wavelet Power Spectrum in Perceptual Domain

Blind image quality assessment(BIQA) can assess the perceptual quality of a distorted image without a prior knowledge of its reference image or distortion type. In this paper, a novel BIQA model is developed in wavelet domain. Considering the multi-resolution and band-passing characteristics of discrete wavelet transform(DWT), an improvement over the power spectrum is put forward, i.e., dubbed wavelet power spectrum(WPS)estimation. Then, the concept of directional WPS is applied to simplify the calculation. Moreover, a rotationally symmetric modulation transfer function(MTF) of human visual system(HVS) is integrated as a filter, which makes the metric to be consistent with the human vision perception and more discriminative. Experiments are conducted on the LIVE databases and three other databases, and the results show that the proposed metric is highly correlated with subjective evaluations and it competes well with other state-of-the-art metrics in terms of effectiveness and robustness.

Computed Tomography Protocol Optimisation for Pediatric Head Trauma: Radiation Dose and Image Quality Assessment

Purpose: Children are sometimes examined with Computed Tomography protocols designed for adults, leading to radiation doses higher than necessary. Lack of optimisation could lead to image quality higher than what is needed for diagnostic purposes with associated high doses to patients. Optimising the protocols for paediatric head trauma CT imaging will reduce radiation dose. Objective: The study aimed to optimise radiation dose and assess the image quality for a set of protocols by evaluating noise, a contrast to noise ratio, modulation transfer function and noise power spectrum. Methods: Somaton Sensation 64 was used to scan the head of an anthropomorphic phantom with a set of protocols. ImageJ software was used to analyse the paediatric head image from the scanner. IMPACTSCAN dosimeter software was used to evaluate the radiation dose to the various organs in the head. MATLAB was used to analyse the Modulation Transfer Function and the Noise Power. Results: The estimated Computed Tomography Dose Index volume (CTDIvol) increased with increasing tube current and tube voltage. The high pitch of 0.9 gave a lower dose than the 0.5 pitch. The eye lens received the highest radiation dose (39.2 mGy) whiles the thyroid received the least radiation dose (13.7 mGy). There was an increase in noise (62.46) when the H60 kernel was used and a lower noise (8.829) was noticed when the H30 kernel was used. Conclusion: The results obtained show that the H30 kernel (smooth kernel) gave higher values for noise and contrast to noise ratio (CNR) than the H60 kernel (sharp kernel). The H60 kernel produced high values for the modulation transfer function (MTF) and noise power spectrum (NPS). The eye lens received the highest radiation dose.

No-Reference Stereo Image Quality Assessment Based on Transfer Learning

In order to apply the deep learning to the stereo image quality evaluation,two problems need to be solved:The first one is that we have a bit of training samples,another is how to input the dimensional image’s left view or right view.In this paper,we transfer the 2D image quality evaluation model to the stereo image quality evaluation,and this method solves the first problem;use the method of principal component analysis is used to fuse the left and right views into an input image in order to solve the second problem.At the same time,the input image is preprocessed by phase congruency transformation,which further improves the performance of the algorithm.The structure of the deep convolution neural network consists of four convolution layers and three maximum pooling layers and two fully connected layers.The experimental results on LIVE3D image database show that the prediction quality score of the model is in good agreement with the subjective evaluation value.

A multimodal dense convolution network for blind image quality assessment

Technological advancements continue to expand the communications industry’s potential.Images,which are an important component in strengthening communication,are widely available.Therefore,image quality assessment(IQA)is critical in improving content delivered to end users.Convolutional neural networks(CNNs)used in IQA face two common challenges.One issue is that these methods fail to provide the best representation of the image.The other issue is that the models have a large number of parameters,which easily leads to overfitting.To address these issues,the dense convolution network(DSC-Net),a deep learning model with fewer parameters,is proposed for no-reference image quality assessment(NR-IQA).Moreover,it is obvious that the use of multimodal data for deep learning has improved the performance of applications.As a result,multimodal dense convolution network(MDSC-Net)fuses the texture features extracted using the gray-level co-occurrence matrix(GLCM)method and spatial features extracted using DSC-Net and predicts the image quality.The performance of the proposed framework on the benchmark synthetic datasets LIVE,TID2013,and KADID-10k demonstrates that the MDSC-Net approach achieves good performance over state-of-the-art methods for the NR-IQA task.