Underwater Image Classification Based on EfficientnetB0 and Two-Hidden-Layer Random Vector Functional Link

The ocean plays an important role in maintaining the equilibrium of Earth’s ecology and providing humans access to a wealth of resources.To obtain a high-precision underwater image classification model,we propose a classification model that combines an EfficientnetB0 neural network and a two-hidden-layer random vector functional link network(EfficientnetB0-TRVFL).The features of underwater images were extracted using the EfficientnetB0 neural network pretrained via ImageNet,and a new fully connected layer was trained on the underwater image dataset using the transfer learning method.Transfer learning ensures the initial performance of the network and helps in the development of a high-precision classification model.Subsequently,a TRVFL was proposed to improve the classification property of the model.Net construction of the two hidden layers exhibited a high accuracy when the same hidden layer nodes were used.The parameters of the second hidden layer were obtained using a novel calculation method,which reduced the outcome error to improve the performance instability caused by the random generation of parameters of RVFL.Finally,the TRVFL classifier was used to classify features and obtain classification results.The proposed EfficientnetB0-TRVFL classification model achieved 87.28%,74.06%,and 99.59%accuracy on the MLC2008,MLC2009,and Fish-gres datasets,respectively.The best convolutional neural networks and existing methods were stacked up through box plots and Kolmogorov-Smirnov tests,respectively.The increases imply improved systematization properties in underwater image classification tasks.The image classification model offers important performance advantages and better stability compared with existing methods.

Unsupervised Multi-Expert Learning Model for Underwater Image Enhancement

Underwater image enhancement aims to restore a clean appearance and thus improves the quality of underwater degraded images.Current methods feed the whole image directly into the model for enhancement.However,they ignored that the R,G and B channels of underwater degraded images present varied degrees of degradation,due to the selective absorption for the light.To address this issue,we propose an unsupervised multi-expert learning model by considering the enhancement of each color channel.Specifically,an unsupervised architecture based on generative adversarial network is employed to alleviate the need for paired underwater images.Based on this,we design a generator,including a multi-expert encoder,a feature fusion module and a feature fusion-guided decoder,to generate the clear underwater image.Accordingly,a multi-expert discriminator is proposed to verify the authenticity of the R,G and B channels,respectively.In addition,content perceptual loss and edge loss are introduced into the loss function to further improve the content and details of the enhanced images.Extensive experiments on public datasets demonstrate that our method achieves more pleasing results in vision quality.Various metrics(PSNR,SSIM,UIQM and UCIQE) evaluated on our enhanced images have been improved obviously.

A Novel Multi-Stream Fusion Network for Underwater Image Enhancement

Due to the selective absorption of light and the existence of a large number of floating media in sea water, underwater images often suffer from color casts and detail blurs. It is therefore necessary to perform color correction and detail restoration. However,the existing enhancement algorithms cannot achieve the desired results. In order to solve the above problems, this paper proposes a multi-stream feature fusion network. First, an underwater image is preprocessed to obtain potential information from the illumination stream, color stream and structure stream by histogram equalization with contrast limitation, gamma correction and white balance, respectively. Next, these three streams and the original raw stream are sent to the residual blocks to extract the features. The features will be subsequently fused. It can enhance feature representation in underwater images. In the meantime, a composite loss function including three terms is used to ensure the quality of the enhanced image from the three aspects of color balance, structure preservation and image smoothness. Therefore, the enhanced image is more in line with human visual perception.Finally, the effectiveness of the proposed method is verified by comparison experiments with many stateof-the-art underwater image enhancement algorithms. Experimental results show that the proposed method provides superior results over them in terms of MSE,PSNR, SSIM, UIQM and UCIQE, and the enhanced images are more similar to their ground truth images.

Visual Enhancement of Underwater Images Using Transmission Estimation and Multi-Scale Fusion

The demand for the exploration of ocean resources is increasing exponentially.Underwater image data plays a significant role in many research areas.Despite this,the visual quality of underwater images is degraded because of two main factors namely,backscattering and attenuation.Therefore,visual enhancement has become an essential process to recover the required data from the images.Many algorithms had been proposed in a decade for improving the quality of images.This paper aims to propose a single image enhancement technique without the use of any external datasets.For that,the degraded images are subjected to two main processes namely,color correction and image fusion.Initially,veiling light and transmission light is estimated tofind the color required for correction.Veiling light refers to unwanted light,whereas transmission light refers to the required light for color correction.These estimated outputs are applied in the scene recovery equation.The image obtained from color correction is subjected to a fusion process where the image is categorized into two versions and applied to white balance and contrast enhancement techniques.The resultants are divided into three weight maps namely,luminance,saliency,chromaticity and fused using the Laplacian pyramid.The results obtained are graphically compared with their input data using RGB Histogram plot.Finally,image quality is measured and tabulated using underwater image quality measures.

Underwater Image Enhancement Based on IMSRCR and CLAHE-WGIF

Aiming at the scattering and absorption of light in the water body,which causes the problems of color shift,uneven brightness,poor sharpness and missing details in the acquired underwater images,an underwater image enhancement algorithm based on IMSRCR and CLAHE-WGIF is proposed.Firstly,the IMSRCR algorithm proposed in this paper is used to process the original underwater image with adaptive color shift correction;secondly,the image is converted to HSV color space,and the segmentation exponential algorithm is used to process the S component to enhance the image saturation;finally,multi-scale Retinex is used to decompose the V component image into detail layer and base layer,and adaptive two-dimensional gamma correction is made to the base layer to adjust the brightness unevenness,while the detail layer is processed by CLAHE-WGIF algorithm to enhance the image contrast and detail information.The experimental results show that our algorithm has some advantages over existing algorithms in both subjective and objective evaluations,and the information entropy of the image is improved by 6.3%on average,and the UIQM and UCIQE indexes are improved by 12.9%and 20.3%on average.

An Approach to Synthesize Diverse Underwater Image Dataset

Images that are taken underwater mostly present color shift with hazy effects due to the special property of water.Underwater image enhancement methods are proposed to handle this issue.However,their enhancement results are only evaluated on a small number of underwater images.The lack of a sufficiently large and diverse dataset for efficient evaluation of underwater image enhancement methods provokes the present paper.The present paper proposes an organized method to synthesize diverse underwater images,which can function as a benchmark dataset.The present synthesis is based on the underwater image formation model,which describes the physical degradation process.The indoor RGB-D image dataset is used as the seed for underwater style image generation.The ambient light is simulated based on the statistical mean value of real-world underwater images.Attenuation coefficients for diverse water types are carefully selected.Finally,in total 14490 underwater images of 10 water types are synthesized.Based on the synthesized database,state-of-the-art image enhancement methods are appropriately evaluated.Besides,the large diverse underwater image database is beneficial in the development of learning-based methods.

Research on the Application of Super Resolution Reconstruction Algorithm for Underwater Image

Underwater imaging is widely used in ocean,river and lake exploration,but it is affected by properties of water and the optics.In order to solve the lower-resolution underwater image formed by the influence of water and light,the image super-resolution reconstruction technique is applied to the underwater image processing.This paper addresses the problem of generating super-resolution underwater images by convolutional neural network framework technology.We research the degradation model of underwater images,and analyze the lower-resolution factors of underwater images in different situations,and compare different traditional super-resolution image reconstruction algorithms.We further show that the algorithm of super-resolution using deep convolution networks(SRCNN)which applied to super-resolution underwater images achieves good results.

Underwater image enhancement by maximum-likelihood based adaptive color correction and robust scattering removal

Underwater images often exhibit severe color deviations and degraded visibility,which limits many practical applications in ocean engineering.Although extensive research has been conducted into underwater image enhancement,little of which demonstrates the significant robustness and generalization for diverse real-world underwater scenes.In this paper,we propose an adaptive color correction algorithm based on the maximum likelihood estimation of Gaussian parameters,which effectively removes color casts of a variety of underwater images.A novel algorithm using weighted combination of gradient maps in HSV color space and absolute difference of intensity for accurate background light estimation is proposed,which circumvents the influence of white or bright regions that challenges existing physical model-based methods.To enhance contrast of resultant images,a piece-wise affine transform is applied to the transmission map estimated via background light differential.Finally,with the estimated background light and transmission map,the scene radiance is recovered by addressing an inverse problem of image formation model.Extensive experiments reveal that our results are characterized by natural appearance and genuine color,and our method achieves competitive performance with the state-of-the-art methods in terms of objective evaluation metrics,which further validates the better robustness and higher generalization ability of our enhancement model.

Underwater image quality enhancement of sea cucumbers based on improved histogram equalization and wavelet transform

Sea cucumbers usually live in an environment where lighting and visibility are generally not controllable,which cause the underwater image of sea cucumbers to be distorted,blurred,and severely attenuated.Therefore,the valuable information from such an image cannot be fully extracted for further processing.To solve the problems mentioned above and improve the quality of the underwater images of sea cucumbers,pre-processing of a sea cucumber image is attracting increasing interest.This paper presents a newmethod based on contrast limited adaptive histogram equalization and wavelet transform(CLAHE-WT)to enhance the sea cucumber image quality.CLAHE was used to process the underwater image for increasing contrast based on the Rayleigh distribution,and WTwas used for de-noising based on a soft threshold.Qualitative analysis indicated that the proposed method exhibited better performance in enhancing the quality and retaining the image details.For quantitative analysis,the test with 120 underwater images showed that for the proposed method,the mean square error(MSE),peak signal to noise ratio(PSNR),and entropy were 49.2098,13.3909,and 6.6815,respectively.The proposed method outperformed three established methods in enhancing the visual quality of sea cucumber underwater gray image.

Classical and state-of-the-art approaches for underwater image defogging: a comprehensive survey

In underwater scenes,the quality of the video and image acquired by the underwater imaging system suffers from severe degradation,influencing target detection and recognition.Thus,restoring real scenes from blurred videos and images is of great significance.Owing to the light absorption and scattering by suspended particles,the images acquired often have poor visibility,including color shift,low contrast,noise,and blurring issues.This paper aims to classify and compare some of the significant technologies in underwater image defogging,presenting a comprehensive picture of the current research landscape for researchers.First we analyze the reasons for degradation of underwater images and the underwater optical imaging model.Then we classify the underwater image defogging technologies into three categories,including image restoration approaches,image enhancement approaches,and deep learning approaches.Afterward,we present the objective evaluation metrics and analyze the state-of-the-art approaches.Finally,we summarize the shortcomings of the defogging approaches for underwater images and propose seven research directions.

UnderwaterWaste Recognition and Localization Based on Improved YOLOv5

With the continuous development of the economy and society,plastic pollution in rivers,lakes,oceans,and other bodies of water is increasingly severe,posing a serious challenge to underwater ecosystems.Effective cleaning up of underwater litter by robots relies on accurately identifying and locating the plastic waste.However,it often causes significant challenges such as noise interference,low contrast,and blurred textures in underwater optical images.A weighted fusion-based algorithm for enhancing the quality of underwater images is proposed,which combines weighted logarithmic transformations,adaptive gamma correction,improved multi-scale Retinex(MSR)algorithm,and the contrast limited adaptive histogram equalization(CLAHE)algorithm.The proposed algorithm improves brightness,contrast,and color recovery and enhances detail features resulting in better overall image quality.A network framework is proposed in this article based on the YOLOv5 model.MobileViT is used as the backbone of the network framework,detection layer is added to improve the detection capability for small targets,self-attention and mixed-attention modules are introduced to enhance the recognition capability of important features.The cross stage partial(CSP)structure is employed in the spatial pyramid pooling(SPP)section to enrich feature information,and the complete intersection over union(CIOU)loss is replaced with the focal efficient intersection over union(EIOU)loss to accelerate convergence while improving regression accuracy.Experimental results proved that the target recognition algorithm achieved a recognition accuracy of 0.913 and ensured a recognition speed of 45.56 fps/s.Subsequently,Using red,green,blue and depth(RGB-D)camera to construct a system for identifying and locating underwater plastic waste.Experiments were conducted underwater for recognition,localization,and error analysis.The experimental results demonstrate the effectiveness of the proposed method for identifying and locating underwater plastic waste,and it has good localization accuracy.

Turbidity-adaptive underwater image enhancement method using image fusion

Clear,correct imaging is a prerequisite for underwater operations.In real freshwater environment including rivers and lakes,the water bodies are usually turbid and dynamic,which brings extra troubles to quality of imaging due to color deviation and suspended particulate.Most of the existing underwater imaging methods focus on relatively clear underwater environment,it is uncertain that if those methods can work well in turbid and dynamic underwater environments.In this paper,we propose a turbidity-adaptive underwater image enhancement method.To deal with attenuation and scattering of varying degree,the turbidity is detected by the histogram of images.Based on the detection result,different image enhancement strategies are designed to deal with the problem of color deviation and blurring.The proposed method is verified by an underwater image dataset captured in real underwater environment.The result is evaluated by image metrics including structure similarity index measure,underwater color image quality evaluation metric,and speeded-up robust features.Test results exhibit that the method can correct the color deviation and improve the quality of underwater images.

Underwater Terrain Image Stitching Based on Spatial Gradient Feature Block

At present,underwater terrain images are all strip-shaped small fragment images preprocessed by the side-scan sonar imaging system.However,the processed underwater terrain images have inconspicuous and few feature points.In order to better realize the stitching of underwater terrain images and solve the problems of slow traditional image stitching speed,we proposed an improved algorithm for underwater terrain image stitching based on spatial gradient feature block.First,the spatial gradient fuzzy C-Means algorithm is used to divide the underwater terrain image into feature blocks with the fusion of spatial gradient information.The accelerated-KAZE(AKAZE)algorithm is used to combine the feature block information to match the reference image and the target image.Then,the random sample consensus(RANSAC)is applied to optimize the matching results.Finally,image fusion is performed with the global homography and the optimal seam-line method to improve the accuracy of image overlay fusion.The experimental results show that the proposed method in this paper effectively divides images into feature blocks by combining spatial information and gradient information,which not only solves the problem of stitching failure of underwater terrain images due to unobvious features,and further reduces the sensitivity to noise,but also effectively reduces the iterative calculation in the feature point matching process of the traditional method,and improves the stitching speed.Ghosting and shape warping are significantly eliminated by re-optimizing the overlap of the image.

Underwater Diver Image Enhancement via Dual-Guided Filtering

The scattering and absorption of light propagating underwater cause the underwater images to present lowcontrast,color deviation,and loss of details,which in turn make human posture recognition challenging.To address these issues,this study introduced the dual-guided filtering technique and developed an underwater diver image improvement method.First,the color distortion of the underwater diver image was solved using white balance technology to obtain a color-corrected image.Second,dual-guided filtering was applied to the white balanced image to correct the distorted color and enhance its details.Four feature weight maps of the two images were then calculated,and two normalizedweightmapswere constructed formulti-scale fusion using normalization.To better preserve the obtained image details,the fusion image was histogram-stretched to obtain the final enhanced result.The experimental results validated that this method has improved the accuracy of underwater human posture recognition.

Deep Neural Network Driven Automated Underwater Object Detection

Object recognition and computer vision techniques for automated object identification are attracting marine biologist’s interest as a quicker and easier tool for estimating the fish abundance in marine environments.However,the biggest problem posed by unrestricted aquatic imaging is low luminance,turbidity,background ambiguity,and context camouflage,which make traditional approaches rely on their efficiency due to inaccurate detection or elevated false-positive rates.To address these challenges,we suggest a systemic approach to merge visual features and Gaussian mixture models with You Only Look Once(YOLOv3)deep network,a coherent strategy for recognizing fish in challenging underwater images.As an image restoration phase,pre-processing based on diffraction correction is primarily applied to frames.The YOLOv3 based object recognition system is used to identify fish occurrences.The objects in the background that are camouflaged are often overlooked by the YOLOv3 model.A proposed Bi-dimensional Empirical Mode Decomposition(BEMD)algorithm,adapted by Gaussian mixture models,and integrating the results of YOLOv3 improves detection efficiency of the proposed automated underwater object detection method.The proposed approach was tested on four challenging video datasets,the Life Cross Language Evaluation Forum(CLEF)benchmark from the F4K data repository,the University of Western Australia(UWA)dataset,the bubble vision dataset and theDeepFish dataset.The accuracy for fish identification is 98.5 percent,96.77 percent,97.99 percent and 95.3 percent respectively for the various datasets which demonstrate the feasibility of our proposed automated underwater object detection method.

Image Processing of Manganese Nodules Based on Background Gray Value Calculation

To troubleshoot two problems arising from the segmentation of manganese nodule images-uneven illumination and morphological defects caused by white sand coverage,we propose,with reference to features of manganese nodules,a method called“background gray value calculation”.As the result of the image procession with the aid this method,the two problems above are solved eventually,together with acquisition of a segmentable image of manganese nodules.As a result,its comparison with other segmentation methods justifies its feasibility and stability.Judging from simulation results,it is indicated that this method is applicable to repair the target shape in the image,and segment the manganese nodule image in a short time.Also,it could be used to synchronously process a large number of manganese nodules on different conditions in an image,laying a good foundation for automatic underwater manganese nodule survey.Even if the target in the image is slightly distorted,the statistical data of manganese nodules are still accurate.Moreover,other methods cannot be fully applied to the segmentation of manganese nodule images;in another word,the effectiveness and stability of this method are proved.

Polarimetric Laser Range-Gated Underwater Imaging

For conventional laser range-gated underwater imaging （RG[） systems, the target image is obtained based oil the reflective character of the target. One of the main performance limiting factors of conventional RGI is that, when the underwater target has the same reflectivity as the background, it is difficult to distinguish the target from the background. An improvement is to use the polarization components of the reflected light. On the basis of conventional RGI, we propose a polarimetric RGI system that employs a polarization generator and a polarization analyzer to detect and recognize underwater objects. Experimental results demonstrate that, by combining polarization with intensity information, we are better able to enhance identification of the underwater target from other objects of the same reflectivity.

Restoring Polarization Angle Map for High- Fidelity Underwater Imaging

Obtaining polarization information enables researchers to enhance underwater imaging quality by removing backscattering effect and to distinguish targets of different materials.However,due to the simplified assumption of unpolarized target light,most of the existing underwater polari-metric methods lose part of the polarization information,resulting in degraded imaging quality.In this work,a novel underwater polarimetric method is reported,which obtains the angle of polariza-tion(AOP)map to improve imaging quality.Specifically,the Stokes vectors were exploited to re-move the backscattering effect by obtaining two pairs of orthogonal polarization sub-images of the underwater scene.The target reflected light and the angle between the polarization directions of the target reflected light and the backscattered light were computed through the two groups of the or-thogonal polarized sub-images.The AOP map of the target light could be derived from the Stokes vectors.Then,the transmission map of the target light was estimated by using the non-local color priorly combined with the properties of light propagating underwater.Experiments show that the reported technique enables distinguishing different targets when the colors are similar.The quantit-ative metrics validate that the reported technique produces state-of-the-art performance for under-water imaging.

Hydrophobic long-chain two-dimensional perovskite scintillators for underwater X-ray imaging

The underwater X-ray imaging technology development is significant to subaqueous target reconnaissance/detection/identification, subfluvial archaeology,submerged resource exploration, etc. As the core of X-ray imaging detection, the scintillator has been plagued by inherent moisture absorption and decomposition, and strict requirements for seamless packaging and waterproofing.Here, we designed a manganese-doped two-dimensional(2D) perovskite scintillator modified by hydrophobic longchain organic amine through the combination of component and doping engineering. The modified perovskites show high water repellency that can be used as an underwater X-ray scintillator. X-ray images of aquatic organisms or other objects with a high spatial resolution of10 lp·mm^(-1) at a big view field(32 mm × 32 mm) were obtained by scintillation screen. This hydrophobic perovskite scintillator based on molecular design is of great promise in underwater X-ray nondestructive testing technology development.

SIMULATION STUDY OF IMAGING OF UNDERWATER BOTTOM TOPOGRAPHY BY SYNTHETIC APERTURE RADAR

Interaction between current and underwater bottom topography modulates roughness of the sea surface, which in turn yields variation of the radar scattering echo. By using the mechanism, this paper presents a simulation model for Synthetic Aperture Radar (SAR) imaging of underwater bottom topography. The numerical simulations experiments were made using the Princeton Ocean Model (POM) and analytical expression theory of SAR Image in Mischief sea area. It is concluded that the SAR image is better visual when water depth of underwater bottom topography is shallow or gradient of underwater bottom topography is high.