The intelligent detection technology driven by X-ray images and deep learning represents the forefront of advanced techniques and development trends in flaw detection and automated evaluation of light alloy castings.H...The intelligent detection technology driven by X-ray images and deep learning represents the forefront of advanced techniques and development trends in flaw detection and automated evaluation of light alloy castings.However,the efficacy of deep learning models hinges upon a substantial abundance of flaw samples.The existing research on X-ray image augmentation for flaw detection suffers from shortcomings such as poor diversity of flaw samples and low reliability of quality evaluation.To this end,a novel approach was put forward,which involves the creation of the Interpolation-Deep Convolutional Generative Adversarial Network(I-DCGAN)for flaw detection image generation and a comprehensive evaluation algorithm named TOPSIS-IFP.I-DCGAN enables the generation of high-resolution,diverse simulated images with multiple appearances,achieving an improvement in sample diversity and quality while maintaining a relatively lower computational complexity.TOPSIS-IFP facilitates multi-dimensional quality evaluation,including aspects such as diversity,authenticity,image distribution difference,and image distortion degree.The results indicate that the X-ray radiographic images of magnesium and aluminum alloy castings achieve optimal performance when trained up to the 800th and 600th epochs,respectively.The TOPSIS-IFP value reaches 78.7%and 73.8%similarity to the ideal solution,respectively.Compared to single index evaluation,the TOPSIS-IFP algorithm achieves higher-quality simulated images at the optimal training epoch.This approach successfully mitigates the issue of unreliable quality associated with single index evaluation.The image generation and comprehensive quality evaluation method developed in this paper provides a novel approach for image augmentation in flaw recognition,holding significant importance for enhancing the robustness of subsequent flaw recognition networks.展开更多
In this paper,an unsupervised change detection technique for remote sensing images acquired on the same geographical area but at different time instances is proposed by conducting Covariance Intersection(CI) to perfor...In this paper,an unsupervised change detection technique for remote sensing images acquired on the same geographical area but at different time instances is proposed by conducting Covariance Intersection(CI) to perform unsupervised fusion of the final fuzzy partition matrices from the Fuzzy C-Means(FCM) clustering for the feature space by applying compressed sampling to the given remote sensing images.The proposed approach exploits a CI-based data fusion of the membership function matrices,which are obtained by taking the Fuzzy C-Means(FCM) clustering of the frequency-domain feature vectors and spatial-domain feature vectors,aimed at enhancing the unsupervised change detection performance.Compressed sampling is performed to realize the image local feature sampling,which is a signal acquisition framework based on the revelation that a small collection of linear projections of a sparse signal contains enough information for stable recovery.The experimental results demonstrate that the proposed algorithm has a good change detection results and also performs quite well on denoising purpose.展开更多
We propose a novel image segmentation algorithm to tackle the challenge of limited recognition and segmentation performance in identifying welding seam images during robotic intelligent operations.Initially,to enhance...We propose a novel image segmentation algorithm to tackle the challenge of limited recognition and segmentation performance in identifying welding seam images during robotic intelligent operations.Initially,to enhance the capability of deep neural networks in extracting geometric attributes from depth images,we developed a novel deep geometric convolution operator(DGConv).DGConv is utilized to construct a deep local geometric feature extraction module,facilitating a more comprehensive exploration of the intrinsic geometric information within depth images.Secondly,we integrate the newly proposed deep geometric feature module with the Fully Convolutional Network(FCN8)to establish a high-performance deep neural network algorithm tailored for depth image segmentation.Concurrently,we enhance the FCN8 detection head by separating the segmentation and classification processes.This enhancement significantly boosts the network’s overall detection capability.Thirdly,for a comprehensive assessment of our proposed algorithm and its applicability in real-world industrial settings,we curated a line-scan image dataset featuring weld seams.This dataset,named the Standardized Linear Depth Profile(SLDP)dataset,was collected from actual industrial sites where autonomous robots are in operation.Ultimately,we conducted experiments utilizing the SLDP dataset,achieving an average accuracy of 92.7%.Our proposed approach exhibited a remarkable performance improvement over the prior method on the identical dataset.Moreover,we have successfully deployed the proposed algorithm in genuine industrial environments,fulfilling the prerequisites of unmanned robot operations.展开更多
Copy-Move Forgery Detection(CMFD)is a technique that is designed to identify image tampering and locate suspicious areas.However,the practicality of the CMFD is impeded by the scarcity of datasets,inadequate quality a...Copy-Move Forgery Detection(CMFD)is a technique that is designed to identify image tampering and locate suspicious areas.However,the practicality of the CMFD is impeded by the scarcity of datasets,inadequate quality and quantity,and a narrow range of applicable tasks.These limitations significantly restrict the capacity and applicability of CMFD.To overcome the limitations of existing methods,a novel solution called IMTNet is proposed for CMFD by employing a feature decoupling approach.Firstly,this study formulates the objective task and network relationship as an optimization problem using transfer learning.Furthermore,it thoroughly discusses and analyzes the relationship between CMFD and deep network architecture by employing ResNet-50 during the optimization solving phase.Secondly,a quantitative comparison between fine-tuning and feature decoupling is conducted to evaluate the degree of similarity between the image classification and CMFD domains by the enhanced ResNet-50.Finally,suspicious regions are localized using a feature pyramid network with bottom-up path augmentation.Experimental results demonstrate that IMTNet achieves faster convergence,shorter training times,and favorable generalization performance compared to existingmethods.Moreover,it is shown that IMTNet significantly outperforms fine-tuning based approaches in terms of accuracy and F_(1).展开更多
Unmanned aerial vehicles(UAVs)have been widely used in military,medical,wireless communications,aerial surveillance,etc.One key topic involving UAVs is pose estimation in autonomous navigation.A standard procedure for...Unmanned aerial vehicles(UAVs)have been widely used in military,medical,wireless communications,aerial surveillance,etc.One key topic involving UAVs is pose estimation in autonomous navigation.A standard procedure for this process is to combine inertial navigation system sensor information with the global navigation satellite system(GNSS)signal.However,some factors can interfere with the GNSS signal,such as ionospheric scintillation,jamming,or spoofing.One alternative method to avoid using the GNSS signal is to apply an image processing approach by matching UAV images with georeferenced images.But a high effort is required for image edge extraction.Here a support vector regression(SVR)model is proposed to reduce this computational load and processing time.The dynamic partial reconfiguration(DPR)of part of the SVR datapath is implemented to accelerate the process,reduce the area,and analyze its granularity by increasing the grain size of the reconfigurable region.Results show that the implementation in hardware is 68 times faster than that in software.This architecture with DPR also facilitates the low power consumption of 4 mW,leading to a reduction of 57%than that without DPR.This is also the lowest power consumption in current machine learning hardware implementations.Besides,the circuitry area is 41 times smaller.SVR with Gaussian kernel shows a success rate of 99.18%and minimum square error of 0.0146 for testing with the planning trajectory.This system is useful for adaptive applications where the user/designer can modify/reconfigure the hardware layout during its application,thus contributing to lower power consumption,smaller hardware area,and shorter execution time.展开更多
A novel algorithm for image edge detection is presented. This algorithm combines the nonsubsampled contourlet transform and the mathematical morphology. First, the source image is decomposed by the nonsubsampled conto...A novel algorithm for image edge detection is presented. This algorithm combines the nonsubsampled contourlet transform and the mathematical morphology. First, the source image is decomposed by the nonsubsampled contourlet transform into multi-scale and multi-directional subbands. Then the edges in the high-frequency and low-frequency sub-bands are respectively extracted by the dualthreshold modulus maxima method and the mathematical morphology operator. Finally, the edges from the high- frequency and low-frequency sub-bands are integrated to the edges of the source image, which are refined, and isolated points are excluded to achieve the edges of the source image. The simulation results show that the proposed algorithm can effectively suppress noise, eliminate pseudo-edges and overcome the adverse effects caused by uneven illumination to a certain extent. Compared with the traditional methods such as LoG, Sobel, and Carmy operators and the modulus maxima algorithm, the proposed method can maintain sufficient positioning accuracy and edge details, and it can also make an improvement in the completeness, smoothness and clearness of the outline.展开更多
This paper proposes a digital image processing-based detection algorithm for cross joint traces of coal roadway heading face.Initially,the acquired images were preprocessed,i.e.,adaptive correction was conducted for n...This paper proposes a digital image processing-based detection algorithm for cross joint traces of coal roadway heading face.Initially,the acquired images were preprocessed,i.e.,adaptive correction was conducted for non-uniform illumination images based on the 2D gamma function.The edge detection algorithm was then applied to extract the edges of the structural plane,followed by the filtration of the non-structural plane noises.Moreover,the Hough transform algorithm was applied to extract the linear edges;finally,the edges were locally connected in accordance with the angle and distance criteria.The experimental results show that this algorithm can be used to reduce the noise caused by non-uniform illumination and avoid the mutual interference of multi-scale edges,so as to effectively extract the traces of the cross joint.Furthermore,Q-system and rock mass rating(RMR),were applied to conduct a quantitative evaluation on the stand-up time of unsupported roof in the four test images.The Q-system quality scores are 26.7,43.3,3.1,and 6.7,and the RMR quality scores are 56.84,58.73,48.42,and 51.42,respectively.The stand-up time of unsupported roofs with a span of 4.6 m are 30,36,7.7 and 14 d,respectively.展开更多
Aiming at the parameter detection of the circumferential equispaced curves,and on the background of the rifling parameter detection, a panoramic image based detectiontechnique is proposed, which employs the panoramic ...Aiming at the parameter detection of the circumferential equispaced curves,and on the background of the rifling parameter detection, a panoramic image based detectiontechnique is proposed, which employs the panoramic image photographed by a tamper reflector and aCCD camera to detect the parameter of the circumferential equispaced curves. The effect of thesystem's off-center error, deflection error and pixel error on the parameter detection is analyzed,which shows that this technique make a good use of the property of the circumferential equispaced,and has a high power of anti off-center error and anti deflection error, resulting a high precisionat the parameter measurement on circumferential equispaced curves.展开更多
The“memory wall”of traditional von Neumann computing systems severely restricts the efficiency of data-intensive task execution,while in-memory computing(IMC)architecture is a promising approach to breaking the bott...The“memory wall”of traditional von Neumann computing systems severely restricts the efficiency of data-intensive task execution,while in-memory computing(IMC)architecture is a promising approach to breaking the bottleneck.Although variations and instability in ultra-scaled memory cells seriously degrade the calculation accuracy in IMC architectures,stochastic computing(SC)can compensate for these shortcomings due to its low sensitivity to cell disturbances.Furthermore,massive parallel computing can be processed to improve the speed and efficiency of the system.In this paper,by designing logic functions in NOR flash arrays,SC in IMC for the image edge detection is realized,demonstrating ultra-low computational complexity and power consumption(25.5 fJ/pixel at 2-bit sequence length).More impressively,the noise immunity is 6 times higher than that of the traditional binary method,showing good tolerances to cell variation and reliability degradation when implementing massive parallel computation in the array.展开更多
Oil spills pose a major threat to ocean ecosystems and their health. Synthetic aperture radar(SAR) sensors can detect oil spills on the sea surface. These oil spills appear as dark spots in SAR images. However, dark...Oil spills pose a major threat to ocean ecosystems and their health. Synthetic aperture radar(SAR) sensors can detect oil spills on the sea surface. These oil spills appear as dark spots in SAR images. However, dark formations can be caused by a number of phenomena. It is aimed to distinguishing oil spills or look-alike objects. A novel method based on a bidimensional empirical mode decomposition is proposed. The selected dark formations are first decomposed into several bidimensional intrinsic mode functions and the residue. Subsequently, 64 dimension feature sets are calculated using the Hilbert spectral analysis and five new features are extracted with a relief algorithm. Mahalanobis distances are then used for classification. Three data sets containing oil spills or look-alikes are used to test the accuracy rate of the method. The accuracy rate is more than 90%. The experimental results demonstrate that the novel method can detect oil spills validly and accurately.展开更多
Copy-Move Forgery(CMF) is one of the simple and effective operations to create forged digital images.Recently,techniques based on Scale Invariant Features Transform(SIFT) are widely used to detect CMF.Various approach...Copy-Move Forgery(CMF) is one of the simple and effective operations to create forged digital images.Recently,techniques based on Scale Invariant Features Transform(SIFT) are widely used to detect CMF.Various approaches under the SIFT-based framework are the most acceptable ways to CMF detection due to their robust performance.However,for some CMF images,these approaches cannot produce satisfactory detection results.For instance,the number of the matched keypoints may be too less to prove an image to be a CMF image or to generate an accurate result.Sometimes these approaches may even produce error results.According to our observations,one of the reasons is that detection results produced by the SIFT-based framework depend highly on parameters whose values are often determined with experiences.These values are only applicable to a few images,which limits their application.To solve the problem,a novel approach named as CMF Detection with Particle Swarm Optimization(CMFDPSO) is proposed in this paper.CMFD-PSO integrates the Particle Swarm Optimization(PSO) algorithm into the SIFT-based framework.It utilizes the PSO algorithm to generate customized parameter values for images,which are used for CMF detection under the SIFT-based framework.Experimental results show that CMFD-PSO has good performance.展开更多
In order to overcome the disadvantages of low accuracy rate, high complexity and poor robustness to image noise in many traditional algorithms of cloud image detection, this paper proposed a novel algorithm on the bas...In order to overcome the disadvantages of low accuracy rate, high complexity and poor robustness to image noise in many traditional algorithms of cloud image detection, this paper proposed a novel algorithm on the basis of Markov Random Field (MRF) modeling. This paper first defined algorithm model and derived the core factors affecting the performance of the algorithm, and then, the solving of this algorithm was obtained by the use of Belief Propagation (BP) algorithm and Iterated Conditional Modes (ICM) algorithm. Finally, experiments indicate that this algorithm for the cloud image detection has higher average accuracy rate which is about 98.76% and the average result can also reach 96.92% for different type of image noise.展开更多
A real-time pedestrian detection and tracking system using a single video camera was developed to monitor pedestrians. This system contained six modules: video flow capture, pre-processing, movement detection, shadow ...A real-time pedestrian detection and tracking system using a single video camera was developed to monitor pedestrians. This system contained six modules: video flow capture, pre-processing, movement detection, shadow removal, tracking, and object classification. The Gaussian mixture model was utilized to extract the moving object from an image sequence segmented by the mean-shift technique in the pre-processing module. Shadow removal was used to alleviate the negative impact of the shadow to the detected objects. A model-free method was adopted to identify pedestrians. The maximum and minimum integration methods were developed to integrate multiple cues into the mean-shift algorithm and the initial tracking iteration with the competent integrated probability distribution map for object tracking. A simple but effective algorithm was proposed to handle full occlusion cases. The system was tested using real traffic videos from different sites. The results of the test confirm that the system is reliable and has an overall accuracy of over 85%.展开更多
This paper presents a robust filter called the quaternion Hardy filter(QHF)for color image edge detection.The QHF can be capable of color edge feature enhancement and noise resistance.QHF can be used flexibly by selec...This paper presents a robust filter called the quaternion Hardy filter(QHF)for color image edge detection.The QHF can be capable of color edge feature enhancement and noise resistance.QHF can be used flexibly by selecting suitable parameters to handle different levels of noise.In particular,the quaternion analytic signal,which is an effective tool in color image processing,can also be produced by quaternion Hardy filtering with specific parameters.Based on the QHF and the improved Di Zenzo gradient operator,a novel color edge detection algorithm is proposed;importantly,it can be efficiently implemented by using the fast discrete quaternion Fourier transform technique.From the experimental results,we conclude that the minimum PSNR improvement rate is 2.3%and the minimum SSIM improvement rate is 30.2%on the CSEE database.The experiments demonstrate that the proposed algorithm outperforms several widely used algorithms.展开更多
Image inpainting based on deep learning has been greatly improved.The original purpose of image inpainting was to repair some broken photos, suchas inpainting artifacts. However, it may also be used for malicious oper...Image inpainting based on deep learning has been greatly improved.The original purpose of image inpainting was to repair some broken photos, suchas inpainting artifacts. However, it may also be used for malicious operations,such as destroying evidence. Therefore, detection and localization of imageinpainting operations are essential. Recent research shows that high-pass filteringfull convolutional network (HPFCN) is applied to image inpainting detection andachieves good results. However, those methods did not consider the spatial location and channel information of the feature map. To solve these shortcomings, weintroduce the squeezed excitation blocks (SE) and propose a high-pass filter attention full convolutional network (HPACN). In feature extraction, we apply concurrent spatial and channel attention (scSE) to enhance feature extraction and obtainmore information. Channel attention (cSE) is introduced in upsampling toenhance detection and localization. The experimental results show that the proposed method can achieve improvement on ImageNet.展开更多
A new method for image edge detection based on a pulse neural network is proposed in this paper. The network is locally connected. The external input of each neuron of the network is gray value of the corresponding pi...A new method for image edge detection based on a pulse neural network is proposed in this paper. The network is locally connected. The external input of each neuron of the network is gray value of the corresponding pixel. The synchrony of the neuron and its neighbors is detected by detection neurons. The edge of the image can be read off at minima of the total activity of the detection neurons.展开更多
Metamaterials(MTM)can enhance the properties of microwaves and also exceed some limitations of devices used in technical practice.Note that the antenna is the element for realizing a microwave imaging(MWI)system since...Metamaterials(MTM)can enhance the properties of microwaves and also exceed some limitations of devices used in technical practice.Note that the antenna is the element for realizing a microwave imaging(MWI)system since it is where signal transmission and absorption occur.Ultra-Wideband(UWB)antenna superstrates with MTM elements to ensure the signal transmitted from the antenna reaches the tumor and is absorbed by the same antenna.The lack of conventional head imaging techniques,for instance,Magnetic Resonance Imaging(MRI)and Computerized Tomography(CT)-scan,has been demonstrated in the paper focusing on the point of failure of these techniques for prompt diagnosis and portable systems.Furthermore,the importance ofMWIhas been addressed elaborately to portray its effectiveness and aptness for a primary tumor diagnosis.Other than that,MTM element designs have been discussed thoroughly based on their performances towards the contributions to the better image resolution of MWI with detailed reasonings.This paper proposes the novel design of a Zeroindex Split RingResonator(SRR)MTMelement superstrate with a UWB antenna implemented in MWI systems for detecting tumor.The novel design of the MTM enables the realization of a high gain of a superstrate UWB antenna with the highest gain of 5.70 dB.Besides that,the MTM imitates the conduct of the zeroreflection phase on the resonance frequency,which does not exist.An antenna with an MTM unit is of a 7×4 and 10×5 Zero-index SRR MTM element that acts as a superstrate plane to the antenna.Apart from that,Rogers(RT5880)substrate material is employed to fabricate the designed MTM unit cell,with the following characteristics:0.51mm thickness,the loss tangent of 0.02,as well as the relative permittivity of 2.2,with Computer Simulation Technology(CST)performing the simulation and design.Both MTM unit cells of 7×4 and 10×5 attained 0°with respect to the reflection phase at the 2.70 GHz frequency band.The first design,MTM Antenna Design 1,consists of a 7×4 MTM unit cell that observed a rise of 5.70 dB with a return loss(S11)−20.007 dB at 2.70 GHz frequency.The second design,MTM Antenna Design 2,consists of 10×5 MTM unit cells that recorded a gain of 5.66 dB,having the return loss(S11)−19.734 dB at 2.70 GHz frequency.Comparing these two MTM elements superstrates with the antenna,one can notice that the 7×4 MTM element shape has a low number of the unit cell with high gain and is a better choice than the 10×5 MTM element in realizing MTM element superstrates antenna for MWI.展开更多
A primary study on Processing in X - ray inspection of spot weld for aluminum alloy spot welding,in- cluding for background simulation,acquisition of ideal binary image, and extraction and identifi- cation of defec...A primary study on Processing in X - ray inspection of spot weld for aluminum alloy spot welding,in- cluding for background simulation,acquisition of ideal binary image, and extraction and identifi- cation of defect features was presented.展开更多
Increasingly advanced image processing technology has made digital image editing easier and easier.With image processing software at one’s fingertips,one can easily alter the content of an image,and the altered image...Increasingly advanced image processing technology has made digital image editing easier and easier.With image processing software at one’s fingertips,one can easily alter the content of an image,and the altered image is so realistic that it is illegible to the naked eye.These tampered images have posed a serious threat to personal privacy,social order,and national security.Therefore,detecting and locating tampered areas in images has important practical significance,and has become an important research topic in the field of multimedia information security.In recent years,deep learning technology has been widely used in image tampering localization,and the achieved performance has significantly surpassed traditional tampering forensics methods.This paper mainly sorts out the relevant knowledge and latest methods in the field of image tampering detection based on deep learning.According to the two types of tampering detection based on deep learning,the detection tasks of the method are detailed separately,and the problems and future prospects in this field are discussed.It is quite different from the existing work:(1)This paper mainly focuses on the problem of image tampering detection,so it does not elaborate on various forensic methods.(2)This paper focuses on the detectionmethod of image tampering based on deep learning.(3)This paper is driven by the needs of tampering targets,so it pays more attention to sorting out methods for different tampering detection tasks.展开更多
With the popularization of high-performance electronic imaging equipment and the wide application of digital image editing software,the threshold of digital image editing becomes lower and lower.Thismakes it easy to t...With the popularization of high-performance electronic imaging equipment and the wide application of digital image editing software,the threshold of digital image editing becomes lower and lower.Thismakes it easy to trick the human visual system with professionally altered images.These tampered images have brought serious threats to many fields,including personal privacy,news communication,judicial evidence collection,information security and so on.Therefore,the security and reliability of digital information has been increasingly concerned by the international community.In this paper,digital image tamper detection methods are classified according to the clues that they rely on,detection methods based on image content and detection methods based on double JPEG compression traces.This paper analyzes and discusses the important algorithms in several classification methods,and summarizes the problems existing in various methods.Finally,this paper predicts the future development trend of tamper detection.展开更多
基金funded by the National Key R&D Program of China(2020YFB1710100)the National Natural Science Foundation of China(Nos.52275337,52090042,51905188).
文摘The intelligent detection technology driven by X-ray images and deep learning represents the forefront of advanced techniques and development trends in flaw detection and automated evaluation of light alloy castings.However,the efficacy of deep learning models hinges upon a substantial abundance of flaw samples.The existing research on X-ray image augmentation for flaw detection suffers from shortcomings such as poor diversity of flaw samples and low reliability of quality evaluation.To this end,a novel approach was put forward,which involves the creation of the Interpolation-Deep Convolutional Generative Adversarial Network(I-DCGAN)for flaw detection image generation and a comprehensive evaluation algorithm named TOPSIS-IFP.I-DCGAN enables the generation of high-resolution,diverse simulated images with multiple appearances,achieving an improvement in sample diversity and quality while maintaining a relatively lower computational complexity.TOPSIS-IFP facilitates multi-dimensional quality evaluation,including aspects such as diversity,authenticity,image distribution difference,and image distortion degree.The results indicate that the X-ray radiographic images of magnesium and aluminum alloy castings achieve optimal performance when trained up to the 800th and 600th epochs,respectively.The TOPSIS-IFP value reaches 78.7%and 73.8%similarity to the ideal solution,respectively.Compared to single index evaluation,the TOPSIS-IFP algorithm achieves higher-quality simulated images at the optimal training epoch.This approach successfully mitigates the issue of unreliable quality associated with single index evaluation.The image generation and comprehensive quality evaluation method developed in this paper provides a novel approach for image augmentation in flaw recognition,holding significant importance for enhancing the robustness of subsequent flaw recognition networks.
基金Supported by the National Natural Science Foundation of China(No.61071163)
文摘In this paper,an unsupervised change detection technique for remote sensing images acquired on the same geographical area but at different time instances is proposed by conducting Covariance Intersection(CI) to perform unsupervised fusion of the final fuzzy partition matrices from the Fuzzy C-Means(FCM) clustering for the feature space by applying compressed sampling to the given remote sensing images.The proposed approach exploits a CI-based data fusion of the membership function matrices,which are obtained by taking the Fuzzy C-Means(FCM) clustering of the frequency-domain feature vectors and spatial-domain feature vectors,aimed at enhancing the unsupervised change detection performance.Compressed sampling is performed to realize the image local feature sampling,which is a signal acquisition framework based on the revelation that a small collection of linear projections of a sparse signal contains enough information for stable recovery.The experimental results demonstrate that the proposed algorithm has a good change detection results and also performs quite well on denoising purpose.
基金This work was supported by the National Natural Science Foundation of China(Grant No.U20A20197).
文摘We propose a novel image segmentation algorithm to tackle the challenge of limited recognition and segmentation performance in identifying welding seam images during robotic intelligent operations.Initially,to enhance the capability of deep neural networks in extracting geometric attributes from depth images,we developed a novel deep geometric convolution operator(DGConv).DGConv is utilized to construct a deep local geometric feature extraction module,facilitating a more comprehensive exploration of the intrinsic geometric information within depth images.Secondly,we integrate the newly proposed deep geometric feature module with the Fully Convolutional Network(FCN8)to establish a high-performance deep neural network algorithm tailored for depth image segmentation.Concurrently,we enhance the FCN8 detection head by separating the segmentation and classification processes.This enhancement significantly boosts the network’s overall detection capability.Thirdly,for a comprehensive assessment of our proposed algorithm and its applicability in real-world industrial settings,we curated a line-scan image dataset featuring weld seams.This dataset,named the Standardized Linear Depth Profile(SLDP)dataset,was collected from actual industrial sites where autonomous robots are in operation.Ultimately,we conducted experiments utilizing the SLDP dataset,achieving an average accuracy of 92.7%.Our proposed approach exhibited a remarkable performance improvement over the prior method on the identical dataset.Moreover,we have successfully deployed the proposed algorithm in genuine industrial environments,fulfilling the prerequisites of unmanned robot operations.
基金supported and founded by the Guizhou Provincial Science and Technology Project under the Grant No.QKH-Basic-ZK[2021]YB311the Youth Science and Technology Talent Growth Project of Guizhou Provincial Education Department under Grant No.QJH-KY-ZK[2021]132+2 种基金the Guizhou Provincial Science and Technology Project under the Grant No.QKH-Basic-ZK[2021]YB319the National Natural Science Foundation of China(NSFC)under Grant 61902085the Key Laboratory Program of Blockchain and Fintech of Department of Education of Guizhou Province(2023-014).
文摘Copy-Move Forgery Detection(CMFD)is a technique that is designed to identify image tampering and locate suspicious areas.However,the practicality of the CMFD is impeded by the scarcity of datasets,inadequate quality and quantity,and a narrow range of applicable tasks.These limitations significantly restrict the capacity and applicability of CMFD.To overcome the limitations of existing methods,a novel solution called IMTNet is proposed for CMFD by employing a feature decoupling approach.Firstly,this study formulates the objective task and network relationship as an optimization problem using transfer learning.Furthermore,it thoroughly discusses and analyzes the relationship between CMFD and deep network architecture by employing ResNet-50 during the optimization solving phase.Secondly,a quantitative comparison between fine-tuning and feature decoupling is conducted to evaluate the degree of similarity between the image classification and CMFD domains by the enhanced ResNet-50.Finally,suspicious regions are localized using a feature pyramid network with bottom-up path augmentation.Experimental results demonstrate that IMTNet achieves faster convergence,shorter training times,and favorable generalization performance compared to existingmethods.Moreover,it is shown that IMTNet significantly outperforms fine-tuning based approaches in terms of accuracy and F_(1).
基金financially supported by the National Council for Scientific and Technological Development(CNPq,Brazil),Swedish-Brazilian Research and Innovation Centre(CISB),and Saab AB under Grant No.CNPq:200053/2022-1the National Council for Scientific and Technological Development(CNPq,Brazil)under Grants No.CNPq:312924/2017-8 and No.CNPq:314660/2020-8.
文摘Unmanned aerial vehicles(UAVs)have been widely used in military,medical,wireless communications,aerial surveillance,etc.One key topic involving UAVs is pose estimation in autonomous navigation.A standard procedure for this process is to combine inertial navigation system sensor information with the global navigation satellite system(GNSS)signal.However,some factors can interfere with the GNSS signal,such as ionospheric scintillation,jamming,or spoofing.One alternative method to avoid using the GNSS signal is to apply an image processing approach by matching UAV images with georeferenced images.But a high effort is required for image edge extraction.Here a support vector regression(SVR)model is proposed to reduce this computational load and processing time.The dynamic partial reconfiguration(DPR)of part of the SVR datapath is implemented to accelerate the process,reduce the area,and analyze its granularity by increasing the grain size of the reconfigurable region.Results show that the implementation in hardware is 68 times faster than that in software.This architecture with DPR also facilitates the low power consumption of 4 mW,leading to a reduction of 57%than that without DPR.This is also the lowest power consumption in current machine learning hardware implementations.Besides,the circuitry area is 41 times smaller.SVR with Gaussian kernel shows a success rate of 99.18%and minimum square error of 0.0146 for testing with the planning trajectory.This system is useful for adaptive applications where the user/designer can modify/reconfigure the hardware layout during its application,thus contributing to lower power consumption,smaller hardware area,and shorter execution time.
基金The National Key Technologies R&D Program during the 12th Five-Year Period of China(No.2012BAJ23B02)Science and Technology Support Program of Jiangsu Province(No.BE2010606)
文摘A novel algorithm for image edge detection is presented. This algorithm combines the nonsubsampled contourlet transform and the mathematical morphology. First, the source image is decomposed by the nonsubsampled contourlet transform into multi-scale and multi-directional subbands. Then the edges in the high-frequency and low-frequency sub-bands are respectively extracted by the dualthreshold modulus maxima method and the mathematical morphology operator. Finally, the edges from the high- frequency and low-frequency sub-bands are integrated to the edges of the source image, which are refined, and isolated points are excluded to achieve the edges of the source image. The simulation results show that the proposed algorithm can effectively suppress noise, eliminate pseudo-edges and overcome the adverse effects caused by uneven illumination to a certain extent. Compared with the traditional methods such as LoG, Sobel, and Carmy operators and the modulus maxima algorithm, the proposed method can maintain sufficient positioning accuracy and edge details, and it can also make an improvement in the completeness, smoothness and clearness of the outline.
基金supported by the National Natural Scieince Foundation of China(Nos.52004204 and 52034007).
文摘This paper proposes a digital image processing-based detection algorithm for cross joint traces of coal roadway heading face.Initially,the acquired images were preprocessed,i.e.,adaptive correction was conducted for non-uniform illumination images based on the 2D gamma function.The edge detection algorithm was then applied to extract the edges of the structural plane,followed by the filtration of the non-structural plane noises.Moreover,the Hough transform algorithm was applied to extract the linear edges;finally,the edges were locally connected in accordance with the angle and distance criteria.The experimental results show that this algorithm can be used to reduce the noise caused by non-uniform illumination and avoid the mutual interference of multi-scale edges,so as to effectively extract the traces of the cross joint.Furthermore,Q-system and rock mass rating(RMR),were applied to conduct a quantitative evaluation on the stand-up time of unsupported roof in the four test images.The Q-system quality scores are 26.7,43.3,3.1,and 6.7,and the RMR quality scores are 56.84,58.73,48.42,and 51.42,respectively.The stand-up time of unsupported roofs with a span of 4.6 m are 30,36,7.7 and 14 d,respectively.
文摘Aiming at the parameter detection of the circumferential equispaced curves,and on the background of the rifling parameter detection, a panoramic image based detectiontechnique is proposed, which employs the panoramic image photographed by a tamper reflector and aCCD camera to detect the parameter of the circumferential equispaced curves. The effect of thesystem's off-center error, deflection error and pixel error on the parameter detection is analyzed,which shows that this technique make a good use of the property of the circumferential equispaced,and has a high power of anti off-center error and anti deflection error, resulting a high precisionat the parameter measurement on circumferential equispaced curves.
基金supported by the National Natural Science Foundation of China(Nos.62034006,91964105,61874068)the China Key Research and Development Program(No.2016YFA0201802)+1 种基金the Natural Science Foundation of Shandong Province(No.ZR2020JQ28)Program of Qilu Young Scholars of Shandong University。
文摘The“memory wall”of traditional von Neumann computing systems severely restricts the efficiency of data-intensive task execution,while in-memory computing(IMC)architecture is a promising approach to breaking the bottleneck.Although variations and instability in ultra-scaled memory cells seriously degrade the calculation accuracy in IMC architectures,stochastic computing(SC)can compensate for these shortcomings due to its low sensitivity to cell disturbances.Furthermore,massive parallel computing can be processed to improve the speed and efficiency of the system.In this paper,by designing logic functions in NOR flash arrays,SC in IMC for the image edge detection is realized,demonstrating ultra-low computational complexity and power consumption(25.5 fJ/pixel at 2-bit sequence length).More impressively,the noise immunity is 6 times higher than that of the traditional binary method,showing good tolerances to cell variation and reliability degradation when implementing massive parallel computation in the array.
基金The National Science and Technology Support Project under contract No.2014BAB12B02the Natural Science Foundation of Liaoning Province under contract No.201602042
文摘Oil spills pose a major threat to ocean ecosystems and their health. Synthetic aperture radar(SAR) sensors can detect oil spills on the sea surface. These oil spills appear as dark spots in SAR images. However, dark formations can be caused by a number of phenomena. It is aimed to distinguishing oil spills or look-alike objects. A novel method based on a bidimensional empirical mode decomposition is proposed. The selected dark formations are first decomposed into several bidimensional intrinsic mode functions and the residue. Subsequently, 64 dimension feature sets are calculated using the Hilbert spectral analysis and five new features are extracted with a relief algorithm. Mahalanobis distances are then used for classification. Three data sets containing oil spills or look-alikes are used to test the accuracy rate of the method. The accuracy rate is more than 90%. The experimental results demonstrate that the novel method can detect oil spills validly and accurately.
基金supported in part by the National Natural Science Foundation of China under grant No.(61472429,61070192,91018008,61303074,61170240)Beijing Natural Science Foundation under grant No.4122041+1 种基金National High-Tech Research Development Program of China under grant No.2007AA01Z414National Science and Technology Major Project of China under grant No.2012ZX01039-004
文摘Copy-Move Forgery(CMF) is one of the simple and effective operations to create forged digital images.Recently,techniques based on Scale Invariant Features Transform(SIFT) are widely used to detect CMF.Various approaches under the SIFT-based framework are the most acceptable ways to CMF detection due to their robust performance.However,for some CMF images,these approaches cannot produce satisfactory detection results.For instance,the number of the matched keypoints may be too less to prove an image to be a CMF image or to generate an accurate result.Sometimes these approaches may even produce error results.According to our observations,one of the reasons is that detection results produced by the SIFT-based framework depend highly on parameters whose values are often determined with experiences.These values are only applicable to a few images,which limits their application.To solve the problem,a novel approach named as CMF Detection with Particle Swarm Optimization(CMFDPSO) is proposed in this paper.CMFD-PSO integrates the Particle Swarm Optimization(PSO) algorithm into the SIFT-based framework.It utilizes the PSO algorithm to generate customized parameter values for images,which are used for CMF detection under the SIFT-based framework.Experimental results show that CMFD-PSO has good performance.
基金Supported by the National Natural Science Foundation of China (No. 61172047)
文摘In order to overcome the disadvantages of low accuracy rate, high complexity and poor robustness to image noise in many traditional algorithms of cloud image detection, this paper proposed a novel algorithm on the basis of Markov Random Field (MRF) modeling. This paper first defined algorithm model and derived the core factors affecting the performance of the algorithm, and then, the solving of this algorithm was obtained by the use of Belief Propagation (BP) algorithm and Iterated Conditional Modes (ICM) algorithm. Finally, experiments indicate that this algorithm for the cloud image detection has higher average accuracy rate which is about 98.76% and the average result can also reach 96.92% for different type of image noise.
基金Project(50778015)supported by the National Natural Science Foundation of ChinaProject(2012CB725403)supported by the Major State Basic Research Development Program of China
文摘A real-time pedestrian detection and tracking system using a single video camera was developed to monitor pedestrians. This system contained six modules: video flow capture, pre-processing, movement detection, shadow removal, tracking, and object classification. The Gaussian mixture model was utilized to extract the moving object from an image sequence segmented by the mean-shift technique in the pre-processing module. Shadow removal was used to alleviate the negative impact of the shadow to the detected objects. A model-free method was adopted to identify pedestrians. The maximum and minimum integration methods were developed to integrate multiple cues into the mean-shift algorithm and the initial tracking iteration with the competent integrated probability distribution map for object tracking. A simple but effective algorithm was proposed to handle full occlusion cases. The system was tested using real traffic videos from different sites. The results of the test confirm that the system is reliable and has an overall accuracy of over 85%.
基金supported in part by the Science and Technology Development Fund,Macao SAR FDCT/085/2018/A2the Guangdong Basic and Applied Basic Research Foundation(2019A1515111185)。
文摘This paper presents a robust filter called the quaternion Hardy filter(QHF)for color image edge detection.The QHF can be capable of color edge feature enhancement and noise resistance.QHF can be used flexibly by selecting suitable parameters to handle different levels of noise.In particular,the quaternion analytic signal,which is an effective tool in color image processing,can also be produced by quaternion Hardy filtering with specific parameters.Based on the QHF and the improved Di Zenzo gradient operator,a novel color edge detection algorithm is proposed;importantly,it can be efficiently implemented by using the fast discrete quaternion Fourier transform technique.From the experimental results,we conclude that the minimum PSNR improvement rate is 2.3%and the minimum SSIM improvement rate is 30.2%on the CSEE database.The experiments demonstrate that the proposed algorithm outperforms several widely used algorithms.
基金supported by the National Natural Science Foundation of China under Grant 62172059,61972057 and 62072055Hunan Provincial Natural Science Foundations of China under Grant 2020JJ4626+1 种基金Scientific Research Fund of Hunan Provincial Education Department of China under Grant 19B004Postgraduate Scientific Research Innovation Project of Hunan Province under Grant CX20210811.
文摘Image inpainting based on deep learning has been greatly improved.The original purpose of image inpainting was to repair some broken photos, suchas inpainting artifacts. However, it may also be used for malicious operations,such as destroying evidence. Therefore, detection and localization of imageinpainting operations are essential. Recent research shows that high-pass filteringfull convolutional network (HPFCN) is applied to image inpainting detection andachieves good results. However, those methods did not consider the spatial location and channel information of the feature map. To solve these shortcomings, weintroduce the squeezed excitation blocks (SE) and propose a high-pass filter attention full convolutional network (HPACN). In feature extraction, we apply concurrent spatial and channel attention (scSE) to enhance feature extraction and obtainmore information. Channel attention (cSE) is introduced in upsampling toenhance detection and localization. The experimental results show that the proposed method can achieve improvement on ImageNet.
文摘A new method for image edge detection based on a pulse neural network is proposed in this paper. The network is locally connected. The external input of each neuron of the network is gray value of the corresponding pixel. The synchrony of the neuron and its neighbors is detected by detection neurons. The edge of the image can be read off at minima of the total activity of the detection neurons.
基金the Fundamental Research Grant Scheme (FRGS/1/2018/ICT06/UNIMAP/02/1)of the Ministry of Higher Education of Malaysia.
文摘Metamaterials(MTM)can enhance the properties of microwaves and also exceed some limitations of devices used in technical practice.Note that the antenna is the element for realizing a microwave imaging(MWI)system since it is where signal transmission and absorption occur.Ultra-Wideband(UWB)antenna superstrates with MTM elements to ensure the signal transmitted from the antenna reaches the tumor and is absorbed by the same antenna.The lack of conventional head imaging techniques,for instance,Magnetic Resonance Imaging(MRI)and Computerized Tomography(CT)-scan,has been demonstrated in the paper focusing on the point of failure of these techniques for prompt diagnosis and portable systems.Furthermore,the importance ofMWIhas been addressed elaborately to portray its effectiveness and aptness for a primary tumor diagnosis.Other than that,MTM element designs have been discussed thoroughly based on their performances towards the contributions to the better image resolution of MWI with detailed reasonings.This paper proposes the novel design of a Zeroindex Split RingResonator(SRR)MTMelement superstrate with a UWB antenna implemented in MWI systems for detecting tumor.The novel design of the MTM enables the realization of a high gain of a superstrate UWB antenna with the highest gain of 5.70 dB.Besides that,the MTM imitates the conduct of the zeroreflection phase on the resonance frequency,which does not exist.An antenna with an MTM unit is of a 7×4 and 10×5 Zero-index SRR MTM element that acts as a superstrate plane to the antenna.Apart from that,Rogers(RT5880)substrate material is employed to fabricate the designed MTM unit cell,with the following characteristics:0.51mm thickness,the loss tangent of 0.02,as well as the relative permittivity of 2.2,with Computer Simulation Technology(CST)performing the simulation and design.Both MTM unit cells of 7×4 and 10×5 attained 0°with respect to the reflection phase at the 2.70 GHz frequency band.The first design,MTM Antenna Design 1,consists of a 7×4 MTM unit cell that observed a rise of 5.70 dB with a return loss(S11)−20.007 dB at 2.70 GHz frequency.The second design,MTM Antenna Design 2,consists of 10×5 MTM unit cells that recorded a gain of 5.66 dB,having the return loss(S11)−19.734 dB at 2.70 GHz frequency.Comparing these two MTM elements superstrates with the antenna,one can notice that the 7×4 MTM element shape has a low number of the unit cell with high gain and is a better choice than the 10×5 MTM element in realizing MTM element superstrates antenna for MWI.
文摘A primary study on Processing in X - ray inspection of spot weld for aluminum alloy spot welding,in- cluding for background simulation,acquisition of ideal binary image, and extraction and identifi- cation of defect features was presented.
基金supported by Key Projects of Innovation and Entrepreneurship Training Program for College Students in Jiangsu Province of China(202210300028Z).
文摘Increasingly advanced image processing technology has made digital image editing easier and easier.With image processing software at one’s fingertips,one can easily alter the content of an image,and the altered image is so realistic that it is illegible to the naked eye.These tampered images have posed a serious threat to personal privacy,social order,and national security.Therefore,detecting and locating tampered areas in images has important practical significance,and has become an important research topic in the field of multimedia information security.In recent years,deep learning technology has been widely used in image tampering localization,and the achieved performance has significantly surpassed traditional tampering forensics methods.This paper mainly sorts out the relevant knowledge and latest methods in the field of image tampering detection based on deep learning.According to the two types of tampering detection based on deep learning,the detection tasks of the method are detailed separately,and the problems and future prospects in this field are discussed.It is quite different from the existing work:(1)This paper mainly focuses on the problem of image tampering detection,so it does not elaborate on various forensic methods.(2)This paper focuses on the detectionmethod of image tampering based on deep learning.(3)This paper is driven by the needs of tampering targets,so it pays more attention to sorting out methods for different tampering detection tasks.
文摘With the popularization of high-performance electronic imaging equipment and the wide application of digital image editing software,the threshold of digital image editing becomes lower and lower.Thismakes it easy to trick the human visual system with professionally altered images.These tampered images have brought serious threats to many fields,including personal privacy,news communication,judicial evidence collection,information security and so on.Therefore,the security and reliability of digital information has been increasingly concerned by the international community.In this paper,digital image tamper detection methods are classified according to the clues that they rely on,detection methods based on image content and detection methods based on double JPEG compression traces.This paper analyzes and discusses the important algorithms in several classification methods,and summarizes the problems existing in various methods.Finally,this paper predicts the future development trend of tamper detection.