The widespread availability of digital multimedia data has led to a new challenge in digital forensics.Traditional source camera identification algorithms usually rely on various traces in the capturing process.Howeve...The widespread availability of digital multimedia data has led to a new challenge in digital forensics.Traditional source camera identification algorithms usually rely on various traces in the capturing process.However,these traces have become increasingly difficult to extract due to wide availability of various image processing algorithms.Convolutional Neural Networks(CNN)-based algorithms have demonstrated good discriminative capabilities for different brands and even different models of camera devices.However,their performances is not ideal in case of distinguishing between individual devices of the same model,because cameras of the same model typically use the same optical lens,image sensor,and image processing algorithms,that result in minimal overall differences.In this paper,we propose a camera forensics algorithm based on multi-scale feature fusion to address these issues.The proposed algorithm extracts different local features from feature maps of different scales and then fuses them to obtain a comprehensive feature representation.This representation is then fed into a subsequent camera fingerprint classification network.Building upon the Swin-T network,we utilize Transformer Blocks and Graph Convolutional Network(GCN)modules to fuse multi-scale features from different stages of the backbone network.Furthermore,we conduct experiments on established datasets to demonstrate the feasibility and effectiveness of the proposed approach.展开更多
With the diversified development of big data,detection and precision guidance technologies,electromagnetic(EM)functional materials and devices serving multiple spectrums have become a hot topic.Exploring the multispec...With the diversified development of big data,detection and precision guidance technologies,electromagnetic(EM)functional materials and devices serving multiple spectrums have become a hot topic.Exploring the multispectral response of materials is a challenging and meaningful scientific question.In this study,MXene/TiO_(2)hybrids with tunable conduction loss and polarization relaxation are fabricated by in situ atomic reconstruction engineering.More importantly,MXene/TiO_(2)hybrids exhibit adjustable spectral responses in the GHz,infrared and visible spectrums,and several EM devices are constructed based on this.An antenna array provides excellent EM energy harvesting in multiple microwave bands,with|S11|up to−63.2 dB,and can be tuned by the degree of bending.An ultra-wideband bandpass filter realizes a passband of about 5.4 GHz and effectively suppresses the transmission of EM signals in the stopband.An infrared stealth device has an emissivity of less than 0.2 in the infrared spectrum at wavelengths of 6-14μm.This work can provide new inspiration for the design and development of multifunctional,multi-spectrum EM devices.展开更多
An ultrafast framing camera with a pulse-dilation device,a microchannel plate(MCP)imager,and an electronic imaging system were reported.The camera achieved a temporal resolution of 10 ps by using a pulse-dilation devi...An ultrafast framing camera with a pulse-dilation device,a microchannel plate(MCP)imager,and an electronic imaging system were reported.The camera achieved a temporal resolution of 10 ps by using a pulse-dilation device and gated MCP imager,and a spatial resolution of 100μm by using an electronic imaging system comprising combined magnetic lenses.The spatial resolution characteristics of the camera were studied both theoretically and experimentally.The results showed that the camera with combined magnetic lenses reduced the field curvature and acquired a larger working area.A working area with a diameter of 53 mm was created by applying four magnetic lenses to the camera.Furthermore,the camera was used to detect the X-rays produced by the laser-targeting device.The diagnostic results indicated that the width of the X-ray pulse was approximately 18 ps.展开更多
This paper introduces an intelligent computational approach for extracting salient objects fromimages and estimatingtheir distance information with PTZ (Pan-Tilt-Zoom) cameras. PTZ cameras have found wide applications...This paper introduces an intelligent computational approach for extracting salient objects fromimages and estimatingtheir distance information with PTZ (Pan-Tilt-Zoom) cameras. PTZ cameras have found wide applications innumerous public places, serving various purposes such as public securitymanagement, natural disastermonitoring,and crisis alarms, particularly with the rapid development of Artificial Intelligence and global infrastructuralprojects. In this paper, we combine Gauss optical principles with the PTZ camera’s capabilities of horizontal andpitch rotation, as well as optical zoom, to estimate the distance of the object.We present a novel monocular objectdistance estimation model based on the Focal Length-Target Pixel Size (FLTPS) relationship, achieving an accuracyrate of over 95% for objects within a 5 km range. The salient object extraction is achieved through a simplifiedconvolution kernel and the utilization of the object’s RGB features, which offer significantly faster computingspeeds compared to Convolutional Neural Networks (CNNs). Additionally, we introduce the dark channel beforethe fog removal algorithm, resulting in a 20 dB increase in image definition, which significantly benefits distanceestimation. Our system offers the advantages of stability and low device load, making it an asset for public securityaffairs and providing a reference point for future developments in surveillance hardware.展开更多
This paper aims to develop an automatic miscalibration detection and correction framework to maintain accurate calibration of LiDAR and camera for autonomous vehicle after the sensor drift.First,a monitoring algorithm...This paper aims to develop an automatic miscalibration detection and correction framework to maintain accurate calibration of LiDAR and camera for autonomous vehicle after the sensor drift.First,a monitoring algorithm that can continuously detect the miscalibration in each frame is designed,leveraging the rotational motion each individual sensor observes.Then,as sensor drift occurs,the projection constraints between visual feature points and LiDAR 3-D points are used to compute the scaled camera motion,which is further utilized to align the drifted LiDAR scan with the camera image.Finally,the proposed method is sufficiently compared with two representative approaches in the online experiments with varying levels of random drift,then the method is further extended to the offline calibration experiment and is demonstrated by a comparison with two existing benchmark methods.展开更多
The geometric accuracy of topographic mapping with high-resolution remote sensing images is inevita-bly affected by the orbiter attitude jitter.Therefore,it is necessary to conduct preliminary research on the stereo m...The geometric accuracy of topographic mapping with high-resolution remote sensing images is inevita-bly affected by the orbiter attitude jitter.Therefore,it is necessary to conduct preliminary research on the stereo mapping camera equipped on lunar orbiter before launching.In this work,an imaging simulation method consid-ering the attitude jitter is presented.The impact analysis of different attitude jitter on terrain undulation is conduct-ed by simulating jitter at three attitude angles,respectively.The proposed simulation method is based on the rigor-ous sensor model,using the lunar digital elevation model(DEM)and orthoimage as reference data.The orbit and attitude of the lunar stereo mapping camera are simulated while considering the attitude jitter.Two-dimensional simulated stereo images are generated according to the position and attitude of the orbiter in a given orbit.Experi-mental analyses were conducted by the DEM with the simulated stereo image.The simulation imaging results demonstrate that the proposed method can ensure imaging efficiency without losing the accuracy of topographic mapping.The effect of attitude jitter on the stereo mapping accuracy of the simulated images was analyzed through a DEM comparison.展开更多
Real-time indoor camera localization is a significant problem in indoor robot navigation and surveillance systems.The scene can change during the image sequence and plays a vital role in the localization performance o...Real-time indoor camera localization is a significant problem in indoor robot navigation and surveillance systems.The scene can change during the image sequence and plays a vital role in the localization performance of robotic applications in terms of accuracy and speed.This research proposed a real-time indoor camera localization system based on a recurrent neural network that detects scene change during the image sequence.An annotated image dataset trains the proposed system and predicts the camera pose in real-time.The system mainly improved the localization performance of indoor cameras by more accurately predicting the camera pose.It also recognizes the scene changes during the sequence and evaluates the effects of these changes.This system achieved high accuracy and real-time performance.The scene change detection process was performed using visual rhythm and the proposed recurrent deep architecture,which performed camera pose prediction and scene change impact evaluation.Overall,this study proposed a novel real-time localization system for indoor cameras that detects scene changes and shows how they affect localization performance.展开更多
Based on diverse landforms, the correlation between soil organic matter content and multi-spectral band of remote sensing image was analyzed in this pa- per. In addition, the inversion models were built for the soil o...Based on diverse landforms, the correlation between soil organic matter content and multi-spectral band of remote sensing image was analyzed in this pa- per. In addition, the inversion models were built for the soil organic matter content in different landforms. The results showed that the spectral reflectance was nega- tively related to soil organic matter content; linear regression analysis of remove was performed throughout the bands using SPSS. When the inversion models were built based on all the bands, better fitting effect was obtained. The precision of in- version models built based on different landforms was higher than those built re- gardless landforms. Compared with the actual value, the identification level of soil organic matter content was 91 65% under the allowable error was 7%. It indicated that the extraction of soil organic matter with inversion model that was built based on different landforrrs was feasible with higher precision.展开更多
In order to overcome the shortcomings that the reconstructed spectral reflectance may be negative when using the classic principal component analysis (PCA)to reduce the dimensions of the multi-spectral data, a nonne...In order to overcome the shortcomings that the reconstructed spectral reflectance may be negative when using the classic principal component analysis (PCA)to reduce the dimensions of the multi-spectral data, a nonnegative constrained principal component analysis method is proposed to construct a low-dimensional multi-spectral space and accomplish the conversion between the new constructed space and the multispectral space. First, the reason behind the negative data is analyzed and a nonnegative constraint is imposed on the classic PCA. Then a set of nonnegative linear independence weight vectors of principal components is obtained, by which a lowdimensional space is constructed. Finally, a nonlinear optimization technique is used to determine the projection vectors of the high-dimensional multi-spectral data in the constructed space. Experimental results show that the proposed method can keep the reconstructed spectral data in [ 0, 1 ]. The precision of the space created by the proposed method is equivalent to or even higher than that by the PCA.展开更多
[Objective] The aim of this study was to extract effective feature bands of damaged rice leaves by planthoppers to make identification and classification rapidly from great amounts of imaging spectral data. [Method] T...[Objective] The aim of this study was to extract effective feature bands of damaged rice leaves by planthoppers to make identification and classification rapidly from great amounts of imaging spectral data. [Method] The experiment, using multi-spectral imaging system, acquired the multi-spectral images of damaged rice leaves from band 400 to 720 nm by interval of 5 nm. [Result] According to the principle of band index, it was calculated that the bands at 515, 510, 710, 555, 630, 535, 505, 530 and 595 nm were having high band index value with rich information and little correlation. Furthermore, the experiment used two classification methods and calcu-lated the classification accuracy higher than 90.00% for feature bands and ful bands of damaged rice leaves by planthoppers respectively. [Conclusion] It can be con-cluded that these bands can be considered as effective feature bands to identify damaged rice leaves by planthoppers quickly from a large scale of crops.展开更多
Histogram of collinear gradient-enhanced coding (HCGEC), a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detaile...Histogram of collinear gradient-enhanced coding (HCGEC), a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detailed textural information, which is desirable in multi-spectral image matching. Experiments on two multi-spectral data sets demonstrate that the proposed descriptor can yield significantly better results than some state-of- the-art descriptors.展开更多
Image fusion is performed between one band of multi-spectral image and two bands of hyperspectral image to produce fused image with the same spatial resolution as source multi-spectral image and the same spectral reso...Image fusion is performed between one band of multi-spectral image and two bands of hyperspectral image to produce fused image with the same spatial resolution as source multi-spectral image and the same spectral resolution as source hyperspeetral image. According to the characteristics and 3-Dimensional (3-D) feature analysis of multi-spectral and hyperspectral image data volume, the new fusion approach using 3-D wavelet based method is proposed. This approach is composed of four major procedures: Spatial and spectral resampling, 3-D wavelet transform, wavelet coefficient integration and 3-D inverse wavelet transform. Especially, a novel method, Ratio Image Based Spectral Resampling (RIBSR)method, is proposed to accomplish data resampling in spectral domain by utilizing the property of ratio image. And a new fusion rule, Average and Substitution (A&S) rule, is employed as the fusion rule to accomplish wavelet coefficient integration. Experimental results illustrate that the fusion approach using 3-D wavelet transform can utilize both spatial and spectral characteristics of source images more adequately and produce fused image with higher quality and fewer artifacts than fusion approach using 2-D wavelet transform. It is also revealed that RIBSR method is capable of interpolating the missing data more effectively and correctly, and A&S rule can integrate coefficients of source images in 3-D wavelet domain to preserve both spatial and spectral features of source images more properly.展开更多
To monitor growth and predict the yield of rice over a large area, the chlorophyll contents in the rice canopy were estimated using the unmanned aerial vehicle(UAV) remote sensing technology. In this work, multi-spect...To monitor growth and predict the yield of rice over a large area, the chlorophyll contents in the rice canopy were estimated using the unmanned aerial vehicle(UAV) remote sensing technology. In this work, multi-spectral image information of the rice crop was obtained using a 6-channel multi-spectral camera mounted on a fixed wing UAV, which was flown 600 m above the ground, between 11: 00-14: 00 on a sunny day in summer. The measured chlorophyll values were collected as sample sets. The s-REP index was screened out to estimate chlorophyll contents through the analysis of six kinds of spectral indexes of chlorophyll estimated capacity. An inversion model of the chlorophyll contents was then built using the least square support vector regression(LS-SVR)algorithm, with calibration and prediction R-square values of 0.89 and 0.83, respectively. Finally, remote sensing mapping for a UAV image of the Fangzheng County Dexter Rice Planting Park was accomplished using the inversion model. The inversion and measured values were then compared using regression fitting. R-square and root-mean-square error of the fitting model were 0.79 and 2.39,respectively. The results demonstrated that accurate estimation of rice-canopy chlorophyll contents was feasible using the LS-SVR inversion model developed using the s-REP vegetation index.展开更多
Evaluation of the impact of herbicides on maize was done through multi- spectral and multi-modal imaging and multi-spectral fluorescence imaging combined with statistical methods. Spectra containing 13 wavelengths ran...Evaluation of the impact of herbicides on maize was done through multi- spectral and multi-modal imaging and multi-spectral fluorescence imaging combined with statistical methods. Spectra containing 13 wavelengths ranging from 375 nm to 940 nm were derived from multi-spectral images in transmission, reflection and scattering mode and fluorescence images obtained using high-pass filters (F450 nm, F500 nm, F550 nm, F600 nm, F650 nm) on control maize samples and maize samples treated with Herbextra herbicide were used. The appearance of the spectra allowed us to characterize the effect of the herbicide on the maize pigment concentration. The fluorescence images allowed us to track the fate of absorbed energy and through PLS-DA and SVM-DA to discriminate the two leaf categories with very low error rates for the test, i.e. 4.9% and 2% respectively. The results of this technique can be used in the context of precision agriculture.展开更多
基金This work was funded by the National Natural Science Foundation of China(Grant No.62172132)Public Welfare Technology Research Project of Zhejiang Province(Grant No.LGF21F020014)the Opening Project of Key Laboratory of Public Security Information Application Based on Big-Data Architecture,Ministry of Public Security of Zhejiang Police College(Grant No.2021DSJSYS002).
文摘The widespread availability of digital multimedia data has led to a new challenge in digital forensics.Traditional source camera identification algorithms usually rely on various traces in the capturing process.However,these traces have become increasingly difficult to extract due to wide availability of various image processing algorithms.Convolutional Neural Networks(CNN)-based algorithms have demonstrated good discriminative capabilities for different brands and even different models of camera devices.However,their performances is not ideal in case of distinguishing between individual devices of the same model,because cameras of the same model typically use the same optical lens,image sensor,and image processing algorithms,that result in minimal overall differences.In this paper,we propose a camera forensics algorithm based on multi-scale feature fusion to address these issues.The proposed algorithm extracts different local features from feature maps of different scales and then fuses them to obtain a comprehensive feature representation.This representation is then fed into a subsequent camera fingerprint classification network.Building upon the Swin-T network,we utilize Transformer Blocks and Graph Convolutional Network(GCN)modules to fuse multi-scale features from different stages of the backbone network.Furthermore,we conduct experiments on established datasets to demonstrate the feasibility and effectiveness of the proposed approach.
基金supported by the National Natural Science Foundation of China(Grant Nos.52373280,52177014,51977009,52273257).
文摘With the diversified development of big data,detection and precision guidance technologies,electromagnetic(EM)functional materials and devices serving multiple spectrums have become a hot topic.Exploring the multispectral response of materials is a challenging and meaningful scientific question.In this study,MXene/TiO_(2)hybrids with tunable conduction loss and polarization relaxation are fabricated by in situ atomic reconstruction engineering.More importantly,MXene/TiO_(2)hybrids exhibit adjustable spectral responses in the GHz,infrared and visible spectrums,and several EM devices are constructed based on this.An antenna array provides excellent EM energy harvesting in multiple microwave bands,with|S11|up to−63.2 dB,and can be tuned by the degree of bending.An ultra-wideband bandpass filter realizes a passband of about 5.4 GHz and effectively suppresses the transmission of EM signals in the stopband.An infrared stealth device has an emissivity of less than 0.2 in the infrared spectrum at wavelengths of 6-14μm.This work can provide new inspiration for the design and development of multifunctional,multi-spectrum EM devices.
基金National Natural Science Foundation of China(NSFC)(No.11775147)Guangdong Basic and Applied Basic Research Foundation(Nos.2019A1515110130 and 2024A1515011832)+1 种基金Shenzhen Key Laboratory of Photonics and Biophotonics(ZDSYS20210623092006020)Shenzhen Science and Technology Program(Nos.JCYJ20210324095007020,JCYJ20200109105201936 and JCYJ20230808105019039).
文摘An ultrafast framing camera with a pulse-dilation device,a microchannel plate(MCP)imager,and an electronic imaging system were reported.The camera achieved a temporal resolution of 10 ps by using a pulse-dilation device and gated MCP imager,and a spatial resolution of 100μm by using an electronic imaging system comprising combined magnetic lenses.The spatial resolution characteristics of the camera were studied both theoretically and experimentally.The results showed that the camera with combined magnetic lenses reduced the field curvature and acquired a larger working area.A working area with a diameter of 53 mm was created by applying four magnetic lenses to the camera.Furthermore,the camera was used to detect the X-rays produced by the laser-targeting device.The diagnostic results indicated that the width of the X-ray pulse was approximately 18 ps.
基金the Social Development Project of Jiangsu Key R&D Program(BE2022680)the National Natural Science Foundation of China(Nos.62371253,52278119).
文摘This paper introduces an intelligent computational approach for extracting salient objects fromimages and estimatingtheir distance information with PTZ (Pan-Tilt-Zoom) cameras. PTZ cameras have found wide applications innumerous public places, serving various purposes such as public securitymanagement, natural disastermonitoring,and crisis alarms, particularly with the rapid development of Artificial Intelligence and global infrastructuralprojects. In this paper, we combine Gauss optical principles with the PTZ camera’s capabilities of horizontal andpitch rotation, as well as optical zoom, to estimate the distance of the object.We present a novel monocular objectdistance estimation model based on the Focal Length-Target Pixel Size (FLTPS) relationship, achieving an accuracyrate of over 95% for objects within a 5 km range. The salient object extraction is achieved through a simplifiedconvolution kernel and the utilization of the object’s RGB features, which offer significantly faster computingspeeds compared to Convolutional Neural Networks (CNNs). Additionally, we introduce the dark channel beforethe fog removal algorithm, resulting in a 20 dB increase in image definition, which significantly benefits distanceestimation. Our system offers the advantages of stability and low device load, making it an asset for public securityaffairs and providing a reference point for future developments in surveillance hardware.
基金Supported by National Natural Science Foundation of China(Grant Nos.52025121,52394263)National Key R&D Plan of China(Grant No.2023YFD2000301).
文摘This paper aims to develop an automatic miscalibration detection and correction framework to maintain accurate calibration of LiDAR and camera for autonomous vehicle after the sensor drift.First,a monitoring algorithm that can continuously detect the miscalibration in each frame is designed,leveraging the rotational motion each individual sensor observes.Then,as sensor drift occurs,the projection constraints between visual feature points and LiDAR 3-D points are used to compute the scaled camera motion,which is further utilized to align the drifted LiDAR scan with the camera image.Finally,the proposed method is sufficiently compared with two representative approaches in the online experiments with varying levels of random drift,then the method is further extended to the offline calibration experiment and is demonstrated by a comparison with two existing benchmark methods.
基金Supported by the National Natural Science Foundation of China(42221002,42171432)Shanghai Municipal Science and Technology Major Project(2021SHZDZX0100)the Fundamental Research Funds for the Central Universities.
文摘The geometric accuracy of topographic mapping with high-resolution remote sensing images is inevita-bly affected by the orbiter attitude jitter.Therefore,it is necessary to conduct preliminary research on the stereo mapping camera equipped on lunar orbiter before launching.In this work,an imaging simulation method consid-ering the attitude jitter is presented.The impact analysis of different attitude jitter on terrain undulation is conduct-ed by simulating jitter at three attitude angles,respectively.The proposed simulation method is based on the rigor-ous sensor model,using the lunar digital elevation model(DEM)and orthoimage as reference data.The orbit and attitude of the lunar stereo mapping camera are simulated while considering the attitude jitter.Two-dimensional simulated stereo images are generated according to the position and attitude of the orbiter in a given orbit.Experi-mental analyses were conducted by the DEM with the simulated stereo image.The simulation imaging results demonstrate that the proposed method can ensure imaging efficiency without losing the accuracy of topographic mapping.The effect of attitude jitter on the stereo mapping accuracy of the simulated images was analyzed through a DEM comparison.
文摘Real-time indoor camera localization is a significant problem in indoor robot navigation and surveillance systems.The scene can change during the image sequence and plays a vital role in the localization performance of robotic applications in terms of accuracy and speed.This research proposed a real-time indoor camera localization system based on a recurrent neural network that detects scene change during the image sequence.An annotated image dataset trains the proposed system and predicts the camera pose in real-time.The system mainly improved the localization performance of indoor cameras by more accurately predicting the camera pose.It also recognizes the scene changes during the sequence and evaluates the effects of these changes.This system achieved high accuracy and real-time performance.The scene change detection process was performed using visual rhythm and the proposed recurrent deep architecture,which performed camera pose prediction and scene change impact evaluation.Overall,this study proposed a novel real-time localization system for indoor cameras that detects scene changes and shows how they affect localization performance.
文摘Based on diverse landforms, the correlation between soil organic matter content and multi-spectral band of remote sensing image was analyzed in this pa- per. In addition, the inversion models were built for the soil organic matter content in different landforms. The results showed that the spectral reflectance was nega- tively related to soil organic matter content; linear regression analysis of remove was performed throughout the bands using SPSS. When the inversion models were built based on all the bands, better fitting effect was obtained. The precision of in- version models built based on different landforms was higher than those built re- gardless landforms. Compared with the actual value, the identification level of soil organic matter content was 91 65% under the allowable error was 7%. It indicated that the extraction of soil organic matter with inversion model that was built based on different landforrrs was feasible with higher precision.
基金The Pre-Research Foundation of National Ministries andCommissions (No9140A16050109DZ01)the Scientific Research Program of the Education Department of Shanxi Province (No09JK701)
文摘In order to overcome the shortcomings that the reconstructed spectral reflectance may be negative when using the classic principal component analysis (PCA)to reduce the dimensions of the multi-spectral data, a nonnegative constrained principal component analysis method is proposed to construct a low-dimensional multi-spectral space and accomplish the conversion between the new constructed space and the multispectral space. First, the reason behind the negative data is analyzed and a nonnegative constraint is imposed on the classic PCA. Then a set of nonnegative linear independence weight vectors of principal components is obtained, by which a lowdimensional space is constructed. Finally, a nonlinear optimization technique is used to determine the projection vectors of the high-dimensional multi-spectral data in the constructed space. Experimental results show that the proposed method can keep the reconstructed spectral data in [ 0, 1 ]. The precision of the space created by the proposed method is equivalent to or even higher than that by the PCA.
基金Supported by National Natural Science Foundation of China under Grant(No.60968001,61168003)Natural Science Foundation of Yunnan Province under Grant(No.2011FZ079,2009CD047)National Training Programs of Innovation and Entrepreneurship for Undergraduates under Grant(No.201210681005,201310681004)~~
文摘[Objective] The aim of this study was to extract effective feature bands of damaged rice leaves by planthoppers to make identification and classification rapidly from great amounts of imaging spectral data. [Method] The experiment, using multi-spectral imaging system, acquired the multi-spectral images of damaged rice leaves from band 400 to 720 nm by interval of 5 nm. [Result] According to the principle of band index, it was calculated that the bands at 515, 510, 710, 555, 630, 535, 505, 530 and 595 nm were having high band index value with rich information and little correlation. Furthermore, the experiment used two classification methods and calcu-lated the classification accuracy higher than 90.00% for feature bands and ful bands of damaged rice leaves by planthoppers respectively. [Conclusion] It can be con-cluded that these bands can be considered as effective feature bands to identify damaged rice leaves by planthoppers quickly from a large scale of crops.
文摘Histogram of collinear gradient-enhanced coding (HCGEC), a robust key point descriptor for multi-spectral image matching, is proposed. The HCGEC mainly encodes rough structures within an image and suppresses detailed textural information, which is desirable in multi-spectral image matching. Experiments on two multi-spectral data sets demonstrate that the proposed descriptor can yield significantly better results than some state-of- the-art descriptors.
文摘Image fusion is performed between one band of multi-spectral image and two bands of hyperspectral image to produce fused image with the same spatial resolution as source multi-spectral image and the same spectral resolution as source hyperspeetral image. According to the characteristics and 3-Dimensional (3-D) feature analysis of multi-spectral and hyperspectral image data volume, the new fusion approach using 3-D wavelet based method is proposed. This approach is composed of four major procedures: Spatial and spectral resampling, 3-D wavelet transform, wavelet coefficient integration and 3-D inverse wavelet transform. Especially, a novel method, Ratio Image Based Spectral Resampling (RIBSR)method, is proposed to accomplish data resampling in spectral domain by utilizing the property of ratio image. And a new fusion rule, Average and Substitution (A&S) rule, is employed as the fusion rule to accomplish wavelet coefficient integration. Experimental results illustrate that the fusion approach using 3-D wavelet transform can utilize both spatial and spectral characteristics of source images more adequately and produce fused image with higher quality and fewer artifacts than fusion approach using 2-D wavelet transform. It is also revealed that RIBSR method is capable of interpolating the missing data more effectively and correctly, and A&S rule can integrate coefficients of source images in 3-D wavelet domain to preserve both spatial and spectral features of source images more properly.
基金Supported by the National Key R&D Program of China(2016YFD0300610)
文摘To monitor growth and predict the yield of rice over a large area, the chlorophyll contents in the rice canopy were estimated using the unmanned aerial vehicle(UAV) remote sensing technology. In this work, multi-spectral image information of the rice crop was obtained using a 6-channel multi-spectral camera mounted on a fixed wing UAV, which was flown 600 m above the ground, between 11: 00-14: 00 on a sunny day in summer. The measured chlorophyll values were collected as sample sets. The s-REP index was screened out to estimate chlorophyll contents through the analysis of six kinds of spectral indexes of chlorophyll estimated capacity. An inversion model of the chlorophyll contents was then built using the least square support vector regression(LS-SVR)algorithm, with calibration and prediction R-square values of 0.89 and 0.83, respectively. Finally, remote sensing mapping for a UAV image of the Fangzheng County Dexter Rice Planting Park was accomplished using the inversion model. The inversion and measured values were then compared using regression fitting. R-square and root-mean-square error of the fitting model were 0.79 and 2.39,respectively. The results demonstrated that accurate estimation of rice-canopy chlorophyll contents was feasible using the LS-SVR inversion model developed using the s-REP vegetation index.
文摘Evaluation of the impact of herbicides on maize was done through multi- spectral and multi-modal imaging and multi-spectral fluorescence imaging combined with statistical methods. Spectra containing 13 wavelengths ranging from 375 nm to 940 nm were derived from multi-spectral images in transmission, reflection and scattering mode and fluorescence images obtained using high-pass filters (F450 nm, F500 nm, F550 nm, F600 nm, F650 nm) on control maize samples and maize samples treated with Herbextra herbicide were used. The appearance of the spectra allowed us to characterize the effect of the herbicide on the maize pigment concentration. The fluorescence images allowed us to track the fate of absorbed energy and through PLS-DA and SVM-DA to discriminate the two leaf categories with very low error rates for the test, i.e. 4.9% and 2% respectively. The results of this technique can be used in the context of precision agriculture.