Image Motion Compensation of Off-Axis TMA Three-Line ArrayAerospace Mapping Cameras

To enhance the image motion compensation accuracy of off-axis three-mirror anastigmatic( TMA)three-line array aerospace mapping cameras,a new method of image motion velocity field modeling is proposed in this paper. Firstly,based on the imaging principle of mapping cameras,an analytical expression of image motion velocity of off-axis TMA three-line array aerospace mapping cameras is deduced from different coordinate systems we established and the attitude dynamics principle. Then,the case of a three-line array mapping camera is studied,in which the simulation of the focal plane image motion velocity fields of the forward-view camera,the nadir-view camera and the backward-view camera are carried out,and the optimization schemes for image motion velocity matching and drift angle matching are formulated according the simulation results. Finally,this method is verified with a dynamic imaging experimental system. The results are indicative of that when image motion compensation for nadir-view camera is conducted using the proposed image motion velocity field model,the line pair of target images at Nyquist frequency is clear and distinguishable. Under the constraint that modulation transfer function( MTF) reduces by 5%,when the horizontal frequencies of the forward-view camera and the backward-view camera are adjusted uniformly according to the proposed image motion velocity matching scheme,the time delay integration( TDI) stages reach 6 at most. When the TDI stages are more than 6,the three groups of camera will independently undergo horizontal frequency adjustment. However, when the proposed drift angle matching scheme is adopted for uniform drift angle adjustment,the number of TDI stages will not exceed 81. The experimental results have demonstrated the validity and accuracy of the proposed image motion velocity field model and matching optimization scheme,providing reliable basis for on-orbit image motion compensation of aerospace mapping cameras.

A deep Koopman operator-based modelling approach for long-term prediction of dynamics with pixel-level measurements

Although previous studies have made some clear leap in learning latent dynamics from high-dimensional representations,the performances in terms of accuracy and inference time of long-term model prediction still need to be improved.In this study,a deep convolutional network based on the Koopman operator(CKNet)is proposed to model non-linear systems with pixel-level measurements for long-term prediction.CKNet adopts an autoencoder network architecture,consisting of an encoder to generate latent states and a linear dynamical model(i.e.,the Koopman operator)which evolves in the latent state space spanned by the encoder.The decoder is used to recover images from latent states.According to a multi-step ahead prediction loss function,the system matrices for approximating the Koopman operator are trained synchronously with the autoencoder in a mini-batch manner.In this manner,gradients can be synchronously transmitted to both the system matrices and the autoencoder to help the encoder self-adaptively tune the latent state space in the training process,and the resulting model is time-invariant in the latent space.Therefore,the proposed CKNet has the advantages of less inference time and high accuracy for long-term prediction.Experiments are per-formed on OpenAI Gym and Mujoco environments,including two and four non-linear forced dynamical systems with continuous action spaces.The experimental results show that CKNet has strong long-term prediction capabilities with sufficient precision.

Reference-driven method for MR image reconstruction based on wavelet sparsity and nonlocal total variation

A novel reference-driven method for MR image reconstruction based on wavelet sparsity and nonlocal total variation（NLTV）is proposed.Utilizing the sparsity of the difference image between the target image and the motion-compensated reference image in wavelet transform domain,the proposed method does not need to estimate contrast changes and therefore increases computational efficiency.Additionally,NLTV regularization is applied to preserve image details and features without blocky effects.An efficient alternating iterative algorithm is used to estimate motion effects and reconstruct the difference image.Experimental results demonstrate that the proposed method can significantly reduce sampling rate or improve the quality of the reconstructed image alternatively.

Image motion and experimental study of a 0.1″space pointing measuring instrument for micro-vibration conditions

There exists an increasing need for Milli-Arc-Seconds(MAS)accuracy pointing measurement for current and future space systems.To meet the 0.1″space pointing measurement accuracy requirements of spacecraft in future,the influence of spacecraft micro-vibration on a 0.1″Space Pointing Measuring Instrument(SPMI)is studied.A Quasi-Zero Stiffness Device(QZSD)with adaptive adjustment and variable stroke was proposed.Then,a series of micro-vibration experiments of the SPMI were carried out.The influence of the micro-vibration generated by Guidance Navigation Control(GNC)attitude control components under different attitudes on the SPMI was analyzed.Point spread function of image motion in micro-vibration was also derived.Further,the changes of image motion under the micro-vibration environment were evaluated by extracting the gray centroid of the images,and the experiment processes and results are deeply discussed.The results show that the firstorder frequency of the QZSD system is 0.114 Hz,and it is induced by a double pendulum system;the image motion of single flywheel spinning reached 0.015 pixels;whilst the image motion reached 0.03 pixels when three flywheels are combined spinning.These latest findings provide a beneficial theoretical and technical support for the development of spacecraft with 0·1″pointing accuracy.

Double Deep Q-Network Decoder Based on EEG Brain-Computer Interface

Brain-computer interfaces(BCI)use neural activity as a control signal to enable direct communication between the human brain and external devices.The electrical signals generated by the brain are captured through electroencephalogram(EEG)and translated into neural intentions reflecting the user’s behavior.Correct decoding of the neural intentions then facilitates the control of external devices.Reinforcement learning-based BCIs enhance decoders to complete tasks based only on feedback signals(rewards)from the environment,building a general framework for dynamic mapping from neural intentions to actions that adapt to changing environments.However,using traditional reinforcement learning methods can have challenges such as the curse of dimensionality and poor generalization.Therefore,in this paper,we use deep reinforcement learning to construct decoders for the correct decoding of EEG signals,demonstrate its feasibility through experiments,and demonstrate its stronger generalization on motion imaging(MI)EEG data signals with high dynamic characteristics.

Research on time-frequency cross mutual of motor imagination data based on multichannel EEG signal

At present,multi-channel electroencephalogram(EEG)signal acquisition equipment is used to collect motor imagery EEG data,and there is a problem with selecting multiple acquisition channels.Choosing too many channels will result in a large amount of calculation.Components irrelevant to the task will interfere with the required features,which is not conducive to the real-time processing of EEG data.Using too few channels will result in the loss of useful information and low robustness.A method of selecting data channels for motion imagination is proposed based on the time-frequency cross mutual information(TFCMI).This method determines the required data channels in a targeted manner,uses the common spatial pattern mode for feature extraction,and uses support vector ma-chine(SVM)for feature classification.An experiment is designed to collect motor imagery EEG da-ta with four experimenters and adds brain-computer interface(BCI)Competition IV public motor imagery experimental data to verify the method.The data demonstrates that compared with the meth-od of selecting too many or too few data channels,the time-frequency cross mutual information meth-od using motor imagery can improve the recognition accuracy and reduce the amount of calculation.

Self-service Behavior Recognition Algorithm Based on Improved Motion History Image Network

Aiming at the problem of automatic detection of normal operation behavior in self-service business management,with improved motion history image as input,a recognition method of convolutional neural network is proposed to timely judge the occurrence of anomie behavior.Firstly,the key frame sequence was extracted from the self-service operation video based on the method of uniform energy down-sampling.Secondly,combined with the timing information of key frames to adaptively estimate the decay parameters of the motion history image,adding information contrast to generating a logic matrix can improve the calculation speed of the improved motion history image.Finally,the formed motion history image was input into the established convolutional neural network to obtain the class of self-service behavior and distinguish anomie behavior.In real scenarios of self-service baggage check-in for civil aviation passengers,the typical check-in behavior data set is established and tested in actual self-service baggage check-in system of the airport.The results show that the method proposed can effectively identify typical anomie behaviors and has high practical value.

Motion de-blurring by second-order intensity-correlated imaging

For a Hanbury Brown and Twiss system, the influence of relative motion between the object and the detection plane on the resolution of second-order intensity-correlated imaging is investigated. The analytical results, which are backed up by experiments, demonstrate that the amplitude and mode of the object＇s motion have no effect on the second-order intensity-correlated imaging and that high-resolution imaging can be always achieved by using a phase-retrieval method from the diffraction patterns. The use of motion de-blurring imaging for this approach is also discussed.

Evaluation Value of Intravoxel Incoherent Motion Diffusion-Weighted Imaging on Early Efficacy of Magnetic Resonance-Guided High-Intensity Focused Ultrasound Ablation for Uterine Adenomyoma

To investigate the evaluation value of intravoxel incoherent motion diffusion-weighted imaging(IVIM-DWI)on the early efficacy of magnetic resonance-guided high-intensity focused ultrasound(MRgFUS)ablation for uterine adenomyoma.The clinical and magnetic resonance imaging(MRI)data of 36 patients with uterine adenomyoma before and after MRgFUS treatment in our hospital from January 2018 to December 2018 were retrospectively analyzed.All the 36 patients underwent MRI examination one day before operation and immediately after operation using GE Discovery MR7503.0T MRI,including conventional sequences(T1WI,T2WI,and T2 fat suppression sequences)plain scan,IVIM-DWI sequences with 9 b values,and contrast enhanced-MRI sequences.The IVIM-DWI quantitative parameters(true diffusion coefficient D,perfusion related diffusion coefficient D*,and perfusion fraction f)of double-exponential model were obtained by using GE ADW 4.7 functool,a postprocessor.SPSS 24.0 software was used to analyze the difference in parameter between the ablation and non-ablation areas of uterine adenomyoma.DWI signal in the ablation area of uterine adenomyoma was increased,and manifested as heterogeneous diffuse high signal,with low central signal and high edge signal.Values of D,D*and f in the ablation area of uterine adenomyoma were significantly lower than those in the non-ablation area,and there was statistical difference between the two(P<0.05).The areas under receiver operating characteristic(ROC)curve of D,D*and f values in the ablation area of uterine adenomyoma were 0.854,0.898 and 0.924,respectively;the optimal thresholds for the diagnosis of ablation area of uterine adenomyoma were 0.81×10−3 mm2/s,4.99×10−3 mm2/s and 0.24,respectively;the diagnostic sensitivity was 80.6%,72.2%and 94.4%,respectively;and the specificity was 91.7%,97.2%and 94.4%,respectively.IVIM-DWI has a certain clinical value in the evaluation on early efficacy of MRgFUS ablation of uterine adenomyosis.

Coordinate difference homogenization matching method for motion correction in 3D range-intensity correlation laser imaging

This Letter proposes a coordinate difference homogenization matching method to solve motion influence in three-dimensional（3D） range-intensity correlation laser imaging. Firstly, features and feature pairs of gate images are obtained by speeded-up robust figures and bi-directional feature matching methods. The original mean value of the feature-pair coordinate differences is calculated. Comparing the coordinate differences with the original mean value, the wrong feature pairs are removed, and then an optimized mean value is updated. The final feature-pair coordinates are re-registered based on the updated mean value. Thus, an accurate transformation is established to rectify motion gate images for 3D reconstruction. In the experiment, a 3D image of a tower at 780 m is successfully captured by our laser gated imaging system on a pan-tilt device.

Setup and data analysis for functional magnetic resonance imaging of awake cat visual cortex

Functional magnetic resonance imaging（fMRI）is one of the most commonly used methods in cognitive neuroscience on humans.In recent decades,fMRI has also been used in the awake monkey experiments to localize functional brain areas and to compare the functional differences between human and monkey brains.Several procedures and paradigms have been developed to maintain proper head fixation and to perform motion control training.In this study,we extended the application of fMRI to awake cats without training,receiving a flickering checkerboard visual stimulus projected to a screen in front of them in a block-design paradigm.We found that body movement-induced non-rigid motion introduced artifacts into the functional scans,especially those around the eye and neck.To correct for these artifacts,we developed two methods：one for general experimental design,and the other for studies of whether a checkerboard task could be used as a localizer to optimize the motioncorrection parameters.The results demonstrated that,with proper animal fixation and motion correction procedures,it is possible to perform fMRI experiments with untrained awake cats.

Attitude Guidance Algorithms for Agile Satellite Dynamic Imaging

Dynamic imaging modes are increasingly crucial for agile satellites to perform complicated Earth observation tasks.In this study,a direct guidance algorithm is developed to calculate the reference attitude and velocity for dynamic imaging mode from target geolocation information while considering the constraints on both the satellite camera boresight axis and the image motion vector.The two slew angles are determined directly,and no rotation around the boresight or reference vector is required.The proposed approach employs a direct solution instead of the iterative process to obtain the reference attitude,which releases the onboard control system from the intensive computational load.To illustrate the performance of the proposed guidance algorithms,numerical simulation results are presented.