Estimation-free spatial-domain image reconstruction of structured illumination microscopy

Structured illumination microscopy(SIM)achieves super-resolution(SR)by modulating the high-frequency information of the sample into the passband of the optical system and subsequent image reconstruction.The traditional Wiener-filtering-based reconstruction algorithm operates in the Fourier domain,it requires prior knowledge of the sinusoidal illumination patterns which makes the time-consuming procedure of parameter estimation to raw datasets necessary,besides,the parameter estimation is sensitive to noise or aberration-induced pattern distortion which leads to reconstruction artifacts.Here,we propose a spatial-domain image reconstruction method that does not require parameter estimation but calculates patterns from raw datasets,and a reconstructed image can be obtained just by calculating the spatial covariance of differential calculated patterns and differential filtered datasets(the notch filtering operation is performed to the raw datasets for attenuating and compensating the optical transfer function(OTF)).Experiments on reconstructing raw datasets including nonbiological,biological,and simulated samples demonstrate that our method has SR capability,high reconstruction speed,and high robustness to aberration and noise.

Sequential quadratic programming-based non-cooperative target distributed hybrid processing optimization method

The distributed hybrid processing optimization problem of non-cooperative targets is an important research direction for future networked air-defense and anti-missile firepower systems. In this paper, the air-defense anti-missile targets defense problem is abstracted as a nonconvex constrained combinatorial optimization problem with the optimization objective of maximizing the degree of contribution of the processing scheme to non-cooperative targets, and the constraints mainly consider geographical conditions and anti-missile equipment resources. The grid discretization concept is used to partition the defense area into network nodes, and the overall defense strategy scheme is described as a nonlinear programming problem to solve the minimum defense cost within the maximum defense capability of the defense system network. In the solution of the minimum defense cost problem, the processing scheme, equipment coverage capability, constraints and node cost requirements are characterized, then a nonlinear mathematical model of the non-cooperative target distributed hybrid processing optimization problem is established, and a local optimal solution based on the sequential quadratic programming algorithm is constructed, and the optimal firepower processing scheme is given by using the sequential quadratic programming method containing non-convex quadratic equations and inequality constraints. Finally, the effectiveness of the proposed method is verified by simulation examples.

Speckle structured illumination endoscopy with enhanced resolution at wide field of view and depth of field

Structured illumination microscopy(SIM)is one of the most widely applied wide field super resolution imaging techniques with high temporal resolution and low phototoxicity.The spatial resolution of SIM is typically limited to two times of the diffraction limit and the depth of field is small.In this work,we propose and experimentally demonstrate a low cost,easy to implement,novel technique called speckle structured illumination endoscopy(SSIE)to enhance the resolution of a wide field endoscope with large depth of field.Here,speckle patterns are used to excite objects on the sample which is then followed by a blind-SIM algorithm for super resolution image reconstruction.Our approach is insensitive to the 3D morphology of the specimen,or the deformation of illuminations used.It greatly simplifies the experimental setup as there are no calibration protocols and no stringent control of illumination patterns nor focusing optics.We demonstrate that the SSIE can enhance the resolution 2–4.5 times that of a standard white light endoscopic(WLE)system.The SSIE presents a unique route to super resolution in endoscopic imaging at wide field of view and depth of field,which might be beneficial to the practice of clinical endoscopy.

Comparison of point detection and area detection for point-scanning structured illumination microscopy

Structured illumination microscopy(SIM)is suitable for biological samples because of its relatively low-peak illumination intensity requirement and high imaging speed.The system resolution is affected by two typical detection modes:Point detection and area detection.However,a systematic analysis of the imaging performance of the different detection modes of the system has rarely been conducted.In this study,we compared laser point scanning point detection(PS-PD)and point scanning area detection(PS-AD)imaging in nonconfocal microscopy through theoretical analysis and simulated imaging.The results revealed that the imaging resolutions of PSPD and PS-AD depend on excitation and emission point spread functions(PSFs),respectively.Especially,we combined the second harmonic generation(SHG)of point detection(P-SHG)and area detection(A-SHG)with SIM to realize a nonlinear SIM-imaging technique that improves the imaging resolution.Moreover,we analytically and experimentally compared the nonlinear SIM performance of P-SHG with that of A-SHG.

Non-Cooperative Game of Coordinated Scheduling of Parallel Machine Production and Transportation in Shared Manufacturing

Given the challenges of manufacturing resource sharing and competition in the modern manufacturing industry,the coordinated scheduling problem of parallel machine production and transportation is investigated.The problem takes into account the coordination of production and transportation before production as well as the disparities in machine spatial position and performance.A non-cooperative game model is established,considering the competition and self-interest behavior of jobs from different customers for machine resources.The job from different customers is mapped to the players in the game model,the corresponding optional processing machine and location are mapped to the strategy set,and the makespan of the job is mapped to the payoff.Then the solution of the scheduling model is transformed into the Nash equilibrium of the non-cooperative game model.A Nash equilibrium solution algorithm based on the genetic algorithm(NEGA)is designed,and the effective solution of approximate Nash equilibrium for the game model is realized.The fitness function,single-point crossover operator,and mutation operator are derived from the non-cooperative game model’s characteristics and the definition of Nash equilibrium.Rules are also designed to avoid the generation of invalid offspring chromosomes.The effectiveness of the proposed algorithm is demonstrated through numerical experiments of various sizes.Compared with other algorithms such as heuristic algorithms(FCFS,SPT,and LPT),the simulated annealing algorithm(SA),and the particle swarm optimization algorithm(PSO),experimental results show that the proposed NE-GA algorithm has obvious performance advantages.

Coordinated Scheduling of Two-Agent Production and Transportation Based on Non-Cooperative Game

A two-agent production and transportation coordinated scheduling problem in a single-machine environment is suggested to compete for one machine from different downstream production links or various consumers.The jobs of two agents compete for the processing position on a machine,and after the pro-cessed,they compete for the transport position on a transport vehicle to be trans-ported to two agents.The two agents have different objective functions.The objective function of the first agent is the sum of the makespan and the total trans-portation time,whereas the objective function of the second agent is the sum of the total completion time and the total transportation time.Given the competition between two agents for machine resources and transportation resources,a non-cooperative game model with agents as game players is established.The job pro-cessing position and transportation position corresponding to the two agents are mapped as strategies,and the corresponding objective function is the utility func-tion.To solve the game model,an approximate Nash equilibrium solution algo-rithm based on an improved genetic algorithm(NE-IGA)is proposed.The genetic operation based on processing sequence and transportation sequence,as well as the fitness function based on Nash equilibrium definition,are designed based on the features of the two-agent production and transportation coordination scheduling problem.The effectiveness of the proposed algorithm is demonstrated through numerical experiments of various sizes.When compared to heuristic rules such as the Longest Processing Time first(LPT)and the Shortest Processing Time first(SPT),the objective function values of the two agents are reduced by 4.3%and 2.6% on average.

Compact and robust dual-color linearly polarized illumination source for three-photon fluorescence imaging

The miniaturized femtosecond laser in near infrared-Ⅱregion is the core equipment of threephoton microscopy.In this paper,we design a compact and robust illumination source that emits dual-color linearly polarized light for three-photon microscopy.Based on an all-polarizationmaintaining passive mode-locked fiber laser,we shift the center wavelength of the pulses to the 1.7m band utilizing cascade Raman effect,thereby generate dual-wavelength pulses.To enhance clarity,the two wavelengths are separated through the graded-index multimode fiber.Then we obtain the dual-pulse sequences with 1639.4 nm and 1683.7 nm wavelengths,920 fs pulse duration,and 23.75 MHz pulse repetition rate.The average power of the signal is 53.64mW,corresponding to a single pulse energy of 2.25 nJ.This illumination source can be further amplified and compressed for three-photon fluorescence imaging,especially dual-color three-photon fluorescence imaging,making it an ideal option for biomedical applications.

Complex-amplitude Fourier single-pixel imaging via coherent structured illumination

We propose a method of complex-amplitude Fourier single-pixel imaging(CFSI)with coherent structured illumination to acquire both the amplitude and phase of an object.In the proposed method,an object is illustrated by a series of coherent structured light fields,which are generated by a phase-only spatial light modulator,the complex Fourier spectrum of the object can be acquired sequentially by a single-pixel photodetector.Then the desired complex-amplitude image can be retrieved directly by applying an inverse Fourier transform.We experimentally implemented this CFSI with several different types of objects.The experimental results show that the proposed method provides a promising complex-amplitude imaging approach with high quality and a stable configuration.Thus,it might find broad applications in optical metrology and biomedical science.

Non-Cooperative Behavior Management in Large-Scale Group Decision-Making Considering the Altruistic Behaviors of Experts and Its Application in Emergency Alternative Selection

Emergency decision-making problems usually involve many experts with different professional backgrounds and concerns,leading to non-cooperative behaviors during the consensus-reaching process.Many studies on noncooperative behavior management assumed that the maximumdegree of cooperation of experts is to totally accept the revisions suggested by the moderator,which restricted individuals with altruistic behaviors to make more contributions in the agreement-reaching process.In addition,when grouping a large group into subgroups by clustering methods,existing studies were based on the similarity of evaluation values or trust relationships among experts separately but did not consider them simultaneously.In this study,we introduce a clustering method considering the similarity of evaluation values and the trust relations of experts and then develop a consensusmodel taking into account the altruistic behaviors of experts.First,we cluster experts into subgroups by a constrained Kmeans clustering algorithm according to the opinion similarity and trust relationship of experts.Then,we calculate the weights of experts and clusters based on the centrality degrees of experts.Next,to enhance the quality of consensus reaching,we identify three kinds of non-cooperative behaviors and propose corresponding feedback mechanisms relying on the altruistic behaviors of experts.A numerical example is given to show the effectiveness and practicality of the proposed method in emergency decision-making.The study finds that integrating altruistic behavior analysis in group decision-making can safeguard the interests of experts and ensure the integrity of decision-making information.

Peer-to-Peer Energy Trading Method of Multi-Virtual Power Plants Based on Non-Cooperative Game

The current electricity market fails to consider the energy consumption characteristics of transaction subjects such as virtual power plants.Besides,the game relationship between transaction subjects needs to be further explored.This paper proposes a Peer-to-Peer energy trading method for multi-virtual power plants based on a non-cooperative game.Firstly,a coordinated control model of public buildings is incorporated into the scheduling framework of the virtual power plant,considering the energy consumption characteristics of users.Secondly,the utility functions of multiple virtual power plants are analyzed,and a non-cooperative game model is established to explore the game relationship between electricity sellers in the Peer-to-Peer transaction process.Finally,the influence of user energy consumption characteristics on the virtual power plant operation and the Peer-to-Peer transaction process is analyzed by case studies.Furthermore,the effect of different parameters on the Nash equilibrium point is explored,and the influence factors of Peer-to-Peer transactions between virtual power plants are summarized.According to the obtained results,compared with the central air conditioning set as constant temperature control strategy,the flexible control strategy proposed in this paper improves the market power of each VPP and the overall revenue of the VPPs.In addition,the upper limit of the service quotation of the market operator have a great impact on the transaction mode of VPPs.When the service quotation decreases gradually,the P2P transaction between VPPs is more likely to occur.

Radial Basis Approximations Based BEMD for Enhancement of Non-Uniform Illumination Images

An image can be degraded due to many environmental factors like foggy or hazy weather,low light conditions,extra light conditions etc.Image captured under the poor light conditions is generally known as non-uniform illumination image.Non-uniform illumination hides some important information present in an image during the image capture Also,it degrades the visual quality of image which generates the need for enhancement of such images.Various techniques have been present in literature for the enhancement of such type of images.In this paper,a novel architecture has been proposed for enhancement of poor illumination images which uses radial basis approximations based BEMD(Bi-dimensional Empirical Mode Decomposition).The enhancement algorithm is applied on intensity and saturation components of image.Firstly,intensity component has been decomposed into various bi-dimensional intrinsic mode function and residue by using sifting algorithm.Secondly,some linear transformations techniques have been applied on various bidimensional intrinsic modes obtained and residue and further on joining the transformed modes with residue,enhanced intensity component is obtained.Saturation part of an image is then enhanced in accordance to the enhanced intensity component.Final enhanced image can be obtained by joining the hue,enhanced intensity and enhanced saturation parts of the given image.The proposed algorithm will not only give the visual pleasant image but maintains the naturalness of image also.

Efficacy and safety of Usights UC100 illuminated microcatheter in microcatheter-assisted trabeculotomy

AIM:To evaluate the efficacy and safety of Usights UC100 illuminated microcatheter in microcatheter-assisted trabeculotomy(MAT).METHODS:Totally 10 eyes of 10 patients with primary open angle glaucoma(POAG)who underwent MAT facilitated by Usights UC100(5 eyes)or iTrack(5 eyes)were reviewed.The success of this surgery was defined as intraocular pressure(IOP)<22 mm Hg with>30%reduction,without oral glaucoma medications,or additional glaucoma surgery.RESULTS:The mean pre-operative IOP was 25.38±10.22 mm Hg in the Usights UC100 group and 19.98±3.87 mm Hg in the iTrack group.MAT was achieved in all eyes in both groups.The success rates for the Usights UC100 group and iTrack groups were in all and 4 eyes,respectively.Both microcatheters produced a statistically significant reduction in IOP,and eyes using Usights UC100 achieved a lower IOP than the iTrack group at 3mo followup(12.58±1.52 and 14.84±1.89 mm Hg,respectively),but no statistical significance was there.No severe side effects were observed in either group.CONCLUSION:MAT using Usights UC100 or iTrack both achieve significant pressure reduction in cases of POAG,and Usights UC100 is as safe as iTrack.

DECREASING PITTING SUSCEPTIBILITY OF PASSIVE FILMS ON X70 PIPELINE STEEL IN NaCl SOLUTIONS BY ILLUMINATION

The influence of UV illumination on passivity and pitting susceptibility on X70 pipoeline steel in a borate buffer （pH=8.4 ） solution containing NaCl is described. It is observed that illumination of the sample leads to a decrease in its pitting susceptibility as indicated by pitting potential and incubation time measurements in chloride containing electrolytes. This effect is strongly dependent on the applied potential during passivation. The electronic properties of the passive films on X70 steel were studied by Mott-Schottky analysis and photocurrent transient measurements. The results indicated that illumination during passivation led to modifications in the electronic properties of the passive films, mainly to a decrease of the bulk doping and an increase in the surface state density. The cause for the decrease in the pitting susceptibility is preliminary explained in terms of such modifications of the passive flm.

Adaptive illumination light source for online machine vision inspection of tin steel strips

The different reflection characteristics of the surface of tin steel strips and the different speeds of the tinning line demand an adaptive illumination light source for online machine vision inspection. This light source can be integrated with a time delay integration charge-coupled device （TDI CCD ） to capture the images of moving objects and facilitate inspection of the surface quality of tin steel strips. On-site application show the effectiveness of the TDI camera with the adaptive illumination light source in detecting the surface defects on tin steel strips of three different materials and with different tin coating weights.

Frequency-Hopping Frequency Reconnaissance and Prediction for Non-cooperative Communication Network

The continuous change of communica-tion frequency brings difficulties to the reconnaissance and prediction of non-cooperative communication net-works.Since the frequency-hopping(FH)sequence is usually generated by a certain model with certain regularity,the FH frequency is thus predictable.In this paper,we investigate the FH frequency reconnais-sance and prediction of a non-cooperative communi-cation network by effective FH signal detection,time-frequency(TF)analysis,wavelet detection and fre-quency estimation.With the intercepted massive FH signal data,long short-term memory(LSTM)neural network model is constructed for FH frequency pre-diction.Simulation results show that our parameter es-timation methods could estimate frequency accurately in the presence of certain noise.Moreover,the LSTM-based scheme can effectively predict FH frequency and frequency interval.

Gaussian Mixture Models for Human Face Recognition under Illumination Variations

The appearance of a face is severely altered by illumination conditions that makes automatic face recognition a challenging task. In this paper we propose a Gaussian Mixture Models (GMM)-based human face identification technique built in the Fourier or frequency domain that is robust to illumination changes and does not require “illumination normalization” (removal of illumination effects) prior to application unlike many existing methods. The importance of the Fourier domain phase in human face identification is a well-established fact in signal processing. A maximum a posteriori (or, MAP) estimate based on the posterior likelihood is used to perform identification, achieving misclassification error rates as low as 2% on a database that contains images of 65 individuals under 21 different illumination conditions. Furthermore, a misclassification rate of 3.5% is observed on the Yale database with 10 people and 64 different illumination conditions. Both these sets of results are significantly better than those obtained from traditional PCA and LDA classifiers. Statistical analysis pertaining to model selection is also presented.

A DNN based trajectory optimization method for intercepting non-cooperative maneuvering spacecraft

Current successes in artificial intelligence domain have revitalized interest in neural networks and demonstrated their potential in solving spacecraft trajectory optimization problems. This paper presents a data-free deep neural network(DNN) based trajectory optimization method for intercepting noncooperative maneuvering spacecraft, in a continuous low-thrust scenario. Firstly, the problem is formulated as a standard constrained optimization problem through differential game theory and minimax principle. Secondly, a new DNN is designed to integrate interception dynamic model into the network and involve it in the process of gradient descent, which makes the network endowed with the knowledge of physical constraints and reduces the learning burden of the network. Thus, a DNN based method is proposed, which completely eliminates the demand of training datasets and improves the generalization capacity. Finally, numerical results demonstrate the feasibility and efficiency of our proposed method.

Impedance control of multi-arm space robot for the capture of non-cooperative targets

Robotic systems are expected to play an increasingly important role in future space activities. The robotic on-orbital service, whose key is the capturing technology, becomes a research hot spot in recent years. This paper studies the dynamics modeling and impedance control of a multi-arm free-flying space robotic system capturing a non-cooperative target. Firstly, a control-oriented dynamics model is essential in control algorithm design and code realization. Unlike a numerical algorithm, an analytical approach is suggested. Using a general and a quasi-coordinate Lagrangian formulation, the kinematics and dynamics equations are derived.Then, an impedance control algorithm is developed which allows coordinated control of the multiple manipulators to capture a target.Through enforcing a reference impedance, end-effectors behave like a mass-damper-spring system fixed in inertial space in reaction to any contact force between the capture hands and the target. Meanwhile, the position and the attitude of the base are maintained stably by using gas jet thrusters to work against the manipulators' reaction. Finally, a simulation by using a space robot with two manipulators and a free-floating non-cooperative target is illustrated to verify the effectiveness of the proposed method.

Nonlinear scanning structured illumination microscopy based on nonsinusoidal modulation

Structured illumination microscopy(SIM)is an essential super-resolution microscopy technique that enhances resolution.Several images are required to reconstruct a super-resolution image.However,linear SIM resolution enhancement can only increase the spatial resolution of micros-copy by a factor of two at most because the frequency of the structured illumination pattern is limited by the cutoff frequency of the excitation point spread function.The frequency of the pattern generated by the nonlinear response in samples is not limited;therefore,nonlinear SIM(NL-SIM),in theory,has no inherent limit to the resolution.In the present study,we describe a two-photon nonlinear SIM(2P-SIM)technique using a multiple harmonics scanning pattern that employs a composite structured illumination pattern,which can produce a higher order harmonic pattern based on the fluorescence nonlinear response in a 2P process.The theoretical models of super-resolution imaging were established through our simulation,which describes the working mechanism of the multi-frequency structure of the nonsinusoidal function to improve the reso-lution.The simulation results predict that a 5-fold improvement in resolution in the 2P-SIM is possible.

Design of a Non-cooperative Target Capture Mechanism

A passive compliant non-cooperative target capture mechanism is designed to maintain the non-cooperative target on-orbit. When the relative position between capture mechanism and satellite is confirmed,a pair of four-bar linkages lock the docking ring,which is used for connecting the satellite and the rocket. The mathematical model of capture mechanism and capture space is built by the Denavit-Hartenberg(D-H)method,and the torque of each joint is analyzed by the Lagrange dynamic equation. Besides,the capture condition and the torque of every joint under different capture conditions are analyzed by simulation in MSC. Adams. The results indicate that the mechanism can capture the non-cooperative target satellite in a wide range. During the process of capture,the passive compliant mechanism at the bottom can increase capture space,thereby reducing the difficulty and enhance stability of the capture.