Cloud manufacturing is a specific implementation form of the "Internet + manufacturing" strategy. Why and how to develop cloud manufacturing platform(CMP), however, remains the key concern of both platform o...Cloud manufacturing is a specific implementation form of the "Internet + manufacturing" strategy. Why and how to develop cloud manufacturing platform(CMP), however, remains the key concern of both platform operators and users. A microscopic model is proposed to investigate advantages and diffusion forces of CMP through exploration of its diffusion process and mechanism. Specifically, a three-stage basic evolution process of CMP is innovatively proposed. Then, based on this basic process, a more complex CMP evolution model has been established in virtue of complex network theory, with five diffusion forces identified. Thereafter, simulations on CMP diffusion have been conducted. The results indicate that, CMP possesses better resource utilization,user satisfaction, and enterprise utility. Results of simulation on impacts of different diffusion forces show that both the time required for CMP to reach an equilibrium state and the final network size are affected simultaneously by the five diffusion forces. All these analyses indicate that CMP could create an open online cooperation environment and turns out to be an effective implementation of the "Internet + manufacturing" strategy.展开更多
In order to deal with aliasing distortions of Doppler frequencies shown in time-frequency representation( TFR) with aspect undersampling,an approach using adaptive segmental compressive sampling according to the asp...In order to deal with aliasing distortions of Doppler frequencies shown in time-frequency representation( TFR) with aspect undersampling,an approach using adaptive segmental compressive sampling according to the aspect dependencies of the scattering centers is proposed. The random noise problem induced by compressive sampling is solved by employing a series of signal processing techniques of filtering,image transformation and Hough Transform. Three examples are presented to verify the effectiveness of this approach. The comparisons between the built models and the precise scattered fields computed by a well-validated full-wave numerical method are investigated,and the results showgood agreements between each other.展开更多
Cloud manufacturing is a new, networked and intelligent manufacturing model that is service-oriented. know edge based, high performance, and energy efficient. In this model, state-of-the-art technologies such as infor...Cloud manufacturing is a new, networked and intelligent manufacturing model that is service-oriented. know edge based, high performance, and energy efficient. In this model, state-of-the-art technologies such as informatized manufacturing, cloud computing, intemet of Things, semantic Web, aria high-performance computing are integrated in oroer to provide secure, reliabte. and high quality on-demand services at low prices for those involved in the whole manufacturing lifecycie. As an important part of cioud manufacturing, cloud simulation technology based on the COSIM-CSP platform has primarily been aoplied in thedesign of a multidisciplinary virtual prototype of a flight vehicle. This lays the foundation for further research into cloud manufacturina.展开更多
Multi-disciplinary virtual prototypes of complex products are increasingly and widely used in modern advanced manufactur- ing. How to effectively address the problems of unified modeling, composition and reuse based o...Multi-disciplinary virtual prototypes of complex products are increasingly and widely used in modern advanced manufactur- ing. How to effectively address the problems of unified modeling, composition and reuse based on the multi-disciplinary heteroge- neous models has brought great challenges to the modeling and simulation (M&S) science and technology. This paper presents a top-level modeling theory based on the meta modeling framework (M2F) of the COllaborative SIMulation (COSlM) theory of virtual prototyping to solve the problems. Firstly the fundamental prin- ciples of the top-level modeling theory are decribed to expound the premise, assumptions, basic conventions and special require- ments in the description of complex heterogeneous systems. Next the formalized definitions for each factor in top level modeling are proposed and the hierarchical nature of them is illustrated. After demonstrating that they are self-closing, this paper divides the top- level modeling into two views, static structural graph and dynamic behavioral graph. Finally, a case study is discussed to demon- strate the feasibility of the theory.展开更多
Many complex networks in real life are embedded in space and most infrastructure networks are interdependent,such as the power system and the transport network.In this paper,we construct two cascading failure models o...Many complex networks in real life are embedded in space and most infrastructure networks are interdependent,such as the power system and the transport network.In this paper,we construct two cascading failure models on the multilayer spatial network.In our research,the distance l between nodes within the layer obeys the exponential distribution P(l)~exp(-l/ζ),and the length r of dependency link between layers is defined according to node position.An entropy approach is applied to analyze the spatial network structure and reflect the difference degree between nodes.Two metrics,namely dynamic network size and dynamic network entropy,are proposed to evaluate the spatial network robustness and stability.During the cascading failure process,the spatial network evolution is analyzed,and the numbers of failure nodes caused by different reasons are also counted,respectively.Besides,we discuss the factors affecting network robustness.Simulations demonstrate that the larger the values of average degree<k>,the stronger the network robustness.As the length r decreases,the network performs better.When the probability p is small,asζdecreases,the network robustness becomes more reliable.When p is large,the network robustness manifests better performance asζincreases.These results provide insight into enhancing the robustness,maintaining the stability,and adjusting the difference degree between nodes of the embedded spatiality systems.展开更多
A new method of adaptable rendering for interaction in Virtual Environment(VE) through different visual acuity equations is proposed. An acuity factor equation of luminance vision is first given. Secondly, five equati...A new method of adaptable rendering for interaction in Virtual Environment(VE) through different visual acuity equations is proposed. An acuity factor equation of luminance vision is first given. Secondly, five equations which calculate the visual acuity through visual acuity factors are presented, and adaptive rendering strategy based on different visual acuity equations is given. The VE system may select one of them on the basis of the host’s load, hereby select LOD for each model which would be rendered. A coarser LOD is selected where the visual acuity is lower, and a better LOD is used where it is higher. This method is tested through experiments and the experimental results show that it is effective.展开更多
As one of the next generation imaging spectrometers, the interferential spectrometer (iS) possesses the advantages of high throughput, multi-channel and great resolution. The data of IS are produced in the spatial d...As one of the next generation imaging spectrometers, the interferential spectrometer (iS) possesses the advantages of high throughput, multi-channel and great resolution. The data of IS are produced in the spatial domain, but optical applications are in the Fourier domain. Traditional compression methods can only protect the visual quality of interferometer data in the spatial do- main but ignore the distortion in the Fourier domain. The relation between the distortion in the Fourier domain and the compression in the spatial domain is analyzed. By mathematical proof and val- idation with experiments, the relation between spatial and Fourier domains is discovered, and the significance in the Fourier domain is more important as optical path difference (OPD) increasing in the spatial domain. Based on this relation, a novel coding scheme is proposed, which can compress data in the spatial domain while reducing the distortion in the Fourier domain. In this scheme, the bit stream of the set partitioning in hierarchical trees (SPIHT) is truncated by adaptively lifting rate-distortion slopes according to the priorities of OPD based on rate-distortion optimization theory. Experimental results show that the proposed method can provide better protection of spectrum curves in the Fourier domain while maintaining a comparable visual quality in the spatial domain.展开更多
Complex System Modeling,Simulation and Optimization Language(CoSMSOL)is problem-oriented and designed to run on multi-core computers.This paper provides the system environment of CoSMSOL and proposes the modeling meth...Complex System Modeling,Simulation and Optimization Language(CoSMSOL)is problem-oriented and designed to run on multi-core computers.This paper provides the system environment of CoSMSOL and proposes the modeling methods of complex system,language text specification,function library,algorithm library,parallel simulation algorithms and intelligent optimization algorithms which support continuous system,discrete system and agent systems.Also,we developed a simulation language compiler of CoSMSOL,which is employed in two case studies generating a multi-entity war gaming system and an aerodynamic spacecraft model.The two cases illustrate main functions and implementation processes of CoSMSOL.The results validate that CoSMSOL is useful to model agent-based system and aerospace system.展开更多
In order to realize the agility,collaboration and visualization of alloy material devel-opment process,a product development platform based on simulation and modeling technologies is established in this study.In this ...In order to realize the agility,collaboration and visualization of alloy material devel-opment process,a product development platform based on simulation and modeling technologies is established in this study.In this platform,the whole-process simulation module builds multi-level simulation models based on metallurgical mechanisms from the production line level,the thermo-mechanical coupling field level and the microstructure evolution level.The design knowledge management module represents the multi-source heterogeneous material design knowledge through ontology model,including customers’requirement knowledge,material component knowledge,process design knowledge and quality inspection knowledge,and utilizes the case-based reasoning approach to reuse the knowledge.The data-driven modeling module applies machine learning algorithms to mine the relationships between product mechanical properties,material components,and process parameters from historical samples,and utilizes multi-objective optimiza-tion algorithms to find the optimal combination of process parameters.Application of the developed platform in actual steel mills shows that the proposed method helps to improve the efficiency of product design process.展开更多
The flourish of deep learning frameworks and hardware platforms has been demanding an efficient compiler that can shield the diversity in both software and hardware in order to provide application portability.Among th...The flourish of deep learning frameworks and hardware platforms has been demanding an efficient compiler that can shield the diversity in both software and hardware in order to provide application portability.Among the existing deep learning compilers,TVM is well known for its efficiency in code generation and optimization across diverse hardware devices.In the meanwhile,the Sunway many-core processor renders itself as a competitive candidate for its attractive computational power in both scientific computing and deep learning workloads.This paper combines the trends in these two directions.Specifically,we propose swTVM that extends the original TVM to support ahead-of-time compilation for architecture requiring cross-compilation such as Sunway.In addition,we leverage the architecture features during the compilation such as core group for massive parallelism,DMA for high bandwidth memory transfer and local device memory for data locality,in order to generate efficient codes for deep learning workloads on Sunway.The experiment results show that the codes generated by swTVM achieve 1.79x improvement of inference latency on average compared to the state-of-the-art deep learning framework on Sunway,across eight representative benchmarks.This work is the first attempt from the compiler perspective to bridge the gap of deep learning and Sunway processor particularly with productivity and efficiency in mind.We believe this work will encourage more people to embrace the power of deep learning and Sunwaymany-coreprocessor.展开更多
In this paper,deep learning technology was utilited to solve the railway track recognition in intrusion detection problem.The railway track recognition can be viewed as semantic segmentation task which extends image p...In this paper,deep learning technology was utilited to solve the railway track recognition in intrusion detection problem.The railway track recognition can be viewed as semantic segmentation task which extends image processing to pixel level prediction.An encoder-decoder architecture DeepLabv3+model was applied in this work due to its good performance in semantic segmentation task.Since images of the railway track collected from the video surveillance of the train cab were used as experiment dataset in this work,the following improvements were made to the model.The first aspect deals with over-fitting problem due to the limited amount of training data.Data augmentation and transfer learning are applied consequently to rich the diversity of data and enhance model robustness during the training process.Besides,different gradient descent methods are compared to obtain the optimal optimizer for training model parameters.The third problem relates to data sample imbalance,cross entropy(CE)loss is replaced by focal loss(FL)to address the issue of serious imbalance between positive and negative sample.Effectiveness of the improved DeepLabv3+model with above solutions is demonstrated by experiment results with different system parameters.展开更多
The data stream processing framework processes the stream data based on event-time to ensure that the request can be responded to in real-time.In reality,streaming data usually arrives out-of-order due to factors such...The data stream processing framework processes the stream data based on event-time to ensure that the request can be responded to in real-time.In reality,streaming data usually arrives out-of-order due to factors such as network delay.The data stream processing framework commonly adopts the watermark mechanism to address the data disorderedness.Watermark is a special kind of data inserted into the data stream with a timestamp,which helps the framework to decide whether the data received is late and thus be discarded.Traditional watermark generation strategies are periodic;they cannot dynamically adjust the watermark distribution to balance the responsiveness and accuracy.This paper proposes an adaptive watermark generation mechanism based on the time series prediction model to address the above limitation.This mechanism dynamically adjusts the frequency and timing of watermark distribution using the disordered data ratio and other lateness properties of the data stream to improve the system responsiveness while ensuring acceptable result accuracy.We implement the proposed mechanism on top of Flink and evaluate it with realworld datasets.The experiment results show that our mechanism is superior to the existing watermark distribution strategies in terms of both system responsiveness and result accuracy.展开更多
The color, shape, and other appearance characteristics of the flame emitted by different flame engines are different. In order to make a preliminary judgment on the category of the device to which it belongs through s...The color, shape, and other appearance characteristics of the flame emitted by different flame engines are different. In order to make a preliminary judgment on the category of the device to which it belongs through studying exterior characteristics of the flame, this paper uses the flame of matches, lighters, and candles to simulate different types of flames. It is hoped that the flames can be located and classified by detecting the characteristics of flames using the object detection algorithm. First, different types of fire are collected for the dataset of experiments. The mmDetection toolbox is then used to build several different object detection frameworks, in which the dataset can be trained and tested. The object detection model suitable for this kind of problem is obtained through the evaluation index analysis. The model is ResNet50-based faster-region-convolutional neural network(Faster R-CNN), whose mean average-precision(mAP) is 93.6%. Besides, after clipping the detected flames through object detection, a similarity fusion algorithm is used to aggregate and classify the three types of flames. Finally, the color components are analyzed to obtain the red, green, blue(RGB) color histograms of the three flames.展开更多
As the mean-time-between-failures(MTBF)continues to decline with the increasing number of components on large-scale high performance computing(HPC)systems,program failures might occur during the execution period with ...As the mean-time-between-failures(MTBF)continues to decline with the increasing number of components on large-scale high performance computing(HPC)systems,program failures might occur during the execution period with high probability.Ensuring successful execution of the HPC programs has become an issue that the unprivileged users should be concerned.From the user perspective,if the program failure cannot be detected and handled in time,it would waste resources and delay the progress of program execution.Unfortunately,the unprivileged users are unable to perform program state checking due to execution control by the job management system as well as the limited privilege.Currently,automated tools for supporting user-level failure detection and autorecovery of parallel programs in HPC systems are missing.This paper proposes an innovative method for the unprivileged user to achieve failure detection of job execution and automatic resubmission of failed jobs.The state checker in our method is encapsulated as an independent job to reduce interference with the user jobs.In addition,we propose a dual-checker mechanism to improve the robustness of our approach.We implement the proposed method as a tool named automatic re-launcher(ARL)and evaluate it on the Tianhe-2 system.Experiment results show that ARL can detect the execution failures effectively on Tianhe-2 system.In addition,the communication and performance overhead caused by ARL is negligible.The good scalability of ARL makes it applicable for large-scale HPC systems.展开更多
基金supported by the National High-Tech R&D Program,China(2015AA042101)
文摘Cloud manufacturing is a specific implementation form of the "Internet + manufacturing" strategy. Why and how to develop cloud manufacturing platform(CMP), however, remains the key concern of both platform operators and users. A microscopic model is proposed to investigate advantages and diffusion forces of CMP through exploration of its diffusion process and mechanism. Specifically, a three-stage basic evolution process of CMP is innovatively proposed. Then, based on this basic process, a more complex CMP evolution model has been established in virtue of complex network theory, with five diffusion forces identified. Thereafter, simulations on CMP diffusion have been conducted. The results indicate that, CMP possesses better resource utilization,user satisfaction, and enterprise utility. Results of simulation on impacts of different diffusion forces show that both the time required for CMP to reach an equilibrium state and the final network size are affected simultaneously by the five diffusion forces. All these analyses indicate that CMP could create an open online cooperation environment and turns out to be an effective implementation of the "Internet + manufacturing" strategy.
基金Supported by the National Natural Science Foundation of China(61421001,61471041,61671059)
文摘In order to deal with aliasing distortions of Doppler frequencies shown in time-frequency representation( TFR) with aspect undersampling,an approach using adaptive segmental compressive sampling according to the aspect dependencies of the scattering centers is proposed. The random noise problem induced by compressive sampling is solved by employing a series of signal processing techniques of filtering,image transformation and Hough Transform. Three examples are presented to verify the effectiveness of this approach. The comparisons between the built models and the precise scattered fields computed by a well-validated full-wave numerical method are investigated,and the results showgood agreements between each other.
基金funded by the National Basic Research Program of China ("973" Program)under Grant No. 2007CB310900the National High Technology Research and Development Program of China "(863"Program) under Grant No. 2007AA04Z153
文摘Cloud manufacturing is a new, networked and intelligent manufacturing model that is service-oriented. know edge based, high performance, and energy efficient. In this model, state-of-the-art technologies such as informatized manufacturing, cloud computing, intemet of Things, semantic Web, aria high-performance computing are integrated in oroer to provide secure, reliabte. and high quality on-demand services at low prices for those involved in the whole manufacturing lifecycie. As an important part of cioud manufacturing, cloud simulation technology based on the COSIM-CSP platform has primarily been aoplied in thedesign of a multidisciplinary virtual prototype of a flight vehicle. This lays the foundation for further research into cloud manufacturina.
基金supported by the National High Technology Research and Development Program (863 Program) (2011AA040502).
文摘Multi-disciplinary virtual prototypes of complex products are increasingly and widely used in modern advanced manufactur- ing. How to effectively address the problems of unified modeling, composition and reuse based on the multi-disciplinary heteroge- neous models has brought great challenges to the modeling and simulation (M&S) science and technology. This paper presents a top-level modeling theory based on the meta modeling framework (M2F) of the COllaborative SIMulation (COSlM) theory of virtual prototyping to solve the problems. Firstly the fundamental prin- ciples of the top-level modeling theory are decribed to expound the premise, assumptions, basic conventions and special require- ments in the description of complex heterogeneous systems. Next the formalized definitions for each factor in top level modeling are proposed and the hierarchical nature of them is illustrated. After demonstrating that they are self-closing, this paper divides the top- level modeling into two views, static structural graph and dynamic behavioral graph. Finally, a case study is discussed to demon- strate the feasibility of the theory.
基金Project supported by the National Natural Science Foundation of China(Grant No.61871046).
文摘Many complex networks in real life are embedded in space and most infrastructure networks are interdependent,such as the power system and the transport network.In this paper,we construct two cascading failure models on the multilayer spatial network.In our research,the distance l between nodes within the layer obeys the exponential distribution P(l)~exp(-l/ζ),and the length r of dependency link between layers is defined according to node position.An entropy approach is applied to analyze the spatial network structure and reflect the difference degree between nodes.Two metrics,namely dynamic network size and dynamic network entropy,are proposed to evaluate the spatial network robustness and stability.During the cascading failure process,the spatial network evolution is analyzed,and the numbers of failure nodes caused by different reasons are also counted,respectively.Besides,we discuss the factors affecting network robustness.Simulations demonstrate that the larger the values of average degree<k>,the stronger the network robustness.As the length r decreases,the network performs better.When the probability p is small,asζdecreases,the network robustness becomes more reliable.When p is large,the network robustness manifests better performance asζincreases.These results provide insight into enhancing the robustness,maintaining the stability,and adjusting the difference degree between nodes of the embedded spatiality systems.
文摘A new method of adaptable rendering for interaction in Virtual Environment(VE) through different visual acuity equations is proposed. An acuity factor equation of luminance vision is first given. Secondly, five equations which calculate the visual acuity through visual acuity factors are presented, and adaptive rendering strategy based on different visual acuity equations is given. The VE system may select one of them on the basis of the host’s load, hereby select LOD for each model which would be rendered. A coarser LOD is selected where the visual acuity is lower, and a better LOD is used where it is higher. This method is tested through experiments and the experimental results show that it is effective.
文摘As one of the next generation imaging spectrometers, the interferential spectrometer (iS) possesses the advantages of high throughput, multi-channel and great resolution. The data of IS are produced in the spatial domain, but optical applications are in the Fourier domain. Traditional compression methods can only protect the visual quality of interferometer data in the spatial do- main but ignore the distortion in the Fourier domain. The relation between the distortion in the Fourier domain and the compression in the spatial domain is analyzed. By mathematical proof and val- idation with experiments, the relation between spatial and Fourier domains is discovered, and the significance in the Fourier domain is more important as optical path difference (OPD) increasing in the spatial domain. Based on this relation, a novel coding scheme is proposed, which can compress data in the spatial domain while reducing the distortion in the Fourier domain. In this scheme, the bit stream of the set partitioning in hierarchical trees (SPIHT) is truncated by adaptively lifting rate-distortion slopes according to the priorities of OPD based on rate-distortion optimization theory. Experimental results show that the proposed method can provide better protection of spectrum curves in the Fourier domain while maintaining a comparable visual quality in the spatial domain.
文摘Complex System Modeling,Simulation and Optimization Language(CoSMSOL)is problem-oriented and designed to run on multi-core computers.This paper provides the system environment of CoSMSOL and proposes the modeling methods of complex system,language text specification,function library,algorithm library,parallel simulation algorithms and intelligent optimization algorithms which support continuous system,discrete system and agent systems.Also,we developed a simulation language compiler of CoSMSOL,which is employed in two case studies generating a multi-entity war gaming system and an aerodynamic spacecraft model.The two cases illustrate main functions and implementation processes of CoSMSOL.The results validate that CoSMSOL is useful to model agent-based system and aerospace system.
基金This research is supported by the National Key R&D Program of China under the Grant No.2018YFB1701602the National Natural Science Foundation of China under the Grant No.61903031the Fundamental Research Funds for the Cen-tral Universities under the Grant No.FRF-TP-20-050A2.
文摘In order to realize the agility,collaboration and visualization of alloy material devel-opment process,a product development platform based on simulation and modeling technologies is established in this study.In this platform,the whole-process simulation module builds multi-level simulation models based on metallurgical mechanisms from the production line level,the thermo-mechanical coupling field level and the microstructure evolution level.The design knowledge management module represents the multi-source heterogeneous material design knowledge through ontology model,including customers’requirement knowledge,material component knowledge,process design knowledge and quality inspection knowledge,and utilizes the case-based reasoning approach to reuse the knowledge.The data-driven modeling module applies machine learning algorithms to mine the relationships between product mechanical properties,material components,and process parameters from historical samples,and utilizes multi-objective optimiza-tion algorithms to find the optimal combination of process parameters.Application of the developed platform in actual steel mills shows that the proposed method helps to improve the efficiency of product design process.
基金supported by the National Key Research and Development Program of China (No.2020YFB1506703)the National Natural Science Foundation of China (Grant Nos.62072018 and 61732002)+1 种基金the State Key Laboratory of Software Development Environment (No.SKLSDE-2021ZX-06)the Fundamental Research Funds for the Central Universities。
文摘The flourish of deep learning frameworks and hardware platforms has been demanding an efficient compiler that can shield the diversity in both software and hardware in order to provide application portability.Among the existing deep learning compilers,TVM is well known for its efficiency in code generation and optimization across diverse hardware devices.In the meanwhile,the Sunway many-core processor renders itself as a competitive candidate for its attractive computational power in both scientific computing and deep learning workloads.This paper combines the trends in these two directions.Specifically,we propose swTVM that extends the original TVM to support ahead-of-time compilation for architecture requiring cross-compilation such as Sunway.In addition,we leverage the architecture features during the compilation such as core group for massive parallelism,DMA for high bandwidth memory transfer and local device memory for data locality,in order to generate efficient codes for deep learning workloads on Sunway.The experiment results show that the codes generated by swTVM achieve 1.79x improvement of inference latency on average compared to the state-of-the-art deep learning framework on Sunway,across eight representative benchmarks.This work is the first attempt from the compiler perspective to bridge the gap of deep learning and Sunway processor particularly with productivity and efficiency in mind.We believe this work will encourage more people to embrace the power of deep learning and Sunwaymany-coreprocessor.
基金the Key Special Project in Intergovernmental International Scientific and Technological Innovation Cooperation of the National Key Research and Development Program of China(2017YFE0118600)。
文摘In this paper,deep learning technology was utilited to solve the railway track recognition in intrusion detection problem.The railway track recognition can be viewed as semantic segmentation task which extends image processing to pixel level prediction.An encoder-decoder architecture DeepLabv3+model was applied in this work due to its good performance in semantic segmentation task.Since images of the railway track collected from the video surveillance of the train cab were used as experiment dataset in this work,the following improvements were made to the model.The first aspect deals with over-fitting problem due to the limited amount of training data.Data augmentation and transfer learning are applied consequently to rich the diversity of data and enhance model robustness during the training process.Besides,different gradient descent methods are compared to obtain the optimal optimizer for training model parameters.The third problem relates to data sample imbalance,cross entropy(CE)loss is replaced by focal loss(FL)to address the issue of serious imbalance between positive and negative sample.Effectiveness of the improved DeepLabv3+model with above solutions is demonstrated by experiment results with different system parameters.
基金This work was supported by National Key Research and Development Program of China(2020YFB1506703)the National Natural Science Foundation of China(Grant No.62072018).
文摘The data stream processing framework processes the stream data based on event-time to ensure that the request can be responded to in real-time.In reality,streaming data usually arrives out-of-order due to factors such as network delay.The data stream processing framework commonly adopts the watermark mechanism to address the data disorderedness.Watermark is a special kind of data inserted into the data stream with a timestamp,which helps the framework to decide whether the data received is late and thus be discarded.Traditional watermark generation strategies are periodic;they cannot dynamically adjust the watermark distribution to balance the responsiveness and accuracy.This paper proposes an adaptive watermark generation mechanism based on the time series prediction model to address the above limitation.This mechanism dynamically adjusts the frequency and timing of watermark distribution using the disordered data ratio and other lateness properties of the data stream to improve the system responsiveness while ensuring acceptable result accuracy.We implement the proposed mechanism on top of Flink and evaluate it with realworld datasets.The experiment results show that our mechanism is superior to the existing watermark distribution strategies in terms of both system responsiveness and result accuracy.
基金supported by the National Natural Science Foundation of China (61871058)。
文摘The color, shape, and other appearance characteristics of the flame emitted by different flame engines are different. In order to make a preliminary judgment on the category of the device to which it belongs through studying exterior characteristics of the flame, this paper uses the flame of matches, lighters, and candles to simulate different types of flames. It is hoped that the flames can be located and classified by detecting the characteristics of flames using the object detection algorithm. First, different types of fire are collected for the dataset of experiments. The mmDetection toolbox is then used to build several different object detection frameworks, in which the dataset can be trained and tested. The object detection model suitable for this kind of problem is obtained through the evaluation index analysis. The model is ResNet50-based faster-region-convolutional neural network(Faster R-CNN), whose mean average-precision(mAP) is 93.6%. Besides, after clipping the detected flames through object detection, a similarity fusion algorithm is used to aggregate and classify the three types of flames. Finally, the color components are analyzed to obtain the red, green, blue(RGB) color histograms of the three flames.
基金This work was supported by National Key R&D Program of China(2020YFB150001)the National Natural Science Foundation of China(Grant No.62072018).
文摘As the mean-time-between-failures(MTBF)continues to decline with the increasing number of components on large-scale high performance computing(HPC)systems,program failures might occur during the execution period with high probability.Ensuring successful execution of the HPC programs has become an issue that the unprivileged users should be concerned.From the user perspective,if the program failure cannot be detected and handled in time,it would waste resources and delay the progress of program execution.Unfortunately,the unprivileged users are unable to perform program state checking due to execution control by the job management system as well as the limited privilege.Currently,automated tools for supporting user-level failure detection and autorecovery of parallel programs in HPC systems are missing.This paper proposes an innovative method for the unprivileged user to achieve failure detection of job execution and automatic resubmission of failed jobs.The state checker in our method is encapsulated as an independent job to reduce interference with the user jobs.In addition,we propose a dual-checker mechanism to improve the robustness of our approach.We implement the proposed method as a tool named automatic re-launcher(ARL)and evaluate it on the Tianhe-2 system.Experiment results show that ARL can detect the execution failures effectively on Tianhe-2 system.In addition,the communication and performance overhead caused by ARL is negligible.The good scalability of ARL makes it applicable for large-scale HPC systems.