Distributed Stochastic Optimization with Compression for Non-Strongly Convex Objectives

We are investigating the distributed optimization problem,where a network of nodes works together to minimize a global objective that is a finite sum of their stored local functions.Since nodes exchange optimization parameters through the wireless network,large-scale training models can create communication bottlenecks,resulting in slower training times.To address this issue,CHOCO-SGD was proposed,which allows compressing information with arbitrary precision without reducing the convergence rate for strongly convex objective functions.Nevertheless,most convex functions are not strongly convex(such as logistic regression or Lasso),which raises the question of whether this algorithm can be applied to non-strongly convex functions.In this paper,we provide the first theoretical analysis of the convergence rate of CHOCO-SGD on non-strongly convex objectives.We derive a sufficient condition,which limits the fidelity of compression,to guarantee convergence.Moreover,our analysis demonstrates that within the fidelity threshold,this algorithm can significantly reduce transmission burden while maintaining the same convergence rate order as its no-compression equivalent.Numerical experiments further validate the theoretical findings by demonstrating that CHOCO-SGD improves communication efficiency and keeps the same convergence rate order simultaneously.And experiments also show that the algorithm fails to converge with low compression fidelity and in time-varying topologies.Overall,our study offers valuable insights into the potential applicability of CHOCO-SGD for non-strongly convex objectives.Additionally,we provide practical guidelines for researchers seeking to utilize this algorithm in real-world scenarios.

Co-salient object detection with iterative purification and predictive optimization

Background Co-salient object detection(Co-SOD)aims to identify and segment commonly salient objects in a set of related images.However,most current Co-SOD methods encounter issues with the inclusion of irrelevant information in the co-representation.These issues hamper their ability to locate co-salient objects and significantly restrict the accuracy of detection.Methods To address this issue,this study introduces a novel Co-SOD method with iterative purification and predictive optimization(IPPO)comprising a common salient purification module(CSPM),predictive optimizing module(POM),and diminishing mixed enhancement block(DMEB).Results These components are designed to explore noise-free joint representations,assist the model in enhancing the quality of the final prediction results,and significantly improve the performance of the Co-SOD algorithm.Furthermore,through a comprehensive evaluation of IPPO and state-of-the-art algorithms focusing on the roles of CSPM,POM,and DMEB,our experiments confirmed that these components are pivotal in enhancing the performance of the model,substantiating the significant advancements of our method over existing benchmarks.Experiments on several challenging benchmark co-saliency datasets demonstrate that the proposed IPPO achieves state-of-the-art performance.

Multi-Objective Optimization with Artificial Neural Network Based Robust Paddy Yield Prediction Model

Agriculture plays a vital role in the food production process that occupies nearly one-third of the total surface of the earth.Rice is propagated from the seeds of paddy and it is a stable food almost used byfifty percent of the total world population.The extensive growth of the human population alarms us to ensure food security and the country should take proper food steps to improve the yield of food grains.This paper concentrates on improving the yield of paddy by predicting the factors that influence the growth of paddy with the help of Evolutionary Computation Techniques.Most of the researchers used to relay on historical records of meteorological parameters to predict the yield of paddy.There is a lack in analyzing the day to day impact of meteorological parameters such as direction of wind,relative humidity,Instant Wind Speed in paddy cultivation.The real time meteorological data collected and analysis the impact of weather parameters from the day of paddy sowing to till the last day of paddy harvesting with regular time series.A Robust Optimized Artificial Neural Network(ROANN)Algorithm with Genetic Algorithm(GA)and Multi Objective Particle Swarm Optimization Algorithm(MOPSO)proposed to predict the factors that to be concentrated by farmers to improve the paddy yield in cultivation.A real time paddy data collected from farmers of Tamilnadu and the meteorological parameters were matched with the cropping pattern of the farmers to construct the database.The input parameters were optimized either by using GA or MOPSO optimization algorithms to reconstruct the database.Reconstructed database optimized by using Artificial Neural Network Back Propagation Algorithm.The reason for improving the growth of paddy was identified using the output of the Neural Network.Performance metrics such as Accuracy,Error Rate etc were used to measure the performance of the proposed algorithm.Comparative analysis made between ANN with GA and ANN with MOPSO to identify the recommendations for improving the paddy yield.

Multi-Objective Cold Chain Path Optimization Based on Customer Satisfaction

To improve customer satisfaction of cold chain logistics of fresh agricultural goods enterprises and reduce the comprehensive distribution cost composed of fixed cost, transportation cost, cargo damage cost, refrigeration cost, and time penalty cost, a multi-objective path optimization model of fresh agricultural products distribution considering client satisfaction is constructed. The model is solved using an enhanced Elitist Non-dominated Sorting Genetic Algorithm (NSGA-II), and differential evolution is incorporated to the evolution operator. The algorithm produced by the revised algorithm produces a better Pareto optimum solution set, efficiently balances the relationship between customer pleasure and cost, and serves as a reference for the long-term growth of organizations. .

A multi-objective fuzzy optimization model for cropping structure and water resources and its method

Cropping structure has a close relationship with the optimal allocation of agricultural water resources. Based on the analysis of the relationship between agricultural water resources and sustainable development, this paper presents a multi objective fuzzy optimization model for cropping structure and water allocation, which overcomes the shortcoming of current models that only considered the economic objective,and ignored the social and environmental objectives. During the process, a new method named fuzzy deciding weight is developed to decide the objective weight. A case study shows that the model is reliable, the method is simple and objective, and the results are reasonable. This model is useful for agricultural management and sustainable development.

Optimal Positioning Strategy for Multi-Camera Zooming Drones

In the context of multiple-target tracking and surveillance applications,this paper investigates the challenge of determining the optimal positioning of a single autonomous aerial vehicle or agent equipped with multiple independently-steerable zooming cameras to effectively monitor a set of targets of interest.Each camera is dedicated to tracking a specific target or cluster of targets.The key innovation of this study,in comparison to existing approaches,lies in incorporating the zooming factor for the onboard cameras into the optimization problem.This enhancement offers greater flexibility during mission execution by allowing the autonomous agent to adjust the focal lengths of the onboard cameras,in exchange for varying real-world distances to the corresponding targets,thereby providing additional degrees of freedom to the optimization problem.The proposed optimization framework aims to strike a balance among various factors,including distance to the targets,verticality of viewpoints,and the required focal length for each camera.The primary focus of this paper is to establish the theoretical groundwork for addressing the non-convex nature of the optimization problem arising from these considerations.To this end,we develop an original convex approximation strategy.The paper also includes simulations of diverse scenarios,featuring varying numbers of onboard tracking cameras and target motion profiles,to validate the effectiveness of the proposed approach.

Overview of multi-objective optimization methods

To assist readers to have a comprehensive understanding, the classical and intelligent methods roundly based on precursory research achievements are summarized in this paper. First, basic conception and description about multi-objective (MO) optimization are introduced. Then some definitions and related terminologies are given. Furthermore several MO optimization methods including classical and current intelligent methods are discussed one by one succinctly. Finally evaluations on advantages and disadvantages about these methods are made at the end of the paper.

Bi-Objective Optimization: A Pareto Method with Analytical Solutions

Multiple objectives to be optimized simultaneously are prevalent in real-life problems. This paper develops a new Pareto Method for bi-objective optimization which yields analytical solutions. The Pareto optimal front is obtained in closed-form, enabling the derivation of various solutions in a convenient and efficient way. The advantage of analytical solution is the possibility of deriving accurate, exact and well-understood solutions, which is especially useful for policy analysis. An extension of the method to include multiple objectives is provided with the objectives being classified into two types. Such an extension expands the applicability of the developed techniques.

Multi-Objective Optimization and Analysis Model of Sintering Process Based on BP Neural Network

A multi-objective optimization and analysis model of the sintering process based on BP neural network is presented. Genetic algorithms are combined to simplify the BP neural network, which can reduce the learning time and increase the forecasting accuracy of the network model. This model has been experimented in the sintering process, and the production cost, the energy consumption, the quality （revolving intensity）, and the output are considered at the same time. Moreover, the relation between some factors and the multi-objectives has been analyzed, and the results are consistent with the process. Different objectives are emphasized at different practical periods, and this can provide a theoretical basis for the manager.

Multidisciplinary Design Optimization of Vehicle Instrument Panel Based on Multi-objective Genetic Algorithm

Typical multidisciplinary design optimization（MDO） has gradually been proposed to balance performances of lightweight, noise, vibration and harshness（NVH） and safety for instrument panel（IP） structure in the automotive development. Nevertheless, plastic constitutive relation of Polypropylene（PP） under different strain rates, has not been taken into consideration in current reliability-based and collaborative IP MDO design. In this paper, based on tensile test under different strain rates, the constitutive relation of Polypropylene material is studied. Impact simulation tests for head and knee bolster are carried out to meet the regulation of FMVSS 201 and FMVSS 208, respectively. NVH analysis is performed to obtain mainly the natural frequencies and corresponding mode shapes, while the crashworthiness analysis is employed to examine the crash behavior of IP structure. With the consideration of lightweight, NVH, head and knee bolster impact performance, design of experiment（DOE）, response surface model（RSM）, and collaborative optimization（CO） are applied to realize the determined and reliability-based optimizations, respectively. Furthermore, based on multi-objective genetic algorithm（MOGA）, the optimal Pareto sets are completed to solve the multi-objective optimization（MOO） problem. The proposed research ensures the smoothness of Pareto set, enhances the ability of engineers to make a comprehensive decision about multi-objectives and choose the optimal design, and improves the quality and efficiency of MDO.

Evolutionary Multi-objective Portfolio Optimization in Practical Context

This paper addresses evolutionary multi-objective portfolio optimization in the practical context by incorporating realistic constraints into the problem model and preference criterion into the optimization search process. The former is essential to enhance the realism of the classical mean-variance model proposed by Harry Markowitz, since portfolio managers often face a number of realistic constraints arising from business and industry regulations, while the latter reflects the fact that portfolio managers are ultimately interested in specific regions or points along the efficient frontier during the actual execution of their investment orders. For the former, this paper proposes an order-based representation that can be easily extended to handle various realistic constraints like floor and ceiling constraints and cardinality constraint. An experimental study, based on benchmark problems obtained from the OR-library, demonstrates its capability to attain a better approximation of the efficient frontier in terms of proximity and diversity with respect to other conventional representations. The experimental results also illustrated its viability and practicality in handling the various realistic constraints. A simple strategy to incorporate preferences into the multi-objective optimization process is highlighted and the experimental study demonstrates its capability in driving the evolutionary search towards specific regions of the efficient frontier.

Rotary unmanned aerial vehicles path planning in rough terrain based on multi-objective particle swarm optimization

This paper presents a path planning approach for rotary unmanned aerial vehicles(R-UAVs)in a known static rough terrain environment.This approach aims to find collision-free and feasible paths with minimum altitude,length and angle variable rate.First,a three-dimensional(3D)modeling method is proposed to reduce the computation burden of the dynamic models of R-UAVs.Considering the length,height and tuning angle of a path,the path planning of R-UAVs is described as a tri-objective optimization problem.Then,an improved multi-objective particle swarm optimization algorithm is developed.To render the algorithm more effective in dealing with this problem,a vibration function is introduced into the collided solutions to improve the algorithm efficiency.Meanwhile,the selection of the global best position is taken into account by the reference point method.Finally,the experimental environment is built with the help of the Google map and the 3D terrain generator World Machine.Experimental results under two different rough terrains from Guilin and Lanzhou of China demonstrate the capabilities of the proposed algorithm in finding Pareto optimal paths.

Interactive Multi-objective Optimization Design for the Pylon Structure of an Airplane

The pylon structure of an airplane is very complex, and its high-fidelity analysis is quite time-consuming. If posterior preference optimization algorithm is used to solve this problem, the huge time consumption will be unacceptable in engineering practice due to the large amount of evaluation needed for the algorithm. So, a new interactive optimization algorithm-interactive multi-objective particle swarm optimization （IMOPSO） is presented. IMOPSO is efficient, simple and operable. The decision-maker can expediently determine the accurate preference in IMOPSO. IMOPSO is used to perform the pylon structure optimization design of an airplane, and a satisfactory design is achieved after only 12 generations of IMOPSO evolutions. Compared with original design, the maximum displacement of the satisfactory design is reduced, and the mass of the satisfactory design is decreased for 22%.

Improved non-dominated sorting genetic algorithm (NSGA)-II in multi-objective optimization studies of wind turbine blades

The non-dominated sorting genetic algorithm （NSGA） is improved with the controlled elitism and dynamic crowding distance. A novel multi-objective optimization algorithm is obtained for wind turbine blades. As an example, a 5 MW wind turbine blade design is presented by taking the maximum power coefficient and the minimum blade mass as the optimization objectives. The optimal results show that this algorithm has good performance in handling the multi-objective optimization of wind turbines, and it gives a Pareto-optimal solution set rather than the optimum solutions to the conventional multi objective optimization problems. The wind turbine blade optimization method presented in this paper provides a new and general algorithm for the multi-objective optimization of wind turbines.

Multi-objective optimization of membrane structures based on Pareto Genetic Algorithm

A multi-objective optimization method based on Pareto Genetic Algorithm is presented for shape design of membrane structures from a structural view point.Several non-dimensional variables are defined as optimization variables,which are decision factors of shapes of membrane structures.Three objectives are proposed including maximization of stiffness,maximum uniformity of stress and minimum reaction under external loads.Pareto Multi-objective Genetic Algorithm is introduced to solve the Pareto solutions.Consequently,the dependence of the optimality upon the optimization variables is derived to provide guidelines on how to determine design parameters.Moreover,several examples illustrate the proposed methods and applications.The study shows that the multi-objective optimization method in this paper is feasible and efficient for membrane structures;the research on Pareto solutions can provide explicit and useful guidelines for shape design of membrane structures.

Multi-objective Optimization of a Parallel Ankle Rehabilitation Robot Using Modified Differential Evolution Algorithm

Dimensional synthesis is one of the most difficult issues in the field of parallel robots with actuation redundancy. To deal with the optimal design of a redundantly actuated parallel robot used for ankle rehabilitation, a methodology of dimensional synthesis based on multi-objective optimization is presented. First, the dimensional synthesis of the redundant parallel robot is formulated as a nonlinear constrained multi-objective optimization problem. Then four objective functions, separately reflecting occupied space, input/output transmission and torque performances, and multi-criteria constraints, such as dimension, interference and kinematics, are defined. In consideration of the passive exercise of plantar/dorsiflexion requiring large output moment, a torque index is proposed. To cope with the actuation redundancy of the parallel robot, a new output transmission index is defined as well. The multi-objective optimization problem is solved by using a modified Differential Evolution（DE） algorithm, which is characterized by new selection and mutation strategies. Meanwhile, a special penalty method is presented to tackle the multi-criteria constraints. Finally, numerical experiments for different optimization algorithms are implemented. The computation results show that the proposed indices of output transmission and torque, and constraint handling are effective for the redundant parallel robot; the modified DE algorithm is superior to the other tested algorithms, in terms of the ability of global search and the number of non-dominated solutions. The proposed methodology of multi-objective optimization can be also applied to the dimensional synthesis of other redundantly actuated parallel robots only with rotational movements.

A performance comparison of multi-objective optimization algorithms for solving nearly-zero-energy-building design problems

Integrated building design is inherently a multi-objective optimization problem where two or more conflicting objectives must be minimized and/or maximized concurrently.Many multi-objective optimization algorithms have been developed;however few of them are tested in solving building design problems.This paper compares performance of seven commonly-used multi-objective evolutionary optimization algorithms in solving the design problem of a nearly zero energy building(n ZEB) where more than 1.610 solutions would be possible.The compared algorithms include a controlled non-dominated sorting genetic algorithm witha passive archive(p NSGA-II),a multi-objective particle swarm optimization(MOPSO),a two-phase optimization using the genetic algorithm(PR_GA),an elitist non-dominated sorting evolution strategy(ENSES),a multi-objective evolutionary algorithm based on the concept of epsilon dominance(ev MOGA),a multi-objective differential evolution algorithm(sp MODE-II),and a multi-objective dragonfly algorithm(MODA).Several criteria was used to compare performance of these algorithms.In most cases,the quality of the obtained solutions was improved when the number of generations was increased.The optimization results of running each algorithm20 times with gradually increasing number of evaluations indicated that the PR_GA algorithm had a high repeatability to explore a large area of the solution-space and achieved close-to-optimal solutions with a good diversity,followed by the p NSGA-II,ev MOGA and sp MODE-II.Uncompetitive results were achieved by the ENSES,MOPSO and MODA in most running cases.The study also found that 1400-1800 were minimum required number of evaluations to stabilize optimization results of the building energy model.

Multi-objective Optimization Conceptual Design of Product Structure Based on Variable Length Gene Expression

It is a complicated problem for the bottom-to-top adaptive conceptual design of complicated products between structure and function. Reliable theories demand to be found in order to determine whether the structure accords with the requirement of design. For the requirement generally is dynamic variety as time passes, new requirements will come, and some initial requirements can no longer be used. The number of product requirements, the gene length expressing requirements, the structure of the product, and the correlation matrix are varied with individuation of customer requirements of the product. By researching on the calculation mechanisms of dynamic variety, the approaches of gene expression and variable length gene expression are proposed. According to the diversity of structure selection in conceptual design and mutual relations between structure and function as well as structure and structure, the correlation matrixes between structure and function as well as structure and structure are defined. By the approach of making the sum of the elements of correlation matrix maximum, the mathematical models of multi-object optimization for structure design are provided based on variable requirements. An improved genetic algorithm called segment genetic algorithm is proposed based on optimization preservation simple genetic algorithm. The models of multi-object optimization are calculated by the segment genetic algorithm and hybrid genetic algorithm. An example for the conceptual design of a washing machine is given to show that the proposed method is able to realize the optimization structure design fitting for variable requirements. In addition, the proposed approach can provide good Pareto optimization solutions, and the individuation customer requirements for structures of products are able to be resolved effectively.

Multi-objective optimization of oil well drilling using elitist non-dominated sorting genetic algorithm

A multi-objective optimization of oil well drilling has been carried out using a binary coded elitist non-dominated sorting genetic algorithm.A Louisiana offshore field with abnormal formation pressure is considered for optimization.Several multi-objective optimization problems involving twoand three-objective functions were formulated and solved to fix optimal drilling variables.The important objectives are：（i） maximizing drilling depth,（ii） minimizing drilling time and （iii） minimizing drilling cost with fractional drill bit tooth wear as a constraint.Important time dependent decision variables are：（i） equivalent circulation mud density,（ii） drill bit rotation,（iii） weight on bit and （iv） Reynolds number function of circulating mud through drill bit nozzles.A set of non-dominated optimal Pareto frontier is obtained for the two-objective optimization problem whereas a non-dominated optimal Pareto surface is obtained for the three-objective optimization problem.Depending on the trade-offs involved,decision makers may select any point from the optimal Pareto frontier or optimal Pareto surface and hence corresponding values of the decision variables that may be selected for optimal drilling operation.For minimizing drilling time and drilling cost,the optimum values of the decision variables are needed to be kept at the higher values whereas the optimum values of decision variables are at the lower values for the maximization of drilling depth.

A decision support system for satellite layout integrating multi-objective optimization and multi-attribute decision making

A decision support system, including a multi-objective optimization framework and a multi-attribute decision making approach is proposed for satellite equipment layout. Firstly, given three objectives (to minimize the C.G. offset, the cross moments of inertia and the space debris impact risk), we develop a threedimensional layout optimization model. Unlike most of the previous works just focusing on mass characteristics of the system, a space debris impact risk index is developed. Secondly, we develop an efficient optimization framework for the integration of computer-aided design (CAD) software as well as the optimization algorithm to obtain the Pareto front of the layout optimization problem. Thirdly, after obtaining the candidate solutions, we present a multi-attribute decision making approach, which integrates the smart Pareto filter and the correlation coefficient and standard deviation (CCSD) method to select the best tradeoff solutions on the optimal Pareto fronts. Finally, the framework and the decision making approach are applied to a case study of a satellite platform.