The cloud platform has limited defense resources to fully protect the edge servers used to process crowd sensing data in Internet of Things.To guarantee the network's overall security,we present a network defense ...The cloud platform has limited defense resources to fully protect the edge servers used to process crowd sensing data in Internet of Things.To guarantee the network's overall security,we present a network defense resource allocation with multi-armed bandits to maximize the network's overall benefit.Firstly,we propose the method for dynamic setting of node defense resource thresholds to obtain the defender(attacker)benefit function of edge servers(nodes)and distribution.Secondly,we design a defense resource sharing mechanism for neighboring nodes to obtain the defense capability of nodes.Subsequently,we use the decomposability and Lipschitz conti-nuity of the defender's total expected utility to reduce the difference between the utility's discrete and continuous arms and analyze the difference theoretically.Finally,experimental results show that the method maximizes the defender's total expected utility and reduces the difference between the discrete and continuous arms of the utility.展开更多
As a combination of edge computing and artificial intelligence,edge intelligence has become a promising technique and provided its users with a series of fast,precise,and customized services.In edge intelligence,when ...As a combination of edge computing and artificial intelligence,edge intelligence has become a promising technique and provided its users with a series of fast,precise,and customized services.In edge intelligence,when learning agents are deployed on the edge side,the data aggregation from the end side to the designated edge devices is an important research topic.Considering the various importance of end devices,this paper studies the weighted data aggregation problem in a single hop end-to-edge communication network.Firstly,to make sure all the end devices with various weights are fairly treated in data aggregation,a distributed end-to-edge cooperative scheme is proposed.Then,to handle the massive contention on the wireless channel caused by end devices,a multi-armed bandit(MAB)algorithm is designed to help the end devices find their most appropriate update rates.Diffe-rent from the traditional data aggregation works,combining the MAB enables our algorithm a higher efficiency in data aggregation.With a theoretical analysis,we show that the efficiency of our algorithm is asymptotically optimal.Comparative experiments with previous works are also conducted to show the strength of our algorithm.展开更多
The overall cross-linking copolymerization of acrylic acid and multi-armed cross-linkers are investigated by in situ interferometry. The results show that the more arms the cross-linkers have, the higher the polymeriz...The overall cross-linking copolymerization of acrylic acid and multi-armed cross-linkers are investigated by in situ interferometry. The results show that the more arms the cross-linkers have, the higher the polymerization rate is. However, they also mean the existence of less cross-linking efficiency and some defects in gel network.展开更多
The process of making decisions is something humans do inherently and routinely,to the extent that it appears commonplace. However,in order to achieve good overall performance,decisions must take into account both the...The process of making decisions is something humans do inherently and routinely,to the extent that it appears commonplace. However,in order to achieve good overall performance,decisions must take into account both the outcomes of past decisions and opportunities of future ones. Reinforcement learning,which is fundamental to sequential decision-making,consists of the following components: 1 A set of decisions epochs; 2 A set of environment states; 3 A set of available actions to transition states; 4 State-action dependent immediate rewards for each action.At each decision,the environment state provides the decision maker with a set of available actions from which to choose. As a result of selecting a particular action in the state,the environment generates an immediate reward for the decision maker and shifts to a different state and decision. The ultimate goal for the decision maker is to maximize the total reward after a sequence of time steps.This paper will focus on an archetypal example of reinforcement learning,the stochastic multi-armed bandit problem. After introducing the dilemma,I will briefly cover the most common methods used to solve it,namely the UCB and εn- greedy algorithms. I will also introduce my own greedy implementation,the strict-greedy algorithm,which more tightly follows the greedy pattern in algorithm design,and show that it runs comparably to the two accepted algorithms.展开更多
Artificial intelligence has permeated all aspects of our lives today. However, to make AI behave like real AI, the critical bottleneck lies in the speed of computing. Quantum computers employ the peculiar and unique p...Artificial intelligence has permeated all aspects of our lives today. However, to make AI behave like real AI, the critical bottleneck lies in the speed of computing. Quantum computers employ the peculiar and unique properties of quantum states such as superposition, entanglement, and interference to process information in ways that classical computers cannot. As a new paradigm of computation, quantum computers are capable of performing tasks intractable for classical processors, thus providing a quantum leap in AI research and making the development of real AI a possibility. In this regard, quantum machine learning not only enhances the classical machine learning approach but more importantly it provides an avenue to explore new machine learning models that have no classical counterparts. The qubit-based quantum computers cannot naturally represent the continuous variables commonly used in machine learning, since the measurement outputs of qubit-based circuits are generally discrete. Therefore, a continuous-variable (CV) quantum architecture based on a photonic quantum computing model is selected for our study. In this work, we employ machine learning and optimization to create photonic quantum circuits that can solve the contextual multi-armed bandit problem, a problem in the domain of reinforcement learning, which demonstrates that quantum reinforcement learning algorithms can be learned by a quantum device.展开更多
In order to solve the high latency of traditional cloud computing and the processing capacity limitation of Internet of Things(IoT)users,Multi-access Edge Computing(MEC)migrates computing and storage capabilities from...In order to solve the high latency of traditional cloud computing and the processing capacity limitation of Internet of Things(IoT)users,Multi-access Edge Computing(MEC)migrates computing and storage capabilities from the remote data center to the edge of network,providing users with computation services quickly and directly.In this paper,we investigate the impact of the randomness caused by the movement of the IoT user on decision-making for offloading,where the connection between the IoT user and the MEC servers is uncertain.This uncertainty would be the main obstacle to assign the task accurately.Consequently,if the assigned task cannot match well with the real connection time,a migration(connection time is not enough to process)would be caused.In order to address the impact of this uncertainty,we formulate the offloading decision as an optimization problem considering the transmission,computation and migration.With the help of Stochastic Programming(SP),we use the posteriori recourse to compensate for inaccurate predictions.Meanwhile,in heterogeneous networks,considering multiple candidate MEC servers could be selected simultaneously due to overlapping,we also introduce the Multi-Arm Bandit(MAB)theory for MEC selection.The extensive simulations validate the improvement and effectiveness of the proposed SP-based Multi-arm bandit Method(SMM)for offloading in terms of reward,cost,energy consumption and delay.The results showthat SMMcan achieve about 20%improvement compared with the traditional offloading method that does not consider the randomness,and it also outperforms the existing SP/MAB based method for offloading.展开更多
Cardanol-aldehyde condensation polymer containing boron-nitrogen coordinate bond (CFBN) has been synthesized and characterized by IR, XPS, HPLC and DTA-TG. Its properties were also investigated. The results show tha...Cardanol-aldehyde condensation polymer containing boron-nitrogen coordinate bond (CFBN) has been synthesized and characterized by IR, XPS, HPLC and DTA-TG. Its properties were also investigated. The results show that the coating film of CFBN has excellent physico-mechanical properties, good anticorrosive properties and stable at high temperature. (Author abstract) 8 Refs.展开更多
Robotic systems are expected to play an increasingly important role in future space activities. The robotic on-orbital service, whose key is the capturing technology, becomes a research hot spot in recent years. This ...Robotic systems are expected to play an increasingly important role in future space activities. The robotic on-orbital service, whose key is the capturing technology, becomes a research hot spot in recent years. This paper studies the dynamics modeling and impedance control of a multi-arm free-flying space robotic system capturing a non-cooperative target. Firstly, a control-oriented dynamics model is essential in control algorithm design and code realization. Unlike a numerical algorithm, an analytical approach is suggested. Using a general and a quasi-coordinate Lagrangian formulation, the kinematics and dynamics equations are derived.Then, an impedance control algorithm is developed which allows coordinated control of the multiple manipulators to capture a target.Through enforcing a reference impedance, end-effectors behave like a mass-damper-spring system fixed in inertial space in reaction to any contact force between the capture hands and the target. Meanwhile, the position and the attitude of the base are maintained stably by using gas jet thrusters to work against the manipulators' reaction. Finally, a simulation by using a space robot with two manipulators and a free-floating non-cooperative target is illustrated to verify the effectiveness of the proposed method.展开更多
Polymers from renewable resources are receiving tremendous attention due to the increasing concerns on the depletion of fossil oils and deteriorated environments.Cardanol,as an abundant and renewable chemical raw mate...Polymers from renewable resources are receiving tremendous attention due to the increasing concerns on the depletion of fossil oils and deteriorated environments.Cardanol,as an abundant and renewable chemical raw material,has been widely used for the production of renewable polymer materials via converting into various of chemical monomers with active functional groups.This comprehensive review deals with various aspects of cardanol as a starting material the preparing various polymer and polymer composites such as benzoxazine resins,phenolic resin,polyurethanes,epoxy resin,vinyl ester polymers,polyamide and cyanate ester resins.The assessment of the future prospects for the use of cardanol to synthesise novel and valuable renewable materials is presented.展开更多
Biobased aromatic-aliphatic polyols were previously synthesized from a thermal thiol-ene reaction of propoxylated cardanol with 2-mercaptoethanol(ME)in the presence of azobisisobutyronitrile(AIBN)as a radical initiato...Biobased aromatic-aliphatic polyols were previously synthesized from a thermal thiol-ene reaction of propoxylated cardanol with 2-mercaptoethanol(ME)in the presence of azobisisobutyronitrile(AIBN)as a radical initiator.Cardanol used for this purpose was obtained as a dark-brown liquid(Gardner Color Reference^18).The photochemical thiol-ene reaction can also be used to prepare aromatic-aliphatic polyols by employing cardanol.Via the photochemical thiol-ene reaction,2-mercaptoethanol was added successfully to C=C double bond of cardanol,suggesting that phenolic group may not play an inhibitory role in the radical thiol-ene reaction.However,we preferred to alkoxylate the phenolic hydroxyl group of cardanol,which is much more reactive with isocyanates than phenolic hydroxyls,to generate a new aliphatic hydroxyl group.Furthermore,the functionality of polyols was also improved by two methods:1)using 1-thio-glycerol instead of 2-mercaptoethanol and 2)using alkoxylated cardanol with glycidol(Cardanol-GLY)instead of propoxylated cardanol(Cardanol-PO).These polyols were then used in preparation of rigid polyurethane foams that can be useful in various applications such as insulation of freezers,pipes and storage tanks in food and chemical industries.展开更多
A novel cardanol sulfonate Gemini surfactant with high surface properties was synthesized by cashew phenol, 1,3-dibromopropane and chlorosulfonic acid through three steps procedure of etherification, sulfonation and n...A novel cardanol sulfonate Gemini surfactant with high surface properties was synthesized by cashew phenol, 1,3-dibromopropane and chlorosulfonic acid through three steps procedure of etherification, sulfonation and neutralization. A surface tension method was employed to investigate the thermo-dynamic properties of micellization in aqueous solution for cardanol sulfonate Gemini surfactant synthesized in laboratory. As a result, the micellization of cardanol sulfonate Gemini surfactant in aqueous solutions is spontaneous and entropy-driven. The micellization process is enthalpy-entropy compensated with the compensation temperature (Tc) of 308 ± 1 K.展开更多
Aromatic-aliphatic polyols were obtained previously from the thiol-ene reactions of propoxylated cardanol with hydroxyalkyl mercaptans;these aromatic-aliphatic polyols were then utilized in the preparation of rigid po...Aromatic-aliphatic polyols were obtained previously from the thiol-ene reactions of propoxylated cardanol with hydroxyalkyl mercaptans;these aromatic-aliphatic polyols were then utilized in the preparation of rigid polyurethane foams with excellent properties.The current work describes a variant of cardanol polyol synthesis by thiol-ene reactions in three steps.The first step is propoxylation of cardanol by reacting cardanol with propylene oxide;the second step is mercaptanization of propoxylated cardanol by reacting double bonds with hydrogen sulfide;and the third step involves the addition of the thiol groups of mercaptanized propoxylated cardanol to the double bonds of allyl alcohol,glycerol-1-allyl ether,and trimethylolpropane allyl ether.Thus,obtained polyols were characterized by standard analytical methods.Rigid polyurethane foams prepared from these polyols show promising physical-mechanical properties.The rigid polyurethane foams can be used for various applications such as thermo-insulation of freezers,storage tanks and pipes for food and chemical industries,wood substitutes and flotation materials.展开更多
In the present research,cardanol based di-acrylic UV oligomer was synthesized by thiol-ene coupling followed by ring opening reaction with glycidyl methacrylate.The intermediate as well as final diacrylate materials w...In the present research,cardanol based di-acrylic UV oligomer was synthesized by thiol-ene coupling followed by ring opening reaction with glycidyl methacrylate.The intermediate as well as final diacrylate materials were analyzed by chemical as well as spectroscopic analysis.Further,ultraviolet(UV)radiation curable formulations were prepared by replacing commercial epoxy acrylate with synthesized UV oligomer in 10-50 wt%and applied on wood panels.The coated films were then evaluated for their optical,mechanical,chemical and thermal properties.Studies showed that up to 30 wt%amount of UVoligomer the coatings exhibited at par mechanical and chemical properties.The stain resistance of all the coatings was observed to be excellent.展开更多
基金supported by the National Natural Science Foundation of China(NSFC)[grant numbers 62172377,61872205]the Shandong Provincial Natural Science Foundation[grant number ZR2019MF018]the Startup Research Foundation for Distinguished Scholars No.202112016.
文摘The cloud platform has limited defense resources to fully protect the edge servers used to process crowd sensing data in Internet of Things.To guarantee the network's overall security,we present a network defense resource allocation with multi-armed bandits to maximize the network's overall benefit.Firstly,we propose the method for dynamic setting of node defense resource thresholds to obtain the defender(attacker)benefit function of edge servers(nodes)and distribution.Secondly,we design a defense resource sharing mechanism for neighboring nodes to obtain the defense capability of nodes.Subsequently,we use the decomposability and Lipschitz conti-nuity of the defender's total expected utility to reduce the difference between the utility's discrete and continuous arms and analyze the difference theoretically.Finally,experimental results show that the method maximizes the defender's total expected utility and reduces the difference between the discrete and continuous arms of the utility.
基金supported by the National Natural Science Foundation of China(NSFC)(62102232,62122042,61971269)Natural Science Foundation of Shandong Province Under(ZR2021QF064)。
文摘As a combination of edge computing and artificial intelligence,edge intelligence has become a promising technique and provided its users with a series of fast,precise,and customized services.In edge intelligence,when learning agents are deployed on the edge side,the data aggregation from the end side to the designated edge devices is an important research topic.Considering the various importance of end devices,this paper studies the weighted data aggregation problem in a single hop end-to-edge communication network.Firstly,to make sure all the end devices with various weights are fairly treated in data aggregation,a distributed end-to-edge cooperative scheme is proposed.Then,to handle the massive contention on the wireless channel caused by end devices,a multi-armed bandit(MAB)algorithm is designed to help the end devices find their most appropriate update rates.Diffe-rent from the traditional data aggregation works,combining the MAB enables our algorithm a higher efficiency in data aggregation.With a theoretical analysis,we show that the efficiency of our algorithm is asymptotically optimal.Comparative experiments with previous works are also conducted to show the strength of our algorithm.
文摘The overall cross-linking copolymerization of acrylic acid and multi-armed cross-linkers are investigated by in situ interferometry. The results show that the more arms the cross-linkers have, the higher the polymerization rate is. However, they also mean the existence of less cross-linking efficiency and some defects in gel network.
文摘The process of making decisions is something humans do inherently and routinely,to the extent that it appears commonplace. However,in order to achieve good overall performance,decisions must take into account both the outcomes of past decisions and opportunities of future ones. Reinforcement learning,which is fundamental to sequential decision-making,consists of the following components: 1 A set of decisions epochs; 2 A set of environment states; 3 A set of available actions to transition states; 4 State-action dependent immediate rewards for each action.At each decision,the environment state provides the decision maker with a set of available actions from which to choose. As a result of selecting a particular action in the state,the environment generates an immediate reward for the decision maker and shifts to a different state and decision. The ultimate goal for the decision maker is to maximize the total reward after a sequence of time steps.This paper will focus on an archetypal example of reinforcement learning,the stochastic multi-armed bandit problem. After introducing the dilemma,I will briefly cover the most common methods used to solve it,namely the UCB and εn- greedy algorithms. I will also introduce my own greedy implementation,the strict-greedy algorithm,which more tightly follows the greedy pattern in algorithm design,and show that it runs comparably to the two accepted algorithms.
文摘Artificial intelligence has permeated all aspects of our lives today. However, to make AI behave like real AI, the critical bottleneck lies in the speed of computing. Quantum computers employ the peculiar and unique properties of quantum states such as superposition, entanglement, and interference to process information in ways that classical computers cannot. As a new paradigm of computation, quantum computers are capable of performing tasks intractable for classical processors, thus providing a quantum leap in AI research and making the development of real AI a possibility. In this regard, quantum machine learning not only enhances the classical machine learning approach but more importantly it provides an avenue to explore new machine learning models that have no classical counterparts. The qubit-based quantum computers cannot naturally represent the continuous variables commonly used in machine learning, since the measurement outputs of qubit-based circuits are generally discrete. Therefore, a continuous-variable (CV) quantum architecture based on a photonic quantum computing model is selected for our study. In this work, we employ machine learning and optimization to create photonic quantum circuits that can solve the contextual multi-armed bandit problem, a problem in the domain of reinforcement learning, which demonstrates that quantum reinforcement learning algorithms can be learned by a quantum device.
基金This work was supported in part by the Zhejiang Lab under Grant 20210AB02in part by the Sichuan International Science and Technology Innovation Cooperation/Hong Kong,Macao and Taiwan Science and Technology Innovation Cooperation Project under Grant 2019YFH0163in part by the Key Research and Development Project of Sichuan Provincial Department of Science and Technology under Grant 2018JZ0071.
文摘In order to solve the high latency of traditional cloud computing and the processing capacity limitation of Internet of Things(IoT)users,Multi-access Edge Computing(MEC)migrates computing and storage capabilities from the remote data center to the edge of network,providing users with computation services quickly and directly.In this paper,we investigate the impact of the randomness caused by the movement of the IoT user on decision-making for offloading,where the connection between the IoT user and the MEC servers is uncertain.This uncertainty would be the main obstacle to assign the task accurately.Consequently,if the assigned task cannot match well with the real connection time,a migration(connection time is not enough to process)would be caused.In order to address the impact of this uncertainty,we formulate the offloading decision as an optimization problem considering the transmission,computation and migration.With the help of Stochastic Programming(SP),we use the posteriori recourse to compensate for inaccurate predictions.Meanwhile,in heterogeneous networks,considering multiple candidate MEC servers could be selected simultaneously due to overlapping,we also introduce the Multi-Arm Bandit(MAB)theory for MEC selection.The extensive simulations validate the improvement and effectiveness of the proposed SP-based Multi-arm bandit Method(SMM)for offloading in terms of reward,cost,energy consumption and delay.The results showthat SMMcan achieve about 20%improvement compared with the traditional offloading method that does not consider the randomness,and it also outperforms the existing SP/MAB based method for offloading.
基金This work is supported by the National Science Foundation of China.
文摘Cardanol-aldehyde condensation polymer containing boron-nitrogen coordinate bond (CFBN) has been synthesized and characterized by IR, XPS, HPLC and DTA-TG. Its properties were also investigated. The results show that the coating film of CFBN has excellent physico-mechanical properties, good anticorrosive properties and stable at high temperature. (Author abstract) 8 Refs.
基金supported by the National Natural Science Foundation of China (61673009)。
文摘Robotic systems are expected to play an increasingly important role in future space activities. The robotic on-orbital service, whose key is the capturing technology, becomes a research hot spot in recent years. This paper studies the dynamics modeling and impedance control of a multi-arm free-flying space robotic system capturing a non-cooperative target. Firstly, a control-oriented dynamics model is essential in control algorithm design and code realization. Unlike a numerical algorithm, an analytical approach is suggested. Using a general and a quasi-coordinate Lagrangian formulation, the kinematics and dynamics equations are derived.Then, an impedance control algorithm is developed which allows coordinated control of the multiple manipulators to capture a target.Through enforcing a reference impedance, end-effectors behave like a mass-damper-spring system fixed in inertial space in reaction to any contact force between the capture hands and the target. Meanwhile, the position and the attitude of the base are maintained stably by using gas jet thrusters to work against the manipulators' reaction. Finally, a simulation by using a space robot with two manipulators and a free-floating non-cooperative target is illustrated to verify the effectiveness of the proposed method.
基金supported by the Open Fund Project of Jiangsu Key Laboratory of Biomass Energy and Materials(Grants No.JSBEM201907)the National Natural Science Foundation of China(No.31570563)the fund project of Yele Science and Technology Innovation(Grants No.YL201807).
文摘Polymers from renewable resources are receiving tremendous attention due to the increasing concerns on the depletion of fossil oils and deteriorated environments.Cardanol,as an abundant and renewable chemical raw material,has been widely used for the production of renewable polymer materials via converting into various of chemical monomers with active functional groups.This comprehensive review deals with various aspects of cardanol as a starting material the preparing various polymer and polymer composites such as benzoxazine resins,phenolic resin,polyurethanes,epoxy resin,vinyl ester polymers,polyamide and cyanate ester resins.The assessment of the future prospects for the use of cardanol to synthesise novel and valuable renewable materials is presented.
文摘Biobased aromatic-aliphatic polyols were previously synthesized from a thermal thiol-ene reaction of propoxylated cardanol with 2-mercaptoethanol(ME)in the presence of azobisisobutyronitrile(AIBN)as a radical initiator.Cardanol used for this purpose was obtained as a dark-brown liquid(Gardner Color Reference^18).The photochemical thiol-ene reaction can also be used to prepare aromatic-aliphatic polyols by employing cardanol.Via the photochemical thiol-ene reaction,2-mercaptoethanol was added successfully to C=C double bond of cardanol,suggesting that phenolic group may not play an inhibitory role in the radical thiol-ene reaction.However,we preferred to alkoxylate the phenolic hydroxyl group of cardanol,which is much more reactive with isocyanates than phenolic hydroxyls,to generate a new aliphatic hydroxyl group.Furthermore,the functionality of polyols was also improved by two methods:1)using 1-thio-glycerol instead of 2-mercaptoethanol and 2)using alkoxylated cardanol with glycidol(Cardanol-GLY)instead of propoxylated cardanol(Cardanol-PO).These polyols were then used in preparation of rigid polyurethane foams that can be useful in various applications such as insulation of freezers,pipes and storage tanks in food and chemical industries.
文摘A novel cardanol sulfonate Gemini surfactant with high surface properties was synthesized by cashew phenol, 1,3-dibromopropane and chlorosulfonic acid through three steps procedure of etherification, sulfonation and neutralization. A surface tension method was employed to investigate the thermo-dynamic properties of micellization in aqueous solution for cardanol sulfonate Gemini surfactant synthesized in laboratory. As a result, the micellization of cardanol sulfonate Gemini surfactant in aqueous solutions is spontaneous and entropy-driven. The micellization process is enthalpy-entropy compensated with the compensation temperature (Tc) of 308 ± 1 K.
文摘Aromatic-aliphatic polyols were obtained previously from the thiol-ene reactions of propoxylated cardanol with hydroxyalkyl mercaptans;these aromatic-aliphatic polyols were then utilized in the preparation of rigid polyurethane foams with excellent properties.The current work describes a variant of cardanol polyol synthesis by thiol-ene reactions in three steps.The first step is propoxylation of cardanol by reacting cardanol with propylene oxide;the second step is mercaptanization of propoxylated cardanol by reacting double bonds with hydrogen sulfide;and the third step involves the addition of the thiol groups of mercaptanized propoxylated cardanol to the double bonds of allyl alcohol,glycerol-1-allyl ether,and trimethylolpropane allyl ether.Thus,obtained polyols were characterized by standard analytical methods.Rigid polyurethane foams prepared from these polyols show promising physical-mechanical properties.The rigid polyurethane foams can be used for various applications such as thermo-insulation of freezers,storage tanks and pipes for food and chemical industries,wood substitutes and flotation materials.
基金funded by UGC-BSR[F.25-1/2014-15(BSR)/No.F.7-314/2010(BSR)].
文摘In the present research,cardanol based di-acrylic UV oligomer was synthesized by thiol-ene coupling followed by ring opening reaction with glycidyl methacrylate.The intermediate as well as final diacrylate materials were analyzed by chemical as well as spectroscopic analysis.Further,ultraviolet(UV)radiation curable formulations were prepared by replacing commercial epoxy acrylate with synthesized UV oligomer in 10-50 wt%and applied on wood panels.The coated films were then evaluated for their optical,mechanical,chemical and thermal properties.Studies showed that up to 30 wt%amount of UVoligomer the coatings exhibited at par mechanical and chemical properties.The stain resistance of all the coatings was observed to be excellent.