Actor-Critic Reinforcement Learning and Application in Developing Computer-Vision-Based Interface Tracking

This paper synchronizes control theory with computer vision by formalizing object tracking as a sequential decision-making process.A reinforcement learning(RL)agent successfully tracks an interface between two liquids,which is often a critical variable to track in many chemical,petrochemical,metallurgical,and oil industries.This method utilizes less than 100 images for creating an environment,from which the agent generates its own data without the need for expert knowledge.Unlike supervised learning(SL)methods that rely on a huge number of parameters,this approach requires far fewer parameters,which naturally reduces its maintenance cost.Besides its frugal nature,the agent is robust to environmental uncertainties such as occlusion,intensity changes,and excessive noise.From a closed-loop control context,an interface location-based deviation is chosen as the optimization goal during training.The methodology showcases RL for real-time object-tracking applications in the oil sands industry.Along with a presentation of the interface tracking problem,this paper provides a detailed review of one of the most effective RL methodologies:actor–critic policy.

INTERFACE DAMAGE ANALYSIS OF FIBER REINFORCED COMPOSITES WITH DUCTILE MATRIX

A cohesive zone model is employed to simulate the fiber/matrix interface damage of composites with ductile matrix. The study is carried out to investigate the dependence of the interface damage and the composite tensile strength on the micro parameters of the composite. These parameters contain fiber packing pattern, fiber volume fraction, and the modulus ratio of the fiber to the matrix. The investigation reveals that though the high fiber vo lume fraction, the high fiber′s modulus and the square fiber packing can supply strong reinforcement to the composite, the interface damage is susceptible in these cases. The tensile strength of the composite is dominated by the interface strength when the interface debonding occurs.

The Effects of Degradation Phenomena of the Steel-Concrete Interface in Reinforced Concrete Structures

Reinforced concrete (RC) constructions are the innovation of sustainable constructions replacing masonry constructions. Despite this, the use of concrete and steel to improve the performance of structural members in service is a recurring problem due to the immediate or overtime appearance of cracks. The objective of this work was therefore to assess the damage phenomena of the steel-concrete interface in order to assess the performance of an RC structure. Samples of approximately 30 cm of reinforcement attacked by rust were taken from broken reinforced concrete columns and beams in order to determine the impact of corrosion on high adhesion steel (HA) and therefore on its ability to resist. The experimental results have shown that the corrosion degradation rates of reinforcing bars of different diameters increase as the diameter of the reinforcing bars decreases: 5% for HA12;23.75% for HA8 and 50% for HA6. Using the approach proposed by Mangat and Elgalf on the bearing capacity as a function of the progress of the corrosion phenomenon, these rates made it possible to assess the new fracture limits of corroded HA steels. For HA6 respectively HA8 and HA12, their initial limit resistances will decrease by 4/4, 3/4 and 1/4. Based on the results of this study and in order to guarantee their durability, an RC structure can be dimensioned by taking into account the effects of reinforcement corrosion.

INTERFACE AND PROPERTIES OF ALKALI-TREATED CARBON FIBRE REINFORCED CEMENT COMPOSITES

The surface of carbon fibre is studied which has been treated with heated sodium hydrate solution (NaOH) . It is found that the surface of carbon fibre is not corroded during the treatment. But at the same time, it is also found that after this treatment, a certain number of carbonyl groups (C O) and (-COOH or ?COONa) are produced on the treated surface of carbon fibre. When carbon fiber is mixed with cement paste, the above reactive groups will link with Ca+2 in the paste, which will result in an early stage hydration of cement in inter facial areas. In addition, the experiments show that the rheological properties of cement paste reinforced with alkali-treated carbon fibre differ greatly from that of untreated carbon fibre reinforced cement paste.

Study on Interface mechanical behavior of steel tube reinforced concrete composite pile

Currently for the steel tube reinforced concrete composite pile research, although predecessors make a comprehensive research on the composite pile beating performance, design technology, but there are still many problems have not been solved, such as the steel tube reinforced concrete pile composite interracial force learn performance research is still in the initial stage. In this paper, we mainly discuss the research methods of several interface mechanical properties and propose the possibility of studying the mechanical properties of the steel tube reinforced concrete composite pile by using the principle of ultrasonic speckle.

SCATTERING OF ELASTIC WAVES IN AN ELASTIC MATRIX CONTAINING AN INCLUSION WITH INTERFACES

Based on the theory of elastic dynamics, the scattering of elasticwaves and dynamic stress concentration of fiber-reinforced compositewith interfaces are studied. Analytical expressions of elastic wavesin different medium areas are presented and an analytic method ofsolving this problem is established. The mode coefficients aredetermined by means of the continuous conditions of displacement andstress on the boundary of the interfaces. The influence of materialproperties and structural size on the dynamic stress con- centrationfactors near the interfaces is analyzed.

Numerical Analysis of Reinforcement Structure Stability Based on the Stress State of Geogrid

The reinforcement effect of geogrids is exerted through the fixing and occlusion with the surrounding soil to ensure the stability of reinforced structure. Based on the friction reinforced mechanism, the geogrids play the role of anti-shear and anti-pulling. So the indexes of interface strength identified by shear and tensile tests?are?usually used to conduct the stability analysis of reinforced structure. At present, the same indexes of interface strength?areadopted in the stability analysis of reinforced structure, where only one of the anti-shearing action or anti-pulling effect of geogrid is considered, which is separated from the practical stress state of geogrids and has certain limitation. To solve the problem, the paper adjusts the interface indexes of geogrids based on the potential sliding surface and the stress state of geogrids when the failure happens. So the method of stability analysis is concluded where cyclic iterative analysis is carried out till the interface characters of geogrids and the unstable mode of the whole structure are the same. The calculation examples of reinforced soil slope in the paper shows that the method can fully reflect the reinforcement of geogrids and can complete the adoption of numerical method in the stability analysis of reinforcement structure.

Meso-mechanical Interfacial Behavior of Elbow Steel Fiber Reinforced Concrete

The strain distributions near the interface when the elbow steel fiber is pulled out from the half-mould concrete matrix are directly measured using a combined method of single fiber pull-out test and digital image correlation. Meanwhile, the real-time processes of the bonding, debonding and sliding at the interface are observed. The micro-mechanism of the strain localization in the failure process of interface when debonding occurs and the strengthening mechanism at the imbedded fiber are discussed. The experimental results show that the meso-scale strain localization gives rise to the localization of shear damage near the fiber interface. This strain localization characterized by the debonding process near the interface occurs, develops and moves gradually at an apparently regular interval. At the elbow part of the imbedded fiber, the peak value of the shearing stress occurs. But the primary debonding does not occur at this place because the strength of the shear damage is increased at the local area of the elbow part in the concrete, displaying an apparent reinforced effect at the end of the fiber.

Effect of Silane Coupling Agent Concentration on Interfacial Properties of Basalt Fiber Reinforced Composites

The purpose of this study is to investigate the effect of the concentration of silane coupling solution on the tensile strength of basalt fiber and the interfacial properties of basalt fiber reinforced polymer composites.The surface treatment of basalt fibers was carried out using an aqueous alcohol solution method.Basalt fibers were subjected to surface treatment with 3-Methacryloxypropyl trimethoxy silane at 0.5 wt.%,1 wt.%,2 wt.%,4 wt.%and 10 wt.%.The basalt monofilament tensile tests were carried out to investigate the variation in strength with the concentration of the silane coupling agent.The microdroplet test was performed to examine the effect of the concentration of the silane coupling agent on interfacial strength of basalt reinforced polymer composites.The film was formed on the surface of the basalt fiber treated silane coupling agent solution.The tensile strength of basalt fiber increased because the damaged fiber surface was repaired by the firm of silane coupling agent.The firm was effective in not only the surface protection of basalt fiber but also the improvement on the interfacial strength of fiber-matrix interface.However,the surface treatment using the high concentration silane coupling agent solution has an adverse effect on the mechanical properties of the composite materials,because of causing the degradation of the interfacial strength of the composite materials.

Double Deep Q-Network Decoder Based on EEG Brain-Computer Interface

Brain-computer interfaces(BCI)use neural activity as a control signal to enable direct communication between the human brain and external devices.The electrical signals generated by the brain are captured through electroencephalogram(EEG)and translated into neural intentions reflecting the user’s behavior.Correct decoding of the neural intentions then facilitates the control of external devices.Reinforcement learning-based BCIs enhance decoders to complete tasks based only on feedback signals(rewards)from the environment,building a general framework for dynamic mapping from neural intentions to actions that adapt to changing environments.However,using traditional reinforcement learning methods can have challenges such as the curse of dimensionality and poor generalization.Therefore,in this paper,we use deep reinforcement learning to construct decoders for the correct decoding of EEG signals,demonstrate its feasibility through experiments,and demonstrate its stronger generalization on motion imaging(MI)EEG data signals with high dynamic characteristics.

UHPC-NC界面抗剪性能试验研究

超高性能混凝土(UHPC)在工程结构加固领域应用前景广阔,新浇UHPC加固层与既有混凝土可靠的界面黏结性能,是确保加固结构服役性能的关键。为研究不同界面处理方式对UHPC与普通混凝土(NC)间黏结性能的影响,设计制作了6个Z形UHPC-NC界面抗剪试件,探究光滑、凿毛、凿毛+植筋3种不同UHPC-NC结合面黏结性能,并通过建立混凝土结合面非线性有限元模型,探讨剪切荷载作用下不同UHPC-NC结合面黏结应力的分布规律。结果表明:UHPC-NC界面黏结性能随结合面粗糙度增大不断提高,界面抗剪钢筋有利于延缓混凝土结合面脱黏和裂缝发展;相比光滑UHPC-NC结合面,平均凿毛深度为4 mm且植入4根直径8 mm抗剪钢筋的混凝土结合面,其抗剪强度、刚度及弹性刚度依次增大了156.1%、10.9%和101.0%,且随着界面裂缝不断发展,凿毛+植筋处理的UHPC-NC界面剪应力分布渐趋均匀,结合面残余黏结作用主要由界面抗剪钢筋提供。

THE INTERFACIAL BEHAVIORS OF ALUMINUM MATRIX COMPOSITE IN DIFFERENT WELDING METHODS

Non-interlayer liquid phase diffusion welding (China Patent) and laser welding methods for aluminum matrix composite are mainly described in this paper. In the non-interlayer liquid phase diffusion welding, the key processing parameters affecting the strength of joint is welding temperature. When temperature rises beyond solidus temperature, the bonded line vanishes. The strength of joint reaches the maximum and becomes constant when welding temperature is close to liquid phase temperature. Oxide film in the interface is no longer detected by SEM in the welded joint. With this kind of technique, particle reinforced aluminum matrix composite Al2 O3p/6061Al is welded successfully, and the joint strength is about 80% of the strength of composite (as-casted). In the laser welding, results indicate that because of the huge specific surface area of the reinforcement, the interfacial reaction between the matrix and the reinforcement is restrained intensively at certain laser power and pulsed laser beam. The laser pulse frequency directly affects the reinforcement segregation and the reinforcement distribution in the weld, so that the weldability of the composite could be improved by increasing the laser pulse frequency. The maximum strength of the weld can reach 70% of the strength of the parent.

A review of processing of Cu/C base plate composites for interfacial control and improved properties

The increase in both power and packing densities in power electronic devices has led to an increase in the market demand for effective heat-dissipating materials with a high thermal conductivity and thermal expansion coefficient compatible with chip materials while still ensuring the reliability of the power modules.Metal matrix composites,especially copper matrix composites,containing carbon fibers,carbon nanofibers,or diamond are considered very promising as the next generation of thermalmanagement materials in power electronic packages.These composites exhibit enhanced thermal properties,as compared to pure copper,combined with lower density.This paper presents powder metallurgy and hot uniaxial pressing fabrication techniques for copper/carbon composite materials which promise to be efficient heat-dissipation materials for power electronic modules.Thermal analyses clearly indicate that interfacial treatments are required in these composites to achieve high thermal and thermomechanical properties.Control of interfaces(through a novel reinforcement surface treatment,the addition of a carbide-forming element inside the copper powders,and processing methods),when selected carefully and processed properly,will form the right chemical/mechanical bonding between copper and carbon,enhancing all of the desired thermal and thermomechanical properties while minimizing the deleterious effects.This paper outlines a variety of methods and interfacial materials that achieve these goals.

Fatigue properties of special kind of reinforced concrete composite beams

The special reinforced concrete composite beam consists of a steel fiber reinforced self-stressing concrete composite layer and a reinforced concrete T-beam, and constructional bars are set up at their bonding interface. Fatigue properties of the composite beam under the action of negative moment were experimentally studied. Through inverted loading mode the load-beating state of a composite beam was simulated under the action of negative moment. With the ratios of constructional bars being 0, 0.082% and 0.164% respectively as parameters, the effects of constructional bars on the properties of composite beam, such as fatigue life, crack propagation, rigidity loss as well as damage behavior of bonding interface, were studied. The mechanism of the constructional bars on the fatigue properties of the composite beams and the restriction mechanism of crack widths and rigidity loss were analyzed. The test results show that the constructional bars can enhance the shear resistance of the bonding interface between composite layer and old concrete beam and restrict expanding of steel fiber reinforced self-stressing concrete, which are beneficial to synergistic action of composite layer and old concrete beam, to reducing the stress amplitude of bars and the crack width of composite layer, and to increasing the durability and fatigue life of the composite beam.

INVESTIGATION OF MULTIPHASE-REINFORCED Si_3N_4 COMPOSITE MATERIAL

By means of whisker reinforce and paricle dispersion, the routes of property improvement on Si3N4 ceramic material have been studied. The medhaniacl properties of Siw/Si3N4 and Siw/Si3N4TiC material was compared, which proved that multiphase reinforce had overlap effect. Microstructure of the rnaterial was investigated by means of SEM and the mechanisms of SiC. and TiCP reinforces had been disussed.

Surface wave transference in a piezoelectric cylinder coated with reinforced material

The present study deals with the propagation of a polarized shear horizontal(SH)wave in a pre-stressed piezoelectric cylinder circumscribed by a self-reinforced cylinder.The interface of the two media is assumed mechanically imperfect.For obtaining the dispersion relation,the mathematical formulation has been developed and solved by an analytical treatment.The effects of various parameters,i.e.,the thickness ratio,the imperfect interface,the initial stress,the reinforcement,and the piezoelectric and dielectric constants,on the dispersion curve are observed prominently.The dispersion curves for different modes have been also plotted.The consequences of the study may be used for achieving optimum efficiency of acoustic wave devices.

增强体表面改性在高导热金属基复合材料中的应用

随着电子技术的高速发展和电子器件的更新换代,电子封装材料的性能需求越来越高。金属基复合材料,尤其是铝基和铜基复合材料具有高导热、低膨胀、高稳定性等特点,是具有广阔应用前景的电子封装材料。然而,金刚石、石墨烯、硅等增强体与基体的润湿性差,或者在高温下与基体发生有害的界面反应,限制了此类高导热金属基复合材料的开发和应用。本文简述了金属基复合材料的界面研究进展,结合影响金属基复合材料界面结合的因素,提出了几种改善界面结合的方法。增强体表面改性是改善金属基复合材料界面的重要途径之一,常用工艺有磁控溅射法、化学气相沉积法、溶胶凝胶法、化学镀法等;最后,对增强体表面改性在高热导金属基复合材料中的应用进行分析和展望。

金属颗粒增强镁基复合材料制备技术及性能的研究进展

镁基复合材料具有低的密度、优异的力学性能等特点,在汽车、电子、航空航天等领域有广阔的应用前景。本文综述了国内外金属颗粒增强镁基复合材料的研究进展,详细介绍了金属颗粒增强镁基复合材料常见制备方法的特点,分析了金属颗粒增强镁基复合材料的界面结构和主要强韧化机理。最后,对金属颗粒增强镁基复合材料制备材料及工艺的发展进行了展望。

纤维增强热塑性复合材料/金属连接界面调控研究进展

综述了纤维增强热塑性复合材料/金属界面连接机制和界面调控的国内外研究动态,涵盖粘附和机械结合两种机制。简要概述了粘附机制的主要结合力类型,探讨了粘附机制下连接界面轻度较差的原因;重点关注了机械方法、化学方法、金属表面增材处理和激光加工4类机械结合界面调控方法,其中化学方法的使用会对环境造成一定危害,且难以精确控制微结构的形貌尺寸。而金属表面增材制备微观结构的方法目前还存在难以实现完全锚固且易变形造成应力集中的问题。利用高能量密度激光对金属表面进行粗化、清洗以及引入化学基团,可以在毫米、微米和纳米等不同尺度下调控微结构形貌,对接头强度的改善效果远高于喷砂、喷丸、砂纸打磨、铣削加工等机械方法。同时,超快脉冲激光与材料相互作用时间极短,热影响小,能加工出跨尺度复合结构,相比于其他金属表面处理方式,超快激光表面处理能更大程度上提高接头强度。

芯片用金刚石增强金属基复合材料研究进展

随着电子设备集成化程度越来越高,对高导热封装材料的需求也越来越大,金刚石增强金属基复合材料凭借其高导热性能成为研究焦点。然而,由于金刚石颗粒与金属基体之间的不润湿特性,具有高导热性的金刚石增强金属基复合材料难以制备。文中综述了金刚石增强金属基复合材料的研究进展,包括界面改性、工艺参数优化和复合材料制备方法,并指出了金刚石增强金属基复合材料目前存在的问题和今后的研究方向。