Optimized operation scheme of flash-memory-based neural network online training with ultra-high endurance

With the rapid development of machine learning,the demand for high-efficient computing becomes more and more urgent.To break the bottleneck of the traditional Von Neumann architecture,computing-in-memory(CIM)has attracted increasing attention in recent years.In this work,to provide a feasible CIM solution for the large-scale neural networks(NN)requiring continuous weight updating in online training,a flash-based computing-in-memory with high endurance(10^(9) cycles)and ultrafast programming speed is investigated.On the one hand,the proposed programming scheme of channel hot electron injection(CHEI)and hot hole injection(HHI)demonstrate high linearity,symmetric potentiation,and a depression process,which help to improve the training speed and accuracy.On the other hand,the low-damage programming scheme and memory window(MW)optimizations can suppress cell degradation effectively with improved computing accuracy.Even after 109 cycles,the leakage current(I_(off))of cells remains sub-10pA,ensuring the large-scale computing ability of memory.Further characterizations are done on read disturb to demonstrate its robust reliabilities.By processing CIFAR-10 tasks,it is evident that~90%accuracy can be achieved after 109 cycles in both ResNet50 and VGG16 NN.Our results suggest that flash-based CIM has great potential to overcome the limitations of traditional Von Neumann architectures and enable high-performance NN online training,which pave the way for further development of artificial intelligence(AI)accelerators.

Generation of endurance time excitation functions using spectral representation method

In this study,application of the spectral representation method for generation of endurance time excitation functions is introduced.Using this method,the intensifying acceleration time series is generated so that its acceleration response spectrum in any desired time duration is compatible with a time-scaled predefined acceleration response spectrum.For this purpose,simulated stationary acceleration time series is multiplied by the time dependent linear modulation function,then using a simple iterative scheme,it is forced to match a target acceleration response spectrum.It is shown that the generated samples have excellent conformity in low frequency,which is useful for nonlinear endurance time analysis.In the second part of this study,it is shown that this procedure can be extended to generate a set of spatially correlated endurance time excitation functions.This makes it possible to assess the performance of long structures under multi-support seismic excitation using endurance time analysis.

Effect of endurance training on the expression profile of circRNA-lncRNA-miRNA-mRNA in myocardial tissues of mice after exhaustive exercise

Objective:To clarify the effect of endurance training on the expression profile of circRNA-lncRNA-miRNA-mRNA in myocardial tissues of mice after exhaustive exercise.Methods:A total of 45 male C57BL/6 mice were randomly divided into control(C),low-strength endurance training(LSET)and high-strength endurance training(HSET)groups(n=15).The mice in the control group were not conducted to platform training.The mice in the LSET and HSET groups were conducted to platform training at 30%and 60%of exhaustive exercise once a day for 5 days a week,respectively.The exhaustion exercise was performed after 5 weeks of platform training.Total RNA was extracted from myocardial tissues,and the expression profile of circRNA-lncRNA-miRNA-mRNA in myocardial tissues was analyzed using Illimina transcriptome sequencing.Results:The distance and time of exhaustive exercise were longer in the LSET and HSET groups than in the control group,and the distance and time of exhaustive exercise were longer in the HSET group than in the LSET group(P<0.05).A total of 54 differentially expressed circRNAs(28 down-regulated and 26 up-regulated),7 differentially expressed lncRNAs(all down-regulated),3 differentially expressed miRNAs(1 down-regulated and 2 up-regulated)and 99 differentially expressed mRNAs(81 down-regulated and 18 up-regulated)were identified by transcriptome sequencing(P<0.05).Interaction network analysis revealed that ENSMUSG00000113041,MSTRG.79740,mmu-miR-374c-5p,18 down-regulated mRNAs and 3 up-regulated mRNAs formed a regulatory network.GO functional analysis revealed that the differentially expressed mRNAs were mainly enriched in primary metabolic processes and macromolecular synthesis and metabolic processes.KEGG pathway analysis revealed that the differentially expressed mRNAs were mainly enriched in complement and coagulation cascade pathways,estrogen signaling pathway and glucagon signaling pathway.Conclusion:Endurance training could alter the expression profile of circRNA-lncRNA-miRNA-mRNA in myocardial tissues of mice after exhaustive exercise,and these differentially expressed RNAs form a regulatory network that affects cardiomyocyte synthesis and metabolism and thus participates in the regulation of myocardial injury.

Endurance tests are the most reliable core stability related measurements

Purpose:To determine the intra-tester reliability of clinical measurements that assess five components related to core stability:strength. endurance,flexibility,motor control,and function. Methods:Participants were 15 college-aged males who had not suffered any orthopedic injury in the past year.Core strength measurements included eight isometric tests and a sit-up test.The four core endurance tests were the trunk flexor test,trunk extensor test,and bilateral side bridge tests.Flexibility tests included the sit-and-reach test and active range of the trunk and hip joint motions.Proprioception via passive reposition tests of the hips and a single limb balance test on an unsteady platform were used to evaluate core motor control.Functional measurements consisted of a squat test and a single leg hop test for time and distance.Measurements were performed during two data collection sessions with a week’s rest between the sessions.Intra-class correlation coefficients were calculated to establish reliability. Results:The overall intra-rater reliability for all core stability related measurements ranged from low(ICC = 0.35,left hip reposition) to very high(ICC = 0.98,sit-and-reach).As a group,the core endurance tests were observed to be the most reliable. Conclusion:There are highly reliable tests in each of the five groups.Overall,core endurance tests are the most reliable measurements,followed by the flexibility,strength,neuromuscular control,and functional tests,respectively.

Collapse assessment of steel moment frames using endurance time method

In endurance time(ET) method structures are subjected to a set of predesigned intensifying excitations. These excitations are produced in a way that their response spectrum, while complying with a specifi ed spectrum, intensifi es with time so they can be used approximately to simulate the average effects of several ground motions scaled to different intensities. In this paper applicability of the ET method for evaluating collapse potential of buildings is investigated. A set of four steel moment frames is used for collapse assessment. The process of using ET method in collapse evaluation is explained and the results are compared with incremental dynamic analysis(IDA) results. It is shown that although the computational effort using the ET method is much less than the IDA analysis, the results of both methods are consistent. Finally collapse fragility curves using ET and IDA methods are produced and it is shown that the probabilities of collapse in different hazard levels are also consistent.

Efficient structural seismic performance evaluation method using improved endurance time analysis

Evaluation of structural performance under seismic excitations from low intensity to high intensity is essential to verify the seismic resistant capacity of a structure, and usually carried out by the incremental dynamic analysis (IDA) method or pushover method. The recently developed endurance time (ET) method is another method that uses dynamic pushover excitations, i.e., endurance time acceleration function, to obtain results similar to those obtained by IDA or pushover methods with low computational cost and acceptable accuracy. This study proposes an improvement on the ET method by considering more restrictions for both the elastic and inelastic response spectra in the generation procedure, and by specifying a target duration. Four reinforced concrete frame structures with 4, 8, 12, and 16 stories are adopted to verify the accuracy of the improved method. Comparison of the results obtained by the proposed method, the ET method and the IDA method shows that the improved method has a higher accuracy than the ET method. For evaluation of structural responses under specifi c ground motion intensity, which is typically required in seismic design codes, the results obtained by the proposed method are compared with fi ve commonly used ground motion selection methods, and shows the proposed method provides acceptable accuracy for engineering applications.

How does high-intensity intermittent training affect recreational endurance runners? Acute and chronic adaptations: A systematic review

Objective: This systematic review aimed to critically analyze the literature to determine how high-intensity intermittent training(HIIT) affects recreational endurance runners in the short-and long-term.Methods: Electronic databases were searched for literature dating from January 2000 to October 2015. The search was conducted using the key words "high-intensity intermittent training" or "high-intensity interval exercise" or "interval running" or "sprint interval training" and "endurance runners" or "long distance runners". A systematic approach was used to evaluate the 783 articles identified for initial review. Studies were included if they investigated HIIT in recreational endurance runners. The methodological quality of the studies was evaluated using the Physiotherapy Evidence Database(PEDro) scale(for intervention studies) and the modified Downs and Black Quality Index(for cross-sectional studies).Results: Twenty-three studies met the inclusionary criteria for review. The results are presented in 2 parts: cross-sectional(n = 15) and intervention studies(n = 8). In the 15 cross-sectional studies selected, endurance runners performed at least 1 HIIT protocol, and the acute impact on physiological, neuromuscular, metabolic and/or biomechanical variables was assessed. Intervention studies lasted a minimum of 4 weeks, with 10 weeks being the longest intervention period, and included 2 to 4 HIIT sessions per week. Most of these studies combined HIIT sessions with continuous run(CR) sessions; 2 studies' subjects performed HIIT exclusively.Conclusion: HIIT-based running plans(2 to 3 HIIT sessions per week, combining HIIT and CR runs) show athletic performance improvements in endurance runners by improving maximal oxygen uptake and running economy along with muscular and metabolic adaptations. To maximize the adaptations to training, both HIIT and CR must be part of training programs for endurance runners.

Seismic assessment of unanchored steel storage tanks by endurance time method

Liquid storage tanks are essential structures that are often located in residential and industrial areas; thus an assessment of their seismic performance is an important engineering issue. In this paper, the seismic response ofunanchored steel liquid storage tanks is investigated using the endurance time （ET） dynamic analysis procedure and compared to responses obtained for anchored tanks under actual ground motions and intensifying ET records. In most cases, the results from ground motions are properly obtained with negligible differences using ET records. It is observed that uplifting of the tank base, which is closely related to the tank aspect ratio, has the greatest significance in the responses of the tank and can be predicted with reasonable accuracy by using currently available ET records.

Effect of Carbonitriding on Endurance Life of Ball Bearing Produced from SAE 52100 Bearing Steels

The present paper reports the unusual enhancement of endurance life of ball bearings subjected to carbonitriding treatment. The microstructure was characterized by scanning electron microscopy and correlated with hardness and X-ray diffraction analysis. Endurance tests at 90% reliability revealed that the carbonitrided bearings exhibit nearly ten times more life than the non-carbonitrided bearings. This is attributed to synergic combination of retained austenitic, fine martensitic microstructure and ultrafine carbide precipitates obtained by carbonitriding treatment.

Effects of Maca Extract on Exercise Endurance and Ultrastructure of Mitochondria in Spinal Neurons

[Objectives] To study the effects of maca extract on the exercise endurance and ultrastructure of mitochondria in spinal neurons.[Methods]First,50 Wistar rats were randomly divided into 5 groups. The control group: no swimming,administered intragastrically the same volume of distilled water; simple swimming group: free swimming,administered intragastrically the same volume of distilled water; maca extract groups: free swimming,and treated with 4. 0,5. 3,and 8. 0 g/kg dose of maca extracts. Swimming rats swam freely in the circulating water flow of swimming pool and administered for 15 d. On the 16 th d,after the swimming endurance test,the rats were killed painlessly. The ultrastructure of the mitochondria in the spinal neurons was observed with a projection electron microscope,muscle glycogen,malondialdehyde( MDA),superoxide dismutase( SOD),glutathione peroxidase( GSH-Px) and free calcium in muscle were measured by radioimmunoassay.[Results] Compared with the simple swimming group,the swimming time before sinking and total swimming time extended 19. 83%,60. 28%,77. 55% and 55. 34%,73. 91% and 94. 47% respectively,and the differences were statistically significant( P < 0. 01). The sinking times decreased by 34. 35%,51. 18% and 57. 96% respectively,the differences were statistically significant( P < 0. 01). MDA and free calcium decreased by 20. 10%,31. 49% and 38. 72%,respectively with statistically significant differences( P < 0. 01) and 6. 42%,17. 58%and 26. 35% respectively. The levels of SOD,GSH-Px and muscle glycogen increased by 5. 12%,22. 74%,52. 53%,44. 22%,77. 79%and 98. 45% respectively,with statistically significant differences( P < 0. 01) and 35. 08%,47. 83% and 81. 88%,respectively,with statistically significant differences( P < 0. 01). The volume density( Vd),surface density( Sd) and number density( Nd) of mitochondria of spinal neurons decreased by 7. 79%,18. 18%,31. 17%,16. 95%,27. 34%,43. 31% and 13. 51%,23. 19% and 43. 15% respectively.[Conclusions]Maca extract can protect ultrastructure of the mitochondria in the spinal neurons,antioxidant activity,increase muscle glycogen,and improving the exercise capacity.

Chronic exercise training versus acute endurance exercise in reducing neurotoxicity in rats exposed to lead acetate

After intraperitoneal injection of 20 mg/kg lead acetate, rats received 8 weeks of treadmill exercise （15-22 m/min, 25-64 minutes） and/or treadmill exercise at 1.6 km/h until exhaustion. The markers related to neurotoxicity were measured by enzyme-linked immunosorbent assay method. 8 weeks of treadmill exercise significantly increased brain-derived neurotrophic factor level in the hippocampus （P = 0.04） and plasma level of total antioxidant capacity of rats exposed to lead acetate （P 〈 0.001）, and significantly decreased plasma level of malondialdehyde （P 〈 0.001）. Acute exercise only decreased the hippocampal malondialdehyde level （P = 0.09） and increased brain-derived neurotrophic factor level in the hippocampus （P = 0.66）. Acute exercise also enhanced the total antioxidant capacity in rats exposed to lead acetate, insignificantly （P = 0.99）, These findings suggest that chronic treadmill exercise can significantly decrease neurotoxicity and alleviate oxidative stress in rats exposed to lead acetate. However, acute endurance exercise was not associated with these beneficial effects.

Endurance催化剂在长庆石化重油催化裂化装置上的应用

由于生产调整,长庆石化公司140×104t/a重油催化裂化装置原料由常压渣油变为全减压渣油,原料密度增大、残炭含量增高,反应生焦量大,制约了装置的加工量。为此,试用了Endurance重油深度转化催化剂。该催化剂在对渣油原料深度转化的同时,可最大量地降低焦炭产率。试用结果表明:Endurance催化剂初活性较高,衰减慢,且持久活性表现良好,抗重金属污染能力强,催化剂性能稳定,一段转化率较好,回炼油量减少;重油裂解能力较强,可以显著提高轻柴油、液化气收率,但汽油产率略有下降;可降低汽油烯烃含量,同时会造成汽油辛烷值的降低(汽油烯烃含量下降约3个百分点,汽油辛烷值下降约1个单位),对轻柴油、液化气质量基本没有影响;可明显降低催化剂单耗,试用期间,催化剂平均单耗由原来的1.46kg/t原料下降至1.25kg/t原料。

Thermal effect on endurance performance of 3-dimensional RRAM crossbar array

Three-dimensional（3D） crossbar array architecture is one of the leading candidates for future ultra-high density nonvolatile memory applications. To realize the technological potential, understanding the reliability mechanisms of the3 D RRAM array has become a field of intense research. In this work, the endurance performance of the 3D 1D1 R crossbar array under the thermal effect is investigated in terms of numerical simulation. It is revealed that the endurance performance of the 3D 1D1 R array would be seriously deteriorated under thermal effects as the feature size scales down to a relatively small value. A possible method to alleviate the thermal effects is provided and verified by numerical simulation.

Walking and Aerobic Capacity in Old Adults after Concentric and Eccentric Endurance Exercise at Self-Selected Intensities

Self-selected exercise intensity can be a useful exercise prescription tool for older adults;however, it is not known if it can elicit improvements in walking and aerobic capacity. In older adults, effects of concentric or eccentric endurance exercise at self-selected walking speed were examined on 1-mile indoor walk performance, predicted maximum oxygen uptake and physiological parameters. Twenty-four older adults (67 ± 4 years) completed 3 × 30 min treadmill walks per week for 12-weeks on level (LTW, n = 11, 0%) or downhill (DTW, n = 13, ﹣10%) treadmill gradient at a self- selected speed, which progressed every 4 weeks. Maximal oxygen uptake was predicted using a 1-mile walk at 4-week intervals with physiological responses recorded using a portable metabolic system. One-mile walking speed increased from baseline following 8- and 12-weeks (12 weeks: LTW: 13% ± 6%, DTW: 14% ± 9%,

Probabilistic seismic loss estimation via endurance time method

Probabilistic Seismic Loss Estimation is a methodology used as a quantitative and explicit expression of the performance of buildings using terms that address the interests of both owners and insurance companies. Applying the ATC 58 approach for seismic loss assessment of buildings requires using Incremental Dynamic Analysis （IDA）, which needs hundreds of time-consuming analyses, which in turn hinders its wide application. The Endurance Time Method （ETM） is proposed herein as part of a demand propagation prediction procedure and is shown to be an economical alternative to IDA. Various scenarios were considered to achieve this purpose and their appropriateness has been evaluated using statistical methods. The most precise and efficient scenario was validated through comparison against IDA driven response predictions of 34 code conforming benchmark structures and was proven to be sufficiently precise while offering a great deal of efficiency. The loss values were estimated by replacing IDA with the proposed ETM-based procedure in the ATC 58 procedure and it was fotmd that these values suffer from varying inaccuracies, which were attributed to the discretized nature of damage and loss prediction functions provided by ATC 58.

Endurance exercise and gut microbiota:A review

Background: The physiological and biochemical demands of intense exercise elicit both muscle-based and systemic responses. The main adaptations to endurance exercise include the correction of electrolyte imbalance, a decrease in glycogen storage and the increase of oxidative stress, intestinal permeability, muscle damage, and systemic inflammatory response. Adaptations to exercise might be influenced by the gut microbiota, which plays an important role in the production, storage, and expenditure of energy obtained from the diet as well as in inflammation,redox reactions, and hydration status.Methods: A systematic and comprehensive search of electronic databases, including MEDLINE, Scopus, Clinical Trials.gov, Science Direct,Springer Link, and EMBASE was done. The search process was completed using the keywords: "endurance", "exercise", "immune response","microbiota", "nutrition", and "probiotics".Results: Reviewed literature supports the hypothesis that intestinal microbiota might be able to provide a measureable, effective marker of an athlete's immune function and that microbial composition analysis might also be sensitive enough to detect exercise-induced stress and metabolic disorders. The review also supports the hypothesis that modifying the microbiota through the use of probiotics could be an important therapeutic tool to improve athletes' overall general health, performance, and energy availability while controlling inflammation and redox levels.Conclusion: The present review provides a comprehensive overview of how gut microbiota may have a key role in controlling the oxidative stress and inflammatory responses as well as improving metabolism and energy expenditure during intense exercise.

Effects of mRNA, Protein Expression and Activity for Myocardial SOD2 by a Single Bout of or Long-Term Strenuous Endurance Exercise in Rats

Objective: To explore the effects of myocardial SOD2 by strenuous endurance exercise. Methods: 27 grown male SD rats were randomly divided into control group (C), a single bout of strenuous endurance exercise group (E1) and seventh-week strenuous endurance exercise group (E2). Real-time PCR was used to observe the changes of mRNA expression for myocardial SOD2. Western bolt was used to observe the changes of SOD2 protein expression. In addition, SOD2, T-SOD and SOD1 activity changes were observed. Results: Myocardial SOD2 expression level at mRNA and protein of Group E1, E2 was significantly higher than that in group C, and SOD2 and T-SOD activity in group E2 were significantly higher than those in group C. Those changes were more obvious in group E2. Conclusions: Strenuous endurance exercise can improve level of myocardial SOD2 expression at mRNA and protein, and enhance the activity for SOD2, thus increasing the activity for T-SOD. Effect of long-term strenuous endurance exercise was better than a single bout of one.

Hippocampal ultrastructural changes and apoptotic cell death in rats following endurance training and acute exhaustive exercise

BACKGROUND： Exhaustive exercise can lead to apoptosis of skeletal muscle cells and myocardial cells as a result of pathological changes in the corresponding cellular ultrastructure. It is hypothesized that such changes could also occur in neurons. OBJECTIVE： To observe brain cell apoptosis and ultrastructural changes in hippocampal neurons in rats following endurance training and acute exhaustive exercise. DESIGN, TIME AND SETTING： A randomized, controlled, morphological analysis was performed at the Medical Laboratory Center of Zhengzhou University between July and November 2007. MATERIALS： Forty male, 8-week-old, Sprague Dawley rats were included in this study. METHODS： Endurance training consisted of treadmill running once a day, 6 days a week, for 4. weeks. For acute exhaustive exercise, graded treadmill running was conducted. Rats were exposed to exercise at an increasing speed （10 m/min, increasing to 20 and 36 m/min for moderate- and high-intensity exhaustive exercise, respectively, and then was continued until exhaustion）. A total of 40 rats were evenly distributed into the following 4. groups： Group A rats were not exercised; Group B rats were not trained but sacrificed 24 hours after acute exhaustive treadmill running exercise; Group C-rats were subjected to endurance training and sacrificed immediately after acute exhaustive treadmill running exercise; Group D rats were subjected to endurance training and sacrificed 24 hours after acute exhaustive treadmill running exercise. MAIN OUTCOME MEASURES： Apoptotic cell death was detected by the TUNEL method and hippocampal neuronal ultrastructural change was observed through using transmission electron microscopy. RESULTS： All 40 rats were included in the final analysis. Subsequent to exhaustive exercise, rat cerebral cortex and hippocampal neurons appeared contracted and degenerated. In addition, high amount of lipofuscin was visible in the hippocampal region, Necrotic neurons encased by glial cells appeared in the cerebral cortex and hippocampus. Glial cells exhibited different degrees of swelling. Subsequent to exhaustive exercise, brain cell apoptosis rate significantly increased, and reached over 30% in some regions, compared with group A （P 〈 0.05）. No significant difference in apoptosis rate existed between groups B, C, and D （P 〈 0.05）. CONCLUSION： Endurance training and acute exhaustive exercise cause, to some degree, injuries to glial cells, resulting in apoptosis of numerous brain cells. Subsequent to exhaustive exercise, high amounts of lipofuscin appear in the hippocampus, indicating that exhaustive exercise possibly contributes to neural cell aging or dysmetabolism.

Effects of intermittent sprint and plyometric training on endurance running performance

Purpose:The purpose of this study was to compare the effects of intermittent sprint training and plyometric training on endurance running performance.Methods:Fourteen moderately trained male endurance runners were allocated into either the intermittent sprint training group(n = 7)or the plyometric training group(n = 7).The preliminary tests required subjects to perform a treadmill graded exercise test,a countermovement jump test for peak power measurement,and a 10-km time trial.Training included 12 sessions of either intermittent sprint or plyometric training carried out twice per week.On completion of the intervention,post-tests were conducted.Results:Both groups showed significant reduction in weekly training mileage from pre-intervention during the intervention period.There were significant improvements in the 10-km time trial performance and peak power.There was also significant improvement in relative peak power for both groups.The 10-km time trial performance and relative peak power showed a moderate inverse correlation.Conclusion:These findings showed that both intermittent sprint and plyometric training resulted in improved 10-km running performance despite reduction in training mileage.The improvement in running performance was accompanied by an improvement in peak power and showed an inverse relationship with relative peak power.

Estimation of the Fatigue Endurance Limit of HMAC for Perpetual Pavements

A simplified procedure was described to estimate the FEL of three kinds of hot-mix asphalt concrete （HMAC） without doing any fatigue tests. The procedure required two fundamental properties of HMAC, tensile strength under different temperatures and strain rates, and flexural stiffness under different stain levels. This information can reliably be obtained in simple tests, which are the monotonic uniaxial tensile test （MUTT） and the four-point bending test （FPBT）. A new parameter, the initial stress ratio Rinitial, was introduced to connect these two tests, which was defined as the ratio of applied initial stress and tensile strength of the specimen. At last the FEL can be expressed as a function of the initial flexural stiffness, frequency and temperature. Obviously, this procedure has the potential to be very useful in view of long-life pavement design and time consuming traditional fatigue tests.