Automated deep learning system for power line inspection image analysis and processing: architecture and design issues

The continuous growth in the scale of unmanned aerial vehicle (UAV) applications in transmission line inspection has resulted in a corresponding increase in the demand for UAV inspection image processing. Owing to its excellent performance in computer vision, deep learning has been applied to UAV inspection image processing tasks such as power line identification and insulator defect detection. Despite their excellent performance, electric power UAV inspection image processing models based on deep learning face several problems such as a small application scope, the need for constant retraining and optimization, and high R&D monetary and time costs due to the black-box and scene data-driven characteristics of deep learning. In this study, an automated deep learning system for electric power UAV inspection image analysis and processing is proposed as a solution to the aforementioned problems. This system design is based on the three critical design principles of generalizability, extensibility, and automation. Pre-trained models, fine-tuning (downstream task adaptation), and automated machine learning, which are closely related to these design principles, are reviewed. In addition, an automated deep learning system architecture for electric power UAV inspection image analysis and processing is presented. A prototype system was constructed and experiments were conducted on the two electric power UAV inspection image analysis and processing tasks of insulator self-detonation and bird nest recognition. The models constructed using the prototype system achieved 91.36% and 86.13% mAP for insulator self-detonation and bird nest recognition, respectively. This demonstrates that the system design concept is reasonable and the system architecture feasible .

Processing of Laser Scanner Data and Extraction of Structure Lines Using Methods of the Image Processing

激光扫描数据提供了一种新的手段用于获取高精度的数字地形表面模型。原始的航空激光扫描数据表达的是一些非规则分布的“点云” ,这些非规则分布的点需要进行有效的事后处理。这种事后处理有 2个目的 :一是将那些分布在地表面上的点 (即地面点 )与分布在非地表面上的点 (譬如树木、房屋或汽车上的点 ,即非地面点 )进行有效的分离 ;二是从分离后的地面点中提取结构线 ,用于建立高精度的数字地面模型。作者发展了一系列的基于数字形态学理论和稳健参数估计理论的方法用于分离和探测地面点。这里所介绍和开发的提取结构线的算法建立在数字图像处理和表面曲率理论的基础上。这些算法同样可以扩展地用于其他领域。所介绍的基于数字图像处理理论处理原始的航空激光扫瞄数据和提取结构线的方法取得了很好的结果。

ON-LINE PROBLEMS OF MINIMIZING MAKESPAN ON A SINGLE BATCH PROCESSING MACHINE WITH NONIDENTICAL JOB SIZES

The on-line problem of scheduling on a batch processing machine with nonidentical job sizes to minimize makespan is considered. The batch processing machine can process a number of jobs simultaneously as long as the total size of these jobs being processed does not exceed the machine capacity. The processing time of a batch is given by the longest processing time of any job in the batch. Each job becomes available at its arrival time, which is unknown in advance, and its processing time becomes known upon its arrival. The paper deals with two variants： the case only with two distinct arrival times and the general case. For the first case, an on-line algorithm with competitive ratio 119/44 is given. For the latter one, a simple algorithm with competitive ratio 3 is given. For both variants the better ratios can be obtained if the problem satisfies proportional assumption.

An Energy Saving Glass Deep Processing Line Put into Production in Hubei

On July 16, 2013, the first low-E energy saving glass deep processing line of Hubei Zhongyi Glass Co., Ltd. was put into production in Changyang County of Hubei Province. Low-E glass is a kind of new glass featured with good lighting, thermal insulation, and ultraviolet radiation resistance. So far contracts worth about CNY 50 million have been signed.

Research on Flexible Transfer Line Schematic Design Using Hierarchical Process Planning

Flexible transfer line(FTL)is now widely used in ma ny manufacturing domains to realize efficiently,high quantity and economic prod uction.These manufacturing domains include automobile,tractor,internal-combu stion engine,and so on.In today’s competitive business environment,it is vit ally important for machine tool manufacturers to design flexible transfer line m ore effectively and efficiently according to a wider variety of customer demand s.This paper proposes an approach to a bidding-based flexible transfer line sc hematic design system.By analyzing manual FTL design process,the architecture o f flexible transfer line schematic design system(FTLSDS)is established.The syst em consists:of four processes:part feature modeling,process planning,FTL fac i lity layout and FTL evaluation. For FTL schematic design.a five-level proces s planning strategy named hierarchical process planning method is proposed.This method includes selection of manufacturing feature machining operation;part se t-up planning,feature sequencing,operation sequencing and process plan genera ting.The major decision relies on setup planning.According to the proceeding o f the hierarchical process planning,the structure of reasoning is proposed base d on blackboard.Under this paradigm,a cooperative effort between a hybrid coll ection of knowledge sources is possible.Total reasoning task can be divided int o some subtasks,and recursive-reasoning system is formed.It is convenient for process planning with step-by-step solution.Meanwhile,the blackboard is use d as the global data exchange area during all reasoning process.By using modula r technology,special purpose machine tools can be designed more efficiently and rapidly.The framework of machine modular design system to support machine requ irement design for FTL is established.By synthesizing the FTL evaluation criter ia.five evaluation criteria of flexible transfer 1ine schematic design are take n into account.An exampie is supplied to demonstrate and verify the validity an d feasibility of flexible transfer line schematic design approach.

Study on the automatic process of line heating for pillow shape plate

This paper focuses on the process for pillow shape plate by line heating technique, which is widely applied in the production of ship hull. Based on the analysis of primary parameters and experimental data in line heating process, the amount of local contraction generated by line heating has been illustrated. Then, combining with the computational result of local deformation determined by shell plate development, an optimization method for line heating parameters has been studied. This prediction system may provide rational arrangements of heating lines and technical parameters of process. By integrating the prediction system into the line heating robot for pillow shape plate, the automatic process of line heating for pillow shape plate can be achieved.

Stochastic Model for Multiple Classes and Subclasses Simple Documents Processing

The issue of document management has been raised for a long time, especially with the appearance of office automation in the 1980s, which led to dematerialization and Electronic Document Management (EDM). In the same period, workflow management has experienced significant development, but has become more focused on the industry. However, it seems to us that document workflows have not had the same interest for the scientific community. But nowadays, the emergence and supremacy of the Internet in electronic exchanges are leading to a massive dematerialization of documents;which requires a conceptual reconsideration of the organizational framework for the processing of said documents in both public and private administrations. This problem seems open to us and deserves the interest of the scientific community. Indeed, EDM has mainly focused on the storage (referencing) and circulation of documents (traceability). It paid little attention to the overall behavior of the system in processing documents. The purpose of our researches is to model document processing systems. In the previous works, we proposed a general model and its specialization in the case of small documents (any document processed by a single person at a time during its processing life cycle), which represent 70% of documents processed by administrations, according to our study. In this contribution, we extend the model for processing small documents to the case where they are managed in a system comprising document classes organized in subclasses;which is the case for most administrations. We have thus observed that this model is a Markovian ML×K/ML×K/1 queues network. We have analyzed the constraints of this model and deduced certain characteristics and metrics. In fine, the ultimate objective of our work is to design a document workflow management system, integrating a component of global behavior prediction.

Approach to monitoring, data processing and regularity on landslip in open-pits

A new method of landslip monitoring in open-pit is presented, in which the monitoring data processing and a variety of deformation curvilinear drawings are carried out by microcomputer system, based on the practice in Haizhou Open-Mine for many years. Meanwhile, the general regularity on landslip in open-pit is acquired.

Developing of robot flexible processing system for shipbuilding profile steel

A robot flexible processing system of shipbuilding profile steel was developed. The system consists of computer integrated control and robot. An off line programming robot was used for marking and cutting of shipbuilding profile steel. In the system the deformation and position error of profile steel can be detected by precise sensors, and figure position coordinate error resulted from profile steel deformation can be compensated by modifying traveling track of robotic arm online. The practical operation results show that the system performance can meet the needs of profile steel processing.

Sectional Dimensions Identification of Metal Profile by Image Processing

In steel plants, estimation of the production system characteristic is highly critical to adjust the system parameters for best efficiency. Although the system parameters may be tuned very well, due to the machine and human factors involved in the production line some deficiencies may occur in product. It is important to detect such problems as early as possible. Surface defects and dimensional deviations are the most important quality problems. In this study, it is aimed to develop an approach to measure the dimensions of metal profiles by obtaining images of them. This will be of use in detecting the deviations in dimensions. A platform was introduced to simulate the real-time environment and images were taken from the metal profile using 4 laser light sources. The shape of the material is generated by combining the images taken from different cameras. Real dimensions were obtained by using image processing and mathematical conversion operations on the images. The results obtained with small deviations from the real values showed that this method can be applied in a real-time production line.

Modeling of Microstructure Evolution and Mechanical Properties of Steel Plates Produced by Thermo-Mechanical Control Process and Its On-line Application

An integrated metallurgical model was developed to predict microstructure evolution and mechanical properties of low-carbon steel plates produced by TMCP. The metallurgical phenomena occurring during TMCP and mechanical properties were predicted for different process parameters. In the later passes full recrystallization becomes difficult to occur and higher residual strain remains in austenite after rolling. For the reasonable temperature and cooling schedule, yield strength of 30 mm plain carbon steel plate can reach 310 MPa. The first on-line application of prediction and control of microstructure and properties (PCMP) in the medium plate production was achieved. The predictions of the system are in good agreement with measurements.

Multi-Objective Genetic Algorithm to Design Manufacturing Process Line Including Feasible and Infeasible Solutions in Neighborhood

This paper treats multi-objective problem for manufacturing process design. A purpose of the process design is to decide combinations of work elements assigned to different work centers. Multiple work elements are ordinarily assigned to each center. Here, infeasible solutions are easily generated by precedence relationship of work elements in process design. The number of infeasible solutions generated is ordinarily larger than that of feasible solutions generated in the process. Therefore, feasible and infeasible solutions are located in any neighborhood in solution space. It is difficult to seek high quality Pareto solutions in this problem by using conventional multi-objective evolutional algorithms. We consider that the problem includes difficulty to seek high quality solutions by the following characteristics： （1） Since infeasible solutions are resemble to good feasible solutions, many infeasible solutions which have good values of objective functions are easily sought in the search process, （2） Infeasible solutions are useful to select new variable conditions generating good feasible solutions in search process. In this study, a multi-objective genetic algorithm including local search is proposed using these characteristics. Maximum value of average operation times and maximum value of dispersion of operation time in all work centers are used as objective functions to promote productivity. The optimal weighted coefficient is introduced to control the ratio of feasible solutions to all solutions selected in crossover and selection process in the algorithm. This paper shows the effectiveness of the proposed algorithm on simple model.

An Implementation of Multiscale Line Detection and Mathematical Morphology for Efficient and Precise Blood Vessel Segmentation in Fundus Images

Diagnosing various diseases such as glaucoma,age-related macular degeneration,cardiovascular conditions,and diabetic retinopathy involves segmenting retinal blood vessels.The task is particularly challenging when dealing with color fundus images due to issues like non-uniformillumination,low contrast,and variations in vessel appearance,especially in the presence of different pathologies.Furthermore,the speed of the retinal vessel segmentation system is of utmost importance.With the surge of now available big data,the speed of the algorithm becomes increasingly important,carrying almost equivalent weightage to the accuracy of the algorithm.To address these challenges,we present a novel approach for retinal vessel segmentation,leveraging efficient and robust techniques based on multiscale line detection and mathematical morphology.Our algorithm’s performance is evaluated on two publicly available datasets,namely the Digital Retinal Images for Vessel Extraction dataset(DRIVE)and the Structure Analysis of Retina(STARE)dataset.The experimental results demonstrate the effectiveness of our method,withmean accuracy values of 0.9467 forDRIVE and 0.9535 for STARE datasets,aswell as sensitivity values of 0.6952 forDRIVE and 0.6809 for STARE datasets.Notably,our algorithmexhibits competitive performance with state-of-the-art methods.Importantly,it operates at an average speed of 3.73 s per image for DRIVE and 3.75 s for STARE datasets.It is worth noting that these results were achieved using Matlab scripts containing multiple loops.This suggests that the processing time can be further reduced by replacing loops with vectorization.Thus the proposed algorithm can be deployed in real time applications.In summary,our proposed system strikes a fine balance between swift computation and accuracy that is on par with the best available methods in the field.

Local Torrential Rainfall Event within a Mei-Yu Season Mesoscale Convective System:Importance of Back-Building Processes

An extreme rainfall event occurred over Hangzhou,China,during the afternoon hours on 24 June 2013.This event occurred under suitable synoptic conditions and the maximum 4-h cumulative rainfall amount was over 150 mm.This rainfall event had two major rainbands.One was caused by a quasi-stationary convective line,and the other by a backbuilding convective line related to the interaction of the outflow boundary from the first rainband and an existing low-level mesoscale convergence line associated with a mei-yu frontal system.The rainfall event lasted 4 h,while the back-building process occurred in 2 h when the extreme rainfall center formed.So far,few studies have examined the back-building processes in the mei-yu season that are caused by the interaction of a mesoscale convergence line and a convective cold pool.The two rainbands are successfully reproduced by the Weather Research and Forecasting(WRF)model with fourlevel,two-way interactive nesting.In the model,new cells repeatedly occur at the west side of older cells,and the backbuilding process occurs in an environment with large CAPE,a low LFC,and plenty of water vapor.Outflows from older cells enhance the low-level convergence that forces new cells.High precipitation efficiency of the back-building training cells leads to accumulated precipitation of over 150 mm.Sensitivity experiments without evaporation of rainwater show that the convective cold pool plays an important role in the organization of the back-building process in the current extreme precipitation case.

An FPGA-based real-time image processing system

This paper analyzes the current difficulties encountered in on-line inspection systems of strip surface quality, specifically relating to problems with real-time processing of huge amounts of data. To address this need, this paper describes an FPGA-based high-speed image processing module with both hardware and software aspects. Improving these two aspects together will help the system achieve real-time processing of massive image data, and simplifies the architecture of the strip surface quality on-line inspection system.

采用Process Designer的白车身焊装生产线工艺规划研究

白车身焊装生产线工艺规划是决定汽车整车生产周期的重要环节。以先进的数字化工厂技术软件——ProcessDesigner为平台,通过创建制造信息模型和工艺过程模型,实现对白车身焊装生产线的生产信息管理和工艺过程规划,构建了白车身焊装生产线工艺规划系统,并详细描述了其工艺规划实现的具体方法和步骤,最后以某型白车身底板焊装线为例,生成了基于规划系统的数字化三维工厂,对规划结果进行了验证。结果表明,利用该系统进行焊装工艺规划能显著缩短工艺规划时间,提高工艺规划的准确性。

一个改进的陆面过程模式及其模拟试验研究第一部分:陆面过程模式及其“独立(off-line)”模拟试验和模式性能分析

文中在综合比较过去各类陆面过程模式优缺点的基础上，主要参考ＢＡＴＳ模式，发展了一个陆面过程模式（ＬＰＭ－ＺＤ）。它具有以下几个特征：１．采用物理方程和经验解析公式相结合的方法进行土壤温度和土壤水汽的求解。在上层土壤，土壤分层较细并采用温度传导和水汽扩散方程求解，而在下层土壤，土壤分层较粗并利用经验方法处理。２．考虑了降水分布的次网格特征及其对陆面水文产生的重要影响。３．较全面地考虑了雪盖对陆面过程的各种影响：对陆面水文的影响、对土壤热传导的影响以及雪盖的高反照率对辐射收支的影响。利用３组单点观测试验资料对陆面过程模式ＬＰＭ－ＺＤ进行了“独立（ｏｆ－ｌｉｎｅ）”模拟试验。模拟结果表明陆面过程模式ＬＰＭ－ＺＤ具有较好的模拟性能，能够比较准确地模拟不同气候区的多种下垫面类型的陆面过程变化特点，模拟结果与观测基本一致。进而又利用一组观测资料和模式ＬＰＭ－ＺＤ进行了一系列敏感性模拟试验，试验结果表明模式ＬＰＭ－ＺＤ对一些参数的确定非常敏感，如初始土壤水汽、植被的物理特性参数以及降水次网格分布因子等，因此提高确定这些参数的准确性是改进陆面模式的重要内容之一。

A new straight line detection method in images for robot seam tracking

A new efftcient straight line detection algorithm, GPI （ Gray Projecting Integral） method is proposed. The gray values of a sub-window are projected onto a line, and sum the gray values which are projected onto one same point to shape a special vector, then rotate the projecting direction, obtain many such vectors corresponding to different projecting directions. The vectors can form a matrix, a GPI matrix of the sub-image. The problem of lines detection is converted into maxima or minima searching problem in the GPI matrix. Bused on the GPI matrix, the lines can be calculated. Different from traditional methods, the algorithm can detect the positions of lines accurately, quickly without previous edge detection, which costs less time, and avoids the error resulted from the poor threshold with traditional methods. This algorithm is useful and efftcient for numerous image understanding applications and robot visual navigation, especially for welded joint position detection in heavy noise.

Adaptive broadband beamformer for nonuniform linear array based on second order cone programming

Adaptive broadband beamforraing is a key issue in array applications. The adaptive broadband beamformer with tapped delay line （TDL） structure for nonuniform linear array （NLA） is designed according to the rule of minimizing the beamformer＇s output power while keeping the distortionless response （DR） in the direction of desired signal and keeping the constant beamwidth （CB） with the prescribed sidelobe level over the whole operating band. This kind of beamforming problem can be solved with the interior-point method after being converted to the form of standard second order cone programming （SOCP）. The computer simulations are presented which illustrate the effectiveness of our beamformer.

Analysis of Strain Clamp Failure on 500 kV Transmission Line

In this work, the main reasons for the breakage of 500 kV transmission line are studied. Under low temperature condition, the coverage of the ice results in the disconnection between the aluminum tube and the steel anchor of strain clamp. Using macroscopic analysis, structure stress analysis, force analysis and mechanical property test, the fractured strain clamps are investigated. The crimping of the aluminum tube on the polished rod not on the grooves of the steel anchor leads to the damage of the strain clamps, which is defined as improper crimping. When improper crimping emerges, there will be only friction force between the aluminum tube and the steel anchor without shear force, and the tension of the conductor will be mainly supported by the steel strands which should be supported by both the aluminum tube and steel stands. Therefore, the breaking force of the strain clamp will greatly decrease. The failure analysis helps to promote the proper hydraulic crimping process and the safe operation of the transmission line.