Automated deep learning system for power line inspection image analysis and processing: architecture and design issues

The continuous growth in the scale of unmanned aerial vehicle (UAV) applications in transmission line inspection has resulted in a corresponding increase in the demand for UAV inspection image processing. Owing to its excellent performance in computer vision, deep learning has been applied to UAV inspection image processing tasks such as power line identification and insulator defect detection. Despite their excellent performance, electric power UAV inspection image processing models based on deep learning face several problems such as a small application scope, the need for constant retraining and optimization, and high R&D monetary and time costs due to the black-box and scene data-driven characteristics of deep learning. In this study, an automated deep learning system for electric power UAV inspection image analysis and processing is proposed as a solution to the aforementioned problems. This system design is based on the three critical design principles of generalizability, extensibility, and automation. Pre-trained models, fine-tuning (downstream task adaptation), and automated machine learning, which are closely related to these design principles, are reviewed. In addition, an automated deep learning system architecture for electric power UAV inspection image analysis and processing is presented. A prototype system was constructed and experiments were conducted on the two electric power UAV inspection image analysis and processing tasks of insulator self-detonation and bird nest recognition. The models constructed using the prototype system achieved 91.36% and 86.13% mAP for insulator self-detonation and bird nest recognition, respectively. This demonstrates that the system design concept is reasonable and the system architecture feasible .

Sectional Dimensions Identification of Metal Profile by Image Processing

In steel plants, estimation of the production system characteristic is highly critical to adjust the system parameters for best efficiency. Although the system parameters may be tuned very well, due to the machine and human factors involved in the production line some deficiencies may occur in product. It is important to detect such problems as early as possible. Surface defects and dimensional deviations are the most important quality problems. In this study, it is aimed to develop an approach to measure the dimensions of metal profiles by obtaining images of them. This will be of use in detecting the deviations in dimensions. A platform was introduced to simulate the real-time environment and images were taken from the metal profile using 4 laser light sources. The shape of the material is generated by combining the images taken from different cameras. Real dimensions were obtained by using image processing and mathematical conversion operations on the images. The results obtained with small deviations from the real values showed that this method can be applied in a real-time production line.

Processing of Laser Scanner Data and Extraction of Structure Lines Using Methods of the Image Processing

激光扫描数据提供了一种新的手段用于获取高精度的数字地形表面模型。原始的航空激光扫描数据表达的是一些非规则分布的“点云” ,这些非规则分布的点需要进行有效的事后处理。这种事后处理有 2个目的 :一是将那些分布在地表面上的点 (即地面点 )与分布在非地表面上的点 (譬如树木、房屋或汽车上的点 ,即非地面点 )进行有效的分离 ;二是从分离后的地面点中提取结构线 ,用于建立高精度的数字地面模型。作者发展了一系列的基于数字形态学理论和稳健参数估计理论的方法用于分离和探测地面点。这里所介绍和开发的提取结构线的算法建立在数字图像处理和表面曲率理论的基础上。这些算法同样可以扩展地用于其他领域。所介绍的基于数字图像处理理论处理原始的航空激光扫瞄数据和提取结构线的方法取得了很好的结果。

An Implementation of Multiscale Line Detection and Mathematical Morphology for Efficient and Precise Blood Vessel Segmentation in Fundus Images

Diagnosing various diseases such as glaucoma,age-related macular degeneration,cardiovascular conditions,and diabetic retinopathy involves segmenting retinal blood vessels.The task is particularly challenging when dealing with color fundus images due to issues like non-uniformillumination,low contrast,and variations in vessel appearance,especially in the presence of different pathologies.Furthermore,the speed of the retinal vessel segmentation system is of utmost importance.With the surge of now available big data,the speed of the algorithm becomes increasingly important,carrying almost equivalent weightage to the accuracy of the algorithm.To address these challenges,we present a novel approach for retinal vessel segmentation,leveraging efficient and robust techniques based on multiscale line detection and mathematical morphology.Our algorithm’s performance is evaluated on two publicly available datasets,namely the Digital Retinal Images for Vessel Extraction dataset(DRIVE)and the Structure Analysis of Retina(STARE)dataset.The experimental results demonstrate the effectiveness of our method,withmean accuracy values of 0.9467 forDRIVE and 0.9535 for STARE datasets,aswell as sensitivity values of 0.6952 forDRIVE and 0.6809 for STARE datasets.Notably,our algorithmexhibits competitive performance with state-of-the-art methods.Importantly,it operates at an average speed of 3.73 s per image for DRIVE and 3.75 s for STARE datasets.It is worth noting that these results were achieved using Matlab scripts containing multiple loops.This suggests that the processing time can be further reduced by replacing loops with vectorization.Thus the proposed algorithm can be deployed in real time applications.In summary,our proposed system strikes a fine balance between swift computation and accuracy that is on par with the best available methods in the field.

Local Torrential Rainfall Event within a Mei-Yu Season Mesoscale Convective System:Importance of Back-Building Processes

An extreme rainfall event occurred over Hangzhou,China,during the afternoon hours on 24 June 2013.This event occurred under suitable synoptic conditions and the maximum 4-h cumulative rainfall amount was over 150 mm.This rainfall event had two major rainbands.One was caused by a quasi-stationary convective line,and the other by a backbuilding convective line related to the interaction of the outflow boundary from the first rainband and an existing low-level mesoscale convergence line associated with a mei-yu frontal system.The rainfall event lasted 4 h,while the back-building process occurred in 2 h when the extreme rainfall center formed.So far,few studies have examined the back-building processes in the mei-yu season that are caused by the interaction of a mesoscale convergence line and a convective cold pool.The two rainbands are successfully reproduced by the Weather Research and Forecasting(WRF)model with fourlevel,two-way interactive nesting.In the model,new cells repeatedly occur at the west side of older cells,and the backbuilding process occurs in an environment with large CAPE,a low LFC,and plenty of water vapor.Outflows from older cells enhance the low-level convergence that forces new cells.High precipitation efficiency of the back-building training cells leads to accumulated precipitation of over 150 mm.Sensitivity experiments without evaporation of rainwater show that the convective cold pool plays an important role in the organization of the back-building process in the current extreme precipitation case.

ON-LINE PROBLEMS OF MINIMIZING MAKESPAN ON A SINGLE BATCH PROCESSING MACHINE WITH NONIDENTICAL JOB SIZES

The on-line problem of scheduling on a batch processing machine with nonidentical job sizes to minimize makespan is considered. The batch processing machine can process a number of jobs simultaneously as long as the total size of these jobs being processed does not exceed the machine capacity. The processing time of a batch is given by the longest processing time of any job in the batch. Each job becomes available at its arrival time, which is unknown in advance, and its processing time becomes known upon its arrival. The paper deals with two variants： the case only with two distinct arrival times and the general case. For the first case, an on-line algorithm with competitive ratio 119/44 is given. For the latter one, a simple algorithm with competitive ratio 3 is given. For both variants the better ratios can be obtained if the problem satisfies proportional assumption.

An Energy Saving Glass Deep Processing Line Put into Production in Hubei

On July 16, 2013, the first low-E energy saving glass deep processing line of Hubei Zhongyi Glass Co., Ltd. was put into production in Changyang County of Hubei Province. Low-E glass is a kind of new glass featured with good lighting, thermal insulation, and ultraviolet radiation resistance. So far contracts worth about CNY 50 million have been signed.

Research on Flexible Transfer Line Schematic Design Using Hierarchical Process Planning

Flexible transfer line(FTL)is now widely used in ma ny manufacturing domains to realize efficiently,high quantity and economic prod uction.These manufacturing domains include automobile,tractor,internal-combu stion engine,and so on.In today’s competitive business environment,it is vit ally important for machine tool manufacturers to design flexible transfer line m ore effectively and efficiently according to a wider variety of customer demand s.This paper proposes an approach to a bidding-based flexible transfer line sc hematic design system.By analyzing manual FTL design process,the architecture o f flexible transfer line schematic design system(FTLSDS)is established.The syst em consists:of four processes:part feature modeling,process planning,FTL fac i lity layout and FTL evaluation. For FTL schematic design.a five-level proces s planning strategy named hierarchical process planning method is proposed.This method includes selection of manufacturing feature machining operation;part se t-up planning,feature sequencing,operation sequencing and process plan genera ting.The major decision relies on setup planning.According to the proceeding o f the hierarchical process planning,the structure of reasoning is proposed base d on blackboard.Under this paradigm,a cooperative effort between a hybrid coll ection of knowledge sources is possible.Total reasoning task can be divided int o some subtasks,and recursive-reasoning system is formed.It is convenient for process planning with step-by-step solution.Meanwhile,the blackboard is use d as the global data exchange area during all reasoning process.By using modula r technology,special purpose machine tools can be designed more efficiently and rapidly.The framework of machine modular design system to support machine requ irement design for FTL is established.By synthesizing the FTL evaluation criter ia.five evaluation criteria of flexible transfer 1ine schematic design are take n into account.An exampie is supplied to demonstrate and verify the validity an d feasibility of flexible transfer line schematic design approach.

Stochastic Model for Multiple Classes and Subclasses Simple Documents Processing

The issue of document management has been raised for a long time, especially with the appearance of office automation in the 1980s, which led to dematerialization and Electronic Document Management (EDM). In the same period, workflow management has experienced significant development, but has become more focused on the industry. However, it seems to us that document workflows have not had the same interest for the scientific community. But nowadays, the emergence and supremacy of the Internet in electronic exchanges are leading to a massive dematerialization of documents;which requires a conceptual reconsideration of the organizational framework for the processing of said documents in both public and private administrations. This problem seems open to us and deserves the interest of the scientific community. Indeed, EDM has mainly focused on the storage (referencing) and circulation of documents (traceability). It paid little attention to the overall behavior of the system in processing documents. The purpose of our researches is to model document processing systems. In the previous works, we proposed a general model and its specialization in the case of small documents (any document processed by a single person at a time during its processing life cycle), which represent 70% of documents processed by administrations, according to our study. In this contribution, we extend the model for processing small documents to the case where they are managed in a system comprising document classes organized in subclasses;which is the case for most administrations. We have thus observed that this model is a Markovian ML×K/ML×K/1 queues network. We have analyzed the constraints of this model and deduced certain characteristics and metrics. In fine, the ultimate objective of our work is to design a document workflow management system, integrating a component of global behavior prediction.

Study on the automatic process of line heating for pillow shape plate

This paper focuses on the process for pillow shape plate by line heating technique, which is widely applied in the production of ship hull. Based on the analysis of primary parameters and experimental data in line heating process, the amount of local contraction generated by line heating has been illustrated. Then, combining with the computational result of local deformation determined by shell plate development, an optimization method for line heating parameters has been studied. This prediction system may provide rational arrangements of heating lines and technical parameters of process. By integrating the prediction system into the line heating robot for pillow shape plate, the automatic process of line heating for pillow shape plate can be achieved.

Approach to monitoring, data processing and regularity on landslip in open-pits

A new method of landslip monitoring in open-pit is presented, in which the monitoring data processing and a variety of deformation curvilinear drawings are carried out by microcomputer system, based on the practice in Haizhou Open-Mine for many years. Meanwhile, the general regularity on landslip in open-pit is acquired.

Developing of robot flexible processing system for shipbuilding profile steel

A robot flexible processing system of shipbuilding profile steel was developed. The system consists of computer integrated control and robot. An off line programming robot was used for marking and cutting of shipbuilding profile steel. In the system the deformation and position error of profile steel can be detected by precise sensors, and figure position coordinate error resulted from profile steel deformation can be compensated by modifying traveling track of robotic arm online. The practical operation results show that the system performance can meet the needs of profile steel processing.

Vision Navigation Based PID Control for Line Tracking Robot

In a controlled indoor environment,line tracking has become the most practical and reliable navigation strategy for autonomous mobile robots.A line tracking robot is a self-mobile machine that can recognize and track a painted line on thefloor.In general,the path is set and can be visible,such as a black line on a white surface with high contrasting colors.The robot’s path is marked by a distinct line or track,which the robot follows to move.Several scientific contributions from the disciplines of vision and control have been made to mobile robot vision-based navigation.Localization,automated map generation,autonomous navigation and path tracking is all becoming more frequent in vision applications.A visual navigation line tracking robot should detect the line with a camera using an image processing technique.The paper focuses on combining computer vision techniques with a proportional-integral-derivative(PID)control-ler for automatic steering and speed control.A prototype line tracking robot is used to evaluate the proposed control strategy.

Modeling of Microstructure Evolution and Mechanical Properties of Steel Plates Produced by Thermo-Mechanical Control Process and Its On-line Application

An integrated metallurgical model was developed to predict microstructure evolution and mechanical properties of low-carbon steel plates produced by TMCP. The metallurgical phenomena occurring during TMCP and mechanical properties were predicted for different process parameters. In the later passes full recrystallization becomes difficult to occur and higher residual strain remains in austenite after rolling. For the reasonable temperature and cooling schedule, yield strength of 30 mm plain carbon steel plate can reach 310 MPa. The first on-line application of prediction and control of microstructure and properties (PCMP) in the medium plate production was achieved. The predictions of the system are in good agreement with measurements.

Development and characterization of wheat–Aegilops kotschyi 1U^(k)(1A)substitution line with positive dough quality parameters

Exploring novel high molecular weight glutenin subunits(HMW-GSs)from wild related species is a strategy to improve wheat processing quality.The objective of the present investigation was to identify the chromosomes of the wheatalien introgression line N124,derived from the hybridization between Triticum aestivum with Aegilops kotschyi,and characterize the effects on quality-related traits.Fluorescence in situ hybridization karyotypes showed that N124 is a disomic 1U^(k)(1A)substitution line.Sodium dodecyl sulfate polyacrylamide gel electrophoresis(SDS-PAGE)and reversedphase high-performance liquid chromatography verified N124 expressed two HMW-GSs of the Ae.kotschyi parent.PacBio RNA sequencing and phylogenetic analysis confirmed that the two HMW-GSs were U^(k)x and U^(k)y.Compared to the wheat parent,the substitution line had no obvious agronomic defects except fewer grains per spike but improved several major quality parameters.It can be served as a donor or bridge material for wheat quality improvement.

On-line Batch Process Monitoring and Diagnosing Based on Fisher Discriminant Analysis

A new on-line batch process monitoring and diagnosing approach based on Fisher discriminant analysis (FDA) was proposed. This method does not need to predict the future observations of variables, so it is more sensitive to fault detection and stronger implement for monitoring. In order to improve the monitoring performance, the variables trajectories of batch process are separated into several blocks. The key to the proposed approach for on-line monitoring is to calculate the distance of block data that project to low-dimension Fisher space between new batch and reference batch. Comparing the distance with the predefine threshold, it can be considered whether the batch process is normal or abnormal. Fault diagnosis is performed based on the weights in fault direction calculated by FDA. The proposed method was applied to the simulation model of fed-batch penicillin fermentation and the results were compared with those obtained using MPCA. The simulation results clearly show that the on-line monitoring method based on FDA is more efficient than the MPCA.

An FPGA-based real-time image processing system

This paper analyzes the current difficulties encountered in on-line inspection systems of strip surface quality, specifically relating to problems with real-time processing of huge amounts of data. To address this need, this paper describes an FPGA-based high-speed image processing module with both hardware and software aspects. Improving these two aspects together will help the system achieve real-time processing of massive image data, and simplifies the architecture of the strip surface quality on-line inspection system.

基于线结构光的厚板焊缝特征点提取算法

针对厚板结构件在使用激光视觉系统时图像特征区域提取难和工件表面加工不均匀漫反射等导致特征点提取困难的问题,提出基于线结构光的厚板焊缝特征点提取算法。首先,激光视觉系统获取焊缝图像并使用YOLOv4算法进行预训练,利用训练获取的权重文件自动检测并获取焊缝特征感兴趣区域(ROI);其次,对ROI进行降噪、二值化等处理,通过逐行(列)搜索法得到焊缝中心线;最后,根据不同焊缝类型,基于最小二乘法使用距离法和直线段聚类的方法来提取特征点。实验结果表明:该方法可有效提取不同类型的焊缝特征点,具有鲁棒性强、识别误差小等特点。

面向流程制造的数字孪生车间可视化监控系统研究

为了解决流程制造过程监控实时性差、准确性不足的问题,在数字孪生技术迅速发展且与制造业结合愈发紧密的背景下,提出基于生产要素数据、生产工艺流程与多工序设备实体对象的数字孪生车间可视化监控系统架构。从要素、状态、运行逻辑等多个维度对多工序耦合生产线实体对象进行孪生建模,基于OPC UA统一架构的数据采集传输,虚拟车间的实时驱动等关键技术,实现了流程制造设备状态、生产要素工艺全流程三维可视化监控。基于某流程制造企业制丝生产试验线开展了应用验证,为提升流程制造过程中全生产要素的预见性、联动性、自治性提供了方法和实现途径。