An Efficient Crash Recovery Technique for Real-Time Main Memory Database

This paper presents an efficient recovery scheme suitable for real-time mainmemory database. In the recovery scheme, log records are stored in non-volatile RAM which is dividedinto four different partitions based on transaction types. Similarly, a main memory database isdivided into four partitions based data types. When the using ratio of log store area exceeds thethreshold value, checkpoint procedure is triggered. During executing checkpoint procedure, someuseless log records are deleted. During restart recovery after a crash, partition reloading policyis adopted to assure that critical data are reloaded and restored in advance, so that the databasesystem can be brought up before the entire database is reloaded into main memory. Therefore downtime is obvionsly reduced. Simulation experiments show our recovery scheme obviously improves thesystem performance, and does a favor to meet the dtadlints of real-time transactions.

Weak Serializable Concurrency Control in Distributed Real-Time Database Systems

Most of the proposed concurrency control protocols for real time database systems are based on serializability theorem. Owing to the unique characteristics of real time database applications and the importance of satisfying the timing constraints of transactions, serializability is too strong as a correctness criterion and not suitable for real time databases in most cases. On the other hand, relaxed serializability including epsilon serializability and similarity serializability can allow more real time transactions to satisfy their timing constraints, but database consistency may be sacrificed to some extent. We thus propose the use of weak serializability(WSR) that is more relaxed than conflicting serializability while database consistency is maintained. In this paper, we first formally define the new notion of correctness called weak serializability. After the necessary and sufficient conditions for weak serializability are shown, corresponding concurrency control protocol WDHP(weak serializable distributed high priority protocol) is outlined for distributed real time databases, where a new lock mode called mask lock mode is proposed for simplifying the condition of global consistency. Finally, through a series of simulation studies, it is shown that using the new concurrency control protocol the performance of distributed real time databases can be greatly improved.

Validation concurrency control protocol in parallel real-time database systems

In parallel real-time database systems, concurrency control protocols must satisfy time constraints as well as the integrity constraints. The authors present a validation concurrency control(VCC) protocol, which can enhance the performance of real-time concurrency control mechanism by reducing the number of transactions that might miss their deadlines, and compare the performance of validation concurrency control protocol with that of HP2PL(High priority two phase locking) protocol and OCC-TI-WAIT-50(Optimistic concurrency control-time interval-wait-50) protocol under shared-disk architecture by simulation. The simulation results reveal that the protocol the author presented can effectively reduce the number of transactions restarting which might miss their deadlines and performs better than HP2PL and OCC-TI-WAIT-50. It works well when arrival rate of transaction is lesser than threshold. However, due to resource contention the percentage of missing deadline increases sharply when arrival rate is greater than the threshold.

A dynamic crash recovery scheme for distributed real-time database systems

Recovery performance in the event of failures is very important for distributed real-time database systems. This paper presents a time-cognizant logging-based crash recovery scheme （TCLCRS） that aims at distributed real-time databases, which adopts a main memory database as its ground support. In our scheme, each site maintains a real-time log for local transactions and the subtransactions, which execute at the site, and execte local checkpointing independently. Log records are stored in non-volatile high- speed store, which is divided into four different partitions based on transaction classes. During restart recovery after a site crash, partitioned crash recovery strategy is adopted to ensure that the site can be brought up before the entire local secondary database is reloaded in main memory. The partitioned crash recovery strategy not only guarantees the internal consistency to be recovered, but also guarantee the temporal consistency and recovery of the sates of physical world influenced by uncommitted transactions. Combined with two- phase commit protocol, TCLCRS can guarantee failure atomicity of distributed real-time transactions.

Real-TimeSQL的设计与实现

实时数据库的结构化查询语言RTSQL(Real-TimeSQL)是实时数据库研究的一项重要内容。论文详细论述了RTSQL的一种设计方法,即扩展SQL92标准以支持实时数据库的要求,构建RTSQL语言的方法。文章还介绍了RTSQL在Agilor实时数据库系统中的实现方式。在文章最后给出了RTSQL进一步研究的思路和建议。

Cache-Conscious Index Mechanism for Main-Memory Databases

Recent studies have addressed that the cache be havior is important in the design of main memory index structures. Cache-conscious indices such as the CSB^＋-tree are shown to outperform conventional main memory indices such as the AVL-tree and the T-tree. This paper proposes a cacheconscious version of the T-tree, CST-tree, defined according to the cache-conscious definition. To separate the keys within a node into two parts, the CST-tree can gain higher cache hit ratio.

Real-time crash prediction on freeways using data mining and emerging techniques

Recent advances in intelligent transportation system allow traffic safety studies to extend from historic data-based analyses to real-time applications. The study presents a new method to predict crash likelihood with traffic data collected by discrete loop detectors as well as the web-crawl weather data. Matched case-control method and support vector machines （SVMs） technique were employed to identify the risk status. The adaptive synthetic over-sampling technique was applied to solve the imbalanced dataset issues. Random forest technique was applied to select the contributing factors and avoid the over-fitting issues. The results indicate that the SVMs classifier could successfully classify 76.32% of the crashes on the test dataset and 87.52% of the crashes on the overall dataset, which were relatively satisfactory compared with the results of the previous studies. Compared with the SVMs classifier without the data, the SVMs classifier with the web-crawl weather data increased the crash prediction accuracy by 1.32% and decreased the false alarm rate by 1.72%, showing the potential value of the massive web weather data. Mean impact value method was employed to evaluate the variable effects, and the results are identical with the results of most of previous studies. The emerging technique based on the discrete traffic data and web weather data proves to be more applicable on real- time safety management on freeways.

An Efficient Secure Real-Time Concurrency Control Protocol

Secure real-time databases must simultaneously satisfy two requirements in guaranteeing data security and minimizing the missing deadlines ratio of transactions. However, these two requirements can conflict with each other and achieve one requirement is to sacrifice the other. This paper presents a secure real-time concurrency control protocol based on optimistic method. The concurrency control protocol incorporates security constraints in a real-time optimistic concurrency control protocol and makes a suitable tradeoff between security and real-time requirements by introducing secure influence factor and real-time influence factor. The experimental results show the concurrency control protocol achieves data security without degrading real-time perform ance significantly.

ACTIVE-A Real Time Commit Protocol

Many existing real time commit protocols try to improve system performance by allowing a committing cohort to lend its data to an executing cohort, thus reducing data inaccessibility. They block the borrower from sending WORKDONE/PREPARED message and restrict them from lending data so that transaction abort chain is limited to one. Thus, transaction execution time increases. This paper proposes a modified real time commit protocol for distributed real time database systems (DRTDBS), Allow Commit Dependent and in Time borrowers for Incredible Value added data lending without extended abort chain (ACTIVE), where borrower cohorts are categorized as commit and abort dependent. Further, the commit dependent borrowers can lend data to executing cohorts with still limiting the transaction abort chain to one only and reducing the data inaccessibility. Also, an incoming executing cohort having borrowing factor greater than one can only borrow the dirty data items from lender. This minimizes the fruitless borrowing by the cohort. The performance of ACTIVE is compared with PROMPT, 2SC and SWIFT protocols for both main memory resident and disk resident databases with and without communication delay. Simulation results show that the proposed protocol improves the system performance up to 4% as transaction miss percentage.

Research on Real-time Data Sharing in Power Integrated Automation System

The Power Integrated Automation System has a large amount of the real-time data, it needs to achieve data sharing in different modules in its own system, sometimes even needs to be shared with the other systems. The thesis discusses the characteristics and the ways of the real-time data sharing in the first place. Then, it compares the merits and drawbacks in different ways. Besides, it gives a viable resolution in different aspects, such as the design of the real-time database, the framework of the communication system and the design of the communication software, as well as the real-time data sharing in different systems.

Data—mining massive real—time data in a power plant：challenges,problems and solutions

Nowadays, the scale of data normally stored in a database collected by Data Acquisition System (DAS) or Distributed Control System (DCS) in a power plant is becoming larger and larger. However there are abundant valuable knowledge hidden behind them. It will be beyond people's capacity to analyze and understand these data stored in such a scale database. Fortunately data mining techniques are arising at the historic moment. In this paper, we explain the basic concept and general knowledge of data mining; analyze the characteristics and research method of data mining; give some typical applications of data mining system based on power plant real time database on intranet.

The Organizing of Database from Surlari National Geomagnetic Observatory

Our paper describes the organizing of database,remarks about SNGO(Surlari National Geomagnetic Observatory)and network infrastructure.Based on the geomagnetic data acquired and stored on the database server,we perform the processing and analysis of geomagnetic parameters through different spectral,statistical and correlation methods.All these parameters are included in the geomagnetic database on server.The web interface for the database meets the different needs of handling the data collected,raw or processed.The server-side programming language used for design is php.This allow us to select different periods for which access to stored data,required for different search filters and different parameters or data from different time periods can be compared.For a more in-depth analysis of the stored data,through JavaScript programming language graphs for different parameters can be drawn.Access to the web interface can be done with or without authentication,depending on the need to ensure the security of certain data collected,stored and processed.The applications are scalable for different devices that will access it:mobile,tablets,laptops or desktops.

实时数据库数据的批量写入及性能测试研究

通过对石油化工行业使用较多的PHD实时数据库在多模式下的数据批量写入,以标准差指标对测试值进行可信度分析、测试调校,得出多模式下实时数据批量修改、更新测试的最优结果,探索一种行之有效的工业实时数据库优化、应用的方法。

卷烟滤棒成型加工区域集控系统实现

针对滤棒成型作业区分散、设备种类多、制造厂家和数量多、接口协议复杂且不统一以及海量数据变量难识别等问题,设计并开发了基于OPC UA架构和实时内存数据库的就地滤棒加工区数采和监控系统。自主开发OPC服务器,实现了滤棒成型主、辅设备的实时数据采集,并通过高效内存数据库服务器对生产及设备信息进行海量存储,进而实现了对滤棒成型车间生产过程信息的全面、准确迁移集成,以及对滤棒生产、产量、质量、机台效率、设备状态等信息的可视化区域集控。

嵌入式实时数据库ARTs-EDB事务调度实现技术

着重讨论了嵌入式实时数据库系统ARTs-EDB中事务调度实现技术。给出了ARTs-EDB中事务的执行模型、状态及状态变迁;设计了一个考虑事务类型和截止期的多层动态可调整优先级分派方法;给出了一个优先级驱动可抢占的实时事务调度策略,以保证更多事务满足截止期要求。

基于PI-API的PI数据库访问技术的研究

PI是应用广泛的实时/历史数据库系统,在高效数据访问、海量数据存储等方面表现出关系数据无法比拟的优势.PI提供了比较完善的PI数据库访问工具,但没有提供数据分析和挖掘工具,实现数据分析和挖掘,需要利用第三方开发工具.研究了PI数据库访问的原理以及C++ Builder利用PI-API访问PI数据库的方法,并将该方法应用到电力负荷预测系统中,实现了PI中电力负荷数据的访问.实际应用说明该方法是正确有效的.

The Multi-level Recovery of Main-memory Real-time Database Systems with ECBH

Storing the whole database in the main-memory is a common method to processreal-time transaction in real-time database systems. The recovery mechanism of Main-memory Real-timeDatabase Systems (MMRTDBS) should reflect the characteristics of the main-memory database andreal-time database because their structures are quite different from other conventional databasesystems. In this paper, therefore, we propose a multi-level recovery mechanism for main-memoryreal-time database systems with Extendable Chained Bucket Hashing (ECBH). Owing to the occurrence ofreal-time data in real-time systems, we should also consider it in our recovery mechanism .According to our performance test, this mechanism can improve the transaction concurrency, reducingtransactions ' deadline missing rate.

基于PAS-300M DCS平台的监控软件设计与实现

基于国电南京自动化股份有限公司新一代的分散控制系统PAS-300M的硬件平台,采用Visual C++、eXtremeDB、SQLServer和VBA等开发工具和网络通信协议,设计并实现了分散控制系统的软件。介绍分散控制系统PAS-300M系统软硬件总体结构,重点分析了监控组态软件的设计与实现。介绍了其中的关键技术即实时内存数据库eXtremeDB技术、数据库组态及图形组态软件、监控画面的分析与设计等。

RT21-ISCS综合监控系统中实时历史数据库的设计与实现

历史数据的存储和查询对轨道交通综合监控系统具有重要意义。针对轨道交通综合监控系统通常只能保存几个月的历史数据且存储和查询速度慢的问题,根据轨道交通综合监控系统的特点,为RT21-ISCS综合监控系统设计了一种实时历史数据库FVDB。介绍了FVDB核心模块(点管理、实时数据管理、历史数据管理)的设计。FVDB能够在轨道交通综合监控系统海量信息的情况下,保存3年以上的历史数据并具有较快的存储和查询速度。