用于冻土实验大数据文件处理的软件设计与开发

A Software for Processing Big Data Files Produced in Frozen Soil Tests

冻土实验是冻土研究的重要基础,长时间的野外冻土监测和高频率采集的室内冻土测试会产出大量数据,传统数据处理程序往往无法有效处理这些大数据文件,因此开发了一个用于冻土实验大数据文件处理的软件系统.首先描述了该软件系统的组成,包括温度转换和显示、冻土力学实验数据转换和冻胀实验数据转换3个功能模块,并介绍了实现过程中涉及的主要关键技术,然后通过一个示例说明此软件具备的实用性和优异的性能.借助系统具备的扩展性设计,未来更多的实用功能将被添加到系统里面.

Frozen soil test can provide important data for frozen soil research.Long-time in situ field monitoring and high frequency laboratory frozen soil experiments will produce big data files that are usually unable to be handled efficiently by traditional data processing software.A new system developed for processing big testing data file was presented in this paper.Three functional data conversion and display modules were described in details,included handling temperature monitoring data,frozen soil mechanics test data and frost heave test data.Key techniques about how to optimize the performance of processing big data file were introduced.A simple practical example was presented to demonstrate the applicability and high performance.Taking advantage of the well-designed public interfaces of this system,additional functional modules can be easily added to meet the possible requirements from frozen soil laboratory practices.