摘要
针对现有大数据量Excel导入系统效率较低的问题,设计并实现了一种新的大数据量Excel数据导入系统。该系统采用C#语言,在VS2012的开发环境中,利用多线程技术将大数据量Excel表格数据导入到SQL Server中,加快了信息导入的速度。并且在临时表与目标表之间的合并过程中,摒弃了传统的游标逐条插入方式,取而代之的是SQL Server 2008中的Merge技术,极大地加快了数据库端不同表之间数据的同步过程。实验测试结果表明,整个系统导入100万条数据耗时9 534 ms,远少于传统Excel导入系统所耗时间,有效提高大数据量Excel导入系统的效率。
In order to eliminate the poor efficiency phenomenon existing in mass data Excellimportation system,a novel mass data Excellimporting system was designed and implemented. C# language and multi-threading technology are used in the system to introduce the mass data Excelltabular data into SQL Server under VS2012 developing environment. The system can shorten the time in the process of information importation. Moreover,instead of the traditional way of inserting item by item,a new Merge technology in SQL Sever 2008 is employed in the process of the mergence between the target table and the temporary table to greatly accelerate the data synchronization between different tables. The experimental testing result demonstrates that it takes 9534 ms for this system to import 1,000,000 data,which is far shorter than the traditional Excellimporting system. It proves that this system can improve the efficiency of mass data Excellimporting system efficiently.
出处
《现代电子技术》
2014年第14期57-59,共3页
Modern Electronics Technique