LAMOST数据流与光谱质量控制研究

Research of LAMOST Dataflow Designation and Spectral Quality Control

郭守敬望远镜每日产生海量观测数据,数据处理涉及观测计划生成、二维和一维数据分析、参数测量、质量控制和光谱释放等诸多环节。为了更高效地获取、处理、分析和发布数据以及及时解决数据处理过程中出现的问题,开展了郭守敬望远镜数据流与光谱质量控制研究。首先,深入研究郭守敬望远镜系统数据流和工作流程,结合关系型数据库进行数据建模,实现基于Linux的MySQL数据库系统,将数据处理和发布各个环节有机串联并融合在一起;然后,基于该数据库系统,定义光谱质量控制模型,建立光谱质量控制系统,严格控制光谱质量和光谱产出的各个环节,从而为优质的光谱资源释放提供保障。该数据流与光谱质量控制系统可以很好地满足望远镜数据处理和数据管理的需要,是可以扩展至同类望远镜系统进行数据处理的一种有效方案。

Guo Shoujing telescope(LAMOST)produces massive observational data every day.Data processing involves a series of processes,such as observation program generation,two dimensional data reduction and one dimensional data analysis,parameter measurement,quality control and data releases.In order to obtain,process,analyze and release data more efficiently and solve problems happened during data processing in a timely manner,the research of the LAMOST data flow designation and spectral quality control are carried out.Firstly,we intensively study the LAMOST dataflow and workflow.By combining the relational database,data modeling is fulfilled and the database system is realized based on MySQL,and the data processing and releasing segments are integrated organically.Then,ground on the former system,we define the spectral quality control model and establish the spectral quality control system to strictly control the spectral quality and spectra output,so as to provide guarantee for the releases of high-quality spectral resources.This system can meet the needs of LAMOST data processing and data management,and is an effective scheme that can be extended to similar telescope systems for data storage and processing.