基于RESTful的EAST工程数据访问方法

EAST Engineering Data Access Method Based on RESTful

EAST工程数据访问是等离子体物理研究中重要的环节,优化EAST实验数据统一访问方法是避免出现各子系统数据因独立采集存储而导致数据孤岛现象的有效措施。对系统进行了分层设计,在数据层通过Redis缓存提高数据检索效率,在应用层通过多进程加协程保证数据传输服务性能并基于HTTPS进行数据加密,在中间件层通过计数限流和消息队列进行流量削峰。为了进一步保障系统的可维护性,通过Prometheus实现了对系统日志数据的采集、存储和可视化管理,并基于RBAC实现访问控制。实测结果表明,所设计的数据访问系统可以满足既定功能及性能要求。该系统将获得更广泛的应用。

EAST engineering data access is an important link in plasma physics research.Optimizing the unified access method of EAST experimental data is an effective measure to avoid data islands caused by independent acquisition and storage of subsystem data.The system is designed hierarchically.In the data layer,Redis caches are used to improve the efficiency of data retrieval.In the application layer,multi-process and co-scheduling are used to ensure the performance of data transmission services.Data encryption is performed based on HTTPS.In the middleware layer,traffic peaks are cut through count flow restriction and message queues.In order to further ensure the maintainability of the system,the system log data collection,storage and visual management are realized through Prometheus,and access control is realized based on RBAC.The test results show that the designed data access system can meet the functions and performance requirements.The system will be widely used.