In an era of rapid advancement of algorithms that extract knowledge from data,data and metadata management are increasingly critical to research success.In materials science,there are few examples of experimental data...In an era of rapid advancement of algorithms that extract knowledge from data,data and metadata management are increasingly critical to research success.In materials science,there are few examples of experimental databases that contain many different types of information,and compared with other disciplines,the database sizes are relatively small.Underlying these issues are the challenges in managing and linking data across disparate synthesis and characterization experiments,which we address with the development of a lightweight data management framework that is generally applicable for experimental science and beyond.Five years of managing experiments with this system has yielded the Materials Experiment and Analysis Database(MEAD)that contains raw data and metadata from millions of materials synthesis and characterization experiments,as well as the analysis and distillation of that data into property and performance metrics via software in an accompanying open source repository.The unprecedented quantity and diversity of experimental data are searchable by experiment and analysis attributes generated by both researchers and data processing software.The search web interface allows users to visualize their search results and download zipped packages of data with full annotations of their lineage.The enormity of the data provides substantial challenges and opportunities for incorporating data science in the physical sciences,and MEAD’s data and algorithm management framework will foster increased incorporation of automation and autonomous discovery in materials and chemistry research.展开更多
基金This study and the acquisition of all data is based upon work performed by the Joint Center for Artificial Photosynthesis,a DOE Energy Innovation Hub,supported through the Office of Science of the US Department of Energy(Award No.DE-SC0004993)Use of the Stanford Synchrotron Radiation Lightsource,SLAC National Accelerator Laboratory,is supported by the US Department of Energy,Office of Science,Office of Basic Energy Sciences under Contract No.DE-AC02-76SF00515.
文摘In an era of rapid advancement of algorithms that extract knowledge from data,data and metadata management are increasingly critical to research success.In materials science,there are few examples of experimental databases that contain many different types of information,and compared with other disciplines,the database sizes are relatively small.Underlying these issues are the challenges in managing and linking data across disparate synthesis and characterization experiments,which we address with the development of a lightweight data management framework that is generally applicable for experimental science and beyond.Five years of managing experiments with this system has yielded the Materials Experiment and Analysis Database(MEAD)that contains raw data and metadata from millions of materials synthesis and characterization experiments,as well as the analysis and distillation of that data into property and performance metrics via software in an accompanying open source repository.The unprecedented quantity and diversity of experimental data are searchable by experiment and analysis attributes generated by both researchers and data processing software.The search web interface allows users to visualize their search results and download zipped packages of data with full annotations of their lineage.The enormity of the data provides substantial challenges and opportunities for incorporating data science in the physical sciences,and MEAD’s data and algorithm management framework will foster increased incorporation of automation and autonomous discovery in materials and chemistry research.
