Speaker
Mr
Ming Tang
(Institute of High Energy Physics)
Description
The design philosophy of data management system for China Spallation Neutron Source (CSNS) is data safety, user convenience, and big-data sharing. Under the considerations, the four main parts are covered: data transfer, data storage, metadata catalogue, and data access.
The high-speed and highly reliable data transfer service is developed. It will handle with the data delivery among several locations: local beamlines, computing center on site, remote mirrors for disaster backup or supercomputing. It will favor the high-performance computing and big-data analysis. Meanwhile, multi-level hierarchies including hot/cold/backup zones are introduced in data storage, in order to apply the different data retrieval policies and grant permissions.
The metadata catalogue is completed based on ICAT (http://www.icatproject.org/). A load-balanced ICAT cluster with read/write splitting is used to ensure safety and stability of database. The web-based data portal will provide users data access every time and everywhere, including metadata indexing, data download/upload, NeXus data browser and visualization in one-stop.
Primary author
Mr
Ming Tang
(Institute of High Energy Physics)
Co-authors
Dr
Haolai Tian
(Institute of High Energy Physics, Chinese Academy of Sciences)
Dr
JUNRONG ZHANG
(Institute of High Energy Physics, Chinese Academy of Sciences)
Mrs
Lili Yan
(Institute of High Energy Physics, Chinese Academy of Sciences)
Dr
Rong Du
(China Spallation Neutron Source, Institute of High Energy Physics)
