Speaker
Mr
Kentaro Moriyama
(Comprehensive Research Organization for Science and Society)
Description
The MLF Experimental Database (MLF EXP-DB) is a core system aimed at delivering advanced services for data management and data access in J-PARC/MLF [1]. The main role of this system is to safely and efficiently manage a huge amount of data created in neutron instruments, and provide an effective data access for facility users promoting the creation of scientific results. The system is a web-based integrated database system based on a three-tiered architecture model. Collecting experimental data and associated information such as proposal, principal investigator and samples from instruments and other business database systems, it creates experimental data catalog, and provides facility staff and users with web portals for referring the data catalog.
Recently we have redesigned the MLF EXP-DB for enhancing the availability and scalability toward full-scale operation of the system and facility in the future. In addition, we have made additional development of the web portal for improving the usability.
**High availability**
In order to enhance the availability, we have made the system to a redundant distributed system consisting of a couple of servers in a switch over relationship with database replication. It allows to avoid a service outage owing to system failure and maintenance such as application of a security patch as much as possible.
**Scaling-out**
We have scaled out the system improving scalability especially for the load balancing of data cataloging which depends on the data production rate in the instruments. The data production rate is increasing with the enhancement of beam intensity based on the development plan for accelerators and neutron sources. Since the maximum data production rate in a whole facility at the full performance of beam intensity is expected to reach 5TB/day, so it is critical issue for the sustainability of service provision.
**Web portal**
We have developed a unified web interface for the redundant distributed system and improved some features such as data retrieval on the web portal. It is possible to search data through the distributed systems and with flexible search conditions according to various measurement conditions.
In this contributions, we will report the detail architecture and the result of performance evaluation for the recent development, and present operating status of the MLF EXP-DB.
**References**
1. K. Moriyama and T. Nakatani, “A Data Management Infrastructure for Neutron Scattering Experiments in J-PARC/MLF”, Proceedings of ICALEPCS2015, Melbourne, Australia, in press.
Primary author
Mr
Kentaro Moriyama
(Comprehensive Research Organization for Science and Society)
Co-author
Dr
Takeshi Nakatani
(J-PARC)
Peer reviewing
Paper
Paper files:
