Speaker
Dr
Matthew Jones
(STFC, Tessella)
Description
At the ESS, data from each instrument will need to be transported elsewhere for use by various software packages which will perform tasks such as analysing the data, providing live visualisation or writing data files. To do this, an ESS and ISIS in-kind collaboration will implement a robust and high throughput streaming system. The data stream will largely comprise neutron events and efficiently encoding a compact, serialised message for sending this information down the wire will be of high importance. To achieve this, we plan to use Google Flatbuffers for serialisation and base our data streaming software on Apache Kafka. In this short talk I will briefly introduce these two technologies and present results of event data streaming tests we have carried out so far.
Primary authors
Afonso Mukai
(European Spallation Source ERIC)
Dr
Frederick Akeroyd
(STFC)
Dr
Matt Clarke
(STFC)
Dr
Matthew Jones
(STFC, Tessella)
Tobias Richter
(European Spallation Source ERIC)
