Oct 16 – 19, 2016
Copenhagen University
Europe/Copenhagen timezone

ESS Event Data Streaming

Oct 19, 2016, 11:35 AM
5m
Marble Hall (Copenhagen University)

Marble Hall

Copenhagen University

Thorvaldsensvej 40

Speaker

Dr Matthew Jones (STFC, Tessella)

Description

At the ESS, data from each instrument will need to be transported elsewhere for use by various software packages which will perform tasks such as analysing the data, providing live visualisation or writing data files. To do this, an ESS and ISIS in-kind collaboration will implement a robust and high throughput streaming system. The data stream will largely comprise neutron events and efficiently encoding a compact, serialised message for sending this information down the wire will be of high importance. To achieve this, we plan to use Google Flatbuffers for serialisation and base our data streaming software on Apache Kafka. In this short talk I will briefly introduce these two technologies and present results of event data streaming tests we have carried out so far.

Primary authors

Afonso Mukai (European Spallation Source ERIC) Dr Frederick Akeroyd (STFC) Dr Matt Clarke (STFC) Dr Matthew Jones (STFC, Tessella) Tobias Richter (European Spallation Source ERIC)

Presentation materials

There are no materials yet.