Speaker
Dr
Sergey Stepanov
(Advanced Photon Source, Argonne National Laboratory, Argonne, IL, USA)
Description
Fast detectors revolutionize many operations at macromolecular crystallography beamlines, from introducing shutterless data collection and on-the-fly rastering scans to new standards for beamline stability, detector-goniometer synchronization at 100Hz data collection, and new ways to display data (e.g. plotting spots count in addition to visual inspection of individual frames). Fast crystal screening and data collection with such detectors also create new requirements for the computing environment, including needs for fast automatic distributed data processing and analysis pipelines on clusters, high-speed storage, transferring of large data volumes to remote institutions, and software to handle new data formats such as HDF5. The General Medical Sciences and Cancer Institutes Structural Biology Facility at the Advanced Photon Source (GM/CA @ APS) has operated the Pilatus3 6M detector at the 23ID-D beamline for 2.5 years and just started operating the Eiger 16M at 23ID-B. In this presentation we report how we incorporated controls for these detectors into our EPICS-based JBluIce control system, how we collect, display and automatically process data on computing clusters at speeds up to 100 frames per second, how we re-arranged our network, distributed storage and computing clusters to accommodate greater data speeds and volumes, how we are optimizing our ScienceDMZ network to speed up remote data backups, and how we implement automatic beamline alignment and remote access for more efficient use of beamlines equipped with these new detectors.
Primary author
Dr
Sergey Stepanov
(Advanced Photon Source, Argonne National Laboratory, Argonne, IL, USA)
Co-authors
Prof.
Janet L. Smith
(Life Sciences Institute & Dept. Biological Chemistry, University of Michigan, MI, USA)
Mr
Jason Zurawski
(Energy Sciences Network (ESnet), Berkeley, CA, USA)
Mr
Mark Hilgart
(Advanced Photon Source, Argonne National Laboratory, Argonne, IL, USA)
Dr
Oleg Makarov
(Advanced Photon Source, Argonne National Laboratory, Argonne, IL, USA)
Dr
Robert Fischetti
(Advanced Photon Source, Argonne National Laboratory, Argonne, IL, USA)
Mr
Sudhir Babu Pothineni
(Advanced Photon Source, Argonne National Laboratory, Argonne, IL, USA)
