From 0dff73719928e0f58e9a580027e242bcb36a3aaf Mon Sep 17 00:00:00 2001 From: Sinisa Veseli <sveseli@aps.anl.gov> Date: Tue, 9 May 2017 16:36:32 +0000 Subject: [PATCH] added 0MQ interface to workflow service --- cdb_dm_integration_notes.txt | 38 ++++++++++++++++++++++++++++++++++++ 1 file changed, 38 insertions(+) create mode 100644 cdb_dm_integration_notes.txt diff --git a/cdb_dm_integration_notes.txt b/cdb_dm_integration_notes.txt new file mode 100644 index 00000000..7371d683 --- /dev/null +++ b/cdb_dm_integration_notes.txt @@ -0,0 +1,38 @@ +- DS service + - runs on extrepid +- DAQ service + - APSU station, runs on ctlsdaqsrv2 +- Catalog service + - APSU station, runs on ctlsdaqsrv2 +- Processing (Workflow) service + - can run workflows for each file, or for set of files, in real-time + - RT workflow args can be set via PV + - DAQ needs to send burst number (e.g, file 3/10) + - can always request workflow processing on a set of files (post processing) + - need portal that will be able to submit processing job + - need to be able to keep track of processing jobs and their results + +- DM/CDB integration plugin + - triggered via CDB:<qrId> keyword + - adds DM-document property, will have metadata catalog URL, + file download URL, metadata key/value pairs as needed + - must be able to associate multiple qrID's +- CDB Document domain +- CDB/DM integration plugin: needs to be able to click on the file to see the + metadata, or to download the file +- DM/SDDS plugin + - triggered by ".sdds" + - reads parameters, converts them to metadata + +- Use Case: StudiesSession-20170422 + - From CDB perspective StudiesSession-20170422 is an item in the + Documents Domain + - From DM perspective, StudiesSession-20170422 is an experiment on an APSU + station + - When collecting DAQ data, DM will automatically asign all files to be + part of the StudiesSession-20170422 experiment + - DM/CDB plugin will add DataFile property to StudiesSession-20170422 for + each file + - CDB/DM file property handler will be able to display DM metadata (URL link) + and download file; later, it may be be able to submit processing job + to DM processing service -- GitLab