Skip to content
Snippets Groups Projects

Compare revisions

Changes are shown as if the source revision was being merged into the target revision. Learn more about comparing revisions.

Source

Select target project
No results found

Target

Select target project
  • DM/dm-docs
  • hammonds/dm-docs
  • hparraga/dm-docs
3 results
Show changes
Commits on Source (261)
Showing
with 172 additions and 0 deletions
File added
File added
File added
File added
This diff is collapsed.
File added
This diff is collapsed.
File added
File added
This diff is collapsed.
File added
"1-BM-B,C"
"1-ID-B,C,E"
"2-BM-A,B"
"2-ID-D"
"2-ID-E"
"3-ID-B,C,D"
"4-ID-C"
"4-ID-D"
"5-BM-C"
"5-BM-D"
"5-ID-B,C,D"
"6-BM-A,B"
"6-ID-B,C"
"6-ID-D"
"7-BM-B"
"7-ID-B,C,D"
"8-BM-B"
"8-ID-E"
"8-ID-I"
"9-BM-B,C"
"9-ID-B,C"
"10-BM-A,B"
"10-ID-B"
"11-BM-B"
"11-ID-B"
"11-ID-C"
"11-ID-D"
"12-BM-B"
"12-ID-B"
"12-ID-C,D"
"13-BM-C"
"13-BM-D"
"13-ID-C,D"
"13-ID-E"
"14-BM-C"
"14-ID-B"
"15-ID-B,C,D"
"16-BM-B"
"16-BM-D"
"16-ID-B"
"16-ID-D"
"17-BM-B"
"17-ID-B"
"18-ID-D"
"19-BM-D"
"19-ID-D"
"20-BM-B"
"20-ID-B,C"
"21-ID-D"
"21-ID-E"
"21-ID-F"
"21-ID-G"
"22-BM-D"
"22-ID-D"
"23-BM-B"
"23-ID-B"
"23-ID-D"
"24-ID-C"
"24-ID-E"
"26-ID-C"
"27-ID-B"
"28-ID-B"
"28-ID-C"
"29-ID-C,D"
"30-ID-B,C"
"31-ID-D"
"32-ID-B,C"
"33-BM-C"
"33-ID-D,E"
"34-ID-C"
"34-ID-E"
"35-ID-B,C,D,E"
- DS service
- runs on extrepid
- DAQ service
- APSU station, runs on ctlsdaqsrv2
- Catalog service
- APSU station, runs on ctlsdaqsrv2
- Processing (Workflow) service
- can run workflows for each file, or for set of files, in real-time
- RT workflow args can be set via PV
- DAQ needs to send burst number (e.g, file 3/10)
- can always request workflow processing on a set of files (post processing)
- need portal that will be able to submit processing job
- need to be able to keep track of processing jobs and their results
- DM/CDB integration plugin
- triggered via CDB:<qrId> keyword
- adds DM-document property, will have metadata catalog URL,
file download URL, metadata key/value pairs as needed
- must be able to associate multiple qrID's
- CDB Document domain
- CDB/DM integration plugin: needs to be able to click on the file to see the
metadata, or to download the file
- DM/SDDS plugin
- triggered by ".sdds"
- reads parameters, converts them to metadata
- Use Case: StudiesSession-20170422
- From CDB perspective StudiesSession-20170422 is an item in the
Documents Domain
- From DM perspective, StudiesSession-20170422 is an experiment on an APSU
station
- When collecting DAQ data, DM will automatically asign all files to be
part of the StudiesSession-20170422 experiment
- DM/CDB plugin will add DataFile property to StudiesSession-20170422 for
each file
- CDB/DM file property handler will be able to display DM metadata (URL link)
and download file; later, it may be be able to submit processing job
to DM processing service
Document can now be found [here](https://git.aps.anl.gov/DM/dm-docs/-/wikis/DM/HowTos/Getting-Started) on the [DM Wiki](https://git.aps.anl.gov/DM/dm-docs/-/wikis/home).
Document can now be found [here](https://git.aps.anl.gov/DM/dm-docs/-/wikis/DM/HowTos/Getting-Data-From-Globus) on the [DM Wiki](https://git.aps.anl.gov/DM/dm-docs/-/wikis/home).
cd /local/DmSystem/dm
source setup.sh
make deploy-cat-web-service
cd /local/DmSystem/support
./bin/install_node.sh
cd /local/DmSystem/support/node/linux-x86_64/bin/node_modules/mongo-express/
cp config.default.js config.js
vi config.js
export PATH=/local/DmSystem/support/node/linux-x86_64/bin:$PATH
../forever/bin/forever start app.js
../forever/bin/forever list
RHEL7 Packages
===============
make
autoconf
expect
gcc
gcc-c++
subversion
zlib-devel
openssl-devel
libffi-devel
openldap-devel
readline-devel
ncurses-devel
qt-x11
qt-postgresql
qt-devel
gtk2-devel
Globus Packages
===============
globus-openssl-module
globus-ftp-client
globus-gsi-proxy
globus-gsi-openssl
globus-ftp-control
globus-gass-copy
globus-common-16.8
globus-gass-transfer
globus-io-11.8
globus-gss-assist
globus-gsi-cert
globus-xio-popen
globus-xio-gsi
globus-gsi-credential
globus-callout-3.15
globus-gsi-sysconfig
globus-gsi-callback
globus-xio-5.14
globus-gssapi-gsi
globus-gass-copy
globus-gsi-proxy
globus-gssapi-error