|
|
## System Usage
|
|
|
|
|
|
In this section we illustrate typical system usage via DM command line interfaces.
|
|
|
|
|
|
1. Setup environment by sourcing setup file.
|
|
|
`truffle1> # After sourcing setup file, all DM commands will be in your path`
|
|
|
`truffle1> source /opt/dm/etc/dm.setup.sh`
|
|
|
2. Create DM experiment, and upload data to the GPFS DDN storage:
|
|
|
`truffle1> # Experiment name must be unique and start with a letter. `
|
|
|
`truffle1> dm-5idd-upload --experiment=s5test-01 --data-directory=/data/2017-1/bedzyk`
|
|
|
`EXPERIMENT INFO`
|
|
|
`id=284 name=s5test-01`
|
|
|
`...`
|
|
|
In this section we illustrate typical system usage via the DM Station GUI (see the [Getting Started](https://git.aps.anl.gov/DM/dm-docs/-/blob/master/getting_started/getting-started.md) guide for more details). Note that /opt/dm directory should be accessible on all LSCAT machines.
|
|
|
|
|
|
1. Setup environment by sourcing setup file.
|
|
|
`$ # After sourcing setup file, all DM commands will be in your path`
|
|
|
`$ source /opt/dm/etc/dm.setup.csh`
|
|
|
2. Create DM experiment, and upload data to the GPFS DDN storage:
|
|
|
`truffle1> # Experiment name must be unique and start with a letter. `
|
|
|
`truffle1> dm-5idd-upload --experiment=s5test-01 --data-directory=/data/2017-1/bedzyk`
|
|
|
`EXPERIMENT INFO`
|
|
|
`id=284 name=s5test-01`
|
|
|
`...`
|
|
|
3. Check status of your uploads:
|
|
|
|
|
|
`truffle1> # Use dm-list-uploads to get status of all uploads`
|
|
|
`truffle1> dm-list-uploads`
|
|
|
`id=50392f24-e7e9-4122-b94d-d7662c6c0ab9 experimentName=s5test-01`
|
|
|
`...`
|
|
|
|
|
|
`truffle1> # Use dm-list-uploads to get status of all uploads`
|
|
|
`truffle1> dm-list-uploads`
|
|
|
`id=50392f24-e7e9-4122-b94d-d7662c6c0ab9 experimentName=s5test-01`
|
|
|
`...`
|
|
|
4. Start monitoring directory for new files (DAQ mode):
|
|
|
|
|
|
`truffle1> # Any files already present in the specified data directory will be ignored. `
|
|
|
`truffle1> # The --dest-directory option indicates directory path relative to experiment root directory in storage`
|
|
|
`truffle1> dm-5idd-daq --data-directory=/opt/dm/test --experiment=s5test-01 --dest-directory=daqdata --duration=1h`
|
|
|
`id=ac392f24-e7e9-3712-b94d-d7662c6c0ab9 experimentName=s5test-01`
|
|
|
`...`
|
|
|
|
|
|
`truffle1> # Any files already present in the specified data directory will be ignored. `
|
|
|
`truffle1> # The --dest-directory option indicates directory path relative to experiment root directory in storage`
|
|
|
`truffle1> dm-5idd-daq --data-directory=/opt/dm/test --experiment=s5test-01 --dest-directory=daqdata --duration=1h`
|
|
|
`id=ac392f24-e7e9-3712-b94d-d7662c6c0ab9 experimentName=s5test-01`
|
|
|
`...`
|
|
|
5. Check status of your DAQs:
|
|
|
|
|
|
`truffle1> # Use dm-list-daqs to get status of all DAQs`
|
|
|
`truffle1> dm-list-daqs`
|
|
|
`id=ac392f24-e7e9-3712-b94d-d7662c6c0ab9 experimentName=s5test-01`
|
|
|
`...`
|
|
|
|
|
|
`truffle1> # Use dm-list-daqs to get status of all DAQs`
|
|
|
`truffle1> dm-list-daqs`
|
|
|
`id=ac392f24-e7e9-3712-b94d-d7662c6c0ab9 experimentName=s5test-01`
|
|
|
`...`
|
|
|
6. Retrieve list of your cataloged file metadata, etc. Alternative way of viewing metadata catalog is via Mongo Express application (https://truffle1.dnd.aps.anl.gov:8182/db/dm).
|
|
|
|
|
|
`truffle1> dm-list-experiment-files --experiment=s5test-01`
|
|
|
`id=591f359171913f50b4df5f6d fileName=`
|
|
|
`...`
|
|
|
|
|
|
|
|
|
`truffle1> dm-list-experiment-files --experiment=s5test-01`
|
|
|
`id=591f359171913f50b4df5f6d fileName=`
|
|
|
`...`
|
|
|
7. Check that you can see your files using Globus Online. Note that experiment files can be read only by those DM usernames that have been assigned a role within a given experiment.
|
|
|
|
|
|
a. Using your browser, open https://www.globus.org/
|
|
|
b. Sign in with your Globus username
|
|
|
c. Click on "Transfer Files"
|
... | ... | |