... | @@ -14,6 +14,45 @@ In this section we illustrate typical system usage via the DM Station GUI (see t |
... | @@ -14,6 +14,45 @@ In this section we illustrate typical system usage via the DM Station GUI (see t |
|
e. Navigate to experiment folder. All experiments will be under the "/gdata/dm/LSCAT" directory (e.g. "/gdata/dm/LSCAT/test-12idf-01)".
|
|
e. Navigate to experiment folder. All experiments will be under the "/gdata/dm/LSCAT" directory (e.g. "/gdata/dm/LSCAT/test-12idf-01)".
|
|
f. At this point you should be able to transfer files to any Globus endpoint that you have access to. Note that downloading files to your desktop or laptop requires installing Globus Connect Personal endpoint.
|
|
f. At this point you should be able to transfer files to any Globus endpoint that you have access to. Note that downloading files to your desktop or laptop requires installing Globus Connect Personal endpoint.
|
|
|
|
|
|
|
|
##Command Lines
|
|
|
|
|
|
|
|
In this section we list few most important DM commands that can be used from a terminal session or in scripts.
|
|
|
|
|
|
|
|
1. Create an experiment and upload data to the central storage system:
|
|
|
|
```
|
|
|
|
$ # Experiment name must be unique and start with a letter.
|
|
|
|
$ # Users can be added to experiment by specifying Beamline Scheduling System proposal id (--proposal-id option),
|
|
|
|
$ # or a list of users directly (--users option)
|
|
|
|
$ dm-lscat-upload --experiment=test-lscat-01 --data-directory=/opt/dm/test
|
|
|
|
```
|
|
|
|
1. Check status of your uploads:
|
|
|
|
```
|
|
|
|
$ dm-list-uploads
|
|
|
|
```
|
|
|
|
1. Start monitoring directory for new files (DAQ mode):
|
|
|
|
```
|
|
|
|
$ # Any files already present in the specified data directory will be ignored.
|
|
|
|
$ # The --dest-directory option indicates directory path relative to experiment root directory in storage
|
|
|
|
$ # Users can be added to experiment by specifying Beamline Scheduling System proposal id (--proposal-id option)
|
|
|
|
$ # or a list of users directly (--users option)
|
|
|
|
$ dm-lscat-daq --data-directory=/opt/dm/test --experiment=test-lscat-01 --dest-directory=daqdata --duration=1h
|
|
|
|
```
|
|
|
|
1. Check status of your DAQs:
|
|
|
|
```
|
|
|
|
$ dm-list-daqs
|
|
|
|
```
|
|
|
|
1. Retrieve list of your cataloged file metadata, etc. Alternative way of viewing metadata catalog is via Mongo Express application (https://s12iddm.xray.aps.anl.gov:8182/db/dm).
|
|
|
|
```
|
|
|
|
$ dm-list-experiment-files --experiment=test-lscat-01
|
|
|
|
```
|
|
|
|
1. Add or remove users associated with your experiment.
|
|
|
|
```
|
|
|
|
$ # Use d<badge> when specifying usernames
|
|
|
|
$ dm-add-user-experiment-role --username=d225159 --experiment=test-lscat-01 --role=User
|
|
|
|
$ dm-delete-user-experiment-role --username=d225159 --experiment=test-lscat-01 --role=User
|
|
|
|
```
|
|
|
|
|
|
|
|
|
|
## System Administration
|
|
## System Administration
|
|
|
|
|
|
DM services are controlled using standard RHEL daemon scripts located under the /home/dm_bm/production/etc/init.d directory. Relevant scripts are:
|
|
DM services are controlled using standard RHEL daemon scripts located under the /home/dm_bm/production/etc/init.d directory. Relevant scripts are:
|
... | | ... | |