RELEASE_NOTES.txt 19.7 KB
Newer Older
sveseli's avatar
sveseli committed
1
2
3
4
Release 3.3.3 (XX/YY/2020)
=============================
- Fixed issue with non-ascii characters for daq/upload CLI tools

sveseli's avatar
sveseli committed
5
Release 3.3.2 (07/09/2020)
6
7
8
=============================
- Added ability to upload files from remote machines via rsync plugin and using
  ssh
sveseli's avatar
sveseli committed
9
- Added start/end time into GUP proposal object
10
11
12

Release 3.3.1 (05/06/2020)
=============================
sveseli's avatar
sveseli committed
13
- Maintenance release
14
15

Release 3.3.0 (05/04/2020)
sveseli's avatar
sveseli committed
16
17
18
19
20
=============================
- Change log4j version from 1.2.7 to 2.13.2. Code changes to adapt were
  necessary. Changed config file from log4j.properties to log4j2.xml
- Change jar file for postgresql from 9.3-1102.jdbc41 to 42.2.8.
  The underlying postgresql in support changed from 9.3 to 9.6 a while ago.
21
22
23

Release 3.2.2 (02/24/2020)
=============================
sveseli's avatar
sveseli committed
24
- Added user documentation (Getting Started guide)
25
26
27

Release 3.2.1 (01/15/2020)
=============================
sveseli's avatar
sveseli committed
28
29
30
- DM GUI Changes:
  - Reworked configuration options for DAQs and uploads; those now support
    including/excluding file extensions  
sveseli's avatar
sveseli committed
31
  - Fixed bug that was preventing using configuration options and additional
sveseli's avatar
sveseli committed
32
    keywords at the same time
33

34
35
36
37
38
39
40
41
42
43
Release 3.2.0 (11/05/2019)
=============================
- Implemented ability to include or exclude file extensions for uploads and DAQs
  - New API Options for starting DAQ/Upload
    * includeFileExtensions
    * excludeFileExtensions
  - New CLI Options for starting DAQ/Upload
    * include-extensions
    * exclude-extensions

sveseli's avatar
sveseli committed
44
Release 3.1.0 (10/25/2019)
45
=============================
sveseli's avatar
sveseli committed
46
47
48
49
- Added new ESAF interfaces for support of extended data retrieval
- Enabled URL scheme for transfer plugin configuration; this allows
  multiple gridftp hosts per deployment
- Updated support software to allow offsite installation
sveseli's avatar
sveseli committed
50
- DM GUI changes:
51
52
  - Add settings page
    - Allow user to specify refresh rates per module. 
sveseli's avatar
sveseli committed
53
    - Fixed protocol parsing bug
54

sveseli's avatar
sveseli committed
55
56
57
58
59
60
61
62
Release 3.0.1 (08/09/2019)
=============================
- Fixed issue with unchecked additions to metadata catalog
- Updated support software:
  - OpenJDK (replaces Oracle JDK)
  - Payara (replaces Glassfish)
- Added 12IDB utilities

sveseli's avatar
sveseli committed
63
64
65
66
67
68
69
70
71
Release 3.0.0 (07/26/2019)
=============================
- Added python web service API for downloading files 
- Updated DB schema for experiment data archival support
- Web Portal changes:
  - Added storage views
  - Added connection between station and experiment types
  - Updated experiment views with storage and root path fields

sveseli's avatar
sveseli committed
72
Release 2.6.0 (07/15/2019)
sveseli's avatar
sveseli committed
73
74
75
76
=============================
- Moved code repo to gitlab
- Updated release/upgrade utilities

sveseli's avatar
sveseli committed
77
78
79
80
81
Release 2.5.0 (06/23/2019)
=============================
- Added pprint (pretty-print) option to display format for all commands
- Added support for repeated commands via repeatPeriod/repeatUntil/maxRepeats
  keys in workflow definitions
sveseli's avatar
sveseli committed
82
- Added skip/limit options to list-processing-jobs 
sveseli's avatar
sveseli committed
83
84
85
86
87
88
89
90
91
92
- Implemented ability to stop processing jobs
  - New command:
    * stop-processing-job
- Enhanced support for processing multiple files with a given workflow
  - New command:
    * process-files
- Updated workflow API documentation
- DM Station GUI fixes/enhancements:
  - Fixed issue with modifying user list before saving experiment

sveseli's avatar
sveseli committed
93
Release 2.4.0 (05/20/2019)
sveseli's avatar
sveseli committed
94
95
96
97
=============================
- Added system LDAP utilities for verifying and creating groups
- Added support for retrieving single processing job stage via the --stage
  option for the get-processing-job command
sveseli's avatar
sveseli committed
98
99
- Prevented core files from being uploaded
- Prevented creation of experiment names with spaces
sveseli's avatar
sveseli committed
100
101
102
103
104
- Fixed file limit problem in compression utilities
- DM Station GUI fixes/enhancements:
  - Fixed issue with experiment user list modification
  - Added tab for monitoring processing jobs
  - Restored workflow tab 
sveseli's avatar
sveseli committed
105

sveseli's avatar
sveseli committed
106
Release 2.3.0 (04/15/2019)
sveseli's avatar
sveseli committed
107
=============================
sveseli's avatar
sveseli committed
108
- Updated CDB plugin for the latest CDB API changes
sveseli's avatar
sveseli committed
109
- Expanded support for HTML-formatted output
110
- Optimized amount of data transferred with file metadata listing
111
112
- Implemented limit on number of files that can be retrieved using
  a single list-experiment-files command or API call
sveseli's avatar
sveseli committed
113
- Added more diagnostic output to compression/decompression utilities
sveseli's avatar
sveseli committed
114
- DM Station GUI fixes/enhancements:
sveseli's avatar
sveseli committed
115
116
117
  - Added logging and ability to use DM_CONSOLE_LOG_LEVEL environment 
    variable to specify logging level
  - Resolved issue with undefined self key in exception hook
sveseli's avatar
sveseli committed
118
119
120
121
  - Added support for single file upload
  - Added support for experiment root path
  - Added warning dialog for experiment updates
  - Added number of tooltips 
sveseli's avatar
sveseli committed
122
123
124
125
126
127
  - Optimized handling of file metadata for experiments with large
    number of files
  - Added support for pagination while fetching full list of files
  - Implemented progress dialog when fetching a very large set of files
  - Resolved issue with filter boxes layout not matching data table 
    default column sizes
sveseli's avatar
sveseli committed
128

sveseli's avatar
sveseli committed
129
130
131
132
133
Release 2.2.2 (02/11/2019)
=============================
- Updated deployment scripts
- Fixed several Python 2/3 compatibility issues

sveseli's avatar
sveseli committed
134
135
136
137
138
139
Release 2.2.1 (02/04/2019)
=============================
- Updated API documentation
- DM Station GUI fixes/enhancements:
  - Added file compression capability

sveseli's avatar
sveseli committed
140
Release 2.2.0 (01/15/2019)
sveseli's avatar
sveseli committed
141
142
=============================
- Added ESAF interfaces to APS DB service 
sveseli's avatar
sveseli committed
143
144
145
- Moved all ESAF/BSS command line utilities to APS DB service 
  - New command:
    * list-beamlines 
sveseli's avatar
sveseli committed
146
147
- Converted software to Python 3, but retained Python 2 compatibility
- Introduced support for API pip and conda packages
sveseli's avatar
sveseli committed
148
149
- Added support for a single file upload via the --file-path option to
  upload commands
sveseli's avatar
sveseli committed
150
151
152
153
154
155
156
157
- Added support for arbitrary experiment path under the ${DM_STATION_NAME}
  directory via the --root-path option to the following commands:
    * add-experiment
    * update-experiment
    * ${DM_STATION_NAME}-daq
    * ${DM_STATION_NAME}-upload
  Note that if this option is not used, experiment will be located under
  the experiment type folder, as before. 
sveseli's avatar
sveseli committed
158

sveseli's avatar
sveseli committed
159
Release 2.1.0 (12/31/2018)
sveseli's avatar
sveseli committed
160
161
=============================
- Added estimated completion time to upload monitoring
sveseli's avatar
sveseli committed
162
163
164
165
166
- Introduced additional enhancements for cataloging plugin that shorten
  uploads of large datasets
- Developed initial image receiver service and utilities that can accept
  Area Detector NTNDArray frames and save them into files; currently
  supported formats are SDDS, JSON, HDF5, and JPEG.
sveseli's avatar
sveseli committed
167
168
169
  - New commands:
    * start-image-receiver
    * stop-image-receiver
sveseli's avatar
sveseli committed
170
- Added new APS DB service for accessing beamline scheduling system 
sveseli's avatar
sveseli committed
171

sveseli's avatar
sveseli committed
172
173
174
175
Release 2.0.0 (10/15/2018)
=============================
- Modified DM DB to support arbitrary experiment root paths

sveseli's avatar
sveseli committed
176
Release 1.9.3 (09/15/2018)
177
178
179
180
181
=============================
- Added generic script processing plugin for DAQ service
- Parallelized cataloging plugin; this significantly increased performance 
  for uploads using directory mode

sveseli's avatar
sveseli committed
182
Release 1.9.2 (05/15/2018)
sveseli's avatar
sveseli committed
183
=============================
sveseli's avatar
sveseli committed
184
- Added support for compressing and decompressing files
sveseli's avatar
sveseli committed
185
186
187
188
189
190
191
192
  - New commands:
    * compress-files
    * decompress-files
- Added support for deleting files
  - New commands:
    * delete-file
    * delete-files
- Modified stat-file utility, which now requires explicit --md5sum flag to
sveseli's avatar
sveseli committed
193
194
  retrieve checksum
- Added new --path-pattern option to the list-files command
sveseli's avatar
sveseli committed
195
196
197
- DM Station GUI fixes/enhancements:
  - Added initial GUI test suite
  - Added right-click copying functionality
sveseli's avatar
sveseli committed
198
  - Fixed issue with trailing comma for DAQ/upload parameters
sveseli's avatar
sveseli committed
199
200
201
202
  - Fixed CPU usage bug 
  - Fixed incorrect handling of user selections
  - Fixed focus policy for several buttons

sveseli's avatar
sveseli committed
203
Release 1.9.1 (03/30/2018)
sveseli's avatar
sveseli committed
204
205
=============================
- Added support for command output in html format
206
- Added support for requesting only subset of keys for list of processing jobs
sveseli's avatar
sveseli committed
207
208
- Resolved issues with symbolic links for uploading directories and files 
  via rsync 
209
210
- Fixed DAQ mode issue with double counting of observed files under certain
  circumstances
sveseli's avatar
sveseli committed
211
- Fixed problem with cataloging of HDF5 files that contain non-ascii metadata
sveseli's avatar
sveseli committed
212
213
214
- DM Station GUI fixes/enhancements:
  - Fixed issue with user permissions when creating new experiments
  - Fixed upload configuration issue 
215
  - Fixed caching issues for experiment file metadata and users
sveseli's avatar
sveseli committed
216
217
218
219
  - Added live metadata browsing while files load in background 
  - Added sorting for user table
  - Added ability to copy table information to clipboard
  - Improved selection behavior on tables
sveseli's avatar
sveseli committed
220
  
sveseli's avatar
sveseli committed
221
Release 1.9.0 (01/31/2018)
sveseli's avatar
sveseli committed
222
223
=============================
  
sveseli's avatar
sveseli committed
224
225
- Added support for retrieving file metadata for a given experiment in 
  batches; list-experiment-files get --skip and --limit options
sveseli's avatar
sveseli committed
226
227
228
229
230
231
232
233
- Simplified workflow and processing job management by allowing DM session user
  to be used as default workflow and/or processing job owner
  - Modified commands:
    * list-workflows
    * get-workflow
    * delete-workflow
    * start-processing-job
    * list-processing-jobs
sveseli's avatar
sveseli committed
234
235
- DM Station GUI fixes/enhancements:
  - Added support for DM_DATA_DIRECTORY_MAP environment variable; this allows
sveseli's avatar
sveseli committed
236
    browsing data locally, while moving data using GridFTP third
sveseli's avatar
sveseli committed
237
    party transfers
sveseli's avatar
sveseli committed
238
  - Enhanced support for viewing large file metadata collections
sveseli's avatar
sveseli committed
239

sveseli's avatar
sveseli committed
240
Release 1.8.0 (12/15/2017)
sveseli's avatar
sveseli committed
241
242
=============================
  
sveseli's avatar
sveseli committed
243
244
245
- Enhanced algorithm for processing of existing files; this resolved issues
  with multiple simultaneous DAQs involving large number of pre-existing
  files that need to be processed
246
247
248
- Added support for retrieving experiment dataset statistics:
  - New command:
    * get-file-collection-stats
sveseli's avatar
sveseli committed
249
250
251
252
253
- Added support for output variables in workflow definitions
- Added generic HDF5 file metadata reader
- Developed DAQ/PROC service integration via new DAQ plugin; this enables
  development and deployment of fully automated data acquisition/processing 
  pipelines based on user-defined workflows
254
255
256
257
258
259
  - Modified commands (all get --workflow-name, --workflow-owner, 
    --workflow-job-owner and --workflow-args options):
    * start-daq
    * upload
    * ${DM_STATION_NAME}-daq
    * ${DM_STATION_NAME}-upload
sveseli's avatar
sveseli committed
260
261
262
263
264
265
- Added HTTPS support for accessing file metadata catalog via Mongo Express
- DM Station GUI fixes/enhancements:
  - Added support for viewing experiment file metadata and file collection
    statistics
  - Added support for DM_BEAMLINE_MANAGERS environment variable
  - Improved dialogs for DAQ/upload configuration options
sveseli's avatar
sveseli committed
266

sveseli's avatar
sveseli committed
267
Release 1.7.0 (11/01/2017)
268
269
270
271
=============================

- DM Station GUI fixes/enhancements:
  - Added integration with ESAF DB
sveseli's avatar
sveseli committed
272
273
- Added new output formating option "--display-format=key-per-line" that is
  common to all commands 
sveseli's avatar
sveseli committed
274
275
- Introduced service monitoring infrastructure, which enabled deployment of
  Nagios-based system monitoring
sveseli's avatar
sveseli committed
276
277
278
  - New commands:
    * get-service-status 
    * clear-service-status 
279

sveseli's avatar
sveseli committed
280
Release 1.6.0 (10/07/2017)
sveseli's avatar
sveseli committed
281
282
=============================

sveseli's avatar
sveseli committed
283
284
285
286
287
288
289
290
291
292
293
- Added integration with APS ESAF DB via new APIs and CLIs
  - New commands:
    * list-esafs: list sector ESAFs by year
    * get-esafs: retrieve ESAF by id
  - Modified commands (new ESAF id option for setting experiment users)
    * ${DM_STATION_NAME}-daq 
    * ${DM_STATION_NAME}-upload
- Enhanced DAQ processing framework with introduction of meta
  classes for plugins and supporting utilities; this enables using
  different processing chain depending on data location, or other 
  distinguishing criteria
sveseli's avatar
sveseli committed
294
295
296
297
298
299
- DM Station GUI fixes/enhancements:
  - Added timer for automatic refresh of DAQ/upload status screens
  - Split configuration options for DAQs/uploads
  - Fixed issue with duplicate proposal users
  - Used current date as default for experiment start/end dates

sveseli's avatar
sveseli committed
300
Release 1.5.0 (08/04/2017)
sveseli's avatar
sveseli committed
301
302
303
=============================

- Added DS interface and Java API for downloading files 
sveseli's avatar
sveseli committed
304
305
306
307
- Added APIs and CLIs to clear (force service to forget) DAQs and uploads
  - New commands:
    * clear-daq
    * clear-upload
sveseli's avatar
sveseli committed
308
309
310
- Introduced APSU-related enhancements:
  - Processing for SDDS metadata in MongoDB cataloging plugin
  - Component Database processing plugin 
sveseli's avatar
sveseli committed
311
- DM Station GUI fixes/enhancements:
sveseli's avatar
sveseli committed
312
  - Fixed issue with DM_BEAMLINE_NAME not set
sveseli's avatar
sveseli committed
313
314
  - Fixed issues with buttons that require previous item selection
  - Added start date to list of DAQs and uploads
sveseli's avatar
sveseli committed
315
  - Added ability to remove completed DAQs or uploads from the top-level list
sveseli's avatar
sveseli committed
316

sveseli's avatar
sveseli committed
317
Release 1.4.0 (07/20/2017)
sveseli's avatar
sveseli committed
318
319
320
321
=============================

- Introduced DM Station GUI (accessed via dm-station-gui command)
- Introduced automated system test framework for DM stations
sveseli's avatar
sveseli committed
322
323
- Added --process-existing option to start-daq and <station>-daq
  commands; this will cause upload of existing files when starting DAQs
sveseli's avatar
sveseli committed
324

sveseli's avatar
sveseli committed
325
Release 1.3.0 (05/10/2017)
sveseli's avatar
sveseli committed
326
327
328
=============================

- Added APIs and CLIs to update experiment attributes and metadata
329
  catalog, as well as to delete experiments
sveseli's avatar
sveseli committed
330
331
332
333
  - New commands:
    * update-experiment
    * update-experiment-files
    * get-async-update-status
334
    * delete-experiment
sveseli's avatar
sveseli committed
335

sveseli's avatar
sveseli committed
336
Release 1.2.0 (04/18/2017)
337
338
339
340
=============================

- Modified scheduling algorithm for DAQs/uploads to simplify status monitoring

sveseli's avatar
sveseli committed
341
Release 1.1.0 (03/10/2017)
342
343
=============================

sveseli's avatar
sveseli committed
344
345
- Introduced integration with Beamline Scheduling System:
  - New commands: 
sveseli's avatar
sveseli committed
346
347
348
349
350
351
352
353
354
355
356
357
358
359
    * list-runs
    * list-proposals
    * get-proposal
  - Added the following options to the add-experiment command:
    --proposal-id: automatically add to experiment all 
      users associated with a given beamline proposal 
    --run: look for beamline proposal in a given run (current run is the 
      default)
    --users: comma specified list of usernames to be added to experiment
      as users
- Added the following options for managing DAQs:
  --duration: DAQ will be stopped automatically after given
    number of days or hours
  --dest-directory: files will be uploaded into
360
    a specific directory relative to experiment root path
sveseli's avatar
sveseli committed
361
362
363
364
365
366
  --upload-data-directory-on-exit: when DAQ finishes, upload of the given 
    data directory will be executed automatically
  --upload-dest-directory-on-exit: specifies destination directory for
    upload after DAQ completes
- Added the following options for managing uploads:
  --dest-directory: files will be uploaded into
367
    a specific directory relative to experiment root path
sveseli's avatar
sveseli committed
368
369
370
- Introduced framework for beamline-specific tools; added 
  beamline-specific commands that combine adding new experiment with running 
  DAQs or uploads: dm-${DM_STATION_NAME}-daq and dm-${DM_STATION_NAME}-upload 
371
- Introduced sphinx as python API documentation framework
sveseli's avatar
sveseli committed
372
373
374
375
- Resolved possible timeout issue when starting DAQ or directory upload 
  with a directory containing large number of files
- Simplified data directory command line option for beamlines that use 
  gridftp (via DM_DATA_DIRECTORY_MAP environment variable)
376

sveseli's avatar
sveseli committed
377
Release 1.0.0 (01/31/2017)
sveseli's avatar
sveseli committed
378
379
380
381
382
383
384
=============================

- Introduced concept of experiment station and redesigned authorization 
  mechanisms to allow beamline managers to manage their stations; all
  APIs and CLIs now conform to the new authorization scheme
- Modified get-experiments utility to allow retrieving list of experiments
  for a given station
sveseli's avatar
sveseli committed
385
386
- Cleaned up web portal by removing unused views, and enabled station 
  management functionality
sveseli's avatar
sveseli committed
387
- GPFS DDN (extrepid) has replaced xstor as the main APS storage
sveseli's avatar
sveseli committed
388
389
390
391
392
393
- CLI changes:
  - add-experiment command requires station name (can be set from env.
    variable); experiment type can be specified using type name
  - get-experiments command requires station name for beamline managers (can 
    be set from env. variable)
  - start-experiment command is now optional
sveseli's avatar
sveseli committed
394

sveseli's avatar
sveseli committed
395
Release 0.9.6 (11/01/2016)
sveseli's avatar
sveseli committed
396
397
398
=============================

- Resolved issue with incorrect accounting of processing errors for DAQs
sveseli's avatar
sveseli committed
399
- Improved DAQ processing algorithm to avoid resource starvation between
400
  simultaneous DAQs and uploads
sveseli's avatar
sveseli committed
401
- Enhanced monitoring status information for both DAQs and uploads
sveseli's avatar
sveseli committed
402

sveseli's avatar
sveseli committed
403
Release 0.9.5 (10/14/2016)
sveseli's avatar
sveseli committed
404
405
406
407
408
409
410
=============================

- Introduced new framework and utilities for synchronizing users with 
  APS DB
- Resolved several issues with special characters in file names for
  gridftp transfer plugin  

sveseli's avatar
sveseli committed
411
Release 0.9.4 (05/27/2016)
sveseli's avatar
sveseli committed
412
413
414
=============================

- Added SFTP file system observer agent
sveseli's avatar
sveseli committed
415
- Enhanced MongoDB plugin with file md5 sum calculation
sveseli's avatar
sveseli committed
416

sveseli's avatar
sveseli committed
417
Release 0.9.3 (05/06/2016)
sveseli's avatar
sveseli committed
418
419
=============================

sveseli's avatar
sveseli committed
420
- Developed processing for HDF5 metadata in MongoDB cataloging plugin
sveseli's avatar
sveseli committed
421
422
423
- Modified catalog API and service interfaces to use file collections on 
  a per-experiment basis

sveseli's avatar
sveseli committed
424
Release 0.9.2 (04/29/2016)
425
426
427
428
429
430
431
432
=============================

- Resolved issue with upload command for directories containing large
  number of files
- Implemented enhanced upload processing algorithm to avoid resource 
  starvation between simultaneous DAQs and uploads
- Added new polling file system observer agent as option for monitoring 
  directories
sveseli's avatar
sveseli committed
433
434
- Reworked catalog API and corresponding MongoDB interfaces to use unique 
  experiment file paths, rather than file names
435

sveseli's avatar
sveseli committed
436
Release 0.9.1 (03/11/2016)
437
438
439
=============================

- Added dm-list-daqs and dm-list-uploads commands
440
441
- Resolved issue with newly created directories treated as files for 
  real-time data acquisitions
442

sveseli's avatar
sveseli committed
443
Release 0.9.0 (02/25/2016)
444
445
446
447
448
449
450
=============================

- Developed directory processing mode for uploads; in this mode file transfer 
  plugins transfer entire directories as opposed to individual files
- Added dm-get-processing-plugins command
- Resolved working directory issue that may occur with simutaneous uploads

sveseli's avatar
sveseli committed
451
Release 0.8.0 (01/26/2016)
sveseli's avatar
sveseli committed
452
=============================
sveseli's avatar
sveseli committed
453

sveseli's avatar
sveseli committed
454
- Enhanced upload/daq performance and functionality (hidden files are not
sveseli's avatar
sveseli committed
455
  processed; for uploads system can detect files that had been processed 
456
  already; improved handling and reporting of processing errors)
sveseli's avatar
sveseli committed
457
- Source file checksum is calculated for rsync/gridftp plugins by default
458
- Added dm-stop-upload command
459
- Resolved globus online user authorization delay issue 
sveseli's avatar
sveseli committed
460

sveseli's avatar
sveseli committed
461
Release 0.7.0 (12/08/2015)
462
463
=============================

sveseli's avatar
sveseli committed
464
465
466
467
- Introduced framework and user interfaces for tracking progress of file 
  uploads and data acquisitions in DAQ service
- Added ability to monitor multiple directories for the same experiment 
  simultaneously (required changes to DAQ service REST interfaces)
sveseli's avatar
sveseli committed
468
469
- Enhanced start/stop DAQ and upload commands to use DM_FILE_SERVER_URL
  environment variable
470
471
- Added user interfaces and utilities that enable experiment data download
  from machines that have SSH access to the storage host
472

sveseli's avatar
sveseli committed
473
Release 0.6.0 (11/06/2015)
474
475
476
=============================

- Added file system observer agent interface for DAQ service
sveseli's avatar
sveseli committed
477
478
479
480
- Implemented FTP file system observer for DAQ service
- Added interfaces for deleting user experiment role in DS service
- Introduced java REST API framework, and specific experiment DS service API 
- Web Portal notifies DS service about experiment user modifications 
481

sveseli's avatar
sveseli committed
482
Release 0.5.0 (10/08/2015)
sveseli's avatar
sveseli committed
483
484
=============================

sveseli's avatar
sveseli committed
485
486
487
488
489
- Implemented Single Sign-On solution for backend services
- Enabled user authentication via login file
- Added file stat (with checksum) interface in DS web service
- After adding user role to experiment via command line, user is also
  added to experiment group (if one exists)
sveseli's avatar
sveseli committed
490
- Added rsync file transfer plugin with checksum and delete
sveseli's avatar
sveseli committed
491

sveseli's avatar
sveseli committed
492
Release 0.4.0 (09/21/2015) 
sveseli's avatar
sveseli committed
493
494
=============================

sveseli's avatar
sveseli committed
495
- Number of minor modifications made in preparation for test deployment at
sveseli's avatar
sveseli committed
496
497
  beamlines

sveseli's avatar
sveseli committed
498
Release 0.3.0 (07/22/2015) 
sveseli's avatar
sveseli committed
499
500
=============================

sveseli's avatar
sveseli committed
501
502
503
- Developed initial version of Catalogging Web Service based on MongoDB
- Developed sample processing plugins: file metadata catalog, SDDS processing, 
  SGE job submission
sveseli's avatar
sveseli committed
504

sveseli's avatar
sveseli committed
505
Release 0.2.0 (06/30/2015) 
sveseli's avatar
sveseli committed
506
507
508
509
510
=============================

- Implemented storage permission management and user group management
- Developed common file processing service plugin framework

sveseli's avatar
sveseli committed
511
Release 0.1.0 (04/21/2015) 
sveseli's avatar
sveseli committed
512
513
514
515
516
517
518
519
=============================

- Functional web portal (user, experiment, and policy pages)
- Developed web service and its API/CLI frameworks
- Developed initial version of Data Storage Web Service
- Developed initial version of Data Acquisition Web Service;
- DAQ service can monitor file system on a detector node and subsequently
  transfer data to storage
sveseli's avatar
sveseli committed
520