Skip to content
Snippets Groups Projects
RELEASE_NOTES.txt 4.87 KiB
Newer Older
sveseli's avatar
sveseli committed
Release 1.0 (15/1/2017)
=============================

- Introduced concept of experiment station and redesigned authorization 
  mechanisms to allow beamline managers to manage their stations; all
  APIs and CLIs now conform to the new authorization scheme
- Modified get-experiments utility to allow retrieving list of experiments
  for a given station

sveseli's avatar
sveseli committed
Release 0.15 (11/1/2016)
sveseli's avatar
sveseli committed
=============================

- Resolved issue with incorrect accounting of processing errors for DAQs
sveseli's avatar
sveseli committed
- Improved DAQ processing algorithm to avoid resource starvation between
sveseli's avatar
sveseli committed
- Enhanced monitoring status information for both DAQs and uploads
sveseli's avatar
sveseli committed

Release 0.14 (10/14/2016)
sveseli's avatar
sveseli committed
=============================

- Introduced new framework and utilities for synchronizing users with 
  APS DB
- Resolved several issues with special characters in file names for
  gridftp transfer plugin  

sveseli's avatar
sveseli committed
Release 0.13 (05/27/2016)
sveseli's avatar
sveseli committed
=============================

- Added SFTP file system observer agent
sveseli's avatar
sveseli committed
- Enhanced MongoDB plugin with file md5 sum calculation
sveseli's avatar
sveseli committed

sveseli's avatar
sveseli committed
Release 0.12 (05/06/2016)
=============================

- Developed processing for HDF5 metadata in Mongo cataloging plugin
- Modified catalog API and service interfaces to use file collections on 
  a per-experiment basis

Release 0.11 (04/29/2016)
=============================

- Resolved issue with upload command for directories containing large
  number of files
- Implemented enhanced upload processing algorithm to avoid resource 
  starvation between simultaneous DAQs and uploads
- Added new polling file system observer agent as option for monitoring 
  directories
sveseli's avatar
sveseli committed
- Reworked catalog API and corresponding MongoDB interfaces to use unique 
  experiment file paths, rather than file names
sveseli's avatar
sveseli committed
Release 0.10 (03/11/2016)
=============================

- Added dm-list-daqs and dm-list-uploads commands
- Resolved issue with newly created directories treated as files for 
  real-time data acquisitions
Release 0.9 (02/25/2016)
=============================

- Developed directory processing mode for uploads; in this mode file transfer 
  plugins transfer entire directories as opposed to individual files
- Added dm-get-processing-plugins command
- Resolved working directory issue that may occur with simutaneous uploads

sveseli's avatar
sveseli committed
Release 0.8 (01/26/2016)
=============================
sveseli's avatar
sveseli committed

sveseli's avatar
sveseli committed
- Enhanced upload/daq performance and functionality (hidden files are not
sveseli's avatar
sveseli committed
  processed; for uploads system can detect files that had been processed 
  already; improved handling and reporting of processing errors)
sveseli's avatar
sveseli committed
- Source file checksum is calculated for rsync/gridftp plugins by default
- Resolved globus online user authorization delay issue 
sveseli's avatar
sveseli committed

sveseli's avatar
sveseli committed
Release 0.7 (12/08/2015)
=============================

sveseli's avatar
sveseli committed
- Introduced framework and user interfaces for tracking progress of file 
  uploads and data acquisitions in DAQ service
- Added ability to monitor multiple directories for the same experiment 
  simultaneously (required changes to DAQ service REST interfaces)
sveseli's avatar
sveseli committed
- Enhanced start/stop DAQ and upload commands to use DM_FILE_SERVER_URL
  environment variable
- Added user interfaces and utilities that enable experiment data download
  from machines that have SSH access to the storage host
sveseli's avatar
sveseli committed
Release 0.6 (11/6/2015)
=============================

- Added file system observer agent interface for DAQ service
sveseli's avatar
sveseli committed
- Implemented FTP file system observer for DAQ service
- Added interfaces for deleting user experiment role in DS service
- Introduced java REST API framework, and specific experiment DS service API 
- Web Portal notifies DS service about experiment user modifications 
sveseli's avatar
sveseli committed
Release 0.5 (10/08/2015)
sveseli's avatar
sveseli committed
=============================

sveseli's avatar
sveseli committed
- Implemented Single Sign-On solution for backend services
- Enabled user authentication via login file
- Added file stat (with checksum) interface in DS web service
- After adding user role to experiment via command line, user is also
  added to experiment group (if one exists)
sveseli's avatar
sveseli committed
- Added rsync file transfer plugin with checksum and delete
sveseli's avatar
sveseli committed

Release 0.4 (09/21/2015) 
=============================

sveseli's avatar
sveseli committed
- Number of minor modifications made in preparation for test deployment at
sveseli's avatar
sveseli committed
  beamlines

Release 0.3 (07/22/2015) 
=============================

sveseli's avatar
sveseli committed
- Developed initial version of Catalogging Web Service based on MongoDB
- Developed sample processing plugins: file metadata catalog, SDDS processing, 
  SGE job submission
sveseli's avatar
sveseli committed

Release 0.2 (06/30/2015) 
=============================

- Implemented storage permission management and user group management
- Developed common file processing service plugin framework

Release 0.1 (04/21/2015) 
=============================

- Functional web portal (user, experiment, and policy pages)
- Developed web service and its API/CLI frameworks
- Developed initial version of Data Storage Web Service
- Developed initial version of Data Acquisition Web Service;
- DAQ service can monitor file system on a detector node and subsequently
  transfer data to storage
sveseli's avatar
sveseli committed