modifications to eliminate processing of hidden files and of unchanged files that were processed already; checksum is now done by default

fixed few issues found while testing gridftp plugin and file observer; made observer more generic by shifting some functionality to agent

Added exception catching for directory events. This is intended to fix a possible crash of watchdog and never seeing file changes