VVLauncher throwing error

[philip_b]

Greetings-

We are evaluating VV and have developed an issue - We created a profile for VVLauncher that watches three folders on 3 different volumes and mirros that data to a second server.

It runs in realtime ans is working very well with one exception: When a very large file is written to one of the source folders it tries to copy the file before the write is complete. THe files are very large (8-10 GB) and are getting transferred via FTP so the write speed is fairly slow.

Eventually the file is written and VV correctly mirros the file, but there are many error messages in the logs from VV trying to copy the open file.

Is it possible to configure VVLauncher to wait 30 secs or 1 min after the write is complete before it attempts to copy?

I like the realtime component and would like to avoid scheduling the profile as the folders are very large and too much time would be wasted on verifying what is already copied.

Any thoughts or pointers would be greatly appreciated.

Thank you.

[TGRMN Software]

Hello,

it;s not possible with VVLauncher , but it's possible with the latest VVEngine, see:
http://www.tgrmn.com/web/vvengine/vvengine.htm

You can set the seconds to wait before starting profile on file change detection. It's a general VVEngine setting, see help file.

thanks
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

[philip_b]

Thank you for the response.

We want to replicate (Mirror) three folders each with a few TB of data. If we use VVEngine will it keep track of file system writes and only replicate the files that have changed/added/deleted or will it need to scan the entire file system before making those updates?

We would like the mirror to be updated within 5-10 minutes of the source and with such a large amount of data I am concerned that re-scanning the entire file system every time would not be appropriate.

From what I have seen the VV app is very well done and I hope that it will meet our requirements.

Thanks again.

[TGRMN Software]

Hello,

VVEngine will do a re-scan of source and target if a file change is detected. Are you replicating files over a slow connection?

thanks
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

[philip_b]

Thanks for response.

No - these servers are sitting next to each other with 1 GB cross-over cable.

My concern is that if a 1 KB file is added to Target that VV will check 6 TB of data. That seems like a lot of array I/O for tracking down a 1 KB file. And this happens all throughout the day... every time a small file is written the entire 6 TB is verified.

Is that what will happen, or does VV keep track of which files were accessed by the filesystem and just sync those?

Thank you.

[TGRMN Software]

Yes, that is what will happen. We plan to improve that and have a "no-rescan" version of VVEngine, in the meantime you could reduce the amount of files to scan in each profile by creating multiple profiles and schedule them with VVEngine.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

[philip_b]

Thanks.

Do you know approximately how close the no-rescan option is to being released?

I guess we could rescan 2X per day, but that doesn't provide the level of redundancy that we were hoping for.

Can you tell me how much of an I/O load this places on the system? We would probably be just doing timestamp compares and not full CRC.. so maybe every 2 hours would be ok.

Any recommendations?

THanks again for your input.

[TGRMN Software]

Hi,