Realtime replication using VV launcher

[KokkersI]

After discarding Microsoft FRS I'm looking for a more suitable file replication program.

Situation:

2 videoservers are streaming video's to our visitors on the internet.
Serving lots of simultaneous video's generates quite some diskload on the RAID5 array.

The replication of uploaded video's should generate as little cpu & diskload as possible as this could cause delays in the videostreams.
(We are using dual Xeon 3,2Ghz servers using hyperthreading and more than enough memory)

The 2 servers are interconnected to dedicated gigabit so bandwidth is not a problem.

I want files to get replicated to the other server as fast as possible.
Realtime bi-directional replication requires the filesystems on both sides have to be watched. (Or the application would have to scan the remote directory continuously which is unacceptable).
I would have to install VV pro & VV Launch on both servers in my situation.
Not a problem at all.

I have set-up VV Pro & launch on one server replicating to the other already but am running into some trouble.

Setup VV Pro:

Source: D:\testvolume\
Target: \\MSS5\d$\testvolume\
Default synchronization method: advanced sync (with history)
Synchronization History: Enabled (database)

Setup VV Launch:

Detect changes in Source(s)
On
Detected changes in Target(s)
Off

Run as soon as file changes are detected
On


My testenvironment only has 8500 files / folders, my real environment has approx. 40.000.

When I launch the profile nothing happens, the filesystem is being watched.

When I add one file to the source directory it replicates nicely.
The launcher then shows VV is comparing the source and target directory structure every 5 seconds and stays in this loop.

1 17:04:01 : ****
2005-08-01 17:04:01 : Checking source D:\testvolume\ ...
2005-08-01 17:04:02 : Checking target \\MSS5\d$\testvolume\ ...
2005-08-01 17:04:05 : Comparing files...
2005-08-01 17:04:05 : Checking synchronization history...
2005-08-01 17:04:05 : Comparing done.

.....

01 17:04:06 : Checking source D:\testvolume\ ...
2005-08-01 17:04:07 : Checking target \\MSS5\d$\testvolume\ ...
2005-08-01 17:04:10 : Comparing files...
2005-08-01 17:04:10 : Checking synchronization history...
2005-08-01 17:04:10 : Comparing done.

Why does VV need to compare directory structure on both sides every 5 seconds if I only need to replicate from source to target and not the other way around.
What is the Synchronization History database used for then?

Comparing both directories every 5 seconds generates the following system load and ofcourse the required undesired diskload.

The diskload will be even heavier in my production environment with almost 40.000 files / directory's.

What I want:
- Compare source & target once
- Update missing data on both sides
- Watch file system for changes
- Add new files without comparing the source & target again & again generating unnecessary load.

Is this possible using VV pro & VV Launch?

Kind regards

[TGRMN Software]

Hello -

VVLauncher works this way:
- It watches source and/or target for changes.
- As soos as a file change is detected it runs ViceVersa.
- ViceVersa scans the directories for checking which files need updating (40.000 files is not much for ViceVersa. With the connectivity you have between the two servers this will happen very quickly) .
- ViceVersa updates files as necessary.

It seems that the issue here is that VVLauncher goes into a loop, like if file changes happen all the time. Do you have VVLauncher.log in the VVLauncher directory to look at?

In order not to disrupt the normal functioning of the server I would set speed to low (it means replicate slow using fewer resources).
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

[Kokkers]

- Cleared log
- Started VV Launcher
- Deleted a file from the specified source directory
- VV Pro runs
- Source / target checks run every 5 seconds at 100% speed.
- Load throttling seems to work just fine

Mailed you the log results