Very slow copy speed

piet200 · Joined: 21 May 2015 Posts: 33

I am running synchronization jobs over a WAN link. Of course the speed of these jobs is dependent of the bandwidth and latency of that line. (bandwidth = 50 Mb)

But the average speed when copying files is much too low.

When copying the files manually, without ViceVersa the performance is much better.

What can I do to improve the performance of the synchronization jobs ?

When looking at the log file there are 4 files a minute copied.
The size of the files is between 20 and 200 Kb.

So the average speed is 400 Kb per minute.
Which is about 24 Mb per hour.

With that speed it takes about 2 days for 1 GB.

I need to sync several 100’s of GB’s. you can imagine this is not acceptable.

By the way, when copying files manually through the windows explorer I get a higher speed.

TGRMN Software · Site Admin Joined: 10 Jan 2005 Posts: 8763

Hi, please try enabling the "use Windows native file copy" option in profile settings -> performance. Does that option help? thanks
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

piet200 · Joined: 21 May 2015 Posts: 33

I have enabled the suggested feature.
Next week I'll send an update on this.

TGRMN Software · Site Admin Joined: 10 Jan 2005 Posts: 8763

OK, thanks. That option instructs ViceVersa to use the same function as Windows Explorer to copy files , you should be able to achieve the same performance as a file copy with Windows Explorer. thanks
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

piet200 · Joined: 21 May 2015 Posts: 33

The performance is still very bad.

When doing some performance tests with iperf the speed could be much higher when using multiple streams. The can be up to a factor 10.

Is there a way to let ViceVersa use multiple parallel streams ?

TGRMN Software · Site Admin Joined: 10 Jan 2005 Posts: 8763

Hi, you can setup multiple profiles to run in parallel using VVEngine. Otherwise we are testing copy multiple-threads in ViceVersa for possible inclusion in a future release. thanks
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

piet200 · Joined: 21 May 2015 Posts: 33

I am currently running multiple profiles, but the speed is still quite bad.
Can't wait to get the new release which supports multiple streams.

When can we expect it to be released ?

TGRMN Software · Site Admin Joined: 10 Jan 2005 Posts: 8763

How many profiles are you running in parallel? Are they all copying files at the same time? thanks
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

piet200 · Joined: 21 May 2015 Posts: 33

Currently there are only 6 jobs running parallel, but there still have to be created around 100 jobs. most of them will run parallel to different wan locations. High latency is also something we have to deal with.

TGRMN Software · Site Admin Joined: 10 Jan 2005 Posts: 8763

I was wondering if you have multiple streams already going from source to target (via multiple profiles), if a multi-threaded copy would help...
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

piet200 · Joined: 21 May 2015 Posts: 33

If the speed won't increase, at lease I can use less profiles.

Now I have a lot of profiles for the same destination location, but have been spit-up because of the very bad performance.

If a single profile can copy data in multiple streams, I can combine these profiles and keep the overview. which makes is much easier to manage.

do you know when we can expect the version which supports multiple streams ?

korence · Joined: 10 Aug 2015 Posts: 1

Copy speed slow in one hand means that there are too much things on your computer. Then you need to speed up your computer at first. Then the slow copy speed will be solved.