Author |
Message |
piet200
Joined: 21 May 2015 Posts: 33
|
Posted: Fri Jun 19, 2015 8:15 am Post subject: Very slow copy speed |
|
|
I am running synchronization jobs over a WAN link. Of course the speed of these jobs is dependent of the bandwidth and latency of that line. (bandwidth = 50 Mb)
But the average speed when copying files is much too low.
When copying the files manually, without ViceVersa the performance is much better.
What can I do to improve the performance of the synchronization jobs ?
When looking at the log file there are 4 files a minute copied.
The size of the files is between 20 and 200 Kb.
So the average speed is 400 Kb per minute.
Which is about 24 Mb per hour.
With that speed it takes about 2 days for 1 GB.
I need to sync several 100’s of GB’s. you can imagine this is not acceptable.
By the way, when copying files manually through the windows explorer I get a higher speed. |
|
Back to top |
|
|
TGRMN Software Site Admin
Joined: 10 Jan 2005 Posts: 8758
|
Posted: Fri Jun 19, 2015 12:17 pm Post subject: |
|
|
Hi, please try enabling the "use Windows native file copy" option in profile settings -> performance. Does that option help? thanks _________________ --
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
Back to top |
|
|
piet200
Joined: 21 May 2015 Posts: 33
|
Posted: Fri Jun 19, 2015 1:33 pm Post subject: |
|
|
I have enabled the suggested feature.
Next week I'll send an update on this. |
|
Back to top |
|
|
TGRMN Software Site Admin
Joined: 10 Jan 2005 Posts: 8758
|
Posted: Sat Jun 20, 2015 1:05 am Post subject: |
|
|
OK, thanks. That option instructs ViceVersa to use the same function as Windows Explorer to copy files , you should be able to achieve the same performance as a file copy with Windows Explorer. thanks _________________ --
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
Back to top |
|
|
piet200
Joined: 21 May 2015 Posts: 33
|
Posted: Fri Jun 26, 2015 7:43 am Post subject: |
|
|
The performance is still very bad.
When doing some performance tests with iperf the speed could be much higher when using multiple streams. The can be up to a factor 10.
Is there a way to let ViceVersa use multiple parallel streams ? |
|
Back to top |
|
|
TGRMN Software Site Admin
Joined: 10 Jan 2005 Posts: 8758
|
Posted: Mon Jun 29, 2015 12:30 am Post subject: |
|
|
Hi, you can setup multiple profiles to run in parallel using VVEngine. Otherwise we are testing copy multiple-threads in ViceVersa for possible inclusion in a future release. thanks _________________ --
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
Back to top |
|
|
piet200
Joined: 21 May 2015 Posts: 33
|
Posted: Thu Jul 02, 2015 5:52 am Post subject: |
|
|
I am currently running multiple profiles, but the speed is still quite bad.
Can't wait to get the new release which supports multiple streams.
When can we expect it to be released ? |
|
Back to top |
|
|
TGRMN Software Site Admin
Joined: 10 Jan 2005 Posts: 8758
|
|
Back to top |
|
|
piet200
Joined: 21 May 2015 Posts: 33
|
Posted: Thu Jul 02, 2015 11:43 am Post subject: |
|
|
Currently there are only 6 jobs running parallel, but there still have to be created around 100 jobs. most of them will run parallel to different wan locations. High latency is also something we have to deal with. |
|
Back to top |
|
|
TGRMN Software Site Admin
Joined: 10 Jan 2005 Posts: 8758
|
Posted: Thu Jul 02, 2015 11:43 pm Post subject: |
|
|
I was wondering if you have multiple streams already going from source to target (via multiple profiles), if a multi-threaded copy would help... _________________ --
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
Back to top |
|
|
piet200
Joined: 21 May 2015 Posts: 33
|
Posted: Fri Jul 03, 2015 6:20 am Post subject: |
|
|
If the speed won't increase, at lease I can use less profiles.
Now I have a lot of profiles for the same destination location, but have been spit-up because of the very bad performance.
If a single profile can copy data in multiple streams, I can combine these profiles and keep the overview. which makes is much easier to manage.
do you know when we can expect the version which supports multiple streams ? |
|
Back to top |
|
|
korence
Joined: 10 Aug 2015 Posts: 1
|
Posted: Mon Aug 10, 2015 1:57 am Post subject: How to solve slow copy speed |
|
|
Copy speed slow in one hand means that there are too much things on your computer. Then you need to speed up your computer at first. Then the slow copy speed will be solved. |
|
Back to top |
|
|
|