Out of memory, too many files ... [Error Code mA3]

[ybherer]

Hi,

I am doing a trial of your software and encountered this error below when I ran the backup job the second time using Compare and Execute (initial backup was fine). I am attempting to keep a replicated copy of our mail servers data for a quick disaster recover scenario, but some of them contain between 1 - 3 million files. What is the maximum allowed number of files per profile allowed? Is there a way to change a setting to increase that threshold and do one backup job, rather then multiple ones?

Regards,
Yannick

************************************************************
Profile Started.
************************************************************
Version: ViceVersa PRO 2.5 Build 2518 (SN409)
Command Line: "C:\Program Files\ViceVersa Pro\VICEVERSA.EXE"
System: Windows Server 2003 R2, (Standard Edition), (x86-32 Processor) v5.2 Build:3790 Service Pack:2
User: Administrator
Computer: XXX
**** - Folders -
**** Source: "E:\IceWarp\"
**** Target: "S:\"
**** Include Subfolders: Yes
**** - Comparison Settings -
**** Comparison Type: Size and Timestamp
**** - Execution Settings -
**** Method: Backup (Mirror Source to Target)
**** No archive for deleted/replaced source files
**** No archive for deleted/replaced target files
**** Limit Bandwidth to: 20.00MB/Sec
**** Speed: 25 Buffer Size: 32768
Checking source E:\IceWarp\ ...
Total found: 1,221,506
Checking target S:\ ...
[ERROR] Out of memory, too many files in source and target. Split job into multiple profiles [Error Code mA3]
Total found: 1,079,999
[ERROR] Error scanning target folder. There are no more files.
Aborted.

[Alice]

You have an x86 processor, that seems like the issue here. I have had up to 8 million files in a single profile on a 8GB 64-bit server 2008 r2.

Generally I stick to 1,500,000 per profile as the compare/re-compare speed can be just too long otherwise. Or sometimes I use two servers pointing at different parts of the data set, eg folders starting with letters A-G, H-M on server 1. Then N-Q, R-Z on server 2.


See also :

[TGRMN Software]

Hi, yes, on Windows 32-bit you can hit the memory limit at around 1 million files, but it also depends on what other programs are running at the same time.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

[ybherer]

Thanks that is very useful. Is there a way to chain the profiles to run one after the other, without any of them running concurrently and cause the same issue? I know I can schedule them, but that means I will have to leave a buffer to make sure they dont conflict with each other. I want to restrict my backups at night, so time is limited.

Thanks,
Yannick

[TGRMN Software]

Yes, you can use the VVEngine add-on for that:

http://www.tgrmn.com/web/vvengine/vvengine.htm

It can chain profiles to run sequentially.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com