Main Page > Browse Categories > How To / Articles > Processing a Large Amount of Files Using Multiple Profiles

Processing a Large Amount of Files Using Multiple Profiles

*** Requires ViceVersa PRO 3 or any later version ***

When processing a large amount of files (e.g. more than one million files) it is recommended to enable the profile settings option "Minimize Memory Usage" and also setup multiple profiles. Using multiple profiles makes the data more manageable and uses less memory.

Subfolder filters (and/or file filters as needed) help select which subfolders to include in which profile.

 


*** Example 1 (split into 2 profiles) ***

Need to Replicate, Backup or Sync:
----------------------------------
Source: c:\SourceFolder\ 
Target: X:\TargetFolder\

Profile A
---------
Source: c:\SourceFolder\
Target: X:\TargetFolder\
Include Subfolder Filter \[a-n]* - Case Sensitive: No
(This filter includes only all level-1 subfolders with names starting with a to n)

Profile B
---------
Source: c:\SourceFolder\
Target: X:\TargetFolder\
Exclude Subfolder Filter \[a-n]* - Case Sensitive: No
(This filter excludes all level-1 subfolders with names starting with a to n)

Profile A + Profile B combined will replicate / backup / sync all files from c:\SourceFolder\ to  X:\TargetFolder\

Profiles can be run sequentially using VVEngine.

 


*** Example 2 (split into 3 profiles) ***

Need to Replicate, Backup or Sync:
----------------------------------
Source: c:\SourceFolder\
Target: X:\TargetFolder\

Profile A
---------
Source: c:\SourceFolder\
Target: X:\TargetFolder\
Include Subfolder Filter \[abcdefg]* - Case Sensitive: No
(This filter includes only all level-1 subfolders with names starting with a, b, c, d, e, f or g)

Profile B
---------
Source: c:\SourceFolder\
Target: X:\TargetFolder\
Include Subfolder Filter \[p-z]* - Case Sensitive: No
(This filter includes only all level-1 subfolders with names starting with p to z)

Profile C
---------
Source: c:\SourceFolder\
Target: X:\TargetFolder\
Exclude Subfolder Filter \[p-z]* - Case Sensitive: No
(This filter excludes all level-1 subfolders starting with p to z)
Exclude Subfolder Filter \[abcdefg]* - Case Sensitive: No
(This filter excludes all level-1 subfolders starting with a, b, c, d, e, f or g)

Profile A + Profile B + Profile C combined will replicate / backup / sync all files from c:\SourceFolder\ to  X:\TargetFolder\

Profiles can be run sequentially using VVEngine.

Instead of subfolder filters, file filters can be used to target individual files.

User Comments
Add Comment
Mark -  08-May-17
I am trying to set filters as I have many files. It seams that I may be doing something wrong. Whether I set include, exclude, on a directory or a group of directories the software seems to be scanning all the directories. Here is my most recent attempt to include just 5 directories any thoughts?

Profile File: C:\Users\crredact\Documents\ViceVersa PRO\Include5 directories.fsf

Folders
- Source: "\\rtthanas\orimglib\Public\Recorded\Instrument Number\"
- Target: "E:\data\rsync\ORImgLib\Public\Recorded\Instrument Number\"
- Include Subfolders: Yes
- Create sources/targets that do not exist
- Include subfolders: "\[100000000-100040000]*"
TGRMN Software -  10-May-17
Which subfolders do you mean to include with:
Include subfolders: "\[100000000-100040000]*"
Add Comment
Attachments
No attachments

Did this help you?
Yes No

Statistics
68% found this information useful

Other Options
Printable Version

General Information
No. 104
Author: TGRMN Software

Download ViceVersa
Visit ViceVersa Forum
A printable version of the entire ViceVersa FAQ and Knowledge Base is also available.
For further queries, please contact us by E-Mail at support@tgrmn.com.