VVEngine 'File Level' monitoring and filters

[nfrombach]

Hello, I'm using a profile with backup (mirror) method and I scheduled it with VVEngine. This profile has a file and folder filters and the schedule is programmed with file monitoring on source with "file level".
Now the problem: This monitoring is detecting changes on files that are excluded on file filter and it ran the profile without file copied because that files are excluded. The same is with folder changes when I set monitoring level "folder Level".
How can I exclude the monitoring of file/folders filtered on profile?

[TGRMN Software]

Yes, you are right, that is a known limitation of the real-time monitoring in VVEngine Server Premium. Currently filters are not checked when monitoring at "file level" and all changes are reported.

The side effect is that VVEngine reports the changes in excluded files, but since they are excluded when ViceVersa runs, the profile runs but no files are copied / deleted.

This is something that we plan to implement in one of the next VVEngine releases.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

[paul_vickery]

Any idea when the new version will be released to address this?

[TGRMN Software]

Sorry, no release date yet...
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

[badon]

Has this been fixed?

[TGRMN Software]

No sorry, do you have a test case where you'd like to use this? thanks
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

[badon]

Test case, no. Use case, yes. I'm running several different profiles to backup the same source to different targets, only when a file changes. There are millions of files, and logging is enabled on each. Even when only a few files changes, the logs grow very quickly to gigabytes due to unnecessary profile runs. Here are some examples of what's in the logs:

2014-06-22 19:10:58 : **** Exclude subfolders: "**\FirefoxPortable*\Data\profile\Cache\**"

2014-06-22 19:10:58 : [VVEngine detected changes: detailed list follows (files)]

2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\A\2B\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\23\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\CF\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\2\89\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\2\89\0DF44d01
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\2\FF\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\0\B2\D0EB7d01
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\0\B2\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\6\A4\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\6\A4\CAF60d01
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\02\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\02\2B3EEd01

2014-06-22 19:10:58 : [VVEngine detected changes: detailed list follows (subfolders)]

2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\A\2B\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\23\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\CF\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\2\89\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\2\FF\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\0\B2\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\6\A4\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\02\^

There are NOT lines that look like these:

2014-06-22 19:10:58 : **** Exclude files: "**\FirefoxPortable*\Data\profile\Cache\**"
2014-06-22 19:10:58 : **** Archive exclude: "**\FirefoxPortable*\Data\profile\Cache\**"

[badon]

I'm not certain, but I think execution time is affected by this problem. If I only change one small text file that I want backed up as often as possible, it is taking something like 20 minutes for VV to do it. When I had fewer files on a much slower computer, my VV profile could run about 10 times per minute. That ensured that my backups were always current.

[TGRMN Software]

Yes, I meant "use case"! The filtering should not impact execution time, only the fact that VV runs without copying anything (because files are excluded).... the logs (VVengine + Viceversa profile log) could contain more info. thanks
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

[badon]

Can you explain why it says "Include" for files and directories that have been excluded? Is it a bug?

[TGRMN Software]

This list is the list of changes VVEngine detected:

2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\A\2B\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\23\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\CF\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\2\89\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\2\89\0DF44d01
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\2\FF\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\0\B2\D0EB7d01
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\0\B2\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\6\A4\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\6\A4\CAF60d01
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\02\*
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\02\2B3EEd01

2014-06-22 19:10:58 : [VVEngine detected changes: detailed list follows (subfolders)]

2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\A\2B\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\23\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\CF\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\2\89\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\2\FF\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\0\B2\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\6\A4\^
2014-06-22 19:10:58 : Include: \\?\C:\path\to\FirefoxPortable\Data\profile\Cache\5\02\^

etc.

This is the ViceVersa profile settings:

2014-06-22 19:10:58 : **** Exclude subfolders: "**\FirefoxPortable*\Data\profile\Cache\**"

So VVEngine is "telling" ViceVersa that changes were detected in those files / subfolders, but no files will be copied as they are excluded in the profile.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

[badon]

OK, there are countless thousands of those changes that are supposed to be ignored. To backup 1 text file the VVEngine log runs for many pages, and I just deleted a few hundred gigabytes of logs again. Any plans to fix this in the near future?

[TGRMN Software]

Hi, this is one of the improvements that are on top of our list for VVEngine.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com

[travinh]

Any update on this VVEngine limitation?

This limitation cause my VVEngine to run so often when my end-users update files in the heavy traffic excluding folders.

Thanks,
Cal