Author |
Message |
InDashMP3
Joined: 22 Aug 2007 Posts: 8
|
Posted: Wed Aug 22, 2007 11:47 pm Post subject: Can it keep with 1280 files per hour? |
|
|
Hi. First of all, so far I am very impressed although I have yet to deploy the trial in my production environment. I am testing it at home, and I THINK it is going to work for me, but I have a couple questions.
I have a video recording system that continuously creates small avi files......non stop. I creates about 64 files every 3 minutes. The files range in size from 100KB to 20MB. The problem is, we have a limited amount of static storage, enough to keep about 3 months worth of avi files, but then the system overwrites the oldest file, and it is gone forever.....
The program creates a new folder everyday in a date format: 082207, 082307, etc... Each folder has the AVI files.
My plan is to use the real time sync - augment mode, to simply copy the files as they are created to a 1TB USB 2 drive. Assuming file size is the avrg we are expecting, the TB drive will be filled up every month. The 1TB drive will be removed and replaced with a new one. So here's a question...
I am using the Engine, and assume I would simply stop the running profile when the drive gets full, put in the new drive and rerun the profile. Would it then go back and copy all the old files again??? I would only want it to copy the files that were newly created but did not have a chance to be replicated to the target before the target was full. Is there a way to alert a connected workstation that the target is FULL and needs to be changed? I am trying to make it as simple for the end user as unplugging the drive when a TARGET FULL msg appears, have them put in the new drive, and have the system automatically pick up where it left off. This would be absolutely amazing if this could work!!! Thanks again for reading thru this message, and I look forward to any feedback you can provide.. _________________ joe |
|
Back to top |
|
|
TGRMN Software Site Admin
Joined: 10 Jan 2005 Posts: 8763
|
Posted: Thu Aug 23, 2007 1:59 am Post subject: |
|
|
This would work, but when you replace the full drive with a new one, VV will copy all files again from source to target. VV compares source and target folders and then copies everything that is not in source to target.... _________________ --
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
Back to top |
|
|
InDashMP3
Joined: 22 Aug 2007 Posts: 8
|
Posted: Thu Aug 23, 2007 2:08 am Post subject: |
|
|
Well, I would be using the exclude all files that more than one day old. It would have to back that up, so I may duplicate about 50 GB of files on every removeable USB. Would love if the Exclude Files Older than xxx could be XXX days, hours, weeks, etc..... instead of just days.. That would help me out...and hey, maybe others!!
So, how would I handle the full USB drive. If i am not constantly monitoring the web page for VVEngine, how do I know when it will be time to change the drive?? Also, I am not monitoring the target, so would it still have to do a full comparison when the new drive is plugged in??? _________________ joe |
|
Back to top |
|
|
TGRMN Software Site Admin
Joined: 10 Jan 2005 Posts: 8763
|
Posted: Thu Aug 23, 2007 4:21 am Post subject: |
|
|
Quote: | Well, I would be using the exclude all files that more than one day old. It would have to back that up, so I may duplicate about 50 GB of files on every removeable USB. Would love if the Exclude Files Older than xxx could be XXX days, hours, weeks, etc..... instead of just days.. That would help me out...and hey, maybe others!! |
that's a good idea! Did not think about that possibility.
Quote: | So, how would I handle the full USB drive. If i am not constantly monitoring the web page for VVEngine, how do I know when it will be time to change the drive?? Also, I am not monitoring the target, so would it still have to do a full comparison when the new drive is plugged in??? |
When the drive is full you would start seeing errors in VVEngine, the profile would terminate with "error copying files". That would be an indication that the drive is full. _________________ --
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
Back to top |
|
|
InDashMP3
Joined: 22 Aug 2007 Posts: 8
|
Posted: Thu Aug 23, 2007 8:23 am Post subject: |
|
|
....and these errors can trigger what kind of alert for someone that doesn't look at the logs? Could it execute the e-mail script? Net Send Msg?? etc...?
And what would the behavior be when a new drive is installed? I have the VVEngine set to start the profile as soon as the drives become ready, but where will it pick up? _________________ joe |
|
Back to top |
|
|
TGRMN Software Site Admin
Joined: 10 Jan 2005 Posts: 8763
|
Posted: Thu Aug 23, 2007 3:20 pm Post subject: |
|
|
Quote: | ....and these errors can trigger what kind of alert for someone that doesn't look at the logs? Could it execute the e-mail script? Net Send Msg?? etc...? |
Yes, you can send an e-mail in case of error with a script, see
http://www.tgrmn.com/web/kb/item67.htm
you can also create a batch to run after exectuion for a net send command.
Quote: | And what would the behavior be when a new drive is installed? I have the VVEngine set to start the profile as soon as the drives become ready, but where will it pick up? |
VVEngine would run the profile as soon as the new drive is inserted (under the same letter) and copy all files as per profile settings. _________________ --
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
Back to top |
|
|
Guest
|
Posted: Sat Aug 25, 2007 1:49 am Post subject: |
|
|
Hmm.. Not sure it's actually "keeping up" so to speak.. It seems as though as soon as a change in the source is detected, it runs the whole profile and not just copy the new files to the target. I don't need to ever really check the target. So what is happening is that it detects a change, does the whole profile, repeat. Each time it takes about 15 minutes. I was thinking it would simply keep copying the new files, but it looks like it has do it all over again. The problem is, during the time it does the compare, and copies the files from that compare, it has to add about 200-250 files..
I am attaching a log file in an e-mail to TGRMN support.
Thanks again for all your help! |
|
Back to top |
|
|
InDashMP3
Joined: 22 Aug 2007 Posts: 8
|
Posted: Sat Aug 25, 2007 1:53 am Post subject: |
|
|
OOPS! Sorry, the guest post above was mine... I thought I was logged in! _________________ joe |
|
Back to top |
|
|
TGRMN Software Site Admin
Joined: 10 Jan 2005 Posts: 8763
|
Posted: Tue Aug 28, 2007 9:25 am Post subject: |
|
|
Yes, in the current version VV scans the target folder to check which files need copying. In the next version VV will be enhanced not to do that, which will make the file synchronization / replication faster... _________________ --
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
Back to top |
|
|
InDashMP3
Joined: 22 Aug 2007 Posts: 8
|
Posted: Tue Aug 28, 2007 10:50 am Post subject: |
|
|
TGRMN Software wrote: | Yes, in the current version VV scans the target folder to check which files need copying. In the next version VV will be enhanced not to do that, which will make the file synchronization / replication faster... |
Any timeframe on the next release? So basically, when replicating, the next release will not do ANY compare? That's good... If I need to do a compare, I would create another job and have it run at a very reduced frequency.
Did you happen to look at the log I sent? Do you see any other issues? _________________ joe |
|
Back to top |
|
|
TGRMN Software Site Admin
Joined: 10 Jan 2005 Posts: 8763
|
Posted: Tue Aug 28, 2007 11:17 am Post subject: |
|
|
Quote: | Any timeframe on the next release? |
We do not have a fixed date for it yet ...
Quote: | So basically, when replicating, the next release will not do ANY compare? That's good... If I need to do a compare, I would create another job and have it run at a very reduced frequency. |
No comparing at all
Quote: | Did you happen to look at the log I sent? Do you see any other issues? |
Yes, if you could be more precise on where the AVI files are stored in the source, the scanning would be much quicker. _________________ --
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com |
|
Back to top |
|
|
InDashMP3
Joined: 22 Aug 2007 Posts: 8
|
Posted: Tue Aug 28, 2007 1:27 pm Post subject: |
|
|
I believe that the source as specified is as specific as I can get. New folders are created every day, so I must keep the source scan one layer above that so that the profile cathes the new folders... _________________ joe |
|
Back to top |
|
|
|