Forum Index  ViceVersa HOME         FAQ and Knowledge Base

 FAQForum FAQ   SearchSearch Forum  RegisterRegister 
 ProfileProfile   Log inLog in 

Can it keep with 1280 files per hour?

 
Post new topic   Reply to topic     Forum Index -> Support
Author Message
InDashMP3



Joined: 22 Aug 2007
Posts: 8

PostPosted: Wed Aug 22, 2007 11:47 pm    Post subject: Can it keep with 1280 files per hour? Reply with quote

Hi. First of all, so far I am very impressed although I have yet to deploy the trial in my production environment. I am testing it at home, and I THINK it is going to work for me, but I have a couple questions.

I have a video recording system that continuously creates small avi files......non stop. I creates about 64 files every 3 minutes. The files range in size from 100KB to 20MB. The problem is, we have a limited amount of static storage, enough to keep about 3 months worth of avi files, but then the system overwrites the oldest file, and it is gone forever.....

The program creates a new folder everyday in a date format: 082207, 082307, etc... Each folder has the AVI files.

My plan is to use the real time sync - augment mode, to simply copy the files as they are created to a 1TB USB 2 drive. Assuming file size is the avrg we are expecting, the TB drive will be filled up every month. The 1TB drive will be removed and replaced with a new one. So here's a question...

I am using the Engine, and assume I would simply stop the running profile when the drive gets full, put in the new drive and rerun the profile. Would it then go back and copy all the old files again??? I would only want it to copy the files that were newly created but did not have a chance to be replicated to the target before the target was full. Is there a way to alert a connected workstation that the target is FULL and needs to be changed? I am trying to make it as simple for the end user as unplugging the drive when a TARGET FULL msg appears, have them put in the new drive, and have the system automatically pick up where it left off. This would be absolutely amazing if this could work!!! Thanks again for reading thru this message, and I look forward to any feedback you can provide.. Very Happy
_________________
joe
Back to top
TGRMN Software
Site Admin


Joined: 10 Jan 2005
Posts: 8759

PostPosted: Thu Aug 23, 2007 1:59 am    Post subject: Reply with quote

This would work, but when you replace the full drive with a new one, VV will copy all files again from source to target. VV compares source and target folders and then copies everything that is not in source to target....
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com
Back to top
InDashMP3



Joined: 22 Aug 2007
Posts: 8

PostPosted: Thu Aug 23, 2007 2:08 am    Post subject: Reply with quote

Well, I would be using the exclude all files that more than one day old. It would have to back that up, so I may duplicate about 50 GB of files on every removeable USB. Would love if the Exclude Files Older than xxx could be XXX days, hours, weeks, etc..... instead of just days.. That would help me out...and hey, maybe others!!

So, how would I handle the full USB drive. If i am not constantly monitoring the web page for VVEngine, how do I know when it will be time to change the drive?? Also, I am not monitoring the target, so would it still have to do a full comparison when the new drive is plugged in???
_________________
joe
Back to top
TGRMN Software
Site Admin


Joined: 10 Jan 2005
Posts: 8759

PostPosted: Thu Aug 23, 2007 4:21 am    Post subject: Reply with quote

Quote:
Well, I would be using the exclude all files that more than one day old. It would have to back that up, so I may duplicate about 50 GB of files on every removeable USB. Would love if the Exclude Files Older than xxx could be XXX days, hours, weeks, etc..... instead of just days.. That would help me out...and hey, maybe others!!


that's a good idea! Smile Did not think about that possibility.

Quote:
So, how would I handle the full USB drive. If i am not constantly monitoring the web page for VVEngine, how do I know when it will be time to change the drive?? Also, I am not monitoring the target, so would it still have to do a full comparison when the new drive is plugged in???


When the drive is full you would start seeing errors in VVEngine, the profile would terminate with "error copying files". That would be an indication that the drive is full.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com
Back to top
InDashMP3



Joined: 22 Aug 2007
Posts: 8

PostPosted: Thu Aug 23, 2007 8:23 am    Post subject: Reply with quote

....and these errors can trigger what kind of alert for someone that doesn't look at the logs? Could it execute the e-mail script? Net Send Msg?? etc...?

And what would the behavior be when a new drive is installed? I have the VVEngine set to start the profile as soon as the drives become ready, but where will it pick up?
_________________
joe
Back to top
TGRMN Software
Site Admin


Joined: 10 Jan 2005
Posts: 8759

PostPosted: Thu Aug 23, 2007 3:20 pm    Post subject: Reply with quote

Quote:
....and these errors can trigger what kind of alert for someone that doesn't look at the logs? Could it execute the e-mail script? Net Send Msg?? etc...?


Yes, you can send an e-mail in case of error with a script, see
http://www.tgrmn.com/web/kb/item67.htm
you can also create a batch to run after exectuion for a net send command.

Quote:
And what would the behavior be when a new drive is installed? I have the VVEngine set to start the profile as soon as the drives become ready, but where will it pick up?


VVEngine would run the profile as soon as the new drive is inserted (under the same letter) and copy all files as per profile settings.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com
Back to top
Guest






PostPosted: Sat Aug 25, 2007 1:49 am    Post subject: Reply with quote

Hmm.. Not sure it's actually "keeping up" so to speak.. It seems as though as soon as a change in the source is detected, it runs the whole profile and not just copy the new files to the target. I don't need to ever really check the target. So what is happening is that it detects a change, does the whole profile, repeat. Each time it takes about 15 minutes. I was thinking it would simply keep copying the new files, but it looks like it has do it all over again. The problem is, during the time it does the compare, and copies the files from that compare, it has to add about 200-250 files..

I am attaching a log file in an e-mail to TGRMN support.

Thanks again for all your help!
Back to top
InDashMP3



Joined: 22 Aug 2007
Posts: 8

PostPosted: Sat Aug 25, 2007 1:53 am    Post subject: Reply with quote

OOPS! Sorry, the guest post above was mine... I thought I was logged in!
_________________
joe
Back to top
TGRMN Software
Site Admin


Joined: 10 Jan 2005
Posts: 8759

PostPosted: Tue Aug 28, 2007 9:25 am    Post subject: Reply with quote

Yes, in the current version VV scans the target folder to check which files need copying. In the next version VV will be enhanced not to do that, which will make the file synchronization / replication faster...
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com
Back to top
InDashMP3



Joined: 22 Aug 2007
Posts: 8

PostPosted: Tue Aug 28, 2007 10:50 am    Post subject: Reply with quote

TGRMN Software wrote:
Yes, in the current version VV scans the target folder to check which files need copying. In the next version VV will be enhanced not to do that, which will make the file synchronization / replication faster...


Any timeframe on the next release? So basically, when replicating, the next release will not do ANY compare? That's good... If I need to do a compare, I would create another job and have it run at a very reduced frequency.

Did you happen to look at the log I sent? Do you see any other issues?
_________________
joe
Back to top
TGRMN Software
Site Admin


Joined: 10 Jan 2005
Posts: 8759

PostPosted: Tue Aug 28, 2007 11:17 am    Post subject: Reply with quote

Quote:
Any timeframe on the next release?


We do not have a fixed date for it yet ...

Quote:
So basically, when replicating, the next release will not do ANY compare? That's good... If I need to do a compare, I would create another job and have it run at a very reduced frequency.


No comparing at all Smile

Quote:
Did you happen to look at the log I sent? Do you see any other issues?


Yes, if you could be more precise on where the AVI files are stored in the source, the scanning would be much quicker.
_________________
--
TGRMN Software Support
http://www.tgrmn.com
http://www.compareandmerge.com
Back to top
InDashMP3



Joined: 22 Aug 2007
Posts: 8

PostPosted: Tue Aug 28, 2007 1:27 pm    Post subject: Reply with quote

I believe that the source as specified is as specific as I can get. New folders are created every day, so I must keep the source scan one layer above that so that the profile cathes the new folders...
_________________
joe
Back to top
Display posts from previous:   
Post new topic   Reply to topic     Forum Index -> Support All times are GMT
Page 1 of 1

 
Jump to:  
You can post new topics in this forum
You can reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © phpBB Group
Copyright © TGRMN Software. TGRMN Software products: