[cvsnt] Re: Performance problem with large files

Tony Hoyle tmh at nodomain.org
Thu Oct 21 14:37:18 BST 2004


michel.leclerc at b-rail.be wrote:
> Hello,
> 
> I need to store large files (more than 200 MB) into the repository.
> Checkout for theses files takes a very very long time (approx 1 hour for 270
> MB).
> Is there a solution to this performance problem
> 
You're probably running out of memory on the server.  That'll slow it 
down.    You also need a beefy CPU to process a file that big.

Make sure your ethernet is running at at least 100MB (preferably gigabit 
if you're shifting files that big regularly) as any network delay on a 
file that big will be significant.

You should be able to get it down to about 20-30 minutes, but really 
version control systems aren't designed for things that big - they have 
to process the file to store it, and any processing rapidly builds up - 
a checkout of the HEAD revision is pretty efficient and is going be 
within usability.  A checkout of a non-HEAD revision is going to take 
much longer.

Tony




More information about the cvsnt mailing list