Opened 9 years ago
Last modified 9 years ago
#9404 new Feature request
download speed limited by directory traversal speed
|Reported by:||Marcel||Owned by:|
|Component version:||Operating system type:|
|Operating system version:|
When backing up my websites (Joomla), I notice that I have a lot more speed available to download but it takes the content of directories to slowly.
Meaning if you have many directories with only 2 to 3 files but have 7 simulta. transfers going way to long to create the Queue for files to download.
I am using V3.8 on Godaddy hosting. The queue is most of the time empty.
It should fill the queue for downloading much faster.
Change History (3)
comment:1 by , 9 years ago
|Summary:||Speed of directory parsing → download speed limited by directory traversal speed|
comment:2 by , 9 years ago
|Operating system type:||Linux|
comment:3 by , 9 years ago
This sounds about right.
When the directories only have a few small files in them then the speed of multiple simultaneous transfers is not fully used.
I like the idea of multiple "workers". This will do an overall speed improvement of factor 10 or more.
Here some stats: It took 4hrs for 765MB(60k files) on a 30Mbps line.
This might be a limitation of the FTP protocol. The solution would be to traverse the directory tree with multiple "workers". Not sure if this is possible with only one command connection.