Opened 6 years ago

Last modified 6 years ago

#9404 new Feature request

download speed limited by directory traversal speed

Reported by: Marcel Owned by:
Priority: high Component: FileZilla Client
Keywords: speed suggestion Cc:
Component version: Operating system type:
Operating system version:

Description

When backing up my websites (Joomla), I notice that I have a lot more speed available to download but it takes the content of directories to slowly.
Meaning if you have many directories with only 2 to 3 files but have 7 simulta. transfers going way to long to create the Queue for files to download.
I am using V3.8 on Godaddy hosting. The queue is most of the time empty.
It should fill the queue for downloading much faster.

Change History (3)

comment:1 Changed 6 years ago by Alexander Schuch

Summary: Speed of directory parsingdownload speed limited by directory traversal speed

This might be a limitation of the FTP protocol. The solution would be to traverse the directory tree with multiple "workers". Not sure if this is possible with only one command connection.

comment:2 Changed 6 years ago by Alexander Schuch

Operating system type: Linux

comment:3 Changed 6 years ago by Marcel

This sounds about right.
When the directories only have a few small files in them then the speed of multiple simultaneous transfers is not fully used.
I like the idea of multiple "workers". This will do an overall speed improvement of factor 10 or more.
Here some stats: It took 4hrs for 765MB(60k files) on a 30Mbps line.

Note: See TracTickets for help on using tickets.