FileZilla crashes while downloading huge

[Alexander Schuch]

I'm using FileZilla 1.9.3 on Win98SE with WinSock 2 installed.
While downloading a huge directory (>10000 files) it starts
downloading quiete normal but crashes all of a sudden... no other
program is running besides FileZilla and I'm doing nothing exept
for watching the screen. I tried it several times... but there is no
scheme for the crashes (it downloads sometimes more, sometimes
less files before crashing).

[Tim Kosse]

please try the latest version and send the exception report
when FileZilla crashes.

[Alexander Schuch]

I am still downloading all the files and FileZilla still
not crashed. :-) This new version (1.9.6) seems to work
fine now but there is still something to make better:
After downloading each file, it refreshes the local file
window which *really* slows down the whole download
process as it takes more than 3 seconds to refresh the
list. So I better don't think of how many hours are wasted
after downloading 12,000 files...

[Alexander Schuch]

I am still "unable" to download that directory. There are
still more than 12,000 files which are 1 mb all together
but it takes ages to download them. Refreshing the local
file list takes more than 10 seconds after a while (still
becoming more with every few downloaded files). There must
be a way to improve performance...

[Tim Kosse]

For FileZilla 1.9.8 I will review the code of the local
file list to find slow code and I'll make the refreshing
asynchronous. When I make any progress, I'll publish beta
versions here.

[Tim Kosse]

I've finished a first test version which should improve
performance of the local dir listing:
​http://filezilla.sf.net/FileZilla_1_9_8_beta_1.zip

Please tell me if it works better for you.

[Alexander Schuch]

Yes, performance is improved somehow but I've downloaded
1,400 files right now and it takes almost 10 secs again to
refresh the local list. It sped up at the beginning a lot but now
it seems to be as slow as before.

I would suggest to add a switch in settings whether or not to
update local file list. When uploading files to a server,
FileZilla simply adds the name of the uploaded file and sets
filesize, date and permission to '?' and updates the whole
directory after upload is complete. Why not doing the same
with local directories?

[Tim Kosse]

Here's another version which should improve speed further:
​http://filezilla.sf.net/FileZilla_1_9_8_beta_2.zip

[Alexander Schuch]

This version works fine. Unfortunately my test directory got
backed up and now there're just 3k files in it... The delay was
about 3 seconds between 'download done' and 'starting
download' message for the last files.

[Tim Kosse]

3 secs for 3k files? Not very fast. I only need 1 sec for over
10000 files on my machine, how fast is your PC? Mine is
1.4GHz (Athlon TB)

[Alexander Schuch]

It's a Pentium 2/233 MHz running Windows 98 SE.

[Tim Kosse]

Here's another version:
​http://filezilla.sf.net/FileZilla_1_9_8_beta_6.zip
FileZilla no longer refreshed the complete list after file
transfers, now it only adds / refreshes the downloaded file

[Tim Kosse]

Again a new version:
I've tested it in a folder with about 30000 files, after a
download the new file appeared almost immediately in the
local file list (less than 1/10th of a second)
​http://filezilla.sf.net/FileZilla_1_9_8_beta_7.zip

[Tim Kosse]

version 1.9.8 has been released. If that's still not fast
enought, maybe it's time to buy a new cpu or at least time for
some overclocking ;-)

[Alexander Schuch]

I'm not able to test it anymore as I've changed the way I
connect to the Internet from using modem to Satelite Internet
which has a minimum response time (ping) of 1-2 secs (due
to the nature of Satelite Internet).