Re: Slow File Transfer (was Re: Helpppp!

Andreas Koenig (k@anna.in-berlin.de)
Sun, 10 Nov 1996 20:39:04 +0100


>>>>> m.koster@webcrawler.com (Martijn Koster) writes:

 martijn> Interesting. That is ftp:// though, not http://. Does http:// do that too?

Yes.

 martijn> Otherwise it might just be a FTP thing Graham might have some suggestions
 martijn> about.

Net::FTP behaves fine. It doesn't grow over 870:589 (virtual:real)
during the file transfer. This is the size from startup to finished
transfer.

 >> Here is the size from ps -elf output in 5 seconds interval:

 martijn> Hmmm. We can probably assume it's malloc, though it would instructive
 martijn> to see what memvis/g_memusage and dpa say.

I do not know anything about these tools. Locate doesn't find any on
my system.

 >> I have no other machine with both libwww-5.04 and perl5.005_07
 >> unfortunately.

 martijn> I have not paid any attention to beta releases recently, but I'll put
 martijn> it on my Indy and see if I can duplicate it.

Thanks. In the meantime I tried some variants and I get the
impression: no difference between http and ftp and no problems at all
on fast links. On an inhouse link I get the big file within a few
seconds with both http and ftp. On the slow link (~ 64k/s) the
process grows over 20 MB and then I kill it when I see the system
starts to behave strange. The link to funet.fi is yet slower and I
covered the problems in my first posting today (10 MB max).

That makes the argument of Paul J. Schinder moot, that it is due to
filling a scalar. If it were only the scalar, we should have identical
behaviour on slow and fast links.

Let me know if I can run any tests for you. I'd be interested in
hearing if other systems have the same behaviour as mine.

 martijn> -- Martijn


Best,
andreas