[Spread-users] Memory leak? FD leak? Other?

Jonathan Stanton jonathan at cnds.jhu.edu
Fri Aug 20 18:16:59 EDT 2004


Yes. John is right. But the fd thing is a bug which is why I wanted to 
distinguish between the two cases. 

Because Spread internally caches a lot of memory, and that even when we 
call free, the OS reported memory usage will often not go down it is hard 
to see when Spread really has a leak and when it doesn't. Spread is 
designed to be somewhat memory aggressive (in order to increase speed in 
the common case of a stable workload of messages) but David is trying to 
trigger cases that he thinks should release the memory (and I agree at 
some point the memory does have to be returned and shouldn't crash/swap 
out the system). 

I'll try out David's stress program and see what kind of memory load we 
are getting.

Cheers,

Jonathan

On Fri, Aug 20, 2004 at 01:03:09PM -0400, John Schultz wrote:
> David Shaw wrote:
> 
> >I believe I have triggered both.  No memory is released by the daemon,
> >and some fds are left behind when using the sabuse program I sent.
> >
> >Currently, the sabuse program connects to spread and justs calls
> >SP_multicast over and over again.  If you modify the program to
> >SP_connect, send 500 messages, then SP_disconnect and then repeat the
> >whole connect-send-disconnect cycle over and over, you get different
> >behavior when killing sabuse: there are no fds left open in spread,
> >but the memory is still not returned.
> >
> >David
> >
> 
> Jonathan, doesn't Spread's memory subsystem keep memory it has allocated 
> around?  Furthermore, even if it releases that memory don't most 
> processes never release allocated memory pages back to the operating 
> system until they finish?  So if any process has a large spike in memory 
> usage, then their memory footprint as far as the OS is concerned never 
> shrinks?
> 
> -- 
> John Lane Schultz
> Spread Concepts LLC
> Phn: 443 838 2200
> 
> 
> 
> _______________________________________________
> Spread-users mailing list
> Spread-users at lists.spread.org
> http://lists.spread.org/mailman/listinfo/spread-users

-- 
-------------------------------------------------------
Jonathan R. Stanton         jonathan at cs.jhu.edu
Dept. of Computer Science   
Johns Hopkins University    
-------------------------------------------------------




More information about the Spread-users mailing list