[Spread-users] Is this a reasonable way to use spread?

[Jonathan Stanton]

To add a bit to what Theo said. Spread should support both of these
requirements quite well. It was actually designed for exactly this purpose
(to support a large number of clients with fewer servers, and to support a
large number of groups). 

The current version (3.17.0) has been tested with at least 6000 groups
active (on a few daemons) with upto 950 client connections per daemon. A
large number of groups and clients will increase a bit the memory used by
the Spread daemon, and will burn some additional cpu, but otherwise should
not cause a problem. Previous versions might encounter some problems in
membership if you are using more then about 1200 groups, so I recommend
you use the current version if you need lots of groups.

If you do experience any issues we would be happy to hear about them, and
once it is working we'd definitely be interested in hearing about your
experiences and thoughts.

Jonathan

On Mon, Oct 07, 2002 at 11:02:46AM -0400, Theo Schlossnagle wrote:
> James Rauser wrote:
> 
> >I see two potential problems: 1) the number of groups can expand to
> >upwards of 1,000, and 2) the clients will be connecting to the spread
> >network from nodes outside of the network which are not running their
> >own daemons.  In the extreme, this might result in a single daemon
> >having to handle connections to several hundred clients as well
> >as the jobs on its cluster node.  I can't tell from the papers and
> >documentation available whether this is feasible and within spread's
> >capabilities or not.
> >  
> >
> While running Spread on several hundred machines may be a challenge, 
> running several handfuls of Spread daemons with hundreds of clients and 
> thousands of groups is not.  If you _really_ need to run several hundred 
> daemons, I am sure the CNDS folks will be more that interested in 
> learning more about your specific problems.
> 
> -- 
> Theo Schlossnagle
> Principal Consultant
> OmniTI Computer Consulting, Inc. -- http://www.omniti.com/
> Phone:  +1 410 872 4910 x201     Fax:  +1 410 872 4911
> 1024D/82844984/95FD 30F1 489E 4613 F22E  491A 7E88 364C 8284 4984
> 2047R/33131B65/71 F7 95 64 49 76 5D BA  3D 90 B9 9F BE 27 24 E7
> 
> -----------------------------------------------------------
>  --              Presenting at ApacheCon                --
>  --                November 18th, 2002                  --
>  --                 Las Vegas, Nevada                   --
>  -- Backhand: understanding and building HA/LB clusters --
>  --           http://apachecon.com/2002/US/             --
>  --                                                     --
>  -- Learn all there is to know about high availability  --
>  -- internet systems and load balancing techniques      --
>  -- focusing on applications driven by the Apache web   --
>  -- server!                                             --
> -----------------------------------------------------------
> 
> 
> 
> 
> _______________________________________________
> Spread-users mailing list
> Spread-users at lists.spread.org
> http://lists.spread.org/mailman/listinfo/spread-users

-- 
-------------------------------------------------------
Jonathan R. Stanton         jonathan at cs.jhu.edu
Dept. of Computer Science   
Johns Hopkins University    
-------------------------------------------------------