[Spread-users] Spread scaling

[Richard Maxwell]

Christopher,

Basically at around 1000 (1k) messages being written to the message queue and those messages being read from the queue I get an exception that forces the connection closed.  I read on the web someplace that spread is compiled with a limit of 1000 messages.  I have not been able to find the post I saw with that information.

One of the questions I have is spread configured out-of-the-box to handle large amounts of messages (50k) per hour?  
are there some common tweaks that I can make to make the out-of-the-box spread install more production worthy?

Richard

On Mar 8, 2010, at 10:24 AM, Christopher Browne wrote:

> Richard Maxwell wrote:
>> 
>> Hello,
>> 
>> 
>> I have written an application that uses Spread to process transactions generated from a call from a MySQL stored procedure in another application.  The stored procedure places the message on a queue via the message_api-1.0beta5 libmessage.so shared library.
>> 
>> 
>> The application works fine with one exception.  Right around 1000 messages being sent by spread the receiving application (scala) receives an exception message that spread disconnected.  This causes no more messages to be received.
>> 
>> 
>> I have read on the internet other people have written applications that receive hundreds of thousands of messages without any problems.  I haven’t done any configuration changes to spread.  I just use the defaults that come with it.
>> 
>> 
>> I am hoping there are some simple changes that can be done to eliminate this problem.
>> 
>> 
>> Any help is appreciated.
>> 
>> 
>> Richard
>> 
> 
> The message was... "Connection closed while reading data"???
> 
> If so, then I asked much the same question on the list back in 2008, and got the following response:
> http://marc.info/?l=spread-users&m=120234452625467&w=2
> 
> Basically, you need to have something listening on the queue, otherwise the queue will fill up, and the spread server will start refusing new messages because it can't buffer any more.