Are all systems running the same setup? Ie. same version of glibc and linux kernel? Have you compared these versions to the systems that dont crash? Was spread built from source or was it provided by your distro? <br><br><div class="gmail_quote">
On Fri, May 9, 2008 at 9:01 AM, Matt Garman <<a href="mailto:matthew.garman@gmail.com">matthew.garman@gmail.com</a>> wrote:<br><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
<br>
Just some more info on the problem below.<br>
<br>
I'm seeing this problem with spread <a href="http://4.0.0." target="_blank">4.0.0.</a> The link below, and<br>
another one I found:<br>
<a href="http://marc.info/?l=spread-users&m=107427748906439&w=2" target="_blank">http://marc.info/?l=spread-users&m=107427748906439&w=2</a><br>
both talk about this problem with spread version 3.x.<br>
<br>
I also can't reproduce this with the spflooder -b 100000 method<br>
described in the post above.<br>
<br>
This is on CentOS 4.3, Linux kernel version 2.6.9-34.ELsmp on<br>
x86_64.<br>
<br>
This crash is pretty rare; it's happened three times on one box,<br>
once on another, and never on any of our other ~20 machines. The<br>
three crashes on the one box have been fairly recent though: 5-Mar,<br>
1-May and 8-May. We're worried that it's going to continue to<br>
increase in frequency.<br>
<br>
Thanks again,<br>
<font color="#888888">Matt<br>
</font><div><div></div><div class="Wj3C7c"><br>
On Fri, May 09, 2008 at 07:44:01AM -0500, Matt Garman wrote:<br>
> We've experienced some random spread crashes recently.<br>
><br>
> In the log, we have the following message:<br>
><br>
> [Thu 01 May 2008 23:01:52] Send_new_packets: created packet 16 already exist 2<br>
> Exit caused by Alarm(EXIT)<br>
><br>
> I found another post on this in the archives, but it doesn't help<br>
> much: <a href="http://marc.info/?t=111651309700001&r=1&w=2" target="_blank">http://marc.info/?t=111651309700001&r=1&w=2</a><br>
><br>
> We have modified some of the #defines for spread, but not<br>
> recently---we've been running with the same parameter set for well<br>
> over a year. But only recently are we seeing this issue.<br>
><br>
> I don't know if it's related, but I'm also seeing the following in<br>
> the logs:<br>
><br>
> [Thu 01 May 2008 23:01:52] Prot_handle_token: BUG WORKAROUND: Too many rounds in EVS state; swallowing token; state:<br>
> [Thu 01 May 2008 23:01:52] Aru: 31<br>
> [Thu 01 May 2008 23:01:52] My_aru: 31<br>
> [Thu 01 May 2008 23:01:52] Highest_seq: 15<br>
> [Thu 01 May 2008 23:01:52] Highest_fifo_seq: 2<br>
> [Thu 01 May 2008 23:01:52] Last_discarded: 0<br>
> [Thu 01 May 2008 23:01:52] Last_delivered: 31<br>
> [Thu 01 May 2008 23:01:52] Last_seq: 3348<br>
> [Thu 01 May 2008 23:01:52] Token_rounds: 501<br>
> [Thu 01 May 2008 23:01:52] Last Token:<br>
> [Thu 01 May 2008 23:01:52] type: 0x80040080<br>
> [Thu 01 May 2008 23:01:52] transmiter_id: -1062683843<br>
> [Thu 01 May 2008 23:01:52] seq: 0<br>
> [Thu 01 May 2008 23:01:52] proc_id: -1062683843<br>
> [Thu 01 May 2008 23:01:52] aru: 31<br>
> [Thu 01 May 2008 23:01:52] aru_last_id: -1062683843<br>
> [Thu 01 May 2008 23:01:52] flow_control: 0<br>
> [Thu 01 May 2008 23:01:52] rtr_len: 0<br>
> [Thu 01 May 2008 23:01:52] conf_hash: 1602235222<br>
><br>
> And here is a more recent example:<br>
><br>
> [Thu 08 May 2008 16:22:01] Prot_handle_token: BUG WORKAROUND: Too many rounds in EVS state; swallowing token; state:<br>
> [Thu 08 May 2008 16:22:01] Aru: 42<br>
> [Thu 08 May 2008 16:22:01] My_aru: 42<br>
> [Thu 08 May 2008 16:22:01] Highest_seq: 33<br>
> [Thu 08 May 2008 16:22:01] Highest_fifo_seq: 0<br>
> [Thu 08 May 2008 16:22:01] Last_discarded: 0<br>
> [Thu 08 May 2008 16:22:01] Last_delivered: 42<br>
> [Thu 08 May 2008 16:22:01] Last_seq: 3366<br>
> [Thu 08 May 2008 16:22:01] Token_rounds: 501<br>
> [Thu 08 May 2008 16:22:01] Last Token:<br>
> [Thu 08 May 2008 16:22:01] type: 0x80040080<br>
> [Thu 08 May 2008 16:22:01] transmiter_id: -1062683843<br>
> [Thu 08 May 2008 16:22:01] seq: 0<br>
> [Thu 08 May 2008 16:22:01] proc_id: -1062683843<br>
> [Thu 08 May 2008 16:22:01] aru: 42<br>
> [Thu 08 May 2008 16:22:01] aru_last_id: -1062683843<br>
> [Thu 08 May 2008 16:22:01] flow_control: 0<br>
> [Thu 08 May 2008 16:22:01] rtr_len: 0<br>
> [Thu 08 May 2008 16:22:01] conf_hash: -1879690443<br>
><br>
> [ ... ]<br>
><br>
> [Thu 08 May 2008 16:22:02] Send_new_packets: created packet 34<br>
> already exist 2<br>
> Exit caused by Alarm(EXIT)<br>
><br>
><br>
> The "BUG WORKAROUND" messages occur more often, maybe two to five<br>
> times a month, but they are not always correlated with a crash.<br>
><br>
> Any help would be much appreciated.<br>
><br>
> Thank you,<br>
> Matt<br>
><br>
<br>
_______________________________________________<br>
Spread-users mailing list<br>
<a href="mailto:Spread-users@lists.spread.org">Spread-users@lists.spread.org</a><br>
<a href="http://lists.spread.org/mailman/listinfo/spread-users" target="_blank">http://lists.spread.org/mailman/listinfo/spread-users</a><br>
</div></div></blockquote></div><br><br clear="all"><br>-- <br>[ Rodrick R. Brown ] <br><a href="http://www.rodrickbrown.com">http://www.rodrickbrown.com</a> <a href="http://www.linkedin.com/in/rodrickbrown">http://www.linkedin.com/in/rodrickbrown</a>