[Spread-users] Is this the hanging bug?
Yair Amir
yairamir at cnds.jhu.edu
Wed Aug 14 10:08:44 EDT 2002
Hi,
This is not a complete spmonitor output - the output from a computer
named "lando" is missing.
It seems that you have a partition and that lando and greedo (that are
together) are trying to merge with vader but I cannot see what lando (who is the
representative of lando and greedo) is doing.
I don't think this has relationship to the bug. To be precise, this
bug is triggered only when a control message is delayed for a long time (e.g.
several hundred milliseconds). It is not triggered by messages
arriving out of order. I think we already solved that bug for the next
release version.
Can you reproduce this? If so, please include also the output from
lando.
:) Yair.
Tom> I'm working on reproducing the Spread hanging bug reliably (as reported
Tom> here before) so that we can test switching to a hub and/or new router.
Tom> We need to see it fail before we can determine that changing out the
Tom> switch fixes it.
Tom> I believe I've got it isolated. Does the following spmonitor output show
Tom> the bug in question?
Tom> If so, how is that determined from the spmonitor output? (so I don't
Tom> have to bother the list with this again)
Tom> Now, I'm clear that Spread has hung here, and I'm about 99.9% certain
Tom> that this is the same bug (packets received out of order), but I want to
Tom> be 100% sure before we proceed.
Tom> ============================
Tom> Status at vader V 3.16. 2 (state 4, gstate 1) after 1718 seconds :
Tom> Membership : 1 procs in 1 segments, leader is vader
Tom> rounds : 570974 tok_hurry : 629 memb change: 2
Tom> sent pack: 4 recv pack : 189333 retrans : 0
Tom> u retrans: 0 s retrans : 0 b retrans : 0
Tom> My_aru : 0 Aru : 0 Highest seq: 0
Tom> Sessions : 1 Groups : 1 Window : 60
Tom> Deliver M: 248020 Deliver Pk: 248027 Pers Window: 15
Tom> Delta Mes: -230654 Delta Pack: -230657 Delta sec : 15
Tom> ==================================
Monitor>>
Tom> ============================
Tom> Status at greedo V 3.16. 2 (state 1, gstate 1) after 1713 seconds :
Tom> Membership : 2 procs in 1 segments, leader is lando
Tom> rounds : 1864969 tok_hurry : 573 memb change: 2
Tom> sent pack: 354273 recv pack : 7 retrans : 7828
Tom> u retrans: 7828 s retrans : 0 b retrans : 0
Tom> My_aru : 236073 Aru : 236068 Highest seq: 236073
Tom> Sessions : 1 Groups : 1 Window : 60
Tom> Deliver M: 484090 Deliver Pk: 484100 Pers Window: 15
Tom> Delta Mes: 236070 Delta Pack: 236068 Delta sec : -5
Tom> ==================================
Monitor>> Monitor: send status query
Tom> ============================
Tom> Status at vader V 3.16. 2 (state 4, gstate 1) after 1728 seconds :
Tom> Membership : 1 procs in 1 segments, leader is vader
Tom> rounds : 570979 tok_hurry : 634 memb change: 2
Tom> sent pack: 4 recv pack : 189333 retrans : 0
Tom> u retrans: 0 s retrans : 0 b retrans : 0
Tom> My_aru : 0 Aru : 0 Highest seq: 0
Tom> Sessions : 1 Groups : 1 Window : 60
Tom> Deliver M: 248020 Deliver Pk: 248027 Pers Window: 15
Tom> Delta Mes: -236070 Delta Pack: -236068 Delta sec : 15
Tom> ==================================
Monitor>>
Tom> ============================
Tom> Status at greedo V 3.16. 2 (state 1, gstate 1) after 1723 seconds :
Tom> Membership : 2 procs in 1 segments, leader is lando
Tom> rounds : 1893963 tok_hurry : 573 memb change: 2
Tom> sent pack: 358126 recv pack : 7 retrans : 7978
Tom> u retrans: 7978 s retrans : 0 b retrans : 0
Tom> My_aru : 241508 Aru : 241508 Highest seq: 241508
Tom> Sessions : 1 Groups : 1 Window : 60
Tom> Deliver M: 489525 Deliver Pk: 489535 Pers Window: 15
Tom> Delta Mes: 241505 Delta Pack: 241508 Delta sec : -5
Tom> ==================================
Monitor>> Monitor: send status query
Tom> ============================
Tom> Status at vader V 3.16. 2 (state 4, gstate 1) after 1738 seconds :
Tom> Membership : 1 procs in 1 segments, leader is vader
Tom> rounds : 570984 tok_hurry : 639 memb change: 2
Tom> sent pack: 4 recv pack : 189333 retrans : 0
Tom> u retrans: 0 s retrans : 0 b retrans : 0
Tom> My_aru : 0 Aru : 0 Highest seq: 0
Tom> Sessions : 1 Groups : 1 Window : 60
Tom> Deliver M: 248020 Deliver Pk: 248027 Pers Window: 15
Tom> Delta Mes: -241505 Delta Pack: -241508 Delta sec : 15
Tom> ==================================
Monitor>>
Tom> ============================
Tom> Status at greedo V 3.16. 2 (state 1, gstate 1) after 1733 seconds :
Tom> Membership : 2 procs in 1 segments, leader is lando
Tom> rounds : 1921294 tok_hurry : 573 memb change: 2
Tom> sent pack: 361976 recv pack : 7 retrans : 8094
Tom> u retrans: 8094 s retrans : 0 b retrans : 0
Tom> My_aru : 247022 Aru : 247022 Highest seq: 247022
Tom> Sessions : 1 Groups : 1 Window : 60
Tom> Deliver M: 495039 Deliver Pk: 495049 Pers Window: 15
Tom> Delta Mes: 247019 Delta Pack: 247022 Delta sec : -5
Tom> ==================================
Monitor>> Monitor: send status query
Tom> ============================
Tom> Status at vader V 3.16. 2 (state 4, gstate 1) after 1748 seconds :
Tom> Membership : 1 procs in 1 segments, leader is vader
Tom> rounds : 570989 tok_hurry : 644 memb change: 2
Tom> sent pack: 4 recv pack : 189333 retrans : 0
Tom> u retrans: 0 s retrans : 0 b retrans : 0
Tom> My_aru : 0 Aru : 0 Highest seq: 0
Tom> Sessions : 1 Groups : 1 Window : 60
Tom> Deliver M: 248020 Deliver Pk: 248027 Pers Window: 15
Tom> Delta Mes: -247019 Delta Pack: -247022 Delta sec : 15
Tom> ==================================
Monitor>>
Tom> ============================
Tom> Status at greedo V 3.16. 2 (state 1, gstate 1) after 1743 seconds :
Tom> Membership : 2 procs in 1 segments, leader is lando
Tom> rounds : 1948679 tok_hurry : 573 memb change: 2
Tom> sent pack: 365793 recv pack : 7 retrans : 8236
Tom> u retrans: 8236 s retrans : 0 b retrans : 0
Tom> My_aru : 252440 Aru : 252440 Highest seq: 252440
Tom> Sessions : 1 Groups : 1 Window : 60
Tom> Deliver M: 500457 Deliver Pk: 500467 Pers Window: 15
Tom> Delta Mes: 252437 Delta Pack: 252440 Delta sec : -5
Tom> ==================================
Monitor>> Monitor: send status query
Tom> ============================
Tom> Status at vader V 3.16. 2 (state 4, gstate 1) after 1758 seconds :
Tom> Membership : 1 procs in 1 segments, leader is vader
Tom> rounds : 570994 tok_hurry : 649 memb change: 2
Tom> sent pack: 4 recv pack : 189333 retrans : 0
Tom> u retrans: 0 s retrans : 0 b retrans : 0
Tom> My_aru : 0 Aru : 0 Highest seq: 0
Tom> Sessions : 1 Groups : 1 Window : 60
Tom> Deliver M: 248020 Deliver Pk: 248027 Pers Window: 15
Tom> Delta Mes: -252437 Delta Pack: -252440 Delta sec : 15
Tom> ==================================
Monitor>>
Tom> ============================
Tom> Status at greedo V 3.16. 2 (state 1, gstate 1) after 1753 seconds :
Tom> Membership : 2 procs in 1 segments, leader is lando
Tom> rounds : 1976080 tok_hurry : 574 memb change: 2
Tom> sent pack: 369643 recv pack : 7 retrans : 8367
Tom> u retrans: 8367 s retrans : 0 b retrans : 0
Tom> My_aru : 257908 Aru : 257907 Highest seq: 257908
Tom> Sessions : 1 Groups : 1 Window : 60
Tom> Deliver M: 505925 Deliver Pk: 505935 Pers Window: 15
Tom> Delta Mes: 257905 Delta Pack: 257907 Delta sec : -5
Tom> ==================================
Tom> --
Tom> -- Tom Mornini
Tom> -- eWingz Systems, Inc.
Tom> --
Tom> -- ICQ: 113526784, AOL, Yahoo, MSN and Jabber: tmornini
Tom> _______________________________________________
Tom> Spread-users mailing list
Tom> Spread-users at lists.spread.org
Tom> http://lists.spread.org/mailman/listinfo/spread-users
More information about the Spread-users
mailing list