X-MimeOLE: Produced By Microsoft Exchange V6.5
Received: by onstor-exch02.onstor.net 
	id <01C78074.F9F10549@onstor-exch02.onstor.net>; Mon, 16 Apr 2007 15:17:10 -0700
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----_=_NextPart_001_01C78074.F9F10549"
Content-class: urn:content-classes:message
Subject: RE: unexplained reboots with no clear elog why
Date: Mon, 16 Apr 2007 15:17:14 -0700
Message-ID: <BB375AF679D4A34E9CA8DFA650E2B04E03436FA2@onstor-exch02.onstor.net>
In-Reply-To: <037f01c78073$808a7360$654d7e0a@glasshousetech.com>
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
Thread-Topic: unexplained reboots with no clear elog why
Thread-Index: AceAc4uTr9Z/Io3WQ96saWNEGvWqQwAATrrA
From: "Eric Barrett" <eric.barrett@onstor.com>
To: "Michael Tracy" <mtracy@css.glasshouse.com>,
	"Sandrine Boulanger" <sandrine.boulanger@onstor.com>,
	"dl-cstech" <dl-cstech@onstor.com>

This is a multi-part message in MIME format.

------_=_NextPart_001_01C78074.F9F10549
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

That's a very different issue. It looks (on the surface) like something
caused the system to lose contact with the partner and it took over the
partner's virtual servers.  I'd say investigate the usual, like
connection problems and NTP configuration, and also look for cifsd
crashes as we were just discussing.
=20
If you find a cifsd error at the same time as the PCC down message, add
this to defect 18618.
=20
=20


________________________________

From: Michael Tracy [mailto:mtracy@css.glasshouse.com]=20
Sent: Monday, April 16, 2007 3:07 PM
To: Eric Barrett; Sandrine Boulanger; dl-cstech
Subject: Re: unexplained reboots with no clear elog why


Sorry, my last reply may have been ambiguous.
=20
I see the BSD on 15th...  and elogs show a reboot at same time
=20
but on Apr 16 09:51:18 there were pcc down/up and all vsvrs moved to
other filer.  But no sign of panic/reboot in logs.  Shouldn't there be
something to show the vsvr's moved over?
=20
=20
Michael
=20

	----- Original Message -----=20
	From: Eric Barrett <mailto:eric.barrett@onstor.com> =20
	To: Michael Tracy <mailto:mtracy@css.glasshouse.com>  ; Sandrine
Boulanger <mailto:sandrine.boulanger@onstor.com>  ; dl-cstech
<mailto:dl-cstech@onstor.com> =20
	Sent: Monday, April 16, 2007 5:56 PM
	Subject: RE: unexplained reboots with no clear elog why
=09
=09
	Michael,
	=20
	Look in the 0.0 file for that filer.  Even though most of it is
unreadable binary, you will see a line that says "crashdump_begin:
<DATE>" occur once for each logged crash.  WordPad should be able to
view the file even though there is junk in it.
	=20
	=20

________________________________

	From: Michael Tracy [mailto:mtracy@css.glasshouse.com]=20
	Sent: Monday, April 16, 2007 2:49 PM
	To: Eric Barrett; Sandrine Boulanger; dl-cstech
	Subject: Re: unexplained reboots with no clear elog why
=09
=09
	Yeah I assumed BSD panic and filing a defect.
	=20
	Seems I mispoke about the other not rebooting... Reboot occurred
then too even though no reboot showed in elogs.  Actually, not sure a
reboot occurred but all vsvrs move to other filer.  Any idea on that
one?
	=20
	Michael

		----- Original Message -----=20
		From: Eric Barrett <mailto:eric.barrett@onstor.com> =20
		To: Sandrine Boulanger
<mailto:sandrine.boulanger@onstor.com>  ; Michael Tracy
<mailto:mtracy@css.glasshouse.com>  ; dl-cstech
<mailto:dl-cstech@onstor.com> =20
		Sent: Monday, April 16, 2007 5:36 PM
		Subject: RE: unexplained reboots with no clear elog why

		From the 0.0 file in the system get all:
		=20
		crashdump_begin: Sun Apr 15 13:54:08 2007
		=20
		Definitely a BSD panic.
		=20

________________________________

		From: Sandrine Boulanger=20
		Sent: Monday, April 16, 2007 2:35 PM
		To: 'Michael Tracy'; dl-cstech
		Subject: RE: unexplained reboots with no clear elog why
	=09
	=09

		Bsd panic. Collect the 0.0 file, this is the bsd
crashdump.

		=20

	=09
________________________________


		From: Michael Tracy [mailto:mtracy@css.glasshouse.com]=20
		Sent: Monday, April 16, 2007 2:32 PM
		To: dl-cstech
		Subject: unexplained reboots with no clear elog why

		=20

		Hi all
		Coldwater Creek - 4964
	=09
		Customer has had several unexplained reboots in the past
month.  First we thought NTP issue (4833) but we had him set that last
time. =20
	=09
		crashdump directory shows a  0.0
		crashdump_begin: Sun Apr 15 13:54:08 2007

	=09
		and elogs show at the corresponding time
		Apr 15 12:03:13 sptc1fsrnas02 : 0:0:sanm:ERROR:
sanm_procRmcRcvMsg: unsupported RMC msg type [2048] len[0]=20

		Apr 15 12:46:47 sptc1fsrnas02 : 0:0:cluster2:WARNING:
ClusterCtrl_iUpdateState: post pcc down pccname sptc1fsrnas01=20

		Apr 15 12:46:47 sptc1fsrnas02 : 0:0:eventd:WARNING:
Process-EVENT 0.0.0.0: Mgmt Port 0.0.0.0 PCC, State Down

		Apr 15 12:46:50 sptc1fsrnas02 : 0:0:eventd:WARNING:
Process-EVENT 0.0.0.0: Mgmt Port 0.0.0.0 PCC, State Up

		Apr 15 13:53:14 sptc1fsrnas02 pm:
/usr/local/agile/bin/elog: finished initialization.=20

		Apr 15 13:53:26 sptc1fsrnas02 : 0:0:cm:NOTICE: CHASSISD:
Chassis Manager: Started

		Apr 15 13:53:26 sptc1fsrnas02 : 0:0:cm:NOTICE: CM:
opened kseg1

		Apr 15 13:54:15 sptc1fsrnas02 : 0:0:evm:NOTICE:
evm_rcvRmcMsg : NCM session open failed

		Apr 15 13:54:15 sptc1fsrnas02 : 0:0:evm:NOTICE:
evm_rcvRmcMsg : SDM session open failed

		Apr 15 13:54:15 sptc1fsrnas02 : 0:0:evm:NOTICE:
evm_closeSess : NCM session closed

		Apr 15 13:54:15 sptc1fsrnas02 : 0:0:evm:NOTICE:
evm_closeSess : SDM session closed

		=20

		I'm not sure what caused the panic.  I see several times
in the elogs=20

		Apr 16 09:51:18 sptc1fsrnas02 : 0:0:nfxsh:NOTICE:
cmd[9]: autosupport generate report : status[0]

		Apr 16 11:22:30 sptc1fsrnas02 : 0:0:cluster2:WARNING:
ClusterCtrl_iUpdateState: post pcc down pccname sptc1fsrnas01=20

		Apr 16 11:22:30 sptc1fsrnas02 : 0:0:eventd:WARNING:
Process-EVENT 0.0.0.0: Mgmt Port 0.0.0.0 PCC, State Down

		Apr 16 11:22:33 sptc1fsrnas02 : 0:0:eventd:WARNING:
Process-EVENT 0.0.0.0: Mgmt Port 0.0.0.0 PCC, State Up

		=20

		But no panic occurs.  What made this one different?  =20

		=20

		Can anyone offer any insight on this?

		=20

		Thanks in advance

		Michael

		=20

		PS

		elogs attached and full SGA can be viewed at

=09
/n/dw/bycase/case0004001-case0006000/case4964/sptc1fsrnas02,sn_054505002
2/system_get_all,20070416_13205417


------_=_NextPart_001_01C78074.F9F10549
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML xmlns=3D"http://www.w3.org/TR/REC-html40" xmlns:v =3D=20
"urn:schemas-microsoft-com:vml" xmlns:o =3D=20
"urn:schemas-microsoft-com:office:office" xmlns:w =3D=20
"urn:schemas-microsoft-com:office:word" xmlns:st1 =3D=20
"urn:schemas-microsoft-com:office:smarttags"><HEAD>
<META http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<META content=3D"MSHTML 6.00.2900.3059" name=3DGENERATOR><!--[if !mso]>
<STYLE>v\:* {
	BEHAVIOR: url(#default#VML)
}
o\:* {
	BEHAVIOR: url(#default#VML)
}
w\:* {
	BEHAVIOR: url(#default#VML)
}
.shape {
	BEHAVIOR: url(#default#VML)
}
</STYLE>
<![endif]--><o:SmartTagType name=3D"PlaceType"=20
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"></o:SmartTagT=
ype><o:SmartTagType=20
name=3D"PlaceName"=20
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"></o:SmartTagT=
ype><o:SmartTagType=20
name=3D"place"=20
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"></o:SmartTagT=
ype><!--[if !mso]>
<STYLE>st1\:* {
	BEHAVIOR: url(#default#ieooui)
}
</STYLE>
<![endif]-->
<STYLE>@font-face {
	font-family: Tahoma;
}
@page Section1 {size: 8.5in 11.0in; margin: 1.0in 1.25in 1.0in 1.25in; }
P.MsoNormal {
	FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"
}
LI.MsoNormal {
	FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"
}
DIV.MsoNormal {
	FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"
}
A:link {
	COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlink {
	COLOR: blue; TEXT-DECORATION: underline
}
A:visited {
	COLOR: navy; TEXT-DECORATION: underline
}
SPAN.MsoHyperlinkFollowed {
	COLOR: navy; TEXT-DECORATION: underline
}
SPAN.EmailStyle17 {
	COLOR: navy; FONT-FAMILY: Arial; mso-style-type: personal-reply
}
DIV.Section1 {
	page: Section1
}
</STYLE>
<!--[if gte mso 9]><xml>
 <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
 <o:shapelayout v:ext=3D"edit">
  <o:idmap v:ext=3D"edit" data=3D"1" />
 </o:shapelayout></xml><![endif]--></HEAD>
<BODY lang=3DEN-US vLink=3Dnavy link=3Dblue bgColor=3Dwhite>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D797431522-16042007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>That's a very different issue. It looks (on the =
surface)=20
like something caused the system to lose contact with the partner and it =
took=20
over the partner's virtual servers.&nbsp; I'd say investigate the usual, =
like=20
connection problems and NTP configuration, and also look for cifsd =
crashes as we=20
were just discussing.</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D797431522-16042007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D797431522-16042007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>If you find a cifsd error at the same time as =
the PCC down=20
message, add this to defect 18618.</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D797431522-16042007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D797431522-16042007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV><FONT face=3DArial =
color=3D#0000ff=20
size=3D2></FONT><BR>
<DIV class=3DOutlookMessageHeader lang=3Den-us dir=3Dltr align=3Dleft>
<HR tabIndex=3D-1>
<FONT face=3DTahoma size=3D2><B>From:</B> Michael Tracy=20
[mailto:mtracy@css.glasshouse.com] <BR><B>Sent:</B> Monday, April 16, =
2007 3:07=20
PM<BR><B>To:</B> Eric Barrett; Sandrine Boulanger; =
dl-cstech<BR><B>Subject:</B>=20
Re: unexplained reboots with no clear elog why<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV><FONT face=3DArial size=3D2>Sorry, my last reply may have been=20
ambiguous.</FONT></DIV>
<DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial size=3D2>I see the BSD on 15th...&nbsp; and =
elogs show a=20
reboot at same time</FONT></DIV>
<DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial size=3D2>but on <SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 16 09:51:18 there were =
pcc=20
down/up and all vsvrs moved to other filer.&nbsp; But no sign of =
panic/reboot in=20
logs.&nbsp; Shouldn't there be something to show the vsvr's moved=20
over?</SPAN></FONT></DIV>
<DIV><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial"></SPAN></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial"></SPAN></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">Michael</SPAN></FONT></DIV>
<DIV><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial"></SPAN></FONT>&nbsp;</DIV>
<BLOCKQUOTE dir=3Dltr=20
style=3D"PADDING-RIGHT: 0px; PADDING-LEFT: 5px; MARGIN-LEFT: 5px; =
BORDER-LEFT: #000000 2px solid; MARGIN-RIGHT: 0px">
  <DIV style=3D"FONT: 10pt arial">----- Original Message ----- </DIV>
  <DIV=20
  style=3D"BACKGROUND: #e4e4e4; FONT: 10pt arial; font-color: =
black"><B>From:</B>=20
  <A title=3Deric.barrett@onstor.com =
href=3D"mailto:eric.barrett@onstor.com">Eric=20
  Barrett</A> </DIV>
  <DIV style=3D"FONT: 10pt arial"><B>To:</B> <A =
title=3Dmtracy@css.glasshouse.com=20
  href=3D"mailto:mtracy@css.glasshouse.com">Michael Tracy</A> ; <A=20
  title=3Dsandrine.boulanger@onstor.com=20
  href=3D"mailto:sandrine.boulanger@onstor.com">Sandrine Boulanger</A> ; =
<A=20
  title=3Ddl-cstech@onstor.com =
href=3D"mailto:dl-cstech@onstor.com">dl-cstech</A>=20
  </DIV>
  <DIV style=3D"FONT: 10pt arial"><B>Sent:</B> Monday, April 16, 2007 =
5:56=20
PM</DIV>
  <DIV style=3D"FONT: 10pt arial"><B>Subject:</B> RE: unexplained =
reboots with no=20
  clear elog why</DIV>
  <DIV><FONT face=3DArial size=3D2></FONT><BR></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D941305521-16042007><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2>Michael,</FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D941305521-16042007><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D941305521-16042007><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2>Look in the 0.0 file for that filer.&nbsp; =
Even though=20
  most of it is unreadable binary, you will see a line that says=20
  "crashdump_begin: &lt;DATE&gt;" occur once for each logged =
crash.&nbsp;=20
  WordPad should be able to view the file even though there is junk in=20
  it.</FONT></SPAN></DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D941305521-16042007><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
  <DIV dir=3Dltr align=3Dleft><SPAN class=3D941305521-16042007><FONT =
face=3DArial=20
  color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV><BR>
  <DIV class=3DOutlookMessageHeader lang=3Den-us dir=3Dltr align=3Dleft>
  <HR tabIndex=3D-1>
  <FONT face=3DTahoma size=3D2><B>From:</B> Michael Tracy=20
  [mailto:mtracy@css.glasshouse.com] <BR><B>Sent:</B> Monday, April 16, =
2007=20
  2:49 PM<BR><B>To:</B> Eric Barrett; Sandrine Boulanger;=20
  dl-cstech<BR><B>Subject:</B> Re: unexplained reboots with no clear =
elog=20
  why<BR></FONT><BR></DIV>
  <DIV></DIV>
  <DIV><FONT face=3DArial size=3D2>Yeah I assumed BSD panic and filing a =

  defect.</FONT></DIV>
  <DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
  <DIV><FONT face=3DArial size=3D2>Seems I mispoke about the other not =
rebooting...=20
  Reboot occurred then too even though no reboot showed in elogs.&nbsp;=20
  Actually, not sure a reboot occurred but all vsvrs move to other =
filer.&nbsp;=20
  Any idea on that one?</FONT></DIV>
  <DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
  <DIV><FONT face=3DArial size=3D2>Michael</FONT></DIV>
  <BLOCKQUOTE dir=3Dltr=20
  style=3D"PADDING-RIGHT: 0px; PADDING-LEFT: 5px; MARGIN-LEFT: 5px; =
BORDER-LEFT: #000000 2px solid; MARGIN-RIGHT: 0px">
    <DIV style=3D"FONT: 10pt arial">----- Original Message ----- </DIV>
    <DIV=20
    style=3D"BACKGROUND: #e4e4e4; FONT: 10pt arial; font-color: =
black"><B>From:</B>=20
    <A title=3Deric.barrett@onstor.com =
href=3D"mailto:eric.barrett@onstor.com">Eric=20
    Barrett</A> </DIV>
    <DIV style=3D"FONT: 10pt arial"><B>To:</B> <A=20
    title=3Dsandrine.boulanger@onstor.com=20
    href=3D"mailto:sandrine.boulanger@onstor.com">Sandrine Boulanger</A> =
; <A=20
    title=3Dmtracy@css.glasshouse.com=20
    href=3D"mailto:mtracy@css.glasshouse.com">Michael Tracy</A> ; <A=20
    title=3Ddl-cstech@onstor.com =
href=3D"mailto:dl-cstech@onstor.com">dl-cstech</A>=20
    </DIV>
    <DIV style=3D"FONT: 10pt arial"><B>Sent:</B> Monday, April 16, 2007 =
5:36=20
    PM</DIV>
    <DIV style=3D"FONT: 10pt arial"><B>Subject:</B> RE: unexplained =
reboots with=20
    no clear elog why</DIV>
    <DIV><BR></DIV>
    <DIV dir=3Dltr align=3Dleft><SPAN class=3D962333621-16042007><FONT =
face=3DArial=20
    color=3D#0000ff size=3D2>From the 0.0 file in the system get=20
    all:</FONT></SPAN></DIV>
    <DIV dir=3Dltr align=3Dleft><SPAN class=3D962333621-16042007><FONT =
face=3DArial=20
    color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
    <DIV dir=3Dltr align=3Dleft><SPAN class=3D962333621-16042007><FONT =
face=3DArial=20
    color=3D#0000ff size=3D2>crashdump_begin: Sun Apr 15 13:54:08=20
    2007</FONT></SPAN></DIV>
    <DIV dir=3Dltr align=3Dleft><SPAN class=3D962333621-16042007><FONT =
face=3DArial=20
    color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
    <DIV dir=3Dltr align=3Dleft><SPAN class=3D962333621-16042007><FONT =
face=3DArial=20
    color=3D#0000ff size=3D2>Definitely a BSD panic.</FONT></SPAN></DIV>
    <DIV dir=3Dltr align=3Dleft><SPAN class=3D962333621-16042007><FONT =
face=3DArial=20
    color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV><BR>
    <DIV class=3DOutlookMessageHeader lang=3Den-us dir=3Dltr =
align=3Dleft>
    <HR tabIndex=3D-1>
    <FONT face=3DTahoma size=3D2><B>From:</B> Sandrine Boulanger =
<BR><B>Sent:</B>=20
    Monday, April 16, 2007 2:35 PM<BR><B>To:</B> 'Michael Tracy';=20
    dl-cstech<BR><B>Subject:</B> RE: unexplained reboots with no clear =
elog=20
    why<BR></FONT><BR></DIV>
    <DIV></DIV>
    <DIV class=3DSection1>
    <P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Bsd =
panic. Collect=20
    the 0.0 file, this is the bsd =
crashdump.<o:p></o:p></SPAN></FONT></P>
    <P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
    <DIV>
    <DIV class=3DMsoNormal style=3D"TEXT-ALIGN: center" =
align=3Dcenter><FONT=20
    face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: 12pt">
    <HR tabIndex=3D-1 align=3Dcenter width=3D"100%" SIZE=3D2>
    </SPAN></FONT></DIV>
    <P class=3DMsoNormal><B><FONT face=3DTahoma size=3D2><SPAN=20
    style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">From:</SPAN></FONT></B><FONT=20
    face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">=20
    Michael Tracy [mailto:mtracy@css.glasshouse.com] <BR><B><SPAN=20
    style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Monday, April 16, 2007 =
2:32=20
    PM<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B>=20
    dl-cstech<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Subject:</SPAN></B>=20
    unexplained reboots with no clear elog=20
why</SPAN></FONT><o:p></o:p></P></DIV>
    <P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
    style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Hi all<BR>Coldwater =
Creek -=20
    4964<BR><BR>Customer has had several unexplained reboots in the past =

    month.&nbsp; First we thought NTP issue (4833) but we had him set =
that last=20
    time.&nbsp; <BR><BR>crashdump directory shows a&nbsp;=20
    0.0<BR>crashdump_begin: Sun Apr 15 13:54:08=20
    2007</SPAN></FONT><o:p></o:p></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial"><BR>and elogs show at =
the=20
    corresponding time<BR>Apr 15 12:03:13 sptc1fsrnas02 : =
0:0:sanm:ERROR:=20
    sanm_procRmcRcvMsg: unsupported RMC msg type [2048] len[0]=20
    <o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 15 12:46:47 =
sptc1fsrnas02 :=20
    0:0:cluster2:WARNING: ClusterCtrl_iUpdateState: post pcc down =
pccname=20
    sptc1fsrnas01 <o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 15 12:46:47 =
sptc1fsrnas02 :=20
    0:0:eventd:WARNING: Process-EVENT 0.0.0.0: <st1:place=20
    w:st=3D"on"><st1:PlaceName w:st=3D"on">Mgmt</st1:PlaceName> =
<st1:PlaceType=20
    w:st=3D"on">Port</st1:PlaceType></st1:place> 0.0.0.0 PCC, State=20
    Down<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 15 12:46:50 =
sptc1fsrnas02 :=20
    0:0:eventd:WARNING: Process-EVENT 0.0.0.0: <st1:place=20
    w:st=3D"on"><st1:PlaceName w:st=3D"on">Mgmt</st1:PlaceName> =
<st1:PlaceType=20
    w:st=3D"on">Port</st1:PlaceType></st1:place> 0.0.0.0 PCC, State=20
    Up<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 15 13:53:14 =
sptc1fsrnas02=20
    pm: /usr/local/agile/bin/elog: finished initialization.=20
    <o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 15 13:53:26 =
sptc1fsrnas02 :=20
    0:0:cm:NOTICE: CHASSISD: Chassis Manager:=20
    Started<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 15 13:53:26 =
sptc1fsrnas02 :=20
    0:0:cm:NOTICE: CM: opened kseg1<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 15 13:54:15 =
sptc1fsrnas02 :=20
    0:0:evm:NOTICE: evm_rcvRmcMsg : NCM session open=20
    failed<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 15 13:54:15 =
sptc1fsrnas02 :=20
    0:0:evm:NOTICE: evm_rcvRmcMsg : SDM session open=20
    failed<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 15 13:54:15 =
sptc1fsrnas02 :=20
    0:0:evm:NOTICE: evm_closeSess : NCM session=20
    closed<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 15 13:54:15 =
sptc1fsrnas02 :=20
    0:0:evm:NOTICE: evm_closeSess : SDM session=20
    closed<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">&nbsp;<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">I'm not sure what =
caused the=20
    panic.&nbsp; I see several times in the elogs=20
    <o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 16 09:51:18 =
sptc1fsrnas02 :=20
    0:0:nfxsh:NOTICE: cmd[9]: autosupport generate report :=20
    status[0]<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 16 11:22:30 =
sptc1fsrnas02 :=20
    0:0:cluster2:WARNING: ClusterCtrl_iUpdateState: post pcc down =
pccname=20
    sptc1fsrnas01 <o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 16 11:22:30 =
sptc1fsrnas02 :=20
    0:0:eventd:WARNING: Process-EVENT 0.0.0.0: <st1:place=20
    w:st=3D"on"><st1:PlaceName w:st=3D"on">Mgmt</st1:PlaceName> =
<st1:PlaceType=20
    w:st=3D"on">Port</st1:PlaceType></st1:place> 0.0.0.0 PCC, State=20
    Down<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Apr 16 11:22:33 =
sptc1fsrnas02 :=20
    0:0:eventd:WARNING: Process-EVENT 0.0.0.0: <st1:place=20
    w:st=3D"on"><st1:PlaceName w:st=3D"on">Mgmt</st1:PlaceName> =
<st1:PlaceType=20
    w:st=3D"on">Port</st1:PlaceType></st1:place> 0.0.0.0 PCC, State=20
    Up<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">&nbsp;<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">But no panic =
occurs.&nbsp; What=20
    made this one different?&nbsp;&nbsp; =
<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">&nbsp;<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Can anyone offer any =
insight on=20
    this?<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">&nbsp;<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Thanks in=20
    advance<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">Michael<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">&nbsp;<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">PS<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">elogs attached and =
full SGA can=20
    be viewed at<o:p></o:p></SPAN></FONT></P></DIV>
    <DIV>
    <P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
    style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">/n/dw/bycase/case0004001-case0006000/case4964/sptc1fsrnas02,sn_054=
5050022/system_get_all,20070416_13205417</SPAN></FONT><o:p></o:p></P></DI=
V></DIV></BLOCKQUOTE></BLOCKQUOTE></BODY></HTML>

------_=_NextPart_001_01C78074.F9F10549--
