AF:
NF:0
PS:10
SRH:1
SFN:
DSR:
MID:
CFG:
PT:0
S:andy.sharp@lsi.com
RQ:
SSV:mhbs.lsil.com
NSV:
SSH:
R:<Brian.Stark@lsi.com>,<Michael.Gollotti@lsi.com>,<Trinh.Tran@lsi.com>,<Rich.Miller@lsi.com>,<Richard.Hardiman@lsi.com>
MAID:2
X-Sylpheed-Privacy-System:
X-Sylpheed-Sign:0
SCF:#mh/Mailbox/sent
RMID:#imap/LSI/INBOX	0	E1EC65251D4B3D46BBC0AAA3C0629222A922820E@cosmail02.lsi.com
X-Sylpheed-End-Special-Headers: 1
Date: Tue, 6 Oct 2009 23:47:00 -0700
From: Andrew Sharp <andy.sharp@lsi.com>
To: "Stark, Brian" <Brian.Stark@lsi.com>
Cc: "Gollotti, Michael" <Michael.Gollotti@lsi.com>, "Tran, Trinh"
 <Trinh.Tran@lsi.com>, "Miller, Richard K (Rich)" <Rich.Miller@lsi.com>,
 "Hardiman, Richard" <Richard.Hardiman@lsi.com>
Subject: Re: General AutoSupport Report - Dogfood
Message-ID: <20091006234700.46a2cca6@ripper.onstor.net>
In-Reply-To: <E1EC65251D4B3D46BBC0AAA3C0629222A922820E@cosmail02.lsi.com>
References: <E1MstAQ-0007tH-4s@Dogfood>
	<E1EC65251D4B3D46BBC0AAA3C0629222A8AAACE1@cosmail02.lsi.com>
	<1254332517.14287.74.camel@rendellf>
	<85A1D09038E3C1438820EF7A7FAFDD30F510262F@cosmail01.lsi.com>
	<E1EC65251D4B3D46BBC0AAA3C0629222A913385E@cosmail02.lsi.com>
	<5BD8489488DB2440ABB93FC6779E533F8329A1B3@cosmail01.lsi.com>
	<B50ED5C0A7967343B07C1764EE1D7BD1E2272848@cosmail01.lsi.com>
	<F679047B9B93354AB6CB9FBFC5408002012E5FE24A@cosmail02.lsi.com>
	<E1EC65251D4B3D46BBC0AAA3C0629222A922820E@cosmail02.lsi.com>
Organization: LSI
X-Mailer: Sylpheed-Claws 2.6.0 (GTK+ 2.8.20; x86_64-pc-linux-gnu)
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit

Discussion list: http://wiki.onstor.net/wiki/IT_Issues_list

On Tue, 6 Oct 2009 23:29:25 -0600 "Stark, Brian" <Brian.Stark@lsi.com>
wrote:

> Following up on this email thread, Mightydog saw temperature events
> on both nodes on Sunday night.  The air intake temperature climbed
> above 40 degrees C at around 7:40pm and then fell to acceptable
> levels around 8:40pm.  
> 
> This means we've had 2 external events that have affected Mightydog
> within the last few weeks.  
> 
> I'd like to have a discussion about this during the IT meeting
> scheduled for Friday at 11. 
> 
> 
> Brian
> 
> 
> -----Original Message-----
> From: Stark, Brian 
> Sent: Thursday, October 01, 2009 1:38 PM
> To: Gollotti, Michael; Tran, Trinh; Miller, Richard K (Rich)
> Cc: Hardiman, Richard
> Subject: RE: FW: General AutoSupport Report - Dogfood
> 
> FYI...no port errors have accumulated since yesterday afternoon.
> 
> 
> Brian
> 
> 
> -----Original Message-----
> From: Gollotti, Michael 
> Sent: Wednesday, September 30, 2009 10:58 AM
> To: Tran, Trinh; Miller, Richard K (Rich)
> Cc: Hardiman, Richard; Stark, Brian
> Subject: RE: FW: General AutoSupport Report - Dogfood
> 
> No work was done on any of the switches in the Campbell IDF yesterday.
> 
> I will verify where Mightydog is connecting to the switch and see if
> switch captured any issues within its log.
> 
> Regards,
> Michael-
> 
> -----Original Message-----
> From: Tran, Trinh 
> Sent: Wednesday, September 30, 2009 10:51 AM
> To: Gollotti, Michael; Miller, Richard K (Rich)
> Cc: Hardiman, Richard; Stark, Brian
> Subject: RE: FW: General AutoSupport Report - Dogfood
> 
> Any ideas?
> 
> Trinh
> 
> 
> -----Original Message-----
> From: Stark, Brian 
> Sent: Wednesday, September 30, 2009 10:48 AM
> To: Tran, Trinh
> Cc: Hardiman, Richard
> Subject: RE: FW: General AutoSupport Report - Dogfood
> 
> Trinh,
> 
> Please see the email thread below.  The Mightydog cluster saw
> hundreds of port events yesterday on the FC ports.  Since both nodes
> in the cluster saw these events, it's likely to be an external cause.
> 
> Was work being done yesterday in the IT closet that would have
> affected connectivity to storage?
> 
> 
> Brian
> 
> 
> -----Original Message-----
> From: Keiffer, John 
> Sent: Wednesday, September 30, 2009 10:45 AM
> To: Fong, Rendell; Stark, Brian
> Cc: DL-ONStor-Engineering; Hardiman, Richard
> Subject: RE: FW: General AutoSupport Report - Dogfood
> 
> Over 800 sp2.0 and sp2.2 events were seen yesterday on each node of
> mightydog between 6:25am and 1:29pm. After that things are fine.
> 
> Thanks,
> John
> 408-376-3106
> 
> -----Original Message-----
> From: Rendell Fong [mailto:Rendell.Fong@lsi.com] 
> Sent: Wednesday, September 30, 2009 10:42 AM
> To: Stark, Brian
> Cc: DL-ONStor-Engineering; Hardiman, Richard
> Subject: Re: FW: General AutoSupport Report - Dogfood
> 
> The port events being reported are either that a port is UP or DOWN.
> The logged event should indicate the FP or SP port that the event was
> relative to.
> 
> 
> On Wed, 2009-09-30 at 10:29 -0600, Stark, Brian wrote:
> > Any idea what the Port events below are referring to?  Looks like
> > we got a ton of these on both Mightydog nodes yesterday...
> > 
> > 
> > ________________________________________
> > From: Dogfood@onstor.com [Dogfood@onstor.com]
> > Sent: Wednesday, September 30, 2009 12:00 AM
> > To: dl-mightydog-alert@onstor.com
> > Subject: General AutoSupport Report - Dogfood
> > 
> > Auto support mail:
> > Node name: Dogfood
> > Time: Sep 30 00:00:02 2009
> > Event Type                  Count       Last Event Time
> > -----------------------------------------------------------------
> > Node                        2           Thu Jul 16 13:08:57 2009
> > PCC                         1           Thu Jul 16 13:07:01 2009
> > SCC                         0           None
> > Card                        0           None
> > CPU                         0           None
> > Volume                      51          Thu Sep 17 10:44:59 2009
> > IP i/f                      3           Thu Jul 16 13:07:45 2009
> > Port                        938         Tue Sep 29 13:28:29 2009
> > NFS                         0           None
> > Route                       0           None
> > Quota Rebuild Start         0           None
> > Quota Rebuild Done          0           None
> > Quota Rebuild Aborted       0           None
> > Quota Tree Enabled          0           None
> > Quota Tree Disabled         0           None
> > Quota Tree Warn             0           None
> > Quota Tree Limit            0           None
> > Quota User Enabled          0           None
> > Quota User Disabled         0           None
> > Quota User Warn             0           None
> > Quota User Limit            0           None
> > Quota Group Enabled         0           None
> > Quota Group Disabled        0           None
> > Quota Group Warn            0           None
> > Quota Group Limit           0           None
> > Mkfs                        0           None
> > IdMap                       0           None
> > Privs                       2           Mon Sep 14 10:34:45 2009
> > Vsvr                        7           Thu Jul 16 13:07:45 2009
> > Coredump                    0           None
> > Power Supply                0           None
> > Domain                      0           None
> > Cluster DB Ver Change       0           None
> > Temperature                 0           None
> > Fan                         0           None
> > DNS                         2           Fri Sep 25 14:07:52 2009
> > CShare                      1           Fri Aug 14 10:49:48 2009
> > GNS                         0           None
> > SNMP                        0           None
> > GNSServerSNMP Cfg           0           None
> > CShareForceGroup            0           None
> > (null)                      0           None
> > -----------------------------------------------------------------
> > -----
> > THIS MAIL HAS BEEN AUTOMATICALLY GENERATED.
> > PLEASE DO NOT REPLY.
> > -----
> 
