AF:
NF:0
PS:10
SRH:1
SFN:
DSR:
MID:<20080626150333.4e3b19d9@ripper.onstor.net>
CFG:
PT:0
S:andy.sharp@onstor.com
RQ:
SSV:onstor-exch02.onstor.net
NSV:
SSH:
R:<brian.stark@onstor.com>,<jonathan.goldick@onstor.com>,<bill.nadzam@onstor.com>
MAID:1
X-Sylpheed-Privacy-System:
X-Sylpheed-Sign:0
SCF:#mh/Mailbox/sent
FMID:#imap/andys@onstor.net@onstor-exch02.onstor.net/INBOX	0	BB375AF679D4A34E9CA8DFA650E2B04E0AA0B384@onstor-exch02.onstor.net
X-Sylpheed-End-Special-Headers: 1
Date: Thu, 26 Jun 2008 15:03:52 -0700
From: Andrew Sharp <andy.sharp@onstor.com>
To: Brian Stark <brian.stark@onstor.com>, Jonathan Goldick
 <jonathan.goldick@onstor.com>, Bill Nadzam <bill.nadzam@onstor.com>
Subject: Fw: I hit fs_abort while deleting a volume on this nightly build
 (0626).
Message-ID: <20080626150352.290a6a18@ripper.onstor.net>
Organization: Onstor
X-Mailer: Sylpheed-Claws 2.6.0 (GTK+ 2.8.20; x86_64-pc-linux-gnu)
Mime-Version: 1.0
Content-Type: multipart/mixed; boundary=MP_EHyGskJHZqB.F6XOrnaWbnK

--MP_EHyGskJHZqB.F6XOrnaWbnK
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

This from Damon while testing on last night's nightly build of dev
branch.  I have no idea if it's related in any way to any recent
changes so I'm forwarding it to youse guyz.




Begin forwarded message:

Date: Thu, 26 Jun 2008 14:55:34 -0700
From: "Damon Wong" <damon.wong@onstor.com>
To: "Vikas Saini" <vikas.saini@onstor.com>
Cc: "Raj Kumar" <raj.kumar@onstor.com>, "Larry Scheer"
<larry.scheer@onstor.com>, "Andy Sharp" <andy.sharp@onstor.com>,
"Sandrine Boulanger" <sandrine.boulanger@onstor.com> Subject: I hit
fs_abort while deleting a volume on this nightly build (0626).


I hit fs_abort while deleting a volume on this nightly build.
Similar to 24376 but I hit it while creating the volume, not deleting
the volume.

Damon

Core_dump:
ONStor Core Analysis Tool version v2.1.0
Core location: /n/users/dwong/private/scripts/1.2
Core platform: CG
Core type: FP
Core version: R4.0.0.0CGDBG-061408
Boot time: Thu Jun 26 14:21:18 2008
Crash time: Thu Jun 26 14:23:35 2008
Image location:
/n/build-trees/R4.0.0.0/R4.0.0.0-061408-sub26/nfx-tree/Build/cg/dbg/Imag
es/fp_cg

===BEGIN STACK TRACE===
#0  fs_abort () at fs-err.c:1141
#1  0x831d9128 in fs_owner_mount (context=0x102059d458,
buf=0x400d5f8280) at fs-owner.c:322
#2  0x831d9cbc in fs_owner_check_mount (context=0x102059d458) at
fs-owner.c:625
#3  0x831da530 in fs_owner_start (context=0x102059d458) at
fs-owner.c:859
#4  0x831a7fe0 in fs_doMount (context=0x102059d458, req=0x101c8c4320) at
fs-mount.c:2479
#5  0x831ac088 in fs_mountThread (context=0x102059d458) at
fs-mount.c:3601
#6  0x830c6f88 in fs_threadBegin (handle=0, arg=0x0) at
fs-context.c:2950
===END STACK TRACE===
[root@c15r18-rhel4 scripts]#

/var/log/Onstor/messages:
Jun 26 14:23:23 g5r204 : 0:0:(null):NOTICE: 'root' logged in through
remote host(10.2.18.15)
Jun 26 14:23:24 g5r204 : 0:0:nfxsh:NOTICE: cmd[0]: system show nodename
: status[0]
Jun 26 14:23:25 g5r204 : 0:0:nfxsh:NOTICE: cmd[1]: volume show  :
status[0]
Jun 26 14:23:25 g5r204 : 0:0:nfxsh:NOTICE: cmd[2]: vsvr set G5R204-T1 :
status[0]
Jun 26 14:23:25 g5r204 : 0:0:ea:ERROR: ea_delFsysProc[2590]:
Volume[g5r204-t1-vol2] is in Mounting state. Operation not allowed.
Jun 26 14:23:25 g5r204 : 0:0:nfxsh:NOTICE: cmd[3]: volume delete
g5r204-t1-vol2 : status[11]
Jun 26 14:23:25 g5r204 : 0:0:nfxsh:NOTICE: cmd[4]: system show nodename
: status[0]
Jun 26 14:23:25 g5r204 : 0:0:nfxsh:NOTICE: cmd[5]: lun show disk -t free
: status[0]
Jun 26 14:23:26 g5r204 : 0:0:nfxsh:NOTICE: cmd[4]: vsvr id 2 : status[0]
Jun 26 14:23:35 g5r204 : 1:5:efs:ERROR: 81: fs_abort
Jun 26 14:23:38 g5r204 : 0:0:eventd:WARNING: Process-EVENT CPU: Slot 1,
CPU 0, State Down
Jun 26 14:23:38 g5r204 : 0:0:eventd:WARNING: Process-EVENT CPU: Slot 1,
CPU 1, State Down
Jun 26 14:23:38 g5r204 : 0:0:vtm:NOTICE: Vtm_ProcEvntMsg: NFX_EVENT_CPU,
state 2, slot 1, cpu 0
Jun 26 14:23:38 g5r204 : 0:0:eventd:WARNING: Process-EVENT CPU: Slot 1,
CPU 2, State Down
Jun 26 14:23:38 g5r204 : 0:0:eventd:WARNING: Process-EVENT CPU: Slot 1,
CPU 3, State Down
Jun 26 14:23:38 g5r204 : 0:0:eventd:WARNING: Process-EVENT CPU: Slot 1,
CPU 4, State Down
Jun 26 14:23:38 g5r204 : 0:0:eventd:WARNING: Process-EVENT CPU: Slot 1,
CPU 5, State Down
Jun 26 14:23:38 g5r204 : 0:0:sanm:ERROR: SANM: FP NIM down. Aborting all
mirror sessions.
Jun 26 14:23:38 g5r204 : 0:0:sanm:ERROR: SANM: FP NIM down. Aborting all
mirror sessions.
Jun 26 14:23:38 g5r204 : 0:0:vtm:NOTICE: Vtm_ProcEvntMsg: NFX_EVENT_CPU,
state 2, slot 1, cpu 1
Jun 26 14:23:38 g5r204 : 0:0:vtm:NOTICE: Vtm_ProcEvntMsg: NFX_EVENT_CPU,
state 2, slot 1, cpu 2
Jun 26 14:23:38 g5r204 : 0:0:vtm:NOTICE: Vtm_ProcEvntMsg: NFX_EVENT_CPU,
state 2, slot 1, cpu 3
Jun 26 14:23:38 g5r204 : 0:0:vtm:NOTICE: Vtm_ProcEvntMsg: NFX_EVENT_CPU,
state 2, slot 1, cpu 4
Jun 26 14:23:38 g5r204 : 0:0:vtm:NOTICE: Vtm_ProcEvntMsg: NFX_EVENT_CPU,
state 2, slot 1, cpu 5
Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'g5r204-t1-vol2', Id 0x00000770000001dd, Event 'Offline', State 'Down'
Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'g5r204-t1-vol4', Id 0x00000770000001df, Event 'Offline', State 'Down'
Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'g5r204-t1-vol5', Id 0x00000770000001e0, Event 'Offline', State 'Down'
Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'g5r204-t1-vol3', Id 0x00000770000001de, Event 'Offline', State 'Down'
Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'g5r204-t1-vol6', Id 0x00000770000001e1, Event 'Offline', State 'Down'
Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'vol_mgmt_1904', Id 0x000007700000017d, Event 'Offline', State 'Down'
Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'g5r204-t1-vol1', Id 0x00000770000001dc, Event 'Offline', State 'Down'
Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT IP i/f: IP
192.167.1.1, Port bp0, State Remove
Jun 26 14:23:39 g5r204 : 0:0:eventd:WARNING: Process-EVENT Vsvr: Virtual
server 'VS_MGMT_1904', Id 1, State 'Down'
Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT IP i/f: IP
192.167.2.1, Port bp0, State Remove
Jun 26 14:23:39 g5r204 : 0:0:eventd:WARNING: Process-EVENT Vsvr: Virtual
server 'G5R204-T1', Id 2, State 'Down'
Jun 26 14:23:42 g5r204 : 0:0:vtm:ERROR: vtm_gatherInfo_proc: gather info
failed for request from g5r204
Jun 26 14:23:43 g5r204 : 0:0:vtm:ERROR: vtm_failover_vsvr_proc: no
alternative filer found for vs 2 failover
Jun 26 14:23:43 g5r204 : 0:0:vtm:ERROR: vtm_failover_vsvr_proc: no
alternative filer found for vs 3 failover
Jun 26 14:23:49 g5r204 : 0:0:nfxsh:NOTICE: cmd[5]: system show chassis :
status[0]
Jun 26 14:24:03 g5r204 : 0:0:nfxsh:NOTICE: cmd[0]: -> EMRS: Not
gathering h_res_stats: not all processors are up. : status[2]
Jun 26 14:24:16 g5r204 : 0:0:(null):NOTICE: 'root' logged in through
remote host(10.0.0.233)
Jun 26 14:26:15 g5r204 : 0:0:eventd:CRITICAL: Process-EVENT Node: Name
'local', State Down, Msg 'Node going down for reboot! ('system reboot'
issued from nfxsh).'
Jun 26 14:26:15 g5r204 : 0:0:spm:NOTICE: spm_ncmNodeEvent: Lost connect
for
Jun 26 14:26:15 g5r204 : 0:0:spm:NOTICE: spm_ncmNodeEvent:  disconnected
Jun 26 14:26:15 g5r204 pm: pm_terminate: child 992
(/onstor/bin/crashsaved) terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 990 (/onstor/bin/sscccc)
terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 987 (/onstor/bin/asd)
terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 986 (/onstor/bin/snmpd)
terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 985
(/onstor/bin/cluster_relay) terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 981 (/onstor/bin/sanmd)
terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 979 (/onstor/bin/vtmd)
terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 978 (/onstor/bin/vsd)
terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 967
(/onstor/bin/auth-agent) terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 966
(/onstor/bin/ndmp_cfgd) terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: forcibly terminating child 965
(/onstor/bin/tape-driver)
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 963 (/onstor/bin/ipmd)
terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 962 (/onstor/bin/spm)
terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 961 (/onstor/bin/ea)
terminated
Jun 26 14:26:16 g5r204 pm: pm_terminate: child 960
(/onstor/bin/evm_cfgd) terminated
Jun 26 14:26:17 g5r204 pm: pm_terminate: child 959
(/onstor/bin/sdm_cfgd) terminated
Jun 26 14:26:17 g5r204 pm: pm_terminate: child 956
(/onstor/bin/cluster_server) terminated
Jun 26 14:26:17 g5r204 pm: pm_terminate: child 955
(/onstor/bin/chassisd) terminated
Jun 26 14:26:17 g5r204 pm: pm_terminate: child 954
(/onstor/bin/timekeeper) terminated
Jun 26 14:26:17 g5r204 pm: pm_terminate: child 953 (/onstor/bin/eventd)
terminated
Jun 26 14:26:17 g5r204 pm: pm_terminate: child 945 (/onstor/bin/ncmd)
terminated
Jun 26 14:26:18 g5r204 pm: pm_terminate: child 932 (/onstor/bin/elog)
terminated
Jun 26 14:29:10 g5r204 pm: /onstor/bin/elog: finished initialization.
Jun 26 14:29:10 g5r204 : 0:0:cm:NOTICE: CHASSISD: Chassis Manager:
Started
Jun 26 14:29:11 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Port: fp1.0
State Up, Msg ''
Jun 26 14:29:11 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Port: fp1.1
State Up, Msg ''
Jun 26 14:29:11 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Port: fp1.2
State Down, Msg ''
Jun 26 14:29:12 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Port: fp1.3
State Down, Msg ''
Jun 26 14:29:12 g5r204 : 1:4:scsi:NOTICE: 9: ispfc: ispfc:sp2.1
Fibrechannel link now online
Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Port: sp2.1
State Up, Msg ''
Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT CPU: Slot 1,
CPU 0, State Up
Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT CPU: Slot 1,
CPU 1, State Up
Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT CPU: Slot 1,
CPU 2, State Up
Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT CPU: Slot 1,
CPU 3, State Up
Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT CPU: Slot 1,
CPU 4, State Up
Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT CPU: Slot 1,
CPU 5, State Up
Jun 26 14:29:17 g5r204 : 0:0:cluster2:NOTICE: Using 10.2.204.5 as my
primary address
Jun 26 14:29:17 g5r204 : 0:0:cluster2:NOTICE: ubik init with buff size
64
Jun 26 14:29:17 g5r204 : 0:0:eventd:WARNING: Process-EVENT 0.0.0.0: Mgmt
Port 0.0.0.0 PCC, State Up
Jun 26 14:29:20 g5r204 : 0:0:cluster2:WARNING: ClusterCtrl_iUpdateState:
PCC down pccname g5r204
Jun 26 14:29:20 g5r204 : 0:0:eventd:WARNING: Process-EVENT 0.0.0.0: Mgmt
Port 0.0.0.0 PCC, State Up
Jun 26 14:29:23 g5r204 : 0:0:ea:NOTICE: ea_rcvRmcMsg: NCM session open
failed
Jun 26 14:29:24 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg:
LUN[ONStor_0a50a1_0a4f7100480d333d4514000000] volId[0x770000001dd]
startBlk[0] numBlks[58595200]
Jun 26 14:29:25 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'g5r204-t1-vol2', Id 0x00000770000001dd, Event 'Create', State 'Down'
Jun 26 14:29:25 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg:
LUN[ONStor_0a50a1_0a4f7100480d333d4520000000] volId[0x770000001df]
startBlk[0] numBlks[58595200]
Jun 26 14:29:25 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg:
LUN[ONStor_0a50a1_0a4f7100480d333d4501000000] volId[0x770000001e1]
startBlk[0] numBlks[58595200]
Jun 26 14:29:25 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'g5r204-t1-vol4', Id 0x00000770000001df, Event 'Create', State 'Down'
Jun 26 14:29:25 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg:
LUN[ONStor_0a50a1_0a4f7100480d333d4507000000] volId[0x770000001de]
startBlk[0] numBlks[58595200]
Jun 26 14:29:25 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg:
LUN[ONStor_0a50a1_0a4f7100480d333d4509000000] volId[0x770000001e0]
startBlk[0] numBlks[58595200]
Jun 26 14:29:25 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'g5r204-t1-vol6', Id 0x00000770000001e1, Event 'Create', State 'Down'
Jun 26 14:29:25 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg:
LUN[ONStor_0a50a1_0a4f7100480d333d4513000000] volId[0x770000001db]
startBlk[0] numBlks[58595200]
Jun 26 14:29:25 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'g5r204-t1-vol3', Id 0x00000770000001de, Event 'Create', State 'Down'
Jun 26 14:29:25 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg:
LUN[ONStor_0a50a1_0a4f7100480d333d450b000000] volId[0x770000001c8]
startBlk[0] numBlks[58595200]
Jun 26 14:29:25 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'g5r204-t1-vol5', Id 0x00000770000001e0, Event 'Create', State 'Down'
Jun 26 14:29:25 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name
'dtest_v1', Id 0x00000770000001db, Event 'Create', State 'Down'

_____________________________________________
From: Vikas Saini 
Sent: Thursday, June 26, 2008 2:08 PM
To: Damon Wong
Subject: FW: 

Can you do some AT on this. Just some IO, nfsperftest, dd 

Thanks
Vikas


_____________________________________________
From: Larry Scheer 
Sent: Thursday, June 26, 2008 1:17 PM
To: Vikas Saini; Raj Kumar
Cc: Andy Sharp; Sandrine Boulanger
Subject: 

Vikas, Raj,
    As requested by Andy the nightly build from Thursday AM is
available.
 
Top of Tree change list is:
Change 29844 on 2008/06/25 by billn@billn-dev 'Protection code added to
make s'

Source tree
		/n/Build-Trees/Nightly/R4.0.0.0-062608/nfx-tree
		/n/Build-Trees/Nightly/R4.0.0.0-062608/linux

Distribution images to use with system upgrade:

R3.3.0.0 images are here:
Cheetah optimized:
http://10.2.0.21/upgrade/NIGHTLY/R3.3.0.0-062608.tar.gz
<http://10.2.0.21/upgrade/R3.3.0.0-052008.tar.gz> 
Cheetah debug:
http://10.2.0.21/upgrade/NIGHTLY/R3.3.0.0DBG-062608.tar.gz
<http://10.2.0.21/upgrade/R3.3.0.0DBG-052008.tar.gz> 

Bobcat optimized:
http://10.2.0.21/upgrade/NIGHTLY/R3.3.0.0BC-062608.tar.gz
<http://10.2.0.21/upgrade/R3.3.0.0BC-051308.tar.gz> 
Bobcat debug:
http://10.2.0.21/upgrade/NIGHTLY/R3.3.0.0BCDBG-062608.tar.gz
<http://10.2.0.21/upgrade/R3.3.0.0BCDBG-042908.tar.gz> 

R4.0.0.0 images are here
Cougar debug:
http://10.2.0.21/upgrade/NIGHTLY/R4.0.0.0CGDBG-062608.tar.gz
<http://10.2.0.21/upgrade/R4.0.0.0CGDBG-042908.tar.gz> 
Cougar optimized:
http://10.2.0.21/upgrade/NIGHTLY/R4.0.0.0CG-062608.tar.gz
<http://10.2.0.21/upgrade/R4.0.0.0CG-051308.tar.gz> 


Larry


--MP_EHyGskJHZqB.F6XOrnaWbnK
Content-Type: text/html
Content-Transfer-Encoding: 7bit

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=us-ascii">
<META NAME="Generator" CONTENT="MS Exchange Server version 6.5.7652.24">
<TITLE>I hit fs_abort while deleting a volume on this nightly build (0626).</TITLE>
</HEAD>
<BODY>
<!-- Converted from text/rtf format -->

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">I hit fs_abort while deleting a volume on this nightly build.</FONT></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Similar to 24376 but I hit it while creating the volume, not deleting the volume.</FONT></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Damon</FONT></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B><FONT COLOR="#000080" SIZE=2 FACE="Arial">Core_dump:</FONT></B></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B></B></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">ONStor Core Analysis Tool version v2.1.0</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Core location: /n/users/dwong/private/scripts/1.2</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Core platform: CG</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Core type: FP</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Core version: R4.0.0.0CGDBG-061408</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Boot time: Thu Jun 26 14:21:18 2008</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Crash time: Thu Jun 26 14:23:35 2008</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Image location: /n/build-trees/R4.0.0.0/R4.0.0.0-061408-sub26/nfx-tree/Build/cg/dbg/Images/fp_cg</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">===BEGIN STACK TRACE===</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">#0&nbsp; fs_abort () at fs-err.c:1141</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">#1&nbsp; 0x831d9128 in fs_owner_mount (context=0x102059d458, buf=0x400d5f8280) at fs-owner.c:322</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">#2&nbsp; 0x831d9cbc in fs_owner_check_mount (context=0x102059d458) at fs-owner.c:625</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">#3&nbsp; 0x831da530 in fs_owner_start (context=0x102059d458) at fs-owner.c:859</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">#4&nbsp; 0x831a7fe0 in fs_doMount (context=0x102059d458, req=0x101c8c4320) at fs-mount.c:2479</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">#5&nbsp; 0x831ac088 in fs_mountThread (context=0x102059d458) at fs-mount.c:3601</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">#6&nbsp; 0x830c6f88 in fs_threadBegin (handle=0, arg=0x0) at fs-context.c:2950</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">===END STACK TRACE===</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">[root@c15r18-rhel4 scripts]#</FONT></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B><FONT COLOR="#000080" SIZE=2 FACE="Arial">/var/log/</FONT></B></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B><FONT COLOR="#000080" SIZE=2 FACE="Arial">Onstor</FONT></B></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B><FONT COLOR="#000080" SIZE=2 FACE="Arial">/messages:</FONT></B></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B></B></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:23 g5r204 : 0:0:(null):NOTICE: 'root' logged in through remote host(10.2.18.15)</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:24 g5r204 : 0:0:nfxsh:NOTICE: cmd[0]: system show nodename : status[0]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:25 g5r204 : 0:0:nfxsh:NOTICE: cmd[1]: volume show&nbsp; : status[0]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:25 g5r204 : 0:0:nfxsh:NOTICE: cmd[2]: vsvr set G5R204-T1 : status[0]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:25 g5r204 : 0:0:ea:ERROR: ea_delFsysProc[2590]: Volume[g5r204-t1-vol2] is in Mounting state. Operation not allowed.</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:25 g5r204 : 0:0:nfxsh:NOTICE: cmd[3]: volume delete g5r204-t1-vol2 : status[11]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:25 g5r204 : 0:0:nfxsh:NOTICE: cmd[4]: system show nodename : status[0]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:25 g5r204 : 0:0:nfxsh:NOTICE: cmd[5]: lun show disk -t free : status[0]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:26 g5r204 : 0:0:nfxsh:NOTICE: cmd[4]: vsvr id 2 : status[0]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:35 g5r204 : 1:5:efs:ERROR: 81: fs_abort</FONT></B></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:eventd:WARNING: Process-EVENT CPU: Slot 1, CPU 0, State Down</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:eventd:WARNING: Process-EVENT CPU: Slot 1, CPU 1, State Down</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:vtm:NOTICE: Vtm_ProcEvntMsg: NFX_EVENT_CPU, state 2, slot 1, cpu 0</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:eventd:WARNING: Process-EVENT CPU: Slot 1, CPU 2, State Down</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:eventd:WARNING: Process-EVENT CPU: Slot 1, CPU 3, State Down</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:eventd:WARNING: Process-EVENT CPU: Slot 1, CPU 4, State Down</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:eventd:WARNING: Process-EVENT CPU: Slot 1, CPU 5, State Down</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:sanm:ERROR: SANM: FP NIM down. Aborting all mirror sessions.</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:sanm:ERROR: SANM: FP NIM down. Aborting all mirror sessions.</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:vtm:NOTICE: Vtm_ProcEvntMsg: NFX_EVENT_CPU, state 2, slot 1, cpu 1</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:vtm:NOTICE: Vtm_ProcEvntMsg: NFX_EVENT_CPU, state 2, slot 1, cpu 2</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:vtm:NOTICE: Vtm_ProcEvntMsg: NFX_EVENT_CPU, state 2, slot 1, cpu 3</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:vtm:NOTICE: Vtm_ProcEvntMsg: NFX_EVENT_CPU, state 2, slot 1, cpu 4</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:38 g5r204 : 0:0:vtm:NOTICE: Vtm_ProcEvntMsg: NFX_EVENT_CPU, state 2, slot 1, cpu 5</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'g5r204-t1-vol2', Id 0x00000770000001dd, Event 'Offline', State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'g5r204-t1-vol4', Id 0x00000770000001df, Event 'Offline', State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'g5r204-t1-vol5', Id 0x00000770000001e0, Event 'Offline', State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'g5r204-t1-vol3', Id 0x00000770000001de, Event 'Offline', State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'g5r204-t1-vol6', Id 0x00000770000001e1, Event 'Offline', State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'vol_mgmt_1904', Id 0x000007700000017d, Event 'Offline', State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'g5r204-t1-vol1', Id 0x00000770000001dc, Event 'Offline', State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT IP i/f: IP 192.167.1.1, Port bp0, State Remove</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:39 g5r204 : 0:0:eventd:WARNING: Process-EVENT Vsvr: Virtual server 'VS_MGMT_1904', Id 1, State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:39 g5r204 : 0:0:eventd:NOTICE: Process-EVENT IP i/f: IP 192.167.2.1, Port bp0, State Remove</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:39 g5r204 : 0:0:eventd:WARNING: Process-EVENT Vsvr: Virtual server 'G5R204-T1', Id 2, State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:42 g5r204 : 0:0:vtm:ERROR: vtm_gatherInfo_proc: gather info failed for request from g5r204</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:43 g5r204 : 0:0:vtm:ERROR: vtm_failover_vsvr_proc: no alternative filer found for vs 2 failover</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:43 g5r204 : 0:0:vtm:ERROR: vtm_failover_vsvr_proc: no alternative filer found for vs 3 failover</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:23:49 g5r204 : 0:0:nfxsh:NOTICE: cmd[5]: system show chassis : status[0]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:24:03 g5r204 : 0:0:nfxsh:NOTICE: cmd[0]: -&gt; EMRS: Not gathering h_res_stats: not all processors are up. : status[2]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:24:16 g5r204 : 0:0:(null):NOTICE: 'root' logged in through remote host(10.0.0.233)</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:15 g5r204 : 0:0:eventd:CRITICAL: Process-EVENT Node: Name 'local', State Down, Msg 'Node going down for reboot! ('system reboot' issued from nfxsh).'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:15 g5r204 : 0:0:spm:NOTICE: spm_ncmNodeEvent: Lost connect for</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:15 g5r204 : 0:0:spm:NOTICE: spm_ncmNodeEvent:&nbsp; disconnected</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:15 g5r204 pm: pm_terminate: child 992 (/onstor/bin/crashsaved) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 990 (/onstor/bin/sscccc) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 987 (/onstor/bin/asd) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 986 (/onstor/bin/snmpd) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 985 (/onstor/bin/cluster_relay) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 981 (/onstor/bin/sanmd) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 979 (/onstor/bin/vtmd) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 978 (/onstor/bin/vsd) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 967 (/onstor/bin/auth-agent) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 966 (/onstor/bin/ndmp_cfgd) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: forcibly terminating child 965 (/onstor/bin/tape-driver)</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 963 (/onstor/bin/ipmd) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 962 (/onstor/bin/spm) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 961 (/onstor/bin/ea) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:16 g5r204 pm: pm_terminate: child 960 (/onstor/bin/evm_cfgd) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:17 g5r204 pm: pm_terminate: child 959 (/onstor/bin/sdm_cfgd) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:17 g5r204 pm: pm_terminate: child 956 (/onstor/bin/cluster_server) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:17 g5r204 pm: pm_terminate: child 955 (/onstor/bin/chassisd) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:17 g5r204 pm: pm_terminate: child 954 (/onstor/bin/timekeeper) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:17 g5r204 pm: pm_terminate: child 953 (/onstor/bin/eventd) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:17 g5r204 pm: pm_terminate: child 945 (/onstor/bin/ncmd) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:26:18 g5r204 pm: pm_terminate: child 932 (/onstor/bin/elog) terminated</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:10 g5r204 pm: /onstor/bin/elog: finished initialization.</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:10 g5r204 : 0:0:cm:NOTICE: CHASSISD: Chassis Manager: Started</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:11 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Port: fp1.0 State Up, Msg ''</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:11 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Port: fp1.1 State Up, Msg ''</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:11 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Port: fp1.2 State Down, Msg ''</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:12 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Port: fp1.3 State Down, Msg ''</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:12 g5r204 : 1:4:scsi:NOTICE: 9: ispfc: ispfc:sp2.1 Fibrechannel link now online</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Port: sp2.1 State Up, Msg ''</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT CPU: Slot 1, CPU 0, State Up</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT CPU: Slot 1, CPU 1, State Up</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT CPU: Slot 1, CPU 2, State Up</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT CPU: Slot 1, CPU 3, State Up</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT CPU: Slot 1, CPU 4, State Up</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:13 g5r204 : 0:0:eventd:NOTICE: Process-EVENT CPU: Slot 1, CPU 5, State Up</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:17 g5r204 : 0:0:cluster2:NOTICE: Using 10.2.204.5 as my primary address</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:17 g5r204 : 0:0:cluster2:NOTICE: ubik init with buff size 64</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:17 g5r204 : 0:0:eventd:WARNING: Process-EVENT 0.0.0.0: Mgmt Port 0.0.0.0 PCC, State Up</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:20 g5r204 : 0:0:cluster2:WARNING: ClusterCtrl_iUpdateState: PCC down pccname g5r204</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:20 g5r204 : 0:0:eventd:WARNING: Process-EVENT 0.0.0.0: Mgmt Port 0.0.0.0 PCC, State Up</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:23 g5r204 : 0:0:ea:NOTICE: ea_rcvRmcMsg: NCM session open failed</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:24 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg: LUN[ONStor_0a50a1_0a4f7100480d333d4514000000] volId[0x770000001dd] startBlk[0] numBlks[58595200]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:25 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'g5r204-t1-vol2', Id 0x00000770000001dd, Event 'Create', State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:25 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg: LUN[ONStor_0a50a1_0a4f7100480d333d4520000000] volId[0x770000001df] startBlk[0] numBlks[58595200]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:25 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg: LUN[ONStor_0a50a1_0a4f7100480d333d4501000000] volId[0x770000001e1] startBlk[0] numBlks[58595200]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:25 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'g5r204-t1-vol4', Id 0x00000770000001df, Event 'Create', State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:25 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg: LUN[ONStor_0a50a1_0a4f7100480d333d4507000000] volId[0x770000001de] startBlk[0] numBlks[58595200]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:25 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg: LUN[ONStor_0a50a1_0a4f7100480d333d4509000000] volId[0x770000001e0] startBlk[0] numBlks[58595200]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:25 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'g5r204-t1-vol6', Id 0x00000770000001e1, Event 'Create', State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:25 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg: LUN[ONStor_0a50a1_0a4f7100480d333d4513000000] volId[0x770000001db] startBlk[0] numBlks[58595200]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:25 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'g5r204-t1-vol3', Id 0x00000770000001de, Event 'Create', State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:25 g5r204 : 0:0:evm:NOTICE: evm_procOdCfg: LUN[ONStor_0a50a1_0a4f7100480d333d450b000000] volId[0x770000001c8] startBlk[0] numBlks[58595200]</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:25 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'g5r204-t1-vol5', Id 0x00000770000001e0, Event 'Create', State 'Down'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Jun 26 14:29:25 g5r204 : 0:0:eventd:NOTICE: Process-EVENT Volume: name 'dtest_v1', Id 0x00000770000001db, Event 'Create', State 'Down'</FONT></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma">_____________________________________________<BR>
</FONT></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B></B></SPAN><B><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma">From:</FONT></SPAN></B><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma"> Vikas Saini<BR>
</FONT></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B></B></SPAN><B><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma">Sent:</FONT></SPAN></B><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma"></FONT> <FONT SIZE=2 FACE="Tahoma">Thursday, June 26, 2008 2:08 PM<BR>
</FONT></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B></B></SPAN><B><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma">To:</FONT></SPAN></B><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma"> Damon Wong<BR>
</FONT></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B></B></SPAN><B><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma">Subject:</FONT></SPAN></B><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma"> FW:</FONT></SPAN><SPAN LANG="en-us"> </SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Can you do some AT on this. Just some IO, nfsperftest, dd </FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Thanks</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT COLOR="#000080" SIZE=2 FACE="Arial">Vikas</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma">_____________________________________________<BR>
</FONT></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B><FONT SIZE=2 FACE="Tahoma">From:</FONT></B></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma"> Larry Scheer<BR>
</FONT></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B><FONT SIZE=2 FACE="Tahoma">Sent:</FONT></B></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma"> Thursday, June 26, 2008 1:17 PM<BR>
</FONT></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B><FONT SIZE=2 FACE="Tahoma">To:</FONT></B></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma"> Vikas Saini; Raj Kumar<BR>
</FONT></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B><FONT SIZE=2 FACE="Tahoma">Cc:</FONT></B></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma"> Andy Sharp; Sandrine Boulanger<BR>
</FONT></SPAN><SPAN LANG="en-us"><B></B></SPAN><SPAN LANG="en-us"><B><FONT SIZE=2 FACE="Tahoma">Subject:</FONT></B></SPAN><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Tahoma"></FONT></SPAN><SPAN LANG="en-us"> </SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Arial">Vikas, Raj,</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Arial">&nbsp;&nbsp;&nbsp; As requested by Andy the nightly build from Thursday AM is available.</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Arial">&nbsp;</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Arial">Top of Tree change list is:</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Arial">Change 29844 on 2008/06/25 by billn@billn-dev 'Protection code added to make s'</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Arial">Source tree</FONT></SPAN></P>
<UL DIR=LTR><UL DIR=LTR>
<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Arial">/n/Build-Trees/Nightly/R4.0.0.0-062608/nfx-tree</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Arial">/n/Build-Trees/Nightly/R4.0.0.0-062608/linux</FONT></SPAN></P>
</UL></UL>
<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Arial">Distribution images to use with system upgrade:</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Courier New">R3.3.0.0 images are here:</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Courier New">Cheetah optimized:</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><A HREF="http://10.2.0.21/upgrade/R3.3.0.0-052008.tar.gz"><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><U><FONT COLOR="#0000FF" SIZE=2 FACE="Courier New">http://10.2.0.21/upgrade/NIGHTLY/R3.3.0.0-062608.tar.gz</FONT></U></SPAN><SPAN LANG="en-us"></SPAN></A><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Courier New">Cheetah debug:</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><A HREF="http://10.2.0.21/upgrade/R3.3.0.0DBG-052008.tar.gz"><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><U><FONT COLOR="#0000FF" SIZE=2 FACE="Courier New">http://10.2.0.21/upgrade/NIGHTLY/R3.3.0.0DBG-062608.tar.gz</FONT></U></SPAN><SPAN LANG="en-us"></SPAN></A><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Courier New">Bobcat optimized:</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><A HREF="http://10.2.0.21/upgrade/R3.3.0.0BC-051308.tar.gz"><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><U><FONT COLOR="#0000FF" SIZE=2 FACE="Courier New">http://10.2.0.21/upgrade/NIGHTLY/R3.3.0.0BC-062608.tar.gz</FONT></U></SPAN><SPAN LANG="en-us"></SPAN></A><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Courier New">Bobcat debug:</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><A HREF="http://10.2.0.21/upgrade/R3.3.0.0BCDBG-042908.tar.gz"><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><U><FONT COLOR="#0000FF" SIZE=2 FACE="Courier New">http://10.2.0.21/upgrade/NIGHTLY/R3.3.0.0BCDBG-062608.tar.gz</FONT></U></SPAN><SPAN LANG="en-us"></SPAN></A><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Courier New">R4.0.0.0 images are here</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Courier New">Cougar debug:</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><A HREF="http://10.2.0.21/upgrade/R4.0.0.0CGDBG-042908.tar.gz"><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><U><FONT COLOR="#0000FF" SIZE=2 FACE="Courier New">http://10.2.0.21/upgrade/NIGHTLY/R4.0.0.0CGDBG-062608.tar.gz</FONT></U></SPAN><SPAN LANG="en-us"></SPAN></A><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><U></U></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><FONT SIZE=2 FACE="Courier New">Cougar optimized:</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><A HREF="http://10.2.0.21/upgrade/R4.0.0.0CG-051308.tar.gz"><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><U><FONT COLOR="#0000FF" SIZE=2 FACE="Courier New">http://10.2.0.21/upgrade/NIGHTLY/R4.0.0.0CG-062608.tar.gz</FONT></U></SPAN><SPAN LANG="en-us"></SPAN></A><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"><U></U></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"><FONT SIZE=2 FACE="Arial">Larry</FONT></SPAN></P>

<P DIR=LTR><SPAN LANG="en-us"></SPAN><SPAN LANG="en-us"></SPAN></P>

</BODY>
</HTML>

--MP_EHyGskJHZqB.F6XOrnaWbnK--
