X-MimeOLE: Produced By Microsoft Exchange V6.5
Received: by onstor-exch02.onstor.net 
	id <01C71FFF.6A363BDB@onstor-exch02.onstor.net>; Thu, 14 Dec 2006 20:13:46 -0800
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----_=_NextPart_001_01C71FFF.6A363BDB"
Content-class: urn:content-classes:message
Subject: RE: Updates
Date: Thu, 14 Dec 2006 20:11:28 -0800
Message-ID: <BB375AF679D4A34E9CA8DFA650E2B04E013D277B@onstor-exch02.onstor.net>
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
Thread-Topic: Updates
thread-index: Acce+b3Mfy+xIPS2TRi4/4armFj97QAAFnpQAAA/8cAAAA8pAAAAMVEwAAtKwPAAAB7EkAAAXasgAAF+nMAAG+bGsAAAEIdhABPlQMAAA51kuQ==
References: <BB375AF679D4A34E9CA8DFA650E2B04E0A942E@onstor-exch02.onstor.net>
From: "Paul Hammer" <paul.hammer@onstor.com>
To: "Larry Scheer" <larry.scheer@onstor.com>,
	"Eric Barrett" <eric.barrett@onstor.com>,
	"Tim Gardner" <tim.gardner@onstor.com>,
	"Sandrine Boulanger" <sandrine.boulanger@onstor.com>,
	"Ed Kwan" <ed.kwan@onstor.com>,
	"Charissa Willard" <charissa.willard@onstor.com>
Cc: "Kevin Matthews" <kevin.matthews@onstor.com>,
	"Brian Baker" <brian.baker@onstor.com>,
	"Vikas Saini" <vikas.saini@onstor.com>,
	"dl-Clio" <dl-Clio@onstor.com>

This is a multi-part message in MIME format.

------_=_NextPart_001_01C71FFF.6A363BDB
Content-Type: text/plain;
	charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

Good progress. Hard to explain why these files, since this seems to be =
the same problem in the field with the same manifestation, that would =
seem to rule out the flash. Curious where these files are located in the =
installation package, are they near the end of the BOM?

________________________________

From: Larry Scheer
Sent: Thu 12/14/2006 7:44 PM
To: Paul Hammer; Eric Barrett; Tim Gardner; Sandrine Boulanger; Ed Kwan; =
Charissa Willard
Cc: Kevin Matthews; Brian Baker; Vikas Saini; dl-Clio
Subject: RE: Updates



I spent some time investigating the upgrade problems that occurred on =
dogfood. Of the list of filer reported previously these files had =
problems:

/usr/local/agile/lib/libucdagent.so
/usr/local/agile/lib/libucdmibs.so

/usr/local/agile/web/js/console/login.js=20

/usr/local/agile/web/js/console/view.js
/usr/local/agile/web/js/domain/util.js=20



I found that although their file size was the same, their check sums did =
not match the source files stored in the compressed tar file used for =
the release distribution.

=20

Examining the contents of the files I found that the files were =
corrupted. They were not copies of the files from a previous release but =
were versions of the files for 2.1.0.0 with either nulls or somewhat =
random bits stored in the file. The files were unpacked by the upgrade =
program from the source distribution and stored on the compact flash =
incorrectly.

=20

I was able to replace these files with copies from the source =
distribution without any problems. After copying good sources to the =
same files on the compact flash their check sums verified. I modified =
the pmtab to start snmpd and rebooted dogfood. The system is running and =
snmpd is staying up.

=20

Although I was unable to determine the root cause, the most likely =
reason for this type of problem is a degrading compact flash. I =
recommended to Brian and Kevin to replace this flash at their earliest =
convenience. After talking to Andy Sharp and Tim I ruled out network and =
memory problems as a cause. If memory was an issue the system would have =
been failing in other more obvious ways. If the network were an issue =
the entire upgrade would have failed in a more obvious manner.

=20

I will add this information to the bug report.

=20

Larry

=20

________________________________

From: Paul Hammer=20
Sent: Thursday, December 14, 2006 8:58 AM
To: Eric Barrett; Tim Gardner; Sandrine Boulanger; Ed Kwan; Charissa =
Willard
Cc: Kevin Matthews; Brian Baker; Vikas Saini; dl-Clio
Subject: RE: Updates

=20

Can we run the tests some place other than on MD?

=20

________________________________

From: Eric Barrett
Sent: Thu 12/14/2006 8:57 AM
To: Tim Gardner; Sandrine Boulanger; Ed Kwan; Charissa Willard; Paul =
Hammer
Cc: Kevin Matthews; Brian Baker; Vikas Saini; dl-Clio
Subject: RE: Updates

I would also suggest comparison to mktg3 -- it's the other node in the =
cluster.  It was not affected by the snmp issue despite also being =
upgraded to Clio.

=20

_____________________________________________=20
From:   Tim Gardner =20
Sent:   Wednesday, December 13, 2006 7:43 PM=20
To:     Sandrine Boulanger; Ed Kwan; Charissa Willard; Paul Hammer=20
Cc:     Kevin Matthews; Brian Baker; Eric Barrett; Vikas Saini; dl-Clio=20
Subject:        RE: Updates=20

/mnt/usr/local/agile/lib/libucdagent.so=20
/mnt/usr/local/agile/lib/libucdmibs.so=20

These files are both used by snmp. We suspect that they may be the cause =
of the snmp problem.=20
We need to do another upgrade to dogfood. But prior to the upgrade, we =
should reinstall just the libraries=20
that have checksum differences and try to start snmp to verify that the =
libraries are the cause of the problem.=20

The next issue will be to try to understand why system upgrade either =
munged the libraries or simply=20
failed to upgrade them. Before overwriting them we should see if their =
checksums match the checksums=20
of the libraries from the previous release that was on dogfood.=20

=20

_____________________________________________
From: Sandrine Boulanger
Sent: Wednesday, December 13, 2006 6:56 PM
To: Sandrine Boulanger; Ed Kwan; Charissa Willard; Paul Hammer
Cc: Kevin Matthews; Brian Baker; Eric Barrett; Vikas Saini; dl-Clio
Subject: RE: Updates=20

I copied the upgrade log (which was on the other flash), to =
~sandrineb/traces/sys_upgrade.log. It looks like those files were =
supposed to be upgraded and they did, check the Installing part. I don't =
know why the checksum would not match then...

_____________________________________________
From: Sandrine Boulanger
Sent: Wednesday, December 13, 2006 6:46 PM
To: Ed Kwan; Charissa Willard; Paul Hammer
Cc: Kevin Matthews; Brian Baker; Eric Barrett; Vikas Saini; dl-Clio
Subject: RE: Updates=20

I ran a system compare, here are the results. We should get the system =
upgrade log file on Dogfood.=20

The following files are different:=20
/mnt/etc/newsyslog.conf =3D> normal, always different=20
/mnt/usr/local/agile/lib/libucdagent.so=20
/mnt/usr/local/agile/lib/libucdmibs.so=20
/mnt/usr/local/agile/etc/pmtab =3D> scary, did someone modified that =
one?=20
/mnt/usr/local/agile/web/js/console/login.js=20
/mnt/usr/local/agile/web/js/console/view.js=20
/mnt/usr/local/agile/web/js/domain/util.js=20
/mnt/var/log/sendmail.st=20
/mnt/version =3D> normal, always different=20
Dogfood diag>=20

_____________________________________________
From: Ed Kwan
Sent: Wednesday, December 13, 2006 6:44 PM
To: Charissa Willard; Paul Hammer
Cc: Kevin Matthews; Brian Baker; Eric Barrett; Vikas Saini; dl-Clio
Subject: RE: Updates=20

Checksums of some libraries on dogfood don't match the release, e.g.=20

Dogfood# cksum libucdmibs.so=20
2089852042 3278706 libucdmibs.so=20

[edk@edk-linux lib]$ pwd=20
/n/build-trees/R2.1.0.0/R2.1.0.0-120906/nfx-tree/Build/ch/opt/lib=20
[edk@edk-linux lib]$ cksum  libucdmibs.so=20
4212168562 3278706 libucdmibs.so=20

Sandrine is running a "system compare" on dogfood.=20

_____________________________________________
From: Charissa Willard
Sent: Wednesday, December 13, 2006 1:20 PM
To: Paul Hammer
Cc: Kevin Matthews; Brian Baker; Ed Kwan; Eric Barrett; Vikas Saini; =
dl-Clio
Subject: RE: Updates=20

Paul,=20

Ed's been looking into 16471 on MD. We still haven't been able to get a =
stack trace.=20

-Charissa=20

=20

=3D=3D=3D=3D=3D State: Assigned by:edk at 12/12/2006 7:01:15 PM =
=3D=3D=3D=3D=3D

Ran the unstripped version of snmpd in gdb on dogfood, and still didn't =
get a good stack trace:

(gdb) bt
#0 0x5ffe31a0 in ?? ()
warning: Hit heuristic-fence-post without finding
warning: enclosing function for address 0x5ffe46c0

I set breakpoints at main, __main, __start and __init, and snmpd got =
SIGSEGV before hitting the break points.

Ran "readelf snmpd" on my Linux box, and the executable instructions in =
snmpd don't map to the pc (0x5ffe31a0).
There are 15 shared libraries used by snmpd, but gdb says they are not =
even loaded at the time:

(gdb) info sharedlibrary
No shared libraries loaded at this time.

I played with ldd and the "LD_TRACE_LOADED_OBJECTS" environment =
variables, but I can't get any useful info.

May need to compile all the libraries with "-g" and load them on =
dogfood...=20

_____________________________________________
From: Paul Hammer
Sent: Wednesday, December 13, 2006 1:14 PM
To: Eric Barrett; Vikas Saini; dl-Clio
Cc: Kevin Matthews; Brian Baker
Subject: RE: Updates=20

This one should have been submitted separately against 2.1, need core =
Dev to have a look at this one in Clio. Agree that it looks similar to =
the one at Shopzilla, however the version at the customer did not core =
on MD nor did it leave a core file, appears now with 2.1 we have a core. =


_____________________________________________
From: Eric Barrett
Sent: Wednesday, December 13, 2006 1:10 PM
To: Vikas Saini; Paul Hammer; dl-Clio
Cc: Kevin Matthews; Brian Baker
Subject: RE: Updates=20

snmpd issue is already filed as 16471.=20

=20

_____________________________________________=20
From:   Vikas Saini =20
Sent:   Wednesday, December 13, 2006 1:08 PM=20
To:     Paul Hammer; dl-Clio=20
Cc:     Eric Barrett; Kevin Matthews; Brian Baker=20
Subject:        RE: Updates=20
Importance:     High=20

Clio is going fine. First regression is complete. Second regression pass =
is going on and should be complete soon. Just sent the Clio Soak =
status..

There are still 2 defects in Dev court that needs resolution.=20

QA has verified all the defects which were targeted for Clio. Right now =
we are verifying the defects which were not targeted for Clio but got =
resolved in Clio.

I haven't seen any defect on snmpd issue. will file one soon. Yes that =
should be resolved.=20

Thanks=20
Vikas=20

=20

_____________________________________________
From: Paul Hammer
Sent: Wednesday, December 13, 2006 1:01 PM
To: dl-Clio
Cc: Eric Barrett; Kevin Matthews; Brian Baker
Subject: Updates=20

Any updates on Clio status?=20

Soak Updates? Uptime numbers=20

Number of defects in Dev that we need to address still in Clio?=20

Defects in QA that we need to resolve?=20

I have not seen any update on the Defect found with SNMP on MD, assume =
this is MF for Clio too.=20

-Paul=20

=20


------_=_NextPart_001_01C71FFF.6A363BDB
Content-Type: text/html;
	charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<HTML dir=3Dltr><HEAD><TITLE>RE: Updates</TITLE>=0A=
<META http-equiv=3DContent-Type content=3D"text/html; charset=3Dunicode">=0A=
<META content=3D"MSHTML 6.00.2900.2995" name=3DGENERATOR>=0A=
<STYLE>=0A=
<!--=0A=
                       =0A=
 font-face=0A=
	{font-family:Tahoma;}=0A=
                        =0A=
 p.MsoNormal, li.MsoNormal, div.MsoNormal=0A=
	{margin:0in;=0A=
	margin-bottom:.0001pt;=0A=
	font-size:12.0pt;=0A=
	font-family:"Times New Roman";}=0A=
a:link, span.MsoHyperlink=0A=
	{color:blue;=0A=
	text-decoration:underline;}=0A=
a:visited, span.MsoHyperlinkFollowed=0A=
	{color:navy;=0A=
	text-decoration:underline;}=0A=
p=0A=
	{=0A=
	margin-right:0in;=0A=
	margin-left:0in;=0A=
	font-size:12.0pt;=0A=
	font-family:"Times New Roman";}=0A=
span.EmailStyle18=0A=
	{=0A=
	font-family:Arial;=0A=
	color:navy;}=0A=
=0A=
div.Section1=0A=
	{page:Section1;}=0A=
-->=0A=
</STYLE>=0A=
</HEAD>=0A=
<BODY lang=3DEN-US vLink=3Dnavy link=3Dblue>=0A=
<DIV id=3DidOWAReplyText28800 dir=3Dltr>=0A=
<DIV dir=3Dltr><FONT face=3DArial color=3D#000000 size=3D2>Good =
progress. Hard to explain why these files, since this seems to be the =
same problem in the field with the same manifestation, that would seem =
to rule out the flash. Curious where these files are located in the =
installation package, are they near the end of the =
BOM?</FONT></DIV></DIV>=0A=
<DIV dir=3Dltr><BR>=0A=
<HR tabIndex=3D-1>=0A=
<FONT face=3DTahoma size=3D2><B>From:</B> Larry Scheer<BR><B>Sent:</B> =
Thu 12/14/2006 7:44 PM<BR><B>To:</B> Paul Hammer; Eric Barrett; Tim =
Gardner; Sandrine Boulanger; Ed Kwan; Charissa Willard<BR><B>Cc:</B> =
Kevin Matthews; Brian Baker; Vikas Saini; dl-Clio<BR><B>Subject:</B> RE: =
Updates<BR></FONT><BR></DIV>=0A=
<DIV>=0A=
<DIV class=3DSection1>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I spent some =
time investigating the upgrade problems that occurred on dogfood. Of the =
list of filer reported previously these files had =
problems:</SPAN></FONT></P>=0A=
<P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT face=3DArial =
color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; =
FONT-FAMILY: =
Arial">/usr/local/agile/lib/libucdagent.so</SPAN></FONT><BR><FONT =
face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
COLOR: navy; FONT-FAMILY: =
Arial">/usr/local/agile/lib/libucdmibs.so</SPAN></FONT></P>=0A=
<P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT face=3DArial =
color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; =
FONT-FAMILY: =
Arial">/usr/local/agile/web/js/console/login.js</SPAN></FONT> </P>=0A=
<P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT face=3DArial =
color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; =
FONT-FAMILY: =
Arial">/usr/local/agile/web/js/console/view.js</SPAN></FONT><BR><FONT =
face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
COLOR: navy; FONT-FAMILY: =
Arial">/usr/local/agile/web/js/domain/util.js</SPAN></FONT> =
<BR><BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"></SPAN></FONT></P>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I found that =
although their file size was the same, their check sums did not match =
the source files stored in the compressed tar file used for the release =
distribution.</SPAN></FONT></P>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"></SPAN></FONT>&nbsp;</P>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Examining the =
contents of the files I found that the files were corrupted. They were =
not copies of the files from a previous release but were versions of the =
files for 2.1.0.0 with either nulls or somewhat random bits stored in =
the file. The files were unpacked by the upgrade program from the source =
distribution and stored on the compact flash =
incorrectly.</SPAN></FONT></P>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"></SPAN></FONT>&nbsp;</P>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I was able to =
replace these files with copies from the source distribution without any =
problems. After copying good sources to the same files on the compact =
flash their check sums verified. I modified the pmtab to start snmpd and =
rebooted dogfood. The system is running and snmpd is staying =
up.</SPAN></FONT></P>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"></SPAN></FONT>&nbsp;</P>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Although I =
was unable to determine the root cause, the most likely reason for this =
type of problem is a degrading compact flash. I recommended to Brian and =
Kevin to replace this flash at their earliest convenience. After talking =
to Andy Sharp and Tim I ruled out network and memory problems as a =
cause. If memory was an issue the system would have been failing in =
other more obvious ways. If the network were an issue the entire upgrade =
would have failed in a more obvious manner.</SPAN></FONT></P>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"></SPAN></FONT>&nbsp;</P>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I will add =
this information to the bug report.</SPAN></FONT></P>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"></SPAN></FONT>&nbsp;</P>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">Larry</SPAN></FONT></P>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"></SPAN></FONT>&nbsp;</P>=0A=
<DIV>=0A=
<DIV class=3DMsoNormal style=3D"TEXT-ALIGN: center" align=3Dcenter><FONT =
face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: 12pt">=0A=
<HR tabIndex=3D-1 align=3Dcenter width=3D"100%" SIZE=3D2>=0A=
</SPAN></FONT></DIV>=0A=
<P class=3DMsoNormal><B><FONT face=3DTahoma size=3D2><SPAN =
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">From:</SPAN></FONT></B><FONT face=3DTahoma size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Tahoma"> Paul Hammer <BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Thursday, December 14, 2006 =
8:58 AM<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B> Eric =
Barrett; Tim Gardner; Sandrine Boulanger; Ed Kwan; Charissa =
Willard<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> Kevin =
Matthews; Brian Baker; Vikas Saini; dl-Clio<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: =
Updates</SPAN></FONT></P></DIV>=0A=
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN =
style=3D"FONT-SIZE: 12pt"></SPAN></FONT>&nbsp;</P>=0A=
<DIV id=3DidOWAReplyText63714>=0A=
<DIV>=0A=
<P class=3DMsoNormal><FONT face=3DArial color=3Dblack size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: black; FONT-FAMILY: Arial">Can we run =
the tests some place other than on MD?</SPAN></FONT></P></DIV></DIV>=0A=
<DIV>=0A=
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN =
style=3D"FONT-SIZE: 12pt"></SPAN></FONT>&nbsp;</P>=0A=
<DIV class=3DMsoNormal style=3D"TEXT-ALIGN: center" align=3Dcenter><FONT =
face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: 12pt">=0A=
<HR tabIndex=3D-1 align=3Dcenter width=3D"100%" SIZE=3D2>=0A=
</SPAN></FONT></DIV>=0A=
<P class=3DMsoNormal style=3D"MARGIN-BOTTOM: 12pt"><B><FONT =
face=3DTahoma size=3D2><SPAN style=3D"FONT-WEIGHT: bold; FONT-SIZE: =
10pt; FONT-FAMILY: Tahoma">From:</SPAN></FONT></B><FONT face=3DTahoma =
size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Tahoma"> Eric =
Barrett<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Thu =
12/14/2006 8:57 AM<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">To:</SPAN></B> Tim Gardner; Sandrine Boulanger; Ed Kwan; Charissa =
Willard; Paul Hammer<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Cc:</SPAN></B> Kevin Matthews; Brian Baker; Vikas Saini; =
dl-Clio<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: =
Updates</SPAN></FONT></P></DIV>=0A=
<DIV>=0A=
<P><FONT face=3DArial size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: Arial">I would also suggest comparison to mktg3 -- it's the =
other node in the cluster.&nbsp; It was not affected by the snmp issue =
despite also being upgraded to Clio.</SPAN></FONT></P>=0A=
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN =
style=3D"FONT-SIZE: 12pt"></SPAN></FONT>&nbsp;</P>=0A=
<P><FONT face=3DTahoma size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; =
FONT-FAMILY: Tahoma">_____________________________________________ =
</SPAN></FONT><BR><B><FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">From: =
&nbsp;</SPAN></FONT></B> <FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">Tim =
Gardner</SPAN></FONT><FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">&nbsp; =
</SPAN></FONT><BR><B><FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Sent:&nbsp;&nbsp;</SPAN></FONT></B> <FONT face=3DTahoma =
size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Wednesday, December 13, 2006 7:43 PM</SPAN></FONT> <BR><B><FONT =
face=3DTahoma size=3D1><SPAN style=3D"FONT-WEIGHT: bold; FONT-SIZE: =
7.5pt; FONT-FAMILY: =
Tahoma">To:&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT></B> <FONT =
face=3DTahoma size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Sandrine Boulanger; Ed Kwan; Charissa Willard; Paul =
Hammer</SPAN></FONT> <BR><B><FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Cc:&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT></B> <FONT =
face=3DTahoma size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Kevin Matthews</SPAN></FONT><FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">; Brian Baker; Eric =
Barrett; Vikas Saini; dl-Clio</SPAN></FONT> <BR><B><FONT face=3DTahoma =
size=3D1><SPAN style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; =
FONT-FAMILY: =
Tahoma">Subject:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT><=
/B> <FONT face=3DTahoma size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; =
FONT-FAMILY: Tahoma">RE: Updates</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/lib/libucdagent.so</SPAN></FONT> <BR><FONT =
face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/lib/libucdmibs.so</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">These files are both used by =
snmp. We suspect that they may be the cause of the snmp =
problem.</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy =
size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">We need to do another upgrade to dogfood. But prior to the =
upgrade, we should reinstall just the libraries</SPAN></FONT> <BR><FONT =
face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
COLOR: navy; FONT-FAMILY: Arial">that have checksum differences and try =
to start snmp to verify that the libraries are the cause of the =
problem.</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">The next issue will be to try to =
understand why system upgrade either munged the libraries or =
simply</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">failed to =
upgrade them. Before overwriting them we should see if their checksums =
match the checksums</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy =
size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">of the libraries from the previous release that was on dogfood. =
</SPAN></FONT></P>=0A=
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN =
style=3D"FONT-SIZE: 12pt"></SPAN></FONT>&nbsp;</P>=0A=
<P><FONT face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> Sandrine =
Boulanger<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> =
Wednesday, December 13, 2006 6:56 PM<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">To:</SPAN></B> Sandrine Boulanger; Ed Kwan; Charissa Willard; Paul =
Hammer<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> Kevin =
Matthews; Brian Baker; Eric Barrett; Vikas Saini; dl-Clio<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: =
Updates</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">I copied the upgrade log (which =
was on the other flash), to ~sandrineb/traces/sys_upgrade.log. It looks =
like those files were supposed to be upgraded and they did, check the =
Installing part. I don&#8217;t know why the checksum would not match =
then&#8230;</SPAN></FONT></P>=0A=
<P><FONT face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> Sandrine =
Boulanger<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> =
Wednesday, December 13, 2006 6:46 PM<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">To:</SPAN></B> Ed Kwan; Charissa Willard; Paul Hammer<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> Kevin Matthews; Brian Baker; =
Eric Barrett; Vikas Saini; dl-Clio<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Subject:</SPAN></B> RE: Updates</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">I ran a system compare, here are =
the results. We should get the system upgrade log file on =
Dogfood.</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">The following files are =
different:</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy =
size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/etc/newsyslog.conf =3D&gt; normal, always =
different</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy =
size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/lib/libucdagent.so</SPAN></FONT> <BR><FONT =
face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/lib/libucdmibs.so</SPAN></FONT> <BR><FONT =
face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
COLOR: navy; FONT-FAMILY: Arial">/mnt/usr/local/agile/etc/pmtab =
=3D&gt;</SPAN></FONT> <FONT face=3DArial color=3Dred size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: Arial">scary, did =
someone modified that one?</SPAN></FONT> <BR><FONT face=3DArial =
color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; =
FONT-FAMILY: =
Arial">/mnt/usr/local/agile/web/js/console/login.js</SPAN></FONT> =
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/web/js/console/view.js</SPAN></FONT> =
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/web/js/domain/util.js</SPAN></FONT> =
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/var/log/sendmail.st</SPAN></FONT> <BR><FONT face=3DArial =
color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; =
FONT-FAMILY: Arial">/mnt/version =3D&gt; normal, always =
different</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy =
size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">Dogfood diag&gt;</SPAN></FONT> </P>=0A=
<P><FONT face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> Ed Kwan<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Wednesday, December 13, =
2006 6:44 PM<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B> =
Charissa Willard; Paul Hammer<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Cc:</SPAN></B> Kevin Matthews; Brian Baker; Eric Barrett; Vikas =
Saini; dl-Clio<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Subject:</SPAN></B> RE: Updates</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">Checksums of some libraries on =
dogfood don&#8217;t match the release, e.g.</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">Dogfood# cksum =
libucdmibs.so</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy =
size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">2089852042 3278706 libucdmibs.so</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">[edk@edk-linux lib]$ =
pwd</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/n/build-trees/R2.1.0.0/R2.1.0.0-120906/nfx-tree/Build/ch/opt/lib<=
/SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN =
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">[edk@edk-linux lib]$ cksum&nbsp; libucdmibs.so</SPAN></FONT> =
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">4212168562 3278706 =
libucdmibs.so</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">Sandrine is running a =
&#8220;system compare&#8221; on dogfood.</SPAN></FONT> </P>=0A=
<P><FONT face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> Charissa =
Willard<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> =
Wednesday, December 13, 2006 1:20 PM<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">To:</SPAN></B> Paul Hammer<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Cc:</SPAN></B> Kevin Matthews; Brian Baker; Ed Kwan; Eric Barrett; =
Vikas Saini; dl-Clio<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Subject:</SPAN></B> RE: Updates</SPAN></FONT> </P>=0A=
<P><FONT face=3D"Courier New" size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: 'Courier New'">Paul,</SPAN></FONT> </P>=0A=
<P><FONT face=3D"Courier New" size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: 'Courier New'">Ed&#8217;s been looking into 16471 on MD. We =
still haven&#8217;t been able to get a stack trace.</SPAN></FONT> </P>=0A=
<P><FONT face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: =
12pt">-Charissa </SPAN></FONT></P>=0A=
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN =
style=3D"FONT-SIZE: 12pt"></SPAN></FONT>&nbsp;</P>=0A=
<P><FONT face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: =
12pt">=3D=3D=3D=3D=3D State: Assigned by:edk at 12/12/2006 7:01:15 PM =
=3D=3D=3D=3D=3D<BR><BR>Ran the unstripped version of snmpd in gdb on =
dogfood, and still didn't get a good stack trace:<BR><BR>(gdb) bt<BR>#0 =
0x5ffe31a0 in ?? ()<BR>warning: Hit heuristic-fence-post without =
finding<BR>warning: enclosing function for address 0x5ffe46c0<BR><BR>I =
set breakpoints at main, __main, __start and __init, and snmpd got =
SIGSEGV before hitting the break points.<BR><BR>Ran "readelf snmpd" on =
my Linux box, and the executable instructions in snmpd don't map to the =
pc (0x5ffe31a0).<BR>There are 15 shared libraries used by snmpd, but gdb =
says they are not even loaded at the time:<BR><BR>(gdb) info =
sharedlibrary<BR>No shared libraries loaded at this time.<BR><BR>I =
played with ldd and the "LD_TRACE_LOADED_OBJECTS" environment variables, =
but I can't get any useful info.<BR><BR>May need to compile all the =
libraries with "-g" and load them on dogfood... </SPAN></FONT></P>=0A=
<P><FONT face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> Paul Hammer<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Wednesday, December 13, =
2006 1:14 PM<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B> Eric =
Barrett; Vikas Saini; dl-Clio<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Cc:</SPAN></B> Kevin Matthews; Brian Baker<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: =
Updates</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">This one should have been =
submitted separately against 2.1, need core Dev to have a look at this =
one in Clio. Agree that it looks similar to the one at Shopzilla, =
however the version at the customer did not core on MD nor did it leave =
a core file, appears now with 2.1 we have a core. </SPAN></FONT></P>=0A=
<P><FONT face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> Eric Barrett<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Wednesday, December 13, =
2006 1:10 PM<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B> =
Vikas Saini; Paul Hammer; dl-Clio<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Cc:</SPAN></B> Kevin Matthews; Brian Baker<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: =
Updates</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: Arial">snmpd issue is already filed as 16471.</SPAN></FONT> =
</P>=0A=
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN =
style=3D"FONT-SIZE: 12pt"></SPAN></FONT>&nbsp;</P>=0A=
<P><FONT face=3DTahoma size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; =
FONT-FAMILY: Tahoma">_____________________________________________ =
</SPAN></FONT><BR><B><FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">From: =
&nbsp;</SPAN></FONT></B> <FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">Vikas =
Saini</SPAN></FONT><FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">&nbsp; =
</SPAN></FONT><BR><B><FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Sent:&nbsp;&nbsp;</SPAN></FONT></B> <FONT face=3DTahoma =
size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Wednesday, December 13, 2006 1:08 PM</SPAN></FONT> <BR><B><FONT =
face=3DTahoma size=3D1><SPAN style=3D"FONT-WEIGHT: bold; FONT-SIZE: =
7.5pt; FONT-FAMILY: =
Tahoma">To:&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT></B> <FONT =
face=3DTahoma size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Paul Hammer</SPAN></FONT><FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">; dl-Clio</SPAN></FONT> =
<BR><B><FONT face=3DTahoma size=3D1><SPAN style=3D"FONT-WEIGHT: bold; =
FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Cc:&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT></B> <FONT =
face=3DTahoma size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Eric Barrett</SPAN></FONT><FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">; Kevin Matthews; Brian =
Baker</SPAN></FONT> <BR><B><FONT face=3DTahoma size=3D1><SPAN =
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Subject:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT><=
/B> <FONT face=3DTahoma size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; =
FONT-FAMILY: Tahoma">RE: Updates</SPAN></FONT> <BR><B><FONT =
face=3DTahoma size=3D1><SPAN style=3D"FONT-WEIGHT: bold; FONT-SIZE: =
7.5pt; FONT-FAMILY: =
Tahoma">Importance:&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT></B> <FONT =
face=3DTahoma size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">High</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">Clio is going fine. First =
regression is complete. Second regression pass is going on and should be =
complete soon. Just sent the Clio Soak status..</SPAN></FONT></P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">There are still 2 defects in Dev =
court that needs resolution.</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">QA has verified all the defects =
which were targeted for Clio. Right now we are verifying the defects =
which were not targeted for Clio but got resolved in =
Clio.</SPAN></FONT></P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">I haven&#8217;t seen any defect =
on snmpd issue. will file one soon. Yes that should be =
resolved.</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: =
10pt; COLOR: navy; FONT-FAMILY: Arial">Thanks</SPAN></FONT> <BR><FONT =
face=3DArial color=3Dnavy size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
COLOR: navy; FONT-FAMILY: Arial">Vikas</SPAN></FONT> </P>=0A=
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN =
style=3D"FONT-SIZE: 12pt"></SPAN></FONT>&nbsp;</P>=0A=
<P><FONT face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> Paul Hammer<BR><B><SPAN =
style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Wednesday, December 13, =
2006 1:01 PM<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B> =
dl-Clio<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> Eric =
Barrett; Kevin Matthews; Brian Baker<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Subject:</SPAN></B> Updates</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: Arial">Any updates on Clio status?</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: Arial">Soak Updates? Uptime numbers</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: Arial">Number of defects in Dev that we need to address =
still in Clio?</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: Arial">Defects in QA that we need to resolve?</SPAN></FONT> =
</P>=0A=
<P><FONT face=3DArial size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: Arial">I have not seen any update on the Defect found with =
SNMP on MD, assume this is MF for Clio too.</SPAN></FONT> </P>=0A=
<P><FONT face=3DArial size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: Arial">-Paul</SPAN></FONT> </P>=0A=
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN =
style=3D"FONT-SIZE: =
12pt"></SPAN></FONT>&nbsp;</P></DIV></DIV></DIV></BODY></HTML>
------_=_NextPart_001_01C71FFF.6A363BDB--
