X-MimeOLE: Produced By Microsoft Exchange V6.5
Received: by onstor-exch02.onstor.net 
	id <01C72075.00F5A299@onstor-exch02.onstor.net>; Fri, 15 Dec 2006 10:15:30 -0800
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----_=_NextPart_001_01C72075.00F5A299"
Content-class: urn:content-classes:message
Subject: RE: Updates
Date: Fri, 15 Dec 2006 10:15:29 -0800
Message-ID: <BB375AF679D4A34E9CA8DFA650E2B04E01C0B2CE@onstor-exch02.onstor.net>
In-Reply-To: <BB375AF679D4A34E9CA8DFA650E2B04E0A942E@onstor-exch02.onstor.net>
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
Thread-Topic: Updates
thread-index: Acce+b3Mfy+xIPS2TRi4/4armFj97QAAFnpQAAA/8cAAAA8pAAAAMVEwAAtKwPAAAB7EkAAAXasgAAF+nMAAG+bGsAAAEIdhABPlQMAAH9fUUA==
From: "Eric Barrett" <eric.barrett@onstor.com>
To: "Larry Scheer" <larry.scheer@onstor.com>,
	"Paul Hammer" <paul.hammer@onstor.com>,
	"Tim Gardner" <tim.gardner@onstor.com>,
	"Sandrine Boulanger" <sandrine.boulanger@onstor.com>,
	"Ed Kwan" <ed.kwan@onstor.com>,
	"Charissa Willard" <charissa.willard@onstor.com>
Cc: "Kevin Matthews" <kevin.matthews@onstor.com>,
	"Brian Baker" <brian.baker@onstor.com>,
	"Vikas Saini" <vikas.saini@onstor.com>,
	"dl-Clio" <dl-Clio@onstor.com>

This is a multi-part message in MIME format.

------_=_NextPart_001_01C72075.00F5A299
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

I have to say, based on the fact we've had three occurrences of exactly
the same problem, two in the field, I strongly disagree with "degrading
compact flash" as an answer.  Were there any associated I/O errors in
the BSD /var/log/messages?  We always see these when a compact flash
fails in the field
=20
I think it's far more likely that the upgrade did not complete
successfully even if the 'system upgrade' command said it did.
=20
Did we preserve the old files from Dogfood for analysis?
=20
=20
=20
________________________________

From: Larry Scheer=20
Sent: Thursday, December 14, 2006 7:45 PM
To: Paul Hammer; Eric Barrett; Tim Gardner; Sandrine Boulanger; Ed Kwan;
Charissa Willard
Cc: Kevin Matthews; Brian Baker; Vikas Saini; dl-Clio
Subject: RE: Updates



I spent some time investigating the upgrade problems that occurred on
dogfood. Of the list of filer reported previously these files had
problems:

/usr/local/agile/lib/libucdagent.so
/usr/local/agile/lib/libucdmibs.so

/usr/local/agile/web/js/console/login.js=20

/usr/local/agile/web/js/console/view.js
/usr/local/agile/web/js/domain/util.js=20



I found that although their file size was the same, their check sums did
not match the source files stored in the compressed tar file used for
the release distribution.

=20

Examining the contents of the files I found that the files were
corrupted. They were not copies of the files from a previous release but
were versions of the files for 2.1.0.0 with either nulls or somewhat
random bits stored in the file. The files were unpacked by the upgrade
program from the source distribution and stored on the compact flash
incorrectly.

=20

I was able to replace these files with copies from the source
distribution without any problems. After copying good sources to the
same files on the compact flash their check sums verified. I modified
the pmtab to start snmpd and rebooted dogfood. The system is running and
snmpd is staying up.

=20

Although I was unable to determine the root cause, the most likely
reason for this type of problem is a degrading compact flash. I
recommended to Brian and Kevin to replace this flash at their earliest
convenience. After talking to Andy Sharp and Tim I ruled out network and
memory problems as a cause. If memory was an issue the system would have
been failing in other more obvious ways. If the network were an issue
the entire upgrade would have failed in a more obvious manner.

=20

I will add this information to the bug report.

=20

Larry

=20

________________________________

From: Paul Hammer=20
Sent: Thursday, December 14, 2006 8:58 AM
To: Eric Barrett; Tim Gardner; Sandrine Boulanger; Ed Kwan; Charissa
Willard
Cc: Kevin Matthews; Brian Baker; Vikas Saini; dl-Clio
Subject: RE: Updates

=20

Can we run the tests some place other than on MD?

=20

________________________________

From: Eric Barrett
Sent: Thu 12/14/2006 8:57 AM
To: Tim Gardner; Sandrine Boulanger; Ed Kwan; Charissa Willard; Paul
Hammer
Cc: Kevin Matthews; Brian Baker; Vikas Saini; dl-Clio
Subject: RE: Updates

I would also suggest comparison to mktg3 -- it's the other node in the
cluster.  It was not affected by the snmp issue despite also being
upgraded to Clio.

=20

_____________________________________________=20
From:   Tim Gardner =20
Sent:   Wednesday, December 13, 2006 7:43 PM=20
To:     Sandrine Boulanger; Ed Kwan; Charissa Willard; Paul Hammer=20
Cc:     Kevin Matthews; Brian Baker; Eric Barrett; Vikas Saini; dl-Clio=20
Subject:        RE: Updates=20

/mnt/usr/local/agile/lib/libucdagent.so=20
/mnt/usr/local/agile/lib/libucdmibs.so=20

These files are both used by snmp. We suspect that they may be the cause
of the snmp problem.=20
We need to do another upgrade to dogfood. But prior to the upgrade, we
should reinstall just the libraries=20
that have checksum differences and try to start snmp to verify that the
libraries are the cause of the problem.=20

The next issue will be to try to understand why system upgrade either
munged the libraries or simply=20
failed to upgrade them. Before overwriting them we should see if their
checksums match the checksums=20
of the libraries from the previous release that was on dogfood.=20

=20

_____________________________________________
From: Sandrine Boulanger
Sent: Wednesday, December 13, 2006 6:56 PM
To: Sandrine Boulanger; Ed Kwan; Charissa Willard; Paul Hammer
Cc: Kevin Matthews; Brian Baker; Eric Barrett; Vikas Saini; dl-Clio
Subject: RE: Updates=20

I copied the upgrade log (which was on the other flash), to
~sandrineb/traces/sys_upgrade.log. It looks like those files were
supposed to be upgraded and they did, check the Installing part. I don't
know why the checksum would not match then...

_____________________________________________
From: Sandrine Boulanger
Sent: Wednesday, December 13, 2006 6:46 PM
To: Ed Kwan; Charissa Willard; Paul Hammer
Cc: Kevin Matthews; Brian Baker; Eric Barrett; Vikas Saini; dl-Clio
Subject: RE: Updates=20

I ran a system compare, here are the results. We should get the system
upgrade log file on Dogfood.=20

The following files are different:=20
/mnt/etc/newsyslog.conf =3D> normal, always different=20
/mnt/usr/local/agile/lib/libucdagent.so=20
/mnt/usr/local/agile/lib/libucdmibs.so=20
/mnt/usr/local/agile/etc/pmtab =3D> scary, did someone modified that =
one?=20
/mnt/usr/local/agile/web/js/console/login.js=20
/mnt/usr/local/agile/web/js/console/view.js=20
/mnt/usr/local/agile/web/js/domain/util.js=20
/mnt/var/log/sendmail.st=20
/mnt/version =3D> normal, always different=20
Dogfood diag>=20

_____________________________________________
From: Ed Kwan
Sent: Wednesday, December 13, 2006 6:44 PM
To: Charissa Willard; Paul Hammer
Cc: Kevin Matthews; Brian Baker; Eric Barrett; Vikas Saini; dl-Clio
Subject: RE: Updates=20

Checksums of some libraries on dogfood don't match the release, e.g.=20

Dogfood# cksum libucdmibs.so=20
2089852042 3278706 libucdmibs.so=20

[edk@edk-linux lib]$ pwd=20
/n/build-trees/R2.1.0.0/R2.1.0.0-120906/nfx-tree/Build/ch/opt/lib=20
[edk@edk-linux lib]$ cksum  libucdmibs.so=20
4212168562 3278706 libucdmibs.so=20

Sandrine is running a "system compare" on dogfood.=20

_____________________________________________
From: Charissa Willard
Sent: Wednesday, December 13, 2006 1:20 PM
To: Paul Hammer
Cc: Kevin Matthews; Brian Baker; Ed Kwan; Eric Barrett; Vikas Saini;
dl-Clio
Subject: RE: Updates=20

Paul,=20

Ed's been looking into 16471 on MD. We still haven't been able to get a
stack trace.=20

-Charissa=20

=20

=3D=3D=3D=3D=3D State: Assigned by:edk at 12/12/2006 7:01:15 PM =
=3D=3D=3D=3D=3D

Ran the unstripped version of snmpd in gdb on dogfood, and still didn't
get a good stack trace:

(gdb) bt
#0 0x5ffe31a0 in ?? ()
warning: Hit heuristic-fence-post without finding
warning: enclosing function for address 0x5ffe46c0

I set breakpoints at main, __main, __start and __init, and snmpd got
SIGSEGV before hitting the break points.

Ran "readelf snmpd" on my Linux box, and the executable instructions in
snmpd don't map to the pc (0x5ffe31a0).
There are 15 shared libraries used by snmpd, but gdb says they are not
even loaded at the time:

(gdb) info sharedlibrary
No shared libraries loaded at this time.

I played with ldd and the "LD_TRACE_LOADED_OBJECTS" environment
variables, but I can't get any useful info.

May need to compile all the libraries with "-g" and load them on
dogfood...=20

_____________________________________________
From: Paul Hammer
Sent: Wednesday, December 13, 2006 1:14 PM
To: Eric Barrett; Vikas Saini; dl-Clio
Cc: Kevin Matthews; Brian Baker
Subject: RE: Updates=20

This one should have been submitted separately against 2.1, need core
Dev to have a look at this one in Clio. Agree that it looks similar to
the one at Shopzilla, however the version at the customer did not core
on MD nor did it leave a core file, appears now with 2.1 we have a core.


_____________________________________________
From: Eric Barrett
Sent: Wednesday, December 13, 2006 1:10 PM
To: Vikas Saini; Paul Hammer; dl-Clio
Cc: Kevin Matthews; Brian Baker
Subject: RE: Updates=20

snmpd issue is already filed as 16471.=20

=20

_____________________________________________=20
From:   Vikas Saini =20
Sent:   Wednesday, December 13, 2006 1:08 PM=20
To:     Paul Hammer; dl-Clio=20
Cc:     Eric Barrett; Kevin Matthews; Brian Baker=20
Subject:        RE: Updates=20
Importance:     High=20

Clio is going fine. First regression is complete. Second regression pass
is going on and should be complete soon. Just sent the Clio Soak
status..

There are still 2 defects in Dev court that needs resolution.=20

QA has verified all the defects which were targeted for Clio. Right now
we are verifying the defects which were not targeted for Clio but got
resolved in Clio.

I haven't seen any defect on snmpd issue. will file one soon. Yes that
should be resolved.=20

Thanks=20
Vikas=20

=20

_____________________________________________
From: Paul Hammer
Sent: Wednesday, December 13, 2006 1:01 PM
To: dl-Clio
Cc: Eric Barrett; Kevin Matthews; Brian Baker
Subject: Updates=20

Any updates on Clio status?=20

Soak Updates? Uptime numbers=20

Number of defects in Dev that we need to address still in Clio?=20

Defects in QA that we need to resolve?=20

I have not seen any update on the Defect found with SNMP on MD, assume
this is MF for Clio too.=20

-Paul=20

=20


------_=_NextPart_001_01C72075.00F5A299
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML xmlns=3D"http://www.w3.org/TR/REC-html40" xmlns:v =3D=20
"urn:schemas-microsoft-com:vml" xmlns:o =3D=20
"urn:schemas-microsoft-com:office:office" xmlns:w =3D=20
"urn:schemas-microsoft-com:office:word" xmlns:st1 =3D=20
"urn:schemas-microsoft-com:office:smarttags"><HEAD><TITLE>RE: =
Updates</TITLE>
<META http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<META content=3D"MSHTML 6.00.2900.2963" name=3DGENERATOR><!--[if !mso]>
<STYLE>v\:* {
	BEHAVIOR: url(#default#VML)
}
o\:* {
	BEHAVIOR: url(#default#VML)
}
w\:* {
	BEHAVIOR: url(#default#VML)
}
.shape {
	BEHAVIOR: url(#default#VML)
}
</STYLE>
<![endif]--><o:SmartTagType name=3D"PersonName"=20
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"></o:SmartTagT=
ype><!--[if !mso]>
<STYLE>st1\:* {
	BEHAVIOR: url(#default#ieooui)
}
</STYLE>
<![endif]-->
<STYLE>@font-face {
	font-family: Tahoma;
}
@page Section1 {size: 8.5in 11.0in; margin: 1.0in 1.25in 1.0in 1.25in; }
P.MsoNormal {
	FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"
}
LI.MsoNormal {
	FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"
}
DIV.MsoNormal {
	FONT-SIZE: 12pt; MARGIN: 0in 0in 0pt; FONT-FAMILY: "Times New Roman"
}
A:link {
	COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlink {
	COLOR: blue; TEXT-DECORATION: underline
}
A:visited {
	COLOR: navy; TEXT-DECORATION: underline
}
SPAN.MsoHyperlinkFollowed {
	COLOR: navy; TEXT-DECORATION: underline
}
P {
	FONT-SIZE: 12pt; MARGIN-LEFT: 0in; MARGIN-RIGHT: 0in; FONT-FAMILY: =
"Times New Roman"; mso-margin-top-alt: auto; mso-margin-bottom-alt: auto
}
SPAN.EmailStyle18 {
	COLOR: navy; FONT-FAMILY: Arial; mso-style-type: personal-reply
}
DIV.Section1 {
	page: Section1
}
</STYLE>
</HEAD>
<BODY lang=3DEN-US vLink=3Dnavy link=3Dblue>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D673443917-15122006><FONT =
face=3DArial size=3D2>I=20
have to say, based on the fact we've had three occurrences of exactly =
the same=20
problem, two in the field, I strongly disagree with "degrading compact =
flash" as=20
an answer.&nbsp; Were there any associated I/O errors in the BSD=20
/var/log/messages?&nbsp; We always see these when a compact flash fails =
in the=20
field</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D673443917-15122006><FONT =
face=3DArial=20
size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D673443917-15122006><FONT =
face=3DArial size=3D2>I=20
think it's far more likely that the upgrade did not complete =
successfully even=20
if the 'system upgrade' command said it did.</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D673443917-15122006><FONT =
face=3DArial=20
size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D673443917-15122006><FONT =
face=3DArial=20
size=3D2>Did we preserve the old files from Dogfood for=20
analysis?</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D673443917-15122006><FONT =
face=3DArial=20
size=3D2>&nbsp;</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D673443917-15122006><FONT =
face=3DArial=20
size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN =
class=3D673443917-15122006>&nbsp;</SPAN></DIV>
<DIV dir=3Dltr align=3Dleft>
<HR tabIndex=3D-1>
</DIV>
<DIV dir=3Dltr align=3Dleft><FONT face=3DTahoma size=3D2><B>From:</B> =
Larry Scheer=20
<BR><B>Sent:</B> Thursday, December 14, 2006 7:45 PM<BR><B>To:</B> Paul =
Hammer;=20
Eric Barrett; Tim Gardner; Sandrine Boulanger; Ed Kwan; Charissa=20
Willard<BR><B>Cc:</B> Kevin Matthews; Brian Baker; Vikas Saini;=20
dl-Clio<BR><B>Subject:</B> RE: Updates<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV class=3DSection1>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I spent some =
time=20
investigating the upgrade problems that occurred on dogfood. Of the list =
of=20
filer reported previously these files had =
problems:<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT face=3DArial =
color=3Dnavy=20
size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/usr/local/agile/lib/libucdagent.so</SPAN></FONT><BR><FONT=20
face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/usr/local/agile/lib/libucdmibs.so<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT face=3DArial =
color=3Dnavy=20
size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/usr/local/agile/web/js/console/login.js</SPAN></FONT>=20
<o:p></o:p></P>
<P class=3DMsoNormal style=3D"MARGIN-LEFT: 0.5in"><FONT face=3DArial =
color=3Dnavy=20
size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/usr/local/agile/web/js/console/view.js</SPAN></FONT><BR><FONT=20
face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/usr/local/agile/web/js/domain/util.js</SPAN></FONT>=20
<BR><BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I found that =
although=20
their file size was the same, their check sums did not match the source =
files=20
stored in the compressed tar file used for the release=20
distribution.<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Examining the =
contents=20
of the files I found that the files were corrupted. They were not copies =
of the=20
files from a previous release but were versions of the files for 2.1.0.0 =
with=20
either nulls or somewhat random bits stored in the file. The files were =
unpacked=20
by the upgrade program from the source distribution and stored on the =
compact=20
flash incorrectly.<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I was able to =
replace=20
these files with copies from the source distribution without any =
problems. After=20
copying good sources to the same files on the compact flash their check =
sums=20
verified. I modified the pmtab to start snmpd and rebooted dogfood. The =
system=20
is running and snmpd is staying up.<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Although I =
was unable=20
to determine the root cause, the most likely reason for this type of =
problem is=20
a degrading compact flash. I recommended to Brian and Kevin to replace =
this=20
flash at their earliest convenience. After talking to <st1:PersonName=20
w:st=3D"on">Andy Sharp</st1:PersonName> and Tim I ruled out network and =
memory=20
problems as a cause. If memory was an issue the system would have been =
failing=20
in other more obvious ways. If the network were an issue the entire =
upgrade=20
would have failed in a more obvious manner.<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I will add =
this=20
information to the bug report.<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">Larry<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<DIV>
<DIV class=3DMsoNormal style=3D"TEXT-ALIGN: center" align=3Dcenter><FONT =

face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: 12pt">
<HR tabIndex=3D-1 align=3Dcenter width=3D"100%" SIZE=3D2>
</SPAN></FONT></DIV>
<P class=3DMsoNormal><B><FONT face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">From:</SPAN></FONT></B><FONT=20
face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">=20
<st1:PersonName w:st=3D"on">Paul Hammer</st1:PersonName> <BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Thursday, December 14, 2006 =
8:58=20
AM<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B> =
<st1:PersonName=20
w:st=3D"on">Eric Barrett</st1:PersonName>; <st1:PersonName =
w:st=3D"on">Tim=20
Gardner</st1:PersonName>; Sandrine Boulanger; Ed Kwan; <st1:PersonName=20
w:st=3D"on">Charissa Willard</st1:PersonName><BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> <st1:PersonName =
w:st=3D"on">Kevin=20
Matthews</st1:PersonName>; <st1:PersonName w:st=3D"on">Brian=20
Baker</st1:PersonName>; <st1:PersonName w:st=3D"on">Vikas =
Saini</st1:PersonName>;=20
dl-Clio<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE:=20
Updates</SPAN></FONT><o:p></o:p></P></DIV>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<DIV id=3DidOWAReplyText63714>
<DIV>
<P class=3DMsoNormal><FONT face=3DArial color=3Dblack size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: black; FONT-FAMILY: Arial">Can we run =
the tests=20
some place other than on MD?</SPAN></FONT><o:p></o:p></P></DIV></DIV>
<DIV>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<DIV class=3DMsoNormal style=3D"TEXT-ALIGN: center" align=3Dcenter><FONT =

face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: 12pt">
<HR tabIndex=3D-1 align=3Dcenter width=3D"100%" SIZE=3D2>
</SPAN></FONT></DIV>
<P class=3DMsoNormal style=3D"MARGIN-BOTTOM: 12pt"><B><FONT =
face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">From:</SPAN></FONT></B><FONT=20
face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">=20
<st1:PersonName w:st=3D"on">Eric Barrett</st1:PersonName><BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Thu 12/14/2006 8:57 =
AM<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">To:</SPAN></B> <st1:PersonName =
w:st=3D"on">Tim=20
Gardner</st1:PersonName>; Sandrine Boulanger; Ed Kwan; <st1:PersonName=20
w:st=3D"on">Charissa Willard</st1:PersonName>; <st1:PersonName =
w:st=3D"on">Paul=20
Hammer</st1:PersonName><BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Cc:</SPAN></B>=20
<st1:PersonName w:st=3D"on">Kevin Matthews</st1:PersonName>; =
<st1:PersonName=20
w:st=3D"on">Brian Baker</st1:PersonName>; <st1:PersonName =
w:st=3D"on">Vikas=20
Saini</st1:PersonName>; dl-Clio<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE:=20
Updates</SPAN></FONT><o:p></o:p></P></DIV>
<DIV>
<P><FONT face=3DArial size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: Arial">I=20
would also suggest comparison to mktg3 -- it's the other node in the=20
cluster.&nbsp; It was not affected by the snmp issue despite also being =
upgraded=20
to Clio.</SPAN></FONT><o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">_____________________________________________=20
</SPAN></FONT><BR><B><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">From: =

&nbsp;</SPAN></FONT></B> <st1:PersonName w:st=3D"on"><FONT face=3DTahoma =

size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">Tim=20
Gardner</SPAN></FONT></st1:PersonName><FONT face=3DTahoma size=3D1><SPAN =

style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">&nbsp; =
</SPAN></FONT><BR><B><FONT=20
face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Sent:&nbsp;&nbsp;</SPAN></FONT></B>=20
<FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">Wednesday, December 13, =
2006 7:43=20
PM</SPAN></FONT> <BR><B><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">To:&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT></B>=20
<FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">Sandrine Boulanger; Ed =
Kwan;=20
<st1:PersonName w:st=3D"on">Charissa Willard</st1:PersonName>; =
<st1:PersonName=20
w:st=3D"on">Paul Hammer</st1:PersonName></SPAN></FONT> <BR><B><FONT =
face=3DTahoma=20
size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Cc:&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT></B>=20
<st1:PersonName w:st=3D"on"><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">Kevin=20
Matthews</SPAN></FONT></st1:PersonName><FONT face=3DTahoma =
size=3D1><SPAN=20
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">; <st1:PersonName =
w:st=3D"on">Brian=20
Baker</st1:PersonName>; <st1:PersonName w:st=3D"on">Eric =
Barrett</st1:PersonName>;=20
<st1:PersonName w:st=3D"on">Vikas Saini</st1:PersonName>; =
dl-Clio</SPAN></FONT>=20
<BR><B><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Subject:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT><=
/B>=20
<FONT face=3DTahoma size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; =
FONT-FAMILY: Tahoma">RE:=20
Updates</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/lib/libucdagent.so</SPAN></FONT>=20
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/lib/libucdmibs.so</SPAN></FONT>=20
<o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">These files =
are both=20
used by snmp. We suspect that they may be the cause of the snmp=20
problem.</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy =
size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">We need to do =
another=20
upgrade to dogfood. But prior to the upgrade, we should reinstall just =
the=20
libraries</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy =
size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">that have =
checksum=20
differences and try to start snmp to verify that the libraries are the =
cause of=20
the problem.</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">The next =
issue will be=20
to try to understand why system upgrade either munged the libraries or=20
simply</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">failed to =
upgrade them.=20
Before overwriting them we should see if their checksums match the=20
checksums</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy =
size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">of the =
libraries from=20
the previous release that was on dogfood. </SPAN></FONT><o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P><FONT face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> Sandrine =
Boulanger<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Wednesday, December 13, =
2006 6:56=20
PM<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B> Sandrine =
Boulanger; Ed=20
Kwan; <st1:PersonName w:st=3D"on">Charissa Willard</st1:PersonName>;=20
<st1:PersonName w:st=3D"on">Paul Hammer</st1:PersonName><BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> <st1:PersonName =
w:st=3D"on">Kevin=20
Matthews</st1:PersonName>; <st1:PersonName w:st=3D"on">Brian=20
Baker</st1:PersonName>; <st1:PersonName w:st=3D"on">Eric =
Barrett</st1:PersonName>;=20
<st1:PersonName w:st=3D"on">Vikas Saini</st1:PersonName>; =
dl-Clio<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: =
Updates</SPAN></FONT>=20
<o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I copied the =
upgrade=20
log (which was on the other flash), to =
~sandrineb/traces/sys_upgrade.log. It=20
looks like those files were supposed to be upgraded and they did, check =
the=20
Installing part. I don&#8217;t know why the checksum would not match=20
then&#8230;</SPAN></FONT><o:p></o:p></P>
<P><FONT face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> Sandrine =
Boulanger<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Wednesday, December 13, =
2006 6:46=20
PM<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B> Ed Kwan; =
<st1:PersonName=20
w:st=3D"on">Charissa Willard</st1:PersonName>; <st1:PersonName =
w:st=3D"on">Paul=20
Hammer</st1:PersonName><BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Cc:</SPAN></B>=20
<st1:PersonName w:st=3D"on">Kevin Matthews</st1:PersonName>; =
<st1:PersonName=20
w:st=3D"on">Brian Baker</st1:PersonName>; <st1:PersonName =
w:st=3D"on">Eric=20
Barrett</st1:PersonName>; <st1:PersonName w:st=3D"on">Vikas=20
Saini</st1:PersonName>; dl-Clio<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: =
Updates</SPAN></FONT>=20
<o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I ran a =
system compare,=20
here are the results. We should get the system upgrade log file on=20
Dogfood.</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">The following =
files are=20
different:</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy =
size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/etc/newsyslog.conf=20
=3D&gt; normal, always different</SPAN></FONT> <BR><FONT face=3DArial =
color=3Dnavy=20
size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/lib/libucdagent.so</SPAN></FONT>=20
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/lib/libucdmibs.so</SPAN></FONT>=20
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/etc/pmtab=20
=3D&gt;</SPAN></FONT> <FONT face=3DArial color=3Dred size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: red; FONT-FAMILY: Arial">scary, did =
someone=20
modified that one?</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy =
size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/web/js/console/login.js</SPAN></FONT>=20
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/web/js/console/view.js</SPAN></FONT>=20
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/usr/local/agile/web/js/domain/util.js</SPAN></FONT>=20
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/mnt/var/log/sendmail.st</SPAN></FONT>=20
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">/mnt/version =
=3D&gt;=20
normal, always different</SPAN></FONT> <BR><FONT face=3DArial =
color=3Dnavy=20
size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">Dogfood=20
diag&gt;</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> Ed Kwan<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Wednesday, December 13, =
2006 6:44=20
PM<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B> =
<st1:PersonName=20
w:st=3D"on">Charissa Willard</st1:PersonName>; <st1:PersonName =
w:st=3D"on">Paul=20
Hammer</st1:PersonName><BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Cc:</SPAN></B>=20
<st1:PersonName w:st=3D"on">Kevin Matthews</st1:PersonName>; =
<st1:PersonName=20
w:st=3D"on">Brian Baker</st1:PersonName>; <st1:PersonName =
w:st=3D"on">Eric=20
Barrett</st1:PersonName>; <st1:PersonName w:st=3D"on">Vikas=20
Saini</st1:PersonName>; dl-Clio<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: =
Updates</SPAN></FONT>=20
<o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Checksums of =
some=20
libraries on dogfood don&#8217;t match the release, e.g.</SPAN></FONT> =
<o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Dogfood# =
cksum=20
libucdmibs.so</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy =
size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">2089852042 =
3278706=20
libucdmibs.so</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">[edk@edk-linux lib]$=20
pwd</SPAN></FONT> <BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">/n/build-trees/R2.1.0.0/R2.1.0.0-120906/nfx-tree/Build/ch/opt/lib<=
/SPAN></FONT>=20
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">[edk@edk-linux lib]$=20
cksum&nbsp; libucdmibs.so</SPAN></FONT> <BR><FONT face=3DArial =
color=3Dnavy=20
size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">4212168562=20
3278706 libucdmibs.so</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Sandrine is =
running a=20
&#8220;system compare&#8221; on dogfood.</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> <st1:PersonName =
w:st=3D"on">Charissa=20
Willard</st1:PersonName><BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Sent:</SPAN></B>=20
Wednesday, December 13, 2006 1:20 PM<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">To:</SPAN></B> <st1:PersonName =
w:st=3D"on">Paul=20
Hammer</st1:PersonName><BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Cc:</SPAN></B>=20
<st1:PersonName w:st=3D"on">Kevin Matthews</st1:PersonName>; =
<st1:PersonName=20
w:st=3D"on">Brian Baker</st1:PersonName>; Ed Kwan; <st1:PersonName =
w:st=3D"on">Eric=20
Barrett</st1:PersonName>; <st1:PersonName w:st=3D"on">Vikas=20
Saini</st1:PersonName>; dl-Clio<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: =
Updates</SPAN></FONT>=20
<o:p></o:p></P>
<P><FONT face=3D"Courier New" size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: 'Courier =
New'">Paul,</SPAN></FONT>=20
<o:p></o:p></P>
<P><FONT face=3D"Courier New" size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: 'Courier New'">Ed&#8217;s been =
looking into 16471=20
on MD. We still haven&#8217;t been able to get a stack =
trace.</SPAN></FONT>=20
<o:p></o:p></P>
<P><FONT face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: =
12pt">-Charissa=20
<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P><FONT face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: =
12pt">=3D=3D=3D=3D=3D=20
State: Assigned by:edk at 12/12/2006 7:01:15 PM =
=3D=3D=3D=3D=3D<BR><BR>Ran the unstripped=20
version of snmpd in gdb on dogfood, and still didn't get a good stack=20
trace:<BR><BR>(gdb) bt<BR>#0 0x5ffe31a0 in ?? ()<BR>warning: Hit=20
heuristic-fence-post without finding<BR>warning: enclosing function for =
address=20
0x5ffe46c0<BR><BR>I set breakpoints at main, __main, __start and __init, =
and=20
snmpd got SIGSEGV before hitting the break points.<BR><BR>Ran "readelf =
snmpd" on=20
my Linux box, and the executable instructions in snmpd don't map to the =
pc=20
(0x5ffe31a0).<BR>There are 15 shared libraries used by snmpd, but gdb =
says they=20
are not even loaded at the time:<BR><BR>(gdb) info sharedlibrary<BR>No =
shared=20
libraries loaded at this time.<BR><BR>I played with ldd and the=20
"LD_TRACE_LOADED_OBJECTS" environment variables, but I can't get any =
useful=20
info.<BR><BR>May need to compile all the libraries with "-g" and load =
them on=20
dogfood... <o:p></o:p></SPAN></FONT></P>
<P><FONT face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> <st1:PersonName =
w:st=3D"on">Paul=20
Hammer</st1:PersonName><BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Sent:</SPAN></B>=20
Wednesday, December 13, 2006 1:14 PM<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">To:</SPAN></B> <st1:PersonName =
w:st=3D"on">Eric=20
Barrett</st1:PersonName>; <st1:PersonName w:st=3D"on">Vikas=20
Saini</st1:PersonName>; dl-Clio<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> <st1:PersonName =
w:st=3D"on">Kevin=20
Matthews</st1:PersonName>; <st1:PersonName w:st=3D"on">Brian=20
Baker</st1:PersonName><BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Subject:</SPAN></B>=20
RE: Updates</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">This one =
should have=20
been submitted separately against 2.1, need core Dev to have a look at =
this one=20
in Clio. Agree that it looks similar to the one at Shopzilla, however =
the=20
version at the customer did not core on MD nor did it leave a core file, =
appears=20
now with 2.1 we have a core. </SPAN></FONT><o:p></o:p></P>
<P><FONT face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> <st1:PersonName =
w:st=3D"on">Eric=20
Barrett</st1:PersonName><BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Sent:</SPAN></B>=20
Wednesday, December 13, 2006 1:10 PM<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">To:</SPAN></B> <st1:PersonName =
w:st=3D"on">Vikas=20
Saini</st1:PersonName>; <st1:PersonName w:st=3D"on">Paul =
Hammer</st1:PersonName>;=20
dl-Clio<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> =
<st1:PersonName=20
w:st=3D"on">Kevin Matthews</st1:PersonName>; <st1:PersonName =
w:st=3D"on">Brian=20
Baker</st1:PersonName><BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Subject:</SPAN></B>=20
RE: Updates</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">snmpd issue is already =
filed as=20
16471.</SPAN></FONT> <o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">_____________________________________________=20
</SPAN></FONT><BR><B><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">From: =

&nbsp;</SPAN></FONT></B> <st1:PersonName w:st=3D"on"><FONT face=3DTahoma =

size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">Vikas=20
Saini</SPAN></FONT></st1:PersonName><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">&nbsp; =
</SPAN></FONT><BR><B><FONT=20
face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Sent:&nbsp;&nbsp;</SPAN></FONT></B>=20
<FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">Wednesday, December 13, =
2006 1:08=20
PM</SPAN></FONT> <BR><B><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">To:&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT></B>=20
<st1:PersonName w:st=3D"on"><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">Paul=20
Hammer</SPAN></FONT></st1:PersonName><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">; dl-Clio</SPAN></FONT>=20
<BR><B><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Cc:&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT></B>=20
<st1:PersonName w:st=3D"on"><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">Eric=20
Barrett</SPAN></FONT></st1:PersonName><FONT face=3DTahoma size=3D1><SPAN =

style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">; <st1:PersonName =
w:st=3D"on">Kevin=20
Matthews</st1:PersonName>; <st1:PersonName w:st=3D"on">Brian=20
Baker</st1:PersonName></SPAN></FONT> <BR><B><FONT face=3DTahoma =
size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Subject:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT><=
/B>=20
<FONT face=3DTahoma size=3D1><SPAN style=3D"FONT-SIZE: 7.5pt; =
FONT-FAMILY: Tahoma">RE:=20
Updates</SPAN></FONT> <BR><B><FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; FONT-FAMILY: =
Tahoma">Importance:&nbsp;&nbsp;&nbsp;&nbsp;</SPAN></FONT></B>=20
<FONT face=3DTahoma size=3D1><SPAN=20
style=3D"FONT-SIZE: 7.5pt; FONT-FAMILY: Tahoma">High</SPAN></FONT> =
<o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Clio is going =
fine.=20
First regression is complete. Second regression pass is going on and =
should be=20
complete soon. Just sent the Clio Soak =
status..</SPAN></FONT><o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">There are =
still 2=20
defects in Dev court that needs resolution.</SPAN></FONT> =
<o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">QA has =
verified all the=20
defects which were targeted for Clio. Right now we are verifying the =
defects=20
which were not targeted for Clio but got resolved in=20
Clio.</SPAN></FONT><o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">I =
haven&#8217;t seen any=20
defect on snmpd issue. will file one soon. Yes that should be=20
resolved.</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">Thanks</SPAN></FONT>=20
<BR><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">Vikas</SPAN></FONT>=20
<o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P><FONT face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">_____________________________________________<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">From:</SPAN></B> <st1:PersonName =
w:st=3D"on">Paul=20
Hammer</st1:PersonName><BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Sent:</SPAN></B>=20
Wednesday, December 13, 2006 1:01 PM<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">To:</SPAN></B> dl-Clio<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> <st1:PersonName =
w:st=3D"on">Eric=20
Barrett</st1:PersonName>; <st1:PersonName w:st=3D"on">Kevin=20
Matthews</st1:PersonName>; <st1:PersonName w:st=3D"on">Brian=20
Baker</st1:PersonName><BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Subject:</SPAN></B>=20
Updates</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: Arial">Any=20
updates on Clio status?</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Soak Updates? Uptime=20
numbers</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Number of defects in Dev =
that we=20
need to address still in Clio?</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Defects in QA that we need =
to=20
resolve?</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial size=3D2><SPAN style=3D"FONT-SIZE: 10pt; =
FONT-FAMILY: Arial">I=20
have not seen any update on the Defect found with SNMP on MD, assume =
this is MF=20
for Clio too.</SPAN></FONT> <o:p></o:p></P>
<P><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">-Paul</SPAN></FONT> =
<o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: =
12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P></DIV></DIV></BODY></HTML>

------_=_NextPart_001_01C72075.00F5A299--
