X-MimeOLE: Produced By Microsoft Exchange V6.5
Received: by onstor-exch02.onstor.net 
	id <01C8B517.F16F66F0@onstor-exch02.onstor.net>; Tue, 13 May 2008 09:39:41 -0700
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----_=_NextPart_001_01C8B517.F16F66F0"
Content-class: urn:content-classes:message
Subject: ssc cores
Date: Tue, 13 May 2008 09:39:41 -0700
Message-ID: <BB375AF679D4A34E9CA8DFA650E2B04E09EE7CFA@onstor-exch02.onstor.net>
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
Thread-Topic: ssc cores
Thread-Index: Aci1F/EwaU0EC7otSre3NYgpvGYxGQ==
From: "Maxim Kozlovsky" <maxim.kozlovsky@onstor.com>
To: "dl-Software" <dl-software@onstor.com>,
	"dl-QA" <dl-qa@onstor.com>

This is a multi-part message in MIME format.

------_=_NextPart_001_01C8B517.F16F66F0
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Hello,

When you are trying to get the SSC core backtrace for a defect please
remember to mount the libraries and binaries with the debugging
information, otherwise the stack trace may be not quite right. See
example below.

Max

Here is what was reported in 21892:

#0  0x2b5b5104 in kill () at ../string/bits/string2.h:998
#1  0x2b5b670c in *__GI_abort () at ../sysdeps/generic/abort.c:88
#2  0x2b5f111c in __libc_message (do_abort=3D2, fmt=3D0x2b6c0878 "*** =
glibc
detected *** %s: 0x%s ***\n")
    at ../sysdeps/unix/sysv/linux/libc_fatal.c:145
#3  0x2b5f7e7c in malloc_printerr (action=3D3, str=3D0x2b6c0a4c =
"malloc():
memory corruption", ptr=3D<value optimized out>) at malloc.c:5525
#4  0x2b5fa4a0 in _int_malloc (av=3D0x2b70eba0, bytes=3D<value optimized
out>) at malloc.c:3933
#5  0x2b5fdd5c in __libc_calloc (n=3D<value optimized out>,
elem_size=3D<value optimized out>) at malloc.c:3647
#6  0x0042e9d0 in evm_allocLunEntry ()
#7  0x0044b1d8 in evm_getVolLunList ()
#8  0x0044d378 in evm_procSpmRsp ()
#9  0x00409f28 in evm_processMsg ()
#10 0x00405884 in evm_closeSess ()
#11 0xffffffffffffff00 in ?? ()

Correct stack trace looks like this:

#0  0x2b5b5104 in kill () at ../string/bits/string2.h:998
#1  0x2b5b670c in *__GI_abort () at ../sysdeps/generic/abort.c:88
#2  0x2b5f111c in __libc_message (do_abort=3D2, fmt=3D0x2b6c0878 "")
    at ../sysdeps/unix/sysv/linux/libc_fatal.c:145
#3  0x2b5f7e7c in malloc_printerr (action=3D3, str=3D0x2b6c0a4c "\n",=20
    ptr=3D<value optimized out>) at malloc.c:5525
#4  0x2b5fa4a0 in _int_malloc (av=3D0x2b70eba0, bytes=3D<value optimized
out>)
    at malloc.c:3933
#5  0x2b5fdd5c in __libc_calloc (n=3D<value optimized out>,=20
    elem_size=3D<value optimized out>) at malloc.c:3647
#6  0x0042e9d0 in evm_allocLunEntry (sid=3D9018322866560060317) at
evm-db.c:1027
#7  0x0044b1d8 in evm_getVolLunList (evmTxn=3D0x2baf7c28) at =
evm-spm.c:459
#8  0x0044d378 in evm_procSpmRsp (mBuf=3D0x513bf0) at evm-spm.c:884
#9  0x00409f28 in evm_processMsg (mbuf=3D0x513bf0 "1\n",
sender=3D0x7f82db50)
    at evm-cfgd-rx.c:299
#10 0x00405884 in evm_rcvRmcMsg (sess=3D0x4d3cc0, mode=3D32768) at
evm-cfgd.c:594
#11 0x00405b7c in evm_processReceivedMessages (clockTick=3D0x7f82dd48)
    at evm-cfgd.c:640
#12 0x00406c38 in main (argc=3D1, argv=3D0x7f82ddc4, envp=3D0x7f82ddcc)
    at evm-cfgd.c:923



------_=_NextPart_001_01C8B517.F16F66F0
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Dus-ascii">
<META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version =
6.5.7653.38">
<TITLE>ssc cores</TITLE>
</HEAD>
<BODY>
<!-- Converted from text/rtf format -->

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT =
SIZE=3D2 FACE=3D"Arial">Hello,</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Arial">When</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"> <FONT SIZE=3D2 FACE=3D"Arial">you</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Arial"> are trying to get the SSC</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"> <FONT SIZE=3D2 =
FACE=3D"Arial">core</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"> <FONT SIZE=3D2 FACE=3D"Arial">backtrace for a defect =
please remember to mount the libraries and binaries with the debugging =
information, otherwise the stack trace may be not quite =
right.</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"> =
<FONT SIZE=3D2 FACE=3D"Arial">See example below.</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Arial">Max</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Arial">H</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">ere is</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"> <FONT SIZE=3D2 =
FACE=3D"Arial">what was reported in 21892:</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT =
SIZE=3D2 FACE=3D"Arial">#0&nbsp; 0x2b5b5104 in kill () at =
../string/bits/string2.h:998</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#1&nbsp; =
0x2b5b670c in *__GI_abort () at =
../sysdeps/generic/abort.c:88</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#2&nbsp; =
0x2b5f111c in __libc_message (do_abort=3D2, fmt=3D0x2b6c0878 &quot;*** =
glibc detected *** %s: 0x%s ***\n&quot;)</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Arial">&nbsp;&nbsp;&nbsp; at =
../sysdeps/unix/sysv/linux/libc_fatal.c:145</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#3&nbsp; =
0x2b5f7e7c in malloc_printerr (action=3D3, str=3D0x2b6c0a4c =
&quot;malloc(): memory corruption&quot;, ptr=3D&lt;value optimized =
out&gt;) at malloc.c:5525</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#4&nbsp; =
0x2b5fa4a0 in _int_malloc (av=3D0x2b70eba0, bytes=3D&lt;value optimized =
out&gt;) at malloc.c:3933</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#5&nbsp; =
0x2b5fdd5c in __libc_calloc (n=3D&lt;value optimized out&gt;, =
elem_size=3D&lt;value optimized out&gt;) at =
malloc.c:3647</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#6&nbsp; =
0x0042e9d0 in evm_allocLunEntry ()</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#7&nbsp; =
0x0044b1d8 in evm_getVolLunList ()</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#8&nbsp; =
0x0044d378 in evm_procSpmRsp ()</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#9&nbsp; =
0x00409f28 in evm_processMsg ()</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#10 =
0x00405884 in evm_closeSess ()</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#11 =
0xffffffffffffff00 in ?? ()</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">Correct =
stack trace looks like this:</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT =
SIZE=3D2 FACE=3D"Arial">#0&nbsp; 0x2b5b5104 in kill () at =
../string/bits/string2.h:998</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#1&nbsp; =
0x2b5b670c in *__GI_abort () at =
../sysdeps/generic/abort.c:88</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#2&nbsp; =
0x2b5f111c in __libc_message (do_abort=3D2, fmt=3D0x2b6c0878 =
&quot;&quot;)</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Arial">&nbsp;&nbsp;&nbsp; at =
../sysdeps/unix/sysv/linux/libc_fatal.c:145</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#3&nbsp; =
0x2b5f7e7c in malloc_printerr (action=3D3, str=3D0x2b6c0a4c =
&quot;\n&quot;, </FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Arial">&nbsp;&nbsp;&nbsp; ptr=3D&lt;value optimized out&gt;) at =
malloc.c:5525</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#4&nbsp; =
0x2b5fa4a0 in _int_malloc (av=3D0x2b70eba0, bytes=3D&lt;value optimized =
out&gt;)</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Arial">&nbsp;&nbsp;&nbsp; at malloc.c:3933</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#5&nbsp; =
0x2b5fdd5c in __libc_calloc (n=3D&lt;value optimized out&gt;, =
</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Arial">&nbsp;&nbsp;&nbsp; elem_size=3D&lt;value optimized =
out&gt;) at malloc.c:3647</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#6&nbsp; =
0x0042e9d0 in evm_allocLunEntry (sid=3D9018322866560060317) at =
evm-db.c:1027</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#7&nbsp; =
0x0044b1d8 in evm_getVolLunList (evmTxn=3D0x2baf7c28) at =
evm-spm.c:459</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#8&nbsp; =
0x0044d378 in evm_procSpmRsp (mBuf=3D0x513bf0) at =
evm-spm.c:884</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#9&nbsp; =
0x00409f28 in evm_processMsg (mbuf=3D0x513bf0 &quot;1\n&quot;, =
sender=3D0x7f82db50)</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Arial">&nbsp;&nbsp;&nbsp; at evm-cfgd-rx.c:299</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#10 =
0x00405884 in evm_rcvRmcMsg (sess=3D0x4d3cc0, mode=3D32768) at =
evm-cfgd.c:594</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#11 =
0x00405b7c in evm_processReceivedMessages =
(clockTick=3D0x7f82dd48)</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Arial">&nbsp;&nbsp;&nbsp; at evm-cfgd.c:640</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Arial">#12 =
0x00406c38 in main (argc=3D1, argv=3D0x7f82ddc4, =
envp=3D0x7f82ddcc)</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Arial">&nbsp;&nbsp;&nbsp; at evm-cfgd.c:923</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"></SPAN></P>

</BODY>
</HTML>
------_=_NextPart_001_01C8B517.F16F66F0--
