X-MimeOLE: Produced By Microsoft Exchange V6.5
Received: by onstor-exch02.onstor.net 
	id <01C7FBB9.6F4ED521@onstor-exch02.onstor.net>; Thu, 20 Sep 2007 11:07:05 -0800
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----_=_NextPart_001_01C7FBB9.6F4ED521"
Content-class: urn:content-classes:message
Subject: RE: Route show has no bp0 interface
Date: Thu, 20 Sep 2007 11:07:05 -0800
Message-ID: <BB375AF679D4A34E9CA8DFA650E2B04E05A2510F@onstor-exch02.onstor.net>
In-Reply-To: <BB375AF679D4A34E9CA8DFA650E2B04E0346A9BB@onstor-exch02.onstor.net>
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
Thread-Topic: Route show has no bp0 interface
Thread-Index: Acf67ERgo+PLyUo+RGi34kad2757owAADrmAADMtQeA=
From: "Eric Barrett" <eric.barrett@onstor.com>
To: "John Rogers" <john.rogers@onstor.com>,
	"Ranga Nathan" <ranga.nathan@onstor.com>,
	"dl-cstech" <dl-cstech@onstor.com>

This is a multi-part message in MIME format.

------_=_NextPart_001_01C7FBB9.6F4ED521
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Actually, there is only a bp0, but there are multiple virtual interfaces
(IPs) on the physical interface bp0, using the IP range 192.167.X.Y,
where X is the virtual server ID and Y is the interface index (usually
just 1 since it's rare to have a vsvr with more than one interface).

(This IP address range is not RFC-compliant, and last I checked belongs
to a small ISP in Italy.  There's a very bug filed for this fact.)

http://wiki.onstor.net/wiki/Networking_FAQ



> _____________________________________________=20
> From: 	John Rogers =20
> Sent:	Wednesday, September 19, 2007 11:45 AM
> To:	Ranga Nathan; dl-cstech
> Subject:	RE: Route show has no bp0 interface
>=20
> Usually bp0 represents the existence of a vsvr. I believe for every
> vsvr with an interface(except mgmt?) a bp interface is created, bp0,
> bp1, bp2, etc. bp stands for backplane. That the interface used for
> internal communications. Perhaps cafs101 has no vsvr's with interfaces
> configured. I think 10.0.10.255 is an invalid IP address. I don't
> think they can end in 255. The route show output you have here, looks
> like the route table for the sc interfaces. We need a route show from
> the vsvr context to get the route tables for fp interfaces.
>=20
> _____________________________________________
> From: Ranga Nathan=20
> Sent: Wednesday, September 19, 2007 11:38 AM
> To: dl-cstech
> Subject: Route show has no bp0 interface
>=20
>=20
> Customer is unable to use the 10.x network on fp1.3 on one of the
> nodes. The filer also had a txrx crash while modifying the interface.=20
>=20
> The only difference that I can see is the output od route show:
>=20
> cafs101
> =3D=3D=3D=3D=3D=3D=3D
> <nfxshCmd cmd=3D"route show" rc=3D'0'>
> Route Table
> ---------------------------------------------------------
> dest              mask              nexthop           interface
> ---------------------------------------------------------
> 0.0.0.0           0.0.0.0           147.145.12.1      sc1
> 147.145.12.0      255.255.252.0     0.0.0.0           sc1
> 192.168.13.0      255.255.255.0     0.0.0.0           sc2
>=20
>=20
> cafs102
> =3D=3D=3D=3D=3D=3D=3D
>=20
> <nfxshCmd cmd=3D"route show" rc=3D'0'>
> Route Table
> ---------------------------------------------------------
> dest              mask              nexthop           interface
> ---------------------------------------------------------
> 0.0.0.0           0.0.0.0           147.145.12.1      sc1
> 147.145.12.0      255.255.252.0     0.0.0.0           sc1
> 192.167.0.0       255.255.0.0       0.0.0.0           bp0
> 192.168.13.0      255.255.255.0     0.0.0.0           sc2
>=20
>=20
> Some elog messages on cafs101:
>=20
> Sep 17 16:36:14 cafs101 : 1:0:bsdrl:ERROR: 7934: sosend failed: IP dst
> 10.0.10.255, port dst 137, Network is unreachable=20
> Sep 17 16:36:14 cafs101 : 0:0:eventd:NOTICE: Process-EVENT IP i/f: IP
> 192.167.11.2, Port bp0, State Remove
> Sep 17 16:36:14 cafs101 : 0:0:nfxsh:NOTICE: cmd[3]: interface modify
> fp1.3 -d 10.0.10.26 : status[0]
>=20
>=20
> Sep 18 15:12:55 cafs101 : 0:0:nfxsh:NOTICE: cmd[20]: interface modify
> fp1.3 -a 147.145.13.81/22 : status[11]
> Sep 18 15:12:57 cafs101 : 0:0:ea:WARNING: nfxnis_createVsContext:
> Context for VS=3D7 already exists.=20
> Sep 18 15:12:57 cafs101 : 0:0:auth_agent:INFO:
> authAgent_checkForReqTimeouts: 6048: Timedifference is computed to be
> greater than 1 sec: 10=20
> Sep 18 15:13:05 cafs101 : 1:0:bsdrl:WARNING: 8726: route dst 0 mask 0
> gateway 10c9193 fail to be added/deleted. error =3D 51=20
> Sep 18 15:13:05 cafs101 : 1:0:bsdrl:ERROR: 8727: sosend failed: IP dst
> 147.145.15.255, port dst 137, No route to host=20
> Sep 18 15:13:06 cafs101 : 0:0:nfxsh:NOTICE: cmd[21]: interface modify
> fp1.3 -d 147.145.13.81 : status[0]
> Sep 18 15:13:06 cafs101 : 0:0:eventd:NOTICE: Process-EVENT IP i/f: IP
> 192.167.11.2, Port bp0, State Remove
> Sep 18 15:13:06 cafs101 : 1:0:ipm:ERROR: 8728: ipm_ProcessMsg: 1125:
> vstack_selectSrcIP: Route lookup failed for vsid =3D 11 dst IP =3D 147
>=20
> The cables checked out ok.=20
>=20
> Anything else to check?
>=20
> Thanks
>=20
> Ranga Nathan=20
> Customer Support 		Direct: 408 963 2493
>=20
> ONStor US Support:=20
> Phone: 1-866-726-3453            E-mail: support@ONStor.com
>=20
>  << OLE Object: Picture (Metafile) >>  254 E Hacienda Ave, Campbell,
> CA 95008
>=20

------_=_NextPart_001_01C7FBB9.6F4ED521
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Dus-ascii">
<META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version =
6.5.7652.24">
<TITLE>RE: Route show has no bp0 interface</TITLE>
</HEAD>
<BODY>
<!-- Converted from text/rtf format -->

<P><FONT SIZE=3D2 FACE=3D"Arial">Actually, there is only a bp0, but =
there are multiple virtual interfaces (IPs) on the physical interface =
bp0, using the IP range =
192.167.<B><I>X</I></B><I></I>.<B></B><B><I>Y</I></B><I></I>, =
where<B></B><B><I> X</I></B><I></I> is the virtual server ID =
and<B></B><B><I> Y</I></B><I></I> is the interface index (usually just 1 =
since it's rare to have a vsvr with more than one interface).</FONT></P>

<P><FONT SIZE=3D2 FACE=3D"Arial">(This IP address range is not =
RFC-compliant, and last I checked belongs to a small ISP in Italy.&nbsp; =
There's a very bug filed for this fact.)</FONT></P>

<P><A HREF=3D"http://wiki.onstor.net/wiki/Networking_FAQ"><U><FONT =
COLOR=3D"#0000FF" SIZE=3D2 =
FACE=3D"Arial">http://wiki.onstor.net/wiki/Networking_FAQ</FONT></U></A>
</P>
<BR>
<BR>

<P><FONT SIZE=3D1 =
FACE=3D"Tahoma">_____________________________________________ </FONT>

<BR><B><FONT SIZE=3D1 FACE=3D"Tahoma">From: &nbsp;</FONT></B> <FONT =
SIZE=3D1 FACE=3D"Tahoma">John Rogers&nbsp; </FONT>

<BR><B><FONT SIZE=3D1 FACE=3D"Tahoma">Sent:&nbsp;&nbsp;</FONT></B> <FONT =
SIZE=3D1 FACE=3D"Tahoma">Wednesday, September 19, 2007 11:45 AM</FONT>

<BR><B><FONT SIZE=3D1 =
FACE=3D"Tahoma">To:&nbsp;&nbsp;&nbsp;&nbsp;</FONT></B> <FONT SIZE=3D1 =
FACE=3D"Tahoma">Ranga Nathan; dl-cstech</FONT>

<BR><B><FONT SIZE=3D1 =
FACE=3D"Tahoma">Subject:&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</FONT>=
</B> <FONT SIZE=3D1 FACE=3D"Tahoma">RE: Route show has no bp0 =
interface</FONT>
</P>

<P><FONT COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">Usually bp0 =
represents the existence of a vsvr. I believe for every vsvr with an =
interface(except mgmt?) a bp interface is created, bp0, bp1, bp2, etc. =
bp stands for backplane. That the interface used for internal =
communications. Perhaps cafs101 has no vsvr&#8217;s with interfaces =
configured. I think</FONT> <FONT SIZE=3D2 FACE=3D"Arial">10.0.10.255 is =
an invalid IP address. I don&#8217;t think they can end in 255. The =
route show output you have here, looks like the route table for the sc =
interfaces. We need a route show from the vsvr context to get the route =
tables for fp interfaces.</FONT></P>

<P><FONT SIZE=3D2 =
FACE=3D"Tahoma">_____________________________________________<BR>
</FONT><B><FONT SIZE=3D2 FACE=3D"Tahoma">From:</FONT></B><FONT SIZE=3D2 =
FACE=3D"Tahoma"> Ranga Nathan<BR>
</FONT><B><FONT SIZE=3D2 FACE=3D"Tahoma">Sent:</FONT></B><FONT SIZE=3D2 =
FACE=3D"Tahoma"> Wednesday, September 19, 2007 11:38 AM<BR>
</FONT><B><FONT SIZE=3D2 FACE=3D"Tahoma">To:</FONT></B><FONT SIZE=3D2 =
FACE=3D"Tahoma"> dl-cstech<BR>
</FONT><B><FONT SIZE=3D2 FACE=3D"Tahoma">Subject:</FONT></B><FONT =
SIZE=3D2 FACE=3D"Tahoma"> Route show has no bp0 interface</FONT>
</P>
<BR>

<P><FONT SIZE=3D2 FACE=3D"Arial">Customer is unable to use the 10.x =
network on fp1.3 on one of the nodes. The filer also had a txrx crash =
while modifying the interface. </FONT></P>

<P><FONT SIZE=3D2 FACE=3D"Arial">The only difference that I can see is =
the output od route show:</FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Arial">cafs101</FONT>

<BR><FONT SIZE=3D2 FACE=3D"Arial">=3D=3D=3D=3D=3D=3D=3D</FONT>

<BR><FONT SIZE=3D2 FACE=3D"Arial">&lt;nfxshCmd cmd=3D&quot;route =
show&quot; rc=3D'0'&gt;</FONT>

<BR><FONT SIZE=3D2 FACE=3D"Arial">Route Table</FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">---------------------------------------------------------<=
/FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">dest&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp; =
mask&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp; =
nexthop&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
interface</FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">---------------------------------------------------------<=
/FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">0.0.0.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp; =
0.0.0.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
147.145.12.1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; sc1</FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">147.145.12.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
255.255.252.0&nbsp;&nbsp;&nbsp;&nbsp; =
0.0.0.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
sc1</FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">192.168.13.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
255.255.255.0&nbsp;&nbsp;&nbsp;&nbsp; =
0.0.0.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
sc2</FONT>
</P>
<BR>

<P><FONT SIZE=3D2 FACE=3D"Arial">cafs102</FONT>

<BR><FONT SIZE=3D2 FACE=3D"Arial">=3D=3D=3D=3D=3D=3D=3D</FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Arial">&lt;nfxshCmd cmd=3D&quot;route =
show&quot; rc=3D'0'&gt;</FONT>

<BR><FONT SIZE=3D2 FACE=3D"Arial">Route Table</FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">---------------------------------------------------------<=
/FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">dest&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp; =
mask&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp; =
nexthop&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
interface</FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">---------------------------------------------------------<=
/FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">0.0.0.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp; =
0.0.0.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
147.145.12.1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; sc1</FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">147.145.12.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
255.255.252.0&nbsp;&nbsp;&nbsp;&nbsp; =
0.0.0.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
sc1</FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">192.167.0.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
255.255.0.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
0.0.0.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
bp0</FONT>

<BR><FONT SIZE=3D2 =
FACE=3D"Arial">192.168.13.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
255.255.255.0&nbsp;&nbsp;&nbsp;&nbsp; =
0.0.0.0&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
sc2</FONT>
</P>
<BR>

<P><FONT SIZE=3D2 FACE=3D"Arial">Some elog messages on cafs101:</FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Arial">Sep 17 16:36:14 cafs101 : =
1:0:bsdrl:ERROR: 7934: sosend failed: IP dst 10.0.10.255, port dst 137, =
Network is unreachable </FONT></P>

<P><FONT SIZE=3D2 FACE=3D"Arial">Sep 17 16:36:14 cafs101 : =
0:0:eventd:NOTICE: Process-EVENT IP i/f: IP 192.167.11.2, Port bp0, =
State Remove</FONT>

<BR><FONT SIZE=3D2 FACE=3D"Arial">Sep 17 16:36:14 cafs101 : =
0:0:nfxsh:NOTICE: cmd[3]: interface modify fp1.3 -d 10.0.10.26 : =
status[0]</FONT>
</P>
<BR>

<P><FONT SIZE=3D2 FACE=3D"Arial">Sep 18 15:12:55 cafs101 : =
0:0:nfxsh:NOTICE: cmd[20]: interface modify fp1.3 -a 147.145.13.81/22 : =
status[11]</FONT>

<BR><FONT SIZE=3D2 FACE=3D"Arial">Sep 18 15:12:57 cafs101 : =
0:0:ea:WARNING: nfxnis_createVsContext: Context for VS=3D7 already =
exists. </FONT>

<BR><FONT SIZE=3D2 FACE=3D"Arial">Sep 18 15:12:57 cafs101 : =
0:0:auth_agent:INFO: authAgent_checkForReqTimeouts: 6048: Timedifference =
is computed to be greater than 1 sec: 10 </FONT></P>

<P><FONT SIZE=3D2 FACE=3D"Arial">Sep 18 15:13:05 cafs101 : =
1:0:bsdrl:WARNING: 8726: route dst 0 mask 0 gateway 10c9193 fail to be =
added/deleted. error =3D 51 </FONT></P>

<P><FONT SIZE=3D2 FACE=3D"Arial">Sep 18 15:13:05 cafs101 : =
1:0:bsdrl:ERROR: 8727: sosend failed: IP dst 147.145.15.255, port dst =
137, No route to host </FONT>

<BR><FONT SIZE=3D2 FACE=3D"Arial">Sep 18 15:13:06 cafs101 : =
0:0:nfxsh:NOTICE: cmd[21]: interface modify fp1.3 -d 147.145.13.81 : =
status[0]</FONT>

<BR><FONT SIZE=3D2 FACE=3D"Arial">Sep 18 15:13:06 cafs101 : =
0:0:eventd:NOTICE: Process-EVENT IP i/f: IP 192.167.11.2, Port bp0, =
State Remove</FONT>

<BR><FONT SIZE=3D2 FACE=3D"Arial">Sep 18 15:13:06 cafs101 : =
1:0:ipm:ERROR: 8728: ipm_ProcessMsg: 1125: vstack_selectSrcIP: Route =
lookup failed for vsid =3D 11 dst IP =3D 147</FONT></P>

<P><FONT SIZE=3D2 FACE=3D"Arial">The cables checked out ok. </FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Arial">Anything else to check?</FONT>
</P>

<P><FONT SIZE=3D2 FACE=3D"Arial">Thanks</FONT>
</P>

<P><FONT COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">Ranga Nathan </FONT>

<BR><FONT COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">Customer Support =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Direct: 408 963 2493</FONT>
</P>

<P><FONT COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">ONStor US Support: =
</FONT>

<BR><FONT COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">Phone: =
1-866-726-3453&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp; E-mail: </FONT><A HREF=3D"mailto:support@ONStor.com"><U><FONT =
COLOR=3D"#0000FF" SIZE=3D2 =
FACE=3D"Arial">support@ONStor.com</FONT></U></A>
</P>

<P><FONT FACE=3D"Times New Roman">&nbsp;&lt;&lt; OLE Object: Picture =
(Metafile) &gt;&gt;</FONT>&nbsp;<FONT SIZE=3D2 FACE=3D"Arial"><SUP> 254 =
E Hacienda Ave, Campbell, CA 95008</SUP></FONT>
</P>

</BODY>
</HTML>
------_=_NextPart_001_01C7FBB9.6F4ED521--
