X-MimeOLE: Produced By Microsoft Exchange V6.5
Received: by onstor-exch02.onstor.net 
	id <01C811A7.AA06485B@onstor-exch02.onstor.net>; Thu, 18 Oct 2007 08:55:18 -0800
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----_=_NextPart_001_01C811A7.AA06485B"
Content-class: urn:content-classes:message
Subject: RE: networking betwixt camphell and pleztown
Date: Thu, 18 Oct 2007 08:55:18 -0800
Message-ID: <BB375AF679D4A34E9CA8DFA650E2B04E0619AE23@onstor-exch02.onstor.net>
In-Reply-To: <BB375AF679D4A34E9CA8DFA650E2B04E068BA6@onstor-exch02.onstor.net>
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
Thread-Topic: networking betwixt camphell and pleztown
Thread-Index: AcgG7Pyp/Y9MZr1QQAyHisK1qVP8mAABipNwAAch4vgAAgO1EwAAbzINAqN/hrA=
References: <BB375AF679D4A34E9CA8DFA650E2B04E05DD73DC@onstor-exch02.onstor.net> <BB375AF679D4A34E9CA8DFA650E2B04E068BA5@onstor-exch02.onstor.net> <BB375AF679D4A34E9CA8DFA650E2B04E05BFE50A@onstor-exch02.onstor.net> <BB375AF679D4A34E9CA8DFA650E2B04E068BA6@onstor-exch02.onstor.net>
From: "Brian Stark" <brian.stark@onstor.com>
To: "Brian Baker" <brian.baker@onstor.com>,
	"Paul Hammer" <paul.hammer@onstor.com>,
	"Andy Sharp" <andy.sharp@onstor.com>
Cc: "Sandrine Boulanger" <sandrine.boulanger@onstor.com>,
	"Raj Kumar" <raj.kumar@onstor.com>,
	"John Rogers" <john.rogers@onstor.com>,
	"Joshua Goldenhar" <joshua.goldenhar@onstor.com>

This is a multi-part message in MIME format.

------_=_NextPart_001_01C811A7.AA06485B
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Looks like our link between Pleasanton and Campbell is nearly saturated
right now on the outbound side:
=20
http://mrtg/mrtg/hp5308A/10.0.0.19_8.html
=20
This is affecting several people right now.  Is this related to the DMIP
testing?
=20
=20
Brian
=20
=20
=20


________________________________

	From: Brian Baker=20
	Sent: Thursday, October 04, 2007 11:44 PM
	To: Paul Hammer; Andy Sharp
	Cc: Sandrine Boulanger; Brian Stark; Raj Kumar; John Rogers;
Joshua Goldenhar
	Subject: RE: networking betwixt camphell and pleztown
=09
=09
	It would be interesting to see how a WAN link compression device
would handle the traffic. In the early days I used a Peribit appliance
and it worked well with common traffic. NFS CIFS, FTP, SMTP even SQL. It
did not speak off the wall protocols and I wonder if it could comprende
DMIP enough to compress it. The 25k it would cost to get them could
easily be used to replace ONStor's entire core switch infrastructure.
Corporate never gets the toys :(
=09
	=20
	Rockies! SWEEP!
	=20
	Brian

________________________________

	From: Paul Hammer
	Sent: Thu 10/4/2007 11:29 PM
	To: Brian Baker; Andy Sharp
	Cc: Sandrine Boulanger; Brian Stark; Raj Kumar; John Rogers;
Joshua Goldenhar
	Subject: RE: networking betwixt camphell and pleztown
=09
=09
	Thanks Brian. The link saturatutaion was pure ignorance on our
behalf, had no idea that DMIP would saturate the link to the point of
hobbling productivity for the P'town team, this goes for both QA and
Corporate, perhaps this is why Kevin never put the MD boxes in P'town 7
months ago as requested by Frank.=20
	=20
	Great point on the testing. Sandrine and John can you propose
how we setup the DMIP feature for testing in Soak? I am okay with all of
the suggestions that Brian listed. Thanks Brain, we did not know what
impact this would have on the link for this test nor for MD. Now I
understand a lot more about it. Thanks.=20
	=20
	John, Raj  and Sandrine lets work out what makes sense for SS
and for MD with the link capacity in mind. Still curious though on the
RiverBed angle.
	=20
	Thanks Brian. =20
	=20
	Go Rockies!! 2 Down and 1 to Go!=20
	=20
	-Paul

________________________________

	From: Brian Baker
	Sent: Thu 10/4/2007 11:16 PM
	To: Paul Hammer; Andy Sharp
	Cc: Sandrine Boulanger; Brian Stark; Raj Kumar; John Rogers;
Joshua Goldenhar
	Subject: RE: networking betwixt camphell and pleztown
=09
=09
	Paul,
	We already have layer 3/4 switches that support QoS . If DMIP
generates this traffic then I will address it. I would use a method,
per-port ingress-based enforcement bandwidth maximums. I'm assuming we
won't have these spikes via DMIP for Mightydog as the baselines will be
done here. No new network equipment needed no need to break out the
checkbook.
	I think we need to revisit the testing that is done across the
Pleasanton link. Why couldn't this testing be done with a DSL, cable
line or t1 line that is hooked into the lab? This would give you the
ability to test with different network equipment in front of your wan
interfaces. John Rogers also mentioned that he was working on acquiring
software to mimic wan speeds. I think this is the direction you need to
take opposed to getting a additional line in Pleasanton. There shouldn't
be a need for the geographic disparity, you just need the hops and
latency to make it look like you aren't in the same room.
	DMIP will be considered general productivity traffic for this
link and I will take it into account as I measure network traffic. Our
problem in this instance was not understanding the impact of this test.
I could have easily been someone downloading 1000's of torrents or 30GB
of CIFS copies.
	If you give me some warning when utilizing corporate resources I
can accommodate some traffic shaping. I only need some time to implement
the solution and forewarning in the future.
	=20
	Brian
	=20

________________________________

	From: Paul Hammer
	Sent: Thu 10/4/2007 7:06 PM
	To: Andy Sharp
	Cc: Brian Baker; Sandrine Boulanger; Brian Stark; Raj Kumar;
John Rogers; Joshua Goldenhar
	Subject: RE: networking betwixt camphell and pleztown
=09
=09

	Hey Andy,
=09
	Agree.
=09
	We need to plan accordingly for the MightyDog corporate DMIP
session's that we plan to start soon.
=09
	Looks like we should have a rigid nightly sessions scheduled (so
we have predicable perf hit). Else we need a bigger or different
pipe/approach in place. A router may be the way to go, also interested
in how a Riverbed deployment may be able to help us here. Added Josh for
his perspective on this point.
=09
	Bottom line is we cannot negatively impact the Cougar schedule
or our general productivity on this link with DMIP, so the solution has
to take into account QoS as part of the solution.
=09
	Thanks,
=09
	-Paul
=09
	-----Original Message-----
	From: Andy Sharp
	Sent: Thursday, October 04, 2007 6:14 PM
	To: Paul Hammer
	Cc: Brian Baker; Sandrine Boulanger; Brian Stark; Raj Kumar
	Subject: Re: networking betwixt camphell and pleztown
=09
	The problem here, and the reason for this disconnect is that,
IIUC, we
	are using a production asset for QA testing purposes.  I think
this
	kind of testing is great -- but should we provision a separate
link for
	it?  Or use a router that is capable of doing QoS itself to
throttle
	back the DMIP traffic?
=09
	Having the line swamped between 8pm and 6am will still affect me
	greatly, sorry to say.
=09
	Cheers,
=09
	a
=09
=09
	On Thu, 4 Oct 2007 17:44:45 -0700 "Paul Hammer"
	<paul.hammer@onstor.com> wrote:
=09
	> Kind of funny, most folks want this thing to go way faster. I
	> understand why you would like slower.
	>
	>=20
	>
	>=20
	>
	> ________________________________
	>
	> From: Brian Baker
	> Sent: Thursday, October 04, 2007 3:59 PM
	> To: Sandrine Boulanger; Paul Hammer; Andy Sharp; Brian Stark
	> Cc: Raj Kumar
	> Subject: RE: networking betwixt camphell and pleztown
	>
	>=20
	>
	> Sandrine,
	>
	> As you can see by the mrtg graph traffic has gone back down.
As a
	> feature request to DMIP I would like to see bandwidth
throttling on
	> the filer side.
	>
	> http://mrtg/mrtg/hp5308A/10.0.0.19_8.html
	>
	>=20
	>
	>=20
	>
	> From: Sandrine Boulanger
	> Sent: Thursday, October 04, 2007 3:50 PM
	> To: Paul Hammer; Brian Baker; Andy Sharp; Brian Stark
	> Cc: Raj Kumar
	> Subject: RE: networking betwixt camphell and pleztown
	>
	>=20
	>
	> Is it better now?
	>
	>=20
	>
	> I changed the schedules to run between 22 and 6am.
	>
	> I paused a mirror that was already at 66%, we can resume it
tonight.
	>
	> I have an issue with one mirror for which I cannot modify the
schedule
	> even if I do it from the GW that owns the vsvr. Mirror show
NAME finds
	> the mirror but mirror schedule NAME does not...
	>
	>=20
	>
	> Welcome to the ONStor NAS Gateway.
	>
	>=20
	>
	> g2r5> vsvr show
	>
	> Virtual servers on nas gateway g2r5
	>
	>=20
	>
	>  ID  State                             Name
	>
	> =
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D
	>
	> 1    Enabled                           VS_MGMT_588
	>
	> 9    Enabled                           G2R5-VS1
	>
	> 10   Enabled                           G2R5-VS2
	>
	> 11   Enabled                           G2R5-VS3
	>
	> 12   Enabled                           G2R5-VS4
	>
	> 13   Enabled                           GNSSRVR
	>
	> 18   Enabled                           G2R5-VS5
	>
	> 19   Enabled                           G2R5-VS6
	>
	> g2r5> vsvr set G2R5-VS3
	>
	> g2r5 G2R5-VS3> mirror show
	>
	>=20
	>
	>    Mirror Name    AdminState  Oper  State  Transferred
Source
	> Volume           Target Volume       VirtualServer
	>
	> ----------------  ----------  -----------  -----------
	> ----------------------  ----------------------  -------------
	>
	>   g2r5-v1v2-dmip     Enabled         Idle           0%
	> g2r5-vs1-vol2  g2r5-vs1-vol2@10.11.1.30       G2R5-VS1
	>
	>   g2r5-v2v1-dmip     Enabled         Idle           0%
	> g2r5-vs2-vol1  g2r5-vs2-vol1-dmip@10.11.1.30       G2R5-VS2
	>
	>   g2r5-v3v1-dmip     Enabled         Idle           0%
	> g2r5-vs3-vol1  g2r5-vs3-vol1-dmip@10.11.1.40       G2R5-VS3
	>
	>  g2r5vs5-vol1-m1     Enabled         Idle         100%
	> g2r5-vs5-vol1        g2r5-vs5-vol1-m1       G2R5-VS5
	>
	>  g2r5vs4-vol1-m1     Enabled         Idle           0%
	> g2r5-vs4-vol1         g2r5vs4-vol1-m1       G2R5-VS4
	>
	>  g2r5vs4-vol5-m1     Enabled         Idle         100%
	> g2r5-vs4-vol5         g2r5vs4-vol5-m1       G2R5-VS4
	>
	>   g4r8-v2v1-dmip     Enabled         Idle         100%
	> g4r8-vs2-vol1  g4r8-vs2-vol1-dmip@10.11.1.36       G4R8-VS2
	>
	>  g12r9-v1v1-dmip     Enabled       Paused          66%
	> g12r9-vs1-vol1  g12r9-vs1-vol1@10.11.1.36      G12R9-VS1
	>
	> g2r5 G2R5-VS3>
	>
	> g2r5 G2R5-VS3>
	>
	> g2r5 G2R5-VS3> mirror schedule g2r5-v3v1-dmip -h 0
	>
	>  /
	>
	> Error: Mirror[g2r5-v3v1-dmip] not found.
	>
	> % Command failure.
	>
	> g2r5 G2R5-VS3> elog show log 20
	>
	> Oct  4 15:35:16 g2r5 : 1:3:efs:INFO: 16516: FS:
g2r5-vs5-vol1-m1
	> 0x24c000000dd - amDeltaInstallCommit - snp - snap resume:
recal
	> refbyte snapcounts for 1
	>
	> Oct  4 15:35:16 g2r5 : 1:2:efs:INFO: 16517: FS:
g2r5-vs5-vol1-m1
	> 0x24c000000dd - amDeltaInstallCommit - snp - snap resume:
recal
	> refbyte snapcounts for 2
	>
	> Oct  4 15:35:16 g2r5 : 1:3:efs:INFO: 16518: FS:
g2r5-vs5-vol1-m1
	> 0x24c000000dd - amDeltaInstallCommit - snp - snap resume:
recal
	> refbyte snapcounts for 3
	>
	> Oct  4 15:35:19 g2r5 : 1:2:efs:INFO: 16519: FS:
g2r5-vs5-vol1-m1
	> 0x24c000000dd - amDeltaInstallCommit - snp - snap revert
mirror 3: end
	>
	> Oct  4 15:35:19 g2r5 : 1:3:efs:INFO: 16520: FS:
g2r5-vs5-vol1-m1
	> 0x24c000000dd - amDeltaInstallCommit - mirror - FS AM TARGET:
install
	> commit reverted to snap 3 genNum 70 ( )
	>
	> Oct  4 15:35:19 g2r5 : 1:3:efs:INFO: 16521: FS: g2r5-vs5-vol1
	> 0x24c000000d9 - amDeltaComplete - mirror - FS AM: removing old
unused
	> snapshot SANM_SS_g2r5vs5-vol1-m1_0000024c000000d9_0000019f 1
gen 70
	>
	> Oct  4 15:35:19 g2r5 : 1:2:efs:NOTICE: 16522: FS:
g2r5-vs5-vol1
	> 0x24c000000d9 - amDeltaComplete - snp - snapnum 1 un pinned
	>
	> Oct  4 15:35:22 g2r5 : 1:3:efs:NOTICE: 16523: FS:
g2r5-vs5-vol1
	> 0x24c000000d9 - amDeltaComplete - snp - snap remove complete
for
	> SANM_SS_g2r5vs5-vol1-m1_0000024c000000d9_0000019f id 1
	>
	> Oct  4 15:35:22 g2r5 : 1:2:efs:INFO: 16524: FS: g2r5-vs5-vol1
	> 0x24c000000d9 - amDeltaComplete - mirror - FS AM: delta
complete
	> session
	>
	> Oct  4 15:35:22 g2r5 : 0:0:sanm:NOTICE: Session terminated
	> successfully for mirror[g2r5vs5-vol1-m1]
	>
	> Oct  4 15:35:25 g2r5 : 0:0:sanm:NOTICE: SANM: Mirror
Completed:
	> g2r5vs5-vol1-m1
	>
	> Oct  4 15:36:13 g2r5 : 0:0:sanm:NOTICE:
sanm_procRemoteModifyRsp:
	> Error: Mirror[g2r5-v3v1-dmip] not found.
	>
	> Oct  4 15:36:13 g2r5 : 0:0:sanm:NOTICE:
sanm_procRemoteModifyRsp:
	> remote modify failed, rc[-6654]
	>
	> Oct  4 15:36:46 g2r5 : 0:0:ssh:INFO: 'admin' logged in through
remote
	> host(10.0.0.79)
	>
	> Oct  4 15:36:49 g2r5 : 0:0:nfxsh:NOTICE: cmd[0]: vsvr show :
status[0]
	>
	> Oct  4 15:36:54 g2r5 : 0:0:nfxsh:NOTICE: cmd[1]: vsvr set
G2R5-VS3 :
	> status[0]
	>
	> Oct  4 15:36:59 g2r5 : 0:0:nfxsh:NOTICE: cmd[2]: mirror show
:
	> status[0]
	>
	> Oct  4 15:37:24 g2r5 : 0:0:sanm:NOTICE:
sanm_procRemoteModifyRsp:
	> Error: Mirror[g2r5-v3v1-dmip] not found.
	>
	> Oct  4 15:37:24 g2r5 : 0:0:sanm:NOTICE:
sanm_procRemoteModifyRsp:
	> remote modify failed, rc[-6654]
	>
	> Oct  4 15:37:24 g2r5 : 0:0:nfxsh:NOTICE: cmd[3]: mirror
schedule
	> g2r5-v3v1-dmip -h 0 : status[11]
	>
	> g2r5 G2R5-VS3>
	>
	> g2r5 G2R5-VS3> mirror show g2r5-v3v1-dmip
	>
	>=20
	>
	> Mirror Name             : g2r5-v3v1-dmip
	>
	> Admin State             : Enabled
	>
	> Operational State       : Idle
	>
	> Mirror Load             : MED
	>
	>=20
	>
	> Source Vol Name         : g2r5-vs3-vol1
	>
	> Source Vol Id           : 0x24c00000080
	>
	> Mirror Vol Name         : g2r5-vs3-vol1-dmip@10.11.1.40
	>
	> Mirror Vol Id           : 0x4100000006b
	>
	>=20
	>
	> Mirror Secondary Node Name : None
	>
	>=20
	>
	> Mirror Schedule :
	>
	> -----------------
	>
	>    Minute       : *
	>
	>    Hour         : 0 2 4 6 8 10 12 14 16 18 20 22
	>
	>    Day Of Month : *
	>
	>    Month        : *
	>
	>    Day Of Week  : *
	>
	>=20
	>
	> Counters:
	>
	> ---------
	>
	>    Mirror Start Count    : 0
	>
	>    Mirror Complete Count : 0
	>
	>    Mirror Abort Count    : 0
	>
	>=20
	>
	> Last Mirror Session Information:
	>
	> --------------------------------
	>
	>    Mirror Started     :
	>
	>    Mirror Finished    :
	>
	>    Bytes Transferred  : 0 (MB)
	>
	>    Percent Transferred: 0%
	>
	>    Throughput         : 0 (bytes/s)
	>
	>    Snapshot Name      :
	> SANM_SS_g2r5-v3v1-dmip_0000024c00000080_0000109b
	>
	>    Session Status     :
	>
	>=20
	>
	> g2r5 G2R5-VS3>
	>
	>=20
	>
	>=20
	>
	> -----Original Message-----
	> From: Paul Hammer
	> Sent: Thursday, October 04, 2007 3:13 PM
	> To: Brian Baker; Andy Sharp; Brian Stark
	> Cc: Raj Kumar; Sandrine Boulanger
	> Subject: RE: networking betwixt camphell and pleztown
	>
	>=20
	>
	> Sandrine do you know?
	>
	>=20
	>
	> -----Original Message-----
	>
	> From: Brian Baker
	>
	> Sent: Thursday, October 04, 2007 3:05 PM
	>
	> To: Andy Sharp; Brian Stark
	>
	> Cc: Raj Kumar; Paul Hammer; Sandrine Boulanger
	>
	> Subject: RE: networking betwixt camphell and pleztown
	>
	>=20
	>
	> Raj,
	>
	> It appears that the dmip mirros are still going. Can you stop
these
	> immediately? Let me know if you believe you have stopped your
mirror,
	> if so I will find the culprit.
	>
	>=20
	>
	>=20
	>
	> -----Original Message-----
	>
	> From: Andy Sharp
	>
	> Sent: Thursday, October 04, 2007 3:02 PM
	>
	> To: Brian Stark
	>
	> Cc: Brian Baker
	>
	> Subject: Re: networking betwixt camphell and pleztown
	>
	>=20
	>
	> I'm not sure where this got left off, but does this mean we
know what
	>
	> the traffic is?  Can we try pulling the plug on that IP
address?
	>
	>=20
	>
	> Thanks,
	>
	>=20
	>
	> a
	>
	>=20
	>
	> On Wed, 3 Oct 2007 18:04:22 -0700 "Brian Stark"
	>
	> <brian.stark@onstor.com> wrote:
	>
	>=20
	>
	> > I'll go unplug the array that's spinning like crazy back
there...
	>
	> >=20
	>
	> >
	>
	> > > -----Original Message-----
	>
	> > > From: Andy Sharp
	>
	> > > Sent: Wednesday, October 03, 2007 5:48 PM
	>
	> > > To: Brian Baker
	>
	> > > Cc: Brian Stark
	>
	> > > Subject: Re: networking betwixt camphell and pleztown
	>
	> > >
	>
	> > > I'm all for blocking it and seeing {what happens,who
	>
	> > > squeals}.  Who's with me?
	>
	> > >
	>
	> > > I can't see the included link because I'm remote and I
can't
	>
	> > > get an ssh proxy to work <hangs his head in shame>.
	>
	> > >
	>
	> > > a
	>
	> > >
	>
	> > >
	>
	> > > On Wed, 3 Oct 2007 17:18:33 -0700 "Brian Baker"
	>
	> > > <brian.baker@onstor.com> wrote:
	>
	> > >
	>
	> > > > Someone is hogging the connection up there. Take a look
at MRTG.
	>
	> > > > http://mrtg/mrtg/hp5308A/10.0.0.19_8.html
	>
	> > > > This is the Pleasanton uplink.
	>
	> > > > We can ask who has been whoring the connection and ask
them to
	>
	> > > > stop. Or I can look into it further and block their
traffic.
	>
	> > > >
	>
	> > > > -----Original Message-----
	>
	> > > > From: Brian Baker
	>
	> > > > Sent: Wednesday, October 03, 2007 4:55 PM
	>
	> > > > To: Andy Sharp; Brian Stark
	>
	> > > > Subject: RE: networking betwixt camphell and pleztown
	>
	> > > >
	>
	> > > > Andy,
	>
	> > > > Thx for reporting this. Kevin was up there last week and
he
	>
	> > > reported
	>
	> > > > the issue was resolved. I will take a look into this.
But
	>
	> > > as you know
	>
	> > > > I'm very blah so I probably won't be able to look at it
until
	>
	> > > > blah.
	>
	> > > >
	>
	> > > > -----Original Message-----
	>
	> > > > From: Andy Sharp
	>
	> > > > Sent: Wednesday, October 03, 2007 4:17 PM
	>
	> > > > To: Brian Stark
	>
	> > > > Cc: Brian Baker
	>
	> > > > Subject: networking betwixt camphell and pleztown
	>
	> > > >
	>
	> > > > I'm sure everyone knows by now, but I just thought I
would put
	> > > > my
	>
	> > > > notice in just in case.
	>
	> > > >
	>
	> > > > Networking between Campbell and Pleasanton has slowed to
a
	>
	> > > crawl, and
	>
	> > > > it's impacting my work, as well as others, I'm guessing,
pretty
	>
	> > > > significantly.
	>
	> > > >
	>
	> > > > Transfering a kernel to 10.1.1.189 goes at about 100-160
	>
	> > > KiB/s, down
	>
	> > > > from 6-700 KiB yesterday.  It takes my cougar about 10
	>
	> > > minutes to boot
	>
	> > > > just to single user mode (NFS root is located in
campbell),
	>
	> > > and that
	>
	> > > > means about 4-5 reboots an hour, when really I need
about 12-15
	>
	> > > > reboots an hour.
	>
	> > > >
	>
	> > > > I know everyone has a lot to do and blah-blah, but I
didn't want
	>
	> > > > to keep it a secret either.
	>
	> > > >
	>
	> > > > Cheers,
	>
	> > > >
	>
	> > > > a
	>
	> > >
	>
=09


------_=_NextPart_001_01C811A7.AA06485B
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML dir=3Dltr><HEAD><TITLE>RE: networking betwixt camphell and =
pleztown</TITLE>
<META http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<META content=3D"MSHTML 6.00.6000.16525" name=3DGENERATOR></HEAD>
<BODY>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D491555316-18102007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>Looks like our link between Pleasanton and =
Campbell is=20
nearly saturated right now on the outbound side:</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D491555316-18102007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D491555316-18102007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2><A=20
href=3D"http://mrtg/mrtg/hp5308A/10.0.0.19_8.html">http://mrtg/mrtg/hp530=
8A/10.0.0.19_8.html</A></FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D491555316-18102007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D491555316-18102007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>This is affecting several people right =
now.&nbsp; Is this=20
related to the DMIP testing?</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D491555316-18102007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D491555316-18102007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D491555316-18102007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2>Brian</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D491555316-18102007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D491555316-18102007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D491555316-18102007><FONT =
face=3DArial=20
color=3D#0000ff size=3D2></FONT></SPAN>&nbsp;</DIV><BR>
<BLOCKQUOTE dir=3Dltr=20
style=3D"PADDING-LEFT: 5px; MARGIN-LEFT: 5px; BORDER-LEFT: #0000ff 2px =
solid; MARGIN-RIGHT: 0px">
  <DIV class=3DOutlookMessageHeader lang=3Den-us dir=3Dltr align=3Dleft>
  <HR tabIndex=3D-1>
  <FONT face=3DTahoma size=3D2><B>From:</B> Brian Baker <BR><B>Sent:</B> =
Thursday,=20
  October 04, 2007 11:44 PM<BR><B>To:</B> Paul Hammer; Andy =
Sharp<BR><B>Cc:</B>=20
  Sandrine Boulanger; Brian Stark; Raj Kumar; John Rogers; Joshua=20
  Goldenhar<BR><B>Subject:</B> RE: networking betwixt camphell and=20
  pleztown<BR></FONT><BR></DIV>
  <DIV></DIV>
  <DIV id=3DidOWAReplyText62293 dir=3Dltr>
  <DIV dir=3Dltr><FONT face=3DArial color=3D#000000 size=3D2>It would be =
interesting to=20
  see how a WAN link compression device would handle the traffic. In the =
early=20
  days I used a Peribit appliance and it worked well with common =
traffic. NFS=20
  CIFS, FTP, SMTP even SQL. It did not speak off the wall protocols and =
I wonder=20
  if it could comprende DMIP enough to compress it. The 25k it would =
cost to get=20
  them could easily be used to replace&nbsp;ONStor's entire core switch=20
  infrastructure. Corporate never gets the toys :(</FONT></DIV><FONT =
face=3DArial=20
  size=3D2></FONT></DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2>Rockies! =
SWEEP!</FONT></DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2>Brian</FONT></DIV>
  <DIV dir=3Dltr><BR></DIV>
  <DIV dir=3Dltr>
  <HR tabIndex=3D-1>
  </DIV>
  <DIV dir=3Dltr><FONT face=3DTahoma size=3D2><B>From:</B> Paul =
Hammer<BR><B>Sent:</B>=20
  Thu 10/4/2007 11:29 PM<BR><B>To:</B> Brian Baker; Andy =
Sharp<BR><B>Cc:</B>=20
  Sandrine Boulanger; Brian Stark; Raj Kumar; John Rogers; Joshua=20
  Goldenhar<BR><B>Subject:</B> RE: networking betwixt camphell and=20
  pleztown<BR></FONT><BR></DIV>
  <DIV dir=3Dltr>
  <DIV id=3DidOWAReplyText7149 dir=3Dltr>
  <DIV dir=3Dltr><FONT face=3DArial color=3D#000000 size=3D2>Thanks =
Brian. The link=20
  saturatutaion was pure ignorance on&nbsp;our behalf, had no idea that =
DMIP=20
  would saturate the link to the point of hobbling productivity for the =
P'town=20
  team, this goes for both QA and Corporate, perhaps this is why Kevin =
never put=20
  the MD boxes in P'town 7 months ago as requested by Frank. =
</FONT></DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2>Great point on the testing. =
Sandrine and=20
  John can you propose how we setup the DMIP feature for testing in =
Soak? I am=20
  okay with all of the suggestions that Brian listed. Thanks Brain, we =
did not=20
  know what impact this would have on the link for this test nor for MD. =
Now I=20
  understand a lot more about it. Thanks. </FONT></DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2>John, Raj &nbsp;and =
Sandrine lets work=20
  out what makes sense for SS and for MD with the link capacity in mind. =
Still=20
  curious though on the RiverBed angle.</FONT></DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
  <DIV dir=3Dltr>Thanks Brian.&nbsp; </DIV>
  <DIV dir=3Dltr>&nbsp;</DIV>
  <DIV dir=3Dltr>Go Rockies!! 2 Down and 1 to Go! </DIV>
  <DIV dir=3Dltr>&nbsp;</DIV>
  <DIV dir=3Dltr>-Paul</DIV></DIV>
  <DIV dir=3Dltr><BR>
  <HR tabIndex=3D-1>
  <FONT face=3DTahoma size=3D2><B>From:</B> Brian Baker<BR><B>Sent:</B> =
Thu=20
  10/4/2007 11:16 PM<BR><B>To:</B> Paul Hammer; Andy Sharp<BR><B>Cc:</B> =

  Sandrine Boulanger; Brian Stark; Raj Kumar; John Rogers; Joshua=20
  Goldenhar<BR><B>Subject:</B> RE: networking betwixt camphell and=20
  pleztown<BR></FONT><BR></DIV>
  <DIV dir=3Dltr>
  <DIV id=3DidOWAReplyText73961 dir=3Dltr>
  <DIV dir=3Dltr><FONT face=3DArial color=3D#000000 =
size=3D2>Paul,</FONT></DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2>We already have layer 3/4 =
switches that=20
  support QoS . If DMIP generates this traffic then I will address it. I =
would=20
  use a method, per-port ingress-based enforcement bandwidth maximums. =
I'm=20
  assuming we won't have these spikes via DMIP for Mightydog as the =
baselines=20
  will be done here. No new network equipment needed no need to break =
out the=20
  checkbook.</FONT></DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2>I think we need to revisit =
the testing=20
  that is done across the Pleasanton link. Why couldn't this testing be =
done=20
  with a DSL, cable line or t1 line that is hooked into the lab? This =
would give=20
  you the ability to test with different network equipment in front of =
your wan=20
  interfaces. John Rogers also mentioned that he was working on =
acquiring=20
  software to mimic wan speeds. I think this is the direction you need =
to take=20
  opposed to getting a additional&nbsp;line in Pleasanton. There =
shouldn't be a=20
  need for the geographic disparity, you just need the hops and latency =
to make=20
  it look like you aren't in the same room.</FONT></DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2>DMIP will be considered =
general=20
  productivity traffic for this link and I will take it into account as =
I=20
  measure network traffic. Our problem in this instance was not =
understanding=20
  the impact of this test. I could have easily been someone downloading =
1000's=20
  of torrents or 30GB of CIFS copies.</FONT></DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2>If you give me some warning =
when=20
  utilizing corporate resources I can accommodate some traffic shaping. =
I only=20
  need some time to implement the solution and forewarning in the=20
  future.</FONT></DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2>Brian</FONT></DIV>
  <DIV dir=3Dltr><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV></DIV>
  <DIV dir=3Dltr><BR>
  <HR tabIndex=3D-1>
  <FONT face=3DTahoma size=3D2><B>From:</B> Paul Hammer<BR><B>Sent:</B> =
Thu=20
  10/4/2007 7:06 PM<BR><B>To:</B> Andy Sharp<BR><B>Cc:</B> Brian Baker; =
Sandrine=20
  Boulanger; Brian Stark; Raj Kumar; John Rogers; Joshua=20
  Goldenhar<BR><B>Subject:</B> RE: networking betwixt camphell and=20
  pleztown<BR></FONT><BR></DIV>
  <DIV>
  <P><FONT size=3D2>Hey Andy,<BR><BR>Agree.<BR><BR>We need to plan =
accordingly for=20
  the MightyDog corporate DMIP session's that we plan to start=20
  soon.<BR><BR>Looks like we should have a rigid nightly sessions =
scheduled (so=20
  we have predicable perf hit). Else we need a bigger or different =
pipe/approach=20
  in place. A router may be the way to go, also interested in how a =
Riverbed=20
  deployment may be able to help us here. Added Josh for his perspective =
on this=20
  point.<BR><BR>Bottom line is we cannot negatively impact the Cougar =
schedule=20
  or our general productivity on this link with DMIP, so the solution =
has to=20
  take into account QoS as part of the=20
  solution.<BR><BR>Thanks,<BR><BR>-Paul<BR><BR>-----Original=20
  Message-----<BR>From: Andy Sharp<BR>Sent: Thursday, October 04, 2007 =
6:14=20
  PM<BR>To: Paul Hammer<BR>Cc: Brian Baker; Sandrine Boulanger; Brian =
Stark; Raj=20
  Kumar<BR>Subject: Re: networking betwixt camphell and =
pleztown<BR><BR>The=20
  problem here, and the reason for this disconnect is that, IIUC, =
we<BR>are=20
  using a production asset for QA testing purposes.&nbsp; I think =
this<BR>kind=20
  of testing is great -- but should we provision a separate link=20
  for<BR>it?&nbsp; Or use a router that is capable of doing QoS itself =
to=20
  throttle<BR>back the DMIP traffic?<BR><BR>Having the line swamped =
between 8pm=20
  and 6am will still affect me<BR>greatly, sorry to=20
  say.<BR><BR>Cheers,<BR><BR>a<BR><BR><BR>On Thu, 4 Oct 2007 17:44:45 =
-0700=20
  "Paul Hammer"<BR>&lt;paul.hammer@onstor.com&gt; wrote:<BR><BR>&gt; =
Kind of=20
  funny, most folks want this thing to go way faster. I<BR>&gt; =
understand why=20
  you would like=20
  slower.<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;=20
  ________________________________<BR>&gt;<BR>&gt; From: Brian =
Baker<BR>&gt;=20
  Sent: Thursday, October 04, 2007 3:59 PM<BR>&gt; To: Sandrine =
Boulanger; Paul=20
  Hammer; Andy Sharp; Brian Stark<BR>&gt; Cc: Raj Kumar<BR>&gt; Subject: =
RE:=20
  networking betwixt camphell and =
pleztown<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;=20
  Sandrine,<BR>&gt;<BR>&gt; As you can see by the mrtg graph traffic has =
gone=20
  back down. As a<BR>&gt; feature request to DMIP I would like to see =
bandwidth=20
  throttling on<BR>&gt; the filer side.<BR>&gt;<BR>&gt; <A=20
  =
href=3D"http://mrtg/mrtg/hp5308A/10.0.0.19_8.html">http://mrtg/mrtg/hp530=
8A/10.0.0.19_8.html</A><BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;&nbsp;<BR>&g=
t;<BR>&gt;=20
  From: Sandrine Boulanger<BR>&gt; Sent: Thursday, October 04, 2007 3:50 =

  PM<BR>&gt; To: Paul Hammer; Brian Baker; Andy Sharp; Brian =
Stark<BR>&gt; Cc:=20
  Raj Kumar<BR>&gt; Subject: RE: networking betwixt camphell and=20
  pleztown<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; Is it better=20
  now?<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; I changed the schedules to =
run=20
  between 22 and 6am.<BR>&gt;<BR>&gt; I paused a mirror that was already =
at 66%,=20
  we can resume it tonight.<BR>&gt;<BR>&gt; I have an issue with one =
mirror for=20
  which I cannot modify the schedule<BR>&gt; even if I do it from the GW =
that=20
  owns the vsvr. Mirror show NAME finds<BR>&gt; the mirror but mirror =
schedule=20
  NAME does not...<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; Welcome to the =
ONStor=20
  NAS Gateway.<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; g2r5&gt; vsvr=20
  show<BR>&gt;<BR>&gt; Virtual servers on nas gateway=20
  g2r5<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;&nbsp; ID&nbsp;=20
  =
State&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  Name<BR>&gt;<BR>&gt;=20
  =
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D<BR>&gt;<BR>&gt;=20
  1&nbsp;&nbsp;&nbsp;=20
  =
Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;=20
  VS_MGMT_588<BR>&gt;<BR>&gt; 9&nbsp;&nbsp;&nbsp;=20
  =
Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;=20
  G2R5-VS1<BR>&gt;<BR>&gt; 10&nbsp;&nbsp;=20
  =
Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;=20
  G2R5-VS2<BR>&gt;<BR>&gt; 11&nbsp;&nbsp;=20
  =
Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;=20
  G2R5-VS3<BR>&gt;<BR>&gt; 12&nbsp;&nbsp;=20
  =
Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;=20
  G2R5-VS4<BR>&gt;<BR>&gt; 13&nbsp;&nbsp;=20
  =
Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;=20
  GNSSRVR<BR>&gt;<BR>&gt; 18&nbsp;&nbsp;=20
  =
Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;=20
  G2R5-VS5<BR>&gt;<BR>&gt; 19&nbsp;&nbsp;=20
  =
Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;=20
  G2R5-VS6<BR>&gt;<BR>&gt; g2r5&gt; vsvr set G2R5-VS3<BR>&gt;<BR>&gt; =
g2r5=20
  G2R5-VS3&gt; mirror=20
  show<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp; Mirror=20
  Name&nbsp;&nbsp;&nbsp; AdminState&nbsp; Oper&nbsp; State&nbsp;=20
  Transferred&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Source<BR>&gt;=20
  Volume&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
Target=20
  Volume&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
VirtualServer<BR>&gt;<BR>&gt;=20
  ----------------&nbsp; ----------&nbsp; -----------&nbsp; =
-----------<BR>&gt;=20
  ----------------------&nbsp; ----------------------&nbsp;=20
  -------------<BR>&gt;<BR>&gt;&nbsp;&nbsp;=20
  g2r5-v1v2-dmip&nbsp;&nbsp;&nbsp;&nbsp;=20
  Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  Idle&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
0%<BR>&gt;=20
  g2r5-vs1-vol2&nbsp;=20
  g2r5-vs1-vol2@10.11.1.30&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  G2R5-VS1<BR>&gt;<BR>&gt;&nbsp;&nbsp; =
g2r5-v2v1-dmip&nbsp;&nbsp;&nbsp;&nbsp;=20
  Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  Idle&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
0%<BR>&gt;=20
  g2r5-vs2-vol1&nbsp;=20
  g2r5-vs2-vol1-dmip@10.11.1.30&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  G2R5-VS2<BR>&gt;<BR>&gt;&nbsp;&nbsp; =
g2r5-v3v1-dmip&nbsp;&nbsp;&nbsp;&nbsp;=20
  Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  Idle&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
0%<BR>&gt;=20
  g2r5-vs3-vol1&nbsp;=20
  g2r5-vs3-vol1-dmip@10.11.1.40&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  G2R5-VS3<BR>&gt;<BR>&gt;&nbsp; g2r5vs5-vol1-m1&nbsp;&nbsp;&nbsp;&nbsp; =

  Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  Idle&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 100%<BR>&gt;=20
  g2r5-vs5-vol1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  g2r5-vs5-vol1-m1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  G2R5-VS5<BR>&gt;<BR>&gt;&nbsp; g2r5vs4-vol1-m1&nbsp;&nbsp;&nbsp;&nbsp; =

  Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  Idle&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
0%<BR>&gt;=20
  g2r5-vs4-vol1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  g2r5vs4-vol1-m1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  G2R5-VS4<BR>&gt;<BR>&gt;&nbsp; g2r5vs4-vol5-m1&nbsp;&nbsp;&nbsp;&nbsp; =

  Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  Idle&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 100%<BR>&gt;=20
  g2r5-vs4-vol5&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  g2r5vs4-vol5-m1&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  G2R5-VS4<BR>&gt;<BR>&gt;&nbsp;&nbsp; =
g4r8-v2v1-dmip&nbsp;&nbsp;&nbsp;&nbsp;=20
  Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  Idle&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 100%<BR>&gt;=20
  g4r8-vs2-vol1&nbsp;=20
  g4r8-vs2-vol1-dmip@10.11.1.36&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  G4R8-VS2<BR>&gt;<BR>&gt;&nbsp; g12r9-v1v1-dmip&nbsp;&nbsp;&nbsp;&nbsp; =

  Enabled&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  Paused&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
66%<BR>&gt;=20
  g12r9-vs1-vol1&nbsp; =
g12r9-vs1-vol1@10.11.1.36&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
  G12R9-VS1<BR>&gt;<BR>&gt; g2r5 G2R5-VS3&gt;<BR>&gt;<BR>&gt; g2r5=20
  G2R5-VS3&gt;<BR>&gt;<BR>&gt; g2r5 G2R5-VS3&gt; mirror schedule =
g2r5-v3v1-dmip=20
  -h 0<BR>&gt;<BR>&gt;&nbsp; /<BR>&gt;<BR>&gt; Error: =
Mirror[g2r5-v3v1-dmip] not=20
  found.<BR>&gt;<BR>&gt; % Command failure.<BR>&gt;<BR>&gt; g2r5 =
G2R5-VS3&gt;=20
  elog show log 20<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:35:16 g2r5 : =
1:3:efs:INFO:=20
  16516: FS: g2r5-vs5-vol1-m1<BR>&gt; 0x24c000000dd - =
amDeltaInstallCommit - snp=20
  - snap resume: recal<BR>&gt; refbyte snapcounts for 1<BR>&gt;<BR>&gt;=20
  Oct&nbsp; 4 15:35:16 g2r5 : 1:2:efs:INFO: 16517: FS: =
g2r5-vs5-vol1-m1<BR>&gt;=20
  0x24c000000dd - amDeltaInstallCommit - snp - snap resume: =
recal<BR>&gt;=20
  refbyte snapcounts for 2<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:35:16 g2r5 :=20
  1:3:efs:INFO: 16518: FS: g2r5-vs5-vol1-m1<BR>&gt; 0x24c000000dd -=20
  amDeltaInstallCommit - snp - snap resume: recal<BR>&gt; refbyte =
snapcounts for=20
  3<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:35:19 g2r5 : 1:2:efs:INFO: 16519: FS: =

  g2r5-vs5-vol1-m1<BR>&gt; 0x24c000000dd - amDeltaInstallCommit - snp - =
snap=20
  revert mirror 3: end<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:35:19 g2r5 : =
1:3:efs:INFO:=20
  16520: FS: g2r5-vs5-vol1-m1<BR>&gt; 0x24c000000dd - =
amDeltaInstallCommit -=20
  mirror - FS AM TARGET: install<BR>&gt; commit reverted to snap 3 =
genNum 70 (=20
  )<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:35:19 g2r5 : 1:3:efs:INFO: 16521: FS: =

  g2r5-vs5-vol1<BR>&gt; 0x24c000000d9 - amDeltaComplete - mirror - FS =
AM:=20
  removing old unused<BR>&gt; snapshot=20
  SANM_SS_g2r5vs5-vol1-m1_0000024c000000d9_0000019f 1 gen =
70<BR>&gt;<BR>&gt;=20
  Oct&nbsp; 4 15:35:19 g2r5 : 1:2:efs:NOTICE: 16522: FS: =
g2r5-vs5-vol1<BR>&gt;=20
  0x24c000000d9 - amDeltaComplete - snp - snapnum 1 un =
pinned<BR>&gt;<BR>&gt;=20
  Oct&nbsp; 4 15:35:22 g2r5 : 1:3:efs:NOTICE: 16523: FS: =
g2r5-vs5-vol1<BR>&gt;=20
  0x24c000000d9 - amDeltaComplete - snp - snap remove complete =
for<BR>&gt;=20
  SANM_SS_g2r5vs5-vol1-m1_0000024c000000d9_0000019f id 1<BR>&gt;<BR>&gt; =

  Oct&nbsp; 4 15:35:22 g2r5 : 1:2:efs:INFO: 16524: FS: =
g2r5-vs5-vol1<BR>&gt;=20
  0x24c000000d9 - amDeltaComplete - mirror - FS AM: delta =
complete<BR>&gt;=20
  session<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:35:22 g2r5 : 0:0:sanm:NOTICE: =
Session=20
  terminated<BR>&gt; successfully for =
mirror[g2r5vs5-vol1-m1]<BR>&gt;<BR>&gt;=20
  Oct&nbsp; 4 15:35:25 g2r5 : 0:0:sanm:NOTICE: SANM: Mirror =
Completed:<BR>&gt;=20
  g2r5vs5-vol1-m1<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:36:13 g2r5 : =
0:0:sanm:NOTICE:=20
  sanm_procRemoteModifyRsp:<BR>&gt; Error: Mirror[g2r5-v3v1-dmip] not=20
  found.<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:36:13 g2r5 : 0:0:sanm:NOTICE:=20
  sanm_procRemoteModifyRsp:<BR>&gt; remote modify failed,=20
  rc[-6654]<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:36:46 g2r5 : 0:0:ssh:INFO: =
'admin'=20
  logged in through remote<BR>&gt; host(10.0.0.79)<BR>&gt;<BR>&gt; =
Oct&nbsp; 4=20
  15:36:49 g2r5 : 0:0:nfxsh:NOTICE: cmd[0]: vsvr show :=20
  status[0]<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:36:54 g2r5 : =
0:0:nfxsh:NOTICE:=20
  cmd[1]: vsvr set G2R5-VS3 :<BR>&gt; status[0]<BR>&gt;<BR>&gt; =
Oct&nbsp; 4=20
  15:36:59 g2r5 : 0:0:nfxsh:NOTICE: cmd[2]: mirror show&nbsp; :<BR>&gt;=20
  status[0]<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:37:24 g2r5 : 0:0:sanm:NOTICE: =

  sanm_procRemoteModifyRsp:<BR>&gt; Error: Mirror[g2r5-v3v1-dmip] not=20
  found.<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:37:24 g2r5 : 0:0:sanm:NOTICE:=20
  sanm_procRemoteModifyRsp:<BR>&gt; remote modify failed,=20
  rc[-6654]<BR>&gt;<BR>&gt; Oct&nbsp; 4 15:37:24 g2r5 : =
0:0:nfxsh:NOTICE:=20
  cmd[3]: mirror schedule<BR>&gt; g2r5-v3v1-dmip -h 0 :=20
  status[11]<BR>&gt;<BR>&gt; g2r5 G2R5-VS3&gt;<BR>&gt;<BR>&gt; g2r5 =
G2R5-VS3&gt;=20
  mirror show g2r5-v3v1-dmip<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; =
Mirror=20
  =
Name&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp; :=20
  g2r5-v3v1-dmip<BR>&gt;<BR>&gt; Admin=20
  =
State&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;=20
  : Enabled<BR>&gt;<BR>&gt; Operational=20
  State&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; : Idle<BR>&gt;<BR>&gt; =
Mirror=20
  =
Load&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp; :=20
  MED<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; Source Vol=20
  Name&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :=20
  g2r5-vs3-vol1<BR>&gt;<BR>&gt; Source Vol=20
  Id&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :=20
  0x24c00000080<BR>&gt;<BR>&gt; Mirror Vol=20
  Name&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :=20
  g2r5-vs3-vol1-dmip@10.11.1.40<BR>&gt;<BR>&gt; Mirror Vol=20
  Id&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :=20
  0x4100000006b<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; Mirror Secondary =
Node Name=20
  : None<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; Mirror Schedule =
:<BR>&gt;<BR>&gt;=20
  -----------------<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp;=20
  Minute&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :=20
  *<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp;=20
  Hour&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; : 0 2 4 6 8 10 12 =
14 16=20
  18 20 22<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp; Day Of Month :=20
  *<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp;=20
  Month&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :=20
  *<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp; Day Of Week&nbsp; :=20
  *<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; Counters:<BR>&gt;<BR>&gt;=20
  ---------<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp; Mirror Start=20
  Count&nbsp;&nbsp;&nbsp; : 0<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp; Mirror =
Complete=20
  Count : 0<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp; Mirror Abort=20
  Count&nbsp;&nbsp;&nbsp; : 0<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; Last =
Mirror=20
  Session Information:<BR>&gt;<BR>&gt;=20
  --------------------------------<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp; =
Mirror=20
  Started&nbsp;&nbsp;&nbsp;&nbsp; :<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp; =
Mirror=20
  Finished&nbsp;&nbsp;&nbsp; :<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp; Bytes=20
  Transferred&nbsp; : 0 (MB)<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp; Percent=20
  Transferred: 0%<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp;=20
  Throughput&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; : 0=20
  (bytes/s)<BR>&gt;<BR>&gt;&nbsp;&nbsp;&nbsp; Snapshot=20
  Name&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; :<BR>&gt;=20
  =
SANM_SS_g2r5-v3v1-dmip_0000024c00000080_0000109b<BR>&gt;<BR>&gt;&nbsp;&nb=
sp;&nbsp;=20
  Session Status&nbsp;&nbsp;&nbsp;&nbsp; =
:<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;=20
  g2r5 =
G2R5-VS3&gt;<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; =

  -----Original Message-----<BR>&gt; From: Paul Hammer<BR>&gt; Sent: =
Thursday,=20
  October 04, 2007 3:13 PM<BR>&gt; To: Brian Baker; Andy Sharp; Brian=20
  Stark<BR>&gt; Cc: Raj Kumar; Sandrine Boulanger<BR>&gt; Subject: RE:=20
  networking betwixt camphell and =
pleztown<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;=20
  Sandrine do you know?<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; =
-----Original=20
  Message-----<BR>&gt;<BR>&gt; From: Brian Baker<BR>&gt;<BR>&gt; Sent: =
Thursday,=20
  October 04, 2007 3:05 PM<BR>&gt;<BR>&gt; To: Andy Sharp; Brian=20
  Stark<BR>&gt;<BR>&gt; Cc: Raj Kumar; Paul Hammer; Sandrine=20
  Boulanger<BR>&gt;<BR>&gt; Subject: RE: networking betwixt camphell and =

  pleztown<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; Raj,<BR>&gt;<BR>&gt; It =
appears=20
  that the dmip mirros are still going. Can you stop these<BR>&gt; =
immediately?=20
  Let me know if you believe you have stopped your mirror,<BR>&gt; if so =
I will=20
  find the =
culprit.<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;=20
  -----Original Message-----<BR>&gt;<BR>&gt; From: Andy =
Sharp<BR>&gt;<BR>&gt;=20
  Sent: Thursday, October 04, 2007 3:02 PM<BR>&gt;<BR>&gt; To: Brian=20
  Stark<BR>&gt;<BR>&gt; Cc: Brian Baker<BR>&gt;<BR>&gt; Subject: Re: =
networking=20
  betwixt camphell and pleztown<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; =
I'm not=20
  sure where this got left off, but does this mean we know =
what<BR>&gt;<BR>&gt;=20
  the traffic is?&nbsp; Can we try pulling the plug on that IP=20
  address?<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;=20
  Thanks,<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt;=20
  a<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; On Wed, 3 Oct 2007 18:04:22 =
-0700=20
  "Brian Stark"<BR>&gt;<BR>&gt; &lt;brian.stark@onstor.com&gt;=20
  wrote:<BR>&gt;<BR>&gt;&nbsp;<BR>&gt;<BR>&gt; &gt; I'll go unplug the =
array=20
  that's spinning like crazy back there...<BR>&gt;<BR>&gt;=20
  &gt;&nbsp;<BR>&gt;<BR>&gt; &gt;<BR>&gt;<BR>&gt; &gt; &gt; =
-----Original=20
  Message-----<BR>&gt;<BR>&gt; &gt; &gt; From: Andy =
Sharp<BR>&gt;<BR>&gt; &gt;=20
  &gt; Sent: Wednesday, October 03, 2007 5:48 PM<BR>&gt;<BR>&gt; &gt; =
&gt; To:=20
  Brian Baker<BR>&gt;<BR>&gt; &gt; &gt; Cc: Brian Stark<BR>&gt;<BR>&gt; =
&gt;=20
  &gt; Subject: Re: networking betwixt camphell and =
pleztown<BR>&gt;<BR>&gt;=20
  &gt; &gt;<BR>&gt;<BR>&gt; &gt; &gt; I'm all for blocking it and seeing =
{what=20
  happens,who<BR>&gt;<BR>&gt; &gt; &gt; squeals}.&nbsp; Who's with=20
  me?<BR>&gt;<BR>&gt; &gt; &gt;<BR>&gt;<BR>&gt; &gt; &gt; I can't see =
the=20
  included link because I'm remote and I can't<BR>&gt;<BR>&gt; &gt; &gt; =
get an=20
  ssh proxy to work &lt;hangs his head in shame&gt;.<BR>&gt;<BR>&gt; =
&gt;=20
  &gt;<BR>&gt;<BR>&gt; &gt; &gt; a<BR>&gt;<BR>&gt; &gt; =
&gt;<BR>&gt;<BR>&gt;=20
  &gt; &gt;<BR>&gt;<BR>&gt; &gt; &gt; On Wed, 3 Oct 2007 17:18:33 -0700 =
"Brian=20
  Baker"<BR>&gt;<BR>&gt; &gt; &gt; &lt;brian.baker@onstor.com&gt;=20
  wrote:<BR>&gt;<BR>&gt; &gt; &gt;<BR>&gt;<BR>&gt; &gt; &gt; &gt; =
Someone is=20
  hogging the connection up there. Take a look at MRTG.<BR>&gt;<BR>&gt; =
&gt;=20
  &gt; &gt; <A=20
  =
href=3D"http://mrtg/mrtg/hp5308A/10.0.0.19_8.html">http://mrtg/mrtg/hp530=
8A/10.0.0.19_8.html</A><BR>&gt;<BR>&gt;=20
  &gt; &gt; &gt; This is the Pleasanton uplink.<BR>&gt;<BR>&gt; &gt; =
&gt; &gt;=20
  We can ask who has been whoring the connection and ask them =
to<BR>&gt;<BR>&gt;=20
  &gt; &gt; &gt; stop. Or I can look into it further and block their=20
  traffic.<BR>&gt;<BR>&gt; &gt; &gt; &gt;<BR>&gt;<BR>&gt; &gt; &gt; &gt; =

  -----Original Message-----<BR>&gt;<BR>&gt; &gt; &gt; &gt; From: Brian=20
  Baker<BR>&gt;<BR>&gt; &gt; &gt; &gt; Sent: Wednesday, October 03, 2007 =
4:55=20
  PM<BR>&gt;<BR>&gt; &gt; &gt; &gt; To: Andy Sharp; Brian =
Stark<BR>&gt;<BR>&gt;=20
  &gt; &gt; &gt; Subject: RE: networking betwixt camphell and=20
  pleztown<BR>&gt;<BR>&gt; &gt; &gt; &gt;<BR>&gt;<BR>&gt; &gt; &gt; &gt; =

  Andy,<BR>&gt;<BR>&gt; &gt; &gt; &gt; Thx for reporting this. Kevin was =
up=20
  there last week and he<BR>&gt;<BR>&gt; &gt; &gt; =
reported<BR>&gt;<BR>&gt; &gt;=20
  &gt; &gt; the issue was resolved. I will take a look into this.=20
  But<BR>&gt;<BR>&gt; &gt; &gt; as you know<BR>&gt;<BR>&gt; &gt; &gt; =
&gt; I'm=20
  very blah so I probably won't be able to look at it =
until<BR>&gt;<BR>&gt; &gt;=20
  &gt; &gt; blah.<BR>&gt;<BR>&gt; &gt; &gt; &gt;<BR>&gt;<BR>&gt; &gt; =
&gt; &gt;=20
  -----Original Message-----<BR>&gt;<BR>&gt; &gt; &gt; &gt; From: Andy=20
  Sharp<BR>&gt;<BR>&gt; &gt; &gt; &gt; Sent: Wednesday, October 03, 2007 =
4:17=20
  PM<BR>&gt;<BR>&gt; &gt; &gt; &gt; To: Brian Stark<BR>&gt;<BR>&gt; &gt; =
&gt;=20
  &gt; Cc: Brian Baker<BR>&gt;<BR>&gt; &gt; &gt; &gt; Subject: =
networking=20
  betwixt camphell and pleztown<BR>&gt;<BR>&gt; &gt; &gt; =
&gt;<BR>&gt;<BR>&gt;=20
  &gt; &gt; &gt; I'm sure everyone knows by now, but I just thought I =
would=20
  put<BR>&gt; &gt; &gt; &gt; my<BR>&gt;<BR>&gt; &gt; &gt; &gt; notice in =
just in=20
  case.<BR>&gt;<BR>&gt; &gt; &gt; &gt;<BR>&gt;<BR>&gt; &gt; &gt; &gt; =
Networking=20
  between Campbell and Pleasanton has slowed to a<BR>&gt;<BR>&gt; &gt; =
&gt;=20
  crawl, and<BR>&gt;<BR>&gt; &gt; &gt; &gt; it's impacting my work, as =
well as=20
  others, I'm guessing, pretty<BR>&gt;<BR>&gt; &gt; &gt; &gt;=20
  significantly.<BR>&gt;<BR>&gt; &gt; &gt; &gt;<BR>&gt;<BR>&gt; &gt; =
&gt; &gt;=20
  Transfering a kernel to 10.1.1.189 goes at about =
100-160<BR>&gt;<BR>&gt; &gt;=20
  &gt; KiB/s, down<BR>&gt;<BR>&gt; &gt; &gt; &gt; from 6-700 KiB=20
  yesterday.&nbsp; It takes my cougar about 10<BR>&gt;<BR>&gt; &gt; &gt; =
minutes=20
  to boot<BR>&gt;<BR>&gt; &gt; &gt; &gt; just to single user mode (NFS =
root is=20
  located in campbell),<BR>&gt;<BR>&gt; &gt; &gt; and =
that<BR>&gt;<BR>&gt; &gt;=20
  &gt; &gt; means about 4-5 reboots an hour, when really I need about=20
  12-15<BR>&gt;<BR>&gt; &gt; &gt; &gt; reboots an hour.<BR>&gt;<BR>&gt; =
&gt;=20
  &gt; &gt;<BR>&gt;<BR>&gt; &gt; &gt; &gt; I know everyone has a lot to =
do and=20
  blah-blah, but I didn't want<BR>&gt;<BR>&gt; &gt; &gt; &gt; to keep it =
a=20
  secret either.<BR>&gt;<BR>&gt; &gt; &gt; &gt;<BR>&gt;<BR>&gt; &gt; =
&gt; &gt;=20
  Cheers,<BR>&gt;<BR>&gt; &gt; &gt; &gt;<BR>&gt;<BR>&gt; &gt; &gt; &gt;=20
  a<BR>&gt;<BR>&gt; &gt;=20
&gt;<BR>&gt;<BR></FONT></P></DIV></DIV></DIV></BLOCKQUOTE></BODY></HTML>

------_=_NextPart_001_01C811A7.AA06485B--
