X-MimeOLE: Produced By Microsoft Exchange V6.5
Received: by onstor-exch02.onstor.net 
	id <01C892F2.BCA27D78@onstor-exch02.onstor.net>; Sun, 30 Mar 2008 22:47:42 -0700
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----_=_NextPart_001_01C892F2.BCA27D78"
Content-class: urn:content-classes:message
Subject: RE: nfs commits, lookups and creates
Date: Sun, 30 Mar 2008 22:47:40 -0700
Message-ID: <BB375AF679D4A34E9CA8DFA650E2B04E091AB400@onstor-exch02.onstor.net>
In-Reply-To: <BB375AF679D4A34E9CA8DFA650E2B04E091AB3D5@onstor-exch02.onstor.net>
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
Thread-Topic: nfs commits, lookups and creates
Thread-Index: AciS4qsgh+48Hq+iQW2H16CZOQsIDQADp0lw
References: <BB375AF679D4A34E9CA8DFA650E2B04E091AB3D5@onstor-exch02.onstor.net>
From: "Jonathan Goldick" <jonathan.goldick@onstor.com>
To: "Dave Limato" <dave.limato@onstor.com>,
	"dl-cstech" <dl-cstech@onstor.com>

This is a multi-part message in MIME format.

------_=_NextPart_001_01C892F2.BCA27D78
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Focus on where the majority of the time is spent, read and write.  That
commit is an insignificant amount of the time so ignore it.
For the read test the lcl client has an NFS read avg of 4.7ms but the VM
client has 22ms, for NFS write you get 3ms vs. 11.6ms.  This is where
you should focus.
There is a similar behavior for the write test.

As I understand it, and I'm by no means an expert, VM is using its own
EFS file system which is running against our NFS.  I dimly remember this
as being stored in NFS as one, or a few, big files that are read and
written as an array of blocks for EFS.  If true, then our locking model
in the TXRX and FP works against you here since we have a lock per file.
While Max made some major improvements in 3.2 for a read/write mix
within a large file, this will never be as fast as actually using
separate files via NFS.  If you were to set the 'stats tx time 4'  and
'stats fp time 4' I would expect to see you spending a lot of time
contending for the FCB lock in the TXRX and the inode lock in the FP.




_____________________________________________
From: Dave Limato=20
Sent: Sunday, March 30, 2008 8:53 PM
To: dl-cstech
Subject: nfs commits, lookups and creates

We have been debugging a performance related issue and we have pulled
the KPI's and attached them.
We have noticed super slow READ throughput when using a VM. We compared
the VM to a Working Linux client and grabbed the kpi data. Complete data
is stored in /n/newcorevol/defect_22846. The NAS is running 3203.=20

The summary of the read requests shows that one client does nfs commits,
the other does not.
Additionally, on Writes NFS_V3_WRITE average is a bit higher

Am I on the write track regarding the analysis? Any comments thoughts or
suggestions would be helpful.
Thank You in Advance!
Dave
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
 << File: 22846-kpi.zip >>=20

READ READ READ READ READ READ READ READ READ READ READ READ READ READ
READ READ READ=20
READ READ READ READ READ READ READ READ READ READ READ READ READ READ
READ READ READ=20

LINUX
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
-bash-3.00$
/n/build-trees/R3.2.0.3/R3.2.0.3-022708/nfx-tree/Build/x86utils/kpi-ui
-f lc14_nfs_reads.kpi -r
kpi                                        count        total
avg         txrx    txrx avg           fp      fp avg           fc
fc avg
FS_EVM_WRITE                                  32     0.052041
0.001626     0.000000     0.000000     0.052041     0.001626
0.001712     0.000053
FS_EVM_READ                                   20     0.007674
0.000383     0.000000     0.000000     0.007674     0.000383
0.001525     0.000076
NFS_V3_READ                                 5247    24.844531
0.004734    24.721119     0.004711     0.000229     0.000000
0.091344     0.000017
NFS_V3_WRITE                                   9     0.027710
0.003078     0.000325     0.000036     0.001977     0.000219
0.000248     0.000027
NFS_V3_ACCESS                                  2     0.000053
0.000026     0.000050     0.000025     0.000000     0.000000
0.000000     0.000000
DCACHE_READAHEAD                            5260    19.802896
0.003764     0.060124     0.000011     0.413370     0.000078
54.397476     0.010341
PKT_RX                                 167423114 22403.589656
0.000133 22403.589656     0.000133     0.000000     0.000000
0.000000     0.000000
NFS_V3_GETATTR                                 9     0.000374
0.000041     0.000239     0.000026     0.000000     0.000000
0.000000     0.000000


VM
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
-bash-3.00$
/n/build-trees/R3.2.0.3/R3.2.0.3-022708/nfx-tree/Build/x86utils/kpi-ui
-f lcvm_reads.kpi -r
kpi                                        count        total
avg         txrx    txrx avg           fp      fp avg           fc
fc avg
FS_EVM_WRITE                                1245     1.386447
0.001113     0.000000     0.000000     1.386447     0.001113
0.182858     0.000146
FS_EVM_READ                                  651     0.191432
0.000294     0.000000     0.000000     0.191432     0.000294
0.023309     0.000035
NFS_V3_COMMIT   <<<<<<<                  72   0.322727    0.004482
0.038471    0.000534   0.008040    0.000111   0.575923    0.007998
NFS_V3_READ                                 2188    48.346003
0.022095    48.337616     0.022092     0.014505     0.000006
0.012396     0.000005
NFS_V3_WRITE                                6399    74.070921
0.011575    70.728324     0.011053     1.442313     0.000225
31.111700     0.004861
NFS_V3_ACCESS                                  3     0.000082
0.000027     0.000078     0.000026     0.000000     0.000000
0.000000     0.000000
DCACHE_READAHEAD                             210     0.073800
0.000351     0.001297     0.000006     0.020630     0.000098
1.132487     0.005392
PKT_RX                                 188840598 22685.743032
0.000120 22685.743032     0.000120     0.000000     0.000000
0.000000     0.000000
NFS_V3_LOOKUP  <<<<<<<        				 1    0.000070
0.000070   0.000041    0.000041   0.000027    0.000027   0.000000
0.000000
NFS_V3_CREATE  <<<<<<<        				 1    0.000860
0.000860   0.000088    0.000088   0.000308    0.000308   0.000018
0.000018
NFS_V3_GETATTR                               197     0.003561
0.000018     0.002990     0.000015     0.000000     0.000000
0.000000     0.000000

VM
-bash-3.00$
/n/build-trees/R3.2.0.3/R3.2.0.3-022708/nfx-tree/Build/x86utils/kpi-ui
-f lcvm_reads.kpi -c NFS_V3_COMMIT
kpi                                        calls        total seconds
seconds/call
NFS_V3_COMMIT                                 72             0.322727
0.004482
  PKT_NCPU_QUEUE                                72             0.000098
0.000001
  PKT_TX                                        72             0.000146
0.000002
  PKT_RPC_REASM                                 72             0.002958
0.000041
  NFS_OPEN_HANDLE                               72             0.034160
0.000474
  PKT_ACPU_QUEUE                                72             0.001193
0.000016
  DCACHE_COMMIT                                 72             0.283157
0.003932
  NFS_REPLY                                     72             0.000330
0.000004



WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE
WRITE WRITE WRITE WRITE=20
WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE
WRITE WRITE WRITE WRITE=20

LINUX
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
-bash-3.00$
/n/build-trees/R3.2.0.3/R3.2.0.3-022708/nfx-tree/Build/x86utils/kpi-ui
-f lc14_nfs_write.kpi -r
kpi                                        count        total
avg         txrx    txrx avg           fp      fp avg           fc
fc avg
FS_EVM_WRITE                                5608   127.818157
0.022792     0.000000     0.000000   127.818157     0.022792
116.534776     0.020780
FS_EVM_READ                                   90     0.062379
0.000693     0.000000     0.000000     0.062379     0.000693
0.017432     0.000193
NFS_V3_READ                                  193     0.370917
0.001921     0.370560     0.001920     0.000241     0.000001
0.000000     0.000000
NFS_V3_WRITE      <<<<<<                    5297    15.614921
0.002947    13.978049     0.002638     1.318470     0.000248
125.645523     0.023720
DCACHE_READAHEAD  <<<<<<                      22     0.000128
0.000005     0.000128     0.000005     0.000000     0.000000
0.000000     0.000000
PKT_RX                                 168321587 22432.762425
0.000133 22432.762425     0.000133     0.000000     0.000000
0.000000     0.000000
NFS_V3_LOOKUP                                  1     0.000171
0.000171     0.000055     0.000055     0.000105     0.000105
0.000000     0.000000
NFS_V3_CREATE                                  1     0.001112
0.001112     0.000089     0.000089     0.000331     0.000331
0.000052     0.000052
NFS_V3_GETATTR        <<<<<<                  29     0.000495
0.000017     0.000449     0.000015     0.000000     0.000000
0.000000     0.000000

VM
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
-bash-3.00$
/n/build-trees/R3.2.0.3/R3.2.0.3-022708/nfx-tree/Build/x86utils/kpi-ui
-f lcvm_write.kpi -r
kpi                                        count        total
avg         txrx    txrx avg           fp      fp avg           fc
fc avg
FS_EVM_WRITE                                 721     0.795502
0.001103     0.000000     0.000000     0.795502     0.001103
0.105277     0.000146
FS_EVM_READ                                  392     0.109339
0.000278     0.000000     0.000000     0.109339     0.000278
0.013907     0.000035
NFS_V3_READ                                   49     0.433681
0.008850     0.433558     0.008848     0.002163     0.000044
0.001505     0.000030
NFS_V3_WRITE      <<<<<<                    1097    14.459296
0.013180    13.487867     0.012295     0.251708     0.000229
1.815289     0.001654
NFS_V3_ACCESS                                  1     0.000033
0.000033     0.000032     0.000032     0.000000     0.000000
0.000000     0.000000
PKT_RX                                 188605613 22543.366395
0.000119 22543.366395     0.000119     0.000000     0.000000
0.000000     0.000000
NFS_V3_LOOKUP                                  1     0.000070
0.000070     0.000041     0.000041     0.000027     0.000027
0.000000     0.000000
NFS_V3_CREATE                                  1     0.000860
0.000860     0.000088     0.000088     0.000308     0.000308
0.000018     0.000018
NFS_V3_GETATTR      <<<<<<                   122     0.002217
0.000018     0.001795     0.000014     0.000000     0.000000
0.000000     0.000000

------_=_NextPart_001_01C892F2.BCA27D78
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Dus-ascii">
<META NAME=3D"Generator" CONTENT=3D"MS Exchange Server version =
6.5.7653.38">
<TITLE>RE: nfs commits, lookups and creates</TITLE>
</HEAD>
<BODY>
<!-- Converted from text/rtf format -->

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">F</FONT><FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">ocus on whe</FONT><FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">r</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">e</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"><FONT COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial"> the =
majority of the time is spent, read and write.&nbsp;</FONT> <FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">That commit is an =
insignificant amount of the time so ignore it.</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT COLOR=3D"#000080" SIZE=3D2 =
FACE=3D"Arial">For the read test the lcl client has</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"> <FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">an</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"> <FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">NFS</FONT> <FONT COLOR=3D"#000080" SIZE=3D2 =
FACE=3D"Arial">read avg of</FONT> <FONT COLOR=3D"#000080" SIZE=3D2 =
FACE=3D"Arial">4.7ms but the VM client has</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"> <FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">22ms, for NFS write you get 3ms vs</FONT><FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">.</FONT> <FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">11.6ms.&nbsp; This is where =
you should focus.</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT COLOR=3D"#000080" SIZE=3D2 =
FACE=3D"Arial">There is a similar behavior for the write =
test.</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT COLOR=3D"#000080" SIZE=3D2 =
FACE=3D"Arial">As I</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"> <FONT COLOR=3D"#000080" SIZE=3D2 =
FACE=3D"Arial">understand</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"><FONT COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial"></FONT> =
<FONT COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">it, and =
I</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">&#8217;</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">m by no means an expert, VM is using =
it</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">s own EFS file system</FONT> =
<FONT COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">which is running against =
our NFS.&nbsp; I dimly remember this as being</FONT> <FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">stored in NFS as one, or a =
few, big files that are read and written</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"> <FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">as an array of blocks for EFS.&nbsp; If true, =
then our locking model in the TXRX</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"> <FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">and FP</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"> <FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">works against you here since we have a =
loc</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">k per file.&nbsp; While Max =
made some major improvements in 3.2 for a</FONT> <FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">read/write mix within a large file, this will =
never be as fast as actually using separate files via =
NFS.</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">&nbsp; If you were to set =
the</FONT></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"> <FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial">&#8216;</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">stats tx time 4</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">&#8217;</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">&nbsp; and</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"> <FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">&#8216;</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">stats fp time 4</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial">&#8217;</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT COLOR=3D"#000080" =
SIZE=3D2 FACE=3D"Arial"> I would expect to see you spending a lot of =
time contending for the FCB lock</FONT> <FONT COLOR=3D"#000080" SIZE=3D2 =
FACE=3D"Arial">in the TXRX and the inode lock</FONT><FONT =
COLOR=3D"#000080" SIZE=3D2 FACE=3D"Arial"> in the FP.</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT =
SIZE=3D2 =
FACE=3D"Tahoma">_____________________________________________<BR>
</FONT></SPAN><SPAN LANG=3D"en-us"><B></B></SPAN><SPAN =
LANG=3D"en-us"><B><FONT SIZE=3D2 =
FACE=3D"Tahoma">From:</FONT></B></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Tahoma"> Dave Limato<BR>
</FONT></SPAN><SPAN LANG=3D"en-us"><B></B></SPAN><SPAN =
LANG=3D"en-us"><B><FONT SIZE=3D2 =
FACE=3D"Tahoma">Sent:</FONT></B></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Tahoma"> Sunday, March 30, 2008 =
8:53 PM<BR>
</FONT></SPAN><SPAN LANG=3D"en-us"><B></B></SPAN><SPAN =
LANG=3D"en-us"><B><FONT SIZE=3D2 =
FACE=3D"Tahoma">To:</FONT></B></SPAN><SPAN LANG=3D"en-us"></SPAN><SPAN =
LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Tahoma"> dl-cstech<BR>
</FONT></SPAN><SPAN LANG=3D"en-us"><B></B></SPAN><SPAN =
LANG=3D"en-us"><B><FONT SIZE=3D2 =
FACE=3D"Tahoma">Subject:</FONT></B></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Tahoma"> nfs commits, lookups and creates</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT =
SIZE=3D2 FACE=3D"Courier">We have been debugging a performance related =
issu</FONT><FONT SIZE=3D2 FACE=3D"Courier">e and we have pulled the =
KPI's and attached them.</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">We =
have noticed super slow READ throughput when using a VM. We compared the =
VM to a Working Linux client and grabbed the kpi data. Complete data is =
stored in /n/newcorevol/defect_22846. The NAS is running 3</FONT><FONT =
SIZE=3D2 FACE=3D"Courier">203. </FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">The =
summary of the read requests shows that one client does nfs commits, the =
other does not.</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">Additionally, on Writes NFS_V3_WRITE average is a bit =
higher</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">Am I =
on the write track regarding the analysis? Any comments thoughts or =
suggestions would be helpful.</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">Thank =
You in Advance!</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">Dave</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT FACE=3D"Times New =
Roman">&nbsp;&lt;&lt; File: 22846-kpi.zip &gt;&gt;</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"> </SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">READ =
READ READ READ READ READ READ READ READ READ READ READ READ READ READ =
READ READ </FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">READ =
READ READ READ READ READ READ READ READ READ READ READ READ READ READ =
READ READ </FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">LINUX</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D</FONT><FONT SIZE=3D2 =
FACE=3D"Courier">=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">-bash-3.00$ =
/n/build-trees/R3.2.0.3/R3.2.0.3-022708/nfx-tree/Build/x86utils/kpi-ui =
-f lc14_nfs_reads.kpi -r</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">kpi&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
count&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
total&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
avg&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
txrx&nbsp;&nbsp;&nbsp; txrx =
avg&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
fp&nbsp;&nbsp;&nbsp;&nbsp;</FONT>&nbsp;<FONT SIZE=3D2 FACE=3D"Courier"> =
fp avg&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
fc&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; fc avg</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">FS_EVM_WRITE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp; 32&nbsp;&nbsp;&nbsp;&nbsp; 0.052041&nbsp;&nbsp;&nbsp;&nbsp; =
0.001626&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.052041&nbsp;&nbsp;&nbsp;&nbsp; =
0.001626&nbsp;&nbsp;&nbsp;&nbsp; 0.001712&nbsp;&nbsp;&nbsp;&nbsp; =
0.000053</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">FS_EVM_READ&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp; 20&nbsp;&nbsp;&nbsp;&nbsp; =
0.007674&nbsp;&nbsp;&nbsp;&nbsp; 0.00</FONT><FONT SIZE=3D2 =
FACE=3D"Courier">0383&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.007674&nbsp;&nbsp;&nbsp;&nbsp; 0.000383&nbsp;&nbsp;&nbsp;&nbsp; =
0.001525&nbsp;&nbsp;&nbsp;&nbsp; 0.000076</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_READ&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
; 5247&nbsp;&nbsp;&nbsp; 24.844531&nbsp;&nbsp;&nbsp;&nbsp; =
0.004734&nbsp;&nbsp;&nbsp; 24.721119&nbsp;&nbsp;&nbsp;&nbsp; =
0.004711&nbsp;&nbsp;&nbsp;&nbsp; 0.000229&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.091344&nbsp;&nbsp;&nbsp;&nbsp; =
0.000017</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_WRITE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;</=
FONT> <FONT SIZE=3D2 =
FACE=3D"Courier">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp; 9&nbsp;&nbsp;&nbsp;&nbsp; =
0.027710&nbsp;&nbsp;&nbsp;&nbsp; 0.003078&nbsp;&nbsp;&nbsp;&nbsp; =
0.000325&nbsp;&nbsp;&nbsp;&nbsp; 0.000036&nbsp;&nbsp;&nbsp;&nbsp; =
0.001977&nbsp;&nbsp;&nbsp;&nbsp; 0.000219&nbsp;&nbsp;&nbsp;&nbsp; =
0.000248&nbsp;&nbsp;&nbsp;&nbsp; 0.000027</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_ACCESS&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp; 2&nbsp;&nbsp;&nbsp;&nbsp; 0.000053&nbsp;&nbsp;&nbsp;&nbsp; =
0.000026&nbsp;&nbsp;&nbsp;&nbsp; 0.000050&nbsp;&nbsp;&nbsp;&nbsp; =
0.000025&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000</FONT><FONT SIZE=3D2 FACE=3D"Courier">000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">DCACHE_READAHEAD&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 5260&nbsp;&nbsp;&nbsp; =
19.802896&nbsp;&nbsp;&nbsp;&nbsp; 0.003764&nbsp;&nbsp;&nbsp;&nbsp; =
0.060124&nbsp;&nbsp;&nbsp;&nbsp; 0.000011&nbsp;&nbsp;&nbsp;&nbsp; =
0.413370&nbsp;&nbsp;&nbsp;&nbsp; 0.000078&nbsp;&nbsp;&nbsp; =
54.397476&nbsp;&nbsp;&nbsp;&nbsp; 0.010341</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">PKT_RX&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
167423114 22403.589656&nbsp;&nbsp;&nbsp;&nbsp; 0.00013</FONT><FONT =
SIZE=3D2 FACE=3D"Courier">3 22403.589656&nbsp;&nbsp;&nbsp;&nbsp; =
0.000133&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_GETATTR&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp; 9&nbsp;&nbsp;&nbsp;&nbsp; 0.000374&nbsp;&nbsp;&nbsp;&nbsp; =
0.000041&nbsp;&nbsp;&nbsp;&nbsp; 0.000239&nbsp;&nbsp;&nbsp;&nbsp; =
0.000026&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000</FONT></SPAN></P>
<BR>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">VM</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D</=
FONT><FONT SIZE=3D2 =
FACE=3D"Courier">=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D</FONT></SPAN=
></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">-bash-3.00$ =
/n/build-trees/R3.2.0.3/R3.2.0.3-022708/nfx-tree/Build/x86utils/kpi-ui =
-f lcvm_reads.kpi -r</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">kpi&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
count&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; total</FONT> <FONT =
SIZE=3D2 =
FACE=3D"Courier">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
avg&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
txrx&nbsp;&nbsp;&nbsp; txrx =
avg&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
fp&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; fp =
avg&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
fc&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; fc avg</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">FS_EVM_WRITE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
1245&nbsp;&nbsp;&nbsp;&nbsp; 1.386447&nbsp;&nbsp;&nbsp;&nbsp; =
0.001113&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 1.386447&nbsp;&nbsp;&nbsp;&nbsp; =
0.001113&nbsp;&nbsp;&nbsp;&nbsp; 0.182858&nbsp;&nbsp;&nbsp;&nbsp; =
0.000146</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">FS_EVM_READ&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp; 651&nbsp;&nbsp;&nbsp;&nbsp; 0.191432&nbsp;&nbsp;&nbsp;&nbsp; =
0.000294&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.191432&nbsp;&nbsp;&nbsp;&nbsp; =
0.000294&nbsp;&nbsp;&nbsp;&nbsp; 0.023309&nbsp;&nbsp;&nbsp;&nbsp; =
0.000035</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><B></B></SPAN><SPAN =
LANG=3D"en-us"><B><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_COMMIT&nbsp;&nbsp; =
&lt;&lt;&lt;&lt;&lt;&lt;&lt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 72&nbsp;&nbsp; =
0.322727&nbsp;&nbsp;&nbsp; 0.004482&nbsp;&nbsp;&nbsp; =
0.038471&nbsp;&nbsp;&nbsp; 0.000534&nbsp;&nbsp; 0.008040&nbsp;</FONT> =
<FONT SIZE=3D2 FACE=3D"Courier">&nbsp; 0.000111&nbsp;&nbsp; =
0.575923&nbsp;&nbsp;&nbsp; 0.007998</FONT></B></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT =
SIZE=3D2 =
FACE=3D"Courier">NFS_V3_READ&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
; 2188&nbsp;&nbsp;&nbsp; 48.346003&nbsp;&nbsp;&nbsp;&nbsp; =
0.022095&nbsp;&nbsp;&nbsp; 48.337616&nbsp;&nbsp;&nbsp;&nbsp; =
0.022092&nbsp;&nbsp;&nbsp;&nbsp; 0.014505&nbsp;&nbsp;&nbsp;&nbsp; =
0.000006&nbsp;&nbsp;&nbsp;&nbsp; 0.012396&nbsp;&nbsp;&nbsp;&nbsp; =
0.000005</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_WRITE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
6399&nbsp;&nbsp;&nbsp; 74.070921&nbsp;&nbsp;&nbsp;&nbsp; 0.0</FONT><FONT =
SIZE=3D2 FACE=3D"Courier">11575&nbsp;&nbsp;&nbsp; =
70.728324&nbsp;&nbsp;&nbsp;&nbsp; 0.011053&nbsp;&nbsp;&nbsp;&nbsp; =
1.442313&nbsp;&nbsp;&nbsp;&nbsp; 0.000225&nbsp;&nbsp;&nbsp; =
31.111700&nbsp;&nbsp;&nbsp;&nbsp; 0.004861</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_ACCESS&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp; 3&nbsp;&nbsp;&nbsp;&nbsp; 0.000082&nbsp;&nbsp;&nbsp;&nbsp; =
0.000027&nbsp;&nbsp;&nbsp;&nbsp; 0.000078&nbsp;&nbsp;&nbsp;&nbsp; =
0.000026&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">DCACHE_READAHEAD&nbsp;&nbsp;</FONT> <FONT SIZE=3D2 =
FACE=3D"Courier">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp; 210&nbsp;&nbsp;&nbsp;&nbsp; =
0.073800&nbsp;&nbsp;&nbsp;&nbsp; 0.000351&nbsp;&nbsp;&nbsp;&nbsp; =
0.001297&nbsp;&nbsp;&nbsp;&nbsp; 0.000006&nbsp;&nbsp;&nbsp;&nbsp; =
0.020630&nbsp;&nbsp;&nbsp;&nbsp; 0.000098&nbsp;&nbsp;&nbsp;&nbsp; =
1.132487&nbsp;&nbsp;&nbsp;&nbsp; 0.005392</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">PKT_RX&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
188840598 22685.743032&nbsp;&nbsp;&nbsp;&nbsp; 0.000120 =
22685.743032&nbsp;&nbsp;&nbsp;&nbsp; 0.000120&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.00</FONT><FONT SIZE=3D2 =
FACE=3D"Courier">0000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><B></B></SPAN><SPAN =
LANG=3D"en-us"><B><FONT SIZE=3D2 FACE=3D"Courier">NFS_V3_LOOKUP&nbsp; =
&lt;&lt;&lt;&lt;&lt;&lt;&lt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1&nbsp;&nbsp;&nbsp; =
0.000070&nbsp;&nbsp;&nbsp;&nbsp; 0.000070&nbsp;&nbsp; =
0.000041&nbsp;&nbsp;&nbsp; 0.000041&nbsp;&nbsp; =
0.000027&nbsp;&nbsp;&nbsp; 0.000027&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp; 0.000000</FONT></B></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><B><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_CREATE&nbsp; =
&lt;&lt;&lt;&lt;&lt;&lt;&lt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
&nbsp; &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; 1&nbsp;&nbsp;&nbsp; =
0.000860&nbsp;&nbsp;&nbsp;&nbsp; 0.000860&nbsp;&nbsp; =
0.000088&nbsp;&nbsp;&nbsp; 0.000088&nbsp;&nbsp; 0.00030</FONT><FONT =
SIZE=3D2 FACE=3D"Courier">8&nbsp;&nbsp;&nbsp; 0.000308&nbsp;&nbsp; =
0.000018&nbsp;&nbsp;&nbsp; 0.000018</FONT></B></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"><FONT =
SIZE=3D2 =
FACE=3D"Courier">NFS_V3_GETATTR&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
197&nbsp;&nbsp;&nbsp;&nbsp; 0.003561&nbsp;&nbsp;&nbsp;&nbsp; =
0.000018&nbsp;&nbsp;&nbsp;&nbsp; 0.002990&nbsp;&nbsp;&nbsp;&nbsp; =
0.000015&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">VM</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">-bash-3.00$&nbsp; =
/n/build-trees/R3.2.0.3/R3.2.0.3-022708/nfx-tree/</FONT><FONT SIZE=3D2 =
FACE=3D"Courier">Build/x86utils/kpi-ui -f lcvm_reads.kpi -c =
NFS_V3_COMMIT</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">kpi&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
calls&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; total =
seconds&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
seconds/call</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_COMMIT&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp; =
72&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
; =
0.322727&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp; 0.004482</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">&nbsp; =
PKT_NCPU_QUEUE</FONT> <FONT SIZE=3D2 =
FACE=3D"Courier">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
72&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
; =
0.000098&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp; 0.000001</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">&nbsp; =
PKT_TX&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp; =
72&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
; =
0.000146&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp; 0.000002</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">&nbsp; =
PKT_RPC_REASM&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
72&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
; =
0.002958&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp; 0.0</FONT><FONT SIZE=3D2 =
FACE=3D"Courier">00041</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">&nbsp; =
NFS_OPEN_HANDLE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
72&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
; =
0.034160&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp; 0.000474</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">&nbsp; =
PKT_ACPU_QUEUE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
72&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
; =
0.001193&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp; 0.000016</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">&nbsp; =
DCACHE_COMMIT&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
72&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
; 0</FONT><FONT SIZE=3D2 =
FACE=3D"Courier">.283157&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp; 0.003932</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">&nbsp; =
NFS_REPLY&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp; =
72&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
; =
0.000330&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp; 0.000004</FONT></SPAN></P>
<BR>
<BR>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">WRITE =
WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE =
WRITE WRITE WRITE </FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 FACE=3D"Courier">WRITE =
WRITE WRITE WRITE WRITE WRIT</FONT><FONT SIZE=3D2 FACE=3D"Courier">E =
WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE WRITE =
</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">LINUX</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">-bash-3.00$ =
/n/build-trees/R3.2.0.3/R3.2.0.3-022708/nfx-tree/Build/x86utils/kpi-ui =
-f lc14_nfs_write.kpi -r</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">kpi&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
count&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
total&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
avg&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
txrx&nbsp;&nbsp;&nbsp; txrx =
avg&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
fp&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; fp =
avg&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
fc&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; fc av</FONT><FONT SIZE=3D2 =
FACE=3D"Courier">g</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">FS_EVM_WRITE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
5608&nbsp;&nbsp; 127.818157&nbsp;&nbsp;&nbsp;&nbsp; =
0.022792&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp; 127.818157&nbsp;&nbsp;&nbsp;&nbsp; =
0.022792&nbsp;&nbsp; 116.534776&nbsp;&nbsp;&nbsp;&nbsp; =
0.020780</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">FS_EVM_READ&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp; 90&nbsp;&nbsp;&nbsp;&nbsp; =
0.062379&nbsp;&nbsp;&nbsp;&nbsp; 0.000693&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000</FONT> <FONT SIZE=3D2 =
FACE=3D"Courier">&nbsp;&nbsp;&nbsp; 0.062379&nbsp;&nbsp;&nbsp;&nbsp; =
0.000693&nbsp;&nbsp;&nbsp;&nbsp; 0.017432&nbsp;&nbsp;&nbsp;&nbsp; =
0.000193</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_READ&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp; 193&nbsp;&nbsp;&nbsp;&nbsp; 0.370917&nbsp;&nbsp;&nbsp;&nbsp; =
0.001921&nbsp;&nbsp;&nbsp;&nbsp; 0.370560&nbsp;&nbsp;&nbsp;&nbsp; =
0.001920&nbsp;&nbsp;&nbsp;&nbsp; 0.000241&nbsp;&nbsp;&nbsp;&nbsp; =
0.000001&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_WRITE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
&lt;&lt;&lt;&lt;&lt;&lt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
5297&nbsp;&nbsp;</FONT>&nbsp;<FONT SIZE=3D2 FACE=3D"Courier"> =
15.614921&nbsp;&nbsp;&nbsp;&nbsp; 0.002947&nbsp;&nbsp;&nbsp; =
13.978049&nbsp;&nbsp;&nbsp;&nbsp; 0.002638&nbsp;&nbsp;&nbsp;&nbsp; =
1.318470&nbsp;&nbsp;&nbsp;&nbsp; 0.000248&nbsp;&nbsp; =
125.645523&nbsp;&nbsp;&nbsp;&nbsp; 0.023720</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">DCACHE_READAHEAD&nbsp; =
&lt;&lt;&lt;&lt;&lt;&lt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp; 22&nbsp;&nbsp;&nbsp;&nbsp; 0.000128&nbsp;&nbsp;&nbsp;&nbsp; =
0.000005&nbsp;&nbsp;&nbsp;&nbsp; 0.000128&nbsp;&nbsp;&nbsp;&nbsp; =
0.000005&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">P</FONT><FONT SIZE=3D2 =
FACE=3D"Courier">KT_RX&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
168321587 22432.762425&nbsp;&nbsp;&nbsp;&nbsp; 0.000133 =
22432.762425&nbsp;&nbsp;&nbsp;&nbsp; 0.000133&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_LOOKUP&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp; 1&nbsp;&nbsp;&nbsp;&nbsp; 0.000171&nbsp;&nbsp;&nbsp;&nbsp; =
0.000171&nbsp;&nbsp;&nbsp;&nbsp; 0.000055&nbsp;&nbsp;&nbsp;&nbsp; =
0.000055&nbsp;&nbsp;&nbsp;</FONT>&nbsp;<FONT SIZE=3D2 FACE=3D"Courier"> =
0.000105&nbsp;&nbsp;&nbsp;&nbsp; 0.000105&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_CREATE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp; 1&nbsp;&nbsp;&nbsp;&nbsp; 0.001112&nbsp;&nbsp;&nbsp;&nbsp; =
0.001112&nbsp;&nbsp;&nbsp;&nbsp; 0.000089&nbsp;&nbsp;&nbsp;&nbsp; =
0.000089&nbsp;&nbsp;&nbsp;&nbsp; 0.000331&nbsp;&nbsp;&nbsp;&nbsp; =
0.000331&nbsp;&nbsp;&nbsp;&nbsp; 0.000052&nbsp;&nbsp;&nbsp;&nbsp; =
0.000052</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_GETATTR&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
 =
&lt;&lt;&lt;&lt;&lt;&lt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
29&nbsp;&nbsp;&nbsp;&nbsp; 0</FONT><FONT SIZE=3D2 =
FACE=3D"Courier">.000495&nbsp;&nbsp;&nbsp;&nbsp; =
0.000017&nbsp;&nbsp;&nbsp;&nbsp; 0.000449&nbsp;&nbsp;&nbsp;&nbsp; =
0.000015&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">VM</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">-bash-3.00$ =
/n/build-trees/R3.2.0.3/R3.2.0.3-</FONT><FONT SIZE=3D2 =
FACE=3D"Courier">022708/nfx-tree/Build/x86utils/kpi-ui -f lcvm_write.kpi =
-r</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">kpi&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
count&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
total&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
avg&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
txrx&nbsp;&nbsp;&nbsp; txrx =
avg&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
fp&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; fp =
avg&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
fc&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; fc avg</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">FS_EVM_WRITE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p; 72</FONT><FONT SIZE=3D2 FACE=3D"Courier">1&nbsp;&nbsp;&nbsp;&nbsp; =
0.795502&nbsp;&nbsp;&nbsp;&nbsp; 0.001103&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.795502&nbsp;&nbsp;&nbsp;&nbsp; 0.001103&nbsp;&nbsp;&nbsp;&nbsp; =
0.105277&nbsp;&nbsp;&nbsp;&nbsp; 0.000146</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">FS_EVM_READ&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp; 392&nbsp;&nbsp;&nbsp;&nbsp; 0.109339&nbsp;&nbsp;&nbsp;&nbsp; =
0.000278&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.109339&nbsp;&nbsp;&nbsp;&nbsp; =
0.000278&nbsp;&nbsp;&nbsp;&nbsp; 0.013907&nbsp;&nbsp;&nbsp;&nbsp; =
0.0000</FONT><FONT SIZE=3D2 FACE=3D"Courier">35</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_READ&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbs=
p;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp; 49&nbsp;&nbsp;&nbsp;&nbsp; =
0.433681&nbsp;&nbsp;&nbsp;&nbsp; 0.008850&nbsp;&nbsp;&nbsp;&nbsp; =
0.433558&nbsp;&nbsp;&nbsp;&nbsp; 0.008848&nbsp;&nbsp;&nbsp;&nbsp; =
0.002163&nbsp;&nbsp;&nbsp;&nbsp; 0.000044&nbsp;&nbsp;&nbsp;&nbsp; =
0.001505&nbsp;&nbsp;&nbsp;&nbsp; 0.000030</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_WRITE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
&lt;&lt;&lt;&lt;&lt;&lt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
1097&nbsp;&nbsp;&nbsp; 14.459296&nbsp;&nbsp;&nbsp;&nbsp; =
0.013180&nbsp;&nbsp;&nbsp; 13.487867&nbsp;&nbsp;&nbsp;&nbsp; =
0.012295</FONT><FONT SIZE=3D2 FACE=3D"Courier">&nbsp;&nbsp;&nbsp;&nbsp; =
0.251708&nbsp;&nbsp;&nbsp;&nbsp; 0.000229&nbsp;&nbsp;&nbsp;&nbsp; =
1.815289&nbsp;&nbsp;&nbsp;&nbsp; 0.001654</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_ACCESS&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp; 1&nbsp;&nbsp;&nbsp;&nbsp; 0.000033&nbsp;&nbsp;&nbsp;&nbsp; =
0.000033&nbsp;&nbsp;&nbsp;&nbsp; 0.000032&nbsp;&nbsp;&nbsp;&nbsp; =
0.000032&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">PKT_RX&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
188605613 2</FONT><FONT SIZE=3D2 =
FACE=3D"Courier">2543.366395&nbsp;&nbsp;&nbsp;&nbsp; 0.000119 =
22543.366395&nbsp;&nbsp;&nbsp;&nbsp; 0.000119&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_LOOKUP&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp; 1&nbsp;&nbsp;&nbsp;&nbsp; 0.000070&nbsp;&nbsp;&nbsp;&nbsp; =
0.000070&nbsp;&nbsp;&nbsp;&nbsp; 0.000041&nbsp;&nbsp;&nbsp;&nbsp; =
0.000041&nbsp;&nbsp;&nbsp;&nbsp; 0.000027&nbsp;&nbsp;&nbsp;&nbsp; =
0.000027&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_CREATE&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nb=
sp;&nbsp; 1&nbsp;&nbsp;&nbsp;&nbsp; 0.000860&nbsp;&nbsp;&nbsp;&nbsp; =
0.000860&nbsp;&nbsp;&nbsp;&nbsp; 0.000088&nbsp;&nbsp;&nbsp;&nbsp; =
0.000088&nbsp;&nbsp;&nbsp;&nbsp; 0.000308&nbsp;&nbsp;&nbsp;&nbsp; =
0.000308&nbsp;&nbsp;&nbsp;&nbsp; 0.000018&nbsp;&nbsp;&nbsp;&nbsp; =
0.000018</FONT></SPAN></P>

<P DIR=3DLTR><SPAN LANG=3D"en-us"><FONT SIZE=3D2 =
FACE=3D"Courier">NFS_V3_GETATTR&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
&lt;&lt;&lt;&lt;&lt;&lt;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
122&nbsp;&nbsp;&nbsp;&nbsp; 0.002217&nbsp;&nbsp;&nbsp;&nbsp; =
0.000018&nbsp;&nbsp;&nbsp;&nbsp; 0.001795&nbsp;&nbsp;&nbsp;&nbsp; =
0.000014&nbsp;&nbsp;</FONT> <FONT SIZE=3D2 FACE=3D"Courier">&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000&nbsp;&nbsp;&nbsp;&nbsp; =
0.000000&nbsp;&nbsp;&nbsp;&nbsp; 0.000000</FONT></SPAN><SPAN =
LANG=3D"en-us"></SPAN><SPAN LANG=3D"en-us"></SPAN></P>

</BODY>
</HTML>
------_=_NextPart_001_01C892F2.BCA27D78--
