X-MimeOLE: Produced By Microsoft Exchange V6.5
Received: by onstor-exch02.onstor.net 
	id <01C71D47.DC03FD19@onstor-exch02.onstor.net>; Mon, 11 Dec 2006 09:14:47 -0800
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----_=_NextPart_001_01C71D47.DC03FD19"
Content-class: urn:content-classes:message
Subject: RE: Clio R2.1 Submittal 8 - RC1 available for testing (EEK update)
Date: Mon, 11 Dec 2006 09:14:46 -0800
Message-ID: <BB375AF679D4A34E9CA8DFA650E2B04E01AA3FA5@onstor-exch02.onstor.net>
In-Reply-To: <BB375AF679D4A34E9CA8DFA650E2B04E01AA3F34@onstor-exch02.onstor.net>
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
Thread-Topic: Clio R2.1 Submittal 8 - RC1 available for testing (EEK update)
thread-index: AccY6/XzKxRmRVxQTvi9NBdZ0ywc+gAADiSQAAbM7tAAAeZNsAARW7xBAJNWRsAABc1NtAABUlQwAAOaxqQAASwOtgAANxJGAASDiMcAAbTpVAAB8VYMAAIqP8wAADyx3AAAKBSgAAhm87oAAAvDIwAY+87fAASclkIAJyn/DgADUDiQAAHvSWA=
From: "Raj Kumar" <raj.kumar@onstor.com>
To: "Jobi Ariyamannil" <jobi.ariyamannil@onstor.com>,
	"Vikas Saini" <vikas.saini@onstor.com>,
	"dl-Clio" <dl-Clio@onstor.com>

This is a multi-part message in MIME format.

------_=_NextPart_001_01C71D47.DC03FD19
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Jobi,

=20

We like to let this EEK complete so we have some baseline for these kind
of huge quota records.=20

=20

Agree that we need to experiment with tuning the cache for this volume
and see how it improves the EEK performance.

=20

Thanks.

=20

________________________________

From: Jobi Ariyamannil=20
Sent: Monday, December 11, 2006 8:16 AM
To: Raj Kumar; Vikas Saini; dl-Clio
Subject: RE: Clio R2.1 Submittal 8 - RC1 available for testing (EEK
update)

=20

Yep.  But no point in leaving the system for quota eek processing, it is
going to take days to process all those 3 million quota records.

Instead, we can experiment the effects of tuning the caches for the rest
of the eek processing.

Also a comparative study against 133 eek on this huge filesystem would
be good.

=20

Regards,

Jobi

=20

________________________________

From: Raj Kumar=20
Sent: Monday, December 11, 2006 6:38 AM
To: Raj Kumar; Vikas Saini; dl-Clio
Subject: RE: Clio R2.1 Submittal 8 - RC1 available for testing (EEK
update)

=20

EEK run is looking good. Already in the quota processing.

=20

# fscmd eek eng49-3 -r -c
running eek in repair mode
all snapshots  will be removed.
Sun Dec 10 11:58:24 2006 =3D=3D eng49-3 =3D=3D verifying meta inodes =
=3D=3D
eng49-3: removing snapshots
Sun Dec 10 11:58:48 2006 =3D=3D eng49-3 =3D=3D mark and compare =
reference counts
=3D=3D
Sun Dec 10 11:58:51 2006 =3D=3D eng49-3 =3D=3D mark used blocks =3D=3D
processed 194314240 of 194314240 inodes

Sun Dec 10 12:58:53 2006 =3D=3D eng49-3 =3D=3D compare used blocks =
=3D=3D
Sun Dec 10 14:20:46 2006 =3D=3D eng49-3 =3D=3D processing quota trees =
=3D=3D
processed 1 quota tree records
Sun Dec 10 14:20:47 2006 =3D=3D eng49-3 =3D=3D mark used inodes =3D=3D
processed 194314240 of 194314240 inodes, 16441522 of 16441522
directories

Mon Dec 11 03:58:52 2006 =3D=3D eng49-3 =3D=3D detecting unused quota =
trees =3D=3D
Mon Dec 11 03:58:52 2006 =3D=3D eng49-3 =3D=3D processing user quotas =
=3D=3D
processed 326040 user quota records

=20

________________________________

From: Raj Kumar
Sent: Sun 12/10/2006 11:56 AM
To: Vikas Saini; dl-Clio
Subject: RE: Clio R2.1 Submittal 8 - RC1 available for testing

Upgraded BC soak.

Started the EEK on the volume that we have issues in processing quotas
records. Will update on the progress.


-----Original Message-----
From: Vikas Saini
Sent: Sun 12/10/2006 9:44 AM
To: dl-Clio
Subject: Clio R2.1 Submittal 8 - RC1 available for testing

Hi All,
   Clio R2.1 Submittal 8 - RC1 is available for testing. Please load
this for your Clio testing and continue with your regression. we need to
load this on our soak systems also so that we have atleast a couple of
days runtime before we load this on mightydog.

Thanks
Vikas

-----Original Message-----
From: Ken Renshaw
Sent: Sat 12/9/2006 9:49 PM
To: Paul Hammer; Tim Gardner; Vikas Saini; Sandrine Boulanger
Cc: Ken Renshaw
Subject: Clio R2.1 Submittal 8 - RC1 Images Ready for Test - Was: RE:
longest eek so far !!!

Yep, here's the package info, I'll complete submittal notes tomorrow if
that's alright:

Changes since submittal 7:

Change 22122 on 2006/12/09 by jobia@jobi:jobi '   leftover changes for
changes'
Change 22105 on 2006/12/08 by nagendras@nags_r21work 'Fix for TED16641
Wildcard chara'
Change 22076 on 2006/12/07 by henryl@henryl-linux '       Fixed
TED#16678. O_GET_E'
Change 22075 on 2006/12/07 by jong@jong-jong-cifs 'Make sure that the
default opti'
Change 22074 on 2006/12/07 by jobia@jobi:jobi '   Avoid a 4k stack usage
while'
Change 22065 on 2006/12/06 by jobia@jobi:jobi '   EEK should remove all
the in'
Change 22060 on 2006/12/05 by maximk@maximk-13 'Add some functions. '

EverON release images:

Cheetah Debug Build Image:

ftp://upgrade:password@10.2.0.2/home/upgrade/R2.1.0.0DBG-120906.tar.gz

Bobcat Debug Build Image:

ftp://upgrade:password@10.2.0.2/home/upgrade/R2.1.0.0BCDBG-120906.tar.gz

Cheetah Opt Build Image:

ftp://upgrade:password@10.2.0.2/home/upgrade/R2.1.0.0-120906.tar.gz

Bobcat Opt Build Image:

ftp://upgrade:password@10.2.0.2/home/upgrade/R2.1.0.0BC-120906.tar.gz

EverON Source tree:

/n/Build-Trees/R2.1.0.0/R2.1.0.0-120906/nfx-tree

Perforce sync info:

//depot/R2_1_X_work/...@22122

I'll get out submittal notes as soon as I can, thanks.

-Ken

-----Original Message-----
From: Paul Hammer
Sent: Sat 12/9/2006 9:47 PM
To: Tim Gardner; Ken Renshaw; Vikas Saini; Sandrine Boulanger
Subject: RE: longest eek so far !!!

Cool, Ken do we have a submittal?

________________________________

From: Tim Gardner
Sent: Sat 12/9/2006 5:47 PM
To: Ken Renshaw; Paul Hammer; Vikas Saini; Sandrine Boulanger
Subject: RE: longest eek so far !!!



take it. I approved the checkin.

-----Original Message-----
From: Ken Renshaw
Sent: Saturday, December 09, 2006 5:43 PM
To: Paul Hammer; Vikas Saini; Sandrine Boulanger; Tim Gardner
Subject: RE: longest eek so far !!!

It's just some functions for GDB that would be useful in debugging the
tree, it's more or less a GDB script instead of a piece of EverON code.
I'd vote for just leaving it, but can skip it if you'd like.


-----Original Message-----
From: Paul Hammer
Sent: Sat 12/9/2006 5:35 PM
To: Vikas Saini; Ken Renshaw; Sandrine Boulanger; Tim Gardner
Subject: RE: longest eek so far !!!

Thanks, guess we should take it, not sure why it is there. Tim do you
know why this in in here?

________________________________

From: Vikas Saini
Sent: Sat 12/9/2006 4:33 PM
To: Paul Hammer; Ken Renshaw; Sandrine Boulanger
Subject: RE: longest eek so far !!!



excepy max check in, everything is in MF list for Clio


________________________________

From: Ken Renshaw
Sent: Sat 12/9/2006 2:49 PM
To: Paul Hammer; Sandrine Boulanger; Vikas Saini
Subject: RE: longest eek so far !!!



Here is what's been checked in since sub7 ( the last one is just some
new GDB functions ):

Change 22122 on 2006/12/09 by jobia@jobi:jobi '   leftover changes for
changes'
Change 22105 on 2006/12/08 by nagendras@nags_r21work 'Fix for TED16641
Wildcard chara'
Change 22076 on 2006/12/07 by henryl@henryl-linux '       Fixed
TED#16678. O_GET_E'
Change 22075 on 2006/12/07 by jong@jong-jong-cifs 'Make sure that the
default opti'
Change 22074 on 2006/12/07 by jobia@jobi:jobi '   Avoid a 4k stack usage
while'
Change 22065 on 2006/12/06 by jobia@jobi:jobi '   EEK should remove all
the in'
Change 22060 on 2006/12/05 by maximk@maximk-13 'Add some functions. '

Long descriptions:

Change 22122 by jobia@jobi:jobi on 2006/12/09 14:40:47

           leftover changes for changes made for defect TED00016681 and
TED00016685.
           EEK should not dereference an inode/buffer, after unlocking
the lock.
           Mark/Fix used blocks, using inode buffers instead of inodes.
  =20
           Reviewed by JonG.

Affected files ...

... //depot/R2_1_X_work/nfx-tree/code/sm-fs/btree/emaproot.c#6 edit
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-dir.c#5 edit
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-eek-quota.c#3 edit
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-eek-quota.h#2 edit
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-eek.c#21 edit
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-proto.h#4 edit

Change 22105 by nagendras@nags_r21work on 2006/12/08 10:48:45

        Fix for TED16641
        Wildcard characters were not being accepted for domain names in
idmap rules.
  =20
        reviewed by briand

Affected files ...

... //depot/R2_1_X_work/nfx-tree/code/ssc-authen-lib/authen-lib-api.h#2
edit
... //depot/R2_1_X_work/nfx-tree/code/ssc-authen-lib/idmap-cfg.c#2 edit
... //depot/R2_1_X_work/nfx-tree/code/ssc-nfxsh/cmd_idmap.c#2 edit

Change 22076 by henryl@henryl-linux on 2006/12/07 10:07:59

               Fixed TED#16678. O_GET_EXCL() can return NULL buf if the
file has a hole on that page offset or an error when caller failed to
get blocking lock. Trigger a volume exception and send ELOG msg to print
the page offset and inode number.
               Reviewed by Jobia

Affected files ...

... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-security.c#2 edit

Change 22075 by jong@jong-jong-cifs on 2006/12/07 09:56:28

        Make sure that the default option for creating a volume is
normal
               stability.  This impacts mirror volume creation.
               This addresses defect 16718
               reviewed by JobiA

Affected files ...

... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-api.h#6 edit

Change 22074 by jobia@jobi:jobi on 2006/12/07 09:40:13

           Avoid a 4k stack usage while traversing the emap btrees.
  =20
           Corrupted special files were not being fixed correctly, thus
would have
           generated errors in every eek run.
  =20
           Symbolic links with invalid numblocks are detected/fixed.
  =20
           A non-directory inode was checked for not to have quota tree
root flag
           while traversing the directories.  If parent directory is
missing, this
           check was missing for its children and thus a second eek
would
           report those errors since the inode is in lost+found then.
Fix this
           issue first time itself.
  =20
           Added a function fs_eek_validateAndFix() to consolidate all
the
           checks/fixes on a disk inode.
  =20
           Some minor changes in fs-debug.c.
  =20
           Defect TED00016681.
  =20
           Reviewed by JonG.

Affected files ...

... //depot/R2_1_X_work/nfx-tree/code/sm-fs/btree/emaproot.c#5 edit
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-debug.c#8 edit
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-eek.c#20 edit

Change 22065 by jobia@jobi:jobi on 2006/12/06 15:25:17

           EEK should remove all the inodes sharing the duplicate
blocks.
  =20
           Defect 16685.
  =20
           Reviewed by JonG.

Affected files ...

... //depot/R2_1_X_work/nfx-tree/code/sm-fs/btree/emaproot.c#4 edit
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-eek.c#19 edit
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-eek.h#11 edit

Change 22060 by maximk@maximk-13 on 2006/12/05 14:44:29

        Add some functions.

Affected files ...

... //depot/R2_1_X_work/nfx-tree/gdbfuncs#2 edit

-----Original Message-----
From: Paul Hammer
Sent: Sat 12/9/2006 12:40 PM
To: Ken Renshaw; Sandrine Boulanger; Vikas Saini
Subject: RE: longest eek so far !!!

YOu bet, was hoping for an update from Tim/Dev about the mem leaks that
have yet to fix.

-paul

________________________________

From: Ken Renshaw
Sent: Sat 12/9/2006 12:34 PM
To: Paul Hammer
Subject: Re: longest eek so far !!!



Hey Paul, likewise can you keep me in the loop for any Clio MFs or
builds past the last submittal 7? I've not heard anything about an RC
build, unless sub7 is considered RC1 by some.

Thanks,

-Ken



-----Original Message-----
From: Paul Hammer
To: Jobi Ariyamannil; Raj Kumar; Vikas Saini; Sandrine Boulanger; Jay
Michlin; Henry Lau; Jerry Lopatin; Tim Gardner; Brian DeForest
CC: dl-QA
Sent: Sat Dec 09 12:06:49 2006
Subject: RE: longest eek so far !!!

Thanks Jobi.

Since this eek run is in the soak env I do not think the cfg has
changed, Raj or Vikas can you confirm?

That is good news on the quotas, nice to hear that you have identified
the problem.

We need to sync up on the eek part and the next submittal. As of now we
are just waiting on the final two MF's to come through and then we
should be done from the Dev perspectice. QA has already started the
final regression pass on Clio and we hope to install the RC on MD on
Monday. Did not know there was other changes being submitted, lets talk
about how to proceed.

Should we change the defaults for shippinf eek? I asked Raj to rerun the
eek tests for comparison in the default configuration since that is how
we ship it and how I belive customers usually run it.

Good stuff Jobi, thanks.

-Paul


________________________________

From: Jobi Ariyamannil
Sent: Sat 12/9/2006 10:27 AM
To: Paul Hammer; Raj Kumar; Vikas Saini; Sandrine Boulanger; Jay
Michlin; Henry Lau; Jerry Lopatin; Tim Gardner; Brian DeForest
Cc: dl-QA
Subject: RE: longest eek so far !!!



This time EEK has been running since Dec 6, 10am.

I also have been monitoring the eek progress this time.

Something strange happened this time, there were I/O retries and eek has
been slowed down.

I looked at the code changes between submittal 4 and 7 and could not
explain the difference in performance, so this must be something changed
in the configuration.



Good news is that, I figured out why EEK is slow processing large number
of quota records.

These issues cannot be fixed in 2.1.  If some customer complains about
eek performance while processing large number of quota records, we have
to suggest using the new eek option to skip processing quota records
during eek.



There have been some more changes to eek after submittal 7.  We should
restart eek on this filesystem once the next submittal is available.

In all my tests, eek in 2.1 is 40% faster than, that of in 133 (I
verified this on a filesystem with 100 million inodes too).

It would be good if QA can validate this claim.



Also while running eek on filesystems of large size and large number of
files and directories, using the default FP cache configuration is a
very bad idea.

EEK can be made much faster by configuring the caches and this is
something we strongly advise our customers too.



Regards,

Jobi



________________________________

From: Paul Hammer
Sent: Saturday, December 09, 2006 9:39 AM
To: Raj Kumar; Jobi Ariyamannil; Vikas Saini; Sandrine Boulanger; Jay
Michlin; Henry Lau; Jerry Lopatin; Tim Gardner; Brian DeForest
Cc: dl-QA
Subject: RE: longest eek so far !!!



Raj, how long has this one been running?

________________________________

From: Raj Kumar
Sent: Sat 12/9/2006 6:57 AM
To: Paul Hammer; Jobi Ariyamannil; Vikas Saini; Sandrine Boulanger; Jay
Michlin; Henry Lau; Jerry Lopatin; Tim Gardner; Brian DeForest
Cc: dl-QA
Subject: RE: longest eek so far !!!

Filer: eng49

Volume - eng49-3

Cache status captured every 10 minutes: /usr/raj/cache



EEK is still running. I am afraid this is going much worse than the last
run. In the last run processing quotas took 90% of the time. This time
we have not reached quota processing yet, delay is on "mark used
inodes".



# fscmd eek eng49-3 -c -r

all snapshots  will be removed.

running eek in repair mode

Wed Dec  6 10:10:53 2006 =3D=3D eng49-3 =3D=3D verifying meta inodes =
=3D=3D

eng49-3: removing snapshots

Wed Dec  6 10:11:30 2006 =3D=3D eng49-3 =3D=3D mark and compare =
reference counts
=3D=3D

Wed Dec  6 10:11:33 2006 =3D=3D eng49-3 =3D=3D mark used blocks =3D=3D

processed 194314240 of 194314240 inodes



Wed Dec  6 11:18:58 2006 =3D=3D eng49-3 =3D=3D compare used blocks =
=3D=3D

processed 0 of 105574336 blocks



Thu Dec  7 07:49:08 2006 =3D=3D eng49-3 =3D=3D processing quota trees =
=3D=3D

processed 1 quota tree records

Thu Dec  7 07:49:09 2006 =3D=3D eng49-3 =3D=3D mark used inodes =3D=3D

processed 68719104 of 194314240 inodes, 10145703 of 16441522 directories



________________________________

From: Paul Hammer
Sent: Wednesday, December 06, 2006 8:35 AM
To: Jobi Ariyamannil; Vikas Saini; Sandrine Boulanger; Jay Michlin;
Henry Lau; Jerry Lopatin; Tim Gardner; Brian DeForest
Cc: dl-QA
Subject: RE: longest eek so far !!!



Thanks Jobi. Vikas please let us know how the rerun of eek goes, thanks.



-Paul



________________________________

From: Jobi Ariyamannil
Sent: Wed 12/6/2006 12:25 AM
To: Paul Hammer; Vikas Saini; Sandrine Boulanger; Jay Michlin; Henry
Lau; Jerry Lopatin; Tim Gardner; Brian DeForest
Cc: dl-QA
Subject: RE: longest eek so far !!!

Hi Paul,



There have been many improvements to eek, but most of them not going to
improve eek processing time of large number of quota records.

We still don't know what is causing bad eek performance while processing
large number of quota records.



But we made an obvious improvement to eek (issue read aheads of quota
records) hoping to make eek faster while processing the quota records.

We have not verified how much this change would help.  Testing with
submittal 7 would verify this.



Also we added an argument to eek which if specified, will skip quota
checks.  Using that option, the given filesystem can be eeked in one day
or so (which is reasonable considering the large number of
inodes/directories etc).



Also we may be able to configure the caches on the filer to get better
performance from eek.



Surprisingly, no customers so far reported so many quota records.



Regards,

Jobi



________________________________

From: Paul Hammer
Sent: Tuesday, December 05, 2006 11:29 PM
To: Jobi Ariyamannil; Vikas Saini; Sandrine Boulanger; Jay Michlin;
Henry Lau; Jerry Lopatin; Tim Gardner; Brian DeForest
Cc: dl-QA
Subject: RE: longest eek so far !!!



Hi Jobi,



Are there any improvements since we started this eek run (2 submittals
ago) that will reduce the amount of time eek takes in a quotated env?
What I am really asking is: will customers with quotas set see this type
of eek performance, potentially take weeks to run eek with 2.1?



I have asked Vikas that we rerun the eek test on the same volume in the
soak env to see if we are now faster, vikas let me know that even though
it took 16 days that eek only fixed one problem.



Thanks,



-Paul



________________________________

From: Jobi Ariyamannil
Sent: Tue 12/5/2006 8:11 PM
To: Vikas Saini; Sandrine Boulanger; Jay Michlin; Henry Lau; Jerry
Lopatin; Tim Gardner; Brian DeForest
Cc: dl-QA
Subject: RE: longest eek so far !!!

Its again spent a lot of days processing quota records.  Rest of the
passes look reasonable.

Submital 7 will have an option in eek to skip quota records passing
("-q") option.

Going forward, while reporting eek delays, please mention the build
info, fscmd cachestats output.

As we have added read ahead of quota records in submittal 7, we may test
that too.

Regards,

Jobi

_____________________________________________
From: Vikas Saini
Sent: Tuesday, December 05, 2006 8:07 PM
To: Sandrine Boulanger; Jay Michlin; Jobi Ariyamannil; Henry Lau; Jerry
Lopatin; Tim Gardner; Brian DeForest
Cc: dl-QA
Subject: longest eek so far !!!
Importance: High

Live view done. Eek for snapshot is still going on. Going to abort the
snapshot eek.



# fscmd eek eng49-3 lvolOnline -r -f

running eek in repair mode

Force mode: corrupt snapshots  will be automatically removed.

volId 0x17a000000d0 is not online, state is 1

eek: trying to bring the logical volume online

Done.

Mon Nov 20 09:22:21 2006 =3D=3D eng49-3 =3D=3D verifying meta inodes =
=3D=3D

eng49-3: Inode (I#1) file invalid numblocks 3036141 in superblock,
expected 3036142

Mon Nov 20 09:22:35 2006 =3D=3D eng49-3 =3D=3D mark and compare =
reference counts
=3D=3D

Mon Nov 20 09:23:08 2006 =3D=3D eng49-3 =3D=3D mark used blocks =3D=3D

eng49-3: Inode (I#1) file invalid numblocks 3036141 in superblock,
expected 3036142

processed 194314240 of 194314240 inodes

Mon Nov 20 10:20:38 2006 =3D=3D eng49-3 =3D=3D compare used blocks =
=3D=3D

processed 105574336 of 105574336 blocks

Mon Nov 20 11:31:12 2006 =3D=3D eng49-3 =3D=3D processing quota trees =
=3D=3D

processed 1 quota tree records

Mon Nov 20 11:31:12 2006 =3D=3D eng49-3 =3D=3D mark used inodes =3D=3D

proceprocessed 194314240 of 194314240 inodes, 16441522 of 16441522
directories

Tue Nov 21 01:42:55 2006 =3D=3D eng49-3 =3D=3D detecting unused quota =
trees =3D=3D

Tue Nov 21 01:42:55 2006 =3D=3D eng49-3 =3D=3D processing user quotas =
=3D=3D

processed 1220544 user quota records

processed 2466048 user quota records

processed 3185126 user quota records

Sat Dec  2 06:52:15 2006 =3D=3D eng49-3 =3D=3D processing group quotas =
=3D=3D

processed 1 group quota records

Sat Dec  2 06:53:01 2006 =3D=3D eng49-3 =3D=3D compare used inodes =
=3D=3D

processed 194314240 of 194314240 inodes, 16441522 of 16441522
directories

Sun Dec  3 22:36:46 2006 =3D=3D eng49-3 =3D=3D user quota not enabled - =
usage
verification skipped =3D=3D

Sun Dec  3 22:36:46 2006 =3D=3D eng49-3 =3D=3D group quota not enabled - =
usage
verification skipped =3D=3D

Sun Dec  3 22:36:46 2006 =3D=3D eng49-3 =3D=3D relink lost inodes =3D=3D

Sun Dec  3 22:37:22 2006 =3D=3D eng49-3 =3D=3D verify link inode =3D=3D

Mon Dec  4 10:49:19 2006 =3D=3D eng49-3 =3D=3D live view done =3D=3D  =
blksUsed
88207888 inodesUsed 58298273 =3D=3D

Mon Dec  4 10:49:19 2006 =3D=3D eng49-3 =3D=3D checking snapshots =3D=3D
















------_=_NextPart_001_01C71D47.DC03FD19
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:st1=3D"urn:schemas-microsoft-com:office:smarttags" =
xmlns=3D"http://www.w3.org/TR/REC-html40">

<head>
<meta http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<meta name=3DGenerator content=3D"Microsoft Word 11 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]-->
<title>RE: Clio R2.1 Submittal 8 - RC1 available for testing</title>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"PersonName"/>
<!--[if !mso]>
<style>
st1\:*{behavior:url(#default#ieooui) }
</style>
<![endif]-->
<style>
<!--
 /* Font Definitions */
 @font-face
	{font-family:Tahoma;
	panose-1:2 11 6 4 3 5 4 4 2 4;}
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0in;
	margin-bottom:.0001pt;
	font-size:12.0pt;
	font-family:"Times New Roman";}
a:link, span.MsoHyperlink
	{color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{color:blue;
	text-decoration:underline;}
p
	{mso-margin-top-alt:auto;
	margin-right:0in;
	mso-margin-bottom-alt:auto;
	margin-left:0in;
	font-size:12.0pt;
	font-family:"Times New Roman";}
span.EmailStyle18
	{mso-style-type:personal;
	font-family:Arial;
	color:navy;}
span.EmailStyle19
	{mso-style-type:personal-reply;
	font-family:Arial;
	color:navy;}
@page Section1
	{size:8.5in 11.0in;
	margin:1.0in 1.25in 1.0in 1.25in;}
div.Section1
	{page:Section1;}
-->
</style>
<!--[if gte mso 9]><xml>
 <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
 <o:shapelayout v:ext=3D"edit">
  <o:idmap v:ext=3D"edit" data=3D"1" />
 </o:shapelayout></xml><![endif]-->
</head>

<body lang=3DEN-US link=3Dblue vlink=3Dblue>

<div class=3DSection1>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Jobi,<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>We like to let this EEK complete so =
we
have some baseline for these kind of huge quota records. =
<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Agree that we need to experiment =
with
tuning the cache for this volume and see how it improves the EEK =
performance.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Thanks.<o:p></o:p></span></font></p>=


<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<div>

<div class=3DMsoNormal align=3Dcenter style=3D'text-align:center'><font =
size=3D3
face=3D"Times New Roman"><span style=3D'font-size:12.0pt'>

<hr size=3D2 width=3D"100%" align=3Dcenter tabindex=3D-1>

</span></font></div>

<p class=3DMsoNormal><b><font size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font =
size=3D2
face=3DTahoma><span style=3D'font-size:10.0pt;font-family:Tahoma'> Jobi =
Ariyamannil
<br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Monday, December =
11, 2006
8:16 AM<br>
<b><span style=3D'font-weight:bold'>To:</span></b> Raj Kumar; =
<st1:PersonName
w:st=3D"on">Vikas Saini</st1:PersonName>; dl-Clio<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> RE: Clio R2.1 =
Submittal 8
- RC1 available for testing (EEK update)</span></font><o:p></o:p></p>

</div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Yep.&nbsp; But no point in leaving =
the
system for quota eek processing, it is going to take days to process all =
those
3 million quota records.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Instead, we can experiment the =
effects of
tuning the caches for the rest of the eek =
processing.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Also a comparative study against =
133 eek
on this huge filesystem would be good.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Regards,<o:p></o:p></span></font></p=
>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Jobi<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<div>

<div class=3DMsoNormal align=3Dcenter style=3D'text-align:center'><font =
size=3D3
face=3D"Times New Roman"><span style=3D'font-size:12.0pt'>

<hr size=3D2 width=3D"100%" align=3Dcenter tabindex=3D-1>

</span></font></div>

<p class=3DMsoNormal><b><font size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font =
size=3D2
face=3DTahoma><span style=3D'font-size:10.0pt;font-family:Tahoma'> Raj =
Kumar <br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Monday, December =
11, 2006
6:38 AM<br>
<b><span style=3D'font-weight:bold'>To:</span></b> Raj Kumar; =
<st1:PersonName
w:st=3D"on">Vikas Saini</st1:PersonName>; dl-Clio<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> RE: Clio R2.1 =
Submittal 8
- RC1 available for testing (EEK update)</span></font><o:p></o:p></p>

</div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<div id=3DidOWAReplyText61882>

<div>

<p class=3DMsoNormal><font size=3D2 color=3Dblack face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:black'>EEK run is looking good. Already =
in the
quota processing.</span></font><o:p></o:p></p>

</div>

<div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;<o:p></o:p></span></font></p>

</div>

<div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'># fscmd eek eng49-3 -r -c<br>
running eek in repair mode<br>
all snapshots&nbsp; will be removed.<br>
Sun Dec 10 11:58:24 2006 =3D=3D eng49-3 =3D=3D verifying meta inodes =
=3D=3D<br>
eng49-3: removing snapshots<br>
Sun Dec 10 11:58:48 2006 =3D=3D eng49-3 =3D=3D mark and compare =
reference counts =3D=3D<br>
Sun Dec 10 11:58:51 2006 =3D=3D eng49-3 =3D=3D mark used blocks =
=3D=3D<br>
processed 194314240 of 194314240 inodes<o:p></o:p></span></font></p>

</div>

<div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>Sun Dec 10 12:58:53 2006 =3D=3D eng49-3 =3D=3D compare used =
blocks =3D=3D<br>
Sun Dec 10 14:20:46 2006 =3D=3D eng49-3 =3D=3D processing quota trees =
=3D=3D<br>
processed 1 quota tree records<br>
Sun Dec 10 14:20:47 2006 =3D=3D eng49-3 =3D=3D mark used inodes =
=3D=3D<br>
processed 194314240 of 194314240 inodes, 16441522 of 16441522 =
directories<o:p></o:p></span></font></p>

</div>

<div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>Mon Dec 11 03:58:52 2006 =3D=3D eng49-3 =3D=3D detecting unused =
quota trees =3D=3D<br>
Mon Dec 11 03:58:52 2006 =3D=3D eng49-3 =3D=3D processing user quotas =
=3D=3D<br>
processed 326040 user quota records<o:p></o:p></span></font></p>

</div>

</div>

<div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<div class=3DMsoNormal align=3Dcenter style=3D'text-align:center'><font =
size=3D3
face=3D"Times New Roman"><span style=3D'font-size:12.0pt'>

<hr size=3D2 width=3D"100%" align=3Dcenter tabIndex=3D-1>

</span></font></div>

<p class=3DMsoNormal style=3D'margin-bottom:12.0pt'><b><font size=3D2 =
face=3DTahoma><span
style=3D'font-size:10.0pt;font-family:Tahoma;font-weight:bold'>From:</spa=
n></font></b><font
size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;font-family:Tahoma'> Raj Kumar<br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Sun 12/10/2006 =
11:56 AM<br>
<b><span style=3D'font-weight:bold'>To:</span></b> <st1:PersonName =
w:st=3D"on">Vikas
 Saini</st1:PersonName>; dl-Clio<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> RE: Clio R2.1 =
Submittal 8
- RC1 available for testing</span></font><o:p></o:p></p>

</div>

<div>

<p style=3D'margin-bottom:12.0pt'><font size=3D2 face=3D"Times New =
Roman"><span
style=3D'font-size:10.0pt'>Upgraded BC soak.<br>
<br>
Started the EEK on the volume that we have issues in processing quotas =
records.
Will update on the progress.<br>
<br>
<br>
-----Original Message-----<br>
From: <st1:PersonName w:st=3D"on">Vikas Saini</st1:PersonName><br>
Sent: Sun 12/10/2006 9:44 AM<br>
To: dl-Clio<br>
Subject: Clio R2.1 Submittal 8 - RC1 available for testing<br>
<br>
Hi All,<br>
&nbsp;&nbsp; Clio R2.1 Submittal 8 - RC1 is available for testing. =
Please load
this for your Clio testing and continue with your regression. we need to =
load
this on our soak systems also so that we have atleast a couple of days =
runtime
before we load this on mightydog.<br>
<br>
Thanks<br>
Vikas<br>
<br>
-----Original Message-----<br>
From: Ken Renshaw<br>
Sent: Sat 12/9/2006 9:49 PM<br>
To: Paul Hammer; Tim Gardner; <st1:PersonName w:st=3D"on">Vikas =
Saini</st1:PersonName>;
<st1:PersonName w:st=3D"on">Sandrine Boulanger</st1:PersonName><br>
Cc: Ken Renshaw<br>
Subject: Clio R2.1 Submittal 8 - RC1 Images Ready for Test - Was: RE: =
longest
eek so far !!!<br>
<br>
Yep, here's the package info, I'll complete submittal notes tomorrow if =
that's
alright:<br>
<br>
Changes since submittal 7:<br>
<br>
Change 22122 on 2006/12/09 by jobia@jobi:jobi '&nbsp;&nbsp; leftover =
changes
for changes'<br>
Change 22105 on 2006/12/08 by nagendras@nags_r21work 'Fix for TED16641 =
Wildcard
chara'<br>
Change 22076 on 2006/12/07 by henryl@henryl-linux
'&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Fixed TED#16678. O_GET_E'<br>
Change 22075 on 2006/12/07 by jong@jong-jong-cifs 'Make sure that the =
default
opti'<br>
Change 22074 on 2006/12/07 by jobia@jobi:jobi '&nbsp;&nbsp; Avoid a 4k =
stack
usage while'<br>
Change 22065 on 2006/12/06 by jobia@jobi:jobi '&nbsp;&nbsp; EEK should =
remove
all the in'<br>
Change 22060 on 2006/12/05 by maximk@maximk-13 'Add some functions. =
'<br>
<br>
EverON release images:<br>
<br>
Cheetah Debug Build Image:<br>
<br>
<a =
href=3D"ftp://upgrade:password@10.2.0.2/home/upgrade/R2.1.0.0DBG-120906.t=
ar.gz">ftp://upgrade:password@10.2.0.2/home/upgrade/R2.1.0.0DBG-120906.ta=
r.gz</a><br>
<br>
Bobcat Debug Build Image:<br>
<br>
<a
href=3D"ftp://upgrade:password@10.2.0.2/home/upgrade/R2.1.0.0BCDBG-120906=
.tar.gz">ftp://upgrade:password@10.2.0.2/home/upgrade/R2.1.0.0BCDBG-12090=
6.tar.gz</a><br>
<br>
Cheetah Opt Build Image:<br>
<br>
<a =
href=3D"ftp://upgrade:password@10.2.0.2/home/upgrade/R2.1.0.0-120906.tar.=
gz">ftp://upgrade:password@10.2.0.2/home/upgrade/R2.1.0.0-120906.tar.gz</=
a><br>
<br>
Bobcat Opt Build Image:<br>
<br>
<a =
href=3D"ftp://upgrade:password@10.2.0.2/home/upgrade/R2.1.0.0BC-120906.ta=
r.gz">ftp://upgrade:password@10.2.0.2/home/upgrade/R2.1.0.0BC-120906.tar.=
gz</a><br>
<br>
EverON Source tree:<br>
<br>
/n/Build-Trees/R2.1.0.0/R2.1.0.0-120906/nfx-tree<br>
<br>
Perforce sync info:<br>
<br>
//depot/R2_1_X_work/&#8230;@22122<br>
<br>
I'll get out submittal notes as soon as I can, thanks.<br>
<br>
-Ken<br>
<br>
-----Original Message-----<br>
From: Paul Hammer<br>
Sent: Sat 12/9/2006 9:47 PM<br>
To: Tim Gardner; Ken Renshaw; <st1:PersonName w:st=3D"on">Vikas =
Saini</st1:PersonName>;
<st1:PersonName w:st=3D"on">Sandrine Boulanger</st1:PersonName><br>
Subject: RE: longest eek so far !!!<br>
<br>
Cool, Ken do we have a submittal?<br>
<br>
________________________________<br>
<br>
From: Tim Gardner<br>
Sent: Sat 12/9/2006 5:47 PM<br>
To: Ken Renshaw; Paul Hammer; <st1:PersonName w:st=3D"on">Vikas =
Saini</st1:PersonName>;
<st1:PersonName w:st=3D"on">Sandrine Boulanger</st1:PersonName><br>
Subject: RE: longest eek so far !!!<br>
<br>
<br>
<br>
take it. I approved the checkin.<br>
<br>
-----Original Message-----<br>
From: Ken Renshaw<br>
Sent: Saturday, December 09, 2006 5:43 PM<br>
To: Paul Hammer; <st1:PersonName w:st=3D"on">Vikas =
Saini</st1:PersonName>; <st1:PersonName
w:st=3D"on">Sandrine Boulanger</st1:PersonName>; Tim Gardner<br>
Subject: RE: longest eek so far !!!<br>
<br>
It's just some functions for GDB that would be useful in debugging the =
tree,
it's more or less a GDB script instead of a piece of EverON code. I'd =
vote for
just leaving it, but can skip it if you'd like.<br>
<br>
<br>
-----Original Message-----<br>
From: Paul Hammer<br>
Sent: Sat 12/9/2006 5:35 PM<br>
To: <st1:PersonName w:st=3D"on">Vikas Saini</st1:PersonName>; Ken =
Renshaw; <st1:PersonName
w:st=3D"on">Sandrine Boulanger</st1:PersonName>; Tim Gardner<br>
Subject: RE: longest eek so far !!!<br>
<br>
Thanks, guess we should take it, not sure why it is there. Tim do you =
know why
this in in here?<br>
<br>
________________________________<br>
<br>
From: <st1:PersonName w:st=3D"on">Vikas Saini</st1:PersonName><br>
Sent: Sat 12/9/2006 4:33 PM<br>
To: Paul Hammer; Ken Renshaw; <st1:PersonName w:st=3D"on">Sandrine =
Boulanger</st1:PersonName><br>
Subject: RE: longest eek so far !!!<br>
<br>
<br>
<br>
excepy max check in, everything is in MF list for Clio<br>
<br>
<br>
________________________________<br>
<br>
From: Ken Renshaw<br>
Sent: Sat 12/9/2006 2:49 PM<br>
To: Paul Hammer; <st1:PersonName w:st=3D"on">Sandrine =
Boulanger</st1:PersonName>;
<st1:PersonName w:st=3D"on">Vikas Saini</st1:PersonName><br>
Subject: RE: longest eek so far !!!<br>
<br>
<br>
<br>
Here is what's been checked in since sub7 ( the last one is just some =
new GDB
functions ):<br>
<br>
Change 22122 on 2006/12/09 by jobia@jobi:jobi '&nbsp;&nbsp; leftover =
changes
for changes'<br>
Change 22105 on 2006/12/08 by nagendras@nags_r21work 'Fix for TED16641 =
Wildcard
chara'<br>
Change 22076 on 2006/12/07 by henryl@henryl-linux
'&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Fixed TED#16678. O_GET_E'<br>
Change 22075 on 2006/12/07 by jong@jong-jong-cifs 'Make sure that the =
default
opti'<br>
Change 22074 on 2006/12/07 by jobia@jobi:jobi '&nbsp;&nbsp; Avoid a 4k =
stack
usage while'<br>
Change 22065 on 2006/12/06 by jobia@jobi:jobi '&nbsp;&nbsp; EEK should =
remove
all the in'<br>
Change 22060 on 2006/12/05 by maximk@maximk-13 'Add some functions. =
'<br>
<br>
Long descriptions:<br>
<br>
Change 22122 by jobia@jobi:jobi on 2006/12/09 14:40:47<br>
<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; leftover =
changes
for changes made for defect TED00016681 and TED00016685.<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; EEK should =
not
dereference an inode/buffer, after unlocking the lock.<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Mark/Fix =
used
blocks, using inode buffers instead of inodes.<br>
&nbsp;&nbsp;&nbsp;<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Reviewed by =
JonG.<br>
<br>
Affected files ...<br>
<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/btree/emaproot.c#6 edit<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-dir.c#5 edit<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-eek-quota.c#3 edit<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-eek-quota.h#2 edit<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-eek.c#21 edit<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-proto.h#4 edit<br>
<br>
Change 22105 by nagendras@nags_r21work on 2006/12/08 10:48:45<br>
<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Fix for TED16641<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Wildcard characters were not =
being
accepted for domain names in idmap rules.<br>
&nbsp;&nbsp;&nbsp;<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; reviewed by briand<br>
<br>
Affected files ...<br>
<br>
... //depot/R2_1_X_work/nfx-tree/code/ssc-authen-lib/authen-lib-api.h#2 =
edit<br>
... //depot/R2_1_X_work/nfx-tree/code/ssc-authen-lib/idmap-cfg.c#2 =
edit<br>
... //depot/R2_1_X_work/nfx-tree/code/ssc-nfxsh/cmd_idmap.c#2 edit<br>
<br>
Change 22076 by henryl@henryl-linux on 2006/12/07 10:07:59<br>
<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;
Fixed TED#16678. O_GET_EXCL() can return NULL buf if the file has a hole =
on
that page offset or an error when caller failed to get blocking lock. =
Trigger a
volume exception and send ELOG msg to print the page offset and inode =
number.<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;
Reviewed by Jobia<br>
<br>
Affected files ...<br>
<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-security.c#2 edit<br>
<br>
Change 22075 by jong@jong-jong-cifs on 2006/12/07 09:56:28<br>
<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Make sure that the default =
option
for creating a volume is normal<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;
stability.&nbsp; This impacts mirror volume creation.<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;
This addresses defect 16718<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;
reviewed by JobiA<br>
<br>
Affected files ...<br>
<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-api.h#6 edit<br>
<br>
Change 22074 by jobia@jobi:jobi on 2006/12/07 09:40:13<br>
<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Avoid a 4k =
stack
usage while traversing the emap btrees.<br>
&nbsp;&nbsp;&nbsp;<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Corrupted =
special
files were not being fixed correctly, thus would have<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; generated =
errors
in every eek run.<br>
&nbsp;&nbsp;&nbsp;<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Symbolic =
links
with invalid numblocks are detected/fixed.<br>
&nbsp;&nbsp;&nbsp;<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; A =
non-directory
inode was checked for not to have quota tree root flag<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; while =
traversing
the directories.&nbsp; If parent directory is missing, this<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; check was =
missing
for its children and thus a second eek would<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; report =
those
errors since the inode is in lost+found then.&nbsp; Fix this<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; issue first =
time
itself.<br>
&nbsp;&nbsp;&nbsp;<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Added a =
function
fs_eek_validateAndFix() to consolidate all the<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
checks/fixes on a
disk inode.<br>
&nbsp;&nbsp;&nbsp;<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Some minor =
changes
in fs-debug.c.<br>
&nbsp;&nbsp;&nbsp;<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Defect
TED00016681.<br>
&nbsp;&nbsp;&nbsp;<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Reviewed by =
JonG.<br>
<br>
Affected files ...<br>
<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/btree/emaproot.c#5 edit<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-debug.c#8 edit<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-eek.c#20 edit<br>
<br>
Change 22065 by jobia@jobi:jobi on 2006/12/06 15:25:17<br>
<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; EEK should =
remove
all the inodes sharing the duplicate blocks.<br>
&nbsp;&nbsp;&nbsp;<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Defect =
16685.<br>
&nbsp;&nbsp;&nbsp;<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Reviewed by =
JonG.<br>
<br>
Affected files ...<br>
<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/btree/emaproot.c#4 edit<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-eek.c#19 edit<br>
... //depot/R2_1_X_work/nfx-tree/code/sm-fs/fs-eek.h#11 edit<br>
<br>
Change 22060 by maximk@maximk-13 on 2006/12/05 14:44:29<br>
<br>
&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Add some functions.<br>
<br>
Affected files ...<br>
<br>
... //depot/R2_1_X_work/nfx-tree/gdbfuncs#2 edit<br>
<br>
-----Original Message-----<br>
From: Paul Hammer<br>
Sent: Sat 12/9/2006 12:40 PM<br>
To: Ken Renshaw; <st1:PersonName w:st=3D"on">Sandrine =
Boulanger</st1:PersonName>;
<st1:PersonName w:st=3D"on">Vikas Saini</st1:PersonName><br>
Subject: RE: longest eek so far !!!<br>
<br>
YOu bet, was hoping for an update from Tim/Dev about the mem leaks that =
have
yet to fix.<br>
<br>
-paul<br>
<br>
________________________________<br>
<br>
From: Ken Renshaw<br>
Sent: Sat 12/9/2006 12:34 PM<br>
To: Paul Hammer<br>
Subject: Re: longest eek so far !!!<br>
<br>
<br>
<br>
Hey Paul, likewise can you keep me in the loop for any Clio MFs or =
builds past
the last submittal 7? I've not heard anything about an RC build, unless =
sub7 is
considered RC1 by some.<br>
<br>
Thanks,<br>
<br>
-Ken<br>
<br>
<br>
<br>
-----Original Message-----<br>
From: Paul Hammer<br>
To: Jobi Ariyamannil; Raj Kumar; <st1:PersonName w:st=3D"on">Vikas =
Saini</st1:PersonName>;
<st1:PersonName w:st=3D"on">Sandrine Boulanger</st1:PersonName>; =
<st1:PersonName
w:st=3D"on">Jay Michlin</st1:PersonName>; Henry Lau; Jerry Lopatin; Tim =
Gardner; <st1:PersonName
w:st=3D"on">Brian DeForest</st1:PersonName><br>
CC: dl-QA<br>
Sent: Sat Dec 09 12:06:49 2006<br>
Subject: RE: longest eek so far !!!<br>
<br>
Thanks Jobi.<br>
<br>
Since this eek run is in the soak env I do not think the cfg has =
changed, Raj
or Vikas can you confirm?<br>
<br>
That is good news on the quotas, nice to hear that you have identified =
the
problem.<br>
<br>
We need to sync up on the eek part and the next submittal. As of now we =
are
just waiting on the final two MF's to come through and then we should be =
done
from the Dev perspectice. QA has already started the final regression =
pass on
Clio and we hope to install the RC on MD on Monday. Did not know there =
was
other changes being submitted, lets talk about how to proceed.<br>
<br>
Should we change the defaults for shippinf eek? I asked Raj to rerun the =
eek
tests for comparison in the default configuration since that is how we =
ship it
and how I belive customers usually run it.<br>
<br>
Good stuff Jobi, thanks.<br>
<br>
-Paul<br>
<br>
<br>
________________________________<br>
<br>
From: Jobi Ariyamannil<br>
Sent: Sat 12/9/2006 10:27 AM<br>
To: Paul Hammer; Raj Kumar; <st1:PersonName w:st=3D"on">Vikas =
Saini</st1:PersonName>;
<st1:PersonName w:st=3D"on">Sandrine Boulanger</st1:PersonName>; =
<st1:PersonName
w:st=3D"on">Jay Michlin</st1:PersonName>; Henry Lau; Jerry Lopatin; Tim =
Gardner; <st1:PersonName
w:st=3D"on">Brian DeForest</st1:PersonName><br>
Cc: dl-QA<br>
Subject: RE: longest eek so far !!!<br>
<br>
<br>
<br>
This time EEK has been running since Dec 6, 10am.<br>
<br>
I also have been monitoring the eek progress this time.<br>
<br>
Something strange happened this time, there were I/O retries and eek has =
been
slowed down.<br>
<br>
I looked at the code changes between submittal 4 and 7 and could not =
explain
the difference in performance, so this must be something changed in the
configuration.<br>
<br>
<br>
<br>
Good news is that, I figured out why EEK is slow processing large number =
of
quota records.<br>
<br>
These issues cannot be fixed in 2.1.&nbsp; If some customer complains =
about eek
performance while processing large number of quota records, we have to =
suggest
using the new eek option to skip processing quota records during =
eek.<br>
<br>
<br>
<br>
There have been some more changes to eek after submittal 7.&nbsp; We =
should
restart eek on this filesystem once the next submittal is available.<br>
<br>
In all my tests, eek in 2.1 is 40% faster than, that of in 133 (I =
verified this
on a filesystem with 100 million inodes too).<br>
<br>
It would be good if QA can validate this claim.<br>
<br>
<br>
<br>
Also while running eek on filesystems of large size and large number of =
files
and directories, using the default FP cache configuration is a very bad =
idea.<br>
<br>
EEK can be made much faster by configuring the caches and this is =
something we
strongly advise our customers too.<br>
<br>
<br>
<br>
Regards,<br>
<br>
Jobi<br>
<br>
<br>
<br>
________________________________<br>
<br>
From: Paul Hammer<br>
Sent: Saturday, December 09, 2006 9:39 AM<br>
To: Raj Kumar; Jobi Ariyamannil; <st1:PersonName w:st=3D"on">Vikas =
Saini</st1:PersonName>;
<st1:PersonName w:st=3D"on">Sandrine Boulanger</st1:PersonName>; =
<st1:PersonName
w:st=3D"on">Jay Michlin</st1:PersonName>; Henry Lau; Jerry Lopatin; Tim =
Gardner; <st1:PersonName
w:st=3D"on">Brian DeForest</st1:PersonName><br>
Cc: dl-QA<br>
Subject: RE: longest eek so far !!!<br>
<br>
<br>
<br>
Raj, how long has this one been running?<br>
<br>
________________________________<br>
<br>
From: Raj Kumar<br>
Sent: Sat 12/9/2006 6:57 AM<br>
To: Paul Hammer; Jobi Ariyamannil; <st1:PersonName w:st=3D"on">Vikas =
Saini</st1:PersonName>;
<st1:PersonName w:st=3D"on">Sandrine Boulanger</st1:PersonName>; =
<st1:PersonName
w:st=3D"on">Jay Michlin</st1:PersonName>; Henry Lau; Jerry Lopatin; Tim =
Gardner; <st1:PersonName
w:st=3D"on">Brian DeForest</st1:PersonName><br>
Cc: dl-QA<br>
Subject: RE: longest eek so far !!!<br>
<br>
Filer: eng49<br>
<br>
Volume - eng49-3<br>
<br>
Cache status captured every 10 minutes: /usr/raj/cache<br>
<br>
<br>
<br>
EEK is still running. I am afraid this is going much worse than the last =
run.
In the last run processing quotas took 90% of the time. This time we =
have not reached
quota processing yet, delay is on &quot;mark used inodes&quot;.<br>
<br>
<br>
<br>
# fscmd eek eng49-3 -c -r<br>
<br>
all snapshots&nbsp; will be removed.<br>
<br>
running eek in repair mode<br>
<br>
Wed Dec&nbsp; 6 10:10:53 2006 =3D=3D eng49-3 =3D=3D verifying meta =
inodes =3D=3D<br>
<br>
eng49-3: removing snapshots<br>
<br>
Wed Dec&nbsp; 6 10:11:30 2006 =3D=3D eng49-3 =3D=3D mark and compare =
reference counts
=3D=3D<br>
<br>
Wed Dec&nbsp; 6 10:11:33 2006 =3D=3D eng49-3 =3D=3D mark used blocks =
=3D=3D<br>
<br>
processed 194314240 of 194314240 inodes<br>
<br>
<br>
<br>
Wed Dec&nbsp; 6 11:18:58 2006 =3D=3D eng49-3 =3D=3D compare used blocks =
=3D=3D<br>
<br>
processed 0 of 105574336 blocks<br>
<br>
<br>
<br>
Thu Dec&nbsp; 7 07:49:08 2006 =3D=3D eng49-3 =3D=3D processing quota =
trees =3D=3D<br>
<br>
processed 1 quota tree records<br>
<br>
Thu Dec&nbsp; 7 07:49:09 2006 =3D=3D eng49-3 =3D=3D mark used inodes =
=3D=3D<br>
<br>
processed 68719104 of 194314240 inodes, 10145703 of 16441522 =
directories<br>
<br>
<br>
<br>
________________________________<br>
<br>
From: Paul Hammer<br>
Sent: Wednesday, December 06, 2006 8:35 AM<br>
To: Jobi Ariyamannil; <st1:PersonName w:st=3D"on">Vikas =
Saini</st1:PersonName>; <st1:PersonName
w:st=3D"on">Sandrine Boulanger</st1:PersonName>; <st1:PersonName =
w:st=3D"on">Jay
 Michlin</st1:PersonName>; Henry Lau; Jerry Lopatin; Tim Gardner; =
<st1:PersonName
w:st=3D"on">Brian DeForest</st1:PersonName><br>
Cc: dl-QA<br>
Subject: RE: longest eek so far !!!<br>
<br>
<br>
<br>
Thanks Jobi. Vikas please let us know how the rerun of eek goes, =
thanks.<br>
<br>
<br>
<br>
-Paul<br>
<br>
<br>
<br>
________________________________<br>
<br>
From: Jobi Ariyamannil<br>
Sent: Wed 12/6/2006 12:25 AM<br>
To: Paul Hammer; <st1:PersonName w:st=3D"on">Vikas =
Saini</st1:PersonName>; <st1:PersonName
w:st=3D"on">Sandrine Boulanger</st1:PersonName>; <st1:PersonName =
w:st=3D"on">Jay
 Michlin</st1:PersonName>; Henry Lau; Jerry Lopatin; Tim Gardner; =
<st1:PersonName
w:st=3D"on">Brian DeForest</st1:PersonName><br>
Cc: dl-QA<br>
Subject: RE: longest eek so far !!!<br>
<br>
Hi Paul,<br>
<br>
<br>
<br>
There have been many improvements to eek, but most of them not going to =
improve
eek processing time of large number of quota records.<br>
<br>
We still don't know what is causing bad eek performance while processing =
large
number of quota records.<br>
<br>
<br>
<br>
But we made an obvious improvement to eek (issue read aheads of quota =
records)
hoping to make eek faster while processing the quota records.<br>
<br>
We have not verified how much this change would help.&nbsp; Testing with
submittal 7 would verify this.<br>
<br>
<br>
<br>
Also we added an argument to eek which if specified, will skip quota
checks.&nbsp; Using that option, the given filesystem can be eeked in =
one day
or so (which is reasonable considering the large number of =
inodes/directories
etc).<br>
<br>
<br>
<br>
Also we may be able to configure the caches on the filer to get better
performance from eek.<br>
<br>
<br>
<br>
Surprisingly, no customers so far reported so many quota records.<br>
<br>
<br>
<br>
Regards,<br>
<br>
Jobi<br>
<br>
<br>
<br>
________________________________<br>
<br>
From: Paul Hammer<br>
Sent: Tuesday, December 05, 2006 11:29 PM<br>
To: Jobi Ariyamannil; <st1:PersonName w:st=3D"on">Vikas =
Saini</st1:PersonName>; <st1:PersonName
w:st=3D"on">Sandrine Boulanger</st1:PersonName>; <st1:PersonName =
w:st=3D"on">Jay
 Michlin</st1:PersonName>; Henry Lau; Jerry Lopatin; Tim Gardner; =
<st1:PersonName
w:st=3D"on">Brian DeForest</st1:PersonName><br>
Cc: dl-QA<br>
Subject: RE: longest eek so far !!!<br>
<br>
<br>
<br>
Hi Jobi,<br>
<br>
<br>
<br>
Are there any improvements since we started this eek run (2 submittals =
ago)
that will reduce the amount of time eek takes in a quotated env? What I =
am
really asking is: will customers with quotas set see this type of eek
performance, potentially take weeks to run eek with 2.1?<br>
<br>
<br>
<br>
I have asked Vikas that we rerun the eek test on the same volume in the =
soak
env to see if we are now faster, vikas let me know that even though it =
took 16
days that eek only fixed one problem.<br>
<br>
<br>
<br>
Thanks,<br>
<br>
<br>
<br>
-Paul<br>
<br>
<br>
<br>
________________________________<br>
<br>
From: Jobi Ariyamannil<br>
Sent: Tue 12/5/2006 8:11 PM<br>
To: <st1:PersonName w:st=3D"on">Vikas Saini</st1:PersonName>; =
<st1:PersonName
w:st=3D"on">Sandrine Boulanger</st1:PersonName>; <st1:PersonName =
w:st=3D"on">Jay
 Michlin</st1:PersonName>; Henry Lau; Jerry Lopatin; Tim Gardner; =
<st1:PersonName
w:st=3D"on">Brian DeForest</st1:PersonName><br>
Cc: dl-QA<br>
Subject: RE: longest eek so far !!!<br>
<br>
Its again spent a lot of days processing quota records.&nbsp; Rest of =
the
passes look reasonable.<br>
<br>
Submital 7 will have an option in eek to skip quota records passing
(&quot;-q&quot;) option.<br>
<br>
Going forward, while reporting eek delays, please mention the build =
info, fscmd
cachestats output.<br>
<br>
As we have added read ahead of quota records in submittal 7, we may test =
that
too.<br>
<br>
Regards,<br>
<br>
Jobi<br>
<br>
_____________________________________________<br>
From: <st1:PersonName w:st=3D"on">Vikas Saini</st1:PersonName><br>
Sent: Tuesday, December 05, 2006 8:07 PM<br>
To: <st1:PersonName w:st=3D"on">Sandrine Boulanger</st1:PersonName>; =
<st1:PersonName
w:st=3D"on">Jay Michlin</st1:PersonName>; Jobi Ariyamannil; Henry Lau; =
Jerry
Lopatin; Tim Gardner; <st1:PersonName w:st=3D"on">Brian =
DeForest</st1:PersonName><br>
Cc: dl-QA<br>
Subject: longest eek so far !!!<br>
Importance: High<br>
<br>
Live view done. Eek for snapshot is still going on. Going to abort the =
snapshot
eek.<br>
<br>
<br>
<br>
# fscmd eek eng49-3 lvolOnline -r -f<br>
<br>
running eek in repair mode<br>
<br>
Force mode: corrupt snapshots&nbsp; will be automatically removed.<br>
<br>
volId 0x17a000000d0 is not online, state is 1<br>
<br>
eek: trying to bring the logical volume online<br>
<br>
Done.<br>
<br>
Mon Nov 20 09:22:21 2006 =3D=3D eng49-3 =3D=3D verifying meta inodes =
=3D=3D<br>
<br>
eng49-3: Inode (I#1) file invalid numblocks 3036141 in superblock, =
expected
3036142<br>
<br>
Mon Nov 20 09:22:35 2006 =3D=3D eng49-3 =3D=3D mark and compare =
reference counts =3D=3D<br>
<br>
Mon Nov 20 09:23:08 2006 =3D=3D eng49-3 =3D=3D mark used blocks =
=3D=3D<br>
<br>
eng49-3: Inode (I#1) file invalid numblocks 3036141 in superblock, =
expected
3036142<br>
<br>
processed 194314240 of 194314240 inodes<br>
<br>
Mon Nov 20 10:20:38 2006 =3D=3D eng49-3 =3D=3D compare used blocks =
=3D=3D<br>
<br>
processed 105574336 of 105574336 blocks<br>
<br>
Mon Nov 20 11:31:12 2006 =3D=3D eng49-3 =3D=3D processing quota trees =
=3D=3D<br>
<br>
processed 1 quota tree records<br>
<br>
Mon Nov 20 11:31:12 2006 =3D=3D eng49-3 =3D=3D mark used inodes =
=3D=3D<br>
<br>
proceprocessed 194314240 of 194314240 inodes, 16441522 of 16441522 =
directories<br>
<br>
Tue Nov 21 01:42:55 2006 =3D=3D eng49-3 =3D=3D detecting unused quota =
trees =3D=3D<br>
<br>
Tue Nov 21 01:42:55 2006 =3D=3D eng49-3 =3D=3D processing user quotas =
=3D=3D<br>
<br>
processed 1220544 user quota records<br>
<br>
processed 2466048 user quota records<br>
<br>
processed 3185126 user quota records<br>
<br>
Sat Dec&nbsp; 2 06:52:15 2006 =3D=3D eng49-3 =3D=3D processing group =
quotas =3D=3D<br>
<br>
processed 1 group quota records<br>
<br>
Sat Dec&nbsp; 2 06:53:01 2006 =3D=3D eng49-3 =3D=3D compare used inodes =
=3D=3D<br>
<br>
processed 194314240 of 194314240 inodes, 16441522 of 16441522 =
directories<br>
<br>
Sun Dec&nbsp; 3 22:36:46 2006 =3D=3D eng49-3 =3D=3D user quota not =
enabled - usage
verification skipped =3D=3D<br>
<br>
Sun Dec&nbsp; 3 22:36:46 2006 =3D=3D eng49-3 =3D=3D group quota not =
enabled - usage
verification skipped =3D=3D<br>
<br>
Sun Dec&nbsp; 3 22:36:46 2006 =3D=3D eng49-3 =3D=3D relink lost inodes =
=3D=3D<br>
<br>
Sun Dec&nbsp; 3 22:37:22 2006 =3D=3D eng49-3 =3D=3D verify link inode =
=3D=3D<br>
<br>
Mon Dec&nbsp; 4 10:49:19 2006 =3D=3D eng49-3 =3D=3D live view done =
=3D=3D&nbsp; blksUsed
88207888 inodesUsed 58298273 =3D=3D<br>
<br>
Mon Dec&nbsp; 4 10:49:19 2006 =3D=3D eng49-3 =3D=3D checking snapshots =
=3D=3D<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
</span></font><o:p></o:p></p>

</div>

</div>

</body>

</html>

------_=_NextPart_001_01C71D47.DC03FD19--
