X-MimeOLE: Produced By Microsoft Exchange V6.5
Received: by onstor-exch02.onstor.net 
	id <01C71E37.D0274E35@onstor-exch02.onstor.net>; Tue, 12 Dec 2006 13:52:26 -0800
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----_=_NextPart_001_01C71E37.D0274E35"
Content-class: urn:content-classes:message
Subject: RE: Maximn number of inodes
Date: Tue, 12 Dec 2006 13:52:26 -0800
Message-ID: <BB375AF679D4A34E9CA8DFA650E2B04E01B7068E@onstor-exch02.onstor.net>
In-Reply-To: <BB375AF679D4A34E9CA8DFA650E2B04E01B7066D@onstor-exch02.onstor.net>
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
Thread-Topic: Maximn number of inodes
thread-index: AcceCgTam1vksTXLS1i27rWuAPT1zgABO3ZgAAb2dAAAAaxIUAAAFM2QAAA1OeAAAFmtcAAAyq5w
From: "Eric Barrett" <eric.barrett@onstor.com>
To: "Steffen Thuemmel" <steffen.thuemmel@onstor.com>,
	"Bill Fenech" <bill.fenech@onstor.com>,
	"Henry Lau" <henry.lau@onstor.com>,
	"Victor Carrell \(Glasshouse\)" <vcarrell@css.glasshouse.com>
Cc: "dl-cstech" <dl-cstech@onstor.com>,
	"Sudheesh Nair" <sudheesh.nair@onstor.com>

This is a multi-part message in MIME format.

------_=_NextPart_001_01C71E37.D0274E35
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Even if there is 1 free inode then it should succeed.  The exact
application error will tell us why it cannot continue.
=20
I can't answer the threshold question -- somebody from Engineering might
be able to.
=20
There is no limit to files per directory, though it does get very slow
if you get over ~200,000 or so.  There IS a limit in subdirectories per
directory, which is 65532.
=20
=20
=20
=20

________________________________

From: Steffen Thuemmel=20
Sent: Tuesday, December 12, 2006 1:35 PM
To: Eric Barrett; Bill Fenech; Henry Lau; Victor Carrell (Glasshouse)
Cc: dl-cstech; Sudheesh Nair
Subject: RE: Maximn number of inodes



Eric,

=20

the customer could not join a web-ex session, they had some trouble with
the connection speed. So I could only do a Q&A with them. They told me,
the application receives an error and breakes. They checked with df -h
and df -I and determined that there is enough space, but not enough
inodes. They added more space to the volume, but still the application
did not work. They deleted some files, then the application worked
again. Until it broke again.

=20

Are we sure, that this is not a problem with inodes ? At what threshold
does the system add more inodes ?=20

=20

If they delete some files and it works again, could that be an
indication for a limit in the number of files per directory ?

=20

Steffen Thuemmel=20

=20

ONStor

Schleussner Str. 42

D-63263 Neu-Isenburg

Germany

=20

telf.       +49 6102 884 84-0

mobil.     +49 173 673 3434

mail.       steffen.thuemmel@onstor.com

web.       www.onstor.com <http://www.onstor.com/>=20

=20

________________________________

From: Eric Barrett=20
Sent: Dienstag, 12. Dezember 2006 22:16
To: Bill Fenech; Steffen Thuemmel; Henry Lau; Victor Carrell
(Glasshouse)
Cc: dl-cstech; Sudheesh Nair
Subject: RE: Maximn number of inodes

=20

Bill,

=20

Sure, but that still doesn't tell us what the error is.  I also contend
the assertion that the auto-allocation of new inodes is not working,
unless we see that the system is at 100% or otherwise have an
application error indicating this.

=20

Steffen, I'm not saying it's not happening, just that there's an
assumption being made here which is not proven, and therefore which we
cannot act upon.

=20

=20

________________________________

From: Bill Fenech=20
Sent: Tuesday, December 12, 2006 1:10 PM
To: Eric Barrett; Steffen Thuemmel; Henry Lau; Victor Carrell
(Glasshouse)
Cc: dl-cstech; Sudheesh Nair
Subject: RE: Maximn number of inodes

From the case (4115):

=20

This is an EVAL at Allegro.=20

Customer is loading files onto a Bobcat volume and noticed that the
mounted FS is running out of inodes. Even adding more space to the
volume (1 LUN, approx 200GB) did not relief. They deleted some files and
started loading again, but the situation is still the same. For whatever
reason, the auto-mechanism of allocating more inodes does not work. Why
?=20
Here are some command outputs which document:=20

fscmd viewfs onstor23=20
Name : onstor23=20
State : online=20
VolId : 0x0000036300000070=20
Size : 1433471 MByte (Nbr blocks 183484376) (Total blocks incl log:
183500760)=20
Available : 905505 MByte (Nbr blocks 115904645)=20
Inodes : 17449982 (available 528747, used 16921235)=20
Blks : total 183484376, allocated 66885653, reserved 0, beyond 0 minFree
694078 minFreeRm 462718=20
snapshots : 0xd=20
grow HWM : 0=20
vsid : 4=20
volType : 0=20
Mkfs : Tue Dec 5 13:39:32 2006=20
Number of mounts: 3 (dirty: 0 )=20
Number of umounts: 3=20
Number of mount failures: 0 (log) 0 (replay) 0 (eek) 0 (snap)=20
Result of last 3 mount operation(s)=20
online Mount time Tue Dec 5 17:52:17 2006=20
online Mount time Tue Dec 5 17:10:27 2006=20
online Mount time Tue Dec 5 13:39:38 2006=20
Result of last 3 umount operation(s)=20
umount time Tue Dec 5 17:50:51 2006=20
umount time Tue Dec 5 17:09:01 2006=20
umount time Tue Dec 5 13:39:38 2006=20
oplocks : allow=20
charSubst : disabled=20
automatic atime update: disabled=20
unstable name space updates: enabled=20
unstable all: enabled=20

***as one can see, the number of available inodes is very low, compared
to the available space in the volume. And it decreases while thy load
more files (file size on average 30kB) see:=20

fscmd viewfs onstor23=20
Name : onstor23=20
State : online=20
VolId : 0x0000036300000070=20
Size : 1433471 MByte (Nbr blocks 183484376) (Total blocks incl log:
183500760)=20
Available : 905425 MByte (Nbr blocks 115894459)=20
Inodes : 17449982 (available 526080, used 16923902)=20
Blks : total 183484376, allocated 66895839, reserved 0, beyond 0 minFree
694078 minFreeRm 462718=20
snapshots : 0xd=20
grow HWM : 0=20
vsid : 4=20
volType : 0=20
Mkfs : Tue Dec 5 13:39:32 2006=20
Number of mounts: 3 (dirty: 0 )=20
Number of umounts: 3=20
Number of mount failures: 0 (log) 0 (replay) 0 (eek) 0 (snap)=20
Result of last 3 mount operation(s)=20
online Mount time Tue Dec 5 17:52:17 2006=20
online Mount time Tue Dec 5 17:10:27 2006=20
online Mount time Tue Dec 5 13:39:38 2006=20
Result of last 3 umount operation(s)=20
umount time Tue Dec 5 17:50:51 2006=20
umount time Tue Dec 5 17:09:01 2006=20
umount time Tue Dec 5 13:39:38 2006=20
oplocks : allow=20
charSubst : disabled=20
automatic atime update: disabled=20
unstable name space updates: enabled=20
unstable all: enabled=20

***it is consistent with output of df -h at the Linux client which loads
the files:=20

192.168.0.141:/onstor13=20
1.2T 516G 685G 43% /photos/photos01=20
192.168.0.142:/onstor23=20
1.4T 516G 885G 37% /photos/photos02=20
[root@rescue photos02]#=20
[15:30:25]=20
192.168.0.141:/onstor13=20
17449982 16937413 512569 98% /photos/photos01=20
192.168.0.142:/onstor23=20
17449982 16927056 522926 98% /photos/photos02=20
[15:31:11]=20
192.168.0.141:/onstor13=20
17449982 16937784 512198 98% /photos/photos01=20
192.168.0.142:/onstor23=20
17449982 16927353 522629 98% /photos/photos02=20
[root@rescue photos02]#=20

fscmd viewfs onstor23=20
Name : onstor23=20
State : online=20
VolId : 0x0000036300000070=20
Size : 1433471 MByte (Nbr blocks 183484376) (Total blocks incl log:
183500760)=20
Available : 905306 MByte (Nbr blocks 115879219)=20
Inodes : 17449982 (available 522152, used 16927830)=20
Blks : total 183484376, allocated 66911079, reserved 0, beyond 0 minFree
694078 minFreeRm 462718=20
snapshots : 0xd=20
grow HWM : 0=20
vsid : 4=20
volType : 0=20
Mkfs : Tue Dec 5 13:39:32 2006=20
Number of mounts: 3 (dirty: 0 )=20
Number of umounts: 3=20
Number of mount failures: 0 (log) 0 (replay) 0 (eek) 0 (snap)=20
Result of last 3 mount operation(s)=20
online Mount time Tue Dec 5 17:52:17 2006=20
online Mount time Tue Dec 5 17:10:27 2006=20
online Mount time Tue Dec 5 13:39:38 2006=20
Result of last 3 umount operation(s)=20
umount time Tue Dec 5 17:50:51 2006=20
umount time Tue Dec 5 17:09:01 2006=20
umount time Tue Dec 5 13:39:38 2006=20
oplocks : allow=20
charSubst : disabled=20
automatic atime update: disabled=20
unstable name space updates: enabled=20
unstable all: enabled=20

Volume Details=20
--------------=20

Name : onstor23=20
Id : 0x36300000070=20
Type : Standard=20
Virtual Server : ONSTOR2=20
Status : Mounted=20
Current Size (MiB): 1433471.69=20
Used Size (MiB): 528191.80=20
Available Size (MiB): 905279.89=20
Usage (%) : 36.85 %=20
Hard Quota (MiB): No Limit=20
Soft Quota (%) : N/A=20
High Water Mark (%) : N/A=20
Min. Auto Growth (MiB): 549887=20
Shared Read : allow=20
Oplocks : allow=20
CharSubst : disabled=20
CharSubstTable : 0000,0000,0000,0000,0000,0000,0000,0000=20
Language : en_us=20
Layout type : 0=20
Automatic Atime Updates: disabled=20
Stability: unstable all=20
Arrays : 3PARdata_03C6=20
Vendor/model : None=20
RAID Level : Raid-5=20
Min. Lun Size (MiB): No Min=20
Max. Lun Size (MiB): No Max=20

LUN List=20
Idx Device Name Size (MiB)=20
--------------------------------------------------=20
1 3PARdata_03C6_0000403C6 307199.94=20
2 3PARdata_03C6_0000103C6 307199.94=20
3 3PARdata_03C6_0000603C6 307199.94=20
4 3PARdata_03C6_0000503C6 307199.94=20
5 3PARdata_03C6_0003A03C6 204799.94=20
-------------------------------------------------=20

Name: ping=20
Date & Time : Tue Dec 12 16:07:07 2006=20
Time zone : Europe/Berlin=20
System Uptime : 33:19:06=20
System temperature (celsius): 44=20
Software Version: 1.3.3.1=20

chassis=20
--------=20
Model number: ONS-SYS-2260=20
System revision: C3=20
System serial number: 0614051015=20
MAC addr: 00:07:34:03:63:00=20

BMFPGA : Version 4=20
Board revision: B4=20
Board serial number: 0614050015=20
Boot Dev: wd0a (cf1)=20
SSC=20
PROM_R9000 : prom-2.0.3 : Thu Apr 13 16:44:49 2006=20

LUC revision: 3.2.10=20
TXRX0=20
PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006=20
NFP_TXRX : R1.3.3.1BC-103106 : Tue Oct 31 18:09:52 2006=20
TXRX1=20
PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006=20
NFP_TXRX : R1.3.3.1BC-103106 : Tue Oct 31 18:09:52 2006=20
FP0=20
PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006=20
NFP_FP : R1.3.3.1BC-103106 : Tue Oct 31 18:04:20 2006=20
FP1=20
PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006=20
NFP_FP : R1.3.3.1BC-103106 : Tue Oct 31 18:04:20 2006=20

FC0=20
PROM_R9000 : prom-2.0.3 : Thu Apr 13 16:44:49 2006=20
FCNIM : R1.3.3.1BC-103106 : Tue Oct 31 18:10:34 2006=20

NTP Configuration :=20
remote refid st t when poll reach delay offset jitter=20
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
=3D=3D=3D=3D=3D=3D=20
127.127.1.0 127.127.1.0 10 l 23 64 377 0.000 0.000 0.004=20
*192.168.0.193 150.254.183.15 2 u 738 1024 377 0.004 -3.555 0.179=20
SC1 IP : 192.168.129.5=20
SC2 IP : 10.11.12.13=20
No of Virtual server(s) : 2

=20

________________________________

From: Eric Barrett=20
Sent: Tuesday, December 12, 2006 1:08 PM
To: Steffen Thuemmel; Henry Lau; Victor Carrell (Glasshouse)
Cc: dl-cstech; Sudheesh Nair
Subject: RE: Maximn number of inodes

=20

Steffen,

=20

What error?  What gives it?  Need way more info here.

=20

Even at 98% inodes used they should not be getting an error.  100%,
sure, but they're not there.

=20

=20

=20

=20

________________________________

From: Steffen Thuemmel=20
Sent: Tuesday, December 12, 2006 12:33 PM
To: Henry Lau; Victor Carrell (Glasshouse)
Cc: dl-cstech; Sudheesh Nair
Subject: RE: Maximn number of inodes

Gentlemen,

=20

This doesn't help here. The customer is using an application that loads
(creates) many files (average size 30 kB) onto the filesystems on a
Bobcat.=20

They simulate their client behavior: The customer, Allegro, is an
internet auction provider. Their clients upload descriptions and picture
of their items they put into an auction.

=20

The application breakes after receiving an error. Looking at the
filesystem they determined that 98% of all inodes are used although the
capacity of the filesystem is only used less than 50%. They increased
the capacity by 200GB, but that did not clear the problem. They were not
able to create more files. Only after deleting some files, they could
generate new ones.

=20

So to me that looks like the automated process of inode allocation does
not work here. The question is why ?

=20

Regards,

St.

=20

Steffen Thuemmel=20

Manager Systems Engineering

Central Europe

=20

ONStor

Schleussner Str. 42

D-63263 Neu-Isenburg

Germany

=20

telf.       +49 6102 884 84-0

mobil.     +49 173 673 3434

mail.       steffen.thuemmel@onstor.com

web.       www.onstor.com <http://www.onstor.com/>=20

=20

________________________________

From: Henry Lau=20
Sent: Dienstag, 12. Dezember 2006 18:01
To: Victor Carrell (Glasshouse)
Cc: dl-cstech
Subject: RE: Maximn number of inodes

=20

Please check http://wiki/wiki/Inodes

=20

Thanks,

=20

Henry

=20

________________________________

From: Victor Carrell (Glasshouse)=20
Sent: Tuesday, December 12, 2006 8:25 AM
To: dl-cstech
Subject: Maximn number of inodes

=20

Hi,

=20

 I have a customer ONStor Germany case 4115 that appears to be running
out of inodes.  I have asked to turn off snapshots if on and retry their
test.  In the mean time it is my understanding that once indoes are used
up we double the number of inodes in the background.   Am I wrong in
this thinking?  Or is there something that would prevent this?  Or is
there a total maximum number of inodes allowed?  In this case 17449982

=20

Thanks

Victor


------_=_NextPart_001_01C71E37.D0274E35
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML xmlns=3D"http://www.w3.org/TR/REC-html40" xmlns:v =3D=20
"urn:schemas-microsoft-com:vml" xmlns:o =3D=20
"urn:schemas-microsoft-com:office:office" xmlns:w =3D=20
"urn:schemas-microsoft-com:office:word" xmlns:st1 =3D=20
"urn:schemas-microsoft-com:office:smarttags"><HEAD>
<META http-equiv=3DContent-Type content=3D"text/html; =
charset=3Dus-ascii">
<META content=3D"MSHTML 6.00.2900.2963" name=3DGENERATOR><!--[if !mso]>
<STYLE>v\:* {
	BEHAVIOR: url(#default#VML)
}
o\:* {
	BEHAVIOR: url(#default#VML)
}
w\:* {
	BEHAVIOR: url(#default#VML)
}
.shape {
	BEHAVIOR: url(#default#VML)
}
</STYLE>
<![endif]--><o:SmartTagType name=3D"country-region"=20
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"></o:SmartTagT=
ype><o:SmartTagType=20
name=3D"place"=20
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"></o:SmartTagT=
ype><!--[if !mso]>
<STYLE>st1\:* {
	BEHAVIOR: url(#default#ieooui)
}
</STYLE>
<![endif]-->
<STYLE>@font-face {
	font-family: MS Mincho;
}
@font-face {
	font-family: Tahoma;
}
@font-face {
	font-family: @MS Mincho;
}
@page Section1 {size: 612.0pt 792.0pt; margin: 72.0pt 90.0pt 72.0pt =
90.0pt; }
P.MsoNormal {
	FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"
}
LI.MsoNormal {
	FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"
}
DIV.MsoNormal {
	FONT-SIZE: 12pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"
}
A:link {
	COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlink {
	COLOR: blue; TEXT-DECORATION: underline
}
A:visited {
	COLOR: purple; TEXT-DECORATION: underline
}
SPAN.MsoHyperlinkFollowed {
	COLOR: purple; TEXT-DECORATION: underline
}
SPAN.EmailStyle17 {
	COLOR: windowtext; FONT-FAMILY: Arial; mso-style-type: personal
}
SPAN.EmailStyle18 {
	COLOR: navy; FONT-FAMILY: Arial; mso-style-type: personal
}
SPAN.EmailStyle19 {
	COLOR: navy; FONT-FAMILY: Arial; mso-style-type: personal
}
SPAN.EmailStyle20 {
	COLOR: navy; FONT-FAMILY: Arial; mso-style-type: personal
}
SPAN.EmailStyle21 {
	COLOR: navy; FONT-FAMILY: Arial; mso-style-type: personal-reply
}
DIV.Section1 {
	page: Section1
}
</STYLE>
<!--[if gte mso 9]><xml>
 <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
 <o:shapelayout v:ext=3D"edit">
  <o:idmap v:ext=3D"edit" data=3D"1" />
 </o:shapelayout></xml><![endif]--></HEAD>
<BODY lang=3DEN-US vLink=3Dpurple link=3Dblue>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D077104821-12122006><FONT =
face=3DArial=20
size=3D2>Even if there is 1 free inode then it should succeed.&nbsp; The =
exact=20
application error will tell us why it cannot =
continue.</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D077104821-12122006><FONT =
face=3DArial=20
size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D077104821-12122006><FONT =
face=3DArial size=3D2>I=20
can't answer the threshold question -- somebody from Engineering might =
be able=20
to.</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D077104821-12122006><FONT =
face=3DArial=20
size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D077104821-12122006><FONT =
face=3DArial=20
size=3D2>There is no limit to files per directory, though it does get =
very slow if=20
you get over ~200,000 or so.&nbsp; There IS a limit in subdirectories =
per=20
directory, which is 65532.</FONT></SPAN></DIV>
<DIV dir=3Dltr align=3Dleft><SPAN =
class=3D077104821-12122006></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D077104821-12122006><FONT =
face=3DArial=20
size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D077104821-12122006><FONT =
face=3DArial=20
size=3D2></FONT></SPAN>&nbsp;</DIV>
<DIV dir=3Dltr align=3Dleft><SPAN class=3D077104821-12122006><FONT =
face=3DArial=20
size=3D2></FONT></SPAN>&nbsp;</DIV><BR>
<DIV class=3DOutlookMessageHeader lang=3Den-us dir=3Dltr align=3Dleft>
<HR tabIndex=3D-1>
<FONT face=3DTahoma size=3D2><B>From:</B> Steffen Thuemmel =
<BR><B>Sent:</B> Tuesday,=20
December 12, 2006 1:35 PM<BR><B>To:</B> Eric Barrett; Bill Fenech; Henry =
Lau;=20
Victor Carrell (Glasshouse)<BR><B>Cc:</B> dl-cstech; Sudheesh=20
Nair<BR><B>Subject:</B> RE: Maximn number of inodes<BR></FONT><BR></DIV>
<DIV></DIV>
<DIV class=3DSection1>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">Eric,<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">the customer =
could not=20
join a web-ex session, they had some trouble with the connection speed. =
So I=20
could only do a Q&amp;A with them. They told me, the application =
receives an=20
error and breakes. They checked with df &#8211;h and df &#8211;I and =
determined that there=20
is enough space, but not enough inodes. They added more space to the =
volume, but=20
still the application did not work. They deleted some files, then the=20
application worked again. Until it broke =
again.<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Are we sure, =
that this=20
is not a problem with inodes ? At what threshold does the system add =
more inodes=20
? <o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">If they =
delete some=20
files and it works again, could that be an indication for a limit in the =
number=20
of files per directory ?<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<DIV>
<DIV>
<P class=3DMsoNormal><B><FONT face=3D"Times New Roman" color=3Dnavy =
size=3D2><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; COLOR: navy">Steffen =
Thuemmel=20
<o:p></o:p></SPAN></FONT></B></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" color=3Dnavy =
size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt; COLOR: =
navy"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><B><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN =
lang=3DDE=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">ONStor<o:p></o:p></SPAN></FONT></B></P>
<P class=3DMsoNormal><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN =
lang=3DDE=20
style=3D"FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: Tahoma">Schleussner =
Str.=20
42<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN =
lang=3DDE=20
style=3D"FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: Tahoma">D-63263=20
Neu-Isenburg<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><st1:country-region w:st=3D"on"><st1:place =
w:st=3D"on"><FONT=20
face=3DTahoma color=3Dnavy size=3D1><SPAN=20
style=3D"FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">Germany</SPAN></FONT></st1:place></st1:country-region><FONT=20
color=3Dnavy><SPAN style=3D"COLOR: navy"><o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" color=3Dnavy =
size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt; COLOR: =
navy"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><B><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">telf.</SPAN></FONT></B><B><FONT=20
face=3DTahoma color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Tahoma">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
</SPAN></FONT></B><B><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; COLOR: navy; FONT-FAMILY: =
Tahoma">+49=20
6102 884 84-0</SPAN></FONT></B><B><FONT face=3DTahoma color=3Dnavy =
size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma"><o:p></o:p></SPAN></FONT></B></P>
<P class=3DMsoNormal><B><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">mobil.=20
&nbsp;&nbsp;&nbsp; </SPAN></FONT></B><B><FONT face=3DTahoma color=3Dnavy =

size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; COLOR: navy; FONT-FAMILY: =
Tahoma">+49=20
173 673 3434<o:p></o:p></SPAN></FONT></B></P>
<P class=3DMsoNormal><B><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN =
lang=3DFR=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">mail.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
<A=20
href=3D"mailto:steffen.thuemmel@onstor.com">steffen.thuemmel@onstor.com</=
A><o:p></o:p></SPAN></FONT></B></P>
<P class=3DMsoNormal><B><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN =
lang=3DFR=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">web.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
<A =
href=3D"http://www.onstor.com/">www.onstor.com</A></SPAN></FONT></B><FONT=
=20
color=3Dnavy><SPAN lang=3DFR=20
style=3D"COLOR: navy"><o:p></o:p></SPAN></FONT></P></DIV></DIV>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<DIV>
<DIV class=3DMsoNormal style=3D"TEXT-ALIGN: center" align=3Dcenter><FONT =

face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: 12pt">
<HR tabIndex=3D-1 align=3Dcenter width=3D"100%" SIZE=3D2>
</SPAN></FONT></DIV>
<P class=3DMsoNormal><B><FONT face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">From:</SPAN></FONT></B><FONT=20
face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma"> Eric=20
Barrett <BR><B><SPAN style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> =
Dienstag, 12.=20
Dezember 2006 22:16<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">To:</SPAN></B> Bill=20
Fenech; Steffen Thuemmel; Henry Lau; Victor Carrell =
(Glasshouse)<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> dl-cstech; Sudheesh =
Nair<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: Maximn number of=20
inodes</SPAN></FONT><o:p></o:p></P></DIV>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">Bill,</SPAN></FONT><o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt">&nbsp;<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Sure, but that still =
doesn't tell us=20
what the error is.&nbsp; I also contend the assertion that the =
auto-allocation=20
of new inodes is not working, unless we see that the system is at 100% =
or=20
otherwise have an application error indicating=20
this.</SPAN></FONT><o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt">&nbsp;<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Steffen, I'm not saying =
it's not=20
happening, just that there's an assumption being made here which is not =
proven,=20
and therefore which we cannot act upon.</SPAN></FONT><o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt">&nbsp;<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<DIV class=3DMsoNormal style=3D"TEXT-ALIGN: center" align=3Dcenter><FONT =

face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: 12pt">
<HR tabIndex=3D-1 align=3Dcenter width=3D"100%" SIZE=3D2>
</SPAN></FONT></DIV>
<P class=3DMsoNormal style=3D"MARGIN-BOTTOM: 12pt"><B><FONT =
face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">From:</SPAN></FONT></B><FONT=20
face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma"> Bill=20
Fenech <BR><B><SPAN style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> =
Tuesday, December=20
12, 2006 1:10 PM<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B> =
Eric=20
Barrett; Steffen Thuemmel; Henry Lau; Victor Carrell =
(Glasshouse)<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> dl-cstech; Sudheesh =
Nair<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: Maximn number of=20
inodes</SPAN></FONT><o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">From the case =

(4115):<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt">This is an EVAL at Allegro. <BR><BR>Customer =
is loading=20
files onto a Bobcat volume and noticed that the mounted FS is running =
out of=20
inodes. Even adding more space to the volume (1 LUN, approx 200GB) did =
not=20
relief. They deleted some files and started loading again, but the =
situation is=20
still the same. For whatever reason, the auto-mechanism of allocating =
more=20
inodes does not work. Why ? <BR>Here are some command outputs which =
document:=20
<BR><BR>fscmd viewfs onstor23 <BR>Name : onstor23 <BR>State : online =
<BR>VolId :=20
0x0000036300000070 <BR>Size : 1433471 MByte (Nbr blocks 183484376) =
(Total blocks=20
incl log: 183500760) <BR>Available : 905505 MByte (Nbr blocks 115904645) =

<BR>Inodes : 17449982 (available 528747, used 16921235) <BR>Blks : total =

183484376, allocated 66885653, reserved 0, beyond 0 minFree 694078 =
minFreeRm=20
462718 <BR>snapshots : 0xd <BR>grow HWM : 0 <BR>vsid : 4 <BR>volType : 0 =

<BR>Mkfs : Tue Dec 5 13:39:32 2006 <BR>Number of mounts: 3 (dirty: 0 )=20
<BR>Number of umounts: 3 <BR>Number of mount failures: 0 (log) 0 =
(replay) 0=20
(eek) 0 (snap) <BR>Result of last 3 mount operation(s) <BR>online Mount =
time Tue=20
Dec 5 17:52:17 2006 <BR>online Mount time Tue Dec 5 17:10:27 2006 =
<BR>online=20
Mount time Tue Dec 5 13:39:38 2006 <BR>Result of last 3 umount =
operation(s)=20
<BR>umount time Tue Dec 5 17:50:51 2006 <BR>umount time Tue Dec 5 =
17:09:01 2006=20
<BR>umount time Tue Dec 5 13:39:38 2006 <BR>oplocks : allow =
<BR>charSubst :=20
disabled <BR>automatic atime update: disabled <BR>unstable name space =
updates:=20
enabled <BR>unstable all: enabled <BR><BR>***as one can see, the number =
of=20
available inodes is very low, compared to the available space in the =
volume. And=20
it decreases while thy load more files (file size on average 30kB) see:=20
<BR><BR>fscmd viewfs onstor23 <BR>Name : onstor23 <BR>State : online =
<BR>VolId :=20
0x0000036300000070 <BR>Size : 1433471 MByte (Nbr blocks 183484376) =
(Total blocks=20
incl log: 183500760) <BR>Available : 905425 MByte (Nbr blocks 115894459) =

<BR>Inodes : 17449982 (available 526080, used 16923902) <BR>Blks : total =

183484376, allocated 66895839, reserved 0, beyond 0 minFree 694078 =
minFreeRm=20
462718 <BR>snapshots : 0xd <BR>grow HWM : 0 <BR>vsid : 4 <BR>volType : 0 =

<BR>Mkfs : Tue Dec 5 13:39:32 2006 <BR>Number of mounts: 3 (dirty: 0 )=20
<BR>Number of umounts: 3 <BR>Number of mount failures: 0 (log) 0 =
(replay) 0=20
(eek) 0 (snap) <BR>Result of last 3 mount operation(s) <BR>online Mount =
time Tue=20
Dec 5 17:52:17 2006 <BR>online Mount time Tue Dec 5 17:10:27 2006 =
<BR>online=20
Mount time Tue Dec 5 13:39:38 2006 <BR>Result of last 3 umount =
operation(s)=20
<BR>umount time Tue Dec 5 17:50:51 2006 <BR>umount time Tue Dec 5 =
17:09:01 2006=20
<BR>umount time Tue Dec 5 13:39:38 2006 <BR>oplocks : allow =
<BR>charSubst :=20
disabled <BR>automatic atime update: disabled <BR>unstable name space =
updates:=20
enabled <BR>unstable all: enabled <BR><BR>***it is consistent with =
output of df=20
-h at the Linux client which loads the files: =
<BR><BR>192.168.0.141:/onstor13=20
<BR>1.2T 516G 685G 43% /photos/photos01 <BR>192.168.0.142:/onstor23 =
<BR>1.4T=20
516G 885G 37% /photos/photos02 <BR>[root@rescue photos02]# =
<BR>[15:30:25]=20
<BR>192.168.0.141:/onstor13 <BR>17449982 16937413 512569 98% =
/photos/photos01=20
<BR>192.168.0.142:/onstor23 <BR>17449982 16927056 522926 98% =
/photos/photos02=20
<BR>[15:31:11] <BR>192.168.0.141:/onstor13 <BR>17449982 16937784 512198 =
98%=20
/photos/photos01 <BR>192.168.0.142:/onstor23 <BR>17449982 16927353 =
522629 98%=20
/photos/photos02 <BR>[root@rescue photos02]# <BR><BR>fscmd viewfs =
onstor23=20
<BR>Name : onstor23 <BR>State : online <BR>VolId : 0x0000036300000070 =
<BR>Size :=20
1433471 MByte (Nbr blocks 183484376) (Total blocks incl log: 183500760)=20
<BR>Available : 905306 MByte (Nbr blocks 115879219) <BR>Inodes : =
17449982=20
(available 522152, used 16927830) <BR>Blks : total 183484376, allocated=20
66911079, reserved 0, beyond 0 minFree 694078 minFreeRm 462718 =
<BR>snapshots :=20
0xd <BR>grow HWM : 0 <BR>vsid : 4 <BR>volType : 0 <BR>Mkfs : Tue Dec 5 =
13:39:32=20
2006 <BR>Number of mounts: 3 (dirty: 0 ) <BR>Number of umounts: 3 =
<BR>Number of=20
mount failures: 0 (log) 0 (replay) 0 (eek) 0 (snap) <BR>Result of last 3 =
mount=20
operation(s) <BR>online Mount time Tue Dec 5 17:52:17 2006 <BR>online =
Mount time=20
Tue Dec 5 17:10:27 2006 <BR>online Mount time Tue Dec 5 13:39:38 2006 =
<BR>Result=20
of last 3 umount operation(s) <BR>umount time Tue Dec 5 17:50:51 2006 =
<BR>umount=20
time Tue Dec 5 17:09:01 2006 <BR>umount time Tue Dec 5 13:39:38 2006 =
<BR>oplocks=20
: allow <BR>charSubst : disabled <BR>automatic atime update: disabled=20
<BR>unstable name space updates: enabled <BR>unstable all: enabled=20
<BR><BR>Volume Details <BR>-------------- <BR><BR>Name : onstor23 <BR>Id =
:=20
0x36300000070 <BR>Type : Standard <BR>Virtual Server : ONSTOR2 =
<BR>Status :=20
Mounted <BR>Current Size (MiB): 1433471.69 <BR>Used Size (MiB): =
528191.80=20
<BR>Available Size (MiB): 905279.89 <BR>Usage (%) : 36.85 % <BR>Hard =
Quota=20
(MiB): No Limit <BR>Soft Quota (%) : N/A <BR>High Water Mark (%) : N/A =
<BR>Min.=20
Auto Growth (MiB): 549887 <BR>Shared Read : allow <BR>Oplocks : allow=20
<BR>CharSubst : disabled <BR>CharSubstTable :=20
0000,0000,0000,0000,0000,0000,0000,0000 <BR>Language : en_us <BR>Layout =
type : 0=20
<BR>Automatic Atime Updates: disabled <BR>Stability: unstable all =
<BR>Arrays :=20
3PARdata_03C6 <BR>Vendor/model : None <BR>RAID Level : Raid-5 <BR>Min. =
Lun Size=20
(MiB): No Min <BR>Max. Lun Size (MiB): No Max <BR><BR>LUN List <BR>Idx =
Device=20
Name Size (MiB) <BR>-------------------------------------------------- =
<BR>1=20
3PARdata_03C6_0000403C6 307199.94 <BR>2 3PARdata_03C6_0000103C6 =
307199.94 <BR>3=20
3PARdata_03C6_0000603C6 307199.94 <BR>4 3PARdata_03C6_0000503C6 =
307199.94 <BR>5=20
3PARdata_03C6_0003A03C6 204799.94=20
<BR>------------------------------------------------- <BR><BR>Name: ping =

<BR>Date &amp; Time : Tue Dec 12 16:07:07 2006 <BR>Time zone : =
Europe/Berlin=20
<BR>System Uptime : 33:19:06 <BR>System temperature (celsius): 44 =
<BR>Software=20
Version: 1.3.3.1 <BR><BR>chassis <BR>-------- <BR>Model number: =
ONS-SYS-2260=20
<BR>System revision: C3 <BR>System serial number: 0614051015 <BR>MAC =
addr:=20
00:07:34:03:63:00 <BR><BR>BMFPGA : Version 4 <BR>Board revision: B4 =
<BR>Board=20
serial number: 0614050015 <BR>Boot Dev: wd0a (cf1) <BR>SSC =
<BR>PROM_R9000 :=20
prom-2.0.3 : Thu Apr 13 16:44:49 2006 <BR><BR>LUC revision: 3.2.10 =
<BR>TXRX0=20
<BR>PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006 <BR>NFP_TXRX : =

R1.3.3.1BC-103106 : Tue Oct 31 18:09:52 2006 <BR>TXRX1 =
<BR>PROM_SIBYTE_BC :=20
prom-2.0.2 : Fri Apr 7 13:13:34 2006 <BR>NFP_TXRX : R1.3.3.1BC-103106 : =
Tue Oct=20
31 18:09:52 2006 <BR>FP0 <BR>PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 =
13:13:34=20
2006 <BR>NFP_FP : R1.3.3.1BC-103106 : Tue Oct 31 18:04:20 2006 <BR>FP1=20
<BR>PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006 <BR>NFP_FP :=20
R1.3.3.1BC-103106 : Tue Oct 31 18:04:20 2006 <BR><BR>FC0 <BR>PROM_R9000 =
:=20
prom-2.0.3 : Thu Apr 13 16:44:49 2006 <BR>FCNIM : R1.3.3.1BC-103106 : =
Tue Oct 31=20
18:10:34 2006 <BR><BR>NTP Configuration : <BR>remote refid st t when =
poll reach=20
delay offset jitter=20
<BR>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=20
<BR>127.127.1.0 127.127.1.0 10 l 23 64 377 0.000 0.000 0.004 =
<BR>*192.168.0.193=20
150.254.183.15 2 u 738 1024 377 0.004 -3.555 0.179 <BR>SC1 IP : =
192.168.129.5=20
<BR>SC2 IP : 10.11.12.13 <BR>No of Virtual server(s) : =
2</SPAN></FONT><FONT=20
face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<DIV>
<DIV class=3DMsoNormal style=3D"TEXT-ALIGN: center" align=3Dcenter><FONT =

face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: 12pt">
<HR tabIndex=3D-1 align=3Dcenter width=3D"100%" SIZE=3D2>
</SPAN></FONT></DIV>
<P class=3DMsoNormal><B><FONT face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">From:</SPAN></FONT></B><FONT=20
face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma"> Eric=20
Barrett <BR><B><SPAN style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> =
Tuesday,=20
December 12, 2006 1:08 PM<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">To:</SPAN></B>=20
Steffen Thuemmel; Henry Lau; Victor Carrell (Glasshouse)<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> dl-cstech; Sudheesh =
Nair<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: Maximn number of=20
inodes</SPAN></FONT><o:p></o:p></P></DIV>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">Steffen,</SPAN></FONT><o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt">&nbsp;<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">What error?&nbsp; What =
gives=20
it?&nbsp; Need way more info here.</SPAN></FONT><o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt">&nbsp;<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">Even at 98% inodes used =
they should=20
not be getting an error.&nbsp; 100%, sure, but they're not=20
there.</SPAN></FONT><o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt">&nbsp;<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt">&nbsp;<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt">&nbsp;<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<DIV class=3DMsoNormal style=3D"TEXT-ALIGN: center" align=3Dcenter><FONT =

face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: 12pt">
<HR tabIndex=3D-1 align=3Dcenter width=3D"100%" SIZE=3D2>
</SPAN></FONT></DIV>
<P class=3DMsoNormal style=3D"MARGIN-BOTTOM: 12pt"><B><FONT =
face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">From:</SPAN></FONT></B><FONT=20
face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma"> Steffen=20
Thuemmel <BR><B><SPAN style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> =
Tuesday,=20
December 12, 2006 12:33 PM<BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">To:</SPAN></B>=20
Henry Lau; Victor Carrell (Glasshouse)<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B> dl-cstech; Sudheesh =
Nair<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> RE: Maximn number of=20
inodes</SPAN></FONT><o:p></o:p></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">Gentlemen,<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">This =
doesn&#8217;t help here.=20
The customer is using an application that loads (creates) many files =
(average=20
size 30 kB) onto the filesystems on a Bobcat. =
<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">They simulate =
their=20
client behavior: The customer, Allegro, is an internet auction provider. =
Their=20
clients upload descriptions and picture of their items they put into an=20
auction.<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">The =
application breakes=20
after receiving an error. Looking at the filesystem they determined that =
98% of=20
all inodes are used although the capacity of the filesystem is only used =
less=20
than 50%. They increased the capacity by 200GB, but that did not clear =
the=20
problem. They were not able to create more files. Only after deleting =
some=20
files, they could generate new ones.<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">So to me that =
looks=20
like the automated process of inode allocation does not work here. The =
question=20
is why ?<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">Regards,<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">St.<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<DIV>
<DIV>
<P class=3DMsoNormal><B><FONT face=3D"Times New Roman" color=3Dnavy =
size=3D2><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; COLOR: navy">Steffen =
Thuemmel=20
<o:p></o:p></SPAN></FONT></B></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" color=3Dnavy =
size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy">Manager Systems=20
Engineering<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><st1:place w:st=3D"on"><FONT face=3D"Times New =
Roman" color=3Dnavy=20
size=3D2><SPAN style=3D"FONT-SIZE: 10pt; COLOR: navy">Central=20
Europe</SPAN></FONT></st1:place><FONT color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy"><o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" color=3Dnavy =
size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt; COLOR: =
navy"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><B><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">ONStor<o:p></o:p></SPAN></FONT></B></P>
<P class=3DMsoNormal><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN=20
style=3D"FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">Schleussne</SPAN></FONT><FONT=20
face=3DTahoma color=3Dnavy size=3D1><SPAN lang=3DDE=20
style=3D"FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: Tahoma">r Str.=20
42<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN =
lang=3DDE=20
style=3D"FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: Tahoma">D-63263=20
Neu-Isenburg<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><st1:place w:st=3D"on"><st1:country-region =
w:st=3D"on"><FONT=20
face=3DTahoma color=3Dnavy size=3D1><SPAN=20
style=3D"FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">Germany</SPAN></FONT></st1:country-region></st1:place><FONT=20
color=3Dnavy><SPAN style=3D"COLOR: navy"><o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" color=3Dnavy =
size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt; COLOR: =
navy"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><B><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">telf.</SPAN></FONT></B><B><FONT=20
face=3DTahoma color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Tahoma">&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
</SPAN></FONT></B><B><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; COLOR: navy; FONT-FAMILY: =
Tahoma">+49=20
6102 884 84-0</SPAN></FONT></B><B><FONT face=3DTahoma color=3Dnavy =
size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma"><o:p></o:p></SPAN></FONT></B></P>
<P class=3DMsoNormal><B><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">mobil.=20
&nbsp;&nbsp;&nbsp; </SPAN></FONT></B><B><FONT face=3DTahoma color=3Dnavy =

size=3D1><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 7.5pt; COLOR: navy; FONT-FAMILY: =
Tahoma">+49=20
173 673 3434<o:p></o:p></SPAN></FONT></B></P>
<P class=3DMsoNormal><B><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN =
lang=3DFR=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">mail.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
<A=20
href=3D"mailto:steffen.thuemmel@onstor.com">steffen.thuemmel@onstor.com</=
A><o:p></o:p></SPAN></FONT></B></P>
<P class=3DMsoNormal><B><FONT face=3DTahoma color=3Dnavy size=3D1><SPAN =
lang=3DFR=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 8pt; COLOR: navy; FONT-FAMILY: =
Tahoma">web.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=20
<A =
href=3D"http://www.onstor.com/">www.onstor.com</A></SPAN></FONT></B><FONT=
=20
color=3Dnavy><SPAN lang=3DFR=20
style=3D"COLOR: navy"><o:p></o:p></SPAN></FONT></P></DIV></DIV>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<DIV>
<DIV class=3DMsoNormal style=3D"TEXT-ALIGN: center" align=3Dcenter><FONT =

face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: 12pt">
<HR tabIndex=3D-1 align=3Dcenter width=3D"100%" SIZE=3D2>
</SPAN></FONT></DIV>
<P class=3DMsoNormal><B><FONT face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">From:</SPAN></FONT></B><FONT=20
face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma"> Henry Lau=20
<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Sent:</SPAN></B> Dienstag, 12. =
Dezember=20
2006 18:01<BR><B><SPAN style=3D"FONT-WEIGHT: bold">To:</SPAN></B> Victor =
Carrell=20
(Glasshouse)<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Cc:</SPAN></B>=20
dl-cstech<BR><B><SPAN style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> =
RE: Maximn=20
number of inodes</SPAN></FONT><o:p></o:p></P></DIV>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: Arial">Please check =
<A=20
href=3D"http://wiki/wiki/Inodes">http://wiki/wiki/Inodes</A><o:p></o:p></=
SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">Thanks,<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial">Henry<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial color=3Dnavy size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; COLOR: navy; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<DIV>
<DIV class=3DMsoNormal style=3D"TEXT-ALIGN: center" align=3Dcenter><FONT =

face=3D"Times New Roman" size=3D3><SPAN style=3D"FONT-SIZE: 12pt">
<HR tabIndex=3D-1 align=3Dcenter width=3D"100%" SIZE=3D2>
</SPAN></FONT></DIV>
<P class=3DMsoNormal><B><FONT face=3DTahoma size=3D2><SPAN=20
style=3D"FONT-WEIGHT: bold; FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma">From:</SPAN></FONT></B><FONT=20
face=3DTahoma size=3D2><SPAN style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Tahoma"> Victor=20
Carrell (Glasshouse) <BR><B><SPAN style=3D"FONT-WEIGHT: =
bold">Sent:</SPAN></B>=20
Tuesday, December 12, 2006 8:25 AM<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">To:</SPAN></B> dl-cstech<BR><B><SPAN=20
style=3D"FONT-WEIGHT: bold">Subject:</SPAN></B> Maximn number of=20
inodes</SPAN></FONT><o:p></o:p></P></DIV>
<P class=3DMsoNormal><FONT face=3D"Times New Roman" size=3D3><SPAN=20
style=3D"FONT-SIZE: 12pt"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">Hi,<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: Arial">&nbsp;I have a customer =
ONStor=20
<st1:place w:st=3D"on"><st1:country-region=20
w:st=3D"on">Germany</st1:country-region></st1:place> case 4115 that =
appears to be=20
running out of inodes.&nbsp; I have asked to turn off snapshots if on =
and retry=20
their test.&nbsp; In the mean time it is my understanding that once =
indoes are=20
used up we double the number of inodes in the background.&nbsp;&nbsp; Am =
I wrong=20
in this thinking?&nbsp; Or is there something that would prevent =
this?&nbsp; Or=20
is there a total maximum number of inodes allowed?&nbsp; In this case=20
</SPAN></FONT>17449982<FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial"><o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial"><o:p>&nbsp;</o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">Thanks<o:p></o:p></SPAN></FONT></P>
<P class=3DMsoNormal><FONT face=3DArial size=3D2><SPAN=20
style=3D"FONT-SIZE: 10pt; FONT-FAMILY: =
Arial">Victor<o:p></o:p></SPAN></FONT></P></DIV></BODY></HTML>

------_=_NextPart_001_01C71E37.D0274E35--
