X-MimeOLE: Produced By Microsoft Exchange V6.5
Received: by onstor-exch02.onstor.net 
	id <01C71E35.5BF9528D@onstor-exch02.onstor.net>; Tue, 12 Dec 2006 13:34:52 -0800
MIME-Version: 1.0
Content-Type: multipart/alternative;
	boundary="----_=_NextPart_001_01C71E35.5BF9528D"
Content-class: urn:content-classes:message
Subject: RE: Maximn number of inodes
Date: Tue, 12 Dec 2006 13:34:48 -0800
Message-ID: <BB375AF679D4A34E9CA8DFA650E2B04E01B7066D@onstor-exch02.onstor.net>
In-Reply-To: <BB375AF679D4A34E9CA8DFA650E2B04E01B7063B@onstor-exch02.onstor.net>
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
Thread-Topic: Maximn number of inodes
thread-index: AcceCgTam1vksTXLS1i27rWuAPT1zgABO3ZgAAb2dAAAAaxIUAAAFM2QAAA1OeAAAFmtcA==
From: "Steffen Thuemmel" <steffen.thuemmel@onstor.com>
To: "Eric Barrett" <eric.barrett@onstor.com>,
	"Bill Fenech" <bill.fenech@onstor.com>,
	"Henry Lau" <henry.lau@onstor.com>,
	"Victor Carrell \(Glasshouse\)" <vcarrell@css.glasshouse.com>
Cc: "dl-cstech" <dl-cstech@onstor.com>,
	"Sudheesh Nair" <sudheesh.nair@onstor.com>

This is a multi-part message in MIME format.

------_=_NextPart_001_01C71E35.5BF9528D
Content-Type: text/plain;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

Eric,

=20

the customer could not join a web-ex session, they had some trouble with
the connection speed. So I could only do a Q&A with them. They told me,
the application receives an error and breakes. They checked with df -h
and df -I and determined that there is enough space, but not enough
inodes. They added more space to the volume, but still the application
did not work. They deleted some files, then the application worked
again. Until it broke again.

=20

Are we sure, that this is not a problem with inodes ? At what threshold
does the system add more inodes ?=20

=20

If they delete some files and it works again, could that be an
indication for a limit in the number of files per directory ?

=20

Steffen Thuemmel=20

=20

ONStor

Schleussner Str. 42

D-63263 Neu-Isenburg

Germany

=20

telf.       +49 6102 884 84-0

mobil.     +49 173 673 3434

mail.       steffen.thuemmel@onstor.com

web.       www.onstor.com <http://www.onstor.com/>=20

=20

________________________________

From: Eric Barrett=20
Sent: Dienstag, 12. Dezember 2006 22:16
To: Bill Fenech; Steffen Thuemmel; Henry Lau; Victor Carrell
(Glasshouse)
Cc: dl-cstech; Sudheesh Nair
Subject: RE: Maximn number of inodes

=20

Bill,

=20

Sure, but that still doesn't tell us what the error is.  I also contend
the assertion that the auto-allocation of new inodes is not working,
unless we see that the system is at 100% or otherwise have an
application error indicating this.

=20

Steffen, I'm not saying it's not happening, just that there's an
assumption being made here which is not proven, and therefore which we
cannot act upon.

=20

=20

________________________________

From: Bill Fenech=20
Sent: Tuesday, December 12, 2006 1:10 PM
To: Eric Barrett; Steffen Thuemmel; Henry Lau; Victor Carrell
(Glasshouse)
Cc: dl-cstech; Sudheesh Nair
Subject: RE: Maximn number of inodes

From the case (4115):

=20

This is an EVAL at Allegro.=20

Customer is loading files onto a Bobcat volume and noticed that the
mounted FS is running out of inodes. Even adding more space to the
volume (1 LUN, approx 200GB) did not relief. They deleted some files and
started loading again, but the situation is still the same. For whatever
reason, the auto-mechanism of allocating more inodes does not work. Why
?=20
Here are some command outputs which document:=20

fscmd viewfs onstor23=20
Name : onstor23=20
State : online=20
VolId : 0x0000036300000070=20
Size : 1433471 MByte (Nbr blocks 183484376) (Total blocks incl log:
183500760)=20
Available : 905505 MByte (Nbr blocks 115904645)=20
Inodes : 17449982 (available 528747, used 16921235)=20
Blks : total 183484376, allocated 66885653, reserved 0, beyond 0 minFree
694078 minFreeRm 462718=20
snapshots : 0xd=20
grow HWM : 0=20
vsid : 4=20
volType : 0=20
Mkfs : Tue Dec 5 13:39:32 2006=20
Number of mounts: 3 (dirty: 0 )=20
Number of umounts: 3=20
Number of mount failures: 0 (log) 0 (replay) 0 (eek) 0 (snap)=20
Result of last 3 mount operation(s)=20
online Mount time Tue Dec 5 17:52:17 2006=20
online Mount time Tue Dec 5 17:10:27 2006=20
online Mount time Tue Dec 5 13:39:38 2006=20
Result of last 3 umount operation(s)=20
umount time Tue Dec 5 17:50:51 2006=20
umount time Tue Dec 5 17:09:01 2006=20
umount time Tue Dec 5 13:39:38 2006=20
oplocks : allow=20
charSubst : disabled=20
automatic atime update: disabled=20
unstable name space updates: enabled=20
unstable all: enabled=20

***as one can see, the number of available inodes is very low, compared
to the available space in the volume. And it decreases while thy load
more files (file size on average 30kB) see:=20

fscmd viewfs onstor23=20
Name : onstor23=20
State : online=20
VolId : 0x0000036300000070=20
Size : 1433471 MByte (Nbr blocks 183484376) (Total blocks incl log:
183500760)=20
Available : 905425 MByte (Nbr blocks 115894459)=20
Inodes : 17449982 (available 526080, used 16923902)=20
Blks : total 183484376, allocated 66895839, reserved 0, beyond 0 minFree
694078 minFreeRm 462718=20
snapshots : 0xd=20
grow HWM : 0=20
vsid : 4=20
volType : 0=20
Mkfs : Tue Dec 5 13:39:32 2006=20
Number of mounts: 3 (dirty: 0 )=20
Number of umounts: 3=20
Number of mount failures: 0 (log) 0 (replay) 0 (eek) 0 (snap)=20
Result of last 3 mount operation(s)=20
online Mount time Tue Dec 5 17:52:17 2006=20
online Mount time Tue Dec 5 17:10:27 2006=20
online Mount time Tue Dec 5 13:39:38 2006=20
Result of last 3 umount operation(s)=20
umount time Tue Dec 5 17:50:51 2006=20
umount time Tue Dec 5 17:09:01 2006=20
umount time Tue Dec 5 13:39:38 2006=20
oplocks : allow=20
charSubst : disabled=20
automatic atime update: disabled=20
unstable name space updates: enabled=20
unstable all: enabled=20

***it is consistent with output of df -h at the Linux client which loads
the files:=20

192.168.0.141:/onstor13=20
1.2T 516G 685G 43% /photos/photos01=20
192.168.0.142:/onstor23=20
1.4T 516G 885G 37% /photos/photos02=20
[root@rescue photos02]#=20
[15:30:25]=20
192.168.0.141:/onstor13=20
17449982 16937413 512569 98% /photos/photos01=20
192.168.0.142:/onstor23=20
17449982 16927056 522926 98% /photos/photos02=20
[15:31:11]=20
192.168.0.141:/onstor13=20
17449982 16937784 512198 98% /photos/photos01=20
192.168.0.142:/onstor23=20
17449982 16927353 522629 98% /photos/photos02=20
[root@rescue photos02]#=20

fscmd viewfs onstor23=20
Name : onstor23=20
State : online=20
VolId : 0x0000036300000070=20
Size : 1433471 MByte (Nbr blocks 183484376) (Total blocks incl log:
183500760)=20
Available : 905306 MByte (Nbr blocks 115879219)=20
Inodes : 17449982 (available 522152, used 16927830)=20
Blks : total 183484376, allocated 66911079, reserved 0, beyond 0 minFree
694078 minFreeRm 462718=20
snapshots : 0xd=20
grow HWM : 0=20
vsid : 4=20
volType : 0=20
Mkfs : Tue Dec 5 13:39:32 2006=20
Number of mounts: 3 (dirty: 0 )=20
Number of umounts: 3=20
Number of mount failures: 0 (log) 0 (replay) 0 (eek) 0 (snap)=20
Result of last 3 mount operation(s)=20
online Mount time Tue Dec 5 17:52:17 2006=20
online Mount time Tue Dec 5 17:10:27 2006=20
online Mount time Tue Dec 5 13:39:38 2006=20
Result of last 3 umount operation(s)=20
umount time Tue Dec 5 17:50:51 2006=20
umount time Tue Dec 5 17:09:01 2006=20
umount time Tue Dec 5 13:39:38 2006=20
oplocks : allow=20
charSubst : disabled=20
automatic atime update: disabled=20
unstable name space updates: enabled=20
unstable all: enabled=20

Volume Details=20
--------------=20

Name : onstor23=20
Id : 0x36300000070=20
Type : Standard=20
Virtual Server : ONSTOR2=20
Status : Mounted=20
Current Size (MiB): 1433471.69=20
Used Size (MiB): 528191.80=20
Available Size (MiB): 905279.89=20
Usage (%) : 36.85 %=20
Hard Quota (MiB): No Limit=20
Soft Quota (%) : N/A=20
High Water Mark (%) : N/A=20
Min. Auto Growth (MiB): 549887=20
Shared Read : allow=20
Oplocks : allow=20
CharSubst : disabled=20
CharSubstTable : 0000,0000,0000,0000,0000,0000,0000,0000=20
Language : en_us=20
Layout type : 0=20
Automatic Atime Updates: disabled=20
Stability: unstable all=20
Arrays : 3PARdata_03C6=20
Vendor/model : None=20
RAID Level : Raid-5=20
Min. Lun Size (MiB): No Min=20
Max. Lun Size (MiB): No Max=20

LUN List=20
Idx Device Name Size (MiB)=20
--------------------------------------------------=20
1 3PARdata_03C6_0000403C6 307199.94=20
2 3PARdata_03C6_0000103C6 307199.94=20
3 3PARdata_03C6_0000603C6 307199.94=20
4 3PARdata_03C6_0000503C6 307199.94=20
5 3PARdata_03C6_0003A03C6 204799.94=20
-------------------------------------------------=20

Name: ping=20
Date & Time : Tue Dec 12 16:07:07 2006=20
Time zone : Europe/Berlin=20
System Uptime : 33:19:06=20
System temperature (celsius): 44=20
Software Version: 1.3.3.1=20

chassis=20
--------=20
Model number: ONS-SYS-2260=20
System revision: C3=20
System serial number: 0614051015=20
MAC addr: 00:07:34:03:63:00=20

BMFPGA : Version 4=20
Board revision: B4=20
Board serial number: 0614050015=20
Boot Dev: wd0a (cf1)=20
SSC=20
PROM_R9000 : prom-2.0.3 : Thu Apr 13 16:44:49 2006=20

LUC revision: 3.2.10=20
TXRX0=20
PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006=20
NFP_TXRX : R1.3.3.1BC-103106 : Tue Oct 31 18:09:52 2006=20
TXRX1=20
PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006=20
NFP_TXRX : R1.3.3.1BC-103106 : Tue Oct 31 18:09:52 2006=20
FP0=20
PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006=20
NFP_FP : R1.3.3.1BC-103106 : Tue Oct 31 18:04:20 2006=20
FP1=20
PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006=20
NFP_FP : R1.3.3.1BC-103106 : Tue Oct 31 18:04:20 2006=20

FC0=20
PROM_R9000 : prom-2.0.3 : Thu Apr 13 16:44:49 2006=20
FCNIM : R1.3.3.1BC-103106 : Tue Oct 31 18:10:34 2006=20

NTP Configuration :=20
remote refid st t when poll reach delay offset jitter=20
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
=3D=3D=3D=3D=3D=3D=20
127.127.1.0 127.127.1.0 10 l 23 64 377 0.000 0.000 0.004=20
*192.168.0.193 150.254.183.15 2 u 738 1024 377 0.004 -3.555 0.179=20
SC1 IP : 192.168.129.5=20
SC2 IP : 10.11.12.13=20
No of Virtual server(s) : 2

=20

________________________________

From: Eric Barrett=20
Sent: Tuesday, December 12, 2006 1:08 PM
To: Steffen Thuemmel; Henry Lau; Victor Carrell (Glasshouse)
Cc: dl-cstech; Sudheesh Nair
Subject: RE: Maximn number of inodes

=20

Steffen,

=20

What error?  What gives it?  Need way more info here.

=20

Even at 98% inodes used they should not be getting an error.  100%,
sure, but they're not there.

=20

=20

=20

=20

________________________________

From: Steffen Thuemmel=20
Sent: Tuesday, December 12, 2006 12:33 PM
To: Henry Lau; Victor Carrell (Glasshouse)
Cc: dl-cstech; Sudheesh Nair
Subject: RE: Maximn number of inodes

Gentlemen,

=20

This doesn't help here. The customer is using an application that loads
(creates) many files (average size 30 kB) onto the filesystems on a
Bobcat.=20

They simulate their client behavior: The customer, Allegro, is an
internet auction provider. Their clients upload descriptions and picture
of their items they put into an auction.

=20

The application breakes after receiving an error. Looking at the
filesystem they determined that 98% of all inodes are used although the
capacity of the filesystem is only used less than 50%. They increased
the capacity by 200GB, but that did not clear the problem. They were not
able to create more files. Only after deleting some files, they could
generate new ones.

=20

So to me that looks like the automated process of inode allocation does
not work here. The question is why ?

=20

Regards,

St.

=20

Steffen Thuemmel=20

Manager Systems Engineering

Central Europe

=20

ONStor

Schleussner Str. 42

D-63263 Neu-Isenburg

Germany

=20

telf.       +49 6102 884 84-0

mobil.     +49 173 673 3434

mail.       steffen.thuemmel@onstor.com

web.       www.onstor.com <http://www.onstor.com/>=20

=20

________________________________

From: Henry Lau=20
Sent: Dienstag, 12. Dezember 2006 18:01
To: Victor Carrell (Glasshouse)
Cc: dl-cstech
Subject: RE: Maximn number of inodes

=20

Please check http://wiki/wiki/Inodes

=20

Thanks,

=20

Henry

=20

________________________________

From: Victor Carrell (Glasshouse)=20
Sent: Tuesday, December 12, 2006 8:25 AM
To: dl-cstech
Subject: Maximn number of inodes

=20

Hi,

=20

 I have a customer ONStor Germany case 4115 that appears to be running
out of inodes.  I have asked to turn off snapshots if on and retry their
test.  In the mean time it is my understanding that once indoes are used
up we double the number of inodes in the background.   Am I wrong in
this thinking?  Or is there something that would prevent this?  Or is
there a total maximum number of inodes allowed?  In this case 17449982

=20

Thanks

Victor


------_=_NextPart_001_01C71E35.5BF9528D
Content-Type: text/html;
	charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

<html xmlns:v=3D"urn:schemas-microsoft-com:vml" =
xmlns:o=3D"urn:schemas-microsoft-com:office:office" =
xmlns:w=3D"urn:schemas-microsoft-com:office:word" =
xmlns:st1=3D"urn:schemas-microsoft-com:office:smarttags" =
xmlns=3D"http://www.w3.org/TR/REC-html40">

<head>
<META HTTP-EQUIV=3D"Content-Type" CONTENT=3D"text/html; =
charset=3Dus-ascii">
<meta name=3DGenerator content=3D"Microsoft Word 11 (filtered medium)">
<!--[if !mso]>
<style>
v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style>
<![endif]--><o:SmartTagType
 namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags" =
name=3D"country-region"/>
<o:SmartTagType =
namespaceuri=3D"urn:schemas-microsoft-com:office:smarttags"
 name=3D"place"/>
<!--[if !mso]>
<style>
st1\:*{behavior:url(#default#ieooui) }
</style>
<![endif]-->
<style>
<!--
 /* Font Definitions */
 @font-face
	{font-family:"MS Mincho";
	panose-1:2 2 6 9 4 2 5 8 3 4;}
@font-face
	{font-family:Tahoma;
	panose-1:2 11 6 4 3 5 4 4 2 4;}
@font-face
	{font-family:"\@MS Mincho";
	panose-1:0 0 0 0 0 0 0 0 0 0;}
 /* Style Definitions */
 p.MsoNormal, li.MsoNormal, div.MsoNormal
	{margin:0cm;
	margin-bottom:.0001pt;
	font-size:12.0pt;
	font-family:"Times New Roman";}
a:link, span.MsoHyperlink
	{color:blue;
	text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
	{color:purple;
	text-decoration:underline;}
span.EmailStyle17
	{mso-style-type:personal;
	font-family:Arial;
	color:windowtext;}
span.EmailStyle18
	{mso-style-type:personal;
	font-family:Arial;
	color:navy;}
span.EmailStyle19
	{mso-style-type:personal;
	font-family:Arial;
	color:navy;}
span.EmailStyle20
	{mso-style-type:personal;
	font-family:Arial;
	color:navy;}
span.EmailStyle21
	{mso-style-type:personal-reply;
	font-family:Arial;
	color:navy;}
@page Section1
	{size:612.0pt 792.0pt;
	margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.Section1
	{page:Section1;}
-->
</style>
<!--[if gte mso 9]><xml>
 <o:shapedefaults v:ext=3D"edit" spidmax=3D"1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
 <o:shapelayout v:ext=3D"edit">
  <o:idmap v:ext=3D"edit" data=3D"1" />
 </o:shapelayout></xml><![endif]-->
</head>

<body lang=3DEN-US link=3Dblue vlink=3Dpurple>

<div class=3DSection1>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Eric,<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>the customer could not join a =
web-ex
session, they had some trouble with the connection speed. So I could =
only do a
Q&amp;A with them. They told me, the application receives an error and =
breakes.
They checked with df &#8211;h and df &#8211;I and determined that there =
is enough space,
but not enough inodes. They added more space to the volume, but still =
the
application did not work. They deleted some files, then the application =
worked
again. Until it broke again.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Are we sure, that this is not a =
problem
with inodes ? At what threshold does the system add more inodes ? =
<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>If they delete some files and it =
works
again, could that be an indication for a limit in the number of files =
per
directory ?<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<div>

<div>

<p class=3DMsoNormal><b><font size=3D2 color=3Dnavy face=3D"Times New =
Roman"><span
style=3D'font-size:10.0pt;color:navy;font-weight:bold'>Steffen Thuemmel =
<o:p></o:p></span></font></b></p>

<p class=3DMsoNormal><font size=3D3 color=3Dnavy face=3D"Times New =
Roman"><span
style=3D'font-size:12.0pt;color:navy'><o:p>&nbsp;</o:p></span></font></p>=


<p class=3DMsoNormal><b><font size=3D1 color=3Dnavy face=3DTahoma><span =
lang=3DDE
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy;font-weight:bold'>=
ONStor<o:p></o:p></span></font></b></p>

<p class=3DMsoNormal><font size=3D1 color=3Dnavy face=3DTahoma><span =
lang=3DDE
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy'>Schleussner Str. =
42<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D1 color=3Dnavy face=3DTahoma><span =
lang=3DDE
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy'>D-63263 =
Neu-Isenburg<o:p></o:p></span></font></p>

<p class=3DMsoNormal><st1:country-region w:st=3D"on"><st1:place =
w:st=3D"on"><font
  size=3D1 color=3Dnavy face=3DTahoma><span =
style=3D'font-size:8.0pt;font-family:Tahoma;
  =
color:navy'>Germany</span></font></st1:place></st1:country-region><font
color=3Dnavy><span style=3D'color:navy'><o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 color=3Dnavy face=3D"Times New =
Roman"><span
style=3D'font-size:12.0pt;color:navy'><o:p>&nbsp;</o:p></span></font></p>=


<p class=3DMsoNormal><b><font size=3D1 color=3Dnavy face=3DTahoma><span
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy;font-weight:bold'>=
telf.</span></font></b><b><font
size=3D2 color=3Dnavy face=3DTahoma><span =
style=3D'font-size:10.0pt;font-family:Tahoma;
color:navy;font-weight:bold'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
</span></font></b><b><font
size=3D1 color=3Dnavy face=3DTahoma><span =
style=3D'font-size:7.5pt;font-family:Tahoma;
color:navy;font-weight:bold'>+49 6102 884 84-0</span></font></b><b><font
size=3D1 color=3Dnavy face=3DTahoma><span =
style=3D'font-size:8.0pt;font-family:Tahoma;
color:navy;font-weight:bold'><o:p></o:p></span></font></b></p>

<p class=3DMsoNormal><b><font size=3D1 color=3Dnavy face=3DTahoma><span
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy;font-weight:bold'>=
mobil.
&nbsp;&nbsp;&nbsp; </span></font></b><b><font size=3D1 color=3Dnavy =
face=3DTahoma><span
style=3D'font-size:7.5pt;font-family:Tahoma;color:navy;font-weight:bold'>=
+49 173
673 3434<o:p></o:p></span></font></b></p>

<p class=3DMsoNormal><b><font size=3D1 color=3Dnavy face=3DTahoma><span =
lang=3DFR
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy;font-weight:bold'>=
mail.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
<a =
href=3D"mailto:steffen.thuemmel@onstor.com">steffen.thuemmel@onstor.com</=
a><o:p></o:p></span></font></b></p>

<p class=3DMsoNormal><b><font size=3D1 color=3Dnavy face=3DTahoma><span =
lang=3DFR
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy;font-weight:bold'>=
web.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
<a =
href=3D"http://www.onstor.com/">www.onstor.com</a></span></font></b><font=

color=3Dnavy><span lang=3DFR =
style=3D'color:navy'><o:p></o:p></span></font></p>

</div>

</div>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<div>

<div class=3DMsoNormal align=3Dcenter style=3D'text-align:center'><font =
size=3D3
face=3D"Times New Roman"><span style=3D'font-size:12.0pt'>

<hr size=3D2 width=3D"100%" align=3Dcenter tabindex=3D-1>

</span></font></div>

<p class=3DMsoNormal><b><font size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font =
size=3D2
face=3DTahoma><span style=3D'font-size:10.0pt;font-family:Tahoma'> Eric =
Barrett <br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Dienstag, 12. =
Dezember 2006
22:16<br>
<b><span style=3D'font-weight:bold'>To:</span></b> Bill Fenech; Steffen =
Thuemmel;
Henry Lau; Victor Carrell (Glasshouse)<br>
<b><span style=3D'font-weight:bold'>Cc:</span></b> dl-cstech; Sudheesh =
Nair<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> RE: Maximn =
number of
inodes</span></font><o:p></o:p></p>

</div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Bill,</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Sure, but that still doesn't tell us what the error
is.&nbsp; I also contend the assertion that the auto-allocation of new =
inodes
is not working, unless we see that the system is at 100% or otherwise =
have an
application error indicating this.</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Steffen, I'm not saying it's not happening, just that
there's an assumption being made here which is not proven, and therefore =
which
we cannot act upon.</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<div class=3DMsoNormal align=3Dcenter style=3D'text-align:center'><font =
size=3D3
face=3D"Times New Roman"><span style=3D'font-size:12.0pt'>

<hr size=3D2 width=3D"100%" align=3Dcenter tabIndex=3D-1>

</span></font></div>

<p class=3DMsoNormal style=3D'margin-bottom:12.0pt'><b><font size=3D2 =
face=3DTahoma><span
style=3D'font-size:10.0pt;font-family:Tahoma;font-weight:bold'>From:</spa=
n></font></b><font
size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;font-family:Tahoma'> Bill
Fenech <br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Tuesday, December =
12, 2006
1:10 PM<br>
<b><span style=3D'font-weight:bold'>To:</span></b> Eric Barrett; Steffen
Thuemmel; Henry Lau; Victor Carrell (Glasshouse)<br>
<b><span style=3D'font-weight:bold'>Cc:</span></b> dl-cstech; Sudheesh =
Nair<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> RE: Maximn =
number of
inodes</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>From the case =
(4115):<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>This is an EVAL at Allegro. <br>
<br>
Customer is loading files onto a Bobcat volume and noticed that the =
mounted FS is
running out of inodes. Even adding more space to the volume (1 LUN, =
approx
200GB) did not relief. They deleted some files and started loading =
again, but
the situation is still the same. For whatever reason, the auto-mechanism =
of
allocating more inodes does not work. Why ? <br>
Here are some command outputs which document: <br>
<br>
fscmd viewfs onstor23 <br>
Name : onstor23 <br>
State : online <br>
VolId : 0x0000036300000070 <br>
Size : 1433471 MByte (Nbr blocks 183484376) (Total blocks incl log: =
183500760) <br>
Available : 905505 MByte (Nbr blocks 115904645) <br>
Inodes : 17449982 (available 528747, used 16921235) <br>
Blks : total 183484376, allocated 66885653, reserved 0, beyond 0 minFree =
694078
minFreeRm 462718 <br>
snapshots : 0xd <br>
grow HWM : 0 <br>
vsid : 4 <br>
volType : 0 <br>
Mkfs : Tue Dec 5 13:39:32 2006 <br>
Number of mounts: 3 (dirty: 0 ) <br>
Number of umounts: 3 <br>
Number of mount failures: 0 (log) 0 (replay) 0 (eek) 0 (snap) <br>
Result of last 3 mount operation(s) <br>
online Mount time Tue Dec 5 17:52:17 2006 <br>
online Mount time Tue Dec 5 17:10:27 2006 <br>
online Mount time Tue Dec 5 13:39:38 2006 <br>
Result of last 3 umount operation(s) <br>
umount time Tue Dec 5 17:50:51 2006 <br>
umount time Tue Dec 5 17:09:01 2006 <br>
umount time Tue Dec 5 13:39:38 2006 <br>
oplocks : allow <br>
charSubst : disabled <br>
automatic atime update: disabled <br>
unstable name space updates: enabled <br>
unstable all: enabled <br>
<br>
***as one can see, the number of available inodes is very low, compared =
to the
available space in the volume. And it decreases while thy load more =
files (file
size on average 30kB) see: <br>
<br>
fscmd viewfs onstor23 <br>
Name : onstor23 <br>
State : online <br>
VolId : 0x0000036300000070 <br>
Size : 1433471 MByte (Nbr blocks 183484376) (Total blocks incl log: =
183500760) <br>
Available : 905425 MByte (Nbr blocks 115894459) <br>
Inodes : 17449982 (available 526080, used 16923902) <br>
Blks : total 183484376, allocated 66895839, reserved 0, beyond 0 minFree =
694078
minFreeRm 462718 <br>
snapshots : 0xd <br>
grow HWM : 0 <br>
vsid : 4 <br>
volType : 0 <br>
Mkfs : Tue Dec 5 13:39:32 2006 <br>
Number of mounts: 3 (dirty: 0 ) <br>
Number of umounts: 3 <br>
Number of mount failures: 0 (log) 0 (replay) 0 (eek) 0 (snap) <br>
Result of last 3 mount operation(s) <br>
online Mount time Tue Dec 5 17:52:17 2006 <br>
online Mount time Tue Dec 5 17:10:27 2006 <br>
online Mount time Tue Dec 5 13:39:38 2006 <br>
Result of last 3 umount operation(s) <br>
umount time Tue Dec 5 17:50:51 2006 <br>
umount time Tue Dec 5 17:09:01 2006 <br>
umount time Tue Dec 5 13:39:38 2006 <br>
oplocks : allow <br>
charSubst : disabled <br>
automatic atime update: disabled <br>
unstable name space updates: enabled <br>
unstable all: enabled <br>
<br>
***it is consistent with output of df -h at the Linux client which loads =
the
files: <br>
<br>
192.168.0.141:/onstor13 <br>
1.2T 516G 685G 43% /photos/photos01 <br>
192.168.0.142:/onstor23 <br>
1.4T 516G 885G 37% /photos/photos02 <br>
[root@rescue photos02]# <br>
[15:30:25] <br>
192.168.0.141:/onstor13 <br>
17449982 16937413 512569 98% /photos/photos01 <br>
192.168.0.142:/onstor23 <br>
17449982 16927056 522926 98% /photos/photos02 <br>
[15:31:11] <br>
192.168.0.141:/onstor13 <br>
17449982 16937784 512198 98% /photos/photos01 <br>
192.168.0.142:/onstor23 <br>
17449982 16927353 522629 98% /photos/photos02 <br>
[root@rescue photos02]# <br>
<br>
fscmd viewfs onstor23 <br>
Name : onstor23 <br>
State : online <br>
VolId : 0x0000036300000070 <br>
Size : 1433471 MByte (Nbr blocks 183484376) (Total blocks incl log: =
183500760) <br>
Available : 905306 MByte (Nbr blocks 115879219) <br>
Inodes : 17449982 (available 522152, used 16927830) <br>
Blks : total 183484376, allocated 66911079, reserved 0, beyond 0 minFree =
694078
minFreeRm 462718 <br>
snapshots : 0xd <br>
grow HWM : 0 <br>
vsid : 4 <br>
volType : 0 <br>
Mkfs : Tue Dec 5 13:39:32 2006 <br>
Number of mounts: 3 (dirty: 0 ) <br>
Number of umounts: 3 <br>
Number of mount failures: 0 (log) 0 (replay) 0 (eek) 0 (snap) <br>
Result of last 3 mount operation(s) <br>
online Mount time Tue Dec 5 17:52:17 2006 <br>
online Mount time Tue Dec 5 17:10:27 2006 <br>
online Mount time Tue Dec 5 13:39:38 2006 <br>
Result of last 3 umount operation(s) <br>
umount time Tue Dec 5 17:50:51 2006 <br>
umount time Tue Dec 5 17:09:01 2006 <br>
umount time Tue Dec 5 13:39:38 2006 <br>
oplocks : allow <br>
charSubst : disabled <br>
automatic atime update: disabled <br>
unstable name space updates: enabled <br>
unstable all: enabled <br>
<br>
Volume Details <br>
-------------- <br>
<br>
Name : onstor23 <br>
Id : 0x36300000070 <br>
Type : Standard <br>
Virtual Server : ONSTOR2 <br>
Status : Mounted <br>
Current Size (MiB): 1433471.69 <br>
Used Size (MiB): 528191.80 <br>
Available Size (MiB): 905279.89 <br>
Usage (%) : 36.85 % <br>
Hard Quota (MiB): No Limit <br>
Soft Quota (%) : N/A <br>
High Water Mark (%) : N/A <br>
Min. Auto Growth (MiB): 549887 <br>
Shared Read : allow <br>
Oplocks : allow <br>
CharSubst : disabled <br>
CharSubstTable : 0000,0000,0000,0000,0000,0000,0000,0000 <br>
Language : en_us <br>
Layout type : 0 <br>
Automatic Atime Updates: disabled <br>
Stability: unstable all <br>
Arrays : 3PARdata_03C6 <br>
Vendor/model : None <br>
RAID Level : Raid-5 <br>
Min. Lun Size (MiB): No Min <br>
Max. Lun Size (MiB): No Max <br>
<br>
LUN List <br>
Idx Device Name Size (MiB) <br>
-------------------------------------------------- <br>
1 3PARdata_03C6_0000403C6 307199.94 <br>
2 3PARdata_03C6_0000103C6 307199.94 <br>
3 3PARdata_03C6_0000603C6 307199.94 <br>
4 3PARdata_03C6_0000503C6 307199.94 <br>
5 3PARdata_03C6_0003A03C6 204799.94 <br>
------------------------------------------------- <br>
<br>
Name: ping <br>
Date &amp; Time : Tue Dec 12 16:07:07 2006 <br>
Time zone : Europe/Berlin <br>
System Uptime : 33:19:06 <br>
System temperature (celsius): 44 <br>
Software Version: 1.3.3.1 <br>
<br>
chassis <br>
-------- <br>
Model number: ONS-SYS-2260 <br>
System revision: C3 <br>
System serial number: 0614051015 <br>
MAC addr: 00:07:34:03:63:00 <br>
<br>
BMFPGA : Version 4 <br>
Board revision: B4 <br>
Board serial number: 0614050015 <br>
Boot Dev: wd0a (cf1) <br>
SSC <br>
PROM_R9000 : prom-2.0.3 : Thu Apr 13 16:44:49 2006 <br>
<br>
LUC revision: 3.2.10 <br>
TXRX0 <br>
PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006 <br>
NFP_TXRX : R1.3.3.1BC-103106 : Tue Oct 31 18:09:52 2006 <br>
TXRX1 <br>
PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006 <br>
NFP_TXRX : R1.3.3.1BC-103106 : Tue Oct 31 18:09:52 2006 <br>
FP0 <br>
PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006 <br>
NFP_FP : R1.3.3.1BC-103106 : Tue Oct 31 18:04:20 2006 <br>
FP1 <br>
PROM_SIBYTE_BC : prom-2.0.2 : Fri Apr 7 13:13:34 2006 <br>
NFP_FP : R1.3.3.1BC-103106 : Tue Oct 31 18:04:20 2006 <br>
<br>
FC0 <br>
PROM_R9000 : prom-2.0.3 : Thu Apr 13 16:44:49 2006 <br>
FCNIM : R1.3.3.1BC-103106 : Tue Oct 31 18:10:34 2006 <br>
<br>
NTP Configuration : <br>
remote refid st t when poll reach delay offset jitter <br>
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D <br>
127.127.1.0 127.127.1.0 10 l 23 64 377 0.000 0.000 0.004 <br>
*192.168.0.193 150.254.183.15 2 u 738 1024 377 0.004 -3.555 0.179 <br>
SC1 IP : 192.168.129.5 <br>
SC2 IP : 10.11.12.13 <br>
No of Virtual server(s) : 2</span></font><font size=3D2 color=3Dnavy =
face=3DArial><span
style=3D'font-size:10.0pt;font-family:Arial;color:navy'><o:p></o:p></span=
></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<div>

<div class=3DMsoNormal align=3Dcenter style=3D'text-align:center'><font =
size=3D3
face=3D"Times New Roman"><span style=3D'font-size:12.0pt'>

<hr size=3D2 width=3D"100%" align=3Dcenter tabIndex=3D-1>

</span></font></div>

<p class=3DMsoNormal><b><font size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font =
size=3D2
face=3DTahoma><span style=3D'font-size:10.0pt;font-family:Tahoma'> Eric =
Barrett <br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Tuesday, December =
12, 2006
1:08 PM<br>
<b><span style=3D'font-weight:bold'>To:</span></b> Steffen Thuemmel; =
Henry Lau;
Victor Carrell (Glasshouse)<br>
<b><span style=3D'font-weight:bold'>Cc:</span></b> dl-cstech; Sudheesh =
Nair<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> RE: Maximn =
number of
inodes</span></font><o:p></o:p></p>

</div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Steffen,</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>What error?&nbsp; What gives it?&nbsp; Need way more =
info
here.</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Even at 98% inodes used they should not be getting an
error.&nbsp; 100%, sure, but they're not =
there.</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'>&nbsp;<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<div class=3DMsoNormal align=3Dcenter style=3D'text-align:center'><font =
size=3D3
face=3D"Times New Roman"><span style=3D'font-size:12.0pt'>

<hr size=3D2 width=3D"100%" align=3Dcenter tabIndex=3D-1>

</span></font></div>

<p class=3DMsoNormal style=3D'margin-bottom:12.0pt'><b><font size=3D2 =
face=3DTahoma><span
style=3D'font-size:10.0pt;font-family:Tahoma;font-weight:bold'>From:</spa=
n></font></b><font
size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;font-family:Tahoma'> Steffen
Thuemmel <br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Tuesday, December =
12, 2006
12:33 PM<br>
<b><span style=3D'font-weight:bold'>To:</span></b> Henry Lau; Victor =
Carrell
(Glasshouse)<br>
<b><span style=3D'font-weight:bold'>Cc:</span></b> dl-cstech; Sudheesh =
Nair<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> RE: Maximn =
number of
inodes</span></font><o:p></o:p></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Gentlemen,<o:p></o:p></span></font><=
/p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>This doesn&#8217;t help here. The =
customer is
using an application that loads (creates) many files (average size 30 =
kB) onto
the filesystems on a Bobcat. <o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>They simulate their client =
behavior: The
customer, Allegro, is an internet auction provider. Their clients upload
descriptions and picture of their items they put into an =
auction.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>The application breakes after =
receiving an
error. Looking at the filesystem they determined that 98% of all inodes =
are
used although the capacity of the filesystem is only used less than 50%. =
They
increased the capacity by 200GB, but that did not clear the problem. =
They were
not able to create more files. Only after deleting some files, they =
could
generate new ones.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>So to me that looks like the =
automated
process of inode allocation does not work here. The question is why =
?<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Regards,<o:p></o:p></span></font></p=
>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>St.<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<div>

<div>

<p class=3DMsoNormal><b><font size=3D2 color=3Dnavy face=3D"Times New =
Roman"><span
style=3D'font-size:10.0pt;color:navy;font-weight:bold'>Steffen Thuemmel =
<o:p></o:p></span></font></b></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3D"Times New =
Roman"><span
style=3D'font-size:10.0pt;color:navy'>Manager Systems =
Engineering<o:p></o:p></span></font></p>

<p class=3DMsoNormal><st1:place w:st=3D"on"><font size=3D2 color=3Dnavy
 face=3D"Times New Roman"><span =
style=3D'font-size:10.0pt;color:navy'>Central
 Europe</span></font></st1:place><font size=3D2 color=3Dnavy><span
style=3D'font-size:10.0pt;color:navy'><o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 color=3Dnavy face=3D"Times New =
Roman"><span
style=3D'font-size:12.0pt;color:navy'><o:p>&nbsp;</o:p></span></font></p>=


<p class=3DMsoNormal><b><font size=3D1 color=3Dnavy face=3DTahoma><span
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy;font-weight:bold'>=
ONStor<o:p></o:p></span></font></b></p>

<p class=3DMsoNormal><font size=3D1 color=3Dnavy face=3DTahoma><span =
style=3D'font-size:
8.0pt;font-family:Tahoma;color:navy'>Schleussne</span></font><font =
size=3D1
color=3Dnavy face=3DTahoma><span lang=3DDE =
style=3D'font-size:8.0pt;font-family:Tahoma;
color:navy'>r Str. 42<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D1 color=3Dnavy face=3DTahoma><span =
lang=3DDE
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy'>D-63263 =
Neu-Isenburg<o:p></o:p></span></font></p>

<p class=3DMsoNormal><st1:place w:st=3D"on"><st1:country-region =
w:st=3D"on"><font
  size=3D1 color=3Dnavy face=3DTahoma><span =
style=3D'font-size:8.0pt;font-family:Tahoma;
  =
color:navy'>Germany</span></font></st1:country-region></st1:place><font
color=3Dnavy><span style=3D'color:navy'><o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D3 color=3Dnavy face=3D"Times New =
Roman"><span
style=3D'font-size:12.0pt;color:navy'><o:p>&nbsp;</o:p></span></font></p>=


<p class=3DMsoNormal><b><font size=3D1 color=3Dnavy face=3DTahoma><span
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy;font-weight:bold'>=
telf.</span></font></b><b><font
size=3D2 color=3Dnavy face=3DTahoma><span =
style=3D'font-size:10.0pt;font-family:Tahoma;
color:navy;font-weight:bold'>&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; =
</span></font></b><b><font
size=3D1 color=3Dnavy face=3DTahoma><span =
style=3D'font-size:7.5pt;font-family:Tahoma;
color:navy;font-weight:bold'>+49 6102 884 84-0</span></font></b><b><font
size=3D1 color=3Dnavy face=3DTahoma><span =
style=3D'font-size:8.0pt;font-family:Tahoma;
color:navy;font-weight:bold'><o:p></o:p></span></font></b></p>

<p class=3DMsoNormal><b><font size=3D1 color=3Dnavy face=3DTahoma><span
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy;font-weight:bold'>=
mobil.
&nbsp;&nbsp;&nbsp; </span></font></b><b><font size=3D1 color=3Dnavy =
face=3DTahoma><span
style=3D'font-size:7.5pt;font-family:Tahoma;color:navy;font-weight:bold'>=
+49 173
673 3434<o:p></o:p></span></font></b></p>

<p class=3DMsoNormal><b><font size=3D1 color=3Dnavy face=3DTahoma><span =
lang=3DFR
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy;font-weight:bold'>=
mail.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
<a =
href=3D"mailto:steffen.thuemmel@onstor.com">steffen.thuemmel@onstor.com</=
a><o:p></o:p></span></font></b></p>

<p class=3DMsoNormal><b><font size=3D1 color=3Dnavy face=3DTahoma><span =
lang=3DFR
style=3D'font-size:8.0pt;font-family:Tahoma;color:navy;font-weight:bold'>=
web.&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;
<a =
href=3D"http://www.onstor.com/">www.onstor.com</a></span></font></b><font=

color=3Dnavy><span lang=3DFR =
style=3D'color:navy'><o:p></o:p></span></font></p>

</div>

</div>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<div>

<div class=3DMsoNormal align=3Dcenter style=3D'text-align:center'><font =
size=3D3
face=3D"Times New Roman"><span style=3D'font-size:12.0pt'>

<hr size=3D2 width=3D"100%" align=3Dcenter tabIndex=3D-1>

</span></font></div>

<p class=3DMsoNormal><b><font size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font =
size=3D2
face=3DTahoma><span style=3D'font-size:10.0pt;font-family:Tahoma'> Henry =
Lau <br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Dienstag, 12. =
Dezember 2006
18:01<br>
<b><span style=3D'font-weight:bold'>To:</span></b> Victor Carrell =
(Glasshouse)<br>
<b><span style=3D'font-weight:bold'>Cc:</span></b> dl-cstech<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> RE: Maximn =
number of
inodes</span></font><o:p></o:p></p>

</div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Please check <a
href=3D"http://wiki/wiki/Inodes">http://wiki/wiki/Inodes</a><o:p></o:p></=
span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Thanks,<o:p></o:p></span></font></p>=


<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'>Henry<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 color=3Dnavy face=3DArial><span =
style=3D'font-size:
10.0pt;font-family:Arial;color:navy'><o:p>&nbsp;</o:p></span></font></p>

<div>

<div class=3DMsoNormal align=3Dcenter style=3D'text-align:center'><font =
size=3D3
face=3D"Times New Roman"><span style=3D'font-size:12.0pt'>

<hr size=3D2 width=3D"100%" align=3Dcenter tabIndex=3D-1>

</span></font></div>

<p class=3DMsoNormal><b><font size=3D2 face=3DTahoma><span =
style=3D'font-size:10.0pt;
font-family:Tahoma;font-weight:bold'>From:</span></font></b><font =
size=3D2
face=3DTahoma><span style=3D'font-size:10.0pt;font-family:Tahoma'> =
Victor Carrell
(Glasshouse) <br>
<b><span style=3D'font-weight:bold'>Sent:</span></b> Tuesday, December =
12, 2006
8:25 AM<br>
<b><span style=3D'font-weight:bold'>To:</span></b> dl-cstech<br>
<b><span style=3D'font-weight:bold'>Subject:</span></b> Maximn number of =
inodes</span></font><o:p></o:p></p>

</div>

<p class=3DMsoNormal><font size=3D3 face=3D"Times New Roman"><span =
style=3D'font-size:
12.0pt'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Hi,<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>&nbsp;I have a customer ONStor <st1:place =
w:st=3D"on"><st1:country-region
 w:st=3D"on">Germany</st1:country-region></st1:place> case 4115 that =
appears to
be running out of inodes.&nbsp; I have asked to turn off snapshots if on =
and
retry their test.&nbsp; In the mean time it is my understanding that =
once
indoes are used up we double the number of inodes in the
background.&nbsp;&nbsp; Am I wrong in this thinking?&nbsp; Or is there
something that would prevent this?&nbsp; Or is there a total maximum =
number of
inodes allowed?&nbsp; In this case </span></font>17449982<font size=3D2
face=3DArial><span =
style=3D'font-size:10.0pt;font-family:Arial'><o:p></o:p></span></font></p=
>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'><o:p>&nbsp;</o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Thanks<o:p></o:p></span></font></p>

<p class=3DMsoNormal><font size=3D2 face=3DArial><span =
style=3D'font-size:10.0pt;
font-family:Arial'>Victor<o:p></o:p></span></font></p>

</div>

</body>

</html>

------_=_NextPart_001_01C71E35.5BF9528D--
