AF:
NF:0
PS:10
SRH:1
SFN:
DSR:
MID:<20090428072751.3b8ea0c7@ripper.onstor.net>
CFG:
PT:0
S:andy.sharp@onstor.com
RQ:
SSV:mail.onstor.net
NSV:
SSH:
R:<narayan.venkat@onstor.com>
MAID:1
X-Sylpheed-Privacy-System:
X-Sylpheed-Sign:0
SCF:#mh/Mailbox/sent
RMID:#imap/andys@onstor.net@exch1.onstor.net/INBOX	0	102AB4F33EBBDB4C91915B145C8E9FB31284F9BBF2@exch1.onstor.net
X-Sylpheed-End-Special-Headers: 1
Date: Tue, 28 Apr 2009 07:43:20 -0700
From: Andrew Sharp <andy.sharp@onstor.com>
To: Narayan Venkat <narayan.venkat@onstor.com>
Subject: Re: Compression Ratio on Mightydog\Marketing data
Message-ID: <20090428074320.2c0f4bd6@ripper.onstor.net>
In-Reply-To: <102AB4F33EBBDB4C91915B145C8E9FB31284F9BBF2@exch1.onstor.net>
References: <102AB4F33EBBDB4C91915B145C8E9FB31284F9BBEB@exch1.onstor.net>
	<20090428003041.7fa9c0f2@ripper.onstor.net>
	<102AB4F33EBBDB4C91915B145C8E9FB31284F9BBF2@exch1.onstor.net>
Organization: Onstor
X-Mailer: Sylpheed-Claws 2.6.0 (GTK+ 2.8.20; x86_64-pc-linux-gnu)
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit

On Tue, 28 Apr 2009 06:32:03 -0700 Narayan Venkat
<narayan.venkat@onstor.com> wrote:

> I agree with you completely.  There are number of jpegs and avi files
> that are not compressible.  We should get at least 2:1 on Home Directories
> and possible about 3:1 for Databases.  The 9:1 or even 5:1 are bogus in
> my mind.  For backup stream with de-dupe, it may be possible.

Well, what I was thinking was that everyone knows that the numbers
everyone gives are absolute best-case, so we should give our absolute
best case as well, so that oranges and oranges, if you get my meaning.

> Those are my next set of tests.  Is there a good software repository
> that doesn't have compressed files that I can copy over?

That's what I was thinking about.  Would it be wrong to create a
folder?  I was thinking just copy a checked-out branch over and over
until you had 100GB worth.  50 copies of r402rel should do it.

We have to figure out a way to try it on our exchange database.

Cheers,

a

> Thanks.
> 
> Narayan Venkat
> Vice President, Marketing
> ONStor Inc. (www.onstor.com)
> Tel: (408) 963-2404
> Cell: (408) 221-4297
> -----Original Message-----
> From: Andy Sharp 
> Sent: Tuesday, April 28, 2009 12:31 AM
> To: Narayan Venkat
> Subject: Re: Compression Ratio on Mightydog\Marketing data
> 
> Hi N,
> 
> We should have a talk about these.  ~:^)
> 
> It's 1.38, BTW.  But these aren't good numbers for marketing/sales
> purposes.  Back the last time this came up, I did a fair bit of poking
> around, and most of these compression weenies claim 9:1 and crazy stuff
> like that in their marketing literature.  Now, you and I both know that
> there's no way that's a real world number, but something closer to 3:1
> or 4:1 would make it seem like it's worth while compared to competitors
> numbers.  Because there are so many jpegs and AVIs on the marketing
> folder, which don't compress at all, a better choice would be several
> engineer's home directories.  Full of source code, which compresses
> quite well.  Make sure you delete any .gz or .tgz files from the target
> folder, because they will bork the numbers.  Don't delete them from
> the home directories though ~:^)
> 
> On Mon, 27 Apr 2009 22:09:21 -0700 Narayan Venkat
> <narayan.venkat@onstor.com> wrote:
> 
> > Folks,
> > 
> > I ran a small experiment to understand what level of data compression I could get for typical user folders.  I copied over \\Mightydog\Marketing folder into two ZFS file systems with compression turned on.  Here are the observed compression ratios:
> > 
> > a)       Case 1:
> > a.       Compression - GZIP
> > b.       Marketing folder size on Mightydog - 24.6GB
> > c.       Same folder size on ZFS - 17.7GB
> > d.       Compression ratio - 1.41x
> > b)       Case 2:
> > a.       Compression - GZIP-9
> > b.       Marketing folder size on Mightydog - 24.6GB
> > c.       Same folder size on ZFS - 17.7GB
> > d.       Compression ratio - 1.42x
> > 
> > It's pretty good compression for the diversity of data stored (ppt, xls, avi, vss, doc, pdf, jpegs, ...) in the Marketing folder.  The beauty of it was that compression was free.  No need to add expensive "in-line" compression appliances.
> > 
> > Now that is a good value proposition to a customer.
> > 
> > 
> > Narayan Venkat
> > Vice President, Marketing
> > ONStor Inc. (www.onstor.com<http://www.onstor.com>)
> > Tel: (408) 963-2404
> > Cell: (408) 221-4297
> > 
