Unix Technical Forum

SEO

vBulletin Search Engine Optimization


Go Back   Unix Technical Forum > Database Server Software > MySQL > MySQL General forum

Register FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 05-10-2008, 02:03 PM
=?ISO-8859-1?Q?I=F1igo_Medina_Garc=EDa?=
 
Posts: n/a
Default Block size of filesystem

Hi friends,

we're developing a new web application that works with a db around 1gb
and 30 tables.

We work with linux, and I'm evaluating the benefit of making an specific
partition (ext3) for mysql in order to have a bigger Block Size. Block
Size by default in / partition is 4096.

Do you think that could be good? Any experience?

Iñigo

--
--------
Iñigo Medina García
Librería Díaz de Santos
imedina@diazdesantos.es
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 05-10-2008, 02:03 PM
Aaron Blew
 
Posts: n/a
Default Re: Block size of filesystem

Will you be using the MyISAM or InnoDB table engines?

I had heard that InnoDB uses 16k blocks internally, so that might be a good
starting point, though I'd love to have someone confirm or deny that this is
actually true.

-Aaron


On Fri, May 9, 2008 at 12:01 AM, Iñigo Medina García <
imedina@diazdesantos.es> wrote:

> Hi friends,
>
> we're developing a new web application that works with a db around 1gb
> and 30 tables.
>
> We work with linux, and I'm evaluating the benefit of making an specific
> partition (ext3) for mysql in order to have a bigger Block Size. Block
> Size by default in / partition is 4096.
>
> Do you think that could be good? Any experience?
>
> Iñigo
>
> --
> --------
> Iñigo Medina García
> Librería Díaz de Santos
> imedina@diazdesantos.es
>
> --
> MySQL General Mailing List
> For list archives: http://lists.mysql.com/mysql
> To unsubscribe: http://lists.mysql.com/mysql?unsub=aaronblew@gmail.com
>
>


Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 05-10-2008, 02:03 PM
Ben Clewett
 
Posts: n/a
Default Re: Block size of filesystem



I would use as large a block size as you dare, especially with InnoDB.
Makes reading and writing faster as custs down seek time as cuts down
disk fragmenation and avoids block table reads. With MyIsam you have
lots of files, but if you only have a few again might work well with a
large block size.

Also have a look at the stripe size of your raid system, might work well
aligning them if you can. This URL also gives some tips for an ext3
file system on RAID, look for 'stride':

http://insights.oetiker.ch/linux/raidoptimization.html

Ben

Iñigo Medina García wrote:
> Hi friends,
>
> we're developing a new web application that works with a db around 1gb
> and 30 tables.
>
> We work with linux, and I'm evaluating the benefit of making an specific
> partition (ext3) for mysql in order to have a bigger Block Size. Block
> Size by default in / partition is 4096.
>
> Do you think that could be good? Any experience?
>
> Iñigo
>


************************************************** ***********************
This e-mail is confidential and may be legally privileged. It is intended
solely for the use of the individual(s) to whom it is addressed. Any
content in this message is not necessarily a view or statement from Road
Tech Computer Systems Limited but is that of the individual sender. If
you are not the intended recipient, be advised that you have received
this e-mail in error and that any use, dissemination, forwarding,
printing, or copying of this e-mail is strictly prohibited. We use
reasonable endeavours to virus scan all e-mails leaving the company but
no warranty is given that this e-mail and any attachments are virus free.
You should undertake your own virus checking. The right to monitor e-mail
communications through our networks is reserved by us

Road Tech Computer Systems Ltd. Shenley Hall, Rectory Lane, Shenley,
Radlett, Hertfordshire, WD7 9AN. - VAT Registration No GB 449 3582 17
Registered in England No: 02017435, Registered Address: Charter Court,
Midland Road, Hemel Hempstead, Hertfordshire, HP2 5GE.
************************************************** ***********************
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old 05-10-2008, 02:03 PM
=?ISO-8859-1?Q?I=F1igo_Medina_Garc=EDa?=
 
Posts: n/a
Default Re: Block size of filesystem

Thanks, Aaron.

>> Will you be using the MyISAM or InnoDB table engines?


Both, but InnoDB more.

>> I had heard that InnoDB uses 16k blocks internally, so that might be

a good starting point, though I'd love to have someone confirm or deny
that this is actually true.

Ok, that's interesting. :-) I'll check it.

Iñigo



Aaron Blew wrote:
> Will you be using the MyISAM or InnoDB table engines?
>
> I had heard that InnoDB uses 16k blocks internally, so that might be a good
> starting point, though I'd love to have someone confirm or deny that this is
> actually true.
>
> -Aaron
>
>
> On Fri, May 9, 2008 at 12:01 AM, Iñigo Medina García <
> imedina@diazdesantos.es> wrote:
>
>> Hi friends,
>>
>> we're developing a new web application that works with a db around 1gb
>> and 30 tables.
>>
>> We work with linux, and I'm evaluating the benefit of making an specific
>> partition (ext3) for mysql in order to have a bigger Block Size. Block
>> Size by default in / partition is 4096.
>>
>> Do you think that could be good? Any experience?
>>
>> Iñigo
>>
>> --
>> --------
>> Iñigo Medina García
>> Librería Díaz de Santos
>> imedina@diazdesantos.es
>>
>> --
>> MySQL General Mailing List
>> For list archives: http://lists.mysql.com/mysql
>> To unsubscribe: http://lists.mysql.com/mysql?unsub=aaronblew@gmail.com
>>
>>

>



--
--------
Iñigo Medina García
Librería Díaz de Santos Madrid (Spain)
imedina@diazdesantos.es facilmejor@gmail.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old 05-10-2008, 02:03 PM
=?ISO-8859-1?Q?I=F1igo_Medina_Garc=EDa?=
 
Posts: n/a
Default Re: Block size of filesystem

Thanks Ben.

>> I would use as large a block size as you dare, especially with InnoDB.
>> Makes reading and writing faster as custs down seek time as cuts down
>> disk fragmenation and avoids block table reads. With MyIsam you have
>> lots of files, but if you only have a few again might work well with
>> a large block size.


Perfect. That sounds the way Aaron explain about 16k blocks in InnoDb.
And actually we have more InnoDB tables tan MyISAM.

>> Also have a look at the stripe size of your raid system, might work
>> well aligning them if you can. This URL also gives some tips for an
>> ext3 file system on RAID, look for 'stride':
>> http://insights.oetiker.ch/linux/raidoptimization.html


Perfect. I'll check it.

Iñigo



Ben Clewett wrote:
>
>
> I would use as large a block size as you dare, especially with InnoDB.
> Makes reading and writing faster as custs down seek time as cuts down
> disk fragmenation and avoids block table reads. With MyIsam you have
> lots of files, but if you only have a few again might work well with a
> large block size.
>
> Also have a look at the stripe size of your raid system, might work well
> aligning them if you can. This URL also gives some tips for an ext3
> file system on RAID, look for 'stride':
>
> http://insights.oetiker.ch/linux/raidoptimization.html
>
> Ben
>
> Iñigo Medina García wrote:
>> Hi friends,
>>
>> we're developing a new web application that works with a db around 1gb
>> and 30 tables.
>>
>> We work with linux, and I'm evaluating the benefit of making an specific
>> partition (ext3) for mysql in order to have a bigger Block Size. Block
>> Size by default in / partition is 4096.
>>
>> Do you think that could be good? Any experience?
>>
>> Iñigo
>>

>
> ************************************************** ***********************
> This e-mail is confidential and may be legally privileged. It is intended
> solely for the use of the individual(s) to whom it is addressed. Any
> content in this message is not necessarily a view or statement from Road
> Tech Computer Systems Limited but is that of the individual sender. If
> you are not the intended recipient, be advised that you have received
> this e-mail in error and that any use, dissemination, forwarding,
> printing, or copying of this e-mail is strictly prohibited. We use
> reasonable endeavours to virus scan all e-mails leaving the company but
> no warranty is given that this e-mail and any attachments are virus free.
> You should undertake your own virus checking. The right to monitor e-mail
> communications through our networks is reserved by us
>
> Road Tech Computer Systems Ltd. Shenley Hall, Rectory Lane, Shenley,
> Radlett, Hertfordshire, WD7 9AN. - VAT Registration No GB 449 3582 17
> Registered in England No: 02017435, Registered Address: Charter Court,
> Midland Road, Hemel Hempstead, Hertfordshire, HP2 5GE.
> ************************************************** ***********************
>



--
--------
Iñigo Medina García
Librería Díaz de Santos Madrid (Spain)
imedina@diazdesantos.es facilmejor@gmail.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #6 (permalink)  
Old 05-10-2008, 02:03 PM
=?ISO-8859-1?Q?I=F1igo_Medina_Garc=EDa?=
 
Posts: n/a
Default Re: Block size of filesystem

I'm seeing that architecture has almost allways the limit in 4 kb (block
size -> page). Theoretically architecture of 64 bits would offer up to 8
kb, but it seems to be that it usually has 4 kb too because of
compatibiliry issues with its i386 ancestors.

Any idea about that? We run Intel Core 2 Duo on kernel 2.6.21-1 and i386
by now. Do you think it could be better to change the architecture in
order to get the advantages of 8 kb blocks size?

Iñigo


Iñigo Medina García wrote:
> Hi friends,
>
> we're developing a new web application that works with a db around 1gb
> and 30 tables.
>
> We work with linux, and I'm evaluating the benefit of making an specific
> partition (ext3) for mysql in order to have a bigger Block Size. Block
> Size by default in / partition is 4096.
>
> Do you think that could be good? Any experience?
>
> Iñigo
>



--
--------
Iñigo Medina García
Librería Díaz de Santos Madrid (Spain)
imedina@diazdesantos.es facilmejor@gmail.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #7 (permalink)  
Old 05-10-2008, 02:03 PM
=?ISO-8859-1?Q?I=F1igo_Medina_Garc=EDa?=
 
Posts: n/a
Default Re: Block size of filesystem


> Will you be using the MyISAM or InnoDB table engines?
>
> I had heard that InnoDB uses 16k blocks internally, so that might be a good
> starting point, though I'd love to have someone confirm or deny that this is
> actually true.


Yep, Aaron. Look at: http://www.innodb.com/innodb/features/
and expand the *wspifmd* link "read more" of InnoDB Features:
"database page sizes configurable, from 4 to 64 kB, default 16 kB".

Iñigo


> -Aaron
>
>
> On Fri, May 9, 2008 at 12:01 AM, Iñigo Medina García <
> imedina@diazdesantos.es> wrote:
>
>> Hi friends,
>>
>> we're developing a new web application that works with a db around 1gb
>> and 30 tables.
>>
>> We work with linux, and I'm evaluating the benefit of making an specific
>> partition (ext3) for mysql in order to have a bigger Block Size. Block
>> Size by default in / partition is 4096.
>>
>> Do you think that could be good? Any experience?
>>
>> Iñigo
>>
>> --
>> --------
>> Iñigo Medina García
>> Librería Díaz de Santos
>> imedina@diazdesantos.es
>>
>> --
>> MySQL General Mailing List
>> For list archives: http://lists.mysql.com/mysql
>> To unsubscribe: http://lists.mysql.com/mysql?unsub=aaronblew@gmail.com
>>
>>

>



--
--------
Iñigo Medina García
Librería Díaz de Santos Madrid (Spain)
imedina@diazdesantos.es facilmejor@gmail.com
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #8 (permalink)  
Old 05-10-2008, 02:03 PM
Aaron Blew
 
Posts: n/a
Default Re: Block size of filesystem

That's true in some workloads, but with InnoDB you'll usually run into data
file fragmentation before filesystem fragmentation (unless it's a shared
system). This is especially true if your application runs a lot of updates
or deletes as random chunks of space will become free at different points
within the InnoDB data file. In a business intelligence application where
there's not much deleting this probably isn't a concern...

I think the best way to approach it may be to look at your average row size
and base your InnoDB and filesystem block sizes around that.

-Aaron

On Fri, May 9, 2008 at 12:43 AM, Ben Clewett <ben@roadrunner.uk.com> wrote:

>
>
> I would use as large a block size as you dare, especially with InnoDB.
> Makes reading and writing faster as custs down seek time as cuts down disk
> fragmenation and avoids block table reads. With MyIsam you have lots of
> files, but if you only have a few again might work well with a large block
> size.
>
> Also have a look at the stripe size of your raid system, might work well
> aligning them if you can. This URL also gives some tips for an ext3 file
> system on RAID, look for 'stride':
>
> http://insights.oetiker.ch/linux/raidoptimization.html
>
> Ben
>
> Iñigo Medina García wrote:
>
>> Hi friends,
>>
>> we're developing a new web application that works with a db around 1gb
>> and 30 tables.
>>
>> We work with linux, and I'm evaluating the benefit of making an specific
>> partition (ext3) for mysql in order to have a bigger Block Size. Block
>> Size by default in / partition is 4096.
>>
>> Do you think that could be good? Any experience?
>>
>> Iñigo
>>
>>

> ************************************************** ***********************
> This e-mail is confidential and may be legally privileged. It is intended
> solely for the use of the individual(s) to whom it is addressed. Any
> content in this message is not necessarily a view or statement from Road
> Tech Computer Systems Limited but is that of the individual sender. If
> you are not the intended recipient, be advised that you have received
> this e-mail in error and that any use, dissemination, forwarding,
> printing, or copying of this e-mail is strictly prohibited. We use
> reasonable endeavours to virus scan all e-mails leaving the company but
> no warranty is given that this e-mail and any attachments are virus free.
> You should undertake your own virus checking. The right to monitor e-mail
> communications through our networks is reserved by us
>
> Road Tech Computer Systems Ltd. Shenley Hall, Rectory Lane, Shenley,
> Radlett, Hertfordshire, WD7 9AN. - VAT Registration No GB 449 3582 17
> Registered in England No: 02017435, Registered Address: Charter Court,
> Midland Road, Hemel Hempstead, Hertfordshire, HP2 5GE.
> ************************************************** ***********************
>
>
> --
> MySQL General Mailing List
> For list archives: http://lists.mysql.com/mysql
> To unsubscribe: http://lists.mysql.com/mysql?unsub=aaronblew@gmail.com
>
>


Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On



All times are GMT. The time now is 05:22 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
Search Engine Optimization by vBSEO 3.1.0

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145