Unix Technical Forum

Re: Free WAL caches on switching segments

This is a discussion on Re: Free WAL caches on switching segments within the Pgsql Patches forums, part of the PostgreSQL category; --> Simon Riggs <simon@2ndquadrant.com> writes: > This was supposed to be a serious suggestion, so apologies if this came > ...


Go Back   Unix Technical Forum > Database Server Software > PostgreSQL > Pgsql Patches

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #21 (permalink)  
Old 04-18-2008, 01:21 AM
Tom Lane
 
Posts: n/a
Default Re: Free WAL caches on switching segments

Simon Riggs <simon@2ndquadrant.com> writes:
> This was supposed to be a serious suggestion, so apologies if this came
> across stronger than it was meant.


If you want to have a serious discussion about it, you need to start a
thread on pghackers under a more suitable subject line. The people
reading this thread are going to be a relatively small group.

regards, tom lane

---------------------------(end of broadcast)---------------------------
TIP 6: explain analyze is your friend

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #22 (permalink)  
Old 04-18-2008, 01:21 AM
Mark Kirkwood
 
Posts: n/a
Default Re: Free WAL caches on switching segments

Tom Lane wrote:
> Mark Kirkwood <markir@paradise.net.nz> writes:
>
>>Tom Lane wrote:
>>
>>>Sounds like a recipe for ensuring it never will be tested. What's
>>>needed here is some actual tests, not preparation...

>
>
>>Does the OP have a test scenario that those of us with appropriate OS's
>>could try? Come to think of it, what are the appropriate OS's? (I see
>>NetBSD mentioned so I suppose all the *BSDs, but what others?).

>
>
> The test run by the OP was just pgbench,


Ah - right, missed that sorry.

> which is probably not the
> greatest scenario for showing the benefits of this patch, but at least
> it's neutral ground. You need a situation in which the kernel is under
> memory stress, else early free of disk cache buffers isn't going to make
> any difference whatever --- so choose a pgbench scale factor that makes
> the database noticeably larger than the test machine's RAM. Other than
> that, follow the usual guidelines for producing trustworthy pgbench
> numbers: number of clients smaller than scale factor, number of
> transactions per client at least 1000 or so (to eliminate startup
> transients), repeat test a couple times to make sure numbers are
> reproducible.
>


Thinking about this, presumably any write intensive, multi-user
benchmark would seem to be suitable, so would something like OSDL's
DBT-2 actually be better to try?

Cheers

Mark

(P.s - academic in my case, unless I try out the latest NetBSD or Linux
on one of my FreeBSD boxes....)

---------------------------(end of broadcast)---------------------------
TIP 6: explain analyze is your friend

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #23 (permalink)  
Old 04-18-2008, 01:21 AM
Tom Lane
 
Posts: n/a
Default Re: Free WAL caches on switching segments

Mark Kirkwood <markir@paradise.net.nz> writes:
> Thinking about this, presumably any write intensive, multi-user
> benchmark would seem to be suitable, so would something like OSDL's
> DBT-2 actually be better to try?


I'm certainly not wedded to pgbench, give it a try.

BTW, I forgot to mention that it would be useful to try different
wal_sync_methods along with this. The reason why it seems unlikely
the patch is useful on Linux is that the sync methods that use O_DIRECT
probably dominate using the patch anyway. There may or may not be
a similar dependence on sync method on other kernels ...

regards, tom lane

---------------------------(end of broadcast)---------------------------
TIP 5: don't forget to increase your free space map settings

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #24 (permalink)  
Old 04-18-2008, 01:24 AM
Bruce Momjian
 
Posts: n/a
Default Re: Free WAL caches on switching segments

Tom Lane wrote:
> Mark Kirkwood <markir@paradise.net.nz> writes:
> > Thinking about this, presumably any write intensive, multi-user
> > benchmark would seem to be suitable, so would something like OSDL's
> > DBT-2 actually be better to try?

>
> I'm certainly not wedded to pgbench, give it a try.
>
> BTW, I forgot to mention that it would be useful to try different
> wal_sync_methods along with this. The reason why it seems unlikely
> the patch is useful on Linux is that the sync methods that use O_DIRECT
> probably dominate using the patch anyway. There may or may not be
> a similar dependence on sync method on other kernels ...


I am thinking the only way to test this would be to do one heavy update
session to generate a lot of WAL traffic, and another session that is
doing a sequential scan on a table that fills most of the cache. It
isn't an easy test to make, which was why I was thinking we just add the
patch, but the community disagrees.

--
Bruce Momjian http://candle.pha.pa.us
SRA OSS, Inc. http://www.sraoss.com

+ If your life is a hard drive, Christ can be your backup. +

---------------------------(end of broadcast)---------------------------
TIP 9: In versions below 8.0, the planner will ignore your desire to
choose an index scan if your joining column's datatypes do not
match

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 05:39 PM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.0
www.UnixAdminTalk.com