Unix Technical Forum

Re: Getting even more insert performance (250m+rows/day)

This is a discussion on Re: Getting even more insert performance (250m+rows/day) within the Pgsql Performance forums, part of the PostgreSQL category; --> Daniel J. Luke wrote: > On May 24, 2006, at 4:12 PM, Larry Rosenman wrote: >> are the batches ...


Go Back   Unix Technical Forum > Database Server Software > PostgreSQL > Pgsql Performance

Register FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 04-19-2008, 07:51 AM
Larry Rosenman
 
Posts: n/a
Default Re: Getting even more insert performance (250m+rows/day)

Daniel J. Luke wrote:
> On May 24, 2006, at 4:12 PM, Larry Rosenman wrote:
>> are the batches single insert's, or within a big transaction?
>> If the former, the latter is a big win.

>
> One big transaction every 5 minutes using 'COPY FROM' (instead of
> inserts).
>
>> Also, what release(s) are you running?

>
> 8.1.x (I think we're upgrading from 8.1.3 to 8.1.4 today).
>

Had to ask

Also, is pg_xlog on the same or different spindles from the rest of the
PG Data directory?

LER

--
Larry Rosenman
Database Support Engineer

PERVASIVE SOFTWARE. INC.
12365B RIATA TRACE PKWY
3015
AUSTIN TX 78727-6531

Tel: 512.231.6173
Fax: 512.231.6597
Email: Larry.Rosenman@pervasive.com
Web: www.pervasive.com

---------------------------(end of broadcast)---------------------------
TIP 5: don't forget to increase your free space map settings

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 04-19-2008, 07:51 AM
Daniel J. Luke
 
Posts: n/a
Default Re: Getting even more insert performance (250m+rows/day)

On May 24, 2006, at 4:24 PM, Larry Rosenman wrote:
> Also, is pg_xlog on the same or different spindles from the rest of
> the
> PG Data directory?


It's sitting on the same disk array (but I'm doing 1 transaction
every 5 minutes, and I'm not near the array's sustained write
capacity, so I don't think that's currently limiting performance).

--
Daniel J. Luke
+================================================= =======+
| *---------------- dluke@geeklair.net ----------------* |
| *-------------- http://www.geeklair.net -------------* |
+================================================= =======+
| Opinions expressed are mine and do not necessarily |
| reflect the opinions of my employer. |
+================================================= =======+



-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.3 (Darwin)

iD8DBQFEdMImjUs5tAKawAoRAi30AJsGbTRtdSK54blhAnNRVU em/Ium6QCfcibS
Uawk3giuLLGSIGB7bADa2WI=
=3Ix3
-----END PGP SIGNATURE-----

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 06:35 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.0
www.UnixAdminTalk.com