Unix Technical Forum

bigger blob rows?

This is a discussion on bigger blob rows? within the Pgsql General forums, part of the PostgreSQL category; --> Back in the days of 7.4.2, we tried storing large blobs (1GB+) in postgres but found them too slow ...


Go Back   Unix Technical Forum > Database Server Software > PostgreSQL > Pgsql General

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 04-09-2008, 07:55 AM
Eric Davies
 
Posts: n/a
Default bigger blob rows?

Back in the days of 7.4.2, we tried storing large blobs (1GB+) in
postgres but found them too slow because the blob was being chopped
into 2K rows stored in some other table.
However, it has occurred to us that if it was possible to configure
the server to split blobs into bigger pieces, say 32K, our speed
problems might diminish correspondingly.
Is there a compile time constant or a run time configuration entry
that accomplish this?

Thank you.

**********************************************
Eric Davies, M.Sc.
Barrodale Computing Services Ltd.
Tel: (250) 472-4372 Fax: (250) 472-4373
Web: http://www.barrodale.com
Email: eric@barrodale.com
**********************************************
Mailing Address:
P.O. Box 3075 STN CSC
Victoria BC Canada V8W 3W2

Shipping Address:
Hut R, McKenzie Avenue
University of Victoria
Victoria BC Canada V8W 3W2
**********************************************



Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 04-09-2008, 07:55 AM
Doug McNaught
 
Posts: n/a
Default Re: bigger blob rows?

Eric Davies <Eric@barrodale.com> writes:

> Back in the days of 7.4.2, we tried storing large blobs (1GB+) in
> postgres but found them too slow because the blob was being chopped
> into 2K rows stored in some other table.
> However, it has occurred to us that if it was possible to configure
> the server to split blobs into bigger pieces, say 32K, our speed
> problems might diminish correspondingly.
> Is there a compile time constant or a run time configuration entry
> that accomplish this?


I *think* the limit would be 8k (the size of a PG page) even if you
could change it. Upping that would require recompiling with PAGE_SIZE
set larger, which would have a lot of other consequences.

-Doug

---------------------------(end of broadcast)---------------------------
TIP 6: explain analyze is your friend

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 04-09-2008, 07:55 AM
Volkan YAZICI
 
Posts: n/a
Default Re: bigger blob rows?

On Jan 18 09:00, Eric Davies wrote:
> Back in the days of 7.4.2, we tried storing large blobs (1GB+) in
> postgres but found them too slow because the blob was being chopped
> into 2K rows stored in some other table.
> However, it has occurred to us that if it was possible to configure
> the server to split blobs into bigger pieces, say 32K, our speed
> problems might diminish correspondingly.
> Is there a compile time constant or a run time configuration entry
> that accomplish this?


include/storage/large_object.h:64: #define LOBLKSIZE (BLCKSZ / 4)
include/pg_config_manual.h:26: #define BLCKSZ 8192


HTH.
Regards.

---------------------------(end of broadcast)---------------------------
TIP 6: explain analyze is your friend

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 02:28 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.0
www.UnixAdminTalk.com