Unix Technical Forum

postgresql cluster on SAN

This is a discussion on postgresql cluster on SAN within the pgsql Admins forums, part of the PostgreSQL category; --> Hi, Can i create create a cluster of postgresql server by sharing the database file on a SAN? I ...


Go Back   Unix Technical Forum > Database Server Software > PostgreSQL > pgsql Admins

Register FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 04-10-2008, 05:16 AM
Robert Ngo
 
Posts: n/a
Default postgresql cluster on SAN

Hi,

Can i create create a cluster of postgresql server by sharing the
database file on a SAN? I am also looking into slony but slony replicate
data to each server and my database will potentially have terabytes of
data. I am thinking about a solution where a cluster of database server
will share database files on SAN, can this be done? I am also looking
for a load balancing salution for the postgresql database. Any sugestion?



---------------------------(end of broadcast)---------------------------
TIP 9: In versions below 8.0, the planner will ignore your desire to
choose an index scan if your joining column's datatypes do not
match

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 04-10-2008, 05:16 AM
Chris Browne
 
Posts: n/a
Default Re: postgresql cluster on SAN

robertngo@perridot.com (Robert Ngo) writes:
> Can i create create a cluster of postgresql server by sharing the
> database file on a SAN? I am also looking into slony but slony replicate
> data to each server and my database will potentially have terabytes of
> data. I am thinking about a solution where a cluster of database server
> will share database files on SAN, can this be done? I am also looking
> for a load balancing salution for the postgresql database. Any sugestion?


What you wish can NOT be done.

There can only be ONE postmaster for each database cluster; you can
NOT have multiple servers sharing a single cluster.
--
(reverse (concatenate 'string "gro.gultn" "@" "enworbbc"))
http://cbbrowne.com/info/internet.html
"The real romance is out ahead and yet to come. The computer
revolution hasn't started yet. Don't be misled by the enormous flow of
money into bad defacto standards for unsophisticated buyers using poor
adaptations of incomplete ideas." -- Alan Kay
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 04-10-2008, 05:16 AM
Robert Ngo
 
Posts: n/a
Default Re: postgresql cluster on SAN

Robert Ngo wrote:

> Chris Browne wrote:
>
>> robertngo@perridot.com (Robert Ngo) writes:
>>
>>
>>> Can i create create a cluster of postgresql server by sharing the
>>> database file on a SAN? I am also looking into slony but slony
>>> replicate
>>> data to each server and my database will potentially have terabytes of
>>> data. I am thinking about a solution where a cluster of database server
>>> will share database files on SAN, can this be done? I am also looking
>>> for a load balancing salution for the postgresql database. Any
>>> sugestion?
>>>

>>
>>
>> What you wish can NOT be done.
>>
>> There can only be ONE postmaster for each database cluster; you can
>> NOT have multiple servers sharing a single cluster.
>>
>>

> so there is no ways for the file storage to be shared between postgres
> cluster? Then i will need to add a huge amount of storage every time
> new server is added.
>

Is there any way i can reduce the storage requirement of the database
server cluster?

---------------------------(end of broadcast)---------------------------
TIP 5: don't forget to increase your free space map settings

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old 04-10-2008, 05:16 AM
Chris Browne
 
Posts: n/a
Default Re: postgresql cluster on SAN

robertngo@perridot.com (Robert Ngo) writes:

> Robert Ngo wrote:
>
>> Chris Browne wrote:
>>
>>> robertngo@perridot.com (Robert Ngo) writes:
>>>
>>>
>>>> Can i create create a cluster of postgresql server by sharing the
>>>> database file on a SAN? I am also looking into slony but slony
>>>> replicate
>>>> data to each server and my database will potentially have terabytes of
>>>> data. I am thinking about a solution where a cluster of database server
>>>> will share database files on SAN, can this be done? I am also looking
>>>> for a load balancing salution for the postgresql database. Any
>>>> sugestion?
>>>>
>>>
>>>
>>> What you wish can NOT be done.
>>>
>>> There can only be ONE postmaster for each database cluster; you can
>>> NOT have multiple servers sharing a single cluster.
>>>

>> so there is no ways for the file storage to be shared between
>> postgres cluster? Then i will need to add a huge amount of storage
>> every time new server is added.
>>

> Is there any way i can reduce the storage requirement of the database
> server cluster?


Well, the base amount of storage for each instance is only about 26MB.

sh-3.00$ /opt/OXRS/dbs/pgsql8/bin/initdb -D .
Success. You can now start the database server using:

/opt/OXRS/dbs/pgsql8/bin/postmaster -D .
or
/opt/OXRS/dbs/pgsql8/bin/pg_ctl -D . -l logfile start

sh-3.00$ du
176 ./global
4 ./pg_xlog/archive_status
16412 ./pg_xlog
12 ./pg_clog
12 ./pg_subtrans
4640 ./base/1
4704 ./base/17229
9348 ./base
4 ./pg_tblspc
25992 .
sh-3.00$

For any sort of interesting-sized database, this bit of overhead,
which is mostly WAL files, doesn't strike me as being terribly
material. I can't see 26MB being considered "huge" in a SAN context.

You only need additional storage (beyond that) when your applications
are actually requesting to store data. There is no magical way to
avoid that need for additional storage.
--
let name="cbbrowne" and tld="acm.org" in name ^ "@" ^ tld;;
http://cbbrowne.com/info/languages.html
"The newsreader abuse likely stems from more fundamental, than merely
just the UI, design disagreements. Requests from Unix programmers to
replicate Free Agent rightfully so should trigger the throwing of
sharp heavy objects at the requesting party."
-- jedi@dementia.mishnet (jedi)
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old 04-10-2008, 05:17 AM
Chris Travers
 
Posts: n/a
Default Re: postgresql cluster on SAN

Robert Ngo wrote:

> Robert Ngo wrote:
>
>> Chris Browne wrote:
>>
>>> robertngo@perridot.com (Robert Ngo) writes:
>>>
>>>
>>>> Can i create create a cluster of postgresql server by sharing the
>>>> database file on a SAN? I am also looking into slony but slony
>>>> replicate
>>>> data to each server and my database will potentially have terabytes of
>>>> data. I am thinking about a solution where a cluster of database
>>>> server
>>>> will share database files on SAN, can this be done? I am also looking
>>>> for a load balancing salution for the postgresql database. Any
>>>> sugestion?
>>>>
>>>
>>>
>>>
>>> What you wish can NOT be done.
>>>
>>> There can only be ONE postmaster for each database cluster; you can
>>> NOT have multiple servers sharing a single cluster.
>>>
>>>

>> so there is no ways for the file storage to be shared between
>> postgres cluster? Then i will need to add a huge amount of storage
>> every time new server is added.
>>

> Is there any way i can reduce the storage requirement of the database
> server cluster?


Maybe you can provide us with more information on your environment,
application, expected load, etc. so we can help you explore other
possibilities.
Best Wishes,
Chris Travers


---------------------------(end of broadcast)---------------------------
TIP 9: In versions below 8.0, the planner will ignore your desire to
choose an index scan if your joining column's datatypes do not
match

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 02:36 PM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.0
www.UnixAdminTalk.com