Unix Technical Forum

Space needed to process a OLAP cube

This is a discussion on Space needed to process a OLAP cube within the SQL Server Data Warehousing forums, part of the Microsoft SQL Server category; --> Hi, Anybony knows how much free space on disk should I have to process a new OLAP cube? And, ...


Go Back   Unix Technical Forum > Database Server Software > Microsoft SQL Server > SQL Server Data Warehousing

FAQ Members List Calendar Search Today's Posts Mark Forums Read
  #1 (permalink)  
Old 02-27-2008, 06:53 PM
=?Utf-8?B?UmljaGFyZF9TUUw=?=
 
Posts: n/a
Default Space needed to process a OLAP cube

Hi,

Anybony knows how much free space on disk should I have to process a new
OLAP cube? And, if I have a processed cube and I just want to do incremental
update, how much free space on disk should I have ????

Thanks

Richard_SQL
Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #2 (permalink)  
Old 02-27-2008, 06:54 PM
Dave Wickert [MSFT]
 
Posts: n/a
Default Re: Space needed to process a OLAP cube

Look in the cube's subfolder under the data folder. You will see files for
the cube/partition. Doing an incremental update on a partition means that
the system will create a partition containing the new data; then merge that
partition with the existing data into shadow file (you will see a quote-S 'S
in the file name). When the merge commits it will delete the old partition
file and rename the shadow file to the partition file. This means that you
need enough disk space to hold:
1) the incremental data into temporary partition *and*
2) the shadow folder which is the size of the old partition + the
incremental data

Hope that helps.
--
Dave Wickert [MSFT]
dwickert@online.microsoft.com
Program Manager
BI SystemsTeam
SQL BI Product Unit (Analysis Services)
--
This posting is provided "AS IS" with no warranties, and confers no rights.

"Richard_SQL" <Richard_SQL@discussions.microsoft.com> wrote in message
news:E3CF0689-31F7-4190-A6B3-32C85A42B8E8@microsoft.com...
> Hi,
>
> Anybony knows how much free space on disk should I have to process a new
> OLAP cube? And, if I have a processed cube and I just want to do

incremental
> update, how much free space on disk should I have ????
>
> Thanks
>
> Richard_SQL



Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #3 (permalink)  
Old 02-27-2008, 06:54 PM
=?Utf-8?B?UmljaGFyZF9TUUw=?=
 
Posts: n/a
Default Re: Space needed to process a OLAP cube

What type of files can I see ??? In my data folder I have different types of
files:

-Partition data map
-Partition data
-Partition meta data
-Partition indexing meta data

Thanks for your help



"Dave Wickert [MSFT]" wrote:

> Look in the cube's subfolder under the data folder. You will see files for
> the cube/partition. Doing an incremental update on a partition means that
> the system will create a partition containing the new data; then merge that
> partition with the existing data into shadow file (you will see a quote-S 'S
> in the file name). When the merge commits it will delete the old partition
> file and rename the shadow file to the partition file. This means that you
> need enough disk space to hold:
> 1) the incremental data into temporary partition *and*
> 2) the shadow folder which is the size of the old partition + the
> incremental data
>
> Hope that helps.
> --
> Dave Wickert [MSFT]
> dwickert@online.microsoft.com
> Program Manager
> BI SystemsTeam
> SQL BI Product Unit (Analysis Services)
> --
> This posting is provided "AS IS" with no warranties, and confers no rights.
>
> "Richard_SQL" <Richard_SQL@discussions.microsoft.com> wrote in message
> news:E3CF0689-31F7-4190-A6B3-32C85A42B8E8@microsoft.com...
> > Hi,
> >
> > Anybony knows how much free space on disk should I have to process a new
> > OLAP cube? And, if I have a processed cube and I just want to do

> incremental
> > update, how much free space on disk should I have ????
> >
> > Thanks
> >
> > Richard_SQL

>
>
>

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #4 (permalink)  
Old 02-27-2008, 06:54 PM
Dave Wickert [MSFT]
 
Posts: n/a
Default Re: Space needed to process a OLAP cube

As you found, there are several files.
However, the bulk of the data is contained in the partition data files
themselves. That is what I mentioned below. Besides those, you also have the
rigid and flex aggregation files. Depending on the number of aggregations
they will grow also . . . I would look at the data files first since those
are straightforward. Once you have the estimates in hand for those files,
then look at the aggregations. They would only grow significantly if the
aggregation sizes increase. For an overview of what is contained in an
aggregations, look at the AS Performance Guide
http://www.microsoft.com/technet/pro.../ansvcspg.mspx
in the sections titled "Understanding an Aggregation and How It is Used" and
"Understanding Aggregation Design Tools"

Hope that helps.
--
Dave Wickert [MSFT]
dwickert@online.microsoft.com
Program Manager
BI SystemsTeam
SQL BI Product Unit (Analysis Services)
--
This posting is provided "AS IS" with no warranties, and confers no rights.

"Richard_SQL" <Richard_SQL@discussions.microsoft.com> wrote in message
news:40565072-D3E9-4546-9231-2F1BCA6896D2@microsoft.com...
> What type of files can I see ??? In my data folder I have different types

of
> files:
>
> -Partition data map
> -Partition data
> -Partition meta data
> -Partition indexing meta data
>
> Thanks for your help
>
>
>
> "Dave Wickert [MSFT]" wrote:
>
> > Look in the cube's subfolder under the data folder. You will see files

for
> > the cube/partition. Doing an incremental update on a partition means

that
> > the system will create a partition containing the new data; then merge

that
> > partition with the existing data into shadow file (you will see a

quote-S 'S
> > in the file name). When the merge commits it will delete the old

partition
> > file and rename the shadow file to the partition file. This means that

you
> > need enough disk space to hold:
> > 1) the incremental data into temporary partition *and*
> > 2) the shadow folder which is the size of the old partition + the
> > incremental data
> >
> > Hope that helps.
> > --
> > Dave Wickert [MSFT]
> > dwickert@online.microsoft.com
> > Program Manager
> > BI SystemsTeam
> > SQL BI Product Unit (Analysis Services)
> > --
> > This posting is provided "AS IS" with no warranties, and confers no

rights.
> >
> > "Richard_SQL" <Richard_SQL@discussions.microsoft.com> wrote in message
> > news:E3CF0689-31F7-4190-A6B3-32C85A42B8E8@microsoft.com...
> > > Hi,
> > >
> > > Anybony knows how much free space on disk should I have to process a

new
> > > OLAP cube? And, if I have a processed cube and I just want to do

> > incremental
> > > update, how much free space on disk should I have ????
> > >
> > > Thanks
> > >
> > > Richard_SQL

> >
> >
> >



Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
  #5 (permalink)  
Old 02-27-2008, 06:54 PM
=?Utf-8?B?UmljaGFyZF9TUUw=?=
 
Posts: n/a
Default Re: Space needed to process a OLAP cube

Thanks a lot... I appreciate that.

Best Regards

"Dave Wickert [MSFT]" wrote:

> As you found, there are several files.
> However, the bulk of the data is contained in the partition data files
> themselves. That is what I mentioned below. Besides those, you also have the
> rigid and flex aggregation files. Depending on the number of aggregations
> they will grow also . . . I would look at the data files first since those
> are straightforward. Once you have the estimates in hand for those files,
> then look at the aggregations. They would only grow significantly if the
> aggregation sizes increase. For an overview of what is contained in an
> aggregations, look at the AS Performance Guide
> http://www.microsoft.com/technet/pro.../ansvcspg.mspx
> in the sections titled "Understanding an Aggregation and How It is Used" and
> "Understanding Aggregation Design Tools"
>
> Hope that helps.
> --
> Dave Wickert [MSFT]
> dwickert@online.microsoft.com
> Program Manager
> BI SystemsTeam
> SQL BI Product Unit (Analysis Services)
> --
> This posting is provided "AS IS" with no warranties, and confers no rights.
>
> "Richard_SQL" <Richard_SQL@discussions.microsoft.com> wrote in message
> news:40565072-D3E9-4546-9231-2F1BCA6896D2@microsoft.com...
> > What type of files can I see ??? In my data folder I have different types

> of
> > files:
> >
> > -Partition data map
> > -Partition data
> > -Partition meta data
> > -Partition indexing meta data
> >
> > Thanks for your help
> >
> >
> >
> > "Dave Wickert [MSFT]" wrote:
> >
> > > Look in the cube's subfolder under the data folder. You will see files

> for
> > > the cube/partition. Doing an incremental update on a partition means

> that
> > > the system will create a partition containing the new data; then merge

> that
> > > partition with the existing data into shadow file (you will see a

> quote-S 'S
> > > in the file name). When the merge commits it will delete the old

> partition
> > > file and rename the shadow file to the partition file. This means that

> you
> > > need enough disk space to hold:
> > > 1) the incremental data into temporary partition *and*
> > > 2) the shadow folder which is the size of the old partition + the
> > > incremental data
> > >
> > > Hope that helps.
> > > --
> > > Dave Wickert [MSFT]
> > > dwickert@online.microsoft.com
> > > Program Manager
> > > BI SystemsTeam
> > > SQL BI Product Unit (Analysis Services)
> > > --
> > > This posting is provided "AS IS" with no warranties, and confers no

> rights.
> > >
> > > "Richard_SQL" <Richard_SQL@discussions.microsoft.com> wrote in message
> > > news:E3CF0689-31F7-4190-A6B3-32C85A42B8E8@microsoft.com...
> > > > Hi,
> > > >
> > > > Anybony knows how much free space on disk should I have to process a

> new
> > > > OLAP cube? And, if I have a processed cube and I just want to do
> > > incremental
> > > > update, how much free space on disk should I have ????
> > > >
> > > > Thanks
> > > >
> > > > Richard_SQL
> > >
> > >
> > >

>
>
>

Digg this Post!Add Post to del.icio.usBookmark Post in TechnoratiFurl this Post!
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On
Forum Jump


All times are GMT. The time now is 04:38 AM.


Powered by vBulletin® Version 3.6.5
Copyright ©2000 - 2008, Jelsoft Enterprises Ltd.
SEO by vBSEO 3.2.0
www.UnixAdminTalk.com