This is a discussion on Space needed to process a OLAP cube within the SQL Server Data Warehousing forums, part of the Microsoft SQL Server category; --> Hi, Anybony knows how much free space on disk should I have to process a new OLAP cube? And, ...
| |||||||
| FAQ | Members List | Calendar | Search | Today's Posts | Mark Forums Read |
| ||||
| Hi, Anybony knows how much free space on disk should I have to process a new OLAP cube? And, if I have a processed cube and I just want to do incremental update, how much free space on disk should I have ???? Thanks Richard_SQL |
| |||
| Look in the cube's subfolder under the data folder. You will see files for the cube/partition. Doing an incremental update on a partition means that the system will create a partition containing the new data; then merge that partition with the existing data into shadow file (you will see a quote-S 'S in the file name). When the merge commits it will delete the old partition file and rename the shadow file to the partition file. This means that you need enough disk space to hold: 1) the incremental data into temporary partition *and* 2) the shadow folder which is the size of the old partition + the incremental data Hope that helps. -- Dave Wickert [MSFT] dwickert@online.microsoft.com Program Manager BI SystemsTeam SQL BI Product Unit (Analysis Services) -- This posting is provided "AS IS" with no warranties, and confers no rights. "Richard_SQL" <Richard_SQL@discussions.microsoft.com> wrote in message news:E3CF0689-31F7-4190-A6B3-32C85A42B8E8@microsoft.com... > Hi, > > Anybony knows how much free space on disk should I have to process a new > OLAP cube? And, if I have a processed cube and I just want to do incremental > update, how much free space on disk should I have ???? > > Thanks > > Richard_SQL |
| |||
| What type of files can I see ??? In my data folder I have different types of files: -Partition data map -Partition data -Partition meta data -Partition indexing meta data Thanks for your help "Dave Wickert [MSFT]" wrote: > Look in the cube's subfolder under the data folder. You will see files for > the cube/partition. Doing an incremental update on a partition means that > the system will create a partition containing the new data; then merge that > partition with the existing data into shadow file (you will see a quote-S 'S > in the file name). When the merge commits it will delete the old partition > file and rename the shadow file to the partition file. This means that you > need enough disk space to hold: > 1) the incremental data into temporary partition *and* > 2) the shadow folder which is the size of the old partition + the > incremental data > > Hope that helps. > -- > Dave Wickert [MSFT] > dwickert@online.microsoft.com > Program Manager > BI SystemsTeam > SQL BI Product Unit (Analysis Services) > -- > This posting is provided "AS IS" with no warranties, and confers no rights. > > "Richard_SQL" <Richard_SQL@discussions.microsoft.com> wrote in message > news:E3CF0689-31F7-4190-A6B3-32C85A42B8E8@microsoft.com... > > Hi, > > > > Anybony knows how much free space on disk should I have to process a new > > OLAP cube? And, if I have a processed cube and I just want to do > incremental > > update, how much free space on disk should I have ???? > > > > Thanks > > > > Richard_SQL > > > |
| |||
| As you found, there are several files. However, the bulk of the data is contained in the partition data files themselves. That is what I mentioned below. Besides those, you also have the rigid and flex aggregation files. Depending on the number of aggregations they will grow also . . . I would look at the data files first since those are straightforward. Once you have the estimates in hand for those files, then look at the aggregations. They would only grow significantly if the aggregation sizes increase. For an overview of what is contained in an aggregations, look at the AS Performance Guide http://www.microsoft.com/technet/pro.../ansvcspg.mspx in the sections titled "Understanding an Aggregation and How It is Used" and "Understanding Aggregation Design Tools" Hope that helps. -- Dave Wickert [MSFT] dwickert@online.microsoft.com Program Manager BI SystemsTeam SQL BI Product Unit (Analysis Services) -- This posting is provided "AS IS" with no warranties, and confers no rights. "Richard_SQL" <Richard_SQL@discussions.microsoft.com> wrote in message news:40565072-D3E9-4546-9231-2F1BCA6896D2@microsoft.com... > What type of files can I see ??? In my data folder I have different types of > files: > > -Partition data map > -Partition data > -Partition meta data > -Partition indexing meta data > > Thanks for your help > > > > "Dave Wickert [MSFT]" wrote: > > > Look in the cube's subfolder under the data folder. You will see files for > > the cube/partition. Doing an incremental update on a partition means that > > the system will create a partition containing the new data; then merge that > > partition with the existing data into shadow file (you will see a quote-S 'S > > in the file name). When the merge commits it will delete the old partition > > file and rename the shadow file to the partition file. This means that you > > need enough disk space to hold: > > 1) the incremental data into temporary partition *and* > > 2) the shadow folder which is the size of the old partition + the > > incremental data > > > > Hope that helps. > > -- > > Dave Wickert [MSFT] > > dwickert@online.microsoft.com > > Program Manager > > BI SystemsTeam > > SQL BI Product Unit (Analysis Services) > > -- > > This posting is provided "AS IS" with no warranties, and confers no rights. > > > > "Richard_SQL" <Richard_SQL@discussions.microsoft.com> wrote in message > > news:E3CF0689-31F7-4190-A6B3-32C85A42B8E8@microsoft.com... > > > Hi, > > > > > > Anybony knows how much free space on disk should I have to process a new > > > OLAP cube? And, if I have a processed cube and I just want to do > > incremental > > > update, how much free space on disk should I have ???? > > > > > > Thanks > > > > > > Richard_SQL > > > > > > |
| ||||
| Thanks a lot... I appreciate that. Best Regards "Dave Wickert [MSFT]" wrote: > As you found, there are several files. > However, the bulk of the data is contained in the partition data files > themselves. That is what I mentioned below. Besides those, you also have the > rigid and flex aggregation files. Depending on the number of aggregations > they will grow also . . . I would look at the data files first since those > are straightforward. Once you have the estimates in hand for those files, > then look at the aggregations. They would only grow significantly if the > aggregation sizes increase. For an overview of what is contained in an > aggregations, look at the AS Performance Guide > http://www.microsoft.com/technet/pro.../ansvcspg.mspx > in the sections titled "Understanding an Aggregation and How It is Used" and > "Understanding Aggregation Design Tools" > > Hope that helps. > -- > Dave Wickert [MSFT] > dwickert@online.microsoft.com > Program Manager > BI SystemsTeam > SQL BI Product Unit (Analysis Services) > -- > This posting is provided "AS IS" with no warranties, and confers no rights. > > "Richard_SQL" <Richard_SQL@discussions.microsoft.com> wrote in message > news:40565072-D3E9-4546-9231-2F1BCA6896D2@microsoft.com... > > What type of files can I see ??? In my data folder I have different types > of > > files: > > > > -Partition data map > > -Partition data > > -Partition meta data > > -Partition indexing meta data > > > > Thanks for your help > > > > > > > > "Dave Wickert [MSFT]" wrote: > > > > > Look in the cube's subfolder under the data folder. You will see files > for > > > the cube/partition. Doing an incremental update on a partition means > that > > > the system will create a partition containing the new data; then merge > that > > > partition with the existing data into shadow file (you will see a > quote-S 'S > > > in the file name). When the merge commits it will delete the old > partition > > > file and rename the shadow file to the partition file. This means that > you > > > need enough disk space to hold: > > > 1) the incremental data into temporary partition *and* > > > 2) the shadow folder which is the size of the old partition + the > > > incremental data > > > > > > Hope that helps. > > > -- > > > Dave Wickert [MSFT] > > > dwickert@online.microsoft.com > > > Program Manager > > > BI SystemsTeam > > > SQL BI Product Unit (Analysis Services) > > > -- > > > This posting is provided "AS IS" with no warranties, and confers no > rights. > > > > > > "Richard_SQL" <Richard_SQL@discussions.microsoft.com> wrote in message > > > news:E3CF0689-31F7-4190-A6B3-32C85A42B8E8@microsoft.com... > > > > Hi, > > > > > > > > Anybony knows how much free space on disk should I have to process a > new > > > > OLAP cube? And, if I have a processed cube and I just want to do > > > incremental > > > > update, how much free space on disk should I have ???? > > > > > > > > Thanks > > > > > > > > Richard_SQL > > > > > > > > > > > > |