XML data sources are gaining popularity in the context of Business Intelligence and On-Line Analytical Processing (OLAP) applications, due to the amenities of XML in representing and managing complex and heterogeneous data. However, XML-native database systems currently suffer from limited performance, both in terms of volumes of manageable data and query response time. Therefore, recent research efforts are focusing on horizontal fragmentation techniques, which are able to overcome the above limitations. However, classical fragmentation algorithms are not suitable to control the number of originated fragments, which instead plays a critical role in data warehouses. In this paper, we propose the use of the K-means clustering algorithm for effectively and efficiently supporting the fragmentation of very large XML data warehouses. We complement our analytical contribution with a comprehensive experimental assessment where we compare the efficiency of our proposal against existing fragmentation algorithms.
Bellatreche and Boukhalfa @cite_18 apply horizontal fragmentation to data warehouse star schemas. Their fragmentation strategy is based on a reference query-workload, and it exploits a genetic algorithm to select a suitable partitioning schema among all the possible ones. Overall, the proposed approach aims at selecting an that minimizes query cost. Wu and Buchmaan @cite_2 recommend to combine horizontal and vertical fragmentation for query optimization purposes. @cite_2 , a fact table can be horizontally partitioned with respect to one or more dimensions of the data warehouse. Moreover, the fact table can also be vertically partitioned according to its dimensions, i.e. all the foreign keys to the dimensional tables are partitioned as separate tables.
@cite_18 @cite_2
1565472858 1863762422 2020396904 1986393412
The problem of selecting an optimal fragmentation schema of a data warehouse is more challenging compared to that in relational and object databases. This challenge is due to the several choices of partitioning star or snowflake schemas. Data partitioning is beneficial if and only if the fact table is fragmented based on the partitioning schemas of dimension tables. This may increase the number of fragments of the fact tables dramatically and makes their maintenance very costly. Therefore, the right selection of fragmenting schemas is important for better performance of OLAP queries. In this paper, we present a genetic algorithm for schema partitioning selection problem. The proposed algorithm gives better solutions since the search space is constrained by the schema partitioning. We conduct several experimental studies using the APB-1 release II benchmark for validating the proposed algorithm. Within the framework of the data warehouse design methodology we are developing, in this paper we investigate the problem of vertical fragmentation of relational views aimed at minimizing the global query response time. Each view includes several measures which, within the workload, are seldom requested together; thus, the system performance may be increased by partitioning the views to be materialized into smaller tables. On the other hand, drill-across queries involve measures taken from two or more views; in this case the access costs may be decreased by unifying these views into larger tables. Within the data warehouse context, the presence of redundant views makes the fragmentation problem more complex than in traditional relational databases since it requires to decide on which views each query should be executed. After formalizing the fragmentation problem as a 0-1 integer linear programming problem, we define a cost function and propose a branch-and-bound algorithm to minimize it. Finally, we demonstrate the usefulness of our approach by presenting a sample set of experimental results. A new approach to vertical fragmentation in relational databases is proposed using association rules, a data-mining technique. Vertical fragmentation can enhance the performance of database systems by reducing the number of disk accesses needed by transactions. By adapting Apriori algorithm, a design methodology for vertical partitioning is proposed. The heuristic methodology is tested using two real-life databases for various minimum support levels and minimum confidence levels. In the smaller database, the partitioning solution obtained matched the optimal solution using exhaustive enumeration. The application of our method on the larger database resulted in the partitioning solution that has an improvement of 41.05 over unpartitioned solution and took less than a second to produce the solution. We provide future research directions on extending the procedure to distributed and object-oriented database designs. In this paper, two-phase horizontal partitioning of distributed databases is addressed. First, primary horizontal fragmentation is carried out on each relation based on the predicate affinity matrix and the bond energy algorithm. This is an application of a vertical partitioning algorithm to the horizontal fragmentation problem. Second, the derived horizontal fragmentation is further performed by considering information related to the global relational database schema and its transactions. A necessary and sufficient condition for the correctness of derived fragmentations is also proved.