Intuition and Decision Making
Decision making based on intuition is characterized by the use of hunches, inner feelings, or the”gut feeling” of the person reaching the decision. Suggestions, influences, preferences, and the psychological makeup ofthe deciding individual play an important part; the subjective element is vital. It is believed by many that the intuitive decider has more “precognitive” ability [...]
Determining the Archive Cycle
The most important figure that needs to be decided is the archive cycle or frequency. How often is data archived? Even if data is loaded daily, you may not want to run archiving on a daily cycle. It is often better to use a longer cycle, such as a week, a month, or even a [...]
User Access To Data
The query manager is the software interface between the users and the data. It presents the data to the users in a form they understand. The query manager also controls the user access to the data. In a data warehouse, the raw data will often be an amalgamation of data from many disparate data sources. [...]
Query Scheduling in a Data Warehouse
Scheduling of ad hoc queries is a responsibility of the query manager. Simultaneous large ad hoc queries, if not controlled, can severely affect the performance of any system: in particular if the queries are run using parallelism, where a single query can potentially use all the CPU resource made available to it. Typically this will [...]
Database - Data Life Expectancy
The data life expectancy is the amount of time that data is expected to remain in the database. You need to establish the requirement for how long fact data needs to be held online at the fact level. Older fact data can often be held online in aggregated form, reducing the amount of space it [...]
Data Archiving in a Data Warehouse
As data ages, it will need to be purged to clear room for more current data. There is often a desire to hold data online for long periods of time, but usually the practicalities of working with such huge volumes of data dictate a reasonable cutoff point. Most companies have a natural cycle of data [...]
Performance Monitoring And Tuning
The warehouse manager is responsible for monitoring the performance of any operation it runs. It should also manage the storage of the performance statistics produced by the query manager. These statistics, along with the query history of all queries, should be stored in the database, so that they can be analyzed.
These statistics need to be [...]
Metadata Management
The warehouse manager is responsible for managing the metadata. Metadata is used to describe the data that resides within the data warehouse; it also describes where each piece of data resides. If new data is loaded, old data is archived or current data is moved within the data warehouse, meta data needs to be generated [...]
Query Scheduling and Monitoring
The query manager has several distinct responsibilities which are used to control various functions such as user access to the data, query scheduling and query monitoring. These areas are all very different in nature, and each area requires its own tools, bespoke software and procedures. The query manager is one. of the most bespoke pieces [...]
The Best Warehouse Manager Software
There is no warehouse manager software currently on the market that can .do this automatically, which means that human input is required. One suggestion to work around this problem is to allow a program or procedure to be associated with each aggregation. If one exists, the warehouse manager can use it instead of directly generating [...]