 Monitoring a large parallel database through dynamic grouping and sequential sampling |
| To overcome the limitations in the prior art described above, and to overcome other limitations ... |
|
| Object-oriented framework for reasoning having pluggable inference engines |
| According to an embodiment of the present invention, a plurality of machine reasoning modules or ... |
|
| Memory system including guarded pointers |
| The present invention relates to several aspects of a memory system which may be used independently ... |
|
| Data access in a processor |
| What is claimed is: 1. A data processor comprising: a register memory comprising an array of M.... |
|
| Access control/crypto system |
| An access control/crypto system having a smart card reader and an access control program for ... |
|
| Method and apparatus for processing recursive hard links in a data processing system |
| The present invention provides a method and apparatus in a data system for processing a recursive ... |
|
| System and methods for synchronizing datasets when dataset changes may be received out of order |
| The present invention provides a system and methods for synchronizing information in datasets via a ... |
|
| Secure on-line PC postage metering system |
| OF THE PRESENT INVENTION A method and apparatus for providing a secure software rental system is ... |
|
|
Apparatus and method for capturing and propagating changes from an operational database to data marts
| Details |
Inventors: Mukhopadhyay, Pinaki; Nesamoney, Diaz; Sankaran, Mohan; Suresh, Sankaran; Gupta, Sanjeev K.;
Assignee: Informatica Corporation (Menlo Park, CA)
Primary Examiner: Vonbuhr; Maria N.
Assistant Examiner:
Attorney, Agent or Firm: Wagner, Murabito & Hao LLP
A method for updating a target table of a data mart in response to changes made by a transaction to data stored in a source table of an operational database. Data that was changed in the source table by the transaction is stored in a dynamic image table of a change capture database. Data that was not changed in the source table by the transaction, but which is nevertheless required to be mapped to the target table, is stored in a static image table of the change capture database. The change capture database also contains relevant information regarding the transaction. Once the dynamic and static image tables are properly staged, the changes are propagated from the change capture database to the target tables of the data marts. In other words, data is extracted from the change capture database and subsequently transformed and loaded, thereby minimizing the impact to the operational database. Thereupon, the tables of the change capture database are truncated to discard data which is now no longer needed. |
|
DETAILED DESCRIPTION The present invention pertains to an apparatus and method for efficiently capturing and propagating changes made upon the source tables of an operational database to one or more target tables of data marts, whereby the impact to the operational database is minimized.
Each source table contained within the operational database has a corresponding dynamic image table and a static image table, which are stored as part of a change capture database.
The dynamic image tables are used to store actual changes made to their respective source tables as part of a transaction.
The static image tables are used to store relevant historical data (e.
g.
, old data that has not been changed by that transaction) corresponding to their respective source tables.
The rationale behind implementing static image tables is to accommodate multiple mappings whereby the contents of one source table may be mapped to multiple target tables.
Often, historical data is necessary in order to properly execute the changes rendered by the transaction.
In the currently preferred embodiment, a change capture process is used to determine which source tables have been changed and the actual changes made to those source tables.
The actual changes are then staged in the dynamic image tables.
When the transaction rendering these changes is committed, a builder process is notified.
It is the function of the builder process to ensure that the correct data is staged in the dynamic and static image tables.
Thereupon, the data is extracted from the dynamic and static image tables, transformed, and loaded into the appropriate target tables.
Afterwards, a truncator process discards the data in the dynamic and static image tables that are now no longer needed.
Thus, in the present invention, the extraction, transformation, and loading process accesses only the change capture database without impacting the operational database.
|
| Related patents |
|
|
Method and apparatus for propagating commit times between a plurality of database servers
A method and system for removing propagation delays between a plurality of database servers that have access to a common database is provided. According to the method, ...
|
|
|
Enhanced two-phase commit protocol
To overcome the limitations in the prior art described above, and to overcome other limitations that will become apparent upon reading and understanding the present ...
|
|
|
Arbitration of state changes
The above-mentioned shortcomings, disadvantages and problems are addressed by the present invention, which will be understood by reading and studying the following ...
|
|
|
Dynamic control of magnetic tape drive
OF THE DRAWINGS In the following description, for purposes of explanation and not limitation, specific details are set forth such as particular architectures, ...
|
|
|
Intelligent processing in the context of away and offline instant messages
In one general aspect, an electronic assistant handles instant messages sent to a user when the user is away or offline. The electronic assistant may respond ...
|
|
|
Artificial intelligence trending system
These and other needs are addressed by the present invention by means of a method and system, and computer-readable media carrying instructions for controlling the ...
|
|
|
Protected shareware
To satisfy the foregoing goals, in accordance with this invention, the functionality of "protected shareware" is controlled by digitally signed messaging protocol. P...
|
|
|
Hardware and software failover services for a file server
The present application is directed to improvements to the failover services disclosed in Duso et al., U.S. application Ser. No. 08/851,507 filed May 5, 1997, issued as U...
|
|
|
Data sort method, data sort apparatus, and data sort program
The present invention aims at providing a data sort method, apparatus, and program capable of obtaining a desired sorting order value by reading records only once. An ...
|
|
|
Method and apparatus for detecting the type of interface to which a peripheral device is connected
The present invention defines a method and apparatus in the peripheral device such that the peripheral device can determine which type of interface it is connected to, ...
|
|
|
Databases 
