Data migration flow

Mon, 01 Jan 0001 00:00:00 +0000

Data migration flow

The data migration flow diagram illustrates the end-to-end flow of data during data migration and integration, highlighting key components and how data is processed from sources to targets.

Source

Data from a source is collected and processed using queries for database-related sources and external API calls for other types of data.

The following are the supported data sources:

DB table — Structured data stored in a database table.
DB query — Data retrieved from SQL queries.
Text file — Data stored in flat files, such as CSV files.
Service file — Data in various service-oriented formats, such as XML.

DIH core processes

DIH handles the following tasks to migrate and integrate data:

Control Tables

Mon, 01 Jan 0001 00:00:00 +0000

Control Tables

Overview

As mentioned in other sections, a conversion run is usually divided into two parts:

Convert all the data in the staging schema, STGADM.
Copy the converted data from the staging to the production schema, CISADM.

These two steps can be repeated many times, so both activities should be repeatable individually and when executed together. The data conversion could be executed many times before the second step. Additionally, the copy-to-production process should also be repeatable to accommodate issues that might arise with the copy and place the previously copied data if the first step is repeated after the second step.

Database Migration on RIA Docs

Data migration flow