AWS : Database Migration Service (DMS) for Full Load / CDC

Overview:

AWS Database Migration Service is managed service. With just few configurations, this service lets you migrate the data from source DB to target DB.

Data can be migrated in following ways:

1. Real time streaming for new data/updates. Incrementally publish each new inserted/updated record from source DB to target DB.
2. Publish full load of the tables from source db to target db
3. Incremental and Full Load from source db to target db

AWS DMS Components

1. DMS Tasks: Database migration tasks are the configurations , which specifies what need to be done as part of migration e.g. Which tables are to be migrated, add new columns in the tables while migrations, populate default values in the new columns while migration. The DMS tasks can be configured to perform full load of data or capture only data changes(CDC)
2. DMS Instance : This is the machine on which the DMS tasks will execute
3. Source DB Endpoint: This endpoint points to source DB and connects DMS instance to source DB
4. Target DB Endpoint : This endpoint points to target DB and connects DMS instance to target DB
5. Source DB: This an AWS RDS DB instances or on premises DB instance
6. Target DB: This an AWS RDS DB instance

Flow: