Scribd
Upload
4 views

AWS Database Migration Service

Uploaded by

Srikar Ganesh
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
4 views

AWS Database Migration Service

Uploaded by

Srikar Ganesh
Copyright
© © All Rights Reserved
Available Formats
Download as PPTX, PDF, TXT or read online on Scribd
You are on page 1/ 17

AWS Database Migration Service

• AWS Database Migration Service (DMS) is a fully managed service


that helps organizations migrate their databases to AWS quickly and
securely.
• It supports both homogeneous migrations (e.g., Oracle to Oracle,
MySQL to MySQL) and heterogeneous migrations (e.g., Oracle to
Amazon Aurora, SQL Server to MySQL).
• DMS is designed to be reliable, scalable, and easy to use, making it
ideal for various database migration scenarios.
Key Features of AWS DMS
• Continuous Data Replication:

• Minimal Downtime: DMS supports continuous data replication,


allowing you to keep your source database operational during
migration with minimal downtime.
• This is beneficial for applications that need to remain available
during the migration process.
• Change Data Capture (CDC): DMS captures changes to the
source database and applies them in near real-time to the target
database to keep data synchronized.
Key Features of AWS DMS
Change Data Capture

• Initial Full Load: DMS first performs a full data load from the source
database to the target.
• Enabling Change Data Capture: After the initial load, CDC keeps track
of ongoing changes by capturing updates, inserts, and deletes as
transactions occur on the source database.
• Log-Based CDC: CDC relies on database logs (e.g., MySQL binlog,
Oracle redo logs) to capture changes. The source database must be set
up to allow DMS access to these logs, which it reads to identify and
transfer data changes.
Key Features of AWS DMS
• Change Data Capture

• The MySQL binlog records all changes made to the MySQL


database, including INSERT, UPDATE, and DELETE statements
• Low Latency: CDC enables near-real-time replication because
changes are usually transferred soon after they occur, depending on
network conditions and database load.
• Supported Databases: CDC is available for a variety of databases,
including Amazon Aurora, PostgreSQL, MySQL, Oracle, SQL
Server, and others.
Key Features of AWS DMS
• Wide Range of Supported Databases:

• Source and Target Compatibility: AWS DMS supports popular


database engines, including Amazon Aurora, PostgreSQL, MySQL,
MariaDB, Oracle, SQL Server, and more. It also supports migrating
to Amazon S3, Amazon Redshift, and Amazon DynamoDB.
• Heterogeneous and Homogeneous Migrations: Whether you're
moving between the same database engines or different ones (e.g.,
Oracle to MySQL), DMS can handle it.
Key Features of AWS DMS
• Ease of Use:

• User-Friendly Console: DMS has a straightforward management


console that guides you through setting up and managing database
migration tasks.
• Pre-configured Templates: You can use templates to create
migration tasks quickly.
Key Features of AWS DMS
• Data Transformation:
• Schema Conversion: When migrating between different database
engines, AWS DMS can work with the AWS Schema Conversion
Tool (SCT) to convert database schema and code to a compatible
format on the target database.
• It is especially useful when migrating from one database engine to
another (heterogeneous migration), like moving from Oracle or SQL
Server to Amazon Aurora or Amazon RDS MySQL
• AWS SCT automatically converts the source database schema
(tables, indexes, views, stored procedures, functions, and other
database objects) into the format used by the target database
engine.
Typical Workflow for Using AWS SCT
• Assessment: Start with an assessment report in AWS SCT to
understand the compatibility and complexity of migration.
• Schema Conversion: Use AWS SCT to automatically convert the source
schema to the target database format.
• Manual Adjustments: Address any manual changes or optimizations
needed based on the assessment.
• Data Migration: Use AWS DMS to migrate the actual data from the
source database to the target database, with the option to enable CDC.
• Validation: Verify the migrated schema and data integrity in the target
database to ensure consistency.
Key Features of AWS DMS
• Data Filtering and Mapping: DMS allows data
transformations by filtering specific data to include or exclude
and mapping columns to fit the target schema.
• Filtering by Table or Schema: AWS DMS lets you specify
which tables or schemas to include in the migration.
• For example, you can migrate only a subset of tables from a
schema by listing them specifically in the migration task.
Key Features of AWS DMS
• Row-Level Filtering:

• DMS allows you to filter data at the row level by defining


conditions based on column values. For example, you can
migrate only recent records by specifying a filter condition:
• WHERE order_date >= '2024-01-01'

• Conditional Expressions:You can use SQL-like conditional


expressions within DMS tasks to define complex filter criteria.
For instance, to migrate orders over a certain amount:
• WHERE order_amount > 100
Key Features of AWS DMS
• Column Mapping:
• AWS DMS enables you to rename columns during migration to align
with the target database schema or follow naming conventions.
• Rename column "cust_id" to "customer_id"
• Data Type Mapping:
• AWS DMS can automatically map data types from the source database
to the target database when there are equivalent types available.
• e.g., converting VARCHAR to TEXT in databases with differing type
systems.
Key Features of AWS DMS
• Scalability and Resilience:

• Scalable: The service can handle databases of any size, from small
to enterprise-scale.
• High Availability: You can enable Multi-AZ deployments for DMS to
provide high availability and fault tolerance for critical migrations.
Common Use Cases for AWS DMS
• Database Migration:
• On-Premises to AWS: Migrating on-premises databases to Amazon
RDS or Amazon Aurora.
• Cloud-to-Cloud: Moving databases from other cloud providers to
AWS.
• Database Consolidation: Organizations with multiple databases
can use DMS to consolidate them into a single database engine to
simplify management.
Common Use Cases for AWS DMS
• Data Replication for Analytics: Replicating data from operational
databases to Amazon Redshift or Amazon S3 for analytics and
reporting.
• Backup and Disaster Recovery: Using DMS for replicating data
from production databases to AWS for backup purposes and
ensuring quick recovery in case of an outage.
Steps to Use AWS DMS
• Set Up the Source and Target: Ensure that both the source database
(e.g., an on-premises Oracle database) and the target database (e.g.,
Amazon RDS) are configured and accessible by DMS.
• Create a Replication Instance: Set up a replication instance within
AWS DMS to facilitate the migration process. This instance handles data
movement between the source and target databases.
• Configure Source and Target Endpoints: Define and test the
endpoints for both source and target databases within the DMS console.
• Create a Migration Task: Specify the migration type (full load, full load
with ongoing replication, or change data capture).
• Configure any necessary data transformation rules or filters.
Steps to Use AWS DMS
• Monitor and Optimize: Use AWS CloudWatch to monitor the
performance of the migration and track progress.
• Adjust migration task settings as needed for optimal performance.

• Validation: After the migration is complete, validate that the data


has been transferred accurately and that the target database is
functioning as expected.
Benefits of AWS DMS
• Cost-Effective: You only pay for the replication instance and any
additional storage used during the migration.
• Reliable and Secure: Data migration with DMS is encrypted,
ensuring data security during transit.
• Simple Setup: DMS is designed for quick configuration, enabling
faster database migrations compared to traditional methods.
• Automated Failover: With Multi-AZ, migrations have built-in
redundancy for high availability.

You might also like