Migrating databases in AWS - Data Pipeline vs DMS vs SCT - AWS Certification Cheat Sheet

Let’s get a quick overview of different options in migrating databases from/to AWS - Data Pipeline vs Database Migration Service DMS vs Schema Conversion Tool SCT.

You will learn

  • What is different options in migrating databases from/to AWS?
  • Comparison - Data Pipeline vs Database Migration Service DMS vs Schema Conversion Tool SCT
  • When to use - Data Pipeline vs Database Migration Service DMS vs Schema Conversion Tool SCT

Table of Contents

AWS Certification Study Material and Notes - 25 PDF Cheat Sheets

Each cheat sheet contains:

  • FAQs and Tutorials with 5-20 slides
  • Study Material and Notes to quickly review and prepare for certification exam
  • Certification Exam Tips
  • Certification and Interview Scenario Questions

AWS Data Pipeline

AWS Data Pipeline helps you to process and move data (ETL) between S3, RDS, DynamoDB, EMR, On-premise data sources.

Here are few important things to remember:

  • AWS Data Pipeline can create complex data processing workloads that are fault tolerant, repeatable, and highly available
  • AWS Data Pipeline launches required resources and tear them down after execution
  • REMEMBER : AWS Data Pipeline is NOT for streaming data!

AWS Database Migration Service

AWS Database Migration Service is used to migrate databases to AWS while keeping source databases operational.

Two types of migrations:

  • Homogeneous Migrations (ex: Oracle to Oracle)
  • Heterogeneous Migrations (ex: Oracle to Amazon Aurora, MySQL to Amazon Aurora)

Here are some of the important characteristics:

  • Free for first 6 months when migrating to Aurora, Redshift or DynamoDB
  • (AFTER MIGRATION) You can keep databases in sync and pick right moment to switch

Here are some the important use cases:

  • Consolidate multiple databases into a single target database
  • Continuous Data Replication can be used for Disaster Recovery

AWS Schema Conversion Tool

AWS Schema Conversion Tool is used to migrate data from commercial databases and data warehouses to open source or AWS services.

AWS Schema Conversion Tool is preferred option for migrating data warehouse data to Amazon Redshift.

You can migrate database schema (views, stored procedures, and functions) to compatible targets.

Here are some of the important features:

  • SCT assessment report
    • Analyze a database to determine the conversion complexity
  • Update source code (update embedded SQL in code)
  • Fan-in (multiple sources - single target)
  • Fan-out (single source - multiple targets)

Database Migration Service VS Schema Conversion Tool

Remember that SCT is part of DMS service.

Here are some of the important recommendations:

  • DMS is preferred for homogeneous migrations
  • SCT is preferred when schema conversion are involved
  • DMS is for smaller workloads (less than 10 TB)
  • SCT preferred for large data warehouse workloads
    • Prefer SCT for migrations to Amazon Redshift
  • Only DMS provides continuous data replication after migration


Certification - Recommended Reading

Elastic Load Balancer (ELB) vs Network Load Balancer (NLB) - A Difference

Elastic Beanstalk vs Cloudformation vs Opswork vs Codedeploy - A Difference

EBS HDD Storages - A Difference

AWS Shield vs AWS WAF vs AWS Macie - Protect Resources and Data Cheat Sheet

Managing Multiple AWS Accounts - Organizations, Trusted Advisor and more Cheat Sheet

Amazon CloudWatch - Logs, Events, Alarms and Dashboards Cheat Sheet

AWS CloudTrail vs Config vs CloudWatch Cheat Sheet

EBS SSD Storages - A Difference

NAT Gateway vs Instance - A Comparison

AWS Security Groups and Network Access Control List - A Comparison Cheat Sheet

Free Videos - Get Started with AWS Certification

Amazing AWS Certification Courses

Get our amazing courses pursued by thousands of learners