ACKF logoACKF
Migration and Transfer

AWS DataSync

View on GitHub

AWS DataSync

AWS DataSync is a managed data transfer service that moves files between on-premises storage and AWS storage services. It operates using a control plane in AWS and optional agent software deployed on customer networks to access NFS/SMB sources or destinations. It normally fits into architectures that need automated, scheduled, or large-scale file transfers to services such as Amazon S3, Amazon EFS, or Amazon FSx.

🗂 Resource Category

Migration and Transfer • Storage

🧠 Exam Memory Hook

Think: Agent-based NFS/SMB file transfer from on-prem to S3/EFS/FSx for migration and sync = AWS DataSync

📖 Ownership

Classification: Shared Responsibility Service

AWS responsibilities: AWS operates and maintains the DataSync control plane, service APIs, orchestration of transfer tasks, and the underlying AWS infrastructure and networking that the service runs on. AWS manages service-side scaling, availability, and the service platform components that coordinate transfers to AWS storage services.

Customer responsibilities: The customer deploys and manages DataSync agents when accessing resources on customer networks, configures tasks, endpoints, scheduling, bandwidth limits, and IAM permissions, and secures source and destination storage and data. The customer monitors transfer metrics and logs, maintains agent hosts where deployed, and is responsible for application-level data integrity, lifecycle policies, and access control.

Patching responsibilities: AWS patches the underlying physical infrastructure and the DataSync managed service platform. The customer is responsible for patching agent host operating systems and any guest-level components where the agent is deployed; when the agent runs on Amazon EC2 the customer is responsible for the EC2 guest OS and installed software while AWS patches the underlying infrastructure and hypervisor. Information not available regarding automatic patching of the DataSync agent software by AWS.

🏗 Typical Architecture

💡 Top 5 Features

  • Agent-based connectors to access NFS and SMB file systems on customer networks.
  • Native integration targets for Amazon S3, Amazon EFS, and Amazon FSx for Windows File Server.
  • Incremental transfers that copy changed files and support metadata preservation during tasks.
  • Configurable bandwidth throttling and scheduling to control transfer windows and network impact.
  • Built-in verification mechanisms to validate data integrity after transfer.

✅ Top 5 Use Cases

  • Migrate on-premises NAS or file server data to Amazon S3 or Amazon EFS during cloud migration projects.
  • Continuous or scheduled synchronization of on-prem file shares with AWS storage for hybrid workflows.
  • Backup on-prem file servers to Amazon S3 for long-term retention and lifecycle management.
  • Ingest large datasets from branch or data-center file shares into S3 for analytics and processing pipelines.
  • Replicate file system data to AWS as part of disaster recovery or archival strategies.

🏗 Architecture Placement

DataSync sits between on-premises or networked file storage and AWS storage services as a managed transfer service; requests originate from a deployed DataSync agent or AWS-hosted endpoints and are executed by the DataSync control plane, which writes to target AWS storage (such as S3, EFS, or FSx) and exports metrics to monitoring services. Placement is regional for the AWS storage endpoints used and typically requires network connectivity (VPN, Direct Connect, or internet) between the agent and AWS.

🎯 Commonly Used With

- Amazon S3
- Amazon EFS
- Amazon FSx for Windows File Server
- Amazon VPC
- Amazon CloudWatch

🌍 5 Real-World Examples

  • A healthcare provider transfers radiology image archives from an on-premises PACS NAS to Amazon S3 for scalable analytics and centralized retention.
  • A media studio moves large video asset libraries from on-prem storage to Amazon S3 for cloud-based transcoding workflows.
  • A retail chain synchronizes store-level file shares to Amazon EFS to provide centralized access to configuration and product catalog files.
  • A government records office archives historical documents from NFS storage to Amazon S3 with lifecycle policies for long-term storage.
  • A software development organization migrates Windows file shares to Amazon FSx for Windows File Server to consolidate Windows file workloads in AWS.

🎓 AWS Exam Clues

  • Used when transferring large NFS/SMB file datasets between on-premises storage and AWS storage services.
  • Requires deploying or running a DataSync agent to access resources on customer networks or isolated environments.
  • Offers scheduling, bandwidth controls, and verification, so choose DataSync when controlled automated transfers are needed over scripting.
  • Consider AWS Snow Family for initial offline bulk transfer when network bandwidth is severely constrained compared to continuous online transfer.
  • Tasks and endpoints require appropriate IAM permissions and network access to source and destination resources.

📝 Quick Revision

AWS DataSync is a managed service for automated, agent-enabled file transfers between on-prem NFS/SMB systems and AWS storage (S3, EFS, FSx). Use it for migrations, syncs, and backups while planning for agent placement, network bandwidth, IAM permissions, and destination storage configuration.

🏷 Keywords

Agent • NFS • SMB • Amazon S3 • Amazon EFS • Amazon FSx • Data transfer task • Incremental transfer • Bandwidth throttling • Data integrity verification • Scheduling • IAM roles