Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://docs.aws.amazon.com/datasync/latest/userguide/configure-metadata.html below:

Configuring how to handle files, objects, and metadata

You can configure how AWS DataSync handles your files, objects, and their associated metadata when transferring between locations.

For example, with recurring transfers, you might want to overwrite files in your destination with changes in the source to keep the locations in sync. You can copy properties such as POSIX permissions for files and folders, tags associated with objects, and access control lists (ACLs).

You can configure whether DataSync transfers only the data (including metadata) that's changed following an initial copy or all data every time you run the task. If you're planning on recurring transfers, you might only want to transfer what's changed since your previous task execution.

Transfer only data that has changed

TransferMode set to CHANGED

Transfer all data

TransferMode set to ALL

DataSync copies everything in the source to the destination without comparing differences between the locations.

You can control some aspects of how DataSync treats your files or objects in the destination location. For example, DataSync can delete files in the destination that aren't in the source.

Keep deleted files

PreserveDeletedFiles

Specifies whether DataSync maintains files or objects in the destination location that don't exist in the source.

If you configure your task to delete objects from your Amazon S3 bucket, you might incur minimum storage duration charges for certain storage classes. For detailed information, see Storage class considerations with Amazon S3 transfers.

You can't configure your task to delete data in the destination and also transfer all data. When you transfer all data, DataSync doesn't scan your destination location and doesn't know what to delete.

Overwrite files

OverwriteMode

Specifies whether DataSync modifies data in the destination location when the source data or metadata has changed. If you don't configure your task to overwrite data, the destination data isn't overwritten even if the source data differs.

If your task overwrites objects, you might incur additional charges for certain storage classes (for example, for retrieval or early deletion). For detailed information, see Storage class considerations with Amazon S3 transfers.

DataSync can preserve file and object metadata during a transfer. The metadata that DataSync can preserve depends on the storage systems involved and whether those systems use a similar metadata structure.

Before configuring your task, make sure that you understand how DataSync handles metadata and special files when transferring between your source and destination locations.

DataSync supports transfers to and from certain third-party cloud storage systems, such as Google Cloud Storage and IBM Cloud Object Storage, which handle system metadata in a way that is not fully S3-compatible. For these transfers, DataSync attempts to copy metadata attributes such as ContentType, ContentEncoding, ContentLanguage, and CacheControl on a best-effort basis. If the destination storage system does not apply these attributes, they will be ignored during task verification.

Copy ownership

Specifies whether DataSync copies POSIX file and folder ownership, such as the group ID of the file's owners and the user ID of the file's owner.

Copy permissions

Specifies whether DataSync copies POSIX permissions for files and folders from the source to the destination.

Specifies whether DataSync copies the timestamp metadata from the source to the destination. Required when you need to run a task more than once.

Specifies whether DataSync preserves the tags associated with your objects when transferring between object storage systems.

DataSync copies the following:

• The object owner.

• NTFS discretionary access lists (DACLs), which determine whether to grant access to an object.

• NTFS system access control lists (SACLs), which are used by administrators to log attempts to access a secured object.

  Note: SACLs are not copied if you use SMB version 1.0.

  Copying DACLs and SACLs requires granting specific permissions to the Windows user that DataSync uses to access your location using SMB. For more information, see creating a location for SMB, FSx for Windows File Server, or FSx for ONTAP (depending on the type of location in your transfer).

DataSync copies the following:

• The object owner.

• DACLs, which determine whether to grant access to an object.

DataSync won't copy SACLs when you choose this option.

DataSync doesn't copy any ownership or permissions data. The objects that DataSync writes to your destination location are owned by the user whose credentials are provided for DataSync to access the destination. Destination object permissions are determined based on the permissions configured on the destination server.

You can configure how DataSync handles files, objects, and metadata when creating, editing, or starting your transfer task.

The following instructions describe how to configure file, object, and metadata handling options when creating a task.

1. Open the AWS DataSync console at https://console.aws.amazon.com/datasync/.

2. In the left navigation pane, expand Data transfer, then choose Tasks, and then choose Create task.

3. Configure your task's source and destination locations.

   For more information, see Where can I transfer my data with AWS DataSync?

4. For Transfer mode, choose one of the following options:

   • Transfer only data that has changed

   • Transfer all data

   For more information about these options, see Transfer mode options.

5. Select Keep deleted files if you want DataSync to maintain files or objects in the destination location that don't exist in the source.

   If you don't choose this option and your task deletes objects from your Amazon S3 bucket, you might incur minimum storage duration charges for certain storage classes. For detailed information, see Storage class considerations with Amazon S3 transfers.

   Warning

   You can't deselect this option and enable Transfer all data. When you transfer all data, DataSync doesn't scan your destination location and doesn't know what to delete.

6. Select Overwrite files if you want DataSync to modify data in the destination location when the source data or metadata has changed.

   If your task overwrites objects, you might incur additional charges for certain storage classes (for example, for retrieval or early deletion). For detailed information, see Storage class considerations with Amazon S3 transfers.

   If you don't choose this option, the destination data isn't overwritten even if the source data differs.

7. Under Transfer options, select how you want DataSync to handle metadata. For more information about the options, see Metadata handling options.

   Important

   The options you see in the console depend on your task's source and destination locations. You might have to expand Additional settings to see some of these options.

   • Copy ownership

   • Copy permissions

   • Copy timestamps

   • Copy object tags

   • Copy ownership, DACLs, and SACLs

   • Copy ownership and DACLs

   • Do not copy ownership or ACLs

You can configure file, object, and metadata handling options by using the Options parameter with any of the following operations:

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4