Previous Topic

Next Topic

Book Contents

Book Index

Amazon S3 Host - Additional Properties

To access these additional fields: Select HOSTS and click the name of the Amazon S3 host. You can filter the list.

Note: The host's properties page shows the configured settings for each property area. To view all possible settings, click Edit.

For General properties, see Amazon S3 Host Field Descriptions.

Amazon S3 Host Field

Description

Limits

 

File count download limit

Maximum number of files that are downloaded from a source in a single task run against this host.

If the limit is exceeded, and the Advanced task setting Automatically re-run task if source download limits are encountered is set, the task is automatically rerun.

File size download limit

Maximum number of bytes that are downloaded from a source in a single task run against this host. Value of 0 means no limit.

Downloading stops after the first file that causes the number of downloaded bytes to exceed the limit.

If the limit is exceeded, and the Advanced task setting Automatically re-run task if source download limits are encountered is set, the task is automatically rerun.

Timeouts

Transfer Rescan Time

The number of seconds between directory scans to detect changes in file size or date.

The default is 0, which deactivates the feature. You can override the value in the individual task settings.

The Transfer Rescan prevents the download of incomplete files. After a file that matches the download criteria is identified, MOVEit Automation rescans the directory to detect file changes. If file changes are identified, MOVEit Automation implements one of the following options:

  • Traditional/Advanced tasks: The file is removed from the download list. This feature detects when another application is changing a file, which prevents MOVEit Automation from downloading partial files.

    Sync Tasks: The files are rescanned until successive scans identify unchanged files. This feature identifies stable sources, which prevents tasks running multiple times to capture and synchronize changes in a directory.

    Note: In the Admin Console, this property is known as Default Xfer Rescan.

Retry Count

Number of extra times that a transfer (get or put) is retried before MOVEit Automation no longer attempts the transfer. Default is 0 - transfer is not retried after a failure. The value can be overridden by settings in individual tasks.

Retry Timeout

The number of seconds between retries of a transfer (get or put). Default is 30 seconds. The value can be overridden by settings in individual tasks.

Connect Timeout

Number of seconds to wait when attempting to connect to the host.

Data Timeout

Number of seconds to wait when sending data to or receiving data from the host.

Proxy Server

 

Proxy Type

Type of proxy server with which MOVEit Automation communicates. Available proxy types: None, HTTP, and HTTPS. Default is None.

Hostname/IP Address, Port

Hostname/IP address and TCP Port of the proxy server.

Username/Password

Username/password for MOVEit Automation to use to authenticate to the proxy server.

SSL Mode

Whether and how MOVEit Automation uses SSL to communicate with the proxy server. Options: Auto (default), Always, Never, Tunnel.

Advanced

 

Delete State for Host Path entries after

Number of days after which State information for this host is deleted.

Note: When this host is assigned as a task source that uses Collect Only New Files, MOVEit Automation saves file stamp information that is specific to this host and the task source's folder path and file mask. If a source's folder path and/or file mask contains a non-static macro (for example, [DD] or other date/time macros) the actual source folder path/file mask combination can potentially be different every time the task runs. This can cause the saved state information for this host to grow excessively large and without limits.

Use default state cache settings

  • Selected (default). Uses the default state cache settings that are specified in SETTINGS > System Settings > State File. For more information, see State File Settings.
  • Not selected: Specify how long to cache state information for this host.

    Note: By default, MOVEit Automation keeps state file information cached in memory to achieve maximum efficiency. In some environments, this can become very memory intensive. Use the State Cache settings to remove state file information from memory after a task run, or after a specified amount of time.

Account for Daylight Savings

This host automatically changes the apparent time of existing files when Daylight Savings Time comes into effect, or reverts to Standard Time. This setting changes the following:

  • How the Collect Only New Files source option is processed.
  • The way that synchronization works.

    In these situations, MOVEit Automation compensates for changes made by the host by adjusting the apparent timestamps of files by one hour. This prevents the unnecessary transfer of files that appear to be new because their apparent times have changed since they were last observed.

    For example, a file is modified in January (during Standard Time) at 8:00 a.m. When Daylight Savings Time comes into effect, that file's apparent modification time changes to 9:00 a.m. If the Host adjusts timestamps is selected, MOVEit Automation internally adjusts its view of the file's time back to 8:00 a.m. for comparison purposes, and does not consider the time to be new.

Data Integrity Checking

 

Never perform data integrity check

MOVEit Automation will not perform download integrity checking. This is similar to the default settings for most other host types.

Perform data integrity check if the hash calculation is guaranteed

MOVEit Automation will perform download integrity checking where it can guarantee the accuracy of the calculations. This option avoids false negatives but may result in being unable to guarantee download integrity.

Always perform data integrity check and ignore failures

MOVEit Automation will perform download integrity checking. If a failure is detected, a warning is issued in the system log and the download is successful. This option requires you to scan the system log to troubleshoot download errors.

Always perform data integrity check

MOVEit Automation will perform download integrity checking. If an error is detected, the download the task fails. This option ensures that downloads are performed correctly.

Note: If the original uploader used a non-standard upload buffer size, the download might incorrectly be reported as corrupted.