Add Source - General tab

Description

Bucket Name (Amazon S3 hosts)

The name of the Bucket where the files are located on the Amazon S3 host.

Container (Azure Blob Storage hosts)

The name of the Container where the files are located on the Azure Blob Storage host.

Note: Empty directory creation is not a supported function of Azure Blob Storage, therefore empty folders cannot be uploaded.

Document Library (SharePoint Hosts)

The name of the library where the files are located on the SharePoint host.

Folder(s)

Folder name or path where files are located on the host.

Browse button is not available if the source uses an FTP or SSH host with Blind Downloads enabled.

For all host types

Macros are allowed in this field.

For local filesystem hosts

Do not use full UNC paths.

For Filesystem, MOVEit Transfer, FTP, and SSH hosts

Note: Do not use a wildcard (* or **) in the first position of the path.

Example of *

/home/jal/data*/reports matches any folder named reports that is a direct subfolder of a folder whose name starts with data and is a subfolder of /home/jal.

• The following folders match:
  /home/jal/data/reports
/home/jal/dataaccounts/reports .
• The following folder does not match:
  /home/jal/reports

  MOVEit Automation specific wildcard operator ** matches any number of intermediate subfolders. A trailing ** means the same as checking Include Subdirectories

  Example of **

  /home/jal/**/reports matches any folder named reports that is a direct or indirect subfolder of jal.

• The following folders match: /home/jal/**/reports:
/home/jal/data1/2005/07/reports
/home/jal/2005/reports
/home/jal/reports
• The following folders do not match /home/jal/**/reports:
  /home/jal/2005/report1
/home/jal/2005/reports/mydata
  

  Note: The folder /home/jal/2005/reports/mydata would match if Search Subdirectories was checked.

For Remote filesystems by UNC or mounted drive letter

First add the host as a Share. If you use a UNC, MOVEit Automation attempts to find a matching Share host and prompts you to use it.

Folders checkboxes

• Ignore folders

If checked, optionally specify a folder mask.

Folder masks must reflect folder names, not full or relative folder paths. The folder masks match against the names of subfolders in the current folder being searched.

To specify multiple folders, use a semicolon (;).separated list with no spaces.

Macros are allowed in this field.

• Search subdirectories

Searches subdirectories of the specified folder (as well as the folder itself) according to the specified file mask.

File(s)

The filename or filemask used to select files on the remote host. Macros are allowed in this field.

Special wildcard characters:

• Asterisk (*) matches zero or more characters in that position in the filename.
• Question mark (?) matches one character at that position in the filename.

  You can use multiple wildcard characters in a single mask.

  Examples:

• x*.rpt matches x.rpt, x1.rpt, and xyz.rpt. It does not match xyz.rp or zz.rpt
• a?rpt matches a1.rpt and aQ.rpt It does not match a.rpt or a1.rp

You may also use multiple filenames or filemasks, separated by semi-colons (";"). The semi-colons act as an "Or" operator. For instance, the filemask "fred*.*;*.zip" will match fred7.txt and will also match sally.zip.

The ampersand operator ("&") acts as an "And" operator unless it is preceded by $. ("$&" means to match an ampersand literally.) For instance, given a filemask of "*.txt&ready.dat&final.log", MOVEit Automation will not process any files on the source location unless "ready.dat", "final.log" and at least one "*.txt" file are available. A semi-colon (";") has a higher precedence than "&", so "*.txt;*.doc&*.zip" means "either *.txt or *.doc, AND ALSO *.zip".

If you want the task to wait until all filetypes in the mask are available from the source, also select Retry if No Files Found.

Note: When Collect only new files is selected, if you change the filemask on an existing source, doing so could cause old files to be downloaded from the source host. File collection timestamps are stored by filemask internally in MOVEit Automation. Changing the filemask negates existing timestamps.

Files checkboxes

• Ignore file(s)

Select and specify the files to ignore. Macros are allowed in this field. See File(s) description, above, for details.

Note: ampersand (&) is always treated as a literal in this field.

• Special filters

Specifies files based on size and date/time of last modification. Select, then click Edit to specify filter criteria. Choose to match any or all criteria.

• Collect only new files

Selects only new files from the remote server.

For filesystem, FTP, and SSH hosts, MOVEit Automation maintains a database of most recent timestamps by host, directory, and filemask. For information on how to edit this database, see Editing Source Timestamps.

MOVEit Automation relies on the MOVEit Transfer definition of newness only until the first new file is downloaded for any given folder. After that, MOVEit Automation uses the same new file definition used by the other source types.

For filesystem files, MOVEit Automation uses the Last Modified stamp to determine newness.

Note: State information for this option is saved on a per-task basis, not on a per-host basis. If the task has run previously and sent files, the files are resent initially after this option is selected, if the files still exist on the source.

• Expand zip file

Uncompresses any files that end in the extension .zip.

• Retry if no files found

Selected: If the previous directory listing was successful but resulted in no matching files, the task times out and retries the directory listing. The retry count and retry timeout are used.

You can set this feature to wait for a file to appear during the running of a task, If the maximum number of retries is reached and no matching files are found, the task continues with the next step, with no error flagged.

Not selected: A directory listing that returns no files is not retried, and no files are downloaded from the source.

Notes:

• Defaults for Retry Count and Retry Timeout are set on a host's Limits settings. To access on an existing host, click HOSTS and click the host name. Expand the Limits category.
• On a Source, overrides for Retry Count and Retry Timeout are set on the Create/Edit Source dialog box Host Override tab.