Inter-Cloud Data Transfer
Product information "Inter-Cloud Data Transfer"
This Universal Extension provides the capability to perform data transfers between cloud-based storage services and local or distributed file systems. Transfers are fast and secure since data are streamed from one storage to another with no intermediate storage taking place.
Multiple storage systems are supported (an overview can be found here). Integrations within this solution package include:
- Amazon S3
- Google Cloud Storage
- Microsoft OneDrive Business, including Sharepoint
- Microsoft Azure Blob Storage
- Hadoop Distributed File Storage (HDFS)
- Local file system (Linux, Windows)
- HTTP(S) URL
Download with: Inter-Cloud Data Monitor
Key Features:
This Universal Extension supports the following key features:
- Actions:
- Copy, move, and synchronize data between two storages.
- Copy a URL's content to a cloud or local destination without saving it in temporary storage.
- List data on storage, including listing with details or in JSON format for machine parsing.
- Create objects on a storage.
- Delete objects from a storage.
- Features:
- Fast transfers for objects stored in the same region.
- Preserves always timestamps and verifies checksums.
- Supports encryption, caching, compression, and chunking.
- Dynamic token updates for OneDrive Business cloud storage, observing the OneDrive business refresh token flow.
- Support for dry runs. Allows users to execute a Universal Task without making any permanent changes on the target storage.
- Advanced filtering capability for files or objects to be listed or transferred.
- Option to mark the Universal Task as Failed when no files have been transferred.
- List of overwrite options for existing data.
- Additional customized options.
- Output:
- Progress of the selected Action is visible, during Universal Task Instance execution.
- Text or JSON formatted output.
What's New in V4.0.0
- This new major version removes the need for manual installation of third party software on the Agent host.
- Added Support for automatic refresh of Token Credentials on UC for Storage Systems of type "One Drive"
- Fixed issue where observability metrics were not produced when Task Instance Log Level is INFO.
Breaking Changes
- Variables name prefix is changed. Following the import of a this new version, some small changes might need to be done on the task definitions depending on task configuration. Please refer to the Migration Notes on the Users Guide Documentation for more information.
- This version is supported for Universal Controller and Universal Agent 7.4.0.0 and later.
| Extension Name: | ue-cloud-dt |
|---|---|
| Universal Template Name: | Cloud Data Transfer |
| Version: | 4.0.0 |
| Vendor: | Amazon, Google, Hadoop, Linux, Microsoft |
| Type: | Free |
| Compatibility : | UC/UA 7.4 and above |
| Support: | Stonebranch Certified |
Please visit this link to find key features, prerequisites, installation instructions, configuration instructions, and examples of how to use this integration.