This Universal Extension is an interface to Rclone that provides the capability to monitor files/directories from across different cloud storages, as well as local or distributed file systems. Additionally and upon successful monitor, this extension publishes Local Universal Events. To properly handle these events and take action on them, this Universal Extension optionally can be attached as a Publisher to a Universal Monitor Task (see more details in section Cloud File Monitor Events). Rclone, is the open-source command line program that is utilized to accomplish all the actions supported in this Extension. Download with: Inter-Cloud Data Transfer Key Features:  This Universal Extension supports the following key features: Action Monitor objects creation Monitor objects change - change based on modification time Monitor objects deletion Options Trigger On Existence - available for Action Monitor On Create. Advanced filtering capability for objects to be monitored. Support for providing additional Rclone options according to the user needs. Universal Event Event published upon single object creation, holding information about the new object Event published upon single object change, holding information about the updated file, including the latest object size and modification time. Event published upon single object deletion, holding information about the deleted object. Event published upon single object existence, holding information about the object.

This Universal Extension provides the capability to perform data transfers between cloud-based storage services as well as local or distributed file systems. Transfers are fast and secure since data are streamed from one storage to another with no intermediate storage taking place. Multiple storage systems are supported (an overview can be found here). Integrations within this solution package include:  AWS S3 Google Cloud Storage Microsoft OneDrive Business, including Sharepoint Microsoft Azure Blob Storage Hadoop Distributed File Storage (HDFS) Local file system (Linux, Windows) HTTP(S) URL Download with:  Inter-Cloud Data MonitorKey Features: This Universal Extension supports the following key features: Actions List objects, list directory Copy, move, synchronize data between two storages. Copy a URL's content and to cloud or local destination without saving it in temporary storage. List data on a storage, including listing with details or in JSON format for machine parsing. Create objects on a storage. Delete objects from a storage. Features: Fast transfers for objects stored in the same region. Preserves always timestamps and verifies checksums. Supports encryption, caching, compression, chunking. Dynamic token updates for OneDrive Business cloud storage, observing the OneDrive business refresh token flow. Support for dry runs. Allows users to execute a Universal Task without making any permanent changes on the target storage. Advanced filtering capability for files or objects to be listed or transferred. Option to mark the Universal Task as Failed when no files have been transferred. List of overwrite options for existing data. Additional customized options. Output: Progress of the selected Action is visible, during Universal Task Instance execution. Text or JSON formatted output.