Product Information "Cloud Data Monitor" This Universal Extension provides the capability to monitor objects (files/directories) on various major Cloud Providers including AWS, Google Cloud, Microsoft Azure and trigger Universal Events, which can be used for execution of tasks and workflows. It can be executed as a standalone UAC Task, however in order to benefit from the full functionality and scalability of UAC, it is suggested to be used in conjunction with Universal Monitor Triggers and Universal Monitor Tasks.Multiple storage systems are supported (an overview can be found here). Integrations within this solution package include:Amazon S3Google Cloud StorageMicrosoft OneDrive Business, including SharepointMicrosoft Azure Blob StorageHadoop Distributed File Storage (HDFS)Local file system (Linux, Windows)HTTP(S) URLKey Features This Universal Extension supports the following key features: Features Monitor Object Creation, Change (based on modification time) and Deletion using advanced filtering capabilities Generates Universal Events for each entity the monitor has detected, which can be used to trigger other tasks and workflows. Large set of possible parameterization and coverage of remote storages. Plug & Play, easy installation without the need to install external dependencies. Dynamic token updates for OneDrive Business cloud storage, observing the OneDrive business refresh token flow.Enhanced observability with event metrics, providing users with detailed statistical insights into events processed across all task instances.Shared configuration with Cloud Data Transfer. Premium FeaturesMonitor files inside OneLake Lakehouses.To receive Cloud Data Monitor Premium contact Stonebranch. What's New 2.5.0:Enhancements Added the option to extend the Update Credentials Token Refresh to more remotes (e.g. Box, OneDrive) Enabled the capability to provide filters as a Script The Storage Credentials are no longer a required field, useful for local executions where authentication is unnecessary. Added forward compatibility with future Python versions. Bundles latest binaries.Premium: Add support for OneLake lakehouses

This Universal Extension provides the capability to perform data transfers between cloud based storage services, as well as local or distributed file systems. Transfers are fast and secure since data are streamed from one storage to another with no intermediate storage taking place.Multiple storage systems are supported (an overview can be found here). Integrations within this solution package include:Amazon S3Google Cloud StorageMicrosoft OneDrive Business, including SharepointMicrosoft Azure Blob StorageHadoop Distributed File Storage (HDFS)Local file system (Linux, Windows)HTTP(S) URLKey FeaturesThis Universal Extension supports the following key features:ActionsCopy, move, synchronize data between two storages. Copy a URL's content and to cloud or local destination without saving it in temporary storage. List data on a storage, including listing with details or in JSON format for machine parsing. Create objects on a storage. Delete objects from a storage. FeaturesFast transfers for objects stored in the same region.Preserves always timestamps and verifies checksums.Supports encryption, caching, compression, chunking.Dynamic token updates for OneDrive Business cloud storage, observing the OneDrive business refresh token flow.Support for dry runs. Allows users to execute a Universal Task without making any permanent changes on the target storage.Advanced filtering capability for files or objects to be listed or transferred.Option to mark the Universal Task as Failed when no files have been transferred.List of overwrite options for existing data.Additional customized options.Observability capabilities, providing users with detailed statistical insights for data transfers across all task instances.OutputProgress of the selected Action is visible, during Universal Task Instance execution.Text or JSON formatted output.Premium FeaturesMonitor files inside OneLake Lakehouses.To receive Cloud Data Transfer Premium contact Stonebranch.What's New 4.6.0:EnhancementsThe Bisync action has been added.Added the option to extend the Update Credentials Token Refresh to more remotes. (e.g. Box, OneDrive)Enabled the capability to provide filters as a ScriptThe Source/Target/Storage Credentials are no longer a required field, useful for local executions where authentication is unnecessary.Added forward compatibility with future Python versions.Bundles latest binaries.Premium: Add support for OneLake lakehouses