Product information "Inter-Cloud Data Monitor"
Product Information "Cloud Data Monitor" This Universal Extension provides the capability to monitor objects (files/directories) on various major Cloud Providers including AWS, Google Cloud, Microsoft Azure and trigger Universal Events, which can be used for execution of tasks and workflows. It can be executed as a standalone UAC Task, however in order to benefit from the full functionality and scalability of UAC, it is suggested to be used in conjunction with Universal Monitor Triggers and Universal Monitor Tasks.
Multiple storage systems are supported (an overview can be found here). Integrations within this solution package include:
- Amazon S3
- Google Cloud Storage
- Microsoft OneDrive Business, including Sharepoint
- Microsoft Azure Blob Storage
- Hadoop Distributed File Storage (HDFS)
- Local file system (Linux, Windows)
- HTTP(S) URL
Key FeaturesÂ
This Universal Extension supports the following key features:Â
FeaturesÂ
Monitor Object Creation, Change (based on modification time) and Deletion using advanced filtering capabilitiesÂ
- Generates Universal Events for each entity the monitor has detected, which can be used to trigger other tasks and workflows.Â
- Large set of possible parameterization and coverage of remote storages.Â
- Plug & Play, easy installation without the need to install external dependencies.Â
- Dynamic token updates for OneDrive Business cloud storage, observing the OneDrive business refresh token flow.
- Enhanced observability with event metrics, providing users with detailed statistical insights into events processed across all task instances.
- Shared configuration with Cloud Data Transfer.Â
Premium Features
- Monitor files inside OneLake Lakehouses.
To receive Cloud Data Monitor Premium contact Stonebranch.Â
What's New 2.5.0:
EnhancementsÂ
- Added the option to extend the Update Credentials Token Refresh to more remotes (e.g. Box, OneDrive)Â
- Enabled the capability to provide filters as a ScriptÂ
- The Storage Credentials are no longer a required field, useful for local executions where authentication is unnecessary.Â
- Added forward compatibility with future Python versions.Â
- Bundles latest binaries.
- Premium: Add support for OneLake lakehouses
| Extension Name: | ue-cloud-dm |
|---|---|
| Universal Template Name: | Cloud Data Monitor |
| Vendor Product: | Rclone |
| Version: | 2.5.0 |
| Vendor: | Amazon, Google, Hadoop, Linux, Microsoft |
| Type: | Free |
| Compatibility : | UC/UA 7.6 and above |
| Support: | Stonebranch Certified |