Featured Integrations
Free
Video
Inter-Cloud Data Transfer
Stream data from one object store to another without intermediate storage.
The Inter-Cloud Data Transfer integration allows users to transfer data to, from, and between major private and public cloud providers like AWS, Google Cloud, and Microsoft Azure. It also supports the transfer of data to and from a Hadoop Distributed File System (HDFS) and to major cloud applications like OneDrive and SharePoint. Integrations within this solution package include:
AWS S3
Google Cloud
SharePoint
Dropbox
OneDrive
Hadoop HDFS
Key Features:
Transfer data to, from, and between any cloud provider
Transfer between any major storage applications like SharePoint, Dropbox, and others
Transfer data to and from a Hadoop File System (HDFS)
Download a URL's content and copy it to the destination without saving it in temporary storage
Data is streamed from one object store to another (no intermediate storage)
Very fast, if the object stores are in the same region
Preserves always timestamps and verifies checksums
Supports encryption, caching, compression, chunking
Perform dry-runs
Dynamic token updates for SharePoint connections
Regular expression-based include/exclude filter rules
Supported actions are:
List objects, list directory
Copy/move
Remove object/object-store
Perform dry-runs
Monitor object
Copy URL
What's New in v1.2.0
New choice field for write options
Do not overwrite existing objects
Replace existing objects
Create a new timestamp if it exists
Use custom parameters
New text field to set the recursion depth
The default value is “1” — no recursion allowed
New checkbox “Error on no transfer”
The task will fail if no transfer has been performed
File Monitor incl. Trigger functionality (similar as the agent file monitor in the Universal Controller)
Skip if Active
Trigger on Exists
Use server modtime — time when the file was uploaded to the object store (S3 bucket, Azure Container, etc. )
Task(s) to launch (CSV-List). You can launch one or multiple tasks, if the monitor goes to success.
New Remote: SFTP client
Support for SFTP streaming
Task acts as SFTP client
Windows agent support
Task can execute rclone installed on Windows
Note:
* SharePoint Online will only work with the latest Universal Agent 7.2
Products
Free
Video
Amazon S3: Cloud Storage Bucket File Transfer
The Amazon S3 Cloud Storage Bucket File Transfer integration allows you to securely automate file transfers from, to, and between Amazon S3 cloud storage buckets and third-party application folders.Storing data in the cloud becomes an integral part of most modern IT landscapes. With Universal Automation Center (UAC), you can securely automate your AWS tasks and integrate them into existing scheduling workflows.
Key Features:
Automate file transfers in real-time.
Drag-and-drop as a task into any existing scheduling workflow within the UAC.
File Transfers can be triggered by a third-party application using the UAC RESTfull web service API: REST API.
The following file transfer commands are supported:
Upload file(s) to an S3 bucket.
Download file(s) from an S3 bucket.
Transfer files between S3 buckets.
List objects in an S3 bucket.
Delete object(s) in an S3 bucket.
List S3 bucket names.
Create an S3 bucket.
Additional Info:
Security is ensured by using the HTTPS protocol with support for an optional proxy server.
Supports AWS IAM Role-Based Access (RBCA).
No Universal Agent needs to be installed on the AWS Cloud – the communication goes via HTTPS.AWS canned ACLs are supported, e.g., to grant full access to the bucket owner.
Free
Amazon SQS: Create, Monitor, and Send Messages
The Amazon SQS integration allows you to create, send, and monitor Amazon SQS messages and automatically trigger a task or workflow in Universal Controller each time a message has been received.Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. Using SQS, enterprises can send, store, and receive messages between software components.
Key Features:
Allows you to monitor for, create, and send Amazon SQS messages.
Trigger a task in Universal Controller upon the arrival of a new SQS message.
Amazon SQS tasks can be integrated into any existing or new automation workflow.
Create and send a SQS message out of any modern third-party application by calling the Universal Controller remote web service API.
Set different log-levels for the Amazon SQS task to provide additional information when root-causing potential issues.
Additional Information:
This integration uses the Python Boto3 module. This enables new Amazon AWS services and the ability to update the current SQS task when new requirements occur.
Credentials for Amazon S3 are stored in an encrypted format in the database.
IAM Role-Based Access Control (RBAC) is supported.
Communication to Amazon AWS is done via the HTTPS protocol.
A proxy server connection to Amazon AWS with basic authentication is supported.
Amazon AWS with basic authentication is supported.
Free
Amazon SQS: Message
Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. This Integration provides the capability to send an AWS SQS message towards an existing queue.
Key Features:
This Universal Extension provides the following main features:
Send a message towards a standard or a FIFO queue.
Capability to control the transport of the messages by configuring the message Delay Seconds (for standard queues) and the message group ID and message deduplication ID (for FIFO queues).Capability to fetch dynamically Queue Names list from SQS for selection during task creation.Capability to be authorized via IAM Role-Based Access Control (RBAC) strategy.Capability for Proxy communication via HTTP/HTTPS protocol. What's New in v1.1.0This new release gives the capability to users to rely on AWS credentials set-up on the environment where the extension is running and therefore it is not mandatory to be passed on the task definition as input field. The same applies to AWS Region.
New
Free
Amazon SQS: Monitor
Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. This Universal Extension provides the capability to monitor AWS SQS messages from an existing queue and run Universal Task and/or workflows accordingly.Key FeaturesThis Universal Extension provides the following main features:ActionMonitor AWS SQS messages from a standard or a FIFO queue.Launch a task in Universal Controller with variables holding the id, body, attributes, message attributes and receipt handle for each fetched message.AuthenticationAWS Credentials.IAM Role-Based Access Control (RBAC) strategy.OtherCommunication through Proxy with use of HTTP or HTTPS.What's New V1.1.0 This new release gives the capability to users to rely on AWS credentials set-up on the environment where the extension is running and therefore it is not mandatory to be passed on the task definition as input field. The same applies to AWS Region.
Free
AWS Batch
AWS Batch is a set of batch management capabilities that enables developers, scientists, and engineers to quickly and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch integration provides the ability to submit new AWS Batch Jobs and read the status for an existing AWS Batch Job.
Key Features:This Universal Extension provides the following key features:Support to submit a new Batch Job, with the option to Terminate Job after a timeout period.
Support to read Batch Job status for an existing Job ID.
Support for authorization via IAM Role-Based Access Control (RBAC) strategy.
Support for Proxy communication via HTTP/HTTPS protocol.What's New in v 1.2.0
This new release gives the capability to users to Submit AWS Jobs and wait until the Jobs reach "Success" or "Failure". Key parameters such as job status, id, name and ARN are updated live during execution.
Free
AWS EC2: Create Instances
This integration allows users to create an AWS EC2 instance with parameters, either in task form or by simply creating an EC2 instance from the existing AWS launch template. This task also offers the option to install a Linux/Unix Universal Agent in the newly provisioned EC2 instance.
Key Features:
The task interacts with the AWS platform via a Python Boto3 module.
All AWS credentials remain encrypted.
Users can also install/configure a Linux Universal Agent for each EC2 instance, enabling the Universal Controller to communicate with the newly created instance instantly.
This task also lets users create multiple EC2 instances with the same configuration. New instances can also be tagged.
It allows customers to create a new key pair or use an existing one for the new EC2 instance.
This task also enables options for additional EBS volume and encryption, as well as detailed monitoring. Additional Info:Only Linux Universal Agent is supported at the moment.
Free
AWS EC2: Start, Stop, and Terminate Instances
This integration allows users to spin up, terminate, and manage AWS EC2 instances on demand simply by providing one or more instance IDs as input.
Key Features:
This task uses Python Boto3 to interact with the AWS platform using the credentials supplied within the task.
It supports multiple EC2 instances at once.
This task goes to the success state in Universal Controller until the EC2 instance is completely spun up or terminated.
Scheduling this task using Universal Controller workflow spins up and tears down EC2 instances based on the business needs, complete with the correct setup and dependencies.
It dynamically manages EC2 operations, offering the potential to reduce EC2 operations costs in the cloud.
Free
AWS Glue
AWS Glue is a serverless data-preparation service for extract, transform, and load (ETL) operations. It makes it easy for data engineers, data analysts, data scientists, and ETL developers to extract, clean, enrich, normalize, and load data. This integration provides the capability to submit a new AWS Glue Job.
Key Features:This Universal Extension provides the following key features:Start a Glue job.
Support authorization via IAM Role-Based Access Control (RBAC) strategy.
Support Proxy communication via HTTP/HTTPS protocol.What's New in v1.1.0This new release gives the capability to users to rely on AWS credentials set-up on the environment where the extension is running and therefore it is not mandatory to be passed on the task definition as input field. The same applies to AWS Region.
Free
AWS Lambda
AWS Lambda is a serverless compute service that runs your code in response to events and automatically manages the underlying compute resources. You can use AWS Lambda to extend other AWS services with custom logic or create your own back-end services that operate at AWS scale, performance, and security. AWS Lambda can automatically run code in response to multiple events, such as HTTP requests via Amazon API Gateway, modifications to objects in Amazon S3 buckets, table updates in Amazon DynamoDB, and state transitions in AWS Step Functions.
Key Features:This Universal Extension provides the following key features:Trigger Lambda function Synchronously or Asynchronously.
Support authorization via IAM Role-Based Access Control (RBAC) strategy.
Support default or on demand AWS Region.
Support Proxy communication via HTTP/HTTPS protocol.What's New v1.1.0This new release gives the capability to users to rely on AWS credentials set-up on the environment where the extension is running and therefore it is not mandatory to be passed on the task definition as input fields. The same applies to AWS Region.
Free
AWS Step Functions
Step Functions is a serverless orchestration service that lets you combine AWS Lambda functions and other AWS services to build business-critical applications. Through Step Functions graphical console, you see your application’s workflow as a series of event-driven steps.This integration allows customers to execute AWS Step Functions from Universal Controller.Key FeaturesThis Universal Extension provides the following key features.ActionsExecute a AWS Step Function and wait until is reaches status "Success" or "Failed".Execute a AWS Step Function asynchronously without waiting for the execution to finish.AuthenticationAuthentication using AWS CredentialsAuthorization via IAM Role-Based Access Control (RBAC) strategy.OtherCommunication through Proxy with use of HTTP or HTTPS.
Free
Azure Blob: Manage File Transfers
The integration for Azure Blob Storage allows secure transfer of files from Azure Blob Storage containers and folders.Storing data in the cloud becomes an integral part of most modern IT landscapes. With the Stonebranch Universal Automation Center, you can securely automate your AWS, Azure, Google, and MinIO file transfers and integrate them into your existing scheduling flows.
Key Features:
The following file transfer commands are supported:
Upload file(s) to an Azure Blob Storage container.
Download file(s) from an Azure Blob Storage container.
Transfer files between Azure Blob Storage containers.
List objects in an Azure Blob Storage container.
Delete object(s) in an Azure Blob Storage container.
List Azure Blob Storage container names.
Create an Azure Blob Storage container.
File transfer can be triggered by a third-party application using the Universal Automation Center RESTfull web service API: REST API.
The integration for Azure Blob Storage can be integrated into any existing scheduling workflow in the same way as any standard Linux or Windows task type.
Security is ensured by using the HTTPS protocol with support for an optional proxy server.
Supports Azure token-based Shared Access Signature (SAS).
No Universal Agent needs to be installed on the Azure cloud – the communication goes via HTTPS.
Free
Azure Data Factory: Schedule, Trigger, and Monitor
This integration allows users to schedule, trigger, and monitor the Azure Data Factory pipeline process directly from the Universal Controller.
Key Features:
Uses Python modules azure-mgmt-resource and azure-mgmt-datafactory to make REST API calls to Azure Data Factory.
Use the Azure tenant ID, subscription ID, client ID, client secret, resource group, and location for authenticating the REST API calls to Azure Data Factory.
Perform the following Azure Data Factory operations:
Run a pipeline.
Get a pipeline info.
List all pipelines.
Cancel pipeline run.
List factory by resource group.
Azure Data Factory triggers user can perform the following operations from UAC:
Start trigger.
Stop trigger.
List trigger by factory.
UAC also can restart a failed pipeline either from the failed step or from any activity name in the failed pipeline.
Free
Azure Logic Apps: Schedule, Trigger, and Monitor Workflows
This integration can trigger and monitor the execution of Azure Logic workflows and retrieve Azure Logic workflow output execution. The Stonebranch Universal Controller (UC) integrates with Logic apps through REST APIs securely through the Azure Oauth 2.0 authentication mechanism.
Key Features:
Passes dynamic input parameters (JSON format) to each Azure Logic app workflow.
Triggers a workflow, monitors it until the process is completed, and then delivers the results to UC.
Customers can manage and control Logic app workflow execution from UC, with the capability to employ other dependencies like time triggers or event-based jobs/workflows.
This task offers ITSM integration capability, enabling the auto-creation of incidents in Logic apps workflow execution failure.
Free
Azure Virtual Machines: Start, Stop, and Terminate Instances
This integration allows users to utilize Azure Virtual Machine (VM) name, resource group, subscription ID, and access token as inputs to a start, stop, terminate, list, and check the status of Azure VMs.
Key Features:
Uses a Python request module to interact with the Azure cloud platform.
Expands user ability to start/stop/terminate/check/list Azure VMs that belong to a subscription and resource group.
In the Stonebranch Universal Controller (UC), this task reaches and stays in the success state until the Azure instance is completely started, stopped, or terminated.
Scheduling this task in UC with the right dependencies set up would start and stop EC2 instances based on business needs using a UC workflow.
This task helps to dynamically manage VM operations. It could potentially reduce the Azure VM running cost in the cloud.
Important:
This integration uses Azure Oauth 2.0 access token for Azure API authentication. Users may need to use the UC web services task to refresh the access token periodically.
Free
Databricks: Automate Jobs and Clusters
This integration allows users to perform end-to-end orchestration and automation of jobs and clusters in Databricks environment either in AWS or Azure.
Key Features:
Uses Python module requests to make REST API calls to the Databricks environment.
Uses the Databricks URL and the user bearer token to connect with the Databricks environment.
With respect to Databricks jobs, this integration can perform the below operations:
Create and list jobs.
Get job details.
Run new jobs.
Run submit jobs.
Cancel run jobs.
With respect to the Databricks cluster, this integration can perform the below operations:
Create, start, and restart a cluster.
Terminate a cluster.
Get a cluster-info.
List clusters.
With respect to Databricks DBFS, this integration also provides a feature to upload files larger files.
Free
Google BigQuery: Schedule, Trigger, Monitor, and Orchestrate Operations
This integration allows users to schedule, trigger, monitor, and orchestrate the Google BigQuery process directly from the Universal Controller.
Key Features:
Users can perform the below Google BigQuery operations:
BigQuery SQL.
List dataset.
List tables in a dataset.
View job information.
Create a dataset.
Load local file to a table.
Load cloud storage data to a table.
Export table data.
Additional Info:
This task uses Python google-cloud-bigquery and google-auth modules to make REST API calls to Google BigQuery.
This task will use the GCP project ID, BigQuery SQL or schema, dataset ID, job ID, location, table ID, cloud storage URI, source file format as parameters of BigQuery function and GCP KeyFile (API KEY) of service account for authenticating the REST API calls to Google BigQuery.
Free
HashiCorp: Terraform
Terraform is an infrastructure as code tool that lets you define cloud and on-prem resources in human-readable configuration files that you can version, reuse, and share. You can then use a consistent workflow to provision and manage your infrastructure throughout its lifecycle.
This integration allows users to create tasks that execute terraform commands. Typically, it can be used for Use Cases where UAC acts as an orchestrator for resource provisioning, and Terraform needs to be used to provide those resources.
Key Features:
This Universal Extension provides the following key features:
Init Terraform (Supports upgrade option)
Plan Terraform (Supports Refresh-only planning mode)
Apply Terraform
Destroy Terraform
What's New v 1.0.1
This new release gives the capability to pass UAC credentials from the template into the terraform variable file and to be used in the terraform execution.
Free
Video
Inter-Cloud Data Transfer
Stream data from one object store to another without intermediate storage.
The Inter-Cloud Data Transfer integration allows users to transfer data to, from, and between major private and public cloud providers like AWS, Google Cloud, and Microsoft Azure. It also supports the transfer of data to and from a Hadoop Distributed File System (HDFS) and to major cloud applications like OneDrive and SharePoint. Integrations within this solution package include:
AWS S3
Google Cloud
SharePoint
Dropbox
OneDrive
Hadoop HDFS
Key Features:
Transfer data to, from, and between any cloud provider
Transfer between any major storage applications like SharePoint, Dropbox, and others
Transfer data to and from a Hadoop File System (HDFS)
Download a URL's content and copy it to the destination without saving it in temporary storage
Data is streamed from one object store to another (no intermediate storage)
Very fast, if the object stores are in the same region
Preserves always timestamps and verifies checksums
Supports encryption, caching, compression, chunking
Perform dry-runs
Dynamic token updates for SharePoint connections
Regular expression-based include/exclude filter rules
Supported actions are:
List objects, list directory
Copy/move
Remove object/object-store
Perform dry-runs
Monitor object
Copy URL
What's New in v1.2.0
New choice field for write options
Do not overwrite existing objects
Replace existing objects
Create a new timestamp if it exists
Use custom parameters
New text field to set the recursion depth
The default value is “1” — no recursion allowed
New checkbox “Error on no transfer”
The task will fail if no transfer has been performed
File Monitor incl. Trigger functionality (similar as the agent file monitor in the Universal Controller)
Skip if Active
Trigger on Exists
Use server modtime — time when the file was uploaded to the object store (S3 bucket, Azure Container, etc. )
Task(s) to launch (CSV-List). You can launch one or multiple tasks, if the monitor goes to success.
New Remote: SFTP client
Support for SFTP streaming
Task acts as SFTP client
Windows agent support
Task can execute rclone installed on Windows
Note:
* SharePoint Online will only work with the latest Universal Agent 7.2
Free
Qlik Sense
Qlik Sense is a Business Intelligence (BI) Tool. Qlik Sense users can connect and combine data from hundreds of data sources by defining data pipelines as applications. Data can then be visualized via custom dashboards on the Qlik Sense Cloud or Desktop application.
Key Features:This Universal Extension provides the following key features:Support to reload a Qlik Sense Cloud Application
Support to read the status of an already reloaded Qlik Sense Cloud Application
New
Free
RClone: Cloud File Transfer
This Universal Extension provides the capability to perform fast and secure data transfers between cloud-based storage services as well as local or distributed file systems. It acts as an interface to RClone, an open source command line program that manages data transfers and supports a vast number of Cloud Providers, including AWS, Google Cloud, and Microsoft Azure. A complete list of Rclone supported Cloud Storage Providers is available on the Rclone official site.
Key Features
This Universal Extension is an interface for Rclone and as an interface it supports the following key features:
ActionsCopy objects between two storages, including copying and renaming the destination objects, as well as copying data from a URL.Move objects between two storages, including moving and renaming the destination objects.Synchronize two storages.List objects on a storage, including listing with details or in JSON format for machine parsing.Create objects on a storage.Delete objects from a storage.OptionsSupport for dry runs. Allows users to execute a Universal Task without making any permanent changes on the target storage.Advanced filtering capability for files or objects to be listed or transferred.Capability not to overwrite files or objects during data transfersSupport for providing additional Rclone options according to the user needs.OutputProgress of the selected Action is visible, during Universal Task Instance execution.
Free
Web Service Integration (7.1 and above)
A Web service is a method of communication between two electronic devices over a network.This integration provides the capability to call endpoints of foreign APIs. It is beneficial for Stonebranch SaaS customers accessing the Universal Controller in the Stonebranch AWS Cloud and having their Universal Agents deployed in their datacenter. As the integration is triggered from the Universal Agent, no additional firewall port for the Universal Agent needs to be opened.
Key Features:
Support for communicating with APIs using the HTTP(S)/REST protocol
Support for Authorization towards the foreign API using Basic Authentication or OAuth2 token
Support for HTTP Methods GET, POST, PUT, DELETE, PATCH
Support for SSL Protocol
Ability to use proxy between Universal Agent and target web service
Ability for configuration of custom exit codes based on the web service response payload (Supported for JSON payloads)
What's New in V 1.2.0The Extension Output is enhanced to include a new JSON attribute body_json. This attribute is populated with the Web Service response body as a JSON object when the Web Service response body is of type JSON.
Free
Web Service Integration (7.0)
The Webservice Integration allows users to call a Webservice triggered from Universal Agent.This integration is beneficial for Stonebranch SaaS customers, which are accessing the Universal Controller in the Stonebranch AWS Cloud and having their Universal Agents deployed in their datacenter. As the integration is triggered from the Universal Agent, no additional firewall port for the Universal Agent needs to be opened. Key Features:
Call a Webservice triggered from Universal Agent
Support for all common HTTP Methods for RESTful Services: Get, Post, Put, Patch, and Delete
Form based query Parameters
Form and Script based HTTP Payload Parameters
Provide HTTP Headers as Form Data e.g. key: Accept, Value: application/json
Response Processing using Output Type JSON or Text