Free
Video
Amazon S3: Cloud Storage Bucket File Transfer
The Amazon S3 Cloud Storage Bucket File Transfer integration allows you to securely automate file transfers from, to, and between Amazon S3 cloud storage buckets and third-party application folders.Storing data in the cloud becomes an integral part of most modern IT landscapes. With Universal Automation Center (UAC), you can securely automate your AWS tasks and integrate them into existing scheduling workflows.
Key Features:
Automate file transfers in real-time.
Drag-and-drop as a task into any existing scheduling workflow within the UAC.
File Transfers can be triggered by a third-party application using the UAC RESTfull web service API: REST API.
The following file transfer commands are supported:
Upload file(s) to an S3 bucket.
Download file(s) from an S3 bucket.
Transfer files between S3 buckets.
List objects in an S3 bucket.
Delete object(s) in an S3 bucket.
List S3 bucket names.
Create an S3 bucket.
Additional Info:Support for AWS S3 prefixes to simulate a folder structure and to improve performance while copying files.Security is ensured by using the HTTPS protocol with support for an optional proxy server.Supports AWS IAM Role-Based Access (RBCA).No Universal Agent needs to be installed on the AWS Cloud – the communication goes via HTTPS.AWS canned ACLs are supported, e.g., to grant full access to the bucket owner.
What's New in V1.6.0Enhancements: This new release supports AWS S3 prefixes to simulate a folder structure and to improve performance while copying files.
Free
Amazon SQS: Message
Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. This Integration provides the capability to send an AWS SQS message towards an existing queue.
Key Features:
This Universal Extension provides the following main features:
Send a message towards a standard or a FIFO queue.
Capability to control the transport of the messages by configuring the message Delay Seconds (for standard queues) and the message group ID and message deduplication ID (for FIFO queues).Capability to fetch dynamically Queue Names list from SQS for selection during task creation.Capability to be authorized via IAM Role-Based Access Control (RBAC) strategy.Capability for Proxy communication via HTTP/HTTPS protocol.
What's New in v1.1.1Introduction of fixes to improve the robustness of this integration.
Free
Amazon SQS: Monitor
Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. This Universal Extension provides the capability to monitor AWS SQS messages from an existing queue and run Universal Task and/or workflows accordingly.
Key Features:
This Universal Extension provides the following main features:ActionMonitor AWS SQS messages from a standard or a FIFO queue.Launch a task in Universal Controller with variables holding the id, body, attributes, message attributes and receipt handle for each fetched message.AuthenticationAWS Credentials.IAM Role-Based Access Control (RBAC) strategy.OtherCommunication through Proxy with use of HTTP or HTTPS.
What's New V1.1.1
Introduction of fixes to improve the robustness of this integration.
Free
Ansible: Execute and Manage Playbooks
This Ansible integration allows users to execute Ansible playbooks and run other Ansible modules or commands directly from the Stonebranch Universal Automation Center (UAC).
Key Features:
Manage Ansible task execution through the intuitive Universal Controller user interface.
Ansible playbooks can either be centrally stored and maintained in the Universal Controller script library, or Universal Controller can call the relevant playbook residing in the Ansible host.
This integration also enables the execution of other Ansible commands.
Free
Apache Airflow
Apache Airflow is an open-source platform created to programmatically author, schedule, and monitor workflows. This Universal Extension provides the capability to integrate with an Apache Airflow Standalone Server or Google Cloud Composer Airflow and use it as part of your end-to-end UC workflow, allowing high-level visibility and orchestration of data-oriented jobs or pipelines.
You gain many enterprise-level benefits by using the Universal Automation Center to control Airflow. Notable benefits include:
Run your Airflow data pipelines in realtime by using event-based triggers from the UC
Add Airflow tasks to broader business process workflows in the UC
Gain observability of your Airflow workflows - with proactive alerts from the the UC
Read this article to learn more about the benefits of integrating Airflow with the Universal Automation Center.
Key-Features
This Universal Extension provides the following key features:ActionsTrigger a DAG run and optionally wait until the DAG was reached "success" or "failure".
Information retrieval of a specific DAG Run.
Information retrieval for a task that is part of a specific DAG Run.AuthenticationBasic authentication for Stand Alone Airflow Server.
Service Account Private Key for Google Cloud Composer.OtherCapability to use HTTP or HTTPS proxy instead of direct communication to Stand Alone Airflow Server.
What's new v 2.0.0
The latest release provides the ability to integrate with Google Cloud Composer Airflow Server. Furthermore, provides the ability to configure Action "Trigger DAG Run", by passing JSON configuration parameters.
Free
Apache Kafka: Event Monitor
Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. A Kafka Event Monitor is a Universal Extension responsible for monitoring events (messages) from topics in Kafka.
Key Features:
This Universal Extension provides the following main features:
Monitor messages and consume a Kafka message by consumer group topic subscriptionAuthenticate against Kafka using PLAINTEXT, SASL_SSL or SSL security protocolCapability to filter Kafka messages based on the value of the message. Number, String and JSON filter patterns are supported.Capability to fetch dynamically Kafka topics, during task creation.Capability to control the partition assignment strategy, as well as session-related timeout values
Typically this extension can be used to monitor events from Kafka and upon successful execution to trigger workflows or other tasks, or just to pass information related to the Kafka event within UAC.
What's New in V1.1.0With this new release client authentication over SSL is supported.
Free
Apache Kafka: Publish Event
Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. This integration is responsible for publishing events (messages) and topics in Kafka.
Key Features:
This Universal Extension supports the following main features:
Perform authentication towards Kafka, using PLAINTEXT or SASL_SSL security protocol
Send a message to Kafka with the capability to select the topic, the partition, the message key, the message value and message metadata
Capability to control the transport of the messages by configuring the message acknowledgment strategy and the request timeout
Capability to fetch dynamically topics and partitions from kafka for selection during task creation
Capability to automatically select the serialization method depending on the key/value message data types
What's New in V1.2.0This new release improves robustness of this integration and adds a number of useful features:Support for client authentication over SSL against Kafka bootstrap server.Extension Output is now provided upon successful execution.Debug mode execution is enhanced to properly close extension execution.Partition field enhanced to show and use all its dependent fields.
Free
AWS Batch
AWS Batch is a set of batch management capabilities that enables developers, scientists, and engineers to quickly and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch integration provides the ability to submit new AWS Batch Jobs and read the status for an existing AWS Batch Job.
Key Features:This Universal Extension provides the following key features:Support to submit a new Batch Job, with the option to Terminate Job after a timeout period.
Support to submit a new Batch Job and wait until it reaches state "success" or "failed".Support to read Batch Job status for an existing Job ID.
Support for authorization via IAM Role-Based Access Control (RBAC) strategy.
Support for Proxy communication via HTTP/HTTPS protocol.What's New in V1.3.1Revert `certifi` as requirement.
Free
AWS CLI
The AWS Command Line Interface (AWS CLI) is an open source tool that enables you to interact with AWS services using commands in your command-line shell. With minimal configuration, the AWS CLI enables you to start running commands that implement functionality equivalent to that provided by the browser-based AWS Management Console from the command prompt in your terminal program. This integration provides an interface to call the AWS CLI and enables users to execute AWS CLI tasks in UAC.Key FeaturesThis Universal Extension provides the following key features.Execute AWS CLI on UAC.Ability to provide configuration options through UAC scripts.
Free
AWS EC2: Create Instances
This integration allows users to create an AWS EC2 instance with parameters, either in task form or by simply creating an EC2 instance from the existing AWS launch template. This task also offers the option to install a Linux/Unix Universal Agent in the newly provisioned EC2 instance.
Key Features:
The task interacts with the AWS platform via a Python Boto3 module.
All AWS credentials remain encrypted.
Users can also install/configure a Linux Universal Agent for each EC2 instance, enabling the Universal Controller to communicate with the newly created instance instantly.
This task also lets users create multiple EC2 instances with the same configuration. New instances can also be tagged.
It allows customers to create a new key pair or use an existing one for the new EC2 instance.
This task also enables options for additional EBS volume and encryption, as well as detailed monitoring. Additional Info:Only Linux Universal Agent is supported at the moment.
Free
AWS EC2: Start, Stop, and Terminate Instances
This integration allows users to spin up, terminate, and manage AWS EC2 instances on demand simply by providing one or more instance IDs as input.
Key Features:
This task uses Python Boto3 to interact with the AWS platform using the credentials supplied within the task.
It supports multiple EC2 instances at once.
This task goes to the success state in Universal Controller until the EC2 instance is completely spun up or terminated.
Scheduling this task using Universal Controller workflow spins up and tears down EC2 instances based on the business needs, complete with the correct setup and dependencies.
It dynamically manages EC2 operations, offering the potential to reduce EC2 operations costs in the cloud.
Free
AWS ECS
Amazon Elastic Container Service (AWS ECS) is a fully managed container orchestration service that simplifies the deployment, management, and scaling of containerized applications. ECS allows you to run and scale Docker containers on AWS infrastructure without needing to manage the underlying hardware or software, making it easier to build, deploy, and operate containerized applications. It integrates seamlessly with other AWS services, supports both serverless (AWS Fargate) and server-based (EC2) compute options, and provides robust security, networking, and monitoring capabilities.In Amazon Elastic Container Service (AWS ECS), an ECS task is a running instance of a task definition. Tasks use case is ideal for one-time or short-lived jobs. For example:Batch Jobs: Suitable for batch processing, data transformations, and other workloads that complete after a certain period. Task Scheduling: Useful for scheduled tasks, such as cron jobs, where you need to run a task at specific intervals.Manual Execution: Good for tasks that you want to run on-demand or manually trigger through an event or user action. This integration provides the capability to run ECS Tasks allowing the above use-cases to be fulfilled through UAC, where UAC has the role of an orchestrator.
Key FeaturesRun AWS ECS Tasks.Stop AWS ECS Tasks.Capability to run and stop tasks with custom configurations and environment variables.Capability to run with proxies.
Free
AWS EMR
Amazon EMR (previously called Amazon Elastic MapReduce) is a managed cluster platform that simplifies running big data frameworks, such as Apache Hadoop and Apache Spark, on AWS to process and analyze vast amounts of data. This integration provides the ability the start and optionally monitor (by polling at specified intervals) notebook executions as supported by AWS EMR. Additionally the user can optionally specify various configuration options relating to the notebook execution.Key Features
Actions:
Start Notebook Execution:
This action is used to start an AWS EMR notebook execution. The authentication is done by access and secret keys, optionally with Role Based Access.
This action can be configured to either simply trigger the execution or trigger and wait until it completes successfully or fails.
Free
AWS Glue
AWS Glue is a serverless data-preparation service for extract, transform, and load (ETL) operations. It makes it easy for data engineers, data analysts, data scientists, and ETL developers to extract, clean, enrich, normalize, and load data.
This Universal Extension provides the capability to submit a new AWS Glue Job.
Key Features
This Universal Extension provides the following key features:
Actions
Start a Glue job.
Start a Glue job and wait until it reaches the state "success" or "failed."
Authentication
Authentication through HTTPS.
Authentication through IAM Role-Based Access Control (RBAC) strategy.
Input/Output
Option to pass Input Arguments as UAC script supporting UAC environment variables and UAC Functions.
Option to choose Worker Type.
Other
Support for Proxy communication via HTTP/HTTPS protocol.
What's new v 2.1.0
Added new field - Endpoint URL.
Proxy Type field has been removed (hidden) as it no longer needs to be filled by users on task definition.
Free
AWS Lambda
AWS Lambda is a serverless compute service that runs your code in response to events and automatically manages the underlying compute resources. You can use AWS Lambda to extend other AWS services with custom logic or create your own back-end services that operate at AWS scale, performance, and security. AWS Lambda can automatically run code in response to multiple events, such as HTTP requests via Amazon API Gateway, modifications to objects in Amazon S3 buckets, table updates in Amazon DynamoDB, and state transitions in AWS Step Functions.
Key Features:This Universal Extension provides the following key features:Trigger Lambda function Synchronously or Asynchronously.
Support authorization via IAM Role-Based Access Control (RBAC) strategy.
Support default or on demand AWS Region.
Support Proxy communication via HTTP/HTTPS protocol.What's New v1.2.0
Provide the capability to use a custom Lambda service endpoint.
Free
AWS Mainframe Modernization
AWS Mainframe Modernization service is an AWS cloud-native platform to migrate, modernize, execute, and operate mainframe applications within a fully-managed runtime. Stonebranch Universal Automation Center (UAC) works with AWS Mainframe Modernization to run both batch schedules and event-based automation on AWS.
Using the Stonebranch AWS Mainframe Modernization extension, enterprises may run automation in both the mainframe and on AWS simultaneously.
Key Features:
The ability to schedule, automate and execute mainframe batch jobs running in AWS Mainframe Modernization Service via the Stonebranch Universal Controller
Monitor Application’s batch processes from the Stonebranch Universal Controller
Start/Restart/Rerun/Cancel batch processes automatically or manually from the Stonebranch Universal Controller
Synchronous and asynchronous batch execution from Stonebranch Universal Controller
Retrieve the results of the AWS Mainframe Modernization Batch processes
Capture the AWS Cloudwatch logs of the executed jobs in Stonebranch Universal Controller
More information:
Article: Mainframe Modernization - How Automation Makes it Possible
What's New In 1.4.0:
BluAge support added
Log Fetching Methods updated
Free
AWS Step Functions
Step Functions is a serverless orchestration service that lets you combine AWS Lambda functions and other AWS services to build business-critical applications. Through Step Functions graphical console, you see your application’s workflow as a series of event-driven steps.
This integration allows customers to execute AWS Step Functions from Universal Controller.
Key Features:
This Universal Extension provides the following key features.Actions
Execute a AWS Step Function and wait until is reaches status "Success" or "Failed". Execute a AWS Step Function asynchronously without waiting for the execution to finish. AuthenticationAuthentication using AWS CredentialsAuthorization via IAM Role-Based Access Control (RBAC) strategy.OtherCommunication through Proxy with use of HTTP or HTTPS.
What's New V2.0.0Breaking Change: This version supports Universal Agent and Universal Controler from version 7.2 onwards. Customers that used older versions of this integration on Universal Controller and Universal Agent of versions <= 7.2 are required to upgrade to use the new functionality introduced by 2.0.0. Added: A suffix is added to the Execution Name before AWS Service is called. That suffix represents the execution count for a specific task instance, therefore providing uniqueness of the Execution Name. Fix: The Extension Output attribute “fields.invocation.execution_name” is corrected to represent the user input after the resolution of UC Functions and variables
Free
Azure AZ CLI
The Azure command-line interface (Azure CLI) is a set of commands used to create and manage Azure resources. The Azure CLI is available across Azure services and is designed to get you working quickly with Azure, with an emphasis on automation.
The Universal Task for Azure AZ CLI allows calling a single or a set of Azure CLI commands.
Key Features
This Universal Task provides the following key features:
The Universal Task for Azure AZ CLI allows you to schedule and Invoke Azure CLI commands.
Either a single command or a list of commands can be invoked.
No Azure CLI needs to be installed. This Universal Task uses Microsoft-maintained Python modules azure-cli.
The following functionalities can be performed:
Authenticate with Azure using your Azure user credentials.
Authenticate with Azure with a service principal.
Invoke a single Azure CLI commands.
Invoke a list of Azure CLI commands provides via a Universal Controller Script file.
Chooses different log-levels.
The Task can run on any Windows or Linux Agent, without the need to install the Azure CLI.
Free
Azure Batch
Azure Batch is a set of batch management capabilities that enables developers, scientists, and engineers to easily and efficiently create Azure Batch jobs and tasks. This Universal Extension provides the capability to submit Azure Jobs, add Azure Batch tasks to jobs as well as monitor tasks for completion.
Key Features:
Actions
Add an Azure Batch Job to a specific pool of nodes by providing the Azure Batch Job configuration in JSON format.
Add a task as part of a specific job & optionally monitor task for completion.
Authentication
Ability to connect to Azure using Client Credentials Grant Type.
Ability to connect to Azure using User Credentials Grant Type.
Free
Video
Azure Blob: Manage File Transfers
The integration for Azure Blob Storage allows secure transfer of files from Azure Blob Storage containers and folders.Storing data in the cloud becomes an integral part of most modern IT landscapes. With the Stonebranch Universal Automation Center, you can securely automate your AWS, Azure, Google, and MinIO file transfers and integrate them into your existing scheduling flows.
Key Features:
The following file transfer commands are supported:
Upload file(s) to an Azure Blob Storage container.
Download file(s) from an Azure Blob Storage container.
Transfer files between Azure Blob Storage containers.
List objects in an Azure Blob Storage container.
Delete object(s) in an Azure Blob Storage container.
List Azure Blob Storage container names.
Create an Azure Blob Storage container.
File transfer can be triggered by a third-party application using the Universal Automation Center RESTfull web service API: REST API.
The integration for Azure Blob Storage can be integrated into any existing scheduling workflow in the same way as any standard Linux or Windows task type.
Security is ensured by using the HTTPS protocol with support for an optional proxy server.
Supports Azure token-based Shared Access Signature (SAS).
No Universal Agent needs to be installed on the Azure cloud – the communication goes via HTTPS.
Free
Azure Data Factory: Schedule, Trigger, and Monitor
This integration allows users to schedule, trigger, and monitor the Azure Data Factory pipeline process directly from the Universal Controller.
Key Features:
Uses Python modules azure-mgmt-resource and azure-mgmt-datafactory to make REST API calls to Azure Data Factory.
Use the Azure tenant ID, subscription ID, client ID, client secret, resource group, and location for authenticating the REST API calls to Azure Data Factory.
Perform the following Azure Data Factory operations:
Run a pipeline.
Get a pipeline info.
List all pipelines.
Cancel pipeline run.
List factory by resource group.
Azure Data Factory triggers user can perform the following operations from UAC:
Start trigger.
Stop trigger.
List trigger by factory.
UAC also can restart a failed pipeline either from the failed step or from any activity name in the failed pipeline.
Free
Azure Logic Apps: Schedule, Trigger, and Monitor Workflows
This integration can trigger and monitor the execution of Azure Logic workflows and retrieve Azure Logic workflow output execution. The Stonebranch Universal Controller (UC) integrates with Logic apps through REST APIs securely through the Azure Oauth 2.0 authentication mechanism.
Key Features:
Passes dynamic input parameters (JSON format) to each Azure Logic app workflow.
Triggers a workflow, monitors it until the process is completed, and then delivers the results to UC.
Customers can manage and control Logic app workflow execution from UC, with the capability to employ other dependencies like time triggers or event-based jobs/workflows.
This task offers ITSM integration capability, enabling the auto-creation of incidents in Logic apps workflow execution failure.
Free
Video
Azure Synapse
Azure Synapse is a cloud-based analytics service that combines big data and data warehousing capabilities to enable organizations to ingest, prepare, manage, and analyze large volumes of data for business insights
This Universal Task provides the capability to run, monitor, and re-start Azure Synapse Pipelines from Universal Automation Center. Key Features:This Universal Task provides the following key features:
Run a Pipeline.Run a Pipeline with parameters.List all Pipelines in a Workspace.Monitor the started Synapse Pipeline. Cancel a Pipeline Run.Cancel a Pipeline Run Recursive.Rerun a Pipeline from a specified activity or the beginning.Service Principal-based Authentication to Azure Synapse. Certificate-based TLS connection.What's New in V1.2.0Enhancements: Json Output is provided for further processing of the output in, e.g., Workflows.
Free
Azure Virtual Machines: Start, Stop, and Terminate Instances
This integration allows users to utilize Azure Virtual Machine (VM) name, resource group, subscription ID, and access token as inputs to a start, stop, terminate, list, and check the status of Azure VMs.
Key Features:
Uses a Python request module to interact with the Azure cloud platform.
Expands user ability to start/stop/terminate/check/list Azure VMs that belong to a subscription and resource group.
In the Stonebranch Universal Controller (UC), this task reaches and stays in the success state until the Azure instance is completely started, stopped, or terminated.
Scheduling this task in UC with the right dependencies set up would start and stop EC2 instances based on business needs using a UC workflow.
This task helps to dynamically manage VM operations. It could potentially reduce the Azure VM running cost in the cloud.
Important:
This integration uses Azure Oauth 2.0 access token for Azure API authentication. Users may need to use the UC web services task to refresh the access token periodically.