Amazon S3: Cloud Storage Bucket File Transfer
The Amazon S3 Cloud Storage Bucket File Transfer integration allows you to securely automate file transfers from, to, and between Amazon S3 cloud storage buckets and third-party application folders.Storing data in the cloud becomes an integral part of most modern IT landscapes. With Universal Automation Center (UAC), you can securely automate your AWS tasks and integrate them into existing scheduling workflows. Key Features: Automate file transfers in real-time. Drag-and-drop as a task into any existing scheduling workflow within the UAC. File Transfers can be triggered by a third-party application using the UAC RESTfull web service API: REST API. The following file transfer commands are supported: Upload file(s) to an S3 bucket. Download file(s) from an S3 bucket. Transfer files between S3 buckets. List objects in an S3 bucket. Delete object(s) in an S3 bucket. List S3 bucket names. Create an S3 bucket. Additional Info: Security is ensured by using the HTTPS protocol with support for an optional proxy server. Supports AWS IAM Role-Based Access (RBCA). No Universal Agent needs to be installed on the AWS Cloud – the communication goes via HTTPS.AWS canned ACLs are supported, e.g., to grant full access to the bucket owner.
Amazon SQS: Message
Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. This Integration provides the capability to send an AWS SQS message towards an existing queue. Key Features: This Universal Extension provides the following main features: Send a message towards a standard or a FIFO queue. Capability to control the transport of the messages by configuring the message Delay Seconds (for standard queues) and the message group ID and message deduplication ID (for FIFO queues).Capability to fetch dynamically Queue Names list from SQS for selection during task creation.Capability to be authorized via IAM Role-Based Access Control (RBAC) strategy.Capability for Proxy communication via HTTP/HTTPS protocol. What's New in v1.1.1Introduction of fixes to improve the robustness of this integration.
Amazon SQS: Monitor
Amazon Simple Queue Service (SQS) is a fully managed message queuing service that enables you to decouple and scale microservices, distributed systems, and serverless applications. This Universal Extension provides the capability to monitor AWS SQS messages from an existing queue and run Universal Task and/or workflows accordingly.Key FeaturesThis Universal Extension provides the following main features:ActionMonitor AWS SQS messages from a standard or a FIFO queue.Launch a task in Universal Controller with variables holding the id, body, attributes, message attributes and receipt handle for each fetched message.AuthenticationAWS Credentials.IAM Role-Based Access Control (RBAC) strategy.OtherCommunication through Proxy with use of HTTP or HTTPS.What's New V1.1.1 Introduction of fixes to improve the robustness of this integration.
AWS Batch is a set of batch management capabilities that enables developers, scientists, and engineers to quickly and efficiently run hundreds of thousands of batch computing jobs on AWS. AWS Batch integration provides the ability to submit new AWS Batch Jobs and read the status for an existing AWS Batch Job. Key Features:This Universal Extension provides the following key features:Support to submit a new Batch Job, with the option to Terminate Job after a timeout period. Support to submit a new Batch Job and wait until it reaches state "success" or "failed".Support to read Batch Job status for an existing Job ID. Support for authorization via IAM Role-Based Access Control (RBAC) strategy. Support for Proxy communication via HTTP/HTTPS protocol.What's New in V1.3.0Extension Output is enhanced to provide the latest job information coming from the AWS Batch Service.
AWS EC2: Create Instances
This integration allows users to create an AWS EC2 instance with parameters, either in task form or by simply creating an EC2 instance from the existing AWS launch template. This task also offers the option to install a Linux/Unix Universal Agent in the newly provisioned EC2 instance. Key Features: The task interacts with the AWS platform via a Python Boto3 module. All AWS credentials remain encrypted. Users can also install/configure a Linux Universal Agent for each EC2 instance, enabling the Universal Controller to communicate with the newly created instance instantly. This task also lets users create multiple EC2 instances with the same configuration. New instances can also be tagged. It allows customers to create a new key pair or use an existing one for the new EC2 instance. This task also enables options for additional EBS volume and encryption, as well as detailed monitoring. Additional Info:Only Linux Universal Agent is supported at the moment.
AWS EC2: Start, Stop, and Terminate Instances
This integration allows users to spin up, terminate, and manage AWS EC2 instances on demand simply by providing one or more instance IDs as input. Key Features: This task uses Python Boto3 to interact with the AWS platform using the credentials supplied within the task. It supports multiple EC2 instances at once. This task goes to the success state in Universal Controller until the EC2 instance is completely spun up or terminated. Scheduling this task using Universal Controller workflow spins up and tears down EC2 instances based on the business needs, complete with the correct setup and dependencies. It dynamically manages EC2 operations, offering the potential to reduce EC2 operations costs in the cloud.
AWS Glue is a serverless data-preparation service for extract, transform, and load (ETL) operations. It makes it easy for data engineers, data analysts, data scientists, and ETL developers to extract, clean, enrich, normalize, and load data. This integration provides the capability to submit a new AWS Glue Job. Key Features: This Universal Extension provides the following key features: Actions Start a Glue job. Start a Glue job and wait until it reaches the state "success" or "failed". Authentication Authentication through HTTPS Authentication through IAM Role-Based Access Control (RBAC) strategy. Input/Output Option to pass Input Arguments as UAC script supporting UAC environment variables and UAC Functions. Other Support for Proxy communication via HTTP/HTTPS protocol. What's New in v1.2.0 What's new This new release gives the capability to users to Start a Glue job and wait until the Job reaches "Success" or "Failure". Key parameters such as job run status, id are updated live during execution. Furthermore, the option to pass Input Arguments as UAC script supporting UAC environment variables and UAC Functions was added.
AWS Lambda is a serverless compute service that runs your code in response to events and automatically manages the underlying compute resources. You can use AWS Lambda to extend other AWS services with custom logic or create your own back-end services that operate at AWS scale, performance, and security. AWS Lambda can automatically run code in response to multiple events, such as HTTP requests via Amazon API Gateway, modifications to objects in Amazon S3 buckets, table updates in Amazon DynamoDB, and state transitions in AWS Step Functions. Key Features:This Universal Extension provides the following key features:Trigger Lambda function Synchronously or Asynchronously. Support authorization via IAM Role-Based Access Control (RBAC) strategy. Support default or on demand AWS Region. Support Proxy communication via HTTP/HTTPS protocol.What's New v1.1.2 This new release provides a fix on the decoding of AWS Log Message.
AWS Mainframe Modernization
AWS Mainframe Modernization service is an AWS cloud-native platform to migrate, modernize, execute, and operate mainframe applications within a fully-managed runtime. Stonebranch Universal Automation Center (UAC) works with AWS Mainframe Modernization to offer a high-availability, template-driven approach to shift existing mainframe batch schedules and event-based automation to re-platformed or refactored mainframe applications that run on AWS. Using the Stonebranch AWS Mainframe Modernization extension, enterprises may run automation in both the mainframe and on AWS simultaneously. Key Features: The ability to schedule, automate and execute mainframe batch jobs running in AWS Mainframe Modernization Service via the Stonebranch Universal ControllerMonitor Application’s batch processes from the Stonebranch Universal ControllerStart/Restart/Rerun/Cancel batch processes automatically or manually from the Stonebranch Universal ControllerSynchronous and asynchronous batch execution from Stonebranch Universal ControllerRetrieve the results of the AWS Mainframe Modernization Batch processesCapture the AWS Cloudwatch logs of the executed jobs in Stonebranch Universal Controller More information: Article: Mainframe Modernization - How Automation Makes it PossibleTechnical Brief: Mainframe Modernization: Convert Mainframe-Centric Schedulers to a Modern Service Orchestration and Automation PlatformWhat's New In 1.4.0: * BluAge support added* Log Fetching Methods updated
AWS Step Functions
Step Functions is a serverless orchestration service that lets you combine AWS Lambda functions and other AWS services to build business-critical applications. Through Step Functions graphical console, you see your application’s workflow as a series of event-driven steps.This integration allows customers to execute AWS Step Functions from Universal Controller.Key FeaturesThis Universal Extension provides the following key features.ActionsExecute a AWS Step Function and wait until is reaches status "Success" or "Failed".Execute a AWS Step Function asynchronously without waiting for the execution to finish.AuthenticationAuthentication using AWS CredentialsAuthorization via IAM Role-Based Access Control (RBAC) strategy.OtherCommunication through Proxy with use of HTTP or HTTPS.Whats New V2.0.0Breaking Change: This version supports Universal Agent and Universal Controler from version 7.2 onwards. Customers that used older versions of this integration on Universal Controller and Universal Agent of versions <= 7.2 are required to upgrade to use the new functionality introduced by 2.0.0. Added: A suffix is added to the Execution Name before AWS Service is called. That suffix represents the execution count for a specific task instance, therefore providing uniqueness of the Execution Name. Fix: The Extension Output attribute “fields.invocation.execution_name” is corrected to represent the user input after the resolution of UC Functions and variables
Inter-Cloud Data Monitor
This Universal Extension is an interface to Rclone that provides the capability to monitor files/directories from across different cloud storages, as well as local or distributed file systems. Additionally and upon successful monitor, this extension publishes Local Universal Events. To properly handle these events and take action on them, this Universal Extension optionally can be attached as a Publisher to a Universal Monitor Task (see more details in section Cloud File Monitor Events). Rclone, is the open-source command line program that is utilized to accomplish all the actions supported in this Extension. Download with: Inter-Cloud Data Transfer Key Features: This Universal Extension supports the following key features: Action Monitor objects creation Monitor objects change - change based on modification time Monitor objects deletion Options Trigger On Existence - available for Action Monitor On Create. Advanced filtering capability for objects to be monitored. Support for providing additional Rclone options according to the user needs. Universal Event Event published upon single object creation, holding information about the new object Event published upon single object change, holding information about the updated file, including the latest object size and modification time. Event published upon single object deletion, holding information about the deleted object. Event published upon single object existence, holding information about the object.
Inter-Cloud Data Transfer
This Universal Extension provides the capability to perform data transfers between cloud-based storage services as well as local or distributed file systems. Transfers are fast and secure since data are streamed from one storage to another with no intermediate storage taking place. Multiple storage systems are supported (an overview can be found here). Integrations within this solution package include: AWS S3 Google Cloud Storage Microsoft OneDrive Business, including Sharepoint Microsoft Azure Blob Storage Hadoop Distributed File Storage (HDFS) Local file system (Linux, Windows) HTTP(S) URL Download with: Inter-Cloud Data MonitorKey Features: This Universal Extension supports the following key features: Actions List objects, list directory Copy, move, synchronize data between two storages. Copy a URL's content and to cloud or local destination without saving it in temporary storage. List data on a storage, including listing with details or in JSON format for machine parsing. Create objects on a storage. Delete objects from a storage. Features: Fast transfers for objects stored in the same region. Preserves always timestamps and verifies checksums. Supports encryption, caching, compression, chunking. Dynamic token updates for OneDrive Business cloud storage, observing the OneDrive business refresh token flow. Support for dry runs. Allows users to execute a Universal Task without making any permanent changes on the target storage. Advanced filtering capability for files or objects to be listed or transferred. Option to mark the Universal Task as Failed when no files have been transferred. List of overwrite options for existing data. Additional customized options. Output: Progress of the selected Action is visible, during Universal Task Instance execution. Text or JSON formatted output. What's new in V3.0.0Introduced Observability metrics enabling enhanced visibility and understanding of behavior for Task Instances (UAC v7.5 and onwards).Progress bar now syncs with RClone's transfer completion (UAC v7.3 and onwards).Added the filter option to all list related actions.Improved clarity of RClone's log messages with respect to log level.Breaking Changes"Status Description" text information has been updated to improve readability. Tasks or workflows evaluating the "Status Description" of the task Instance, either programmatically or within UAC, might be affected by it. In that case, they need to conform to the new "Status Description" Text.Extension Invocation Fields > Credential fields are displayed as an object for better readability.