Azure AZ CLI
`The Azure command-line interface (Azure CLI) is a set of commands used to create and manage Azure resources. The Azure CLI is available across Azure services and is designed to get you working quickly with Azure, with an emphasis on automation.The Universal Task for Azure AZ CLI allows calling a single or a set of Azure CLI commands. Key FeaturesThis Universal Task provides the following key features:The Universal Task for Azure AZ CLI allows you to schedule and Invoke Azure CLI commands.Either a single command or a list of commands can be invoked.No Azure CLI needs to be installed. This Universal Task uses Microsoft-maintained Python modules azure-cli.The following functionalities can be performed:Authenticate with Azure using your Azure user credentials.Authenticate with Azure with a service principal.Invoke a single Azure CLI commands.Invoke a list of Azure CLI commands provides via a Universal Controller Script file.Chooses different log-levels.The Task can run on any Windows or Linux Agent, without the need to install the Azure CLI.
Azure Batch is a set of batch management capabilities that enables developers, scientists, and engineers to easily and efficiently create Azure Batch jobs and tasks. This Universal Extension provides the capability to submit Azure Jobs, add Azure Batch tasks to jobs as well as monitor tasks for completion.Key Features: Actions Add an Azure Batch Job to a specific pool of nodes by providing the Azure Batch Job configuration in JSON format. Add a task as part of a specific job & optionally monitor task for completion. Authentication Ability to connect to Azure using Client Credentials Grant Type. Ability to connect to Azure using User Credentials Grant Type.
Azure Blob: Manage File Transfers
The integration for Azure Blob Storage allows secure transfer of files from Azure Blob Storage containers and folders.Storing data in the cloud becomes an integral part of most modern IT landscapes. With the Stonebranch Universal Automation Center, you can securely automate your AWS, Azure, Google, and MinIO file transfers and integrate them into your existing scheduling flows. Key Features: The following file transfer commands are supported: Upload file(s) to an Azure Blob Storage container. Download file(s) from an Azure Blob Storage container. Transfer files between Azure Blob Storage containers. List objects in an Azure Blob Storage container. Delete object(s) in an Azure Blob Storage container. List Azure Blob Storage container names. Create an Azure Blob Storage container. File transfer can be triggered by a third-party application using the Universal Automation Center RESTfull web service API: REST API. The integration for Azure Blob Storage can be integrated into any existing scheduling workflow in the same way as any standard Linux or Windows task type. Security is ensured by using the HTTPS protocol with support for an optional proxy server. Supports Azure token-based Shared Access Signature (SAS). No Universal Agent needs to be installed on the Azure cloud – the communication goes via HTTPS.
Azure Data Factory: Schedule, Trigger, and Monitor
This integration allows users to schedule, trigger, and monitor the Azure Data Factory pipeline process directly from the Universal Controller. Key Features: Uses Python modules azure-mgmt-resource and azure-mgmt-datafactory to make REST API calls to Azure Data Factory. Use the Azure tenant ID, subscription ID, client ID, client secret, resource group, and location for authenticating the REST API calls to Azure Data Factory. Perform the following Azure Data Factory operations: Run a pipeline. Get a pipeline info. List all pipelines. Cancel pipeline run. List factory by resource group. Azure Data Factory triggers user can perform the following operations from UAC: Start trigger. Stop trigger. List trigger by factory. UAC also can restart a failed pipeline either from the failed step or from any activity name in the failed pipeline.
Azure Logic Apps: Schedule, Trigger, and Monitor Workflows
This integration can trigger and monitor the execution of Azure Logic workflows and retrieve Azure Logic workflow output execution. The Stonebranch Universal Controller (UC) integrates with Logic apps through REST APIs securely through the Azure Oauth 2.0 authentication mechanism. Key Features: Passes dynamic input parameters (JSON format) to each Azure Logic app workflow. Triggers a workflow, monitors it until the process is completed, and then delivers the results to UC. Customers can manage and control Logic app workflow execution from UC, with the capability to employ other dependencies like time triggers or event-based jobs/workflows. This task offers ITSM integration capability, enabling the auto-creation of incidents in Logic apps workflow execution failure.
Azure Synapse is a cloud-based analytics service that combines big data and data warehousing capabilities to enable organizations to ingest, prepare, manage, and analyze large volumes of data for business insights This Universal Task provides the capability to run, monitor, and re-start Azure Synapse Pipelines from Universal Automation Center. Key Features:This Universal Task provides the following key features: Run a Pipeline.Run a Pipeline with parameters.List all Pipelines in a Workspace.Monitor the started Synapse Pipeline. Cancel a Pipeline Run.Cancel a Pipeline Run Recursive.Rerun a Pipeline from a specified activity or the beginning.Service Principal-based Authentication to Azure Synapse.
Azure Virtual Machines: Start, Stop, and Terminate Instances
This integration allows users to utilize Azure Virtual Machine (VM) name, resource group, subscription ID, and access token as inputs to a start, stop, terminate, list, and check the status of Azure VMs. Key Features: Uses a Python request module to interact with the Azure cloud platform. Expands user ability to start/stop/terminate/check/list Azure VMs that belong to a subscription and resource group. In the Stonebranch Universal Controller (UC), this task reaches and stays in the success state until the Azure instance is completely started, stopped, or terminated. Scheduling this task in UC with the right dependencies set up would start and stop EC2 instances based on business needs using a UC workflow. This task helps to dynamically manage VM operations. It could potentially reduce the Azure VM running cost in the cloud. Important: This integration uses Azure Oauth 2.0 access token for Azure API authentication. Users may need to use the UC web services task to refresh the access token periodically.
E-Mail: SMTP and IMAP Integration
This integration is for any email provider that uses SMTP and IMAP, including email vendors like Outlook.com, Microsoft Exchange, and Gmail. This integration allows sending and retrieve E-Mails and E-Mail attachments. It also provides the functionality to download mail attachments to a mail folder. This Integration is beneficial for Stonebranch SaaS customers, accessing the Universal Controller in the Stonebranch AWS Cloud and having their Universal Agents deployed in their own datacenter. As the Integration is triggered from the Universal Agent, no additional firewall ports would need to be opened. Key Features Some details about Universal Tasks to send and retrieve E-Mails and E-Mail attachments. Main functionalities: Send an E-Mail with or without attachments Use Universal Controller Variables Retrieve an E-Mail based on filter criteria like From, To, sender, subject, body content … Move an E-Mail to a Mail folder after downloading it to a configured folder Delete an E-Mail after downloading it to a configured folder
Inter-Cloud Data Monitor
This Universal Extension is an interface to Rclone that provides the capability to monitor files/directories from across different cloud storages, as well as local or distributed file systems. Additionally and upon successful monitor, this extension publishes Local Universal Events. To properly handle these events and take action on them, this Universal Extension optionally can be attached as a Publisher to a Universal Monitor Task (see more details in section Cloud File Monitor Events). Rclone, is the open-source command line program that is utilized to accomplish all the actions supported in this Extension. Download with: Inter-Cloud Data Transfer Key Features: This Universal Extension supports the following key features: Action Monitor objects creation Monitor objects change - change based on modification time Monitor objects deletion Options Trigger On Existence - available for Action Monitor On Create. Advanced filtering capability for objects to be monitored. Support for providing additional Rclone options according to the user needs. Universal Event Event published upon single object creation, holding information about the new object Event published upon single object change, holding information about the updated file, including the latest object size and modification time. Event published upon single object deletion, holding information about the deleted object. Event published upon single object existence, holding information about the object.
Inter-Cloud Data Transfer
This Universal Extension provides the capability to perform data transfers between cloud-based storage services as well as local or distributed file systems. Transfers are fast and secure since data are streamed from one storage to another with no intermediate storage taking place. Multiple storage systems are supported (an overview can be found here). Integrations within this solution package include: AWS S3 Google Cloud Storage Microsoft OneDrive Business, including Sharepoint Microsoft Azure Blob Storage Hadoop Distributed File Storage (HDFS) Local file system (Linux, Windows) HTTP(S) URL Download with: Inter-Cloud Data MonitorKey Features: This Universal Extension supports the following key features: Actions List objects, list directory Copy, move, synchronize data between two storages. Copy a URL's content and to cloud or local destination without saving it in temporary storage. List data on a storage, including listing with details or in JSON format for machine parsing. Create objects on a storage. Delete objects from a storage. Features: Fast transfers for objects stored in the same region. Preserves always timestamps and verifies checksums. Supports encryption, caching, compression, chunking. Dynamic token updates for OneDrive Business cloud storage, observing the OneDrive business refresh token flow. Support for dry runs. Allows users to execute a Universal Task without making any permanent changes on the target storage. Advanced filtering capability for files or objects to be listed or transferred. Option to mark the Universal Task as Failed when no files have been transferred. List of overwrite options for existing data. Additional customized options. Output: Progress of the selected Action is visible, during Universal Task Instance execution. Text or JSON formatted output. What's new in V3.0.0Introduced Observability metrics enabling enhanced visibility and understanding of behavior for Task Instances (UAC v7.5 and onwards).Progress bar now syncs with RClone's transfer completion (UAC v7.3 and onwards).Added the filter option to all list related actions.Improved clarity of RClone's log messages with respect to log level.Breaking Changes"Status Description" text information has been updated to improve readability. Tasks or workflows evaluating the "Status Description" of the task Instance, either programmatically or within UAC, might be affected by it. In that case, they need to conform to the new "Status Description" Text.Extension Invocation Fields > Credential fields are displayed as an object for better readability.
Microsoft Power BI: Refresh Business Intelligence
This integration allows users to refresh datasets and dataflows in the Microsoft Power BI business analytics service. Key Features: Refresh a dataset in a group-workspace or in my workspace. Refresh a dataflow in a group-workspace. Lookup datasets in a selected group. Lookup dataflows in a selected group. Connection to the Power BI REST API is done via the Python MSAL library. Supports Windows and Linux Universal Agents in order to connect to the Power BI REST API.
Microsoft SQL: Schedule SSRS
This integration can complete various administrative tasks, including publishing reports and moving reports from one server to another server. It's based on the SQL Server Reporting Services 'rs.exe' command-line utility, which can perform many scripted operations related to SQL Server Reporting Services (SSRS). The rs.exe utility requires an input file to tell rs.exe what to do.The list of actual tasks that can be performed includes among others: Deploying / Publishing reports Moving reports Exporting reports to a file Adjust security Cancel a running job Configure SSRS system properties
Microsoft SQL: SSIS Package Execution
SQL Server Integration Services (SSIS) is a platform for building data integrations and data transformation solutions.This Universal Extension task interactively allows users to list and select the SSIS Folder, Project, Environment Reference, and SSIS Package while creating the job. Furthermore, it can trigger the SSIS package execution in the Microsoft SQL server, monitor the SSIS Package execution, and fetch SSIS logs to Universal Controller when the SSIS package execution has been completed.Key Features:This Universal Extension provides the following key features:Dynamic Choice Fields to select the SSIS Folder/Project/Package/Environment Reference ID.Launch SSIS Package execution. Monitor SSIS Package execution.Fetch SSIS Package execution logs.SSIS Execution ID and Execution status captured for every execution in the Task Instance.Connection to MS SQL Server is done via the Python PYMSSQL module.Supports Windows and Linux Universal Agents in order to connect to the MSSQL server.What's in V1.0.4This new release involves a minor bug fix.
Microsoft Teams: Monitor Channel
Microsoft Teams is a collaboration app that helps teams stay organized and have conversations. This Integration provides the capability to monitor a Microsoft Teams channel for uploaded files and run job(s) and/or workflows accordingly. Key Features This Universal Extension provides the following main features: Support authentification to Microsoft Teams with Oauth2 protocol (Grant Type: Resource Owner Password Credentials) For a specific Microsoft Teams Channel, periodically poll all the new messages since the last lookup For each fetched message having attachments, launch a task in Universal Controller with variables holding message and attachment details Ability to resume from the last read message on restart.
Microsoft Teams: Notifications
This integration allows users to send messages to an existing channel of Microsoft Teams. Key Features: End-users can request notifications within Teams alerting them about task results from Stonebranch Universal Automation Center. Task results can include items like completed workflows and task failures. Only requires a Python library 'pymsteams' to function.
Microsoft Teams: Send and Receive Notifications
This integration enables users to receive task-related notifications and send task-related approvals through a Teams channel. It uses incoming webhooks to integrate Microsoft Teams with the Stonebranch Universal Automation Center (UAC). Key Features: Using this task, UAC task-related information can be sent directly to an operational Teams channel. Send interactive messages to a Teams channel to trigger an approval process for manual tasks whenever user intervention is needed. End-users can request notifications within Teams alerting them about UAC task results. Task results can include items like completed workflows and task failures. Additional Info: Requires serverless infrastructure (e.g., AWS Lambda, Microsoft Azure Functions, or Google Cloud Functions).
Microsoft Teams: Send Message with Attachment
Microsoft Teams is a collaboration app that helps teams stay organized and have conversations. This Universal Extension provides the capability to post messages with attachments on a Microsoft Teams channel. Key Features This Universal Extension provides the following main features: Support to post a message with an attachment on a Microsoft Teams channel Support for authentication to Microsoft Teams with Oauth2 ROPC (Resource Owner Password Credentials) grant type Support for different attachment handling options in case an attachment already exists in Microsoft Sharepoint (fail, replace, rename)
Microsoft Visual Studio: Code Extension
The Microsoft Visual Studio Code Extension for the Universal Integration Platform (UIP) enhances the development experience of creating and working with Universal Extensions. This extension allows users to develop their own Universal Extensions within Visual Studio. To access this extension, download it directly from the Visual Studio Marketplace. Download NowKey Features: Provides an IDE wrapper for the uip-cli command line utilityQuickly prototype Extensions using starter Extension TemplatesBuild and upload Extensions and/or Universal TemplatesPull the latest Universal Template source files from the ControllerDownload the full Universal Template packageDebug Extensions locally without the need of Agent and Controller Note: End user often pair this extension with version control systems like Git or GitHub. In addition, if you prefer coding automated jobs and workflows, take a look at the jobs-as-code extension.
SQL: ODBC Task
This Universal Extension provides the capability to integrate with ODBC compliant database, by running single or multiple SQL commands and retrieving the resulting data. While it is designed to work with any ODBC-compliant database, it is thoroughly tested against MySQL, MSSQL Server PostgreSQL, and Oracle databases. As opposed to the native UAC SQL Task, which runs on the Controller, this integration allows the user to run an SQL Task from the Agent.Key FeaturesFlexibility in database connection definition supporting DSN, FILE DNS and Connection String.Rich metadata information.Capability to store SQL results in files (CSV or JSON format).Rich Observability capabilitiesWhat's New in V2.0.0Rich observability capabilitiesFeature added to protect task authors from pushing into Universal Controller unnecessary database data by providing the capability to control the number of lines from the SQL result set that will be available on extension output. Task Authors can use UE_EXTENSION_OUTPUT_MAX_SQL_ROWS environment variable to control the behavior Breaking changesCompatibility of this integration has been changed. It is applicable for Universal Controller and Universal Agent with version >=7.2 "Status Description" text information has been updated. Tasks or workflows evaluating the "Status Description" of the task Instance, either programmatically or within UAC, might be affected by it. In that case, they need to conform to the new "Status Description" Text In this version, by default, the returned datasets displayed on the extension output are truncated to the first 100 rows. If more than 100 rows need to be pushed into the extension output, the environment variable UE_EXTENSION_OUTPUT_MAX_SQL_ROWS needs to be set appropriately on the task definition Extension Invocation Fields > Credential fields are displayed as an object for better readabilityWhat's New in V2.1.0Official support for Amazon Redshift Database.New Choice Field “SQL Source” that gives the opportunity to provide the SQL Script either as a UAC Script or as plain text.Enhanced security when the Connection Method is “Connection String” by selecting the proper Credential and passing it via the connection string. This can be achieved using the following notation: [credential_name].user and [credential_name].password.Fix "authenticate with the system user" connectivity when the Connection Method is “Connection String” and the Database Type is “MSSQL”.