Apache Airflow is an open-source platform created to programmatically author, schedule, and monitor workflows. This Universal Extension provides the capability to integrate with an Apache Airflow Standalone Server or Google Cloud Composer Airflow and use it as part of your end-to-end UC workflow, allowing high-level visibility and orchestration of data-oriented jobs or pipelines.You gain many enterprise-level benefits by using the Universal Automation Center to control Airflow. Notable benefits include: Run your Airflow data pipelines in realtime by using event-based triggers from the UCAdd Airflow tasks to broader business process workflows in the UCGain observability of your Airflow workflows - with proactive alerts from the the UCRead this article to learn more about the benefits of integrating Airflow with the Universal Automation Center.Key FeaturesThis Universal Extension provides the following key features:ActionsTrigger a DAG run and optionally wait until the DAG was reached "success" or "failure".Information retrieval of a specific DAG Run.Information retrieval for a task that is part of a specific DAG Run.AuthenticationBasic authentication for Stand Alone Airflow Server.Service Account Private Key for Google Cloud Composer.OtherCapability to use HTTP or HTTPS proxy instead of direct communication to Stand Alone Airflow Server. What's new v 2.0.0 The latest release provides the ability to integrate with Google Cloud Composer Airflow Server. Furthermore, provides the ability to configure Action "Trigger DAG Run", by passing JSON configuration parameters.

Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. A Kafka Event Monitor is a Universal Extension responsible for monitoring events (messages) from topics in Kafka.    Key Features:   This Universal Extension provides the following main features:   Monitor messages and consume a Kafka message by consumer group topic subscriptionAuthenticate against Kafka using PLAINTEXT, SASL_SSL or SSL security protocolCapability to filter Kafka messages based on the value of the message. Number, String and JSON filter patterns are supported.Capability to fetch dynamically Kafka topics, during task creation.Capability to control the partition assignment strategy, as well as session-related timeout values   Typically this extension can be used to monitor events from Kafka and upon successful execution to trigger workflows or other tasks, or just to pass information related to the Kafka event within UAC.   What's New in V1.1.0With this new release client authentication over SSL is supported.  

Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. This Integration is responsible for publishing events (messages) to topics in Kafka.   Key Features: This Universal Extension supports the following main features: Perform authentication towards Kafka, using PLAINTEXT or SASL_SSL security protocol Send a message to Kafka with the capability to select, the topic, the partition, the message key, the message value and message metadata Capability to control the transport of the messages by configuring the message acknowledgment strategy and the request timeout Capability to fetch dynamically topics and partitions from kafka for selection during task creation Capability to automatically select the serialization method depending on the key/value message data types What's New in V1.2.0This new release improves robustness of this integration and adds a number of useful features:Support for client authentication over SSL against Kafka bootstrap server.Extension Output is now provided upon successful execution.Debug mode execution is enhanced to properly close extension execution.Partition field enhanced to show and use all its dependent fields.

AWS Mainframe Modernization service is an AWS cloud-native platform to migrate, modernize, execute, and operate mainframe applications within a fully-managed runtime. Stonebranch Universal Automation Center (UAC) works with AWS Mainframe Modernization to offer a high-availability, template-driven approach to shift existing mainframe batch schedules and event-based automation to re-platformed or refactored mainframe applications that run on AWS. Using the Stonebranch AWS Mainframe Modernization extension, enterprises may run automation in both the mainframe and on AWS simultaneously.  Key Features: The ability to schedule, automate and execute mainframe batch jobs running in AWS Mainframe Modernization Service via the Stonebranch Universal ControllerMonitor Application’s batch processes from the Stonebranch Universal ControllerStart/Restart/Rerun/Cancel batch processes automatically or manually from the Stonebranch Universal ControllerSynchronous and asynchronous batch execution from Stonebranch Universal ControllerRetrieve the results of the AWS Mainframe Modernization Batch processesCapture the AWS Cloudwatch logs of the executed jobs in Stonebranch Universal Controller More information: Article: Mainframe Modernization - How Automation Makes it PossibleTechnical Brief: Mainframe Modernization: Convert Mainframe-Centric Schedulers to a Modern Service Orchestration and Automation PlatformWhat's New In 1.4.0:  * BluAge support added* Log Fetching Methods updated

Step Functions is a serverless orchestration service that lets you combine AWS Lambda functions and other AWS services to build business-critical applications. Through Step Functions graphical console, you see your application’s workflow as a series of event-driven steps.This integration allows customers to execute AWS Step Functions from Universal Controller.Key FeaturesThis Universal Extension provides the following key features.ActionsExecute a AWS Step Function and wait until is reaches status "Success" or "Failed".Execute a AWS Step Function asynchronously without waiting for the execution to finish.AuthenticationAuthentication using AWS CredentialsAuthorization via IAM Role-Based Access Control (RBAC) strategy.OtherCommunication through Proxy with use of HTTP or HTTPS.Whats New V2.0.0Breaking Change: This version supports Universal Agent and Universal Controler from version 7.2 onwards. Customers that used older versions of this integration on Universal Controller and Universal Agent of versions <= 7.2 are required to upgrade to use the new functionality introduced by 2.0.0. Added: A suffix is added to the Execution Name before AWS Service is called. That suffix represents the execution count for a specific task instance, therefore providing uniqueness of the Execution Name. Fix: The Extension Output attribute “fields.invocation.execution_name” is corrected to represent the user input after the resolution of UC Functions and variables

This integration is for any email provider that uses SMTP and IMAP, including email vendors like Outlook.com, Microsoft Exchange, and Gmail. This integration allows sending and retrieve E-Mails and E-Mail attachments. It also provides the functionality to download mail attachments to a mail folder. This Integration is beneficial for Stonebranch SaaS customers, accessing the Universal Controller in the Stonebranch AWS Cloud and having their Universal Agents deployed in their own datacenter. As the Integration is triggered from the Universal Agent, no additional firewall ports would need to be opened. Key Features Some details about Universal Tasks to send and retrieve E-Mails and E-Mail attachments. Main functionalities: Send an E-Mail with or without attachments Use Universal Controller Variables Retrieve an E-Mail based on filter criteria like From, To, sender, subject, body content … Move an E-Mail to a Mail folder after downloading it to a configured folder Delete an E-Mail after downloading it to a configured folder

Fivetran is a cloud-based data integration platform that helps businesses automate the process of extracting data from various sources, transforming it, and loading it into a data warehouse for analysis. It offers a wide range of pre-built connectors to popular data sources such as databases, marketing platforms, CRMs, and more. Fivetran's connectors are designed to be easy to set up and use, allowing businesses to focus on data analysis rather than data integration. The platform also offers features such as data transformation, scheduling, monitoring, and access control to help organizations manage their data pipelines more efficiently. Fivetran supports a variety of data warehouses, including Amazon Redshift, Google BigQuery, Snowflake, and Microsoft Azure. This integration allows to create and execute Fivetran Tasks in Universal Controller.   Key Features: Trigger a Sync action on a Connector. Optionally, wait until Sync is completed. Trigger a Re-sync (Historical Sync) action on a Connector. Optionally, wait until Re-sync is completed. What's New in V1.0.1 A fix is provided to execute the integration with a Python installation, other than the one that is bundled with the Universal Agent.

This Universal Extension is an interface to Rclone that provides the capability to monitor files/directories from across different cloud storages, as well as local or distributed file systems. Additionally and upon successful monitor, this extension publishes Local Universal Events. To properly handle these events and take action on them, this Universal Extension optionally can be attached as a Publisher to a Universal Monitor Task (see more details in section Cloud File Monitor Events). Rclone, is the open-source command line program that is utilized to accomplish all the actions supported in this Extension. Download with: Inter-Cloud Data Transfer Key Features:  This Universal Extension supports the following key features: Action Monitor objects creation Monitor objects change - change based on modification time Monitor objects deletion Options Trigger On Existence - available for Action Monitor On Create. Advanced filtering capability for objects to be monitored. Support for providing additional Rclone options according to the user needs. Universal Event Event published upon single object creation, holding information about the new object Event published upon single object change, holding information about the updated file, including the latest object size and modification time. Event published upon single object deletion, holding information about the deleted object. Event published upon single object existence, holding information about the object.

This Universal Extension provides the capability to perform data transfers between cloud-based storage services as well as local or distributed file systems. Transfers are fast and secure since data are streamed from one storage to another with no intermediate storage taking place. Multiple storage systems are supported (an overview can be found here). Integrations within this solution package include:  AWS S3 Google Cloud Storage Microsoft OneDrive Business, including Sharepoint Microsoft Azure Blob Storage Hadoop Distributed File Storage (HDFS) Local file system (Linux, Windows) HTTP(S) URL Download with:  Inter-Cloud Data MonitorKey Features: This Universal Extension supports the following key features: Actions List objects, list directory Copy, move, synchronize data between two storages. Copy a URL's content and to cloud or local destination without saving it in temporary storage. List data on a storage, including listing with details or in JSON format for machine parsing. Create objects on a storage. Delete objects from a storage. Features: Fast transfers for objects stored in the same region. Preserves always timestamps and verifies checksums. Supports encryption, caching, compression, chunking. Dynamic token updates for OneDrive Business cloud storage, observing the OneDrive business refresh token flow. Support for dry runs. Allows users to execute a Universal Task without making any permanent changes on the target storage. Advanced filtering capability for files or objects to be listed or transferred. Option to mark the Universal Task as Failed when no files have been transferred. List of overwrite options for existing data. Additional customized options. Output: Progress of the selected Action is visible, during Universal Task Instance execution. Text or JSON formatted output.  What's new in V3.0.0Introduced Observability metrics enabling enhanced visibility and understanding of behavior for Task Instances (UAC v7.5 and onwards).Progress bar now syncs with RClone's transfer completion (UAC v7.3 and onwards).Added the filter option to all list related actions.Improved clarity of RClone's log messages with respect to log level.Breaking Changes"Status Description" text information has been updated to improve readability. Tasks or workflows evaluating the "Status Description" of the task Instance, either programmatically or within UAC, might be affected by it. In that case, they need to conform to the new "Status Description" Text.Extension Invocation Fields > Credential fields are displayed as an object for better readability.

SQL Server Integration Services (SSIS) is a platform for building data integrations and data transformation solutions.This Universal Extension task interactively allows users to list and select the SSIS Folder, Project, Environment Reference, and SSIS Package while creating the job. Furthermore, it can trigger the SSIS package execution in the Microsoft SQL server, monitor the SSIS Package execution, and fetch SSIS logs to Universal Controller when the SSIS package execution has been completed.Key Features:This Universal Extension provides the following key features:Dynamic Choice Fields to select the SSIS Folder/Project/Package/Environment Reference ID.Launch SSIS Package execution. Monitor SSIS Package execution.Fetch SSIS Package execution logs.SSIS Execution ID and Execution status captured for every execution in the Task Instance.Connection to MS SQL Server is done via the Python PYMSSQL module.Supports Windows and Linux Universal Agents in order to connect to the MSSQL server.What's in V1.0.4This new release involves a minor bug fix.

Microsoft Teams is a collaboration app that helps teams stay organized and have conversations. This Integration provides the capability to monitor a Microsoft Teams channel for uploaded files and run job(s) and/or workflows accordingly. Key Features This Universal Extension provides the following main features: Support authentification to Microsoft Teams with Oauth2 protocol (Grant Type: Resource Owner Password Credentials) For a specific Microsoft Teams Channel, periodically poll all the new messages since the last lookup For each fetched message having attachments, launch a task in Universal Controller with variables holding message and attachment details Ability to resume from the last read message on restart.

This integration allows users to send messages to an existing channel of Microsoft Teams. Key Features: End-users can request notifications within Teams alerting them about task results from Stonebranch Universal Automation Center. Task results can include items like completed workflows and task failures. Only requires a Python library 'pymsteams' to function.

This integration enables users to receive task-related notifications and send task-related approvals through a Teams channel. It uses incoming webhooks to integrate Microsoft Teams with the Stonebranch Universal Automation Center (UAC).  Key Features: Using this task, UAC task-related information can be sent directly to an operational Teams channel. Send interactive messages to a Teams channel to trigger an approval process for manual tasks whenever user intervention is needed. End-users can request notifications within Teams alerting them about UAC task results. Task results can include items like completed workflows and task failures. Additional Info:  Requires serverless infrastructure (e.g., AWS Lambda, Microsoft Azure Functions, or Google Cloud Functions).

Microsoft Teams is a collaboration app that helps teams stay organized and have conversations. This Universal Extension provides the capability to post messages with attachments on a Microsoft Teams channel. Key Features This Universal Extension provides the following main features: Support to post a message with an attachment on a Microsoft Teams channel Support for authentication to Microsoft Teams with Oauth2 ROPC (Resource Owner Password Credentials) grant type Support for different attachment handling options in case an attachment already exists in Microsoft Sharepoint (fail, replace, rename)

Qlik Sense is a Business Intelligence (BI) Tool. Qlik Sense users can connect and combine data from hundreds of data sources by defining data pipelines as applications. Data can then be visualized via custom dashboards on the Qlik Sense Cloud or Desktop application. Key Features:This Universal Extension provides the following key features:Support to reload a Qlik Sense Cloud Application Support to read the status of an already reloaded Qlik Sense Cloud Application What's New V1.1.0This new release introduces a button that gives the capability to users to trigger and wait until the Qliksense app reaches status "Success" or "Failed".

This integration allows users to create contact and lead objects in Salesforce and execute Salesforce Object Query Language (SOQL) queries.  Key Features: Allows advanced automation by enabling the creation of Salesforce objects (e.g., contacts and leads) from the Stonebranch Universal Controller, as well as event-based triggers. Use the Salesforce Object Query Language (SOQL) to search your organization's Salesforce data for specific information. SOQL is similar to the 'select' statement in SQL, but specifically for Salesforce data. With SOQL, users can construct simple but powerful query strings and execute them from within the Universal Controller.

SAP Integrated Business Planning (IBP) is a cloud-based planning software for supply chain management and this Universal Extension helps to integrate with SAP IBP to Schedule & launch a SAP IBP Job Template or process chain from Universal ControllerKey FeaturesThis Universal Extension provides the following main features:The ability to schedule, automate and execute SAP IBP jobs running in SAP Cloud via Stonebranch Universal ControllerMonitor SAP IBP Jobs from the Stonebranch Universal ControllerStart/Rerun/Cancel batch processes automatically or manually from the Stonebranch Universal ControllerRetrieve the results of the SAP IBP Jobs that are executedCancel a IBP Job execution via dynamic command or by a separate task using the cancel function choiceDisplaying real time IBP execution status in Universal ControllerWhat's New in V1.0.1This new release involves a minor bug fixFix: issue during import due to incompatibility of the extension name

This integration for SAP batch input allows users to schedule and execute batch input sessions in SAP. Batch input sessions enter data non-interactively into an SAP system. It's typically used to transfer data from non-SAP systems to SAP systems or to transfer data between SAP systems. Key Features: Runs a batch input session. You only need to provide the batch input session name in the task variable. It's possible to use wildcards (*) to run multiple batch input sessions. There's no need to create a variant manually for the batch input session in SAP. The SAP task uses the feature inline variants of USAP to create a temporary variant for the ABAP RSBDCSUB with the batch input session name. We are an SAP silver partner. Our product has certified integration with SAP S/4HANA.

Schedule any SAP BusinessObjects Data Services ETL job from the Stonebranch Universal Automation Center, using the 'AL_RWJobLauncher.exe' utility that comes with SAP Data Services.Using analytics tools to collect massive amounts of big data from your organization is one thing. Extracting meaning from that data and using it to drive real growth is another. BusinessObjects analytics from SAP can help you unleash the power of collective insight by delivering enterprise business intelligence, agile visualizations, and advanced predictive analytics to all users.Key Features:The integration provides the same error and trace information as the SAP Data Services Management ConsoleYou can select different log-levels ; for example, Info and DebugYou can configure all connection parameters Exception handling has been implemented for all parametersAdditional Info: Based on the “AL_RWJobLauncher.exe”. which is part of the Data Services InstallThe Task runs on Data Services for Windows and Linux We are an SAP silver partner. Our product has certified integration with SAP S/4HANA.

SAP: BusinessObjects Scheduling Web Intelligence Documents and Crystal Reports is a centralized suite for data reporting, visualization, and sharing.  The integration for SAP BusinessObjects allows scheduling Crystal Reports and Web Intelligence documents. It supports multiple prompts and different output formats like PDF, EXCEL, and Webi.   Key Features Schedule SAP Webi reports Schedule Crystal Reports Support multiple prompts as input parameter Support different output formats like MS EXCEL, PDF, Webi Based on the latest RESTful web service SDK - no Agent needs to be installed on the SAP BO Server Exit code processing and error handling In case a report fails (for example, if you provide a wrong BusinessObjects ID, it will fail), and you can re-start the job with the correct ID. In case of a connection error, the task will fail (for example, wrong IP address or Port of the SAP BO HOST). In case a wrong password has been entered, the instance will fail.     We are an SAP silver partner. Our product has certified integration with SAP S/4HANA.

This integration allows users to import the SAP factory calendar and related holiday calendars into the Stonebranch Universal Automation Center. You can use all valid SAP calendars or import a user-defined CSV file of specific SAP calendars. It's also possible to import calendars from different SAP systems. Key Features: Imports calendars that match the configured selection criteria into the Stonebranch Universal Controller (UC). Can be scheduled to always sync with SAP, e.g., import all calendars every day. The CSV list is saved (including versioning) into the UC script library. Runs on Linux and Windows Universal Agents. The calendar export is done using the SAP-certified XBP-RFC interface. SAP is always considered the master calendar; calendars are always exported from SAP, never imported to SAP. All calendar functionalities are supported, including factory, holiday and special rules. A calendar can be imported from a different SAP system automatically by adding the imported calendar's SAP system identifier and client number as a Postfix to the imported calendar. Set different log-levels for the integration, providing you with more information in case of issues. Support for application server and destination connections via 'nwrfc.ini' file, e.g., for load balancing and encryption. We are an SAP silver partner. Our product has certified integration with SAP S/4HANA.

This integration allows users to query the SAP event history table for the selected SAP event and parameter. If the event is found, it's confirmed so that it doesn't trigger again. It can also launch a task based on the occurrence of an event and parameter. Key Features:  Query the SAP event history table for a selected SAP event and parameter. For the parameter, wildcards (*) are supported. Confirm events in the SAP history table (transaction code SM62). Once the event and parameter have been identified, the event is confirmed in SAP so the monitor won't trigger a second time (optional setting). Launch a task in the Stonebranch Universal Controller, based on the occurrence of an event and parameter. Set different log-levels for the integration, providing you with more information in case of issues.Supported on Linux and Windows agents. Supports SAP application server and 'sapnwrfc.ini' destination connections. We are an SAP silver partner. Our product has certified integration with SAP S/4HANA.

This integration allows users to export SAP job definitions from SAP into one flat file for each job selected for extraction.  Key Features: Export SAP job definitions from SAP into one flat file for each SAP job. Any defined start criteria will be exported from SAP for each job. Jobs to be extracted can be in any status (scheduled, released, canceled, finished, etc.). The jobs to be extracted are provided via a list saved in the Stonebranch Universal Controller (UC) script library. A detailed log file will be provided after each extraction process to identify jobs that could not be found in SAP, e.g., a Jobname provided in the input file that doesn't exist in the SAP system. The extracted SAP job definition files can then read by the Stonebranch Conversion Tool (CTK), which transitions each read job definition file into an SAP task, including defined start criteria. Support for application server and destination connections via 'nwrfc.ini' file, e.g., for load balancing and encryption. Additional Info: The job definitions to extract from SAP are provided by a CSV input file saved in the UC script library. For each job to extract, the SAP Jobname and SAP Job Count ID must be provided in the input file.The extracted SAP job definition files can be read by the CTK, which transitions each read job definition file into an SAP task. If the SAP job is in 'released' status (meaning start conditions had been defined in SAP for that job), then a time trigger with the scheduling criteria will be created by the transition tool. As a result, the transitioned SAP task is ready to be scheduled in the same way as in SAP. We are an SAP silver partner. Our product has certified integration with SAP S/4HANA.

This Universal Extension provides the capability to integrate with ODBC compliant database, by running single or multiple SQL commands and retrieving the resulting data. While it is designed to work with any ODBC-compliant database, it is thoroughly tested against MySQL, MSSQL Server PostgreSQL, and Oracle databases. As opposed to the native UAC SQL Task, which runs on the Controller, this integration allows the user to run an SQL Task from the Agent.Key FeaturesFlexibility in database connection definition supporting DSN, FILE DNS and Connection String.Rich metadata information.Capability to store SQL results in files (CSV or JSON format).Rich Observability capabilitiesWhat's New in V2.0.0Rich observability capabilitiesFeature added to protect task authors from pushing into Universal Controller unnecessary database data by providing the capability to control the number of lines from the SQL result set that will be available on extension output. Task Authors can use UE_EXTENSION_OUTPUT_MAX_SQL_ROWS environment variable to control the behavior Breaking changesCompatibility of this integration has been changed. It is applicable for Universal Controller and Universal Agent with version >=7.2 "Status Description" text information has been updated. Tasks or workflows evaluating the "Status Description" of the task Instance, either programmatically or within UAC, might be affected by it. In that case, they need to conform to the new "Status Description" Text In this version, by default, the returned datasets displayed on the extension output are truncated to the first 100 rows. If more than 100 rows need to be pushed into the extension output, the environment variable UE_EXTENSION_OUTPUT_MAX_SQL_ROWS needs to be set appropriately on the task definition  Extension Invocation Fields > Credential fields are displayed as an object for better readabilityWhat's New in V2.1.0Official support for Amazon Redshift Database.New Choice Field “SQL Source” that gives the opportunity to provide the SQL Script either as a UAC Script or as plain text.Enhanced security when the Connection Method is “Connection String” by selecting the proper Credential and passing it via the connection string. This can be achieved using the following notation: [credential_name].user and [credential_name].password.Fix "authenticate with the system user" connectivity when the Connection Method is “Connection String” and the Database Type is “MSSQL”.