DBT: Core CLI
DBT (Data Build Tool) Core is an open-source tool and it is designed to help data engineers and analysts manage and transform data in a reliable and scalable manner. Some key features of DBT Core include version control integration, automated testing, documentation generation, and dependency management. These features enable teams to collaborate effectively, ensure the quality of their data transformations, and maintain documentation for their data pipelines. DBT Core simplifies the process of transforming data in a data warehouse environment, providing a structured and scalable approach that helps teams manage their data transformation workflows effectively.This integration provides an interface to call the DBT Core CLI and enables users to execute DBT Core CLI tasks in Universal Controller. This is particularly useful when UC acts as a data pipeline orchestrator and DBT is a step within a data pipeline Universal Controller workflow. Key Features: Show DBT version and DBT environment variables information as Task Instance STDOUT. Enables users to retrieve Information on the dbt core installation. Execute a given DBT command. DBT output is displayed as task instance STDOUT Artifacts can be collected, and related information can be published within Universal Controller for subsequent workflow tasks to use.Ability to safely store and pass UC Credentials as DBT environment variables.
Fivetran is a cloud-based data integration platform that helps businesses automate the process of extracting data from various sources, transforming it, and loading it into a data warehouse for analysis. It offers a wide range of pre-built connectors to popular data sources such as databases, marketing platforms, CRMs, and more. Fivetran's connectors are designed to be easy to set up and use, allowing businesses to focus on data analysis rather than data integration. The platform also offers features such as data transformation, scheduling, monitoring, and access control to help organizations manage their data pipelines more efficiently. Fivetran supports a variety of data warehouses, including Amazon Redshift, Google BigQuery, Snowflake, and Microsoft Azure. This integration allows to create and execute Fivetran Tasks in Universal Controller. Key Features: Trigger a Sync action on a Connector. Optionally, wait until Sync is completed. Trigger a Re-sync (Historical Sync) action on a Connector. Optionally, wait until Re-sync is completed.
Microsoft SQL: Schedule SSRS
This integration can complete various administrative tasks, including publishing reports and moving reports from one server to another server. It's based on the SQL Server Reporting Services 'rs.exe' command-line utility, which can perform many scripted operations related to SQL Server Reporting Services (SSRS). The rs.exe utility requires an input file to tell rs.exe what to do.The list of actual tasks that can be performed includes among others: Deploying / Publishing reports Moving reports Exporting reports to a file Adjust security Cancel a running job Configure SSRS system properties
Microsoft SQL: SSIS Package Execution
SQL Server Integration Services (SSIS) is a platform for building data integrations and data transformation solutions.This Universal Extension task interactively allows users to list and select the SSIS Folder, Project, Environment Reference, and SSIS Package while creating the job. Furthermore, it can trigger the SSIS package execution in the Microsoft SQL server, monitor the SSIS Package execution, and fetch SSIS logs to Universal Controller when the SSIS package execution has been completed.Key Features:This Universal Extension provides the following key features:Dynamic Choice Fields to select the SSIS Folder/Project/Package/Environment Reference ID.Launch SSIS Package execution. Monitor SSIS Package execution.Fetch SSIS Package execution logs.SSIS Execution ID and Execution status captured for every execution in the Task Instance.Connection to MS SQL Server is done via the Python PYMSSQL module.Supports Windows and Linux Universal Agents in order to connect to the MSSQL server.What's in V1.0.4This new release involves a minor bug fix.
SQL: ODBC Task
This Universal Extension provides the capability to integrate with ODBC compliant database, by running single or multiple SQL commands and retrieving the resulting data. While it is designed to work with any ODBC-compliant database, it is thoroughly tested against MySQL, MSSQL Server PostgreSQL, and Oracle databases. This integration allows the user to run an SQL Task on the Agent, as opposed to the native UAC SQL Task, which runs on the Controller. Key Features:Flexibility in database connection definition supporting DSN, FILE DNS and Connection String.Rich metadata information.Capability to store SQL results in files (CSV or JSON format).