Skip to main content Skip to search Skip to main navigation
Contact

SAP HANA Cloud - data lake

Product information "SAP HANA Cloud - data lake"

SAP HANA Cloud, data lake is the storage tier of SAP HANA Cloud for large volumes of structured and unstructured data. Its Files service keeps data in file containers secured by client certificates, and its Relational Engine runs SQL analytics over data loaded into tables or held in those files.

This integration transfers files between a Universal Agent and a data lake Files container, and runs SQL scripts against the data lake Relational Engine, so ingestion, export and housekeeping can be scheduled and chained with other tasks from the Universal Controller.

Key Features

  • Upload, download, list and delete data lake files, selected by a glob pattern and an optional recursion depth that mirrors directory trees in both directions.
  • Copy or move files, and choose how an existing file at the destination is handled: replace it, keep it, or write the new file under a timestamped or numbered name.
  • Authenticate to data lake Files with mutual TLS using a client certificate and private key, with an optional key passphrase held in a UAC Credential.
  • Run multi-statement SQL scripts against the Relational Engine, including LOAD TABLE and UNLOAD, stopping at the first failure and committing once all statements succeed.
  • Return transferred, skipped and deleted file paths, and per-statement row counts and result rows, as Extension Output for downstream tasks.
Universal Template Name: SAP HANA Cloud - data lake
Vendor Product: SAP HANA Cloud, data lake
Version: 1.0.0
Vendor: SAP
Compatibility : UC/UA 7.8 and above
Support: Stonebranch Certified
Workflow

Use Case: Deliver Agent Extracts to an SAP HANA Cloud, data lake Landing Zone

UC1-ue-sap-datalake

Description

This workflow automates the delivery of files from a Universal Agent to SAP HANA Cloud, data lake. An extract task produces CSV files on the agent, and the SAP HANA Cloud - data lake task copies every file matching a file pattern into a landing directory of a data lake Files container, recreating the agent's subdirectories. On success, the workflow lists the landing directory to confirm what has been delivered. On failure, an email sent through the Email integration notifies the data team, and a rerun delivers the same files again.

Business Value

  • Replace manual file copies with a scheduled workflow, so data produced on Universal Agents reaches the data lake landing zone on time, ready for SAP HANA Cloud and the data lake Relational Engine to process
  • Rerun safely: files on the agent are never deleted, and files already in the landing directory are replaced, so a rerun after a failure delivers the full set again without duplicates
  • Shorten time to resolution with an immediate failure notification, and confirm every successful delivery with a listing of the landing directory

Technical Capabilities

  • Upload File with Operation "Copy" transfers every file matching a file pattern over mutual TLS and mirrors the agent's subdirectories through the recursion depth
  • Write Option "Replace" makes reruns safe by overwriting files that were already delivered
  • List Files returns the contents of the landing directory as Extension Output for auditing and downstream tasks
  • Distinct exit codes for authentication, connection and partial-transfer failures route the workflow to its failure path

This solution turns file delivery into SAP HANA Cloud, data lake into a single, observable, end-to-end process that combines the scale of the data lake with the scheduling, dependency handling and alerting of the Universal Controller.