2 products found for "kafka"

Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. A Kafka Event Monitor is a Universal Extension responsible for monitoring events (messages) from topics in Kafka, and consuming an event based on filtering criteria via consumer group subscription.Key FeaturesThis Universal Extension supports the following main features:Monitor messages and consume a Kafka message by consumer group topic subscription.Authenticate against Kafka using PLAINTEXT, SASL_SSL or SSL security protocolCapability to filter Kafka messages based on the value of the message. Number, String and JSON filter patterns are supported.Capability to fetch dynamically Kafka topics, during task creation.Capability to control the partition assignment strategy, as well as session-related timeout valuesWhat's New in Version 1.2.0EnhancementsUpgraded kafka-python to version 2.1.6, bringing major enhancements in stability, performance, and compatibility, along with numerous bug fixes.Added support for PLAIN mechanism under SASL authentication.Added environment variables for configuring Kafka connection and polling parameters.Added validation step after initializing a consumer, for improved stability and robustness.Improved consumer shutdown handling to ensure tasks terminate gracefully without leaving open connections.Improved log messages.Optimized the message retrieval logic for better efficiency.Optimized the pipeline stages flow for better efficiency.FixesFixed bug where the last message was not commited when consuming multiple messages.

Apache Kafka is an open-source distributed event streaming platform used by thousands of companies for high-performance data pipelines, streaming analytics, data integration, and mission-critical applications. This integration is responsible for publishing events (messages) and topics in Kafka. Key Features: This Universal Extension supports the following main features: Perform authentication towards Kafka, using PLAINTEXT or SASL_SSL security protocol Send a message to Kafka with the capability to select the topic, the partition, the message key, the message value and message metadata Capability to control the transport of the messages by configuring the message acknowledgment strategy and the request timeout Capability to fetch dynamically topics and partitions from kafka for selection during task creation Capability to automatically select the serialization method depending on the key/value message data types What's New in V2.0.0 This release modernizes dependencies with native Confluent Python support, and introduces SASL authentication via PLAIN.