eMagiz Kafka Connector

Category: Modules
Subcategory: Messaging

Overview

This Connector module allows to make a fast and easy connection from your Mendix application to the eMagiz Event Streaming Cluster. All required eMagiz configurations are provisioned by the Connector module. Mendix version 8.18.2 and higher are supported. Per version 2.0.0 we support Mendix 9.0.5 and higher as well

Documentation

Demo urlhttps://emagiz.github.io/vid/microlearning/intermediate-event-streaming-connectors-using-kafka-module-mendix.mp4

Description

This module allows applications to be able to produce and consume data to and from topics that are managed within an external Kafka Cluster, such as the eMagiz Kafka Cluster.

Producing data on a topic means that the external system, in this case, Mendix, writes data to a pre-defined topic where the data is stored temporarily to make sure that the data can be consumed by one or more other systems. Consuming data from a topic means that the external system, in this case, Mendix, reads data from a pre-defined topic where the data is stored temporarily.

Typical usage scenario

By knowing how you can easily set up Mendix to consume and produce data from and to topics you have the option to better transport large volumes of data between several systems that includes a Mendix application.

Features and limitations

  1. Set up a connection to the external Kafka Cluster (i.e the eMagiz Kafka Cluster) from Mendix
  2. Configure a Producer that can write (publish) data to a topic
  3. Configure a Consumer that can read (listen) data from a topic
  4. Support Mendix mult-instance setup to consume data

Dependencies

  • MxModelReflection
  • LibraryLogging
  • Encryption 2.1.0

Installation

Regular import of the package into your project. Within the Kafka Module there is a microflow called OpenAdministration, make sure an admin can reach this microflow as this is the starting point for the rest of the configuration.

Configuration

Please refer to the relevant Microlearning in the eMagiz Academy section:

https://emagiz.github.io/docs/microlearning/intermediate-event-streaming-connectors-using-kafka-module-mendix

Releases

Version: 2.0.0
Framework Version: 9.0.5
Release Notes: In this version of the eMagiz Kafka we support version 9.x for Mendix as well
Version: 1.0.0
Framework Version: 8.18.2
Release Notes: This is the first release of the eMagiz Kafka Connector. It allows to connect to an Kafka cluster instance in order to produce or consume messages from topic. Access credentials are required to access the cluster.