5 Steps to get started with KaDeck

KaDeck makes monitoring, analyzing and exploring data super easy. To help you get started, I’ll show you the first 5 steps to get to know the features and user interface.

Let’s start with a quick tip. ๐Ÿ˜Š

Quick tip #1: Before you connect to a stream, click through the individual application screens in the navigation bar on the left. There you will find the instructions for some main features of KaDeck and how to use them.

1. Connect to your data streams

After onboarding, you can immediately start connecting to your Apache Kafka or Amazon Kinesis data streams: Click “Add new connection” and enter the connection details.

Quick tip #2: We have equipped KaDeck with an advanced error message dialog that gives you hints on the most common connection errors – so read a bit more carefully if the connection fails. ๐Ÿ˜Š

The connection dialog for Apache Kafka also offers various configuration options for encrypted connections via SSL, authorization via Kerberos, and various security mechanisms for Schema Registry.

2. Setting up the data browser

The heart of KaDeck is the data table in the “Data Browser” application screen. I’ll show you the most important features in this section so you can get the most out of KaDeck.

  1. Select a data stream on the left side to see its data.
  2. Click on a data set to view its details.
  3. Limit the records by count and time (clock icon). Use in combination with “seek” (5) to only view records that were published in a certain time window.
  4. Select and group data by key (“Group data”) or switch between column (shows the attributes that you have added as a column) & raw mode (which only shows key & value) to modify your view. Click on the “eye” icon to unhide columns (e.g. after adding an attribute as a column). Right-click on a column header to hide a column.
  5. Main menu bar: filter, search, export, and create new data sets – “Run Query” to activate the changes.

Filtering & Columns

Quick tip #3: If your data stream contains structured data, click on the attributes (with the ๐Ÿ” icon) to apply a quick attribute filter (filter icon) or add the attribute to the data table as a column (eye icon).

Live Data!

Quick tip #4: Activate the “Live Mode” to see data flying in in real-time.

3. Working with Quick Processor, Flow, and Time Distribution

Using the “Quick Processor” you can apply advanced data transformations and filters to the data stream using JavaScript (Node V4 Support).

Expert Tip

You can access the value and key of a record via rec.value and rec.key respectively.

Filtering: If your function returns a boolean value, the record will be skipped (false) or displayed (true).

Transformation: You can also assign your own values to rec.value and rec.key (see screenshot). Your function must then return the rec object as value.

Don’t forget to click on “Apply” โ˜

Flow View

In the “Flow” view you can see how consumers and producers are connected and what their state is.

Time Distribution View

The “Time Distribution” view gives you a visual overview of the time and frequency of the data.

4. Saving your views of the data streams.

If you have created your own view with filters, the Quick Processor, data limits and individual table columns – remember to save it before leaving the application screen and data stream.

Quick tip #5: Add data streams or custom views you work with frequently to your โค๏ธ favorites.

5. Create new data and data streams

With KaDeck you can not only manage and transform data streams, but also create new data and data streams.

Produce new data

In the data browser view: create a new record by right-clicking on an existing record to use it as a blueprint (“As new Record”) or by clicking “Produce” in the upper right corner.

Create a stream/topic

Create a new stream by clicking on “Stream” in the upper left corner and selecting “Create new Stream” (“Create new Topic” in Apache Kafka).

For Apache Kafka: make sure that the replication factor is not higher than the maximum number of available brokers in your cluster and that the name does not exist yet.

That’s it for now! Of course, these 5 steps only scratch the surface of the possibilities KaDeck offers.

We started with a tip and we conclude with a tip ๐Ÿ˜Š

Quick tip #6: With KaDeck you can create powerful, individual codecs! Learn more at Custom Codec Maven Project – Xeotek.

I wish you a lot of fun with KaDeck.