<commit_before>---
layout: post	
title: Kafka 2.7.0 Installatin on CentOS 8 	
published: true	
categories: [kafka]	
date: 2021-01-01 09:00
excerpt: | 
     export file list as Json via jq
     
---

 
## Introduction

Apache Kafka is a popular distributed message broker designed to efficiently handle large volumes of real-time data. 
A Kafka cluster is not only highly scalable and fault-tolerant, but it also has a much higher throughput compared to other message brokers such as ActiveMQ and RabbitMQ. 
Though it is generally used as a publish/subscribe messaging system, a lot of organizations also use it for log aggregation because it offers persistent storage for published messages.

A publish/subscribe messaging system allows one or more producers to publish messages without considering the number of consumers or how they will process the messages. 
Subscribed clients are notified automatically about updates and the creation of new messages. 
This system is more efficient and scalable than systems where clients poll periodically to determine if new messages are available.

In this tutorial, you will install and use Apache Kafka 2.7.0 on CentOS 8.

## Prerequisites

To follow along, you will need:
- One CentOS 8 server and a non-root user with sudo privileges.
- At least 4GB of RAM on the server. Installations without this amount of RAM may cause the Kafka service to fail, with the Java virtual machine (JVM) throwing an “Out Of Memory” exception during startup.
- OpenJDK 8 installed on your server. To install this version, follow these instructions on installing specific versions of OpenJDK. Kafka is written in Java, so it requires a JVM; however, its startup shell script has a version detection bug that causes it to fail to start with JVM versions above 8.

## Step 1 — Creating a User for Kafka
<commit_msg>Update 2021-01-01-kafka-notes.md<commit_after>---
layout: post	
title: Kafka 2.7.0 Installatin on CentOS 8 	
published: true	
categories: [kafka]	
date: 2021-01-01 09:00
excerpt: | 
     Kafka instalation on CentOS 8
     
---

 
## Introduction

Apache Kafka is a popular distributed message broker designed to efficiently handle large volumes of real-time data. 
A Kafka cluster is not only highly scalable and fault-tolerant, but it also has a much higher throughput compared to other message brokers such as ActiveMQ and RabbitMQ. 
Though it is generally used as a publish/subscribe messaging system, a lot of organizations also use it for log aggregation because it offers persistent storage for published messages.

A publish/subscribe messaging system allows one or more producers to publish messages without considering the number of consumers or how they will process the messages. 
Subscribed clients are notified automatically about updates and the creation of new messages. 
This system is more efficient and scalable than systems where clients poll periodically to determine if new messages are available.

In this tutorial, you will install and use Apache Kafka 2.7.0 on CentOS 8.

## Prerequisites

To follow along, you will need:
- One CentOS 8 server and a non-root user with sudo privileges.
- At least 4GB of RAM on the server. Installations without this amount of RAM may cause the Kafka service to fail, with the Java virtual machine (JVM) throwing an “Out Of Memory” exception during startup.
- OpenJDK 8 installed on your server. To install this version, follow these instructions on installing specific versions of OpenJDK. Kafka is written in Java, so it requires a JVM; however, its startup shell script has a version detection bug that causes it to fail to start with JVM versions above 8.

## Step 1 — Creating a User for Kafka

{'fraction_non_alphanumeric': 0.03761840324763194, 'fraction_numerical': 0.015967523680649527, 'mean_word_length': 4.183730715287518, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4647937', 'n_tokens_mistral': 967, 'n_tokens_neox': 873, 'n_words': 565}