Otu esi etinye Apache Kafka na CentOS/RHEL 7


Apache Kafka bụ igwe ozi dị ike, nke a na-ejikarị na ọrụ BigData na usoro ndụ nchịkọta data. Ọ bụ ikpo okwu mepere emepe iji wuo pipeline iyi data ozugbo. Ọ bụ ikpo okwu na-edebanye aha na-ekesa nke nwere ntụkwasị obi, Scalability, na Ogologo.

Anyị nwere ike ịnwe Kafka dị ka onye kwụ ọtọ ma ọ bụ dị ka ụyọkọ. Kafka na-echekwa data nkwanye, yana enwere ike ịha ya dị ka isiokwu. Isiokwu a ga-enwe ọnụ ọgụgụ nke nkebi ka o wee nwee ike ijikwa ọnụọgụ data aka ike. Ọzọkwa, anyị nwere ike inwe otutu oyiri maka mmejọ-anabataghị ka anyị na-enwe na HDFS. Na ụyọkọ Kafka, onye na-ere ahịa bụ akụkụ nke na-echekwa data ebipụtara.

Onye na-elekọta anụ ọhịa bụ ọrụ amanyere iwu na-agba ọsọ ụyọkọ Kafka, dịka a na-eji ya maka ịhazi nhazi nke ndị na-ere ahịa Kafka. Zookeeper na-arụ ọrụ dị mkpa n'etiti ndị na-emepụta ihe na ndị na-azụ ahịa ebe ọ bụ ọrụ maka idobe ọnọdụ ndị na-ere ahịa niile.

N'isiokwu a, anyị ga-akọwa otu esi etinye Apache Kafka na otu ọnụ CentOS 7 ma ọ bụ RHEL 7.

Ịwụnye Apache Kafka na CentOS 7

1. Nke mbụ, ịkwesịrị ịwụnye Java na sistemụ gị iji na-agba Apache Kafka n'enweghị njehie ọ bụla. Yabụ, wụnye ụdị Java nke ndabara dị site na iji iwu yum na-esote wee nyochaa ụdị Java dịka egosiri.

# yum -y install java-1.8.0-openjdk
# java -version

2. Ọzọ, budata ụdị kwụsiri ike nke Apache Kafka kacha ọhụrụ site na webụsaịtị gọọmentị ma ọ bụ jiri iwu wget na-esonụ budata ya ozugbo wee wepụ ya.

# wget https://mirrors.estointernet.in/apache/kafka/2.7.0/kafka_2.13-2.7.0.tgz 
# tar -xzf kafka_2.13-2.7.0.tgz 

3. Mepụta njikọ ihe atụ maka ngwugwu kafka, wee gbakwunye ụzọ gburugburu Kafka na faịlụ .bash_profile wee bido ya dị ka egosiri.

# ln -s kafka_2.13-2.7.0 kafka
# echo "export PATH=$PATH:/root/kafka_2.13-2.7.0/bin" >> ~/.bash_profile
# source ~/.bash_profile

4. Ọzọ, malite Zookeeper, nke na-abịa na ngwugwu Kafka. Ebe ọ bụ otu ụyọkọ ọnụ ọnụ, ị nwere ike ịmalite onye na-elekọta anụ ụlọ nwere njirimara ndabara.

# zookeeper-server-start.sh -daemon /root/kafka/config/zookeeper.properties

5. Kwado ma onye na-elekọta anụ ụlọ nwere ike ịnweta ma ọ bụ na ọ bụghị site na naanị telnet gaa n'ọdụ ụgbọ mmiri Zookeeper 2181.

# telnet localhost 2181

6. Malite na Kafka na ndabara Njirimara.

# kafka-server-start.sh -daemon /root/kafka/config/server.properties

7. Kwado ma enwere ike ịnweta Kafka ma ọ bụ na ọ bụghị site na naanị telnet gaa n'ọdụ ụgbọ mmiri Kafka 9092

# telnet localhost 9092

8. Ọzọ, mepụta isiokwu atụ.

# kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic tecmint

9. Depụta isiokwu e kere.

# kafka-topics.sh --zookeeper localhost:2181 --list

N'isiokwu a, anyị ahụla otú e si wụnye Single node Kafka cluster na CentOS 7. Anyị ga-ahụ otu esi etinye multinode Kafka Cluster na isiokwu na-esote.