Otu esi etinye na hazie hive na nnweta dị elu - Nkebi nke 7

Hive bụ ụdị ụlọ nkwakọba ihe dị na Hadoop Eco-System. Ọ nwere ike ịrụ dị ka ngwa ETL n'elu Hadoop. Ịkwado ịdị elu dị elu (HA) na Hive adịghị ka anyị na-eme na Master Services dị ka Onye njikwa ihe onwunwe.

Ọdịda nke akpaghị aka agaghị eme na Hive (Hiveserver2). Ọ bụrụ na Hiveserver2 (HS2) ọ bụla daa, ịrụ ọrụ na HS2 dara ada ga-ada. Anyị kwesịrị ịnyeghachi ọrụ ahụ ka ọrụ ahụ wee na-agba ọsọ na HiveServer2 ndị ọzọ. Yabụ, inye HA na HS2 abụghị ihe ọ bụla ma ọ bụghị, ịbawanye ọnụ ọgụgụ nke akụrụngwa HS2 na Ụyọkọ.

N'isiokwu a, anyị ga-ahụ usoro iji wụnye ma mee ka nnweta dị elu nke Hive.

• Emume kacha mma maka ibunye sava Hadoop na CentOS/RHEL 7 – Akụkụ 1
• Ịtọlite ihe ndị a chọrọ na Hadoop chọrọ yana ike nchekwa - Nkebi nke 2
• Otu esi etinye ma hazie njikwa Cloudera na CentOS/RHEL 7 - Nkebi nke 3
• Otu esi etinye CDH wee hazie ebe ọrụ na CentOS/RHEL 7 – Nkebi 4
• Otu esi edobe nnweta dị elu maka Namenode – Nkebi nke 5
• Otu esi edobe nnweta dị elu maka njikwa akụrụngwa - Nkebi nke 6

Ka anyị bido…

Nwụnye na nhazi nke hive

1. Nbanye na Cloudera Manager na URL dị n'okpuru wee gaa na Cloudera Manager -> Tinye Ọrụ.

http://13.233.129.39:7180/cmf/home

2. Họrọ ọrụ 'Hive'.

3. Kenye ọrụ na ọnụ.

• Ọnụ ụzọ - Ọ bụ ọrụ ndị ahịa ebe onye ọrụ nwere ike ịnweta Ekwo Ekwo. Ọtụtụ mgbe, a ga-edobe ọrụ a na oghere Edge raara nye ndị ọrụ.
• Hive Metastore – Ọ bụ ebe nchekwa etiti maka ịchekwa metadata Hive.
• WebHCat sava – Ọ bụ API Weebụ maka HCatalog na ọrụ Hadoop ndị ọzọ.
• Hiveserver2 – Ọ bụ ngwa ngwa nke ndị ahịa maka mkpochapụ ajụjụ na Hive.

Ozugbo ahọpụtara ihe nkesa, pịa 'Gaa n'ihu' ka ọ gaba.

4. Hive Metastore chọrọ ebe nchekwa data dị n'okpuru maka ịchekwa metadata. N'ebe a, anyị na-eji nchekwa data PostgreSQL ndabara nke ejiri CDH rụọ ya.

A ga-abanye nkọwa nchekwa data dị n'okpuru ebe a na-akpaghị aka, 'njikọ ule' ga-awụpụ ka a ga-emepụta nchekwa data a kpọtụrụ aha na ofufe. Na ezigbo oge, anyị kwesịrị ịmepụta Database na nchekwa data mpụga wee nwalee njikọ iji gaa n'ihu. Ozugbo emechara, biko pịa 'Gaa n'ihu'.

5. Hazie ndekọ ụlọ nkwakọba ihe nke Hive,/onye ọrụ/hive/ụlọ nkwakọba ihe bụ ụzọ ndekọ aha ndabere maka ịchekwa tebụl Ekwo Ekwo. Pịa 'Gaa n'ihu'.

6. Ebido nwụnye nke ekwo Ekwo.

7. Ozugbo echichi mechara, ị nwere ike nweta ọnọdụ 'Emechara'. Pịa 'Gaa n'ihu' ka ịga n'ihu.

8. Ekwo Ekwo echichi na nhazi dechara nke ọma. Pịa 'N'ikpeazụ'iji mezue usoro nwụnye.

9. Ị nwere ike ịhụ ọrụ Hive agbakwunyere na ụyọkọ site na Cloudera Manager Dashboard.

10. Ị nwere ike ịlele Hiveserver2 na ihe atụ nke hive. Anyị agbakwunyela Hiveserver2 na master1.

Onye njikwa Cloudera -> Hive -> Ihe atụ -> Hiveserver2.

Na-eme ka nnweta dị elu na Hive

11. Ọzọ tinye hive ọrụ site na ịga Cloudera Manager -> Ekwo Ekwo -> Omume -> Tinye ọrụ atụ.

12. Họrọ sava ebe ịchọrọ idowe mgbakwunye Hiveserver2. Ị nwere ike ịgbakwunye karịa abụọ, enweghị oke. N'ebe a, anyị na-agbakwunye otu Hiveserver2 na master2.

13. Ozugbo ahọpụtara ihe nkesa, pịa 'Gaa n'ihu'.

14. A ga-agbakwunye Hiverver22 n'ime oge Hive, ịkwesịrị ịmalite ya site na ịga na Cloudera Manager -> Hive -> Ihe atụ -> (Họrọ Hiveserver2 agbakwunyere ọhụrụ) -> Action for Selected -> Malite.

15. Ozugbo Hiveserver2 malitere na master2, ị ga-enweta ọkwa 'Emechara'. Pịa Mechie.

16. Ị nwere ike ịlele, ma Hiveserver2 na-agba ọsọ.

Na-enyocha nnweta ekwo Ekwo

Anyị nwere ike jikọọ Hiveserver2 site na beeline nke bụ mkpa ahịa na iwu-akara. Ọ na-eji JDBC ọkwọ ụgbọ ala iji guzobe njikọ ahụ.

17. Nbanye na nkesa ebe Hive Gateway na-agba ọsọ.

[[email  ~]$ beeline

18. Tinye eriri njikọ JDBC iji jikọọ Hiveserver2. Na njikọ a, eriri anyị na-ekwu banyere Hiverserver2 (master2) na nọmba ọdụ ụgbọ mmiri ya 10000. Njikọ njikọ a ga-ejikọta naanị na Hiveserver2 nke na-agba ọsọ na master2.

beeline> !connect "jdbc:hive2://master1.linux-console.net:10000"

19. Gbaa ajụjụ nlele.

0: jdbc:hive2://master1.linux-console.net:10000> show databases;

Nke a bụ nchekwa data ndabara nke na-abịa n'ime ya.

20. Jiri iwu dị n'okpuru ebe a kwụsị nnọkọ hive.

0: jdbc:hive2://master1.linux-console.net:10000> !quit

21. Ị nwere ike iji otu ụzọ jikọọ Hiveserver2 na-agba ọsọ na master2.

beeline> !connect "jdbc:hive2://master2.linux-console.net:10000"

23. Anyị nwere ike jikọọ Hiveserver2 na Zookeeper Discovery mode. Na usoro a, anyị achọghị ịkpọ aha Hiveserver2 na eriri njikọ kama anyị na-eji Zookeeper chọpụta Hiveserver2 dị.

N'ebe a, anyị nwere ike iji ihe nkwụnye ibu nke ndị ọzọ iji dozie ibu n'etiti Hiverserver2 dị. Nhazi dị n'okpuru dị mkpa iji mee ka ọnọdụ nchọpụta Zookeeper rụọ ọrụ site na ịga na Cloudera Manager -> Hive -> Nhazi.

24. Ọzọ, chọọ ụlọ \HiveServer2 Advanced Configuration Snippet wee pịa akara + ka ịgbakwunye akụrụngwa dị n'okpuru.

Name : hive.server2.support.dynamic.service.discovery
Value : true
Description : <any description>

25. Ozugbo banyere ihe onwunwe, pịa 'Chekwa Mgbanwe'.

26. Dị ka anyị mere mgbanwe na nhazi, mkpa Malitegharịa ekwentị emetụtara ọrụ site na ịpị Orange Agba Symbol ka Malitegharịa ekwentị ọrụ.

27. Pịa 'Malitegharịa ekwentị Stale' ọrụ.

28. Enwere nhọrọ abụọ dị. Ọ bụrụ na ụyọkọ ahụ nọ na mmepụta ndụ, anyị kwesịrị ịhọrọ ịmalitegharịgharị iji belata nkwụsị ahụ. Dịka anyị na-etinye ọhụrụ, anyị nwere ike họrọ nhọrọ nke abụọ 'Re-deploy Client Configuration', wee pịa 'Malitegharịa ugbu a'.

29. Ozugbo malitegharịa nke ọma, ị ga-enweta ọkwa 'Emechara'. Pịa 'N'ikpeazụ' ka mezue usoro.

30. Ugbu a, anyị ga-ejikọta Hiveserver2 iji Zookeeper Discovery mode. Na njikọ JDBC, eriri anyị kwesịrị iji sava Zookeeper na nọmba ọdụ ụgbọ mmiri ya 2081. Na-anakọta sava Zookeeper site na ịga na Cloudera Manager -> Zookeeper -> Ihe atụ -> (Rịba ama aha aha nkesa).

Ndị a bụ sava atọ nwere Zookeeper, 2181 bụ nọmba ọdụ ụgbọ mmiri.

master1.linux-console.net:2181
master2.linux-console.net:2181
worker1.linux-console.net:2181

31. Ugbu a banye na beeline.

[[email  ~]$ beeline

32. Tinye eriri njikọ JDBC dị ka ekwuru n'okpuru. Anyị ga-ekwu maka ọnọdụ nchọpụta ọrụ na Zookeeper Namespace. 'hiveserver2' bụ aha ebe ndabara nke Hiveserver2.

beeline>!connect "jdbc:hive2://master1.linux-console.net:2181,master2.linux-console.net:2181,worker1.linux-console.net:2181/;serviceDiscoveryMode=zookeeper;zookeeperNamespace=hiveserver2"

33. Ugbu a, a na-ejikọta nnọkọ na Hiveserver2 na-agba ọsọ na master1. Gbaa ajụjụ nlele iji kwado ya. Jiri iwu dị n'okpuru ka ịmepụta nchekwa data.

0: jdbc:hive2://master1.linux-console.net:2181,mast> create database tecmint;

34. Jiri iwu dị n'okpuru depụta nchekwa data.

0: jdbc:hive2://master1.linux-console.net:2181,mast> show databases;

35. Ugbu a, anyị ga-akwado ịdị elu dị na Zookeeper Discovery Mode. Gaa na Cloudera Manager ma kwụsị Hiveserver2 na master1 nke anyị nwalere n'elu.

Onye njikwa Cloudera -> Hive -> Ọnọdụ -> (họrọ Hiveserver2 na master1) -> Omume maka ahọpụtara -> Kwụsị.

36. Pịa 'Kwụsị'. Ozugbo kwụsịrị, ị ga-enweta ọkwa 'Emechara'. Nyochaa Hiveserver2 na master1 site na ịgagharị n'ime Hive -> Ihe atụ.

37. Banye n'ime beeline na jikọọ Hiveserver2 site na iji otu JDBC njikọ eriri na Zookeeper Discovery Mode dị ka anyị mere na n'elu nzọụkwụ.

[[email  ~]$ beeline

beeline>!connect "jdbc:hive2://master1.linux-console.net:2181,master2.linux-console.net:2181,worker1.linux-console.net:2181/;serviceDiscoveryMode=zookeeper;zookeeperNamespace=hiveserver2"

Ugbu a ị ga-ejikọta na Hiveserver2 na-agba ọsọ na master2.

38. Jiri ajụjụ nlele kwadoo.

0: jdbc:hive2://master1.linux-console.net:2181,mast> show databases;

N'isiokwu a, anyị agabigala usoro zuru ezu iji nweta ụdị ụlọ nkwakọba ihe nke Hive Data na ụyọkọ anyị nwere nnukwu nnweta. N'ebe a na-emepụta oge, ihe karịrị atọ Hiveserver2 ga-etinye ya na Zookeeper Discovery Mode nyeere.

N'ebe a, ndị Hiveserver2 niile na-edebanye aha na Zookeeper n'okpuru aha aha nkịtị. Onye na-elekọta ụlọ na-achọpụta Hiveserver2 dịnụ ma guzobe nnọkọ Hive.