Otu esi etinye CDH na hazie ebe ọrụ na CentOS/RHEL 7 - Nkebi 4


N'okwu mbụ, anyị akọwawo ntinye nke Cloudera Manager, n'isiokwu a, ị ga-amụta otú e si wụnye na hazie CDH (Cloudera Distribution Hadoop) na RHEL/CentOS 7.

Ka ị na-etinye ngwugwu CDH, anyị ga-ahụrịrị na ndakọrịta Cloudera Manager na CDH. Ụdị Cloudera na-enwe akụkụ 3 - ... Ụdị isi na nke nta nke Cloudera Manager ga-abụrịrị otu CDH isi na ụdị obere.

Dịka ọmụmaatụ, anyị na-eji Cloudera Manager 6.3.1 na CDH 6.3.2. Ebe 6 bụ isi na 3 bụ obere ụdị. Isi na obere ga-abụ otu ka ịzenarị okwu ndakọrịta.

  • Emume kacha mma maka ibunye sava Hadoop na CentOS/RHEL 7 – Akụkụ 1
  • Ịtọlite ihe ndị a chọrọ na Hadoop chọrọ yana ike nchekwa - Nkebi nke 2
  • Otu esi etinye ma hazie njikwa Cloudera na CentOS/RHEL 7 - Nkebi nke 3

Anyị ga-ewere ọnụ ụzọ 2 dị n'okpuru maka ịwụnye CDH. Ugbua anyị etinyela Cloudera Manager na master1, anyị na-ejikwa master1 dị ka ihe nkesa repo.

master1.linux-console.net
worker1.linux-console.net

Kwụpụ 1: Budata ngwugwu CDH na Master Server

1. Nke mbụ, jikọọ na ihe nkesa master1 wee budata faịlụ CDH Parcels na /var/www/html/cloudera-repos/cdh directory. Anyị ga-ebudata faịlụ 3 a kpọtụrụ aha n'okpuru nke kwesịrị dakọtara na RHEL/CentOS 7.

CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel
CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel.sha1
manifest.json

2. Tupu nbudata faịlụ ndị a, jide n'aka na ịmepụta akwụkwọ ndekọ cdh n'okpuru /var/www/html/cloudera-repos/ location.

$ cd /var/www/html/cloudera-repos/
$ sudo mkdir cdh
$ cd cdh

3. Ọzọ, budata faịlụ 3 ndị a kpọtụrụ aha n'elu site na iji iwu wget na-esonụ.

$ sudo wget https://archive.cloudera.com/cdh6/6.3.2/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel 
$ sudo wget https://archive.cloudera.com/cdh6/6.3.2/parcels/CDH-6.3.2-1.cdh6.3.2.p0.1605554-el7.parcel.sha1 
$ sudo wget https://archive.cloudera.com/cdh6/6.3.2/parcels/manifest.json 

Kwụpụ 2: Tọọ onye njikwa Cloudera Repo na ndị ahịa ọrụ

4. Ugbu a, jikọọ na sava ndị ọrụ ma detuo faịlụ repo (cloudera-manager.repo) site na sava repo (master1) gaa na ihe nkesa ọrụ niile fọdụrụnụ. Faịlụ repo a na-eme ka ndị sava hụ na a ga-ebudata ngwugwu niile achọrọ na RPM na sava repo mgbe ị na-etinye ya.

cat >/etc/yum.repos.d/cloudera-manager.repo <<EOL
[cloudera-repo]
name=cloudera-manager
baseurl=http://104.211.95.96/cloudera-repos/cm6/
enabled=1
gpgcheck=0
EOL

5. Ozugbo repo agbakwunyere, depụta ebe nchekwa enyere aka iji jide n'aka na agbanyere cloudera-manager repo.

$ yum repolist

Kwụpụ 3: Wụnye Cloudera Manager Daemons na Agent na sava ndị ọrụ

6. Ugbu a, anyị kwesịrị ịwụnye cloudera-manager-daemons na cloudera-manager-agent na sava niile fọdụrụnụ.

$ sudo yum install cloudera-manager-daemons cloudera-manager-agent

7. Ọzọ, ịkwesịrị ịhazi onye ọrụ Cloudera Manager iji kọọ ihe nkesa Cloudera Manager.

$ sudo vi /etc/cloudera-scm-agent/config.ini

Dochie localhost na adreesị IP ihe nkesa Cloudera Manager.

8. Malite Cloudera Manager Agent ma chọpụta ọkwa.

$ sudo systemctl start cloudera-scm-agent
$ sudo systemctl status cloudera-scm-agent

Kwụpụ 4: Wụnye na Mepụta CDH

Anyị nwere ngwugwu CDH na master1 - repo server. Jide n'aka na ihe nkesa niile na-enwe faịlụ repo Cloudera Manager na /etc/yum.repos.d/ ma ọ bụrụ na ị na-eso ntinye akpaaka site na iji Cloudera Manager.

9. Banye na Onye njikwa Cloudera site na iji URL dị n'okpuru na ọdụ ụgbọ mmiri 7180 wee jiri aha njirimara na paswọọdụ ndabara nke Cloudera Manager.

http://104.211.95.96:7180/cmf/login
Username: admin
Password: admin

10. Ozugbo i banyere, a ga-ekele gị na ibe nnabata. Ebe ị nwere ike ịhụ ndetu mwepụta, Njirimara ọhụrụ nke Cloudera Manager.

11. Nabata akwụkwọ ikike wee gaa n'ihu.

12. Họrọ mbipụta. A na-ahọrọ ụdị ikpe ahụ na ndabara, anyị nwere ike ịga n'ihu na nke ahụ.

13. Ugbu a, soro usoro nrụnye ụyọkọ. Gaa n'ihu na ibe nnabata.

14. Kpọọ ụyọkọ ahụ wee gaa n'ihu, anyị akpọla aha ya dị ka \tecmint Enwere ụdị ụyọkọ abụọ ị nwere ike ịkọwapụta anyị na-aga n'ihu na ụyọkọ oge niile.

  • Ụyọkọ oge niile: Ọ ga-enwe ọnụ nchekwa, ọnụ ọnụ ọnụ na ọrụ ndị ọzọ dị mkpa.
  • Uyọkọ Mgbakọ: Ọ ga-enwe naanị ọnụ ọnụ. Enwere ike iji nchekwa mpụga maka ịchekwa data.

15. Anyị etinyelarị Cloudera Manager Agents na sava niile. Ị nwere ike ịchọta ihe nkesa ndị ahụ na \Ugbu a jisiri ike Hosts Maka nrụnye akpaka, ị ga-abanye FQDN ma ọ bụ IP nke ihe nkesa na nhọrọ New Hosts ma chọọ. Onye njikwa Cloudera ga-achọpụta ndị ọbịa nke anyị kwesịrị ịwụnye CDH na akpaghị aka.

Ebe a, pịa \Ugbu a jisiri ụsụụ ndị agha, họrọ ndị ọbịa niile site na ịhọrọ 'Aha nnabata' wee gaa n'ihu.

16. Họrọ ebe nchekwa - iji Parcel bụ ụzọ akwadoro. Pịa 'Nhọrọ ndị ọzọ' iji hazie ebe nchekwa ahụ.

17. Tinye URL nchekwa mpaghara dịka ekwuru n'okpuru. Wepu ebe nchekwa ọha niile fọdụrụ na-atụ Weebụ (Ebe nchekwa Cloudera).

Nke a bụ URL ebe nchekwa CDH nke anyị na-enwe na master1.

http://104.211.95.96/cloudera-repos/cdh/

18. Ozugbo URL batara, ibe a ga-egosi naanị ngwugwu dị. Gaa n'ihu nzọụkwụ a.

19. Ugbu a, a na-ebudata ngwugwu, kesaa, na-ebupụ ma na-arụ ọrụ na sava niile dị.

20. Ozugbo arụnyere ngwugwu CDH, lelee ụyọkọ ahụ. Nzọụkwụ a ga-eme nyocha ahụike nke ụyọkọ ahụ. Ebe a anyị na-awụlikwa elu na-aga n'ihu.

Nzọụkwụ 5: Nhazi ụyọkọ

21. N'ebe a, anyị kwesịrị ịhọrọ ọrụ a ga-etinye na ụyọkọ. Ụfọdụ ngwakọta juru n'ọnụ ga-adị na ndabara, anyị na-eji Ọrụ Omenala.

22. Na Ọrụ Omenala, anyị na-etinye naanị Core components (HDFS na YARN) maka ebumnuche ngosi a.

23. Kenye ọrụ na ihe nkesa. Anyị nwere ike hazie dị ka anyị chọrọ. Chọta chaatị dị n'okpuru nke na-akọwa nkesa ọrụ akwadoro maka obere ụyọkọ nke nwere ọnụ 5 ruo 20 nwere Ọdịmma dị elu.

24. Họrọ ụdị data database, hostname, DB Name, Username, and Password. Dịka anyị na-eji Embedded PostgreSQL, a ga-ahọrọ ya na ndabara. Nyochaa njikọ ahụ, ọ kwesịrị ịga nke ọma.

25. Ibe a ga-egosi ndabara nhazi paramita nke HDFS na Yarn, gụnyere data directories. Nyochaa nkọwa nhazi niile ma ị nwere ike ime mgbanwe ma ọ bụrụ na achọrọ ya. Mgbe ahụ Gaa n'ihu na nke a.

26. Ibe a ga-egosi nkọwa nke iwu 'First Run'. Ị nwere ike gbasaa ya ka ịhụ nkọwa nke iwu na-agba ọsọ. Ọ bụrụ na enwere nsogbu netwọkụ ma ọ bụ ikike na ụyọkọ ahụ, nzọụkwụ a ga-ada. Ọtụtụ mgbe, nzọụkwụ a na-ekpebi nrụnye nke Cluster Building.

27. Ozugbo nzọụkwụ n'elu dechara, Pịa 'N'ikpeazụ' iji mezue echichi. Nke a bụ Dashboard nke Cloudera Manager mgbe ị wụnyechara CDH.

http://104.211.95.96:7180/cmf/home

Anyị emechaala Cloudera Manager na nrụnye CDH nke ọma. Na Cloudera Manager Dashboard, ị nwere ike ịchọta eserese eserese akọwapụtara nke ọma ebe ị nwere ike nyochaa Cluster CPU, Disk IO wdg. Anyị nwere ike ijikwa ụyọkọ niile site na iji Onye njikwa Cloudera a. Anyị ga-ahụ ọrụ nchịkwa niile na isiokwu ndị na-abịa.