Wụnye ma hazie Apache Oozie Workflow Scheduler maka CDH 4.X na RHEL/CentOS 6/5

Oozie bụ onye nhazi isi mmalite maka Hadoop, ọ na-eme ka usoro ọrụ dị mfe na nhazi n'etiti ọrụ. Anyị nwere ike kọwapụta ndabere n'etiti ọrụ maka data ntinye wee nwee ike megharịa ndabere ọrụ site na iji ooze nhazi.

N'ime nkuzi a, etinyere m Oozie na nna ukwu m (ya bụ master dị ka aha nnabata na ebe namenode/JT etinyere) mana na sistemu mmepụta oozie kwesịrị itinye na Hadoop iche. ọnụ.

E kewara ntuziaka nwụnye ụzọ abụọ, anyị na-akpọ ya A na B.

  1. A. Nwụnye Oozie.
  2. B. Nhazi Oozie.

Ka anyị buru ụzọ nyochaa aha nnabata sistemụ, na-eji iwu 'hostname'.

 hostname

master

Usoro A: Nwụnye Oozie na RHEL/CentOS 6/5

Anyị na-eji ebe nchekwa CDH gọọmentị sitere na saịtị cloudera iji wụnye CDH4. Gaa na ngalaba nbudata CDH gọọmentị wee budata ụdị CDH4 (ya bụ 4.6) ma ọ bụ ị nwekwara ike iji iwu wget na-eso budata ebe nchekwa wee wụnye ya.

# wget http://archive.cloudera.com/cdh4/one-click-install/redhat/6/i386/cloudera-cdh-4-0.i386.rpm
# yum --nogpgcheck localinstall cloudera-cdh-4-0.i386.rpm

# wget http://archive.cloudera.com/cdh4/one-click-install/redhat/6/x86_64/cloudera-cdh-4-0.x86_64.rpm
# yum --nogpgcheck localinstall cloudera-cdh-4-0.x86_64.rpm
# wget http://archive.cloudera.com/cdh4/one-click-install/redhat/5/i386/cloudera-cdh-4-0.i386.rpm
# yum --nogpgcheck localinstall cloudera-cdh-4-0.i386.rpm

# wget http://archive.cloudera.com/cdh4/one-click-install/redhat/5/x86_64/cloudera-cdh-4-0.x86_64.rpm
# yum --nogpgcheck localinstall cloudera-cdh-4-0.x86_64.rpm

Ozugbo, ị gbakwunyela ebe nchekwa CDH n'okpuru sistemụ gị, ị nwere ike iji iwu na-esonụ iji wụnye Oozie na sistemụ.

 yum install oozie

Ugbu a, wụnye onye ahịa oozie (iwu dị n'elu kwesịrị ikpuchi akụkụ nrụnye ndị ahịa ma ọ bụrụ na ịnwaleghị iwu n'okpuru).

 yum install oozie-client

Mara: Nrụnye dị n'elu na-ahazi ọrụ oozie ka ọ na-agba na mmalite sistemụ. Ezigbo ọrụ! Anyị emechaala akụkụ mbụ nke nrụnye ugbu a ka anyị gaa n'akụkụ nke abụọ iji hazie oozie.

Usoro B: Nhazi Oozie na RHEL/CentOS 6/5

Ebe oozie anaghị emekọrịta ihe ozugbo na Hadoop, anyị achọghị nhazi nhazi ọ bụla ebe a.

Kpachara anya: Biko hazie ntọala niile ka oozie anaghị arụ ọrụ, nke ahụ pụtara na ị ga-agbaso usoro n'okpuru ebe ọrụ oozie anaghị arụ ọrụ.

Oozie nwere 'Derby' dị ka ndabere wuru na DB, a ga m akwado ka ị jiri Mysql DB. Ya mere, ka anyị tinye MySQL nchekwa data site na iji isiokwu na-esonụ.

  1. Wụnye MySQL ọdụ data na RHEL/CentOS 6/5

Ozugbo ịmechara akụkụ nke nrụnye, na-aga n'ihu iji mepụta oozie DB ma nye ohere dị ka egosiri n'okpuru.

 mysql -uroot -p
Enter password:
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 3
Server version: 5.5.38 MySQL Community Server (GPL) by Remi

Copyright (c) 2000, 2014, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> create database oozie;
Query OK, 1 row affected (0.00 sec)

mysql> grant all privileges on oozie.* to 'oozie'@'localhost' identified by 'oozie';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all privileges on oozie.* to 'oozie'@'%' identified by 'oozie';
Query OK, 0 rows affected (0.00 sec)

mysql> exit
Bye

Na-esote, hazie akụrụngwa Oozie maka MySQL. Mepee faịlụ 'oozie-site.xml' wee dezie akụrụngwa ndị a dịka egosiri.

 cd /etc/oozie/conf
 vi oozie-site.xml

Tinye ihe ndị a (dị nnọọ dochie nna ukwu [aha nnabata m] na aha nnabata gị).

<property>
        <name>oozie.service.JPAService.jdbc.driver</name>
        <value>com.mysql.jdbc.Driver</value>
    </property>
    <property>
        <name>oozie.service.JPAService.jdbc.url</name>
        <value>jdbc:mysql://master:3306/oozie</value>
    </property>
    <property>
        <name>oozie.service.JPAService.jdbc.username</name>
        <value>oozie</value>
    </property>
    <property>
        <name>oozie.service.JPAService.jdbc.password</name>
        <value>oozie</value>
    </property>

Budata ma gbakwunye MySQL JDBC ọkwọ ụgbọ ala JAR na ndekọ Oozie lib. Iji mee nke a, mee nnukwu iwu na-esote na ọnụ.

 cd /tmp/
 wget http://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.31.tar.gz
 tar -zxf mysql-connector-java-5.1.31.tar.gz	
 cd mysql-connector-java-5.1.31
 cp mysql-connector-java-5.1.31-bin.jar /var/lib/oozie/

Mepụta atụmatụ nchekwa data oozie site na ime iwu dị n'okpuru ma biko mara na nke a ga-agba ọsọ dị ka onye ọrụ oozie.

 sudo -u oozie /usr/lib/oozie/bin/ooziedb.sh create -run
setting OOZIE_CONFIG=/etc/oozie/conf
setting OOZIE_DATA=/var/lib/oozie
setting OOZIE_LOG=/var/log/oozie
setting OOZIE_CATALINA_HOME=/usr/lib/bigtop-tomcat
setting CATALINA_TMPDIR=/var/lib/oozie
setting CATALINA_PID=/var/run/oozie/oozie.pid
setting CATALINA_BASE=/usr/lib/oozie/oozie-server-0.20
setting CATALINA_OPTS=-Xmx1024m
setting OOZIE_HTTPS_PORT=11443
...
DONE
Oozie DB has been created for Oozie version '3.3.2-cdh4.7.0'
The SQL commands have been written to: /tmp/ooziedb-8250405588513665350.sql

Ịkwesịrị ibudata ExtJS lib na ịntanetị iji mee ka oozie webụ console nwee ike. Gaa na ibe CDH ExtJS gọọmentị, wee budata ọba akwụkwọ 2.2 ụdị ExtJS ma ọ bụ ị nwere ike budata ngwugwu ahụ site na iji iwu a.

 cd /tmp/
 wget http://archive.cloudera.com/gplextras/misc/ext-2.2.zip
 unzip ext-2.2.zip
 mv ext-2.2 /var/lib/oozie/

N'ikpeazụ, malite sava oozie, site n'ịgbaso iwu.

 service oozie status
not running.

 service oozie start

 service oozie status
running

 oozie admin -oozie http://localhost:11000/oozie -status
System mode: NORMAL

Mepee UI oozie site na iji ihe nchọgharị kachasị amasị gị, wee tụọ aka na adreesị IP gị. N'okwu a, IP m bụ 192.168.1.129.

http://192.168.1.129:11000

Ugbu a ọ bụrụ na ị hụ UI a. Daalụ!! Ị haziela oozie nke ọma.

A nwalela usoro a nke ọma na RHEL/CentOS 6/5. N'ime edemede m na-abịa, m ga-ekekọrịta otu esi ahazi na ịhazi ọrụ hadoop site na oozie. Jikọọ maka ihe ndị ọzọ ma echefula ịza nzaghachi gị.