Apache Ambari 2.7.5 Build on Mac OS X (맥에서 암바리 2.7.5 빌드 과정)
1. vagrant 설치 : with Brew on Mac OS X
user@Mac ~ % /bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"
user@Mac ~ % brew tap hashicorp/tap
user@Mac ~ % brew install vagrant
※ vagrant 설치 : CentOS 7 Linux
sudo yum install -y yum-utils
sudo yum-config-manager --add-repo https://rpm.releases.hashicorp.com/RHEL/hashicorp.repo
sudo yum -y install vagrant
2. ambari-vagrant git clone
user@Mac ~ % git clone https://github.com/u39kun/ambari-vagrant.git
3. /etc/hosts 호스트 추가(설치할 os 버전 부분만)
user@Mac ~ % cat ambari-vagrant/append-to-etc-hosts.txt
※ vagrant의 모든 호스트가 들어있는 파일로, 여기서는 # centos 7.4 부분만 필요하다.
user@Mac ~ % sudo vi /etc/hosts
...
# centos 7.4
192.168.74.101 c7401.ambari.apache.org c7401
192.168.74.102 c7402.ambari.apache.org c7402
192.168.74.103 c7403.ambari.apache.org c7403
192.168.74.104 c7404.ambari.apache.org c7404
192.168.74.105 c7405.ambari.apache.org c7405
192.168.74.106 c7406.ambari.apache.org c7406
192.168.74.107 c7407.ambari.apache.org c7407
192.168.74.108 c7408.ambari.apache.org c7408
192.168.74.109 c7409.ambari.apache.org c7409
192.168.74.110 c7410.ambari.apache.org c7410
...
4. vagrant private key 생성
user@Mac ~ % vagrant ~/.vagrant.d/insecure_private_key
5. pre-configured VM 사용하기
user@Mac ~ % cd ambari-vagrant/centos7.4/
user@Mac ~ % vi Vagrantfile
(dev-bootstrap.sh이 있는 line 29 주석 해제)
...
c7401.vm.provision :shell, :path => "dev-bootstrap.sh"
...
6. dev-bootstrap.sh 파일 수정
※ ambari build 를 위한 적절한 버전의 소프트웨어 사용 설정
user@Mac ~ % vi dev-bootstrap.sh
...
wget https://nodejs.org/dist/v8.11.2/node-v8.11.2-linux-x64.tar.gz
tar zxvf node-v8.11.2-linux-x64.tar.gz
mv node-v8.11.2-linux-x64 /usr/share/node
/usr/share/node/bin/npm install -g brunch
...
wget https://archive.apache.org/dist/maven/maven-3/3.5.3/binaries/apache-maven-3.5.3-bin.tar.gz
tar zxvf apache-maven-3.5.3-bin.tar.gz
mv apache-maven-3.5.3 /usr/share/maven
...
7.VM 생성
user@Mac ~ % cd
user@Mac ~ % cd ambari-vagrant/centos7.4/
user@Mac ~ % cp ~/.vagrant.d/insecure_private_key .
user@Mac ~ % vagrant up c7401
※ vagrant VM을 전체 삭제하려면,
user@Mac ~ % vagrant destroy -f
6.VM 접속
user@Mac ~ % vagrant ssh c7401
7. root 유저로 변환
[vagrant@c7401 ~]$ sudo su -
8. Ambari 2.7.5.0 버전 다운로드 및 mvn 버전 세팅
# wget https://www-eu.apache.org/dist/ambari/ambari-2.7.5/apache-ambari-2.7.5-src.tar.gz
# tar xfvz apache-ambari-2.7.5-src.tar.gz
# cd apache-ambari-2.7.5-src
# mvn versions:set -DnewVersion=2.7.5.0.0
# pushd ambari-metrics
# mvn versions:set -DnewVersion=2.7.5.0.0
# popd
9. Ambari rpm build
1) 개발 패키지 설치
# yum install python-devel.x86_64
2) ambari-admin 폴더의 pom.xml 수정
# cd ambari-admin/
# vi pom.xml
...
<nodeVersion>v8.11.2</nodeVersion>
<npmVersion>5.6.0</npmVersion>
...
# cd ..
3) ambari-metrics 폴더의 pom.xml 수정 (line 42-50)
# cd ambari-metrics/
# vi pom.xml
...
<hbase.tar>https://archive.apache.org/dist/hbase/2.0.2/hbase-2.0.2-bin.tar.gz</hbase.tar>
<hbase.folder>hbase-2.0.2</hbase.folder>
<hadoop.tar>https://archive.apache.org/dist/hadoop/common/hadoop-3.1.4/hadoop-3.1.4.tar.gz</hadoop.tar>
<hadoop.folder>hadoop-3.1.4</hadoop.folder>
<hadoop.version>3.1.4</hadoop.version>
<grafana.folder>grafana-6.7.4</grafana.folder>
<grafana.tar>https://dl.grafana.com/oss/release/grafana-6.7.4.linux-amd64.tar.gz</grafana.tar>
<phoenix.tar>https://downloads.apache.org/phoenix/apache-phoenix-5.0.0-HBase-2.0/bin/apache-phoenix-5.0.0-HBase-2.0-bin.tar.gz</phoenix.tar>
<phoenix.folder>apache-phoenix-5.0.0-HBase-2.0-bin</phoenix.folder>
...
# cd ..
4) ambari-metrics/ambari-metrics-timelineservice 폴더의 pom.xml 수정 (line 929)
# cd ambari-metrics/ambari-metrics-timelineservice/
# vi pom.xml
...
file="${project.build.directory}/embedded/${phoenix.folder}/phoenix-5.0.0-HBase-2.0-server.jar
...
# cd ..
5) Build
# mvn -B clean install rpm:rpm -DnewVersion=2.7.5.0.0 -DbuildNumber=5895e4ed6b30a2da8a90fee2403b6cab91d19972 -DskipTests -Dpython.ver="python >= 2.6" -Drat.numUnapprovedLicenses=600
[INFO] Scanning for projects...
...
...
...
[INFO] Executing(%clean): /bin/sh -e /var/tmp/rpm-tmp.W4O5wJ
[INFO] + umask 022
[INFO] + cd /root/apache-ambari-2.7.5-src/ambari-infra/ambari-infra-manager-it/target/rpm/ambari-infra-manager-it/BUILD
[INFO] + /usr/bin/rm -rf /root/apache-ambari-2.7.5-src/ambari-infra/ambari-infra-manager-it/target/rpm/ambari-infra-manager-it/buildroot
[INFO] + exit 0
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Ambari Main 2.7.5.0.0 .............................. SUCCESS [ 4.795 s]
[INFO] Apache Ambari Project POM .......................... SUCCESS [ 0.172 s]
[INFO] Ambari Web ......................................... SUCCESS [ 54.736 s]
[INFO] Ambari Views ....................................... SUCCESS [ 2.374 s]
[INFO] Ambari Admin View .................................. SUCCESS [ 6.410 s]
[INFO] ambari-utility 1.0.0.0-SNAPSHOT .................... SUCCESS [ 33.500 s]
[INFO] ambari-metrics ..................................... SUCCESS [ 1.068 s]
[INFO] Ambari Metrics Common .............................. SUCCESS [ 9.894 s]
[INFO] Ambari Metrics Hadoop Sink ......................... SUCCESS [ 10.069 s]
[INFO] Ambari Metrics Flume Sink .......................... SUCCESS [ 2.123 s]
[INFO] Ambari Metrics Kafka Sink .......................... SUCCESS [ 2.115 s]
[INFO] Ambari Metrics Storm Sink .......................... SUCCESS [ 3.453 s]
[INFO] Ambari Metrics Storm Sink (Legacy) ................. SUCCESS [ 3.210 s]
[INFO] Ambari Metrics Collector ........................... SUCCESS [07:29 min]
[INFO] Ambari Metrics Monitor ............................. SUCCESS [ 2.178 s]
[INFO] Ambari Metrics Grafana ............................. SUCCESS [ 9.604 s]
[INFO] Ambari Metrics Host Aggregator ..................... SUCCESS [ 22.365 s]
[INFO] Ambari Metrics Assembly ............................ SUCCESS [03:35 min]
[INFO] Ambari Service Advisor 1.0.0.0-SNAPSHOT ............ SUCCESS [ 27.628 s]
[INFO] Ambari Server ...................................... SUCCESS [ 01:15 h]
[INFO] Ambari Functional Tests ............................ SUCCESS [ 2.111 s]
[INFO] Ambari Agent ....................................... SUCCESS [-58.-229 s]
[INFO] ambari-logsearch ................................... SUCCESS [ 1.735 s]
[INFO] Ambari Logsearch Appender .......................... SUCCESS [ 4.152 s]
[INFO] Ambari Logsearch Config Api ........................ SUCCESS [ 0.403 s]
[INFO] Ambari Logsearch Config JSON ....................... SUCCESS [ 0.398 s]
[INFO] Ambari Logsearch Config Solr ....................... SUCCESS [ 12.952 s]
[INFO] Ambari Logsearch Config Zookeeper .................. SUCCESS [ 1.690 s]
[INFO] Ambari Logsearch Config Local ...................... SUCCESS [ 0.197 s]
[INFO] Ambari Logsearch Log Feeder Plugin Api ............. SUCCESS [ 9.075 s]
[INFO] Ambari Logsearch Log Feeder Container Registry ..... SUCCESS [ 9.950 s]
[INFO] Ambari Logsearch Log Feeder ........................ SUCCESS [01:01 min]
[INFO] Ambari Logsearch Web ............................... SUCCESS [01:14 min]
[INFO] Ambari Logsearch Server ............................ SUCCESS [ 02:27 h]
[INFO] Ambari Logsearch Assembly .......................... SUCCESS [ 4.325 s]
[INFO] Ambari Logsearch Integration Test .................. SUCCESS [02:39 min]
[INFO] ambari-infra ....................................... SUCCESS [ 1.036 s]
[INFO] Ambari Infra Solr Client ........................... SUCCESS [ 12.429 s]
[INFO] Ambari Infra Solr Plugin ........................... SUCCESS [ 29.353 s]
[INFO] Ambari Infra Manager ............................... SUCCESS [01:34 min]
[INFO] Ambari Infra Assembly .............................. SUCCESS [ 1.477 s]
[INFO] Ambari Infra Manager Integration Tests 2.7.5.0.0 ... SUCCESS [ 51.914 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 03:53 h
[INFO] Finished at: 2021-06-30T04:58:54Z
[INFO] ------------------------------------------------------------------------