当前位置:首页 >时尚 >大数据安全利器 Ranger 编译安装 本文将介绍部署过程

大数据安全利器 Ranger 编译安装 本文将介绍部署过程

2024-06-10 10:42:20 [百科] 来源:避面尹邢网

大数据安全利器 Ranger 编译安装

作者:数据库干货铺 大数据 Ranger大数据领域的大数一个集中式安全管理框架,它可以对诸如Hdfs、据安Hive、全利器Kafka、译安Storm等组件进行细粒度的大数权限控制。本文将介绍部署过程。据安

ranger大数据领域的全利器一个集中式安全管理框架,它可以对诸如hdfs、译安hive、大数kafka、据安storm等组件进行细粒度的全利器权限控制。本文将介绍部署过程

大数据安全利器 Ranger 编译安装 本文将介绍部署过程

1、译安部署准备

ranger: 进入apach官网下载
http://ranger.apache.org/download.html,大数 本次使用的据安是ranger1.2.0 ,地址为http://mirror.bit.edu.cn/apache/ranger/1.2.0/apache-ranger-1.2.0.tar.gz。全利器

大数据安全利器 Ranger 编译安装 本文将介绍部署过程

maven: 进入Apache的maven官网
http://maven.apache.org/download.cgi下载, 本次用的是maven3.6 ,下载地址 http://mirrors.tuna.tsinghua.edu.cn/apache/maven/maven-3/3.6.1/binaries/apache-maven-3.6.1-bin.tar.gz。

大数据安全利器 Ranger 编译安装 本文将介绍部署过程

python2.7: 因编译及试用中需要Python2.7版本的Python,因此如果为Centos6系统,需要手动升级Python至Python2.7,升级过程可参考历史文章Python升级。

MySQL: 需要mysql数据库,如无可用MySQL需要部署一套MySQL,部署方法请参考历史文章MySQL部署

mysql-connector-java: 进入MySQL官网下载
​​​https://dev.mysql.com/downloads/connector/j/5.1.html。​​

bc命令: 使用过程中需要使用bc命令:

## 下载ranger
wget http://mirror.bit.edu.cn/apache/ranger/1.2.0/apache-ranger-1.2.0.tar.gz
## 下载maven
wget http://mirrors.tuna.tsinghua.edu.cn/apache/maven/maven-3/3.6.1/binaries/apache-maven-3.6.1-bin.tar.gz
## 安装bc命令
yum install bc -y

2、编译安装过程

(1) 解压

#  解压ranger及maven包
tar -zxvf apache-ranger-1.2.0.tar.gz
tar -zxvf apache-maven-3.6.1-bin.tar.gz
# 将maven相关命令路径配置到环境变量
vim /etc/profile
export PATH=/usr/local/maven/bin:$PATH

(2)编译

cd apache-ranger-1.2.0
mvn clean
# 编译
mvn clean compile package assembly:assembly install -DskipTests -Drat.skip=true编译过程中会有如下信息

执行过程中会出现很多信息,且编译时间很长,如果出现异常,根据对应的报错信息进行处理,例如Python包不存在时需要手动添加;如果某个jar不存在,可以手动下载放置对应的路径或修改pom地址或文件。

经过很长一段时间,且多次解决错误后,编译完成,出现如下结果:

[INFO] Reactor Summary for ranger 1.2.0:
[INFO]
[INFO] ranger ............................................. SUCCESS [ 0.244 s]
[INFO] Jdbc SQL Connector ................................. SUCCESS [ 0.573 s]
[INFO] Credential Support ................................. SUCCESS [ 0.391 s]
[INFO] Audit Component .................................... SUCCESS [ 1.065 s]
[INFO] Common library for Plugins ......................... SUCCESS [ 1.332 s]
[INFO] Installer Support Component ........................ SUCCESS [ 0.153 s]
[INFO] Credential Builder ................................. SUCCESS [ 0.293 s]
[INFO] Embedded Web Server Invoker ........................ SUCCESS [ 0.345 s]
[INFO] Key Management Service ............................. SUCCESS [ 0.984 s]
[INFO] ranger-plugin-classloader .......................... SUCCESS [ 0.209 s]
[INFO] HBase Security Plugin Shim ......................... SUCCESS [ 0.830 s]
[INFO] HBase Security Plugin .............................. SUCCESS [ 1.092 s]
[INFO] Hdfs Security Plugin ............................... SUCCESS [ 0.786 s]
[INFO] Hive Security Plugin ............................... SUCCESS [ 1.135 s]
[INFO] Knox Security Plugin Shim .......................... SUCCESS [ 0.524 s]
[INFO] Knox Security Plugin ............................... SUCCESS [ 0.712 s]
[INFO] Storm Security Plugin .............................. SUCCESS [ 0.533 s]
[INFO] YARN Security Plugin ............................... SUCCESS [ 0.398 s]
[INFO] Ranger Util ........................................ SUCCESS [ 1.099 s]
[INFO] Unix Authentication Client ......................... SUCCESS [ 0.259 s]
[INFO] Security Admin Web Application ..................... SUCCESS [ 12.847 s]
[INFO] KAFKA Security Plugin .............................. SUCCESS [ 0.458 s]
[INFO] SOLR Security Plugin ............................... SUCCESS [ 1.208 s]
[INFO] NiFi Security Plugin ............................... SUCCESS [ 0.386 s]
[INFO] NiFi Registry Security Plugin ...................... SUCCESS [ 0.381 s]
[INFO] Unix User Group Synchronizer ....................... SUCCESS [ 1.016 s]
[INFO] Ldap Config Check Tool ............................. SUCCESS [ 0.222 s]
[INFO] Unix Authentication Service ........................ SUCCESS [ 0.330 s]
[INFO] KMS Security Plugin ................................ SUCCESS [ 0.490 s]
[INFO] Tag Synchronizer ................................... SUCCESS [ 1.211 s]
[INFO] Hdfs Security Plugin Shim .......................... SUCCESS [ 0.311 s]
[INFO] Hive Security Plugin Shim .......................... SUCCESS [ 0.800 s]
[INFO] YARN Security Plugin Shim .......................... SUCCESS [ 0.320 s]
[INFO] Storm Security Plugin shim ......................... SUCCESS [ 0.365 s]
[INFO] KAFKA Security Plugin Shim ......................... SUCCESS [ 0.313 s]
[INFO] SOLR Security Plugin Shim .......................... SUCCESS [ 0.701 s]
[INFO] Atlas Security Plugin Shim ......................... SUCCESS [ 0.398 s]
[INFO] KMS Security Plugin Shim ........................... SUCCESS [ 0.342 s]
[INFO] ranger-examples .................................... SUCCESS [ 0.042 s]
[INFO] Ranger Examples - Conditions and ContextEnrichers .. SUCCESS [ 0.335 s]
[INFO] Ranger Examples - SampleApp ........................ SUCCESS [ 0.140 s]
[INFO] Ranger Examples - Ranger Plugin for SampleApp ...... SUCCESS [ 0.322 s]
[INFO] Ranger Tools ....................................... SUCCESS [ 0.457 s]
[INFO] Atlas Security Plugin .............................. SUCCESS [ 0.722 s]
[INFO] Sqoop Security Plugin .............................. SUCCESS [ 0.472 s]
[INFO] Sqoop Security Plugin Shim ......................... SUCCESS [ 0.293 s]
[INFO] Kylin Security Plugin .............................. SUCCESS [ 0.410 s]
[INFO] Kylin Security Plugin Shim ......................... SUCCESS [ 0.315 s]
[INFO] Unix Native Authenticator .......................... SUCCESS [ 0.491 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:24 h
[INFO] Finished at: 2019-08-19T09:47:05+08:00
[INFO] ------------------------------------------------------------------------

在target文件夹下将有如下包。

即表示编译成功完成。

(3)安装并启动ranger-admin

修改配置文件

关于数据库安装,权限设置等,本文不再展开。

#  进入target目录
cd /opt/apache-ranger-1.2.0/target/
# 解压ranger-1.2.0-admin.tar.gz
tar -zxvf ranger-1.2.0-admin.tar.gz
# 进入ranger-1.2.0-admin目录
cd ranger-1.2.0-admin
# 修改 install.properties
vim install.properties
SQL_CONNECTOR_JAR=/usr/share/java/mysql-connector-java-8.0.17.jar // 修改为准备工作中下载的jar包及路径
db_root_user=root
db_root_password=123456
db_host=192.168.56.105
db_name=ranger
db_user=rangeradmin
db_password=rangeradmin
# 可以注销如下内容
#Source for Audit Store. Currently only solr is supported.
# * audit_store is solr
## audit_store=solr
# * audit_solr_url URL to Solr. E.g. http://<solr_host>:6083/solr/ranger_audits
## audit_solr_urls=
## audit_solr_user=
## audit_solr_password=
## audit_solr_zookeepers=

修改 setup.sh

// 注销如下内容
## if [ "$?" != "0" ]
## then
## validateDefaultUsersPassword 'admin' "${ rangerAdmin_password}"
## validateDefaultUsersPassword 'rangertagsync' "${ rangerTagsync_password}"
## validateDefaultUsersPassword 'rangerusersync' "${ rangerUsersync_password}"
## validateDefaultUsersPassword 'keyadmin' "${ keyadmin_password}"
## fi

安装

./ setup.sh

注意,如果中途报如下错误。

2019-08-20 08:54:22,460  [I] '/usr/local/java/bin/java' command found

setup.sh:行325: bc: 未找到命令

setup.sh: 第 325 行:[: -eq: 期待一元表达式

即缺少bc命令,安装后即可。

最终出现如下结果:

2019-08-20 09:00:18,240  [I] --------- Verifying Ranger DB connection ---------
2019-08-20 09:00:18,240 [I] Checking connection..
geradmin' -p '

(责任编辑:探索)

    推荐文章
    热点阅读