CDH安装文档环境准备软件版本选择类目版本下载地址操作系统CentOSLinuxrelease7.5.1804(Core)https
://mirrors.aliyun.com/centos/7.5.1804/isos/x86_64/CentOS-7-x86_64
-Minimal-1804.iso数据库mysql-5.7.24-1.el7.x86_64.rpm-bundle.tarhttp:
//dev.mysql.com/get/Downloads/MySQL-5.7/mysql-5.7.24-1.el7.x86_64
.rpm-bundle.tarJDKJDK1.8https://archive.cloudera.com/cm6/6.0.1/r
edhat7/yum/RPMS/x86_64/oracle-j2sdk1.8-1.8.0+update141-1.x86_64.r
pmClouderaManagercloudera-manager-server-6.0.1https://archive.cl
oudera.com/cm6/6.0.1/redhat7/yum/RPMS/x86_64/cloudera-manager-ser
ver-6.0.1-610811.el7.x86_64.rpmcloudera-manager-daemons-6.0.1http
s://archive.cloudera.com/cm6/6.0.1/redhat7/yum/RPMS/x86_64/cloude
ra-manager-daemons-6.0.1-610811.el7.x86_64.rpmcloudera-manager-ag
ent-6.0.1https://archive.cloudera.com/cm6/6.0.1/redhat7/yum/RPMS/
x86_64/cloudera-manager-agent-6.0.1-610811.el7.x86_64.rpmCDHCDH6
.0.1https://archive.cloudera.com/cdh6/6.0.1/parcels/CDH-6.0.1-1.c
dh6.0.1.p0.590678-el7.parcelmanifest.jsonhttps://archive.cloudera
.com/cdh6/6.0.1/parcels/manifest.json节点IPhostname内存磁盘nodeCM管理软件19
2.168.1.81CDH18G50GMasterClouderaManagerServer&Agent，MYSQL192.
168.1.82CDH28G50GWorkerClouderaManagerAgent192.168.1.83CDH38G50
GWorkerClouderaManagerAgent192.168.1.84CDH48G50GWorkerCloudera
ManagerAgent上传软件包创建软件包上传目录mkdir-p/usr/local/softwarecd/usr/lo
cal/software上传软件包，软件包清单CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcelc
loudera-manager-agent-6.0.1-610811.el7.x86_64.rpmcloudera-manager
-daemons-6.0.1-610811.el7.x86_64.rpmcloudera-manager-server-6.0.1
-610811.el7.x86_64.rpmmanifest.jsonmysql-5.7.24-1.el7.x86_64.rpm-
bundle.tarmysql-connector-java-8.0.13.tar.gzoracle-j2sdk1.8-1.8.0
+update141-1.x86_64.rpm配置主机名和hosts解析(所有节点)编辑/etc/hostname，修改主机名，并
使用命令hostnamectl使其立刻生效。编辑文件/etc/hosts，增加hosts内容：vi/etc/hostnameho
stnamectlvi/etc/hosts关闭防火墙(所有节点)systemctlstopfirewalld.service
systemctldisablefirewalld.service关闭SELinuxsed-i''s#SELINUX=enf
orcing#SELINUX=disabled#g''/etc/selinux/configsetenforce0添加定时任务(
时间同步，可以添加NTP服务)echo"$((RANDOM%60))$((RANDOM%24))/usr/sbi
n/ntpdatetime1.aliyun.com">>/var/spool/cron/root禁用透明大页面压缩CDH配置
需要echonever>/sys/kernel/mm/transparent_hugepage/defragechonev
er>/sys/kernel/mm/transparent_hugepage/enabled并将上面的两条命令写入开机自启动/
etc/rc.local优化交换分区echo"vm.swappiness=10">>/etc/sysctl.confsy
sctl-p安装CM和CDH配置JDK(所有节点)rpm-ivhoracle-j2sdk1.8-1.8.0+update
141-1.x86_64.rpm安装CMServer和AgentMaster:rpm-ivhcloudera-mana
ger-daemons-6.0.1-610811.el7.x86_64.rpmrpm-ivhcloudera-manager-
server-6.0.1-610811.el7.x86_64.rpmrpm-ivhcloudera-manager-agent
-6.0.1-610811.el7.x86_64.rpm安装agent报错缺少依赖，解决办法：yuminstallpsmisc
cyrus-sasl-gssapi/lib/lsb/init-functionshttpdmod_sslopenssl-
develpython-psycopg2MySQL-pythonWorkerrpm-ivhcloudera-manager
-daemons-6.0.1-610811.el7.x86_64.rpmrpm-ivhcloudera-manager-age
nt-6.0.1-610811.el7.x86_64.rpm安装mysql（Master）mkdirmysqlmvmysql
-5.7.24-1.el7.x86_64.rpm-bundle.tarmysql/cdmysqltarxvfmysql-5
.7.24-1.el7.x86_64.rpm-bundle.tar安装mysqlrpm-ivhmysql-community-
common-5.7.24-1.el7.x86_64.rpm--nodeps--forcerpm-ivhmysql-com
munity-libs-5.7.24-1.el7.x86_64.rpm--nodeps--forcerpm-ivhmysq
l-community-client-5.7.24-1.el7.x86_64.rpm--nodeps--forcerpm-i
vhmysql-community-server-5.7.24-1.el7.x86_64.rpm--nodeps--forc
e启动、停止：servicemysqldstartservicemysqldstopservicemysqldstat
us修改数据库配置文件/etc/my.confvi/etc/my.conf[mysqld]datadir=/var/lib/m
ysqlsocket=/var/lib/mysql/mysql.socktransaction-isolation=READ-
COMMITTED#Disablingsymbolic-linksisrecommendedtopreventass
ortedsecurityrisks;#todoso,uncommentthisline:symbolic-lin
ks=0key_buffer_size=32Mmax_allowed_packet=32Mthread_stack=
256Kthread_cache_size=64query_cache_limit=8Mquery_cache_size
=64Mquery_cache_type=1max_connections=550#expire_logs_days
=10#max_binlog_size=100M#log_binshouldbeonadiskwithenou
ghfreespace.#Replace''/var/lib/mysql/mysql_binary_log''withan
appropriatepathforyour#systemandchownthespecifiedfoldert
othemysqluser.log_bin=/var/lib/mysql/mysql_binary_log#Inlater
versionsofMySQL,ifyouenablethebinaryloganddonotset#a
server_id,MySQLwillnotstart.Theserver_idmustbeuniquewi
thin#thereplicatinggroup.server_id=1binlog_format=mixedread_b
uffer_size=2Mread_rnd_buffer_size=16Msort_buffer_size=8Mjoi
n_buffer_size=8M#InnoDBsettingsinnodb_file_per_table=1innod
b_flush_log_at_trx_commit=2innodb_log_buffer_size=64Minnodb_b
uffer_pool_size=4Ginnodb_thread_concurrency=8innodb_flush_met
hod=O_DIRECTinnodb_log_file_size=512M[mysqld_safe]log-error=/
var/log/mysqld.logpid-file=/var/run/mysqld/mysqld.pidsql_mode=STR
ICT_ALL_TABLES添加到自启动项sudosystemctlenablemysqld重启MYSQLsudosyst
emctlstartmysqld修改root密码cat/var/log/mysqld.log|more连接mysqlmy
sql-uroot-p修改密码复杂度：setglobalvalidate_password_policy=0;setgl
obalvalidate_password_policy=0;setglobalvalidate_password_mixe
d_case_count=0;setglobalvalidate_password_number_count=3;setgl
obalvalidate_password_special_char_count=0;setglobalvalidate_p
assword_length=3;设置密码setpassword=''123456'';grantallprivilegeso
n.to''root''@''%''identifiedby''123456'';为Cloudera各软件创建数据库使用r
oot创建以下数据库和账号。CREATEDATABASEscmDEFAULTCHARACTERSETutf8DEFA
ULTCOLLATEutf8_general_ci;GRANTALLONscm.TO''scm''@''%''IDENT
IFIEDBY''hems123'';CREATEDATABASEamonDEFAULTCHARACTERSETutf
8DEFAULTCOLLATEutf8_general_ci;GRANTALLONamon.TO''amon''@''
%''IDENTIFIEDBY''hems123'';CREATEDATABASErmanDEFAULTCHARACTER
SETutf8DEFAULTCOLLATEutf8_general_ci;GRANTALLONrman.TO
''rman''@''%''IDENTIFIEDBY''hems123'';CREATEDATABASEhueDEFAULTC
HARACTERSETutf8DEFAULTCOLLATEutf8_general_ci;GRANTALLONhu
e.TO''hue''@''%''IDENTIFIEDBY''hems123'';CREATEDATABASEmetastor
eDEFAULTCHARACTERSETutf8DEFAULTCOLLATEutf8_general_ci;GRAN
TALLONmetastore.TO''hive''@''%''IDENTIFIEDBY''hems123'';CREATE
DATABASEsentryDEFAULTCHARACTERSETutf8DEFAULTCOLLATEutf8_
general_ci;GRANTALLONsentry.TO''sentry''@''%''IDENTIFIEDBY''h
ems123'';CREATEDATABASEnavDEFAULTCHARACTERSETutf8DEFAULTCO
LLATEutf8_general_ci;GRANTALLONnav.TO''nav''@''%''IDENTIFIED
BY''hems123'';CREATEDATABASEnavmsDEFAULTCHARACTERSETutf8DEF
AULTCOLLATEutf8_general_ci;GRANTALLONnavms.TO''navms''@''%''
IDENTIFIEDBY''hems123'';CREATEDATABASEoozieDEFAULTCHARACTERS
ETutf8DEFAULTCOLLATEutf8_general_ci;GRANTALLONoozie.TO''
oozie''@''%''IDENTIFIEDBY''hems123'';安装MySQLJDBC驱动(所有节点)mkdir-p
/usr/share/java/tarzxvfmysql-connector-java-8.0.13.tar.gzcdmy
sql-connector-java-8.0.13/cpmysql-connector-java-8.0.13.jar/usr
/share/java/mysql-connector-java.jar设置ClouderaManager数据库/opt/c
loudera/cm/schema/scm_prepare_database.shmysqlscmscm注：该命令是当数据库
和ClouderaManagerServer装在同一个节点上时，在该节点上执行使用的。其他部署情况以及脚本的详细使用方法请参考
：https://www.cloudera.com/documentation/enterprise/6/6.0/topics/p
repare_cm_database.html配置CDH的软件包parcels（Master）在manifest.json文件中
，找到对应版本的秘钥，复制到.sha文件中。echo"2e650f1f1ea020a3efc98a231b85c2df1a50b030">CDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel.shacpCDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel/opt/cloudera/parcel-repocpCDH-6.0.1-1.cdh6.0.1.p0.590678-el7.parcel.sha/opt/cloudera/parcel-repo修改属主属组。chowncloudera-scm.cloudera-scm/opt/cloudera/parcel-repo/启动ClouderaManagerServersystemctlstartcloudera-scm-server注：如果启动中有什么问题，可以查看日志。tail-f/var/log/cloudera-scm-server/cloudera-scm-server.log |
|
