TimelineServicev.2(HDP3.1)参数配置以及相关环境

Timeline Service v2 默认集成嵌入HBase(HMaster、HRegionServer)，进程启动 User: yarn-ats

吉安ssl适用于网站、小程序/APP、API接口等需要进行数据传输应用场景，ssl证书未来市场广阔！成为成都创新互联公司的ssl证书销售渠道，可以享受市场价格4-6折优惠！如果有意向欢迎电话联系或者加微信：18982081108（备注：SSL证书合作）期待与您的合作！

嵌入HBase配置文件路径：

[yarn-ats@master1 embedded-yarn-ats-hbase]$ pwd
/usr/hdp/3.1.0.0-78/hadoop-yarn/conf/embedded-yarn-ats-hbase
[yarn-ats@master1 embedded-yarn-ats-hbase]$ ls -la
total 40
drwxr-xr-x 2 yarn-ats hadoop 4096 3月   9 10:32 .
drwxr-xr-x 4 root     root   4096 4月  23 19:32 ..
-rw-r--r-- 1 yarn-ats hadoop 1462 3月   7 09:22 hadoop-metrics2-hbase.properties
-rw-r--r-- 1 yarn-ats hadoop 3374 4月  23 20:41 hbase-env.sh
-rw-r--r-- 1 yarn-ats hadoop  818 3月   7 09:22 hbase_grant_permissions.sh
-rw-r--r-- 1 yarn-ats hadoop  411 3月   7 09:22 hbase-policy.xml
-rw-r--r-- 1 yarn-ats hadoop 5394 3月   7 09:22 hbase-site.xml
-rw-r--r-- 1 yarn-ats hadoop 5315 3月   7 09:22 log4j.properties

hbase-site.xml文件




  dfs.domain.socket.path
  /var/lib/hadoop-hdfs/dn_socket



  hbase.bucketcache.ioengine
  



  hbase.bucketcache.percentage.in.combinedcache
  



  hbase.bucketcache.size
  



  hbase.client.keyvalue.maxsize
  1048576



  hbase.client.retries.number
  7



  hbase.client.scanner.caching
  100



  hbase.cluster.distributed
  true



  hbase.coprocessor.master.classes
  



  hbase.coprocessor.region.classes
  



  hbase.coprocessor.regionserver.classes
  



  hbase.defaults.for.version.skip
  true



  hbase.hregion.majorcompaction
  604800000



  hbase.hregion.majorcompaction.jitter
  0.50



  hbase.hregion.max.filesize
  10737418240



  hbase.hregion.memstore.block.multiplier
  4



  hbase.hregion.memstore.flush.size
  134217728



  hbase.hregion.memstore.mslab.enabled
  true



  hbase.hstore.blockingStoreFiles
  10



  hbase.hstore.compaction.max
  10



  hbase.hstore.compactionThreshold
  3



  hbase.local.dir
  ${hbase.tmp.dir}/local



  hbase.master.info.bindAddress
  0.0.0.0



  hbase.master.info.port
  17010



  hbase.master.namespace.init.timeout
  2400000



  hbase.master.port
  17000



  hbase.master.ui.readonly
  false



  hbase.master.wait.on.regionservers.timeout
  30000



  hbase.regionserver.executor.openregion.threads
  20



  hbase.regionserver.global.memstore.size
  0.4



  hbase.regionserver.handler.count
  30



  hbase.regionserver.info.port
  17030



  hbase.regionserver.port
  17020



  hbase.rootdir
  /atsv2/hbase/data



  hbase.rpc.protection
  authentication



  hbase.rpc.timeout
  90000



  hbase.security.authentication
  simple



  hbase.security.authorization
  false



  hbase.superuser
  yarn



  hbase.tmp.dir
  /tmp/hbase-${user.name}



  hbase.zookeeper.property.clientPort
  2181



  hbase.zookeeper.quorum
  manager.bigdata.com,master2.bigdata.com,master1.bigdata.com



  hbase.zookeeper.useMulti
  true



  hfile.block.cache.size
  0.4



  zookeeper.recovery.retry
  6



  zookeeper.session.timeout
  90000



  zookeeper.znode.parent
  /atsv2-hbase-unsecure

Zookeeper Cluster znode信息

[zookeeper@master1 zookeeper-client]$ bin/zkCli.sh -server master1.bigdata.com:2181
[zk: master1.bigdata.com:2181(CONNECTED) 1] ls /atsv2-hbase-unsecure
[replication, meta-region-server, rs, splitWAL, backup-masters, table-lock, flush-table-proc, master-maintenance, online-snapshot, switch, master, running, draining, namespace, hbaseid, table]
[zk: master1.bigdata.com:2181(CONNECTED) 2] ls /atsv2-hbase-unsecure/rs

UI Interface
```
http://master1.bigdata.com:17010/
```

Table list

prod.timelineservice.app_flow
prod.timelineservice.application
prod.timelineservice.entity 
prod.timelineservice.flowactivity
prod.timelineservice.flowrun
prod.timelineservice.subapplication

Timeline Service v.2 (HDP3.1 )参数配置以及相关环境
TTL: 默认30天

Hbase shell执行

hbase --config /usr/hdp/3.1.0.0-78/hadoop-yarn/conf/embedded-yarn-ats-hbase shell
hbase(main):004:0* status
1 active master, 0 backup masters, 1 servers, 0 dead, 124.0000 average load
Took 1.2255 seconds                                                                                                                                                    
hbase(main):005:0> list
TABLE                                                                                                                                                                  
prod.timelineservice.app_flow                                                                                                                                 
prod.timelineservice.application                                                                                                                                
prod.timelineservice.entity                                                                                                                                       
prod.timelineservice.flowactivity                                                                                                                               
prod.timelineservice.flowrun                                                                                                                                      
prod.timelineservice.subapplication                                                                                                                          
6 row(s)
Took 0.0862 seconds                                                                                                                                                    
=> ["prod.timelineservice.app_flow", "prod.timelineservice.application", "prod.timelineservice.entity", "prod.timelineservice.flowactivity", "prod.timelineservice.flowrun", "prod.timelineservice.subapplication"]
hbase(main):018:0> scan 'prod.timelineservice.app_flow', { COLUMNS => ['m'], LIMIT => 10 }

HDFS存储路径
/atsv2/hbase

分享名称：TimelineServicev.2(HDP3.1)参数配置以及相关环境
转载来源：http://6mz.cn/article/gdeisd.html

网站建设知识

TimelineServicev.2(HDP3.1)参数配置以及相关环境

其他资讯