文章更改默认数据目录

配置文件上传配置文件分布chnode1配置文件chnode2配置文件chnode3配置文件

集群搭建测试

可以通过deb/rpm、tgz方式安装但是离线安装选择tgz方式比较方便。

本篇介绍

tgz下载https://packages.clickhouse.com/tgz/lts

clickhouse单机安装

搭建集群需要在每台主机上进行单机安装将tgz和install.sh上传到服务器执行

bash

clickhouse-common-static-$LATEST_VERSION-${ARCH}.tgz

\||

clickhouse-common-static-$LATEST_VERSION.tgz

sudo

clickhouse-common-static-$LATEST_VERSION/install/doinst.shtar

-xzvf

clickhouse-common-static-dbg-$LATEST_VERSION-${ARCH}.tgz

\||

clickhouse-common-static-dbg-$LATEST_VERSION.tgz

sudo

clickhouse-common-static-dbg-$LATEST_VERSION/install/doinst.shtar

-xzvf

clickhouse-server-$LATEST_VERSION-${ARCH}.tgz

\||

clickhouse-server-$LATEST_VERSION.tgz

sudo

clickhouse-server-$LATEST_VERSION/install/doinst.sh

configure

clickhouse-client-$LATEST_VERSION-${ARCH}.tgz

\||

clickhouse-client-$LATEST_VERSION.tgz

sudo

clickhouse-client-$LATEST_VERSION/install/doinst.sh默认安装

默认数据库目录

默认数据处于/var/lib/clickhouse。

数据重新启动clickhouse

systemctl

/etc/clickhouse-server/config.xml将全部/var/lib/clickhouse/修改为其他数据下所有文件。

重启clickhouse-server对数据目录进行重新初始化。

2分片-1副本-3节点集群搭建

clickhouse的集群每个分片的每个副本只能放到单独的实例上比如2分片-2副本需要4台机器3分片-2副本需要6台机器。

节点角色描述chnode1Data

节点角色chnode1分片1、副本1chnode2分片2、副本1chnode3无分片、无副本

配置hosts

/etc/clickhouse-server/config.d/目录中的配置会覆盖默认配置所以官网建议

服务器配置添加到/etc/clickhouse-server/config.d/用户配置添加到/etc/clickhouse-server/users.d/不要更改/etc/clickhouse-server/config.xml不要更改/etc/clickhouse-server/users.xml

chnode1

/etc/clickhouse-server/config.d/

total

/etc/clickhouse-server/config.d/

total

/etc/clickhouse-server/config.d/

total

network-and-logging.xmlchnode1配置文件

日志在1000M大小时滚动一次保留3000M的日志。

clickhouse监听8123和9000端口服务器间通信使用端口9009

clickhouseloggerleveldebug/levellog/var/log/clickhouse-server/clickhouse-server.log/logerrorlog/var/log/clickhouse-server/clickhouse-server.err.log/errorlogsize1000M/sizecount3/count/loggerdisplay_nameclickhouse/display_namelisten_host0.0.0.0/listen_hosthttp_port8123/http_porttcp_port9000/tcp_portinterserver_http_port9009/interserver_http_port

chnode节点的server_id设置为1其他节点id要不同。

其他配置和chnode2一样

clickhousekeeper_servertcp_port9181/tcp_portserver_id1/server_idlog_storage_path/var/lib/clickhouse/coordination/log/log_storage_pathsnapshot_storage_path/var/lib/clickhouse/coordination/snapshots/snapshot_storage_pathcoordination_settingsoperation_timeout_ms10000/operation_timeout_mssession_timeout_ms30000/session_timeout_msraft_logs_leveltrace/raft_logs_level/coordination_settingsraft_configurationserverid1/idhostnamechnode1/hostnameport9234/port/serverserverid2/idhostnamechnode2/hostnameport9234/port/serverserverid3/idhostnamechnode3/hostnameport9234/port/server/raft_configuration/keeper_server

shard值为1指定了本节点存储分片1副本1chnode2里shard的值将变为2这种指定方式可以减少DDL语句复杂度不用在建表时候再去指定分片分配到哪个节点。

clickhousemacrosshard1/shardreplicareplica_1/replica/macros

remote-servers部分指定了所有集群replacetrue表示覆盖默认配置里配置的集群。

指定了一个集群名为cluster_2S_1R集群使用secret进行加密通信cluster_2S_1R集群有两个分片每个分片有一个副本。

internal_replication设置为true表示写入操作时会选择第一个发现的健康副本去写入。

chnode1和chnode2的remote-servers.xml配置相同。

replacetruecluster_2S_1Rsecretmysecretphrase/secretshardinternal_replicationtrue/internal_replicationreplicahostchnode1/hostport9000/port/replica/shardshardinternal_replicationtrue/internal_replicationreplicahostchnode2/hostport9000/port/replica/shard/cluster_2S_1R/remote_servers

index1hostchnode1/hostport9181/port/nodenode

index2hostchnode2/hostport9181/port/nodenode

index3hostchnode3/hostport9181/port/node/zookeeper

和chnode1配置相同

clickhouseloggerleveldebug/levellog/var/log/clickhouse-server/clickhouse-server.log/logerrorlog/var/log/clickhouse-server/clickhouse-server.err.log/errorlogsize1000M/sizecount3/count/loggerdisplay_nameclickhouse/display_namelisten_host0.0.0.0/listen_hosthttp_port8123/http_porttcp_port9000/tcp_portinterserver_http_port9009/interserver_http_port

clickhousekeeper_servertcp_port9181/tcp_portserver_id2/server_idlog_storage_path/var/lib/clickhouse/coordination/log/log_storage_pathsnapshot_storage_path/var/lib/clickhouse/coordination/snapshots/snapshot_storage_pathcoordination_settingsoperation_timeout_ms10000/operation_timeout_mssession_timeout_ms30000/session_timeout_msraft_logs_leveltrace/raft_logs_level/coordination_settingsraft_configurationserverid1/idhostnamechnode1/hostnameport9234/port/serverserverid2/idhostnamechnode2/hostnameport9234/port/serverserverid3/idhostnamechnode3/hostnameport9234/port/server/raft_configuration/keeper_server

clickhousemacrosshard2/shardreplicareplica_1/replica/macros

chnode1和chnode2的remote-servers.xml配置相同。

replacetruecluster_2S_1Rsecretmysecretphrase/secretshardinternal_replicationtrue/internal_replicationreplicahostchnode1/hostport9000/port/replica/shardshardinternal_replicationtrue/internal_replicationreplicahostchnode2/hostport9000/port/replica/shard/cluster_2S_1R/remote_servers

和chnode1配置相同

index1hostchnode1/hostport9181/port/nodenode

index2hostchnode2/hostport9181/port/nodenode

index3hostchnode3/hostport9181/port/node/zookeeper

和chnode1配置相同

clickhouseloggerleveldebug/levellog/var/log/clickhouse-server/clickhouse-server.log/logerrorlog/var/log/clickhouse-server/clickhouse-server.err.log/errorlogsize1000M/sizecount3/count/loggerdisplay_nameclickhouse/display_namelisten_host0.0.0.0/listen_hosthttp_port8123/http_porttcp_port9000/tcp_portinterserver_http_port9009/interserver_http_port

clickhousekeeper_servertcp_port9181/tcp_portserver_id3/server_idlog_storage_path/var/lib/clickhouse/coordination/log/log_storage_pathsnapshot_storage_path/var/lib/clickhouse/coordination/snapshots/snapshot_storage_pathcoordination_settingsoperation_timeout_ms10000/operation_timeout_mssession_timeout_ms30000/session_timeout_msraft_logs_leveltrace/raft_logs_level/coordination_settingsraft_configurationserverid1/idhostnamechnode1/hostnameport9234/port/serverserverid2/idhostnamechnode2/hostnameport9234/port/serverserverid3/idhostnamechnode3/hostnameport9234/port/server/raft_configuration/keeper_server

/clickhouse4.

0ff16c63-3c1e-438d-8fad-1e8e25c42235┌─cluster───────┐

cluster_2S_1R

rand())分别clickhouse-client连接chnode1和chnode2.

chnode1插入

8ce26016-f923-472e-894d-a7a3025a8927┌─id─┬─column1─┐

abc

https://clickhouse.com/docs/en/architecture/horizontal-scaling