Gluster
Configuration
gluster volume set v0 network.ping-timeout 5Faut il ? :
sudo gluster volume set v0 cluster.server-quorum-type server
Commandes utiles
Options du volume
sudo gluster volume get v0 all # sudo gluster volume status v0 detail dugravot6@minipc1 ↨ 21:10:03
Status of volume: gv0
------------------------------------------------------------------------------
Brick : Brick minipc1:/data/brick1/v0
TCP Port : 49153
RDMA Port : 0
Online : Y
Pid : 91087
File System : xfs
Device : /dev/mapper/minipc1--vg-brick1
Mount Options : rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota
Inode Size : 512
Disk Space Free : 9.4GB
Total Disk Space : 10.0GB
Inode Count : 5242880
Free Inodes : 5170060
------------------------------------------------------------------------------
Brick : Brick minipc2:/data/brick1/v0
TCP Port : 49152
RDMA Port : 0
Online : Y
Pid : 865
File System : xfs
Device : /dev/mapper/minipc2--vg-brick1
Mount Options : rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota
Inode Size : 512
Disk Space Free : 9.4GB
Total Disk Space : 10.0GB
Inode Count : 5242880
Free Inodes : 5170060
------------------------------------------------------------------------------
Brick : Brick pi1:/data/brick1/v0
TCP Port : 49152
RDMA Port : 0
Online : Y
Pid : 1089
File System : ext4
Device : /dev/root
Mount Options : rw,noatime
Inode Size : N/A
Disk Space Free : 53.4GB
Total Disk Space : 58.2GB
Inode Count : 3852672
Free Inodes : 3644730
sudo gluster volume status v0 dugravot6@minipc1 ↨ 21:06:48
Status of volume: gv0
Gluster process TCP Port RDMA Port Online Pid
------------------------------------------------------------------------------
Brick minipc1:/data/brick1/gv0 49153 0 Y 91087
Brick minipc2:/data/brick1/gv0 49152 0 Y 865
Brick pi1:/data/brick1/gv0 49152 0 Y 1089
Self-heal Daemon on localhost N/A N/A Y 91110
Self-heal Daemon on minipc2 N/A N/A Y 876
Self-heal Daemon on pi1 N/A N/A Y 1188
Task Status of Volume gv0
------------------------------------------------------------------------------
There are no active volume tasks
sudo gluster volume status v0 clients dugravot6@minipc1 ↨ 21:08:53
Client connections for volume gv0
----------------------------------------------
Brick : minipc1:/data/brick1/gv0
Clients connected : 2
Hostname BytesRead BytesWritten OpVersion
-------- --------- ------------ ---------
127.0.0.1:49145 4940 5344 90000
127.0.0.1:49144 121252 107068 90000
----------------------------------------------
Brick : minipc2:/data/brick1/gv0
Clients connected : 7
Hostname BytesRead BytesWritten OpVersion
-------- --------- ------------ ---------
192.168.1.142:49136 2024 1596 90000
192.168.1.133:49140 3072 2956 90000
192.168.1.133:49138 2662750 11976 90000
192.168.1.141:49144 60717900 46588484 90000
192.168.1.142:49134 17660 19124 90000
192.168.1.141:49147 1688 1792 90000
192.168.1.141:49141 121308 107068 90000
----------------------------------------------
Brick : pi1:/data/brick1/gv0
Clients connected : 7
Hostname BytesRead BytesWritten OpVersion
-------- --------- ------------ ---------
192.168.1.141:49142 69540850 59101132 90000
192.168.1.133:49142 75000 59132 90000
192.168.1.133:49139 8980 8420 90000
192.168.1.142:49145 3424 3208 90000
192.168.1.142:49139 7316 6508 90000
192.168.1.141:49146 1684 1784 90000
192.168.1.141:49140 100176 86464 90000
----------------------------------------------
Volume top
Lecture de fichiers :
# sudo gluster volume top v0 read list-cnt 10 dugravot6@minipc1 ↨ 16:50:13
Brick: minipc1:/data/brick1/volume1
Count filename
=======================
62285 /UPTIME-KUMA/datas/kuma.db
23020 /UPTIME-KUMA/datas/kuma.db-wal
2290 /JELLYFIN/config/data/library.db
1987 /JELLYFIN/config/data/library.db-journal
725 /PORTAINER/datas/portainer.db
431 /JDOWNLOADER2/data/config/Core.jar
405 /JDOWNLOADER2/data/config/JDownloader.jar
310 /FRESHRSS/prod/data/varlibmysql/rss/dugravot6_entry.ibd
289 /FRESHRSS/prod/data/varlibmysql/ibdata1
286 /BOOKSTACK/db/config/databases/ibdata1
Brick: minipc2:/data/brick1/volume1Ouverture de fichiers :
# sudo gluster volume top v0 open list-cnt 10 dugravot6@minipc1 ↨ 16:51:27
Brick: minipc1:/data/brick1/volume1
Current open fds: 196, Max open fds: 198, Max openfd time: 2023-03-17 15:36:30.422556 +0000
Count filename
=======================
200 /NGINX/data/acme/acme.sh/stephane@dugravot.fr/whoami.local/whoami.local.conf
109 /NGINX/data/acme/acme.sh/stephane@dugravot.fr/http.header
66 /NGINX/data/acme/acme.sh/stephane@dugravot.fr/account.conf
24 /NGINX/data/acme/acme.sh/stephane@dugravot.fr/whoami.local/whoami.local.key
24 /NGINX/data/acme/acme.sh/stephane@dugravot.fr/whoami.local/whoami.local.csr.conf
11 /FRESHRSS/prod/data/freshrss/users/dugravot6/log.txt
8 /NGINX/data/acme/acme.sh/stephane@dugravot.fr/whoami.local/whoami.local.csr
7 /NGINX/data/certs/wiki.dugravot.fr/.companion
7 /FRESHRSS/prod/data/varlibmysql/mysql/plugin.MAI
7 /FRESHRSS/prod/data/varlibmysql/mysql/plugin.MAD
Brick: minipc2:/data/brick1/volume1
Current open fds: 196, Max open fds: 197, Max openfd time: 2023-03-17 16:06:54.886386 +0000
Count filename
=======================
25 <gfid:34f34f23-979e-46d6-b39c-8c224b444058>/stephane@dugravot.fr/whoami.local/whoami.local.conf
17 <gfid:34f34f23-979e-46d6-b39c-8c224b444058>/stephane@dugravot.fr/http.header
12 <gfid:34f34f23-979e-46d6-b39c-8c224b444058>/stephane@dugravot.fr/account.conf
4 /JDOWNLOADER2/data/config/JDownloader.jar
4 /JDOWNLOADER2/data/config/xdg/cache/fontconfig/5ca8086aeacc9c68e81a71e7ef846b3b-le64.cache-8
4 /JDOWNLOADER2/data/config/xdg/cache/fontconfig/386ad34c5eaeb46f7db63aa04756d58d-le64.cache-8
4 /JDOWNLOADER2/data/config/xdg/cache/fontconfig/605eb33399efa08596766eba8c7361d5-le64.cache-8
3 <gfid:34f34f23-979e-46d6-b39c-8c224b444058>/stephane@dugravot.fr/whoami.local/whoami.local.key
3 <gfid:34f34f23-979e-46d6-b39c-8c224b444058>/stephane@dugravot.fr/whoami.local/whoami.local.csr.conf
3 /JDOWNLOADER2/data/config/xdg/cache/fontconfig/a1c95d6dfc9a7b34f44445cf81166004-le64.cache-8
Performance en lecture (possible en écriture)
# sudo gluster volume top v0 read-perf bs 256 count 1 brick minipc1:/data/brick1/volume1 list-cnt 10 dugravot6@minipc1 ↨ 16:57:52
Brick: minipc1:/data/brick1/volume1
Throughput 36.57 MBps time 0.0000 secs
MBps Filename Time
==== ======== ====
2878 ...ipJBinding-732PU0OuPPzj/lib7-Zip-JBinding.so 2023-03-17 15:05:24 +0000.978307
2732 /JDOWNLOADER2/data/config/Core.jar 2023-03-17 15:04:56 +0000.519398
2528 ...2/data/config/libs/sevenzipjbindingLinux.jar 2023-03-17 15:05:24 +0000.367497
2441 /JDOWNLOADER2/data/config/tmp/hosterCache 2023-03-17 15:05:13 +0000.976603
2399 /JDOWNLOADER2/data/config/JDownloader.jar 2023-03-17 15:04:53 +0000.983716
2351 ...e815af0366dca31c28ab149bd8ed75c/backdrop.jpg 2023-03-17 15:06:58 +0000.85402
2234 .../1/10f6ec15-e9be-b988-b6d9-00dcc1ef3674.webp 2023-03-17 15:03:39 +0000.352235
2053 .../9/91ed9e05-232e-9cf5-ef55-2babb3281509.webp 2023-03-17 15:03:36 +0000.184495
1947 ...NLOADER2/data/config/libs/bcprov-jdk15on.jar 2023-03-17 15:38:36 +0000.239210
1942 .../1bf37a0f85b7c9fed7ce54b4952dcb31/poster.jpg 2023-03-17 15:06:42 +0000.912953Informations de profile
Activer le profiling
sudo gluster volume profile v0 startVisualiser les résultats
sudo gluster volume profile v0 info 1m 36s dugravot6@minipc1 ↨ 16:16:09
Brick: minipc1:/data/brick1/volume1
-----------------------------------
Cumulative Stats:
Block Size: 1b+ 2b+ 4b+
No. of Reads: 0 1 0
No. of Writes: 74 10 185
Block Size: 8b+ 16b+ 32b+
No. of Reads: 5 2 1
No. of Writes: 1414 1957 298
Block Size: 64b+ 128b+ 256b+
No. of Reads: 34 97 16
No. of Writes: 415 847 970
Block Size: 512b+ 1024b+ 2048b+
No. of Reads: 1361 21 58
No. of Writes: 2518 1495 1862
Block Size: 4096b+ 8192b+ 16384b+
No. of Reads: 45583 20217 6635
No. of Writes: 11409 3159 4280
Block Size: 32768b+ 65536b+ 131072b+
No. of Reads: 1196 1765 2063
No. of Writes: 2065 2354 11300
Block Size: 262144b+ 524288b+ 1048576b+
No. of Reads: 1 3 106
No. of Writes: 0 0 0
%-latency Avg-latency Min-Latency Max-Latency No. of calls Fop
--------- ----------- ----------- ----------- ------------ ----
0.00 0.00 us 0.00 us 0.00 us 141 FORGET
0.00 0.00 us 0.00 us 0.00 us 15862 RELEASE
0.00 0.00 us 0.00 us 0.00 us 38985 RELEASEDIR
0.00 33.90 us 33.90 us 33.90 us 1 FSYNCDIR
0.00 134.57 us 134.57 us 134.57 us 1 FALLOCATE
0.01 153.39 us 123.50 us 172.33 us 5 RMDIR
0.01 149.02 us 25.24 us 280.28 us 8 READDIR
0.02 256.76 us 204.28 us 329.66 us 6 MKDIR
0.02 127.72 us 63.05 us 220.73 us 15 TRUNCATE
0.02 153.44 us 101.80 us 278.24 us 15 RENAME
0.03 42.87 us 25.44 us 103.08 us 60 READLINK
0.04 135.90 us 67.24 us 296.09 us 30 XATTROP
0.04 81.48 us 15.06 us 216.84 us 51 GETXATTR
0.07 1465.94 us 128.16 us 2210.86 us 5 LINK
0.10 84.19 us 38.87 us 253.69 us 124 OPEN
0.15 37.55 us 11.16 us 299.45 us 400 FLUSH
0.17 162.50 us 92.04 us 858.68 us 103 UNLINK
0.26 48.99 us 15.22 us 2688.13 us 526 ENTRYLK
0.26 236.51 us 156.67 us 573.31 us 109 CREATE
0.26 90.69 us 32.79 us 229.81 us 291 STAT
0.37 189.38 us 86.62 us 467.67 us 196 FTRUNCATE
0.60 66.45 us 19.45 us 161.94 us 899 STATFS
0.93 70.56 us 15.45 us 1843.70 us 1321 FINODELK
2.00 152.13 us 53.12 us 5272.62 us 1321 FXATTROP
2.09 76.37 us 27.49 us 1195.45 us 2741 FSTAT
2.40 69.62 us 15.50 us 367.28 us 3465 LK
4.51 53.58 us 13.81 us 3403.97 us 8451 READ
4.75 52.41 us 1.70 us 4025.41 us 9090 OPENDIR
4.80 143.98 us 35.47 us 5199.62 us 3347 WRITE
4.81 57.25 us 17.02 us 3235.78 us 8432 INODELK
5.06 120.90 us 53.51 us 4871.59 us 4201 SETATTR
18.01 141.41 us 22.43 us 3800.04 us 12778 LOOKUP
23.92 128.27 us 16.64 us 2681.28 us 18711 READDIRP
24.30 2518.68 us 142.53 us 18229.04 us 968 FSYNC
Duration: 9943 seconds
Data Read: 1074532509 bytes
Data Written: 1979205900 bytesStopper le profiling
sudo gluster volume profile v0 stop