[2024-07-11 21:21:47.453699] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 23.11.0 initialization... [2024-07-11 21:21:47.453845] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid835729 ] Set seed to 1720725707450325 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-11 21:21:47.597706] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-11 21:21:47.645938] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-11 21:21:47.645992] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 835729' to capture a snapshot of events at runtime. [2024-07-11 21:21:47.646008] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-11 21:21:47.646025] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-11 21:21:47.646041] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid835729 for offline analysis/debug. [2024-07-11 21:21:47.646146] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Jul 11 21:21:52 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/11-21:21:55 ... thread 0: (1000000,1000000) ops and (264266.4,264266.4) ops/second in (3.784061,3.784061) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 504.03 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 276.8 3.19 2.86 14 0.228 0 0 0.0 0.0 L1 1/0 3.01 MB 0.3 0.4 0.3 0.1 0.4 0.3 0.1 1.4 185.7 185.5 2.37 2.30 2 1.187 447K 421 0.0 0.0 L2 4/3 360.63 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.4 1.8 175.9 175.8 0.63 0.60 1 0.634 113K 38 0.0 0.0 L3 20/13 944.27 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 188.7 188.7 0.33 0.26 1 0.330 63K 0 0.0 0.0 L4 136/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1184/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1353/21 97.00 GB 0.0 0.6 0.4 0.2 1.5 1.3 0.4 1.7 94.2 229.3 6.52 6.03 18 0.362 624K 459 0.0 0.0 Int 0/0 0.00 KB 0.0 0.6 0.4 0.2 1.5 1.3 0.4 1.7 94.2 229.3 6.52 6.03 18 0.362 624K 459 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.6 0.4 0.2 0.6 0.4 0.0 0.0 184.2 184.0 3.34 3.17 4 0.835 624K 459 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 276.8 3.19 2.86 14 0.228 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.1 total, 3.8 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.46 GB write, 367.95 MB/s write, 0.60 GB read, 151.18 MB/s read, 6.5 seconds Interval compaction: 1.46 GB write, 395.06 MB/s write, 0.60 GB read, 162.32 MB/s read, 6.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 135103 Average: 2.6905 StdDev: 19.32 Min: 1 Median: 1.7990 Max: 3466 Percentiles: P50: 1.80 P75: 2.41 P99: 5.96 P99.9: 11.11 P99.99: 246.86 ------------------------------------------------------ [ 0, 1 ] 439 0.325% 0.325% ( 1, 2 ] 83995 62.171% 62.496% ############ ( 2, 3 ] 41681 30.851% 93.347% ###### ( 3, 4 ] 3954 2.927% 96.274% # ( 4, 6 ] 3757 2.781% 99.055% # ( 6, 10 ] 1117 0.827% 99.882% ( 10, 15 ] 117 0.087% 99.968% ( 15, 22 ] 11 0.008% 99.976% ( 22, 34 ] 4 0.003% 99.979% ( 34, 51 ] 2 0.001% 99.981% ( 51, 76 ] 1 0.001% 99.981% ( 170, 250 ] 13 0.010% 99.991% ( 250, 380 ] 4 0.003% 99.994% ( 380, 580 ] 2 0.001% 99.996% ( 580, 870 ] 2 0.001% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 2 0.001% 99.999% ( 2900, 4400 ] 4 0.003% 100.002% ** Level 1 read latency histogram (micros): Count: 47278 Average: 2.8287 StdDev: 14.13 Min: 1 Median: 1.7543 Max: 1364 Percentiles: P50: 1.75 P75: 2.34 P99: 7.20 P99.9: 68.24 P99.99: 827.79 ------------------------------------------------------ [ 0, 1 ] 670 1.417% 1.417% ( 1, 2 ] 30451 64.408% 65.826% ############# ( 2, 3 ] 12660 26.778% 92.603% ##### ( 3, 4 ] 1752 3.706% 96.309% # ( 4, 6 ] 1159 2.451% 98.761% ( 6, 10 ] 382 0.808% 99.569% ( 10, 15 ] 110 0.233% 99.801% ( 15, 22 ] 9 0.019% 99.820% ( 22, 34 ] 7 0.015% 99.835% ( 51, 76 ] 46 0.097% 99.932% ( 76, 110 ] 6 0.013% 99.945% ( 110, 170 ] 2 0.004% 99.949% ( 170, 250 ] 10 0.021% 99.970% ( 250, 380 ] 2 0.004% 99.975% ( 380, 580 ] 4 0.008% 99.983% ( 580, 870 ] 5 0.011% 99.994% ( 870, 1300 ] 3 0.006% 100.000% ( 1300, 1900 ] 1 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 15841 Average: 2.3547 StdDev: 4.45 Min: 1 Median: 1.5685 Max: 365 Percentiles: P50: 1.57 P75: 1.94 P99: 5.95 P99.9: 11.60 P99.99: 277.03 ------------------------------------------------------ [ 0, 1 ] 1930 12.184% 12.184% ## ( 1, 2 ] 10537 66.517% 78.701% ############# ( 2, 3 ] 1731 10.927% 89.628% ## ( 3, 4 ] 802 5.063% 94.691% # ( 4, 6 ] 699 4.413% 99.104% # ( 6, 10 ] 122 0.770% 99.874% ( 10, 15 ] 13 0.082% 99.956% ( 15, 22 ] 2 0.013% 99.968% ( 22, 34 ] 1 0.006% 99.975% ( 170, 250 ] 2 0.013% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 2467 Average: 50.8204 StdDev: 307.76 Min: 0 Median: 4.3742 Max: 5330 Percentiles: P50: 4.37 P75: 5.98 P99: 1699.82 P99.9: 3783.25 P99.99: 4338.32 ------------------------------------------------------ [ 0, 1 ] 105 4.256% 4.256% # ( 1, 2 ] 390 15.809% 20.065% ### ( 2, 3 ] 66 2.675% 22.740% # ( 3, 4 ] 529 21.443% 44.183% #### ( 4, 6 ] 767 31.090% 75.274% ###### ( 6, 10 ] 382 15.484% 90.758% ### ( 10, 15 ] 67 2.716% 93.474% # ( 15, 22 ] 25 1.013% 94.487% ( 22, 34 ] 8 0.324% 94.812% ( 34, 51 ] 2 0.081% 94.893% ( 76, 110 ] 21 0.851% 95.744% ( 110, 170 ] 29 1.176% 96.919% ( 170, 250 ] 8 0.324% 97.244% ( 250, 380 ] 4 0.162% 97.406% ( 380, 580 ] 7 0.284% 97.690% ( 580, 870 ] 16 0.649% 98.338% ( 870, 1300 ] 9 0.365% 98.703% ( 1300, 1900 ] 11 0.446% 99.149% ( 1900, 2900 ] 15 0.608% 99.757% ( 2900, 4400 ] 6 0.243% 100.000% ( 4400, 6600 ] 1 0.041% 100.041% ** Level 4 read latency histogram (micros): Count: 15 Average: 1572.8667 StdDev: 859.39 Min: 196 Median: 1525.0000 Max: 3416 Percentiles: P50: 1525.00 P75: 2212.50 P99: 3416.00 P99.9: 3416.00 P99.99: 3416.00 ------------------------------------------------------ ( 170, 250 ] 1 6.667% 6.667% # ( 380, 580 ] 2 13.333% 20.000% ### ( 580, 870 ] 1 6.667% 26.667% # ( 870, 1300 ] 2 13.333% 40.000% ### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 4 26.667% 93.333% ##### ( 2900, 4400 ] 1 6.667% 100.000% # ** DB Stats ** Uptime(secs): 4.1 total, 3.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 241.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 259.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/11-21:21:59 ... thread 0: (1000000,2000000) ops and (260153.3,262193.7) ops/second in (3.843887,7.627948) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.48 GB 125.9 1.0 0.0 1.0 2.9 1.8 0.0 1.6 87.7 242.4 12.21 11.37 34 0.359 1087K 1154 0.0 0.0 L1 1/0 3.01 MB 0.3 0.4 0.3 0.1 0.4 0.3 0.1 1.4 185.7 185.5 2.37 2.30 2 1.187 447K 421 0.0 0.0 L2 2/1 103.11 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.4 1.8 175.9 175.8 0.63 0.60 1 0.634 113K 38 0.0 0.0 L3 76/12 1.17 GB 0.3 0.4 0.3 0.1 0.4 0.3 0.0 1.2 178.4 178.3 2.11 1.67 2 1.054 381K 160 0.0 0.0 L4 136/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1184/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1410/17 97.98 GB 0.0 2.0 0.7 1.3 3.8 2.5 0.4 2.1 115.4 224.4 17.33 15.94 39 0.444 2030K 1773 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.7 1.3 3.8 2.5 0.4 2.1 115.4 224.4 17.33 15.94 39 0.444 2030K 1773 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.7 1.3 2.0 0.7 0.0 0.0 189.2 189.0 10.57 9.92 9 1.174 2030K 1773 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 279.7 6.76 6.02 30 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.6 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.80 GB write, 491.47 MB/s write, 1.95 GB read, 252.77 MB/s read, 17.3 seconds Interval compaction: 3.80 GB write, 509.44 MB/s write, 1.95 GB read, 262.01 MB/s read, 17.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 406294 Average: 3.0479 StdDev: 13.22 Min: 1 Median: 2.1943 Max: 3466 Percentiles: P50: 2.19 P75: 2.78 P99: 8.77 P99.9: 12.92 P99.99: 23.10 ------------------------------------------------------ [ 0, 1 ] 551 0.136% 0.136% ( 1, 2 ] 168725 41.528% 41.663% ######## ( 2, 3 ] 174363 42.915% 84.579% ######### ( 3, 4 ] 26624 6.553% 91.132% # ( 4, 6 ] 24549 6.042% 97.174% # ( 6, 10 ] 10698 2.633% 99.807% # ( 10, 15 ] 646 0.159% 99.966% ( 15, 22 ] 96 0.024% 99.990% ( 22, 34 ] 15 0.004% 99.993% ( 34, 51 ] 5 0.001% 99.995% ( 51, 76 ] 4 0.001% 99.996% ( 170, 250 ] 31 0.008% 100.003% ( 250, 380 ] 10 0.002% 100.006% ( 380, 580 ] 5 0.001% 100.007% ( 580, 870 ] 5 0.001% 100.008% ( 870, 1300 ] 7 0.002% 100.010% ( 1300, 1900 ] 6 0.001% 100.011% ( 2900, 4400 ] 4 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 109694 Average: 2.6991 StdDev: 9.32 Min: 1 Median: 1.7499 Max: 1364 Percentiles: P50: 1.75 P75: 2.43 P99: 7.33 P99.9: 14.64 P99.99: 481.53 ------------------------------------------------------ [ 0, 1 ] 4719 4.302% 4.302% # ( 1, 2 ] 66848 60.940% 65.242% ############ ( 2, 3 ] 25018 22.807% 88.049% ##### ( 3, 4 ] 5520 5.032% 93.082% # ( 4, 6 ] 6076 5.539% 98.621% # ( 6, 10 ] 1251 1.140% 99.761% ( 10, 15 ] 164 0.150% 99.911% ( 15, 22 ] 10 0.009% 99.920% ( 22, 34 ] 9 0.008% 99.928% ( 51, 76 ] 46 0.042% 99.970% ( 76, 110 ] 6 0.005% 99.975% ( 110, 170 ] 2 0.002% 99.977% ( 170, 250 ] 10 0.009% 99.986% ( 250, 380 ] 2 0.002% 99.988% ( 380, 580 ] 4 0.004% 99.992% ( 580, 870 ] 5 0.005% 99.996% ( 870, 1300 ] 3 0.003% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15917 Average: 2.3701 StdDev: 4.45 Min: 1 Median: 1.5721 Max: 365 Percentiles: P50: 1.57 P75: 1.95 P99: 5.98 P99.9: 11.82 P99.99: 276.54 ------------------------------------------------------ [ 0, 1 ] 1930 12.125% 12.125% ## ( 1, 2 ] 10537 66.200% 78.325% ############# ( 2, 3 ] 1732 10.881% 89.207% ## ( 3, 4 ] 816 5.127% 94.333% # ( 4, 6 ] 749 4.706% 99.039% # ( 6, 10 ] 132 0.829% 99.868% ( 10, 15 ] 14 0.088% 99.956% ( 15, 22 ] 2 0.013% 99.969% ( 22, 34 ] 1 0.006% 99.975% ( 170, 250 ] 2 0.013% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 122470 Average: 6.9024 StdDev: 46.13 Min: 0 Median: 4.5840 Max: 5330 Percentiles: P50: 4.58 P75: 5.86 P99: 19.79 P99.9: 230.66 P99.99: 813.64 ------------------------------------------------------ [ 0, 1 ] 1359 1.110% 1.110% ( 1, 2 ] 8235 6.724% 7.834% # ( 2, 3 ] 3158 2.579% 10.412% # ( 3, 4 ] 34494 28.165% 38.578% ###### ( 4, 6 ] 47913 39.122% 77.700% ######## ( 6, 10 ] 21617 17.651% 95.351% #### ( 10, 15 ] 3489 2.849% 98.200% # ( 15, 22 ] 1435 1.172% 99.371% ( 22, 34 ] 282 0.230% 99.602% ( 34, 51 ] 59 0.048% 99.650% ( 51, 76 ] 9 0.007% 99.657% ( 76, 110 ] 109 0.089% 99.746% ( 110, 170 ] 141 0.115% 99.861% ( 170, 250 ] 64 0.052% 99.913% ( 250, 380 ] 41 0.033% 99.947% ( 380, 580 ] 32 0.026% 99.973% ( 580, 870 ] 27 0.022% 99.995% ( 870, 1300 ] 11 0.009% 100.004% ( 1300, 1900 ] 11 0.009% 100.013% ( 1900, 2900 ] 15 0.012% 100.025% ( 2900, 4400 ] 6 0.005% 100.030% ( 4400, 6600 ] 1 0.001% 100.031% ** Level 4 read latency histogram (micros): Count: 15 Average: 1572.8667 StdDev: 859.39 Min: 196 Median: 1525.0000 Max: 3416 Percentiles: P50: 1525.00 P75: 2212.50 P99: 3416.00 P99.9: 3416.00 P99.99: 3416.00 ------------------------------------------------------ ( 170, 250 ] 1 6.667% 6.667% # ( 380, 580 ] 2 13.333% 20.000% ### ( 580, 870 ] 1 6.667% 26.667% # ( 870, 1300 ] 2 13.333% 40.000% ### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 4 26.667% 93.333% ##### ( 2900, 4400 ] 1 6.667% 100.000% # ** DB Stats ** Uptime(secs): 7.9 total, 3.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 248.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 256.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/11-21:22:03 ... thread 0: (1000000,3000000) ops and (261798.9,262062.0) ops/second in (3.819726,11.447674) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.40 GB 220.3 2.0 0.0 2.0 4.8 2.8 0.0 1.7 102.7 242.6 20.24 18.94 53 0.382 2110K 2136 0.0 0.0 L1 1/0 3.01 MB 0.3 0.4 0.3 0.1 0.4 0.3 0.1 1.4 185.7 185.5 2.37 2.30 2 1.187 447K 421 0.0 0.0 L2 2/1 103.11 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.4 1.8 175.9 175.8 0.63 0.60 1 0.634 113K 38 0.0 0.0 L3 76/12 1.17 GB 0.3 0.4 0.3 0.1 0.4 0.3 0.0 1.2 178.4 178.3 2.11 1.67 2 1.054 381K 160 0.0 0.0 L4 136/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1184/0 85.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1413/17 98.90 GB 0.0 2.9 0.7 2.3 5.7 3.4 0.4 2.1 118.6 230.3 25.36 23.51 58 0.437 3053K 2755 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 0.7 2.3 5.7 3.4 0.4 2.1 118.6 230.3 25.36 23.51 58 0.437 3053K 2755 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 0.7 2.3 2.9 0.7 0.0 0.0 196.7 196.5 15.29 14.56 13 1.176 3053K 2755 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 281.6 10.07 8.95 45 0.224 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.7 total, 11.5 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.70 GB write, 497.83 MB/s write, 2.94 GB read, 256.39 MB/s read, 25.4 seconds Interval compaction: 5.70 GB write, 509.96 MB/s write, 2.94 GB read, 262.64 MB/s read, 25.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 671108 Average: 2.9336 StdDev: 13.92 Min: 1 Median: 2.0840 Max: 4182 Percentiles: P50: 2.08 P75: 2.72 P99: 8.55 P99.9: 12.09 P99.99: 18.34 ------------------------------------------------------ [ 0, 1 ] 23054 3.435% 3.435% # ( 1, 2 ] 290484 43.284% 46.719% ######### ( 2, 3 ] 262020 39.043% 85.762% ######## ( 3, 4 ] 41488 6.182% 91.944% # ( 4, 6 ] 37463 5.582% 97.527% # ( 6, 10 ] 15541 2.316% 99.842% ( 10, 15 ] 930 0.139% 99.981% ( 15, 22 ] 132 0.020% 100.001% ( 22, 34 ] 21 0.003% 100.004% ( 34, 51 ] 8 0.001% 100.005% ( 51, 76 ] 4 0.001% 100.006% ( 170, 250 ] 42 0.006% 100.012% ( 250, 380 ] 15 0.002% 100.014% ( 380, 580 ] 9 0.001% 100.015% ( 580, 870 ] 11 0.002% 100.017% ( 870, 1300 ] 13 0.002% 100.019% ( 1300, 1900 ] 9 0.001% 100.020% ( 1900, 2900 ] 1 0.000% 100.020% ( 2900, 4400 ] 6 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 109694 Average: 2.6991 StdDev: 9.32 Min: 1 Median: 1.7499 Max: 1364 Percentiles: P50: 1.75 P75: 2.43 P99: 7.33 P99.9: 14.64 P99.99: 481.53 ------------------------------------------------------ [ 0, 1 ] 4719 4.302% 4.302% # ( 1, 2 ] 66848 60.940% 65.242% ############ ( 2, 3 ] 25018 22.807% 88.049% ##### ( 3, 4 ] 5520 5.032% 93.082% # ( 4, 6 ] 6076 5.539% 98.621% # ( 6, 10 ] 1251 1.140% 99.761% ( 10, 15 ] 164 0.150% 99.911% ( 15, 22 ] 10 0.009% 99.920% ( 22, 34 ] 9 0.008% 99.928% ( 51, 76 ] 46 0.042% 99.970% ( 76, 110 ] 6 0.005% 99.975% ( 110, 170 ] 2 0.002% 99.977% ( 170, 250 ] 10 0.009% 99.986% ( 250, 380 ] 2 0.002% 99.988% ( 380, 580 ] 4 0.004% 99.992% ( 580, 870 ] 5 0.005% 99.996% ( 870, 1300 ] 3 0.003% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15993 Average: 2.7299 StdDev: 10.97 Min: 1 Median: 1.5757 Max: 487 Percentiles: P50: 1.58 P75: 1.96 P99: 6.77 P99.9: 180.07 P99.99: 487.00 ------------------------------------------------------ [ 0, 1 ] 1930 12.068% 12.068% ## ( 1, 2 ] 10537 65.885% 77.953% ############# ( 2, 3 ] 1732 10.830% 88.783% ## ( 3, 4 ] 818 5.115% 93.897% # ( 4, 6 ] 789 4.933% 98.831% # ( 6, 10 ] 141 0.882% 99.712% ( 10, 15 ] 14 0.088% 99.800% ( 15, 22 ] 2 0.013% 99.812% ( 22, 34 ] 1 0.006% 99.819% ( 110, 170 ] 12 0.075% 99.894% ( 170, 250 ] 8 0.050% 99.944% ( 250, 380 ] 4 0.025% 99.969% ( 380, 580 ] 5 0.031% 100.000% ** Level 3 read latency histogram (micros): Count: 230162 Average: 6.5141 StdDev: 35.23 Min: 0 Median: 4.5492 Max: 5330 Percentiles: P50: 4.55 P75: 5.71 P99: 19.20 P99.9: 219.27 P99.99: 765.15 ------------------------------------------------------ [ 0, 1 ] 1359 0.590% 0.590% ( 1, 2 ] 8235 3.578% 4.168% # ( 2, 3 ] 3737 1.624% 5.792% ( 3, 4 ] 74630 32.425% 38.217% ###### ( 4, 6 ] 98759 42.908% 81.125% ######### ( 6, 10 ] 34154 14.839% 95.965% ### ( 10, 15 ] 5462 2.373% 98.338% ( 15, 22 ] 2545 1.106% 99.443% ( 22, 34 ] 384 0.167% 99.610% ( 34, 51 ] 60 0.026% 99.636% ( 51, 76 ] 10 0.004% 99.641% ( 76, 110 ] 152 0.066% 99.707% ( 110, 170 ] 359 0.156% 99.863% ( 170, 250 ] 141 0.061% 99.924% ( 250, 380 ] 71 0.031% 99.955% ( 380, 580 ] 59 0.026% 99.980% ( 580, 870 ] 36 0.016% 99.996% ( 870, 1300 ] 13 0.006% 100.002% ( 1300, 1900 ] 12 0.005% 100.007% ( 1900, 2900 ] 15 0.007% 100.013% ( 2900, 4400 ] 6 0.003% 100.016% ( 4400, 6600 ] 1 0.000% 100.017% ** Level 4 read latency histogram (micros): Count: 15 Average: 1572.8667 StdDev: 859.39 Min: 196 Median: 1525.0000 Max: 3416 Percentiles: P50: 1525.00 P75: 2212.50 P99: 3416.00 P99.9: 3416.00 P99.99: 3416.00 ------------------------------------------------------ ( 170, 250 ] 1 6.667% 6.667% # ( 380, 580 ] 2 13.333% 20.000% ### ( 580, 870 ] 1 6.667% 26.667% # ( 870, 1300 ] 2 13.333% 40.000% ### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 4 26.667% 93.333% ##### ( 2900, 4400 ] 1 6.667% 100.000% # ** DB Stats ** Uptime(secs): 11.7 total, 3.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 251.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 257.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/11-21:22:09 ... thread 0: (1000000,4000000) ops and (174587.7,232890.5) ops/second in (5.727780,17.175454) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.38 GB 94.4 3.0 0.0 3.0 6.8 3.7 0.0 1.8 104.8 235.2 29.45 27.61 73 0.403 3134K 3142 0.0 0.0 L1 1/1 3.01 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.1 1.4 185.7 185.5 2.37 2.30 2 1.187 447K 421 0.0 0.0 L2 1/0 54.00 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.4 1.8 175.9 175.8 0.63 0.60 1 0.634 113K 38 0.0 0.0 L3 35/0 986.86 MB 1.0 1.3 0.4 0.9 1.3 0.4 0.0 3.5 123.4 123.4 10.59 9.75 3 3.530 1327K 791 0.0 0.0 L4 176/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1188/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1419/13 99.89 GB 0.0 4.8 0.7 4.1 8.6 4.5 1.0 2.3 114.9 204.1 43.04 40.26 79 0.545 5022K 4392 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 0.7 4.1 8.6 4.5 0.9 2.3 114.9 204.1 43.04 40.26 79 0.545 5022K 4392 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 0.7 4.1 4.8 0.7 0.0 0.0 167.6 167.4 29.51 28.25 18 1.640 5022K 4392 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 284.0 13.53 12.02 61 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.5 total, 17.2 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.58 GB write, 503.21 MB/s write, 4.83 GB read, 283.34 MB/s read, 43.0 seconds Interval compaction: 8.58 GB write, 511.38 MB/s write, 4.83 GB read, 287.94 MB/s read, 43.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 0, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1119830 Average: 3.1065 StdDev: 12.95 Min: 1 Median: 2.1953 Max: 4182 Percentiles: P50: 2.20 P75: 2.84 P99: 8.94 P99.9: 13.36 P99.99: 17.88 ------------------------------------------------------ [ 0, 1 ] 27304 2.438% 2.438% ( 1, 2 ] 447253 39.939% 42.378% ######## ( 2, 3 ] 437009 39.025% 81.402% ######## ( 3, 4 ] 86723 7.744% 89.146% ## ( 4, 6 ] 87187 7.786% 96.932% ## ( 6, 10 ] 31525 2.815% 99.747% # ( 10, 15 ] 2542 0.227% 99.974% ( 15, 22 ] 425 0.038% 100.012% ( 22, 34 ] 51 0.005% 100.017% ( 34, 51 ] 12 0.001% 100.018% ( 51, 76 ] 6 0.001% 100.018% ( 76, 110 ] 49 0.004% 100.023% ( 110, 170 ] 137 0.012% 100.035% ( 170, 250 ] 91 0.008% 100.043% ( 250, 380 ] 47 0.004% 100.047% ( 380, 580 ] 24 0.002% 100.050% ( 580, 870 ] 20 0.002% 100.051% ( 870, 1300 ] 15 0.001% 100.053% ( 1300, 1900 ] 14 0.001% 100.054% ( 1900, 2900 ] 3 0.000% 100.054% ( 2900, 4400 ] 7 0.001% 100.055% ** Level 1 read latency histogram (micros): Count: 109695 Average: 2.6999 StdDev: 9.33 Min: 1 Median: 1.7499 Max: 1364 Percentiles: P50: 1.75 P75: 2.43 P99: 7.33 P99.9: 14.67 P99.99: 481.52 ------------------------------------------------------ [ 0, 1 ] 4719 4.302% 4.302% # ( 1, 2 ] 66848 60.940% 65.242% ############ ( 2, 3 ] 25018 22.807% 88.049% ##### ( 3, 4 ] 5520 5.032% 93.081% # ( 4, 6 ] 6076 5.539% 98.620% # ( 6, 10 ] 1251 1.140% 99.760% ( 10, 15 ] 164 0.150% 99.910% ( 15, 22 ] 10 0.009% 99.919% ( 22, 34 ] 9 0.008% 99.927% ( 51, 76 ] 46 0.042% 99.969% ( 76, 110 ] 7 0.006% 99.975% ( 110, 170 ] 2 0.002% 99.977% ( 170, 250 ] 10 0.009% 99.986% ( 250, 380 ] 2 0.002% 99.988% ( 380, 580 ] 4 0.004% 99.992% ( 580, 870 ] 5 0.005% 99.996% ( 870, 1300 ] 3 0.003% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28310 Average: 3.9837 StdDev: 10.21 Min: 1 Median: 2.9341 Max: 487 Percentiles: P50: 2.93 P75: 4.34 P99: 13.23 P99.9: 162.76 P99.99: 485.63 ------------------------------------------------------ [ 0, 1 ] 1930 6.817% 6.817% # ( 1, 2 ] 10537 37.220% 44.037% ####### ( 2, 3 ] 1807 6.383% 50.420% # ( 3, 4 ] 5856 20.685% 71.106% #### ( 4, 6 ] 6535 23.084% 94.189% ##### ( 6, 10 ] 1210 4.274% 98.463% # ( 10, 15 ] 235 0.830% 99.294% ( 15, 22 ] 119 0.420% 99.714% ( 22, 34 ] 14 0.049% 99.763% ( 110, 170 ] 44 0.155% 99.919% ( 170, 250 ] 12 0.042% 99.961% ( 250, 380 ] 5 0.018% 99.979% ( 380, 580 ] 6 0.021% 100.000% ** Level 3 read latency histogram (micros): Count: 238641 Average: 6.5284 StdDev: 35.13 Min: 0 Median: 4.5353 Max: 5330 Percentiles: P50: 4.54 P75: 5.70 P99: 19.15 P99.9: 230.48 P99.99: 791.80 ------------------------------------------------------ [ 0, 1 ] 1359 0.569% 0.569% ( 1, 2 ] 8236 3.451% 4.021% # ( 2, 3 ] 3863 1.619% 5.639% ( 3, 4 ] 78531 32.908% 38.547% ####### ( 4, 6 ] 102117 42.791% 81.338% ######### ( 6, 10 ] 35004 14.668% 96.006% ### ( 10, 15 ] 5588 2.342% 98.348% ( 15, 22 ] 2623 1.099% 99.447% ( 22, 34 ] 393 0.165% 99.612% ( 34, 51 ] 60 0.025% 99.637% ( 51, 76 ] 10 0.004% 99.641% ( 76, 110 ] 152 0.064% 99.705% ( 110, 170 ] 359 0.150% 99.855% ( 170, 250 ] 142 0.060% 99.915% ( 250, 380 ] 74 0.031% 99.946% ( 380, 580 ] 74 0.031% 99.977% ( 580, 870 ] 44 0.018% 99.995% ( 870, 1300 ] 15 0.006% 100.001% ( 1300, 1900 ] 12 0.005% 100.006% ( 1900, 2900 ] 15 0.006% 100.013% ( 2900, 4400 ] 6 0.003% 100.015% ( 4400, 6600 ] 1 0.000% 100.016% ** Level 4 read latency histogram (micros): Count: 15 Average: 1572.8667 StdDev: 859.39 Min: 196 Median: 1525.0000 Max: 3416 Percentiles: P50: 1525.00 P75: 2212.50 P99: 3416.00 P99.9: 3416.00 P99.99: 3416.00 ------------------------------------------------------ ( 170, 250 ] 1 6.667% 6.667% # ( 380, 580 ] 2 13.333% 20.000% ### ( 580, 870 ] 1 6.667% 26.667% # ( 870, 1300 ] 2 13.333% 40.000% ### ( 1300, 1900 ] 4 26.667% 66.667% ##### ( 1900, 2900 ] 4 26.667% 93.333% ##### ( 2900, 4400 ] 1 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 806.6000 StdDev: 1027.11 Min: 103 Median: 230.0000 Max: 3400 Percentiles: P50: 230.00 P75: 1085.00 P99: 3400.00 P99.9: 3400.00 P99.99: 3400.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 6 30.000% 35.000% ###### ( 170, 250 ] 4 20.000% 55.000% #### ( 380, 580 ] 1 5.000% 60.000% # ( 580, 870 ] 2 10.000% 70.000% ## ( 870, 1300 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 2 10.000% 90.000% ## ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 17.5 total, 5.7 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 225.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.869 H:M:S, 10.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 171.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.869 H:M:S, 32.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/11-21:22:22 ... thread 0: (1000000,5000000) ops and (75968.0,164805.0) ops/second in (13.163435,30.338889) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/6 1.84 GB 0.0 5.0 0.0 5.0 9.7 4.7 0.0 2.1 112.7 216.9 45.84 41.82 91 0.504 5244K 11K 0.0 0.0 L1 0/0 0.00 KB 0.0 2.9 2.8 0.1 2.9 2.7 0.1 1.0 172.6 170.8 17.16 16.40 3 5.719 3007K 30K 0.0 0.0 L2 8/6 315.67 MB 0.6 0.6 0.5 0.1 0.6 0.5 2.4 1.2 147.6 147.3 4.02 3.53 2 2.011 603K 1429 0.0 0.0 L3 34/24 2.04 GB 1.0 1.5 0.6 0.9 1.5 0.6 1.9 2.6 116.1 116.0 13.56 11.56 5 2.711 1564K 791 0.0 0.0 L4 185/3 9.72 GB 1.0 1.1 1.0 0.2 1.1 1.0 0.4 1.2 105.1 104.8 11.16 6.71 8 1.395 1167K 3029 0.0 0.0 L5 1200/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1433/39 100.77 GB 0.0 11.2 4.8 6.4 15.8 9.4 6.1 3.4 125.0 176.7 91.74 80.01 109 0.842 11M 46K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.2 4.8 6.4 15.8 9.4 6.0 3.4 125.0 176.7 91.74 80.01 109 0.842 11M 46K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.2 4.8 6.4 11.2 4.7 0.0 0.0 155.0 154.3 73.99 65.13 34 2.176 11M 46K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 269.7 17.75 14.88 75 0.237 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.6 total, 30.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.83 GB write, 529.28 MB/s write, 11.20 GB read, 374.49 MB/s read, 91.7 seconds Interval compaction: 15.83 GB write, 534.15 MB/s write, 11.20 GB read, 377.93 MB/s read, 91.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 11, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2053368 Average: 3.6039 StdDev: 30.15 Min: 0 Median: 2.2574 Max: 12508 Percentiles: P50: 2.26 P75: 2.89 P99: 9.29 P99.9: 118.99 P99.99: 177.61 ------------------------------------------------------ [ 0, 1 ] 41525 2.022% 2.022% ( 1, 2 ] 776042 37.794% 39.816% ######## ( 2, 3 ] 812388 39.564% 79.380% ######## ( 3, 4 ] 174879 8.517% 87.896% ## ( 4, 6 ] 178433 8.690% 96.586% ## ( 6, 10 ] 60342 2.939% 99.525% # ( 10, 15 ] 5774 0.281% 99.806% ( 15, 22 ] 923 0.045% 99.851% ( 22, 34 ] 84 0.004% 99.855% ( 34, 51 ] 14 0.001% 99.856% ( 51, 76 ] 10 0.000% 99.856% ( 76, 110 ] 584 0.028% 99.885% ( 110, 170 ] 2120 0.103% 99.988% ( 170, 250 ] 480 0.023% 100.011% ( 250, 380 ] 264 0.013% 100.024% ( 380, 580 ] 220 0.011% 100.035% ( 580, 870 ] 141 0.007% 100.042% ( 870, 1300 ] 72 0.004% 100.045% ( 1300, 1900 ] 43 0.002% 100.047% ( 1900, 2900 ] 25 0.001% 100.048% ( 2900, 4400 ] 38 0.002% 100.050% ( 4400, 6600 ] 6 0.000% 100.051% ( 6600, 9900 ] 4 0.000% 100.051% ( 9900, 14000 ] 3 0.000% 100.051% ** Level 1 read latency histogram (micros): Count: 521687 Average: 5.2270 StdDev: 82.22 Min: 1 Median: 2.5442 Max: 18333 Percentiles: P50: 2.54 P75: 3.76 P99: 9.90 P99.9: 14.41 P99.99: 14.95 ------------------------------------------------------ [ 0, 1 ] 6195 1.187% 1.187% ( 1, 2 ] 146847 28.148% 29.336% ###### ( 2, 3 ] 198081 37.969% 67.305% ######## ( 3, 4 ] 52474 10.059% 77.364% ## ( 4, 6 ] 79618 15.262% 92.625% ### ( 6, 10 ] 34089 6.534% 99.160% # ( 10, 15 ] 4374 0.838% 99.998% ( 15, 22 ] 740 0.142% 100.140% ( 22, 34 ] 67 0.013% 100.153% ( 34, 51 ] 17 0.003% 100.156% ( 51, 76 ] 51 0.010% 100.166% ( 76, 110 ] 71 0.014% 100.180% ( 110, 170 ] 73 0.014% 100.194% ( 170, 250 ] 81 0.016% 100.209% ( 250, 380 ] 96 0.018% 100.228% ( 380, 580 ] 89 0.017% 100.245% ( 580, 870 ] 90 0.017% 100.262% ( 870, 1300 ] 51 0.010% 100.272% ( 1300, 1900 ] 33 0.006% 100.278% ( 1900, 2900 ] 23 0.004% 100.282% ( 2900, 4400 ] 72 0.014% 100.296% ( 4400, 6600 ] 14 0.003% 100.299% ( 6600, 9900 ] 22 0.004% 100.303% ( 9900, 14000 ] 1 0.000% 100.303% ( 14000, 22000 ] 2 0.000% 100.304% ** Level 2 read latency histogram (micros): Count: 101955 Average: 5.1180 StdDev: 64.34 Min: 1 Median: 2.7914 Max: 4897 Percentiles: P50: 2.79 P75: 4.35 P99: 9.93 P99.9: 14.20 P99.99: 14.69 ------------------------------------------------------ [ 0, 1 ] 2123 2.082% 2.082% ( 1, 2 ] 23135 22.691% 24.774% ##### ( 2, 3 ] 32499 31.876% 56.650% ###### ( 3, 4 ] 15035 14.747% 71.396% ### ( 4, 6 ] 21086 20.682% 92.078% #### ( 6, 10 ] 7190 7.052% 99.130% # ( 10, 15 ] 936 0.918% 100.048% ( 15, 22 ] 246 0.241% 100.289% ( 22, 34 ] 21 0.021% 100.310% ( 34, 51 ] 2 0.002% 100.312% ( 76, 110 ] 1 0.001% 100.313% ( 110, 170 ] 47 0.046% 100.359% ( 170, 250 ] 22 0.022% 100.381% ( 250, 380 ] 13 0.013% 100.393% ( 380, 580 ] 8 0.008% 100.401% ( 580, 870 ] 9 0.009% 100.410% ( 870, 1300 ] 4 0.004% 100.414% ( 1300, 1900 ] 4 0.004% 100.418% ( 2900, 4400 ] 23 0.023% 100.440% ( 4400, 6600 ] 2 0.002% 100.442% ** Level 3 read latency histogram (micros): Count: 423968 Average: 14.2420 StdDev: 185.77 Min: 0 Median: 3.8289 Max: 26087 Percentiles: P50: 3.83 P75: 5.35 P99: 32.27 P99.9: 1987.55 P99.99: 4967.54 ------------------------------------------------------ [ 0, 1 ] 1958 0.462% 0.462% ( 1, 2 ] 40726 9.606% 10.068% ## ( 2, 3 ] 86367 20.371% 30.439% #### ( 3, 4 ] 100057 23.600% 54.039% ##### ( 4, 6 ] 131675 31.058% 85.097% ###### ( 6, 10 ] 48107 11.347% 96.444% ## ( 10, 15 ] 7470 1.762% 98.206% ( 15, 22 ] 2998 0.707% 98.913% ( 22, 34 ] 434 0.102% 99.015% ( 34, 51 ] 65 0.015% 99.030% ( 51, 76 ] 11 0.003% 99.033% ( 76, 110 ] 202 0.048% 99.081% ( 110, 170 ] 737 0.174% 99.254% ( 170, 250 ] 561 0.132% 99.387% ( 250, 380 ] 449 0.106% 99.493% ( 380, 580 ] 548 0.129% 99.622% ( 580, 870 ] 552 0.130% 99.752% ( 870, 1300 ] 415 0.098% 99.850% ( 1300, 1900 ] 202 0.048% 99.898% ( 1900, 2900 ] 126 0.030% 99.927% ( 2900, 4400 ] 239 0.056% 99.984% ( 4400, 6600 ] 107 0.025% 100.009% ( 6600, 9900 ] 39 0.009% 100.018% ( 9900, 14000 ] 15 0.004% 100.022% ( 14000, 22000 ] 6 0.001% 100.023% ( 22000, 33000 ] 1 0.000% 100.023% ** Level 4 read latency histogram (micros): Count: 8268 Average: 10.0824 StdDev: 115.80 Min: 1 Median: 1.9655 Max: 3416 Percentiles: P50: 1.97 P75: 2.88 P99: 12.91 P99.9: 2188.67 P99.99: 3416.00 ------------------------------------------------------ [ 0, 1 ] 161 1.947% 1.947% ( 1, 2 ] 4115 49.770% 51.717% ########## ( 2, 3 ] 2194 26.536% 78.254% ##### ( 3, 4 ] 721 8.720% 86.974% ## ( 4, 6 ] 847 10.244% 97.218% ## ( 6, 10 ] 138 1.669% 98.887% ( 10, 15 ] 16 0.194% 99.081% ( 15, 22 ] 5 0.060% 99.141% ( 22, 34 ] 1 0.012% 99.153% ( 34, 51 ] 3 0.036% 99.190% ( 51, 76 ] 1 0.012% 99.202% ( 76, 110 ] 4 0.048% 99.250% ( 110, 170 ] 9 0.109% 99.359% ( 170, 250 ] 13 0.157% 99.516% ( 250, 380 ] 6 0.073% 99.589% ( 380, 580 ] 4 0.048% 99.637% ( 580, 870 ] 5 0.060% 99.698% ( 870, 1300 ] 7 0.085% 99.782% ( 1300, 1900 ] 8 0.097% 99.879% ( 1900, 2900 ] 6 0.073% 99.952% ( 2900, 4400 ] 4 0.048% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 1599.5625 StdDev: 2452.18 Min: 93 Median: 833.7500 Max: 19157 Percentiles: P50: 833.75 P75: 2455.56 P99: 15600.00 P99.9: 19157.00 P99.99: 19157.00 ------------------------------------------------------ ( 76, 110 ] 3 3.750% 3.750% # ( 110, 170 ] 13 16.250% 20.000% ### ( 170, 250 ] 6 7.500% 27.500% ## ( 250, 380 ] 3 3.750% 31.250% # ( 380, 580 ] 8 10.000% 41.250% ## ( 580, 870 ] 8 10.000% 51.250% ## ( 870, 1300 ] 8 10.000% 61.250% ## ( 1300, 1900 ] 6 7.500% 68.750% ## ( 1900, 2900 ] 9 11.250% 80.000% ## ( 2900, 4400 ] 13 16.250% 96.250% ### ( 4400, 6600 ] 1 1.250% 97.500% ( 6600, 9900 ] 1 1.250% 98.750% ( 14000, 22000 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 30.6 total, 13.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 160.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.919 H:M:S, 32.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 74.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.050 H:M:S, 61.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/11-21:22:27 ... thread 0: (1000000,6000000) ops and (210472.6,170988.4) ops/second in (4.751212,35.090101) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 2.88 GB 81.8 5.8 0.0 5.8 11.6 5.7 0.0 2.0 108.6 214.6 55.12 50.17 110 0.501 6075K 12K 0.0 0.0 L1 0/0 0.00 KB 0.0 2.9 2.8 0.1 2.9 2.7 0.1 1.0 172.6 170.8 17.16 16.40 3 5.719 3007K 30K 0.0 0.0 L2 2/0 58.87 MB 0.6 0.6 0.5 0.1 0.6 0.5 2.4 1.2 147.6 147.3 4.02 3.53 2 2.011 603K 1429 0.0 0.0 L3 16/0 947.60 MB 0.9 2.7 0.8 1.9 2.7 0.8 1.9 3.2 121.0 119.8 22.86 18.52 11 2.078 2775K 27K 0.0 0.0 L4 178/0 9.58 GB 1.0 1.9 1.5 0.3 1.9 1.5 1.2 1.2 113.0 112.6 16.84 11.12 15 1.123 1895K 4099 0.0 0.0 L5 1220/0 88.34 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1429/10 101.78 GB 0.0 13.9 5.6 8.3 19.5 11.2 8.3 3.4 122.5 172.3 116.00 99.73 141 0.823 14M 75K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 5.6 8.3 19.5 11.2 8.3 3.4 122.5 172.3 116.00 99.73 141 0.823 14M 75K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 5.6 8.3 13.8 5.5 0.0 0.0 150.8 150.0 94.21 81.60 50 1.884 14M 75K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 268.8 21.80 18.12 91 0.240 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.4 total, 35.1 interval Flush(GB): cumulative 5.722, interval 5.722 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.52 GB write, 565.10 MB/s write, 13.87 GB read, 401.64 MB/s read, 116.0 seconds Interval compaction: 19.52 GB write, 569.59 MB/s write, 13.87 GB read, 404.84 MB/s read, 116.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 13, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2469560 Average: 3.6778 StdDev: 28.03 Min: 0 Median: 2.3548 Max: 12508 Percentiles: P50: 2.35 P75: 2.96 P99: 9.53 P99.9: 85.28 P99.99: 158.87 ------------------------------------------------------ [ 0, 1 ] 41564 1.683% 1.683% ( 1, 2 ] 834167 33.778% 35.461% ####### ( 2, 3 ] 1011861 40.973% 76.434% ######## ( 3, 4 ] 229479 9.292% 85.727% ## ( 4, 6 ] 246635 9.987% 95.714% ## ( 6, 10 ] 91943 3.723% 99.437% # ( 10, 15 ] 9693 0.392% 99.829% ( 15, 22 ] 1437 0.058% 99.887% ( 22, 34 ] 122 0.005% 99.892% ( 34, 51 ] 18 0.001% 99.893% ( 51, 76 ] 12 0.000% 99.894% ( 76, 110 ] 599 0.024% 99.918% ( 110, 170 ] 2194 0.089% 100.007% ( 170, 250 ] 527 0.021% 100.028% ( 250, 380 ] 305 0.012% 100.040% ( 380, 580 ] 246 0.010% 100.050% ( 580, 870 ] 154 0.006% 100.057% ( 870, 1300 ] 80 0.003% 100.060% ( 1300, 1900 ] 46 0.002% 100.062% ( 1900, 2900 ] 27 0.001% 100.063% ( 2900, 4400 ] 40 0.002% 100.064% ( 4400, 6600 ] 6 0.000% 100.065% ( 6600, 9900 ] 4 0.000% 100.065% ( 9900, 14000 ] 3 0.000% 100.065% ** Level 1 read latency histogram (micros): Count: 623151 Average: 5.2713 StdDev: 77.42 Min: 1 Median: 2.5893 Max: 18333 Percentiles: P50: 2.59 P75: 3.88 P99: 10.06 P99.9: 15.55 P99.99: 18.94 ------------------------------------------------------ [ 0, 1 ] 6510 1.045% 1.045% ( 1, 2 ] 163182 26.187% 27.231% ##### ( 2, 3 ] 240771 38.638% 65.869% ######## ( 3, 4 ] 64821 10.402% 76.271% ## ( 4, 6 ] 99538 15.973% 92.244% ### ( 6, 10 ] 42035 6.746% 98.990% # ( 10, 15 ] 5580 0.895% 99.885% ( 15, 22 ] 1159 0.186% 100.071% ( 22, 34 ] 102 0.016% 100.088% ( 34, 51 ] 18 0.003% 100.091% ( 51, 76 ] 52 0.008% 100.099% ( 76, 110 ] 78 0.013% 100.112% ( 110, 170 ] 133 0.021% 100.133% ( 170, 250 ] 143 0.023% 100.156% ( 250, 380 ] 154 0.025% 100.181% ( 380, 580 ] 141 0.023% 100.203% ( 580, 870 ] 115 0.018% 100.222% ( 870, 1300 ] 65 0.010% 100.232% ( 1300, 1900 ] 35 0.006% 100.238% ( 1900, 2900 ] 38 0.006% 100.244% ( 2900, 4400 ] 78 0.013% 100.256% ( 4400, 6600 ] 14 0.002% 100.259% ( 6600, 9900 ] 22 0.004% 100.262% ( 9900, 14000 ] 1 0.000% 100.262% ( 14000, 22000 ] 2 0.000% 100.263% ** Level 2 read latency histogram (micros): Count: 119146 Average: 5.1079 StdDev: 63.07 Min: 1 Median: 2.8140 Max: 4897 Percentiles: P50: 2.81 P75: 4.41 P99: 9.97 P99.9: 14.32 P99.99: 14.77 ------------------------------------------------------ [ 0, 1 ] 2124 1.783% 1.783% ( 1, 2 ] 24627 20.670% 22.452% #### ( 2, 3 ] 40323 33.843% 56.296% ####### ( 3, 4 ] 17134 14.381% 70.676% ### ( 4, 6 ] 24916 20.912% 91.588% #### ( 6, 10 ] 8894 7.465% 99.053% # ( 10, 15 ] 1169 0.981% 100.034% ( 15, 22 ] 297 0.249% 100.284% ( 22, 34 ] 24 0.020% 100.304% ( 34, 51 ] 2 0.002% 100.306% ( 76, 110 ] 2 0.002% 100.307% ( 110, 170 ] 47 0.039% 100.347% ( 170, 250 ] 22 0.018% 100.365% ( 250, 380 ] 14 0.012% 100.377% ( 380, 580 ] 8 0.007% 100.384% ( 580, 870 ] 9 0.008% 100.391% ( 870, 1300 ] 4 0.003% 100.394% ( 1300, 1900 ] 4 0.003% 100.398% ( 1900, 2900 ] 1 0.001% 100.399% ( 2900, 4400 ] 25 0.021% 100.420% ( 4400, 6600 ] 3 0.003% 100.422% ** Level 3 read latency histogram (micros): Count: 571114 Average: 12.1729 StdDev: 161.90 Min: 0 Median: 3.4663 Max: 26087 Percentiles: P50: 3.47 P75: 5.08 P99: 22.64 P99.9: 1533.02 P99.99: 4393.20 ------------------------------------------------------ [ 0, 1 ] 2199 0.385% 0.385% ( 1, 2 ] 65237 11.423% 11.808% ## ( 2, 3 ] 163717 28.666% 40.474% ###### ( 3, 4 ] 116682 20.431% 60.905% #### ( 4, 6 ] 148889 26.070% 86.975% ##### ( 6, 10 ] 56824 9.950% 96.924% ## ( 10, 15 ] 8663 1.517% 98.441% ( 15, 22 ] 3168 0.555% 98.996% ( 22, 34 ] 450 0.079% 99.075% ( 34, 51 ] 66 0.012% 99.086% ( 51, 76 ] 11 0.002% 99.088% ( 76, 110 ] 268 0.047% 99.135% ( 110, 170 ] 1147 0.201% 99.336% ( 170, 250 ] 763 0.134% 99.469% ( 250, 380 ] 603 0.106% 99.575% ( 380, 580 ] 692 0.121% 99.696% ( 580, 870 ] 629 0.110% 99.806% ( 870, 1300 ] 451 0.079% 99.885% ( 1300, 1900 ] 216 0.038% 99.923% ( 1900, 2900 ] 138 0.024% 99.947% ( 2900, 4400 ] 245 0.043% 99.990% ( 4400, 6600 ] 108 0.019% 100.009% ( 6600, 9900 ] 39 0.007% 100.016% ( 9900, 14000 ] 15 0.003% 100.019% ( 14000, 22000 ] 6 0.001% 100.020% ( 22000, 33000 ] 1 0.000% 100.020% ** Level 4 read latency histogram (micros): Count: 36778 Average: 8.0966 StdDev: 70.17 Min: 1 Median: 2.4985 Max: 3416 Percentiles: P50: 2.50 P75: 3.47 P99: 21.88 P99.9: 1114.86 P99.99: 3020.82 ------------------------------------------------------ [ 0, 1 ] 395 1.074% 1.074% ( 1, 2 ] 10745 29.216% 30.290% ###### ( 2, 3 ] 14543 39.543% 69.833% ######## ( 3, 4 ] 4047 11.004% 80.836% ## ( 4, 6 ] 4585 12.467% 93.303% ## ( 6, 10 ] 1810 4.921% 98.224% # ( 10, 15 ] 242 0.658% 98.882% ( 15, 22 ] 44 0.120% 99.002% ( 22, 34 ] 6 0.016% 99.018% ( 34, 51 ] 5 0.014% 99.032% ( 51, 76 ] 2 0.005% 99.037% ( 76, 110 ] 30 0.082% 99.119% ( 110, 170 ] 69 0.188% 99.307% ( 170, 250 ] 55 0.150% 99.456% ( 250, 380 ] 48 0.131% 99.587% ( 380, 580 ] 59 0.160% 99.747% ( 580, 870 ] 38 0.103% 99.850% ( 870, 1300 ] 32 0.087% 99.937% ( 1300, 1900 ] 13 0.035% 99.973% ( 1900, 2900 ] 6 0.016% 99.989% ( 2900, 4400 ] 4 0.011% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 1376.3833 StdDev: 1905.91 Min: 93 Median: 725.0000 Max: 19157 Percentiles: P50: 725.00 P75: 2138.10 P99: 7260.00 P99.9: 19157.00 P99.99: 19157.00 ------------------------------------------------------ ( 76, 110 ] 7 3.889% 3.889% # ( 110, 170 ] 28 15.556% 19.444% ### ( 170, 250 ] 17 9.444% 28.889% ## ( 250, 380 ] 7 3.889% 32.778% # ( 380, 580 ] 21 11.667% 44.444% ## ( 580, 870 ] 20 11.111% 55.556% ## ( 870, 1300 ] 16 8.889% 64.444% ## ( 1300, 1900 ] 14 7.778% 72.222% ## ( 1900, 2900 ] 21 11.667% 83.889% ## ( 2900, 4400 ] 23 12.778% 96.667% ### ( 4400, 6600 ] 4 2.222% 98.889% ( 6600, 9900 ] 1 0.556% 99.444% ( 14000, 22000 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 35.4 total, 4.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 166.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.205 H:M:S, 28.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 207.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.286 H:M:S, 6.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/07/11-21:22:34 ... thread 0: (1000000,7000000) ops and (140591.1,165865.3) ops/second in (7.112827,42.202928) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.91 GB 62.9 6.6 0.0 6.6 13.2 6.6 0.0 2.0 109.4 218.7 61.59 55.88 127 0.485 6843K 12K 0.0 0.0 L1 6/0 340.35 MB 34.0 4.7 4.6 0.1 4.7 4.6 0.1 1.0 170.9 169.5 28.33 27.05 4 7.082 4917K 38K 0.0 0.0 L2 9/7 1.02 GB 2.6 0.6 0.5 0.1 0.6 0.5 3.9 1.2 147.6 147.3 4.02 3.53 2 2.011 603K 1429 0.0 0.0 L3 21/6 1.46 GB 0.8 2.7 0.9 1.9 2.7 0.9 2.4 3.1 119.7 118.5 23.50 18.81 12 1.958 2821K 27K 0.0 0.0 L4 178/0 9.58 GB 1.0 1.9 1.5 0.3 1.9 1.5 1.2 1.2 113.0 112.6 16.84 11.12 15 1.123 1895K 4099 0.0 0.0 L5 1220/0 88.34 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1446/22 102.63 GB 0.0 16.5 7.5 9.0 23.0 14.0 10.3 3.5 125.8 175.3 134.27 116.38 160 0.839 17M 85K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.5 7.5 9.0 23.0 14.0 10.3 3.5 125.8 175.3 134.27 116.38 160 0.839 17M 85K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.5 7.5 9.0 16.4 7.4 0.0 0.0 154.8 154.0 109.12 95.59 55 1.984 17M 85K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 267.9 25.16 20.79 105 0.240 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.5 total, 42.2 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.99 GB write, 554.16 MB/s write, 16.49 GB read, 397.55 MB/s read, 134.3 seconds Interval compaction: 22.99 GB write, 557.82 MB/s write, 16.49 GB read, 400.17 MB/s read, 134.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 14, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3177382 Average: 3.5555 StdDev: 26.54 Min: 0 Median: 2.3276 Max: 12508 Percentiles: P50: 2.33 P75: 2.92 P99: 9.38 P99.9: 18.32 P99.99: 142.62 ------------------------------------------------------ [ 0, 1 ] 61123 1.924% 1.924% ( 1, 2 ] 1088157 34.247% 36.171% ####### ( 2, 3 ] 1341325 42.215% 78.385% ######## ( 3, 4 ] 272284 8.569% 86.955% ## ( 4, 6 ] 291501 9.174% 96.129% ## ( 6, 10 ] 107836 3.394% 99.523% # ( 10, 15 ] 11229 0.353% 99.876% ( 15, 22 ] 1586 0.050% 99.926% ( 22, 34 ] 132 0.004% 99.930% ( 34, 51 ] 25 0.001% 99.931% ( 51, 76 ] 18 0.001% 99.932% ( 76, 110 ] 620 0.020% 99.951% ( 110, 170 ] 2265 0.071% 100.023% ( 170, 250 ] 562 0.018% 100.040% ( 250, 380 ] 333 0.010% 100.051% ( 380, 580 ] 263 0.008% 100.059% ( 580, 870 ] 176 0.006% 100.065% ( 870, 1300 ] 98 0.003% 100.068% ( 1300, 1900 ] 48 0.002% 100.069% ( 1900, 2900 ] 31 0.001% 100.070% ( 2900, 4400 ] 52 0.002% 100.072% ( 4400, 6600 ] 8 0.000% 100.072% ( 6600, 9900 ] 4 0.000% 100.072% ( 9900, 14000 ] 3 0.000% 100.072% ** Level 1 read latency histogram (micros): Count: 738517 Average: 6.1971 StdDev: 94.77 Min: 1 Median: 2.6379 Max: 18333 Percentiles: P50: 2.64 P75: 4.06 P99: 10.95 P99.9: 17.24 P99.99: 20.37 ------------------------------------------------------ [ 0, 1 ] 6819 0.923% 0.923% ( 1, 2 ] 182146 24.664% 25.587% ##### ( 2, 3 ] 282652 38.273% 63.860% ######## ( 3, 4 ] 78601 10.643% 74.503% ## ( 4, 6 ] 124562 16.867% 91.370% ### ( 6, 10 ] 54907 7.435% 98.804% # ( 10, 15 ] 7622 1.032% 99.836% ( 15, 22 ] 1485 0.201% 100.038% ( 22, 34 ] 129 0.017% 100.055% ( 34, 51 ] 26 0.004% 100.058% ( 51, 76 ] 62 0.008% 100.067% ( 76, 110 ] 88 0.012% 100.079% ( 110, 170 ] 153 0.021% 100.100% ( 170, 250 ] 182 0.025% 100.124% ( 250, 380 ] 235 0.032% 100.156% ( 380, 580 ] 230 0.031% 100.187% ( 580, 870 ] 205 0.028% 100.215% ( 870, 1300 ] 134 0.018% 100.233% ( 1300, 1900 ] 63 0.009% 100.242% ( 1900, 2900 ] 63 0.009% 100.250% ( 2900, 4400 ] 147 0.020% 100.270% ( 4400, 6600 ] 38 0.005% 100.275% ( 6600, 9900 ] 32 0.004% 100.279% ( 9900, 14000 ] 3 0.000% 100.280% ( 14000, 22000 ] 2 0.000% 100.280% ** Level 2 read latency histogram (micros): Count: 134088 Average: 6.1634 StdDev: 87.45 Min: 1 Median: 2.8198 Max: 7888 Percentiles: P50: 2.82 P75: 4.43 P99: 10.77 P99.9: 15.52 P99.99: 18.02 ------------------------------------------------------ [ 0, 1 ] 2170 1.618% 1.618% ( 1, 2 ] 27044 20.169% 21.787% #### ( 2, 3 ] 46147 34.415% 56.203% ####### ( 3, 4 ] 19318 14.407% 70.610% ### ( 4, 6 ] 27618 20.597% 91.207% #### ( 6, 10 ] 10234 7.632% 98.839% ## ( 10, 15 ] 1398 1.043% 99.881% ( 15, 22 ] 338 0.252% 100.133% ( 22, 34 ] 29 0.022% 100.155% ( 34, 51 ] 4 0.003% 100.158% ( 51, 76 ] 1 0.001% 100.159% ( 76, 110 ] 4 0.003% 100.162% ( 110, 170 ] 60 0.045% 100.207% ( 170, 250 ] 55 0.041% 100.248% ( 250, 380 ] 56 0.042% 100.289% ( 380, 580 ] 32 0.024% 100.313% ( 580, 870 ] 18 0.013% 100.327% ( 870, 1300 ] 10 0.007% 100.334% ( 1300, 1900 ] 6 0.004% 100.339% ( 1900, 2900 ] 6 0.004% 100.343% ( 2900, 4400 ] 37 0.028% 100.371% ( 4400, 6600 ] 8 0.006% 100.377% ( 6600, 9900 ] 4 0.003% 100.380% ** Level 3 read latency histogram (micros): Count: 605740 Average: 12.5802 StdDev: 166.65 Min: 0 Median: 3.4424 Max: 26087 Percentiles: P50: 3.44 P75: 5.07 P99: 21.90 P99.9: 1680.47 P99.99: 4376.82 ------------------------------------------------------ [ 0, 1 ] 2261 0.373% 0.373% ( 1, 2 ] 70416 11.625% 11.998% ## ( 2, 3 ] 176731 29.176% 41.174% ###### ( 3, 4 ] 120838 19.949% 61.123% #### ( 4, 6 ] 156488 25.834% 86.957% ##### ( 6, 10 ] 60463 9.982% 96.939% ## ( 10, 15 ] 9242 1.526% 98.465% ( 15, 22 ] 3294 0.544% 99.008% ( 22, 34 ] 462 0.076% 99.085% ( 34, 51 ] 67 0.011% 99.096% ( 51, 76 ] 12 0.002% 99.098% ( 76, 110 ] 269 0.044% 99.142% ( 110, 170 ] 1155 0.191% 99.333% ( 170, 250 ] 776 0.128% 99.461% ( 250, 380 ] 626 0.103% 99.564% ( 380, 580 ] 739 0.122% 99.686% ( 580, 870 ] 660 0.109% 99.795% ( 870, 1300 ] 480 0.079% 99.874% ( 1300, 1900 ] 248 0.041% 99.915% ( 1900, 2900 ] 163 0.027% 99.942% ( 2900, 4400 ] 296 0.049% 99.991% ( 4400, 6600 ] 121 0.020% 100.011% ( 6600, 9900 ] 49 0.008% 100.019% ( 9900, 14000 ] 15 0.002% 100.022% ( 14000, 22000 ] 6 0.001% 100.023% ( 22000, 33000 ] 1 0.000% 100.023% ** Level 4 read latency histogram (micros): Count: 36778 Average: 8.0966 StdDev: 70.17 Min: 1 Median: 2.4985 Max: 3416 Percentiles: P50: 2.50 P75: 3.47 P99: 21.88 P99.9: 1114.86 P99.99: 3020.82 ------------------------------------------------------ [ 0, 1 ] 395 1.074% 1.074% ( 1, 2 ] 10745 29.216% 30.290% ###### ( 2, 3 ] 14543 39.543% 69.833% ######## ( 3, 4 ] 4047 11.004% 80.836% ## ( 4, 6 ] 4585 12.467% 93.303% ## ( 6, 10 ] 1810 4.921% 98.224% # ( 10, 15 ] 242 0.658% 98.882% ( 15, 22 ] 44 0.120% 99.002% ( 22, 34 ] 6 0.016% 99.018% ( 34, 51 ] 5 0.014% 99.032% ( 51, 76 ] 2 0.005% 99.037% ( 76, 110 ] 30 0.082% 99.119% ( 110, 170 ] 69 0.188% 99.307% ( 170, 250 ] 55 0.150% 99.456% ( 250, 380 ] 48 0.131% 99.587% ( 380, 580 ] 59 0.160% 99.747% ( 580, 870 ] 38 0.103% 99.850% ( 870, 1300 ] 32 0.087% 99.937% ( 1300, 1900 ] 13 0.035% 99.973% ( 1900, 2900 ] 6 0.016% 99.989% ( 2900, 4400 ] 4 0.011% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 1376.3833 StdDev: 1905.91 Min: 93 Median: 725.0000 Max: 19157 Percentiles: P50: 725.00 P75: 2138.10 P99: 7260.00 P99.9: 19157.00 P99.99: 19157.00 ------------------------------------------------------ ( 76, 110 ] 7 3.889% 3.889% # ( 110, 170 ] 28 15.556% 19.444% ### ( 170, 250 ] 17 9.444% 28.889% ## ( 250, 380 ] 7 3.889% 32.778% # ( 380, 580 ] 21 11.667% 44.444% ## ( 580, 870 ] 20 11.111% 55.556% ## ( 870, 1300 ] 16 8.889% 64.444% ## ( 1300, 1900 ] 14 7.778% 72.222% ## ( 1900, 2900 ] 21 11.667% 83.889% ## ( 2900, 4400 ] 23 12.778% 96.667% ### ( 4400, 6600 ] 4 2.222% 98.889% ( 6600, 9900 ] 1 0.556% 99.444% ( 14000, 22000 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 42.5 total, 7.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 162.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.282 H:M:S, 24.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 138.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.077 H:M:S, 1.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/07/11-21:22:41 ... thread 0: (1000000,8000000) ops and (141915.9,162438.7) ops/second in (7.046426,49.249354) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 2.95 GB 37.7 8.2 0.0 8.2 15.9 7.6 0.0 2.1 110.6 212.8 76.28 67.42 144 0.530 8569K 18K 0.0 0.0 L1 6/6 340.35 MB 0.0 4.7 4.6 0.1 4.7 4.6 0.1 1.0 170.9 169.5 28.33 27.05 4 7.082 4917K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.6 0.5 0.1 0.6 0.5 3.9 1.2 147.6 147.3 4.02 3.53 2 2.011 603K 1429 0.0 0.0 L3 18/0 983.70 MB 1.0 4.6 1.9 2.6 4.5 1.9 2.4 2.4 116.4 115.4 40.05 30.57 20 2.002 4699K 38K 0.0 0.0 L4 176/0 9.72 GB 1.0 4.2 3.0 1.2 4.2 2.9 1.2 1.4 112.8 112.2 38.17 25.62 36 1.060 4323K 20K 0.0 0.0 L5 1240/0 89.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1456/21 103.65 GB 0.0 22.3 9.9 12.4 29.8 17.5 11.7 3.9 122.2 163.4 186.84 154.18 206 0.907 23M 117K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.3 9.9 12.4 29.8 17.5 11.7 3.9 122.2 163.4 186.84 154.18 206 0.907 23M 117K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.3 9.9 12.4 22.2 9.8 0.0 0.0 146.6 145.8 155.81 129.95 87 1.791 23M 117K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 251.7 31.03 24.23 119 0.261 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.5 total, 49.3 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.82 GB write, 616.43 MB/s write, 22.31 GB read, 461.14 MB/s read, 186.8 seconds Interval compaction: 29.82 GB write, 619.92 MB/s write, 22.31 GB read, 463.75 MB/s read, 186.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 35, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3622555 Average: 3.6482 StdDev: 31.83 Min: 0 Median: 2.3259 Max: 12508 Percentiles: P50: 2.33 P75: 2.92 P99: 9.43 P99.9: 18.34 P99.99: 146.97 ------------------------------------------------------ [ 0, 1 ] 77004 2.126% 2.126% ( 1, 2 ] 1237775 34.169% 36.294% ####### ( 2, 3 ] 1523240 42.049% 78.343% ######## ( 3, 4 ] 307561 8.490% 86.833% ## ( 4, 6 ] 332420 9.176% 96.010% ## ( 6, 10 ] 126510 3.492% 99.502% # ( 10, 15 ] 13535 0.374% 99.876% ( 15, 22 ] 1863 0.051% 99.927% ( 22, 34 ] 160 0.004% 99.931% ( 34, 51 ] 34 0.001% 99.932% ( 51, 76 ] 29 0.001% 99.933% ( 76, 110 ] 638 0.018% 99.951% ( 110, 170 ] 2314 0.064% 100.015% ( 170, 250 ] 623 0.017% 100.032% ( 250, 380 ] 405 0.011% 100.043% ( 380, 580 ] 361 0.010% 100.053% ( 580, 870 ] 251 0.007% 100.060% ( 870, 1300 ] 145 0.004% 100.064% ( 1300, 1900 ] 75 0.002% 100.066% ( 1900, 2900 ] 56 0.002% 100.067% ( 2900, 4400 ] 91 0.003% 100.070% ( 4400, 6600 ] 13 0.000% 100.070% ( 6600, 9900 ] 10 0.000% 100.071% ( 9900, 14000 ] 4 0.000% 100.071% ** Level 1 read latency histogram (micros): Count: 1013543 Average: 6.6093 StdDev: 100.18 Min: 1 Median: 2.7324 Max: 18333 Percentiles: P50: 2.73 P75: 4.39 P99: 12.00 P99.9: 18.09 P99.99: 20.42 ------------------------------------------------------ [ 0, 1 ] 7159 0.706% 0.706% ( 1, 2 ] 214138 21.128% 21.834% #### ( 2, 3 ] 389755 38.455% 60.289% ######## ( 3, 4 ] 112252 11.075% 71.364% ## ( 4, 6 ] 187045 18.455% 89.818% #### ( 6, 10 ] 87782 8.661% 98.479% ## ( 10, 15 ] 13188 1.301% 99.781% ( 15, 22 ] 2741 0.270% 100.051% ( 22, 34 ] 227 0.022% 100.073% ( 34, 51 ] 30 0.003% 100.076% ( 51, 76 ] 64 0.006% 100.083% ( 76, 110 ] 90 0.009% 100.092% ( 110, 170 ] 172 0.017% 100.109% ( 170, 250 ] 211 0.021% 100.129% ( 250, 380 ] 275 0.027% 100.156% ( 380, 580 ] 291 0.029% 100.185% ( 580, 870 ] 264 0.026% 100.211% ( 870, 1300 ] 199 0.020% 100.231% ( 1300, 1900 ] 102 0.010% 100.241% ( 1900, 2900 ] 99 0.010% 100.251% ( 2900, 4400 ] 243 0.024% 100.275% ( 4400, 6600 ] 62 0.006% 100.281% ( 6600, 9900 ] 44 0.004% 100.285% ( 9900, 14000 ] 7 0.001% 100.286% ( 14000, 22000 ] 2 0.000% 100.286% ** Level 2 read latency histogram (micros): Count: 149581 Average: 7.1344 StdDev: 111.51 Min: 1 Median: 2.8197 Max: 9464 Percentiles: P50: 2.82 P75: 4.43 P99: 11.22 P99.9: 17.64 P99.99: 20.22 ------------------------------------------------------ [ 0, 1 ] 2172 1.452% 1.452% ( 1, 2 ] 28555 19.090% 20.542% #### ( 2, 3 ] 53757 35.938% 56.480% ####### ( 3, 4 ] 21242 14.201% 70.681% ### ( 4, 6 ] 30352 20.291% 90.973% #### ( 6, 10 ] 11617 7.766% 98.739% ## ( 10, 15 ] 1599 1.069% 99.808% ( 15, 22 ] 365 0.244% 100.052% ( 22, 34 ] 29 0.019% 100.072% ( 34, 51 ] 5 0.003% 100.075% ( 51, 76 ] 2 0.001% 100.076% ( 76, 110 ] 9 0.006% 100.082% ( 110, 170 ] 69 0.046% 100.128% ( 170, 250 ] 71 0.047% 100.176% ( 250, 380 ] 66 0.044% 100.220% ( 380, 580 ] 43 0.029% 100.249% ( 580, 870 ] 26 0.017% 100.266% ( 870, 1300 ] 13 0.009% 100.275% ( 1300, 1900 ] 12 0.008% 100.283% ( 1900, 2900 ] 12 0.008% 100.291% ( 2900, 4400 ] 49 0.033% 100.324% ( 4400, 6600 ] 14 0.009% 100.333% ( 6600, 9900 ] 11 0.007% 100.340% ** Level 3 read latency histogram (micros): Count: 1030500 Average: 10.5271 StdDev: 144.92 Min: 0 Median: 3.1020 Max: 26087 Percentiles: P50: 3.10 P75: 4.86 P99: 14.78 P99.9: 661.57 P99.99: 1076.71 ------------------------------------------------------ [ 0, 1 ] 3240 0.314% 0.314% ( 1, 2 ] 139802 13.566% 13.881% ### ( 2, 3 ] 354570 34.408% 48.288% ####### ( 3, 4 ] 172922 16.780% 65.069% ### ( 4, 6 ] 238890 23.182% 88.251% ##### ( 6, 10 ] 98154 9.525% 97.776% ## ( 10, 15 ] 13194 1.280% 99.056% ( 15, 22 ] 3910 0.379% 99.435% ( 22, 34 ] 484 0.047% 99.482% ( 34, 51 ] 75 0.007% 99.490% ( 51, 76 ] 20 0.002% 99.492% ( 76, 110 ] 274 0.027% 99.518% ( 110, 170 ] 1188 0.115% 99.633% ( 170, 250 ] 845 0.082% 99.715% ( 250, 380 ] 749 0.073% 99.788% ( 380, 580 ] 912 0.089% 99.877% ( 580, 870 ] 855 0.083% 99.960% ( 870, 1300 ] 651 0.063% 100.023% ( 1300, 1900 ] 349 0.034% 100.057% ( 1900, 2900 ] 232 0.023% 100.079% ( 2900, 4400 ] 444 0.043% 100.122% ( 4400, 6600 ] 145 0.014% 100.136% ( 6600, 9900 ] 56 0.005% 100.142% ( 9900, 14000 ] 16 0.002% 100.143% ( 14000, 22000 ] 9 0.001% 100.144% ( 22000, 33000 ] 1 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 243009 Average: 13.3284 StdDev: 159.30 Min: 1 Median: 2.8393 Max: 11118 Percentiles: P50: 2.84 P75: 4.70 P99: 16.72 P99.9: 1015.63 P99.99: 1527.91 ------------------------------------------------------ [ 0, 1 ] 758 0.312% 0.312% ( 1, 2 ] 39524 16.264% 16.576% ### ( 2, 3 ] 96775 39.824% 56.400% ######## ( 3, 4 ] 28769 11.839% 68.239% ## ( 4, 6 ] 46980 19.333% 87.571% #### ( 6, 10 ] 23641 9.728% 97.300% ## ( 10, 15 ] 3960 1.630% 98.929% ( 15, 22 ] 701 0.288% 99.218% ( 22, 34 ] 60 0.025% 99.242% ( 34, 51 ] 20 0.008% 99.251% ( 51, 76 ] 10 0.004% 99.255% ( 76, 110 ] 62 0.026% 99.280% ( 110, 170 ] 208 0.086% 99.366% ( 170, 250 ] 238 0.098% 99.464% ( 250, 380 ] 277 0.114% 99.578% ( 380, 580 ] 369 0.152% 99.730% ( 580, 870 ] 330 0.136% 99.865% ( 870, 1300 ] 248 0.102% 99.967% ( 1300, 1900 ] 144 0.059% 100.027% ( 1900, 2900 ] 89 0.037% 100.063% ( 2900, 4400 ] 152 0.063% 100.126% ( 4400, 6600 ] 46 0.019% 100.145% ( 6600, 9900 ] 23 0.009% 100.154% ( 9900, 14000 ] 1 0.000% 100.155% ** Level 5 read latency histogram (micros): Count: 280 Average: 1269.8393 StdDev: 1707.03 Min: 93 Median: 618.6667 Max: 19157 Percentiles: P50: 618.67 P75: 1937.04 P99: 6248.00 P99.9: 19157.00 P99.99: 19157.00 ------------------------------------------------------ ( 76, 110 ] 7 2.500% 2.500% # ( 110, 170 ] 45 16.071% 18.571% ### ( 170, 250 ] 29 10.357% 28.929% ## ( 250, 380 ] 21 7.500% 36.429% ## ( 380, 580 ] 34 12.143% 48.571% ## ( 580, 870 ] 30 10.714% 59.286% ## ( 870, 1300 ] 25 8.929% 68.214% ## ( 1300, 1900 ] 18 6.429% 74.643% # ( 1900, 2900 ] 27 9.643% 84.286% ## ( 2900, 4400 ] 37 13.214% 97.500% ### ( 4400, 6600 ] 5 1.786% 99.286% ( 6600, 9900 ] 1 0.357% 99.643% ( 14000, 22000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 49.5 total, 7.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 158.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.412 H:M:S, 25.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 139.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.131 H:M:S, 30.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/11-21:22:45 ... thread 0: (1000000,9000000) ops and (257901.9,169406.0) ops/second in (3.877444,53.126798) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 3.87 GB 157.3 9.2 0.0 9.2 17.8 8.5 0.0 2.1 112.0 215.5 84.38 75.03 163 0.518 9592K 19K 0.0 0.0 L1 6/6 340.35 MB 0.0 4.7 4.6 0.1 4.7 4.6 0.1 1.0 170.9 169.5 28.33 27.05 4 7.082 4917K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.6 0.5 0.1 0.6 0.5 3.9 1.2 147.6 147.3 4.02 3.53 2 2.011 603K 1429 0.0 0.0 L3 18/0 983.70 MB 1.0 4.6 1.9 2.6 4.5 1.9 2.4 2.4 116.4 115.4 40.05 30.57 20 2.002 4699K 38K 0.0 0.0 L4 176/0 9.72 GB 1.0 4.2 3.0 1.2 4.2 2.9 1.2 1.4 112.8 112.2 38.17 25.62 36 1.060 4323K 20K 0.0 0.0 L5 1240/0 89.69 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1459/17 104.57 GB 0.0 23.3 9.9 13.3 31.7 18.4 11.7 3.7 122.3 166.6 194.94 161.79 225 0.866 24M 118K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.3 9.9 13.3 31.7 18.4 11.7 3.7 122.3 166.6 194.94 161.79 225 0.866 24M 118K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.3 9.9 13.3 23.2 9.8 0.0 0.0 148.5 147.8 160.56 134.61 91 1.764 24M 118K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 254.7 34.38 27.18 134 0.257 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.4 total, 53.1 interval Flush(GB): cumulative 8.552, interval 8.552 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.72 GB write, 608.23 MB/s write, 23.29 GB read, 446.53 MB/s read, 194.9 seconds Interval compaction: 31.72 GB write, 611.42 MB/s write, 23.29 GB read, 448.88 MB/s read, 194.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 35, interval: 50 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4034577 Average: 3.5789 StdDev: 30.29 Min: 0 Median: 2.3138 Max: 12508 Percentiles: P50: 2.31 P75: 2.90 P99: 9.35 P99.9: 16.55 P99.99: 141.37 ------------------------------------------------------ [ 0, 1 ] 87872 2.178% 2.178% ( 1, 2 ] 1388785 34.422% 36.600% ####### ( 2, 3 ] 1722808 42.701% 79.301% ######### ( 3, 4 ] 330757 8.198% 87.499% ## ( 4, 6 ] 352995 8.749% 96.248% ## ( 6, 10 ] 132532 3.285% 99.533% # ( 10, 15 ] 14366 0.356% 99.889% ( 15, 22 ] 1945 0.048% 99.938% ( 22, 34 ] 164 0.004% 99.942% ( 34, 51 ] 36 0.001% 99.943% ( 51, 76 ] 33 0.001% 99.943% ( 76, 110 ] 646 0.016% 99.959% ( 110, 170 ] 2365 0.059% 100.018% ( 170, 250 ] 665 0.016% 100.035% ( 250, 380 ] 422 0.010% 100.045% ( 380, 580 ] 379 0.009% 100.054% ( 580, 870 ] 260 0.006% 100.061% ( 870, 1300 ] 151 0.004% 100.065% ( 1300, 1900 ] 77 0.002% 100.066% ( 1900, 2900 ] 57 0.001% 100.068% ( 2900, 4400 ] 91 0.002% 100.070% ( 4400, 6600 ] 13 0.000% 100.070% ( 6600, 9900 ] 10 0.000% 100.071% ( 9900, 14000 ] 4 0.000% 100.071% ** Level 1 read latency histogram (micros): Count: 1013543 Average: 6.6093 StdDev: 100.18 Min: 1 Median: 2.7324 Max: 18333 Percentiles: P50: 2.73 P75: 4.39 P99: 12.00 P99.9: 18.09 P99.99: 20.42 ------------------------------------------------------ [ 0, 1 ] 7159 0.706% 0.706% ( 1, 2 ] 214138 21.128% 21.834% #### ( 2, 3 ] 389755 38.455% 60.289% ######## ( 3, 4 ] 112252 11.075% 71.364% ## ( 4, 6 ] 187045 18.455% 89.818% #### ( 6, 10 ] 87782 8.661% 98.479% ## ( 10, 15 ] 13188 1.301% 99.781% ( 15, 22 ] 2741 0.270% 100.051% ( 22, 34 ] 227 0.022% 100.073% ( 34, 51 ] 30 0.003% 100.076% ( 51, 76 ] 64 0.006% 100.083% ( 76, 110 ] 90 0.009% 100.092% ( 110, 170 ] 172 0.017% 100.109% ( 170, 250 ] 211 0.021% 100.129% ( 250, 380 ] 275 0.027% 100.156% ( 380, 580 ] 291 0.029% 100.185% ( 580, 870 ] 264 0.026% 100.211% ( 870, 1300 ] 199 0.020% 100.231% ( 1300, 1900 ] 102 0.010% 100.241% ( 1900, 2900 ] 99 0.010% 100.251% ( 2900, 4400 ] 243 0.024% 100.275% ( 4400, 6600 ] 62 0.006% 100.281% ( 6600, 9900 ] 44 0.004% 100.285% ( 9900, 14000 ] 7 0.001% 100.286% ( 14000, 22000 ] 2 0.000% 100.286% ** Level 2 read latency histogram (micros): Count: 149581 Average: 7.1344 StdDev: 111.51 Min: 1 Median: 2.8197 Max: 9464 Percentiles: P50: 2.82 P75: 4.43 P99: 11.22 P99.9: 17.64 P99.99: 20.22 ------------------------------------------------------ [ 0, 1 ] 2172 1.452% 1.452% ( 1, 2 ] 28555 19.090% 20.542% #### ( 2, 3 ] 53757 35.938% 56.480% ####### ( 3, 4 ] 21242 14.201% 70.681% ### ( 4, 6 ] 30352 20.291% 90.973% #### ( 6, 10 ] 11617 7.766% 98.739% ## ( 10, 15 ] 1599 1.069% 99.808% ( 15, 22 ] 365 0.244% 100.052% ( 22, 34 ] 29 0.019% 100.072% ( 34, 51 ] 5 0.003% 100.075% ( 51, 76 ] 2 0.001% 100.076% ( 76, 110 ] 9 0.006% 100.082% ( 110, 170 ] 69 0.046% 100.128% ( 170, 250 ] 71 0.047% 100.176% ( 250, 380 ] 66 0.044% 100.220% ( 380, 580 ] 43 0.029% 100.249% ( 580, 870 ] 26 0.017% 100.266% ( 870, 1300 ] 13 0.009% 100.275% ( 1300, 1900 ] 12 0.008% 100.283% ( 1900, 2900 ] 12 0.008% 100.291% ( 2900, 4400 ] 49 0.033% 100.324% ( 4400, 6600 ] 14 0.009% 100.333% ( 6600, 9900 ] 11 0.007% 100.340% ** Level 3 read latency histogram (micros): Count: 1030500 Average: 10.5271 StdDev: 144.92 Min: 0 Median: 3.1020 Max: 26087 Percentiles: P50: 3.10 P75: 4.86 P99: 14.78 P99.9: 661.57 P99.99: 1076.71 ------------------------------------------------------ [ 0, 1 ] 3240 0.314% 0.314% ( 1, 2 ] 139802 13.566% 13.881% ### ( 2, 3 ] 354570 34.408% 48.288% ####### ( 3, 4 ] 172922 16.780% 65.069% ### ( 4, 6 ] 238890 23.182% 88.251% ##### ( 6, 10 ] 98154 9.525% 97.776% ## ( 10, 15 ] 13194 1.280% 99.056% ( 15, 22 ] 3910 0.379% 99.435% ( 22, 34 ] 484 0.047% 99.482% ( 34, 51 ] 75 0.007% 99.490% ( 51, 76 ] 20 0.002% 99.492% ( 76, 110 ] 274 0.027% 99.518% ( 110, 170 ] 1188 0.115% 99.633% ( 170, 250 ] 845 0.082% 99.715% ( 250, 380 ] 749 0.073% 99.788% ( 380, 580 ] 912 0.089% 99.877% ( 580, 870 ] 855 0.083% 99.960% ( 870, 1300 ] 651 0.063% 100.023% ( 1300, 1900 ] 349 0.034% 100.057% ( 1900, 2900 ] 232 0.023% 100.079% ( 2900, 4400 ] 444 0.043% 100.122% ( 4400, 6600 ] 145 0.014% 100.136% ( 6600, 9900 ] 56 0.005% 100.142% ( 9900, 14000 ] 16 0.002% 100.143% ( 14000, 22000 ] 9 0.001% 100.144% ( 22000, 33000 ] 1 0.000% 100.144% ** Level 4 read latency histogram (micros): Count: 243009 Average: 13.3284 StdDev: 159.30 Min: 1 Median: 2.8393 Max: 11118 Percentiles: P50: 2.84 P75: 4.70 P99: 16.72 P99.9: 1015.63 P99.99: 1527.91 ------------------------------------------------------ [ 0, 1 ] 758 0.312% 0.312% ( 1, 2 ] 39524 16.264% 16.576% ### ( 2, 3 ] 96775 39.824% 56.400% ######## ( 3, 4 ] 28769 11.839% 68.239% ## ( 4, 6 ] 46980 19.333% 87.571% #### ( 6, 10 ] 23641 9.728% 97.300% ## ( 10, 15 ] 3960 1.630% 98.929% ( 15, 22 ] 701 0.288% 99.218% ( 22, 34 ] 60 0.025% 99.242% ( 34, 51 ] 20 0.008% 99.251% ( 51, 76 ] 10 0.004% 99.255% ( 76, 110 ] 62 0.026% 99.280% ( 110, 170 ] 208 0.086% 99.366% ( 170, 250 ] 238 0.098% 99.464% ( 250, 380 ] 277 0.114% 99.578% ( 380, 580 ] 369 0.152% 99.730% ( 580, 870 ] 330 0.136% 99.865% ( 870, 1300 ] 248 0.102% 99.967% ( 1300, 1900 ] 144 0.059% 100.027% ( 1900, 2900 ] 89 0.037% 100.063% ( 2900, 4400 ] 152 0.063% 100.126% ( 4400, 6600 ] 46 0.019% 100.145% ( 6600, 9900 ] 23 0.009% 100.154% ( 9900, 14000 ] 1 0.000% 100.155% ** Level 5 read latency histogram (micros): Count: 280 Average: 1269.8393 StdDev: 1707.03 Min: 93 Median: 618.6667 Max: 19157 Percentiles: P50: 618.67 P75: 1937.04 P99: 6248.00 P99.9: 19157.00 P99.99: 19157.00 ------------------------------------------------------ ( 76, 110 ] 7 2.500% 2.500% # ( 110, 170 ] 45 16.071% 18.571% ### ( 170, 250 ] 29 10.357% 28.929% ## ( 250, 380 ] 21 7.500% 36.429% ## ( 380, 580 ] 34 12.143% 48.571% ## ( 580, 870 ] 30 10.714% 59.286% ## ( 870, 1300 ] 25 8.929% 68.214% ## ( 1300, 1900 ] 18 6.429% 74.643% # ( 1900, 2900 ] 27 9.643% 84.286% ## ( 2900, 4400 ] 37 13.214% 97.500% ### ( 4400, 6600 ] 5 1.786% 99.286% ( 6600, 9900 ] 1 0.357% 99.643% ( 14000, 22000 ] 1 0.357% 100.000% ** DB Stats ** Uptime(secs): 53.4 total, 3.9 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 165.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.446 H:M:S, 23.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 253.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.034 H:M:S, 0.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.009 micros/op 166407 ops/sec 60.003 seconds 9984999 operations; 161.2 MB/s Microseconds per write: Count: 9984999 Average: 6.0094 StdDev: 411.44 Min: 1 Median: 2.9337 Max: 700248 Percentiles: P50: 2.93 P75: 4.86 P99: 13.67 P99.9: 250.43 P99.99: 2579.75 ------------------------------------------------------ [ 0, 1 ] 32894 0.329% 0.329% ( 1, 2 ] 1486764 14.890% 15.219% ### ( 2, 3 ] 3719399 37.250% 52.469% ####### ( 3, 4 ] 1156915 11.587% 64.056% ## ( 4, 6 ] 2533561 25.374% 89.429% ##### ( 6, 10 ] 818242 8.195% 97.624% ## ( 10, 15 ] 187300 1.876% 99.500% ( 15, 22 ] 24509 0.245% 99.745% ( 22, 34 ] 5211 0.052% 99.798% ( 34, 51 ] 843 0.008% 99.806% ( 51, 76 ] 138 0.001% 99.807% ( 76, 110 ] 183 0.002% 99.809% ( 110, 170 ] 7548 0.076% 99.885% ( 170, 250 ] 1504 0.015% 99.900% ( 250, 380 ] 903 0.009% 99.909% ( 380, 580 ] 76 0.001% 99.910% ( 580, 870 ] 19 0.000% 99.910% ( 870, 1300 ] 6288 0.063% 99.973% ( 1300, 1900 ] 32 0.000% 99.973% ( 1900, 2900 ] 2459 0.025% 99.998% ( 2900, 4400 ] 175 0.002% 100.000% ( 4400, 6600 ] 12 0.000% 100.000% ( 6600, 9900 ] 11 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 75000, 110000 ] 3 0.000% 100.000% ( 170000, 250000 ] 3 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 154231 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9984999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10304518968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 589 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 15206995 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30709842599 rocksdb.compact.write.bytes COUNT : 30543249040 rocksdb.flush.write.bytes COUNT : 10173424846 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 63 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 361 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10090834944 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3431424 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30807164538 rocksdb.non.last.level.read.count COUNT : 7442044 rocksdb.block.checksum.compute.count COUNT : 7440929 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 2.355789 P95 : 7.025144 P99 : 11.436998 P100 : 700246.000000 COUNT : 9984999 SUM : 51740427 rocksdb.compaction.times.micros P50 : 1396341.463415 P95 : 7765000.000000 P99 : 14981150.000000 P100 : 14981150.000000 COUNT : 97 SUM : 182614398 rocksdb.compaction.times.cpu_micros P50 : 1094761.904762 P95 : 6747500.000000 P99 : 14094712.000000 P100 : 14094712.000000 COUNT : 97 SUM : 155250323 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 795.852273 P95 : 1870.000000 P99 : 18080.000000 P100 : 72723.000000 COUNT : 149 SUM : 248570 rocksdb.compaction.outfile.sync.micros P50 : 1221.020408 P95 : 30525.000000 P99 : 86025.000000 P100 : 117966.000000 COUNT : 374 SUM : 2086844 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 149.230769 P95 : 1016.200000 P99 : 3110.000000 P100 : 10135.000000 COUNT : 286 SUM : 96460 rocksdb.table.open.io.micros P50 : 1439.285714 P95 : 7500.625000 P99 : 13478.714286 P100 : 29234.000000 COUNT : 589 SUM : 1315834 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 5.234303 P95 : 10.047373 P99 : 14.998175 P100 : 26092.000000 COUNT : 7439471 SUM : 62224606 rocksdb.read.block.get.micros P50 : 437.777778 P95 : 3437.857143 P99 : 5010.500000 P100 : 19310.000000 COUNT : 1178 SUM : 1059269 rocksdb.write.raw.block.micros P50 : 0.564783 P95 : 1.734588 P99 : 3.903729 P100 : 33990.000000 COUNT : 9865858 SUM : 27709181 rocksdb.numfiles.in.singlecompaction P50 : 3.203947 P95 : 5.555000 P99 : 13.850000 P100 : 17.000000 COUNT : 169 SUM : 602 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565743 P95 : 1209.814767 P99 : 2595.510037 P100 : 700037.000000 COUNT : 75426 SUM : 15215439 rocksdb.sst.read.micros P50 : 2.494332 P95 : 7.091120 P99 : 10.698989 P100 : 26087.000000 COUNT : 7442606 SUM : 41144868 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9984999 SUM : 10304518968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215230.769231 P95 : 535562.500000 P99 : 958644.000000 P100 : 958644.000000 COUNT : 149 SUM : 38273747 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 379 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0