[2024-11-20 09:19:56.213154] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-20 09:19:56.213417] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2517815 ] Set seed to 1732090796207646 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 09:19:56.323351] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 09:19:56.359313] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 09:19:56.359358] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2517815' to capture a snapshot of events at runtime. [2024-11-20 09:19:56.359381] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2517815 for offline analysis/debug. [2024-11-20 09:19:56.359415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 09:20:00 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-09:20:03 ... thread 0: (1000000,1000000) ops and (360202.9,360202.9) ops/second in (2.776213,2.776213) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.04 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 354.3 2.31 2.09 12 0.193 0 0 0.0 0.0 L2 3/2 251.75 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.2 2.0 250.5 250.4 1.51 1.47 2 0.754 383K 198 0.0 0.0 L3 10/0 867.34 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.3 1.5 98.9 313.2 3.82 3.56 14 0.273 383K 198 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 98.9 313.2 3.82 3.56 14 0.273 383K 198 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 250.5 250.4 1.51 1.47 2 0.754 383K 198 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 354.3 2.31 2.09 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 398.05 MB/s write, 0.37 GB read, 125.71 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 430.70 MB/s write, 0.37 GB read, 136.01 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 99881 Average: 1.8449 StdDev: 15.38 Min: 0 Median: 1.1806 Max: 2822 Percentiles: P50: 1.18 P75: 1.63 P99: 3.75 P99.9: 9.61 P99.99: 381.19 ------------------------------------------------------ [ 0, 1 ] 39932 39.980% 39.980% ######## ( 1, 2 ] 55413 55.479% 95.459% ########### ( 2, 3 ] 2843 2.846% 98.305% # ( 3, 4 ] 933 0.934% 99.239% ( 4, 6 ] 495 0.496% 99.735% ( 6, 10 ] 184 0.184% 99.919% ( 10, 15 ] 37 0.037% 99.956% ( 15, 22 ] 17 0.017% 99.973% ( 51, 76 ] 3 0.003% 99.976% ( 76, 110 ] 1 0.001% 99.977% ( 110, 170 ] 9 0.009% 99.986% ( 170, 250 ] 1 0.001% 99.987% ( 250, 380 ] 4 0.004% 99.991% ( 380, 580 ] 2 0.002% 99.993% ( 580, 870 ] 2 0.002% 99.995% ( 1300, 1900 ] 4 0.004% 99.999% ( 1900, 2900 ] 2 0.002% 100.001% ** Level 1 read latency histogram (micros): Count: 5 Average: 1229.0000 StdDev: 1151.49 Min: 205 Median: 347.5000 Max: 2651 Percentiles: P50: 347.50 P75: 2275.00 P99: 2651.00 P99.9: 2651.00 P99.99: 2651.00 ------------------------------------------------------ ( 170, 250 ] 1 20.000% 20.000% #### ( 250, 380 ] 2 40.000% 60.000% ######## ( 1900, 2900 ] 2 40.000% 100.000% ######## ** Level 2 read latency histogram (micros): Count: 49156 Average: 1.8695 StdDev: 11.23 Min: 1 Median: 1.2309 Max: 1591 Percentiles: P50: 1.23 P75: 1.67 P99: 4.97 P99.9: 9.91 P99.99: 320.49 ------------------------------------------------------ [ 0, 1 ] 18184 36.992% 36.992% ####### ( 1, 2 ] 27697 56.345% 93.338% ########### ( 2, 3 ] 1746 3.552% 96.889% # ( 3, 4 ] 803 1.634% 98.523% ( 4, 6 ] 487 0.991% 99.514% ( 6, 10 ] 195 0.397% 99.910% ( 10, 15 ] 31 0.063% 99.974% ( 15, 22 ] 5 0.010% 99.984% ( 22, 34 ] 2 0.004% 99.988% ( 34, 51 ] 1 0.002% 99.990% ( 250, 380 ] 2 0.004% 99.994% ( 380, 580 ] 1 0.002% 99.996% ( 870, 1300 ] 2 0.004% 100.000% ( 1300, 1900 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 45 Average: 1726.1778 StdDev: 1488.21 Min: 60 Median: 1228.3333 Max: 5145 Percentiles: P50: 1228.33 P75: 2858.33 P99: 5145.00 P99.9: 5145.00 P99.99: 5145.00 ------------------------------------------------------ ( 51, 76 ] 1 2.222% 2.222% ( 76, 110 ] 1 2.222% 4.444% ( 110, 170 ] 1 2.222% 6.667% ( 170, 250 ] 1 2.222% 8.889% ( 250, 380 ] 2 4.444% 13.333% # ( 380, 580 ] 6 13.333% 26.667% ### ( 580, 870 ] 8 17.778% 44.444% #### ( 870, 1300 ] 3 6.667% 51.111% # ( 1300, 1900 ] 5 11.111% 62.222% ## ( 1900, 2900 ] 6 13.333% 75.556% ### ( 2900, 4400 ] 7 15.556% 91.111% ### ( 4400, 6600 ] 4 8.889% 100.000% ## ** Level 4 read latency histogram (micros): Count: 30 Average: 1792.3000 StdDev: 1265.94 Min: 538 Median: 1385.7143 Max: 5367 Percentiles: P50: 1385.71 P75: 2400.00 P99: 5367.00 P99.9: 5367.00 P99.99: 5367.00 ------------------------------------------------------ ( 380, 580 ] 2 6.667% 6.667% # ( 580, 870 ] 7 23.333% 30.000% ##### ( 870, 1300 ] 5 16.667% 46.667% ### ( 1300, 1900 ] 7 23.333% 70.000% ##### ( 1900, 2900 ] 3 10.000% 80.000% ## ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 327.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.221 H:M:S, 7.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 354.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.221 H:M:S, 8.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-09:20:06 ... thread 0: (1000000,2000000) ops and (322874.5,340518.7) ops/second in (3.097179,5.873392) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 1.17 GB 0.0 0.2 0.0 0.2 2.0 1.8 0.0 1.1 41.0 338.1 6.15 5.58 27 0.228 255K 228 0.0 0.0 L1 1/1 3.26 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.8 237.4 1.59 1.54 1 1.589 383K 626 0.0 0.0 L2 2/1 55.29 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.5 2.0 250.5 250.4 1.51 1.47 2 0.754 383K 198 0.0 0.0 L3 20/10 1.18 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 234.5 234.5 1.06 1.00 1 1.065 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 155.1 155.2 1.45 1.06 1 1.449 228K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/26 97.92 GB 0.0 1.4 1.0 0.4 3.2 2.8 1.2 1.8 126.1 281.3 11.76 10.65 32 0.367 1505K 1052 0.0 0.0 Int 0/0 0.00 KB 0.0 1.4 1.0 0.4 3.2 2.8 1.1 1.8 126.1 281.3 11.76 10.65 32 0.367 1505K 1052 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.4 1.0 0.4 1.4 1.0 0.0 0.0 226.0 225.8 6.56 6.00 6 1.093 1505K 1052 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.3 5.20 4.65 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.23 GB write, 542.02 MB/s write, 1.45 GB read, 242.87 MB/s read, 11.8 seconds Interval compaction: 3.23 GB write, 563.04 MB/s write, 1.45 GB read, 252.29 MB/s read, 11.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 396782 Average: 2.1636 StdDev: 9.64 Min: 0 Median: 1.4618 Max: 2822 Percentiles: P50: 1.46 P75: 1.86 P99: 5.67 P99.9: 9.98 P99.99: 14.78 ------------------------------------------------------ [ 0, 1 ] 82062 20.682% 20.682% #### ( 1, 2 ] 251925 63.492% 84.174% ############# ( 2, 3 ] 34040 8.579% 92.753% ## ( 3, 4 ] 15934 4.016% 96.769% # ( 4, 6 ] 10607 2.673% 99.442% # ( 6, 10 ] 1828 0.461% 99.903% ( 10, 15 ] 363 0.091% 99.994% ( 15, 22 ] 36 0.009% 100.003% ( 22, 34 ] 8 0.002% 100.005% ( 34, 51 ] 2 0.001% 100.006% ( 51, 76 ] 4 0.001% 100.007% ( 76, 110 ] 1 0.000% 100.007% ( 110, 170 ] 12 0.003% 100.010% ( 170, 250 ] 10 0.003% 100.013% ( 250, 380 ] 9 0.002% 100.015% ( 380, 580 ] 5 0.001% 100.016% ( 580, 870 ] 7 0.002% 100.018% ( 870, 1300 ] 4 0.001% 100.019% ( 1300, 1900 ] 6 0.002% 100.020% ( 1900, 2900 ] 2 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 31 Average: 363.6129 StdDev: 679.87 Min: 0 Median: 2.5000 Max: 2651 Percentiles: P50: 2.50 P75: 396.67 P99: 2651.00 P99.9: 2651.00 P99.99: 2651.00 ------------------------------------------------------ [ 0, 1 ] 9 29.032% 29.032% ###### ( 1, 2 ] 6 19.355% 48.387% #### ( 2, 3 ] 1 3.226% 51.613% # ( 10, 15 ] 1 3.226% 54.839% # ( 110, 170 ] 1 3.226% 58.065% # ( 170, 250 ] 3 9.677% 67.742% ## ( 250, 380 ] 2 6.452% 74.194% # ( 380, 580 ] 3 9.677% 83.871% ## ( 580, 870 ] 1 3.226% 87.097% # ( 870, 1300 ] 1 3.226% 90.323% # ( 1300, 1900 ] 1 3.226% 93.548% # ( 1900, 2900 ] 2 6.452% 100.000% # ** Level 2 read latency histogram (micros): Count: 95675 Average: 2.0213 StdDev: 8.08 Min: 1 Median: 1.3830 Max: 1591 Percentiles: P50: 1.38 P75: 1.79 P99: 5.56 P99.9: 9.94 P99.99: 24.59 ------------------------------------------------------ [ 0, 1 ] 25514 26.667% 26.667% ##### ( 1, 2 ] 58282 60.917% 87.584% ############ ( 2, 3 ] 6239 6.521% 94.105% # ( 3, 4 ] 3137 3.279% 97.384% # ( 4, 6 ] 1978 2.067% 99.451% ( 6, 10 ] 436 0.456% 99.907% ( 10, 15 ] 70 0.073% 99.980% ( 15, 22 ] 9 0.009% 99.990% ( 22, 34 ] 2 0.002% 99.992% ( 34, 51 ] 1 0.001% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 181677 Average: 3.3593 StdDev: 39.31 Min: 1 Median: 1.6050 Max: 5145 Percentiles: P50: 1.61 P75: 2.01 P99: 8.84 P99.9: 175.75 P99.99: 560.15 ------------------------------------------------------ [ 0, 1 ] 21754 11.974% 11.974% ## ( 1, 2 ] 114186 62.851% 74.825% ############# ( 2, 3 ] 25327 13.941% 88.766% ### ( 3, 4 ] 9442 5.197% 93.963% # ( 4, 6 ] 7172 3.948% 97.911% # ( 6, 10 ] 2792 1.537% 99.447% ( 10, 15 ] 428 0.236% 99.683% ( 15, 22 ] 90 0.050% 99.732% ( 22, 34 ] 21 0.012% 99.744% ( 34, 51 ] 8 0.004% 99.748% ( 51, 76 ] 3 0.002% 99.750% ( 76, 110 ] 132 0.073% 99.823% ( 110, 170 ] 135 0.074% 99.897% ( 170, 250 ] 74 0.041% 99.938% ( 250, 380 ] 57 0.031% 99.969% ( 380, 580 ] 42 0.023% 99.992% ( 580, 870 ] 20 0.011% 100.003% ( 870, 1300 ] 10 0.006% 100.009% ( 1300, 1900 ] 8 0.004% 100.013% ( 1900, 2900 ] 6 0.003% 100.017% ( 2900, 4400 ] 8 0.004% 100.021% ( 4400, 6600 ] 4 0.002% 100.023% ** Level 4 read latency histogram (micros): Count: 320 Average: 172.5938 StdDev: 649.52 Min: 0 Median: 1.6261 Max: 5367 Percentiles: P50: 1.63 P75: 7.09 P99: 3950.00 P99.9: 5367.00 P99.99: 5367.00 ------------------------------------------------------ [ 0, 1 ] 88 27.500% 27.500% ###### ( 1, 2 ] 115 35.938% 63.438% ####### ( 2, 3 ] 22 6.875% 70.312% # ( 3, 4 ] 4 1.250% 71.562% ( 4, 6 ] 2 0.625% 72.188% ( 6, 10 ] 33 10.312% 82.500% ## ( 10, 15 ] 21 6.562% 89.062% # ( 15, 22 ] 2 0.625% 89.688% ( 76, 110 ] 1 0.312% 90.000% ( 110, 170 ] 1 0.312% 90.312% ( 170, 250 ] 1 0.312% 90.625% ( 380, 580 ] 2 0.625% 91.250% ( 580, 870 ] 7 2.188% 93.438% ( 870, 1300 ] 5 1.562% 95.000% ( 1300, 1900 ] 7 2.188% 97.188% ( 1900, 2900 ] 3 0.938% 98.125% ( 2900, 4400 ] 4 1.250% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 322.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.672 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.451 H:M:S, 14.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-09:20:09 ... thread 0: (1000000,3000000) ops and (298730.4,325348.1) ops/second in (3.347500,9.220892) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.54 GB 37.8 1.1 0.0 1.1 3.9 2.8 0.0 1.4 90.4 316.4 12.54 11.44 43 0.292 1151K 1219 0.0 0.0 L1 3/3 182.34 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 234.5 233.9 4.31 4.19 2 2.156 1026K 2239 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 1.0 2.0 250.5 250.4 1.51 1.47 2 0.754 383K 198 0.0 0.0 L3 23/0 940.68 MB 0.9 1.9 0.7 1.2 1.9 0.7 0.4 2.6 219.5 219.1 8.96 8.09 6 1.494 1997K 3982 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 155.1 155.2 1.45 1.06 1 1.449 228K 0 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/13 98.90 GB 0.0 4.6 2.1 2.5 7.4 4.9 3.4 2.7 163.9 262.1 28.77 26.25 54 0.533 4787K 7638 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 2.1 2.5 7.4 4.9 3.3 2.7 163.9 262.1 28.77 26.25 54 0.533 4787K 7638 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 2.1 2.5 4.6 2.1 0.0 0.0 229.2 228.8 20.57 19.05 15 1.371 4787K 7638 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 345.6 8.20 7.19 39 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.5 total, 9.2 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.36 GB write, 797.97 MB/s write, 4.60 GB read, 498.85 MB/s read, 28.8 seconds Interval compaction: 7.36 GB write, 817.69 MB/s write, 4.60 GB read, 511.18 MB/s read, 28.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 772196 Average: 2.2523 StdDev: 8.95 Min: 0 Median: 1.5179 Max: 2855 Percentiles: P50: 1.52 P75: 1.90 P99: 5.79 P99.9: 10.51 P99.99: 14.49 ------------------------------------------------------ [ 0, 1 ] 127812 16.552% 16.552% ### ( 1, 2 ] 498733 64.586% 81.138% ############# ( 2, 3 ] 76855 9.953% 91.091% ## ( 3, 4 ] 37611 4.871% 95.962% # ( 4, 6 ] 26256 3.400% 99.362% # ( 6, 10 ] 4069 0.527% 99.889% ( 10, 15 ] 873 0.113% 100.002% ( 15, 22 ] 84 0.011% 100.013% ( 22, 34 ] 13 0.002% 100.014% ( 34, 51 ] 5 0.001% 100.015% ( 51, 76 ] 8 0.001% 100.016% ( 76, 110 ] 1 0.000% 100.016% ( 110, 170 ] 14 0.002% 100.018% ( 170, 250 ] 18 0.002% 100.020% ( 250, 380 ] 14 0.002% 100.022% ( 380, 580 ] 10 0.001% 100.023% ( 580, 870 ] 12 0.002% 100.025% ( 870, 1300 ] 7 0.001% 100.026% ( 1300, 1900 ] 8 0.001% 100.027% ( 1900, 2900 ] 4 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 237195 Average: 2.9577 StdDev: 22.08 Min: 0 Median: 1.7348 Max: 4013 Percentiles: P50: 1.73 P75: 2.57 P99: 7.61 P99.9: 11.30 P99.99: 13.21 ------------------------------------------------------ [ 0, 1 ] 15180 6.400% 6.400% # ( 1, 2 ] 140737 59.334% 65.734% ############ ( 2, 3 ] 38772 16.346% 82.080% ### ( 3, 4 ] 20065 8.459% 90.539% ## ( 4, 6 ] 18726 7.895% 98.434% ## ( 6, 10 ] 3332 1.405% 99.839% ( 10, 15 ] 560 0.236% 100.075% ( 15, 22 ] 63 0.027% 100.101% ( 22, 34 ] 4 0.002% 100.103% ( 34, 51 ] 2 0.001% 100.104% ( 110, 170 ] 26 0.011% 100.115% ( 170, 250 ] 34 0.014% 100.129% ( 250, 380 ] 33 0.014% 100.143% ( 380, 580 ] 16 0.007% 100.150% ( 580, 870 ] 18 0.008% 100.157% ( 870, 1300 ] 5 0.002% 100.159% ( 1300, 1900 ] 2 0.001% 100.160% ( 1900, 2900 ] 5 0.002% 100.162% ( 2900, 4400 ] 5 0.002% 100.164% ** Level 2 read latency histogram (micros): Count: 95909 Average: 2.0244 StdDev: 8.08 Min: 1 Median: 1.3845 Max: 1591 Percentiles: P50: 1.38 P75: 1.80 P99: 5.57 P99.9: 9.95 P99.99: 30.45 ------------------------------------------------------ [ 0, 1 ] 25514 26.602% 26.602% ##### ( 1, 2 ] 58361 60.850% 87.453% ############ ( 2, 3 ] 6344 6.615% 94.067% # ( 3, 4 ] 3163 3.298% 97.365% # ( 4, 6 ] 1995 2.080% 99.445% ( 6, 10 ] 442 0.461% 99.906% ( 10, 15 ] 70 0.073% 99.979% ( 15, 22 ] 9 0.009% 99.989% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255521 Average: 3.6180 StdDev: 44.25 Min: 0 Median: 1.6200 Max: 5145 Percentiles: P50: 1.62 P75: 2.10 P99: 9.11 P99.9: 224.45 P99.99: 811.06 ------------------------------------------------------ [ 0, 1 ] 29303 11.468% 11.468% ## ( 1, 2 ] 158796 62.146% 73.614% ############ ( 2, 3 ] 35115 13.743% 87.356% ### ( 3, 4 ] 14981 5.863% 93.219% # ( 4, 6 ] 11375 4.452% 97.671% # ( 6, 10 ] 4367 1.709% 99.380% ( 10, 15 ] 680 0.266% 99.646% ( 15, 22 ] 127 0.050% 99.696% ( 22, 34 ] 31 0.012% 99.708% ( 34, 51 ] 10 0.004% 99.712% ( 51, 76 ] 3 0.001% 99.713% ( 76, 110 ] 170 0.067% 99.780% ( 110, 170 ] 219 0.086% 99.865% ( 170, 250 ] 130 0.051% 99.916% ( 250, 380 ] 87 0.034% 99.950% ( 380, 580 ] 64 0.025% 99.975% ( 580, 870 ] 47 0.018% 99.994% ( 870, 1300 ] 20 0.008% 100.002% ( 1300, 1900 ] 11 0.004% 100.006% ( 1900, 2900 ] 8 0.003% 100.009% ( 2900, 4400 ] 16 0.006% 100.015% ( 4400, 6600 ] 7 0.003% 100.018% ** Level 4 read latency histogram (micros): Count: 320 Average: 172.5938 StdDev: 649.52 Min: 0 Median: 1.6261 Max: 5367 Percentiles: P50: 1.63 P75: 7.09 P99: 3950.00 P99.9: 5367.00 P99.99: 5367.00 ------------------------------------------------------ [ 0, 1 ] 88 27.500% 27.500% ###### ( 1, 2 ] 115 35.938% 63.438% ####### ( 2, 3 ] 22 6.875% 70.312% # ( 3, 4 ] 4 1.250% 71.562% ( 4, 6 ] 2 0.625% 72.188% ( 6, 10 ] 33 10.312% 82.500% ## ( 10, 15 ] 21 6.562% 89.062% # ( 15, 22 ] 2 0.625% 89.688% ( 76, 110 ] 1 0.312% 90.000% ( 110, 170 ] 1 0.312% 90.312% ( 170, 250 ] 1 0.312% 90.625% ( 380, 580 ] 2 0.625% 91.250% ( 580, 870 ] 7 2.188% 93.438% ( 870, 1300 ] 5 1.562% 95.000% ( 1300, 1900 ] 7 2.188% 97.188% ( 1900, 2900 ] 3 0.938% 98.125% ( 2900, 4400 ] 4 1.250% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 863.4000 StdDev: 1085.03 Min: 79 Median: 305.7143 Max: 3781 Percentiles: P50: 305.71 P75: 1300.00 P99: 3781.00 P99.9: 3781.00 P99.99: 3781.00 ------------------------------------------------------ ( 76, 110 ] 12 20.000% 20.000% #### ( 110, 170 ] 13 21.667% 41.667% #### ( 170, 250 ] 2 3.333% 45.000% # ( 250, 380 ] 7 11.667% 56.667% ## ( 380, 580 ] 4 6.667% 63.333% # ( 580, 870 ] 4 6.667% 70.000% # ( 870, 1300 ] 3 5.000% 75.000% # ( 1300, 1900 ] 3 5.000% 80.000% # ( 1900, 2900 ] 6 10.000% 90.000% ## ( 2900, 4400 ] 6 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 9.5 total, 3.3 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 312.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.364 H:M:S, 14.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 294.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.692 H:M:S, 20.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-09:20:12 ... thread 0: (1000000,4000000) ops and (326714.1,325688.6) ops/second in (3.060780,12.281672) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.66 GB 144.7 2.0 0.0 2.0 5.7 3.8 0.0 1.5 107.4 312.0 18.77 17.28 60 0.313 2046K 2210 0.0 0.0 L1 7/0 630.75 MB 63.1 2.0 1.8 0.2 2.0 1.8 0.2 1.1 231.4 230.6 8.97 8.67 3 2.989 2106K 6868 0.0 0.0 L2 4/3 428.09 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.4 2.0 250.5 250.4 1.51 1.47 2 0.754 383K 198 0.0 0.0 L3 23/9 940.68 MB 0.4 1.9 0.7 1.2 1.9 0.7 0.4 2.6 219.5 219.1 8.96 8.09 6 1.494 1997K 3982 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 155.1 155.2 1.45 1.06 1 1.449 228K 0 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/16 99.88 GB 0.0 6.5 3.0 3.5 10.2 6.7 3.8 2.7 167.9 264.5 39.66 36.57 72 0.551 6763K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 3.0 3.5 10.2 6.7 3.7 2.7 167.9 264.5 39.66 36.57 72 0.551 6763K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 3.0 3.5 6.5 3.0 0.0 0.0 233.4 232.9 28.54 26.79 19 1.502 6763K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 345.6 11.12 9.78 53 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.24 GB write, 838.36 MB/s write, 6.50 GB read, 532.32 MB/s read, 39.7 seconds Interval compaction: 10.24 GB write, 853.91 MB/s write, 6.50 GB read, 542.19 MB/s read, 39.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1112136 Average: 2.2780 StdDev: 9.92 Min: 0 Median: 1.5201 Max: 3390 Percentiles: P50: 1.52 P75: 1.90 P99: 5.81 P99.9: 10.67 P99.99: 14.68 ------------------------------------------------------ [ 0, 1 ] 180222 16.205% 16.205% ### ( 1, 2 ] 722692 64.982% 81.187% ############# ( 2, 3 ] 110981 9.979% 91.166% ## ( 3, 4 ] 52957 4.762% 95.928% # ( 4, 6 ] 37758 3.395% 99.323% # ( 6, 10 ] 6249 0.562% 99.885% ( 10, 15 ] 1247 0.112% 99.997% ( 15, 22 ] 121 0.011% 100.008% ( 22, 34 ] 16 0.001% 100.010% ( 34, 51 ] 7 0.001% 100.010% ( 51, 76 ] 8 0.001% 100.011% ( 76, 110 ] 25 0.002% 100.013% ( 110, 170 ] 50 0.004% 100.018% ( 170, 250 ] 48 0.004% 100.022% ( 250, 380 ] 33 0.003% 100.025% ( 380, 580 ] 24 0.002% 100.027% ( 580, 870 ] 22 0.002% 100.029% ( 870, 1300 ] 13 0.001% 100.030% ( 1300, 1900 ] 9 0.001% 100.031% ( 1900, 2900 ] 5 0.000% 100.032% ( 2900, 4400 ] 2 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 338661 Average: 2.9131 StdDev: 20.22 Min: 0 Median: 1.7089 Max: 4013 Percentiles: P50: 1.71 P75: 2.47 P99: 7.63 P99.9: 12.41 P99.99: 14.49 ------------------------------------------------------ [ 0, 1 ] 24224 7.153% 7.153% # ( 1, 2 ] 204699 60.444% 67.597% ############ ( 2, 3 ] 53531 15.807% 83.403% ### ( 3, 4 ] 26612 7.858% 91.261% ## ( 4, 6 ] 24362 7.194% 98.455% # ( 6, 10 ] 4541 1.341% 99.796% ( 10, 15 ] 733 0.216% 100.012% ( 15, 22 ] 75 0.022% 100.034% ( 22, 34 ] 5 0.001% 100.036% ( 34, 51 ] 4 0.001% 100.037% ( 51, 76 ] 3 0.001% 100.038% ( 76, 110 ] 54 0.016% 100.054% ( 110, 170 ] 59 0.017% 100.071% ( 170, 250 ] 47 0.014% 100.085% ( 250, 380 ] 47 0.014% 100.099% ( 380, 580 ] 29 0.009% 100.107% ( 580, 870 ] 25 0.007% 100.115% ( 870, 1300 ] 8 0.002% 100.117% ( 1300, 1900 ] 3 0.001% 100.118% ( 1900, 2900 ] 7 0.002% 100.120% ( 2900, 4400 ] 5 0.001% 100.122% ** Level 2 read latency histogram (micros): Count: 95909 Average: 2.0244 StdDev: 8.08 Min: 1 Median: 1.3845 Max: 1591 Percentiles: P50: 1.38 P75: 1.80 P99: 5.57 P99.9: 9.95 P99.99: 30.45 ------------------------------------------------------ [ 0, 1 ] 25514 26.602% 26.602% ##### ( 1, 2 ] 58361 60.850% 87.453% ############ ( 2, 3 ] 6344 6.615% 94.067% # ( 3, 4 ] 3163 3.298% 97.365% # ( 4, 6 ] 1995 2.080% 99.445% ( 6, 10 ] 442 0.461% 99.906% ( 10, 15 ] 70 0.073% 99.979% ( 15, 22 ] 9 0.009% 99.989% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 323469 Average: 3.7210 StdDev: 41.23 Min: 0 Median: 1.6549 Max: 5145 Percentiles: P50: 1.65 P75: 2.27 P99: 9.20 P99.9: 242.68 P99.99: 727.37 ------------------------------------------------------ [ 0, 1 ] 32473 10.039% 10.039% ## ( 1, 2 ] 197389 61.023% 71.062% ############ ( 2, 3 ] 47477 14.677% 85.739% ### ( 3, 4 ] 21024 6.500% 92.239% # ( 4, 6 ] 17269 5.339% 97.577% # ( 6, 10 ] 5757 1.780% 99.357% ( 10, 15 ] 918 0.284% 99.641% ( 15, 22 ] 161 0.050% 99.691% ( 22, 34 ] 37 0.011% 99.702% ( 34, 51 ] 11 0.003% 99.705% ( 51, 76 ] 3 0.001% 99.706% ( 76, 110 ] 195 0.060% 99.767% ( 110, 170 ] 270 0.083% 99.850% ( 170, 250 ] 180 0.056% 99.906% ( 250, 380 ] 125 0.039% 99.944% ( 380, 580 ] 109 0.034% 99.978% ( 580, 870 ] 80 0.025% 100.003% ( 870, 1300 ] 35 0.011% 100.014% ( 1300, 1900 ] 12 0.004% 100.017% ( 1900, 2900 ] 8 0.002% 100.020% ( 2900, 4400 ] 16 0.005% 100.025% ( 4400, 6600 ] 7 0.002% 100.027% ** Level 4 read latency histogram (micros): Count: 320 Average: 172.5938 StdDev: 649.52 Min: 0 Median: 1.6261 Max: 5367 Percentiles: P50: 1.63 P75: 7.09 P99: 3950.00 P99.9: 5367.00 P99.99: 5367.00 ------------------------------------------------------ [ 0, 1 ] 88 27.500% 27.500% ###### ( 1, 2 ] 115 35.938% 63.438% ####### ( 2, 3 ] 22 6.875% 70.312% # ( 3, 4 ] 4 1.250% 71.562% ( 4, 6 ] 2 0.625% 72.188% ( 6, 10 ] 33 10.312% 82.500% ## ( 10, 15 ] 21 6.562% 89.062% # ( 15, 22 ] 2 0.625% 89.688% ( 76, 110 ] 1 0.312% 90.000% ( 110, 170 ] 1 0.312% 90.312% ( 170, 250 ] 1 0.312% 90.625% ( 380, 580 ] 2 0.625% 91.250% ( 580, 870 ] 7 2.188% 93.438% ( 870, 1300 ] 5 1.562% 95.000% ( 1300, 1900 ] 7 2.188% 97.188% ( 1900, 2900 ] 3 0.938% 98.125% ( 2900, 4400 ] 4 1.250% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 863.4000 StdDev: 1085.03 Min: 79 Median: 305.7143 Max: 3781 Percentiles: P50: 305.71 P75: 1300.00 P99: 3781.00 P99.9: 3781.00 P99.99: 3781.00 ------------------------------------------------------ ( 76, 110 ] 12 20.000% 20.000% #### ( 110, 170 ] 13 21.667% 41.667% #### ( 170, 250 ] 2 3.333% 45.000% # ( 250, 380 ] 7 11.667% 56.667% ## ( 380, 580 ] 4 6.667% 63.333% # ( 580, 870 ] 4 6.667% 70.000% # ( 870, 1300 ] 3 5.000% 75.000% # ( 1300, 1900 ] 3 5.000% 80.000% # ( 1900, 2900 ] 6 10.000% 90.000% ## ( 2900, 4400 ] 6 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 12.5 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 314.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.800 H:M:S, 14.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.436 H:M:S, 14.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-09:20:16 ... thread 0: (1000000,5000000) ops and (318914.6,324310.8) ops/second in (3.135636,15.417308) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.58 GB 62.9 2.7 0.0 2.7 7.4 4.7 0.0 1.6 113.3 309.0 24.46 22.55 76 0.322 2814K 2895 0.0 0.0 L1 7/7 630.75 MB 0.0 2.0 1.8 0.2 2.0 1.8 0.2 1.1 231.4 230.6 8.97 8.67 3 2.989 2106K 6868 0.0 0.0 L2 1/0 51.49 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.4 2.0 250.5 250.4 1.51 1.47 2 0.754 383K 198 0.0 0.0 L3 25/0 986.59 MB 1.0 2.8 1.1 1.7 2.8 1.1 0.4 2.5 216.4 215.8 13.19 12.02 9 1.466 2899K 7810 0.0 0.0 L4 175/0 9.47 GB 1.0 0.5 0.4 0.0 0.5 0.4 0.8 1.1 160.9 160.7 3.03 2.34 5 0.606 483K 295 0.0 0.0 L5 1060/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1283/19 100.79 GB 0.0 8.4 3.6 4.8 13.0 8.2 4.3 2.8 167.5 260.7 51.16 47.06 95 0.538 8687K 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.4 3.6 4.8 13.0 8.2 4.2 2.8 167.5 260.7 51.16 47.06 95 0.538 8687K 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.4 3.6 4.8 8.3 3.6 0.0 0.0 230.0 229.5 37.24 34.84 29 1.284 8687K 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 344.1 13.91 12.22 66 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.02 GB write, 852.27 MB/s write, 8.37 GB read, 547.50 MB/s read, 51.2 seconds Interval compaction: 13.02 GB write, 864.87 MB/s write, 8.37 GB read, 555.59 MB/s read, 51.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 25, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1426485 Average: 2.2814 StdDev: 10.48 Min: 0 Median: 1.5166 Max: 4052 Percentiles: P50: 1.52 P75: 1.90 P99: 5.83 P99.9: 11.19 P99.99: 14.99 ------------------------------------------------------ [ 0, 1 ] 233034 16.336% 16.336% ### ( 1, 2 ] 929556 65.164% 81.500% ############# ( 2, 3 ] 140414 9.843% 91.344% ## ( 3, 4 ] 65941 4.623% 95.966% # ( 4, 6 ] 47274 3.314% 99.280% # ( 6, 10 ] 8439 0.592% 99.872% ( 10, 15 ] 1689 0.118% 99.990% ( 15, 22 ] 158 0.011% 100.001% ( 22, 34 ] 17 0.001% 100.003% ( 34, 51 ] 9 0.001% 100.003% ( 51, 76 ] 8 0.001% 100.004% ( 76, 110 ] 69 0.005% 100.009% ( 110, 170 ] 77 0.005% 100.014% ( 170, 250 ] 67 0.005% 100.019% ( 250, 380 ] 52 0.004% 100.022% ( 380, 580 ] 31 0.002% 100.025% ( 580, 870 ] 29 0.002% 100.027% ( 870, 1300 ] 17 0.001% 100.028% ( 1300, 1900 ] 11 0.001% 100.029% ( 1900, 2900 ] 6 0.000% 100.029% ( 2900, 4400 ] 4 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 379042 Average: 2.9118 StdDev: 19.44 Min: 0 Median: 1.7095 Max: 4013 Percentiles: P50: 1.71 P75: 2.46 P99: 7.69 P99.9: 12.79 P99.99: 14.82 ------------------------------------------------------ [ 0, 1 ] 26558 7.007% 7.007% # ( 1, 2 ] 229695 60.599% 67.605% ############ ( 2, 3 ] 60339 15.919% 83.524% ### ( 3, 4 ] 29611 7.812% 91.336% ## ( 4, 6 ] 26899 7.097% 98.433% # ( 6, 10 ] 5091 1.343% 99.776% ( 10, 15 ] 841 0.222% 99.998% ( 15, 22 ] 94 0.025% 100.023% ( 22, 34 ] 6 0.002% 100.024% ( 34, 51 ] 4 0.001% 100.025% ( 51, 76 ] 3 0.001% 100.026% ( 76, 110 ] 62 0.016% 100.042% ( 110, 170 ] 75 0.020% 100.062% ( 170, 250 ] 56 0.015% 100.077% ( 250, 380 ] 56 0.015% 100.092% ( 380, 580 ] 36 0.009% 100.101% ( 580, 870 ] 28 0.007% 100.109% ( 870, 1300 ] 8 0.002% 100.111% ( 1300, 1900 ] 3 0.001% 100.112% ( 1900, 2900 ] 7 0.002% 100.113% ( 2900, 4400 ] 5 0.001% 100.115% ** Level 2 read latency histogram (micros): Count: 95909 Average: 2.0244 StdDev: 8.08 Min: 1 Median: 1.3845 Max: 1591 Percentiles: P50: 1.38 P75: 1.80 P99: 5.57 P99.9: 9.95 P99.99: 30.45 ------------------------------------------------------ [ 0, 1 ] 25514 26.602% 26.602% ##### ( 1, 2 ] 58361 60.850% 87.453% ############ ( 2, 3 ] 6344 6.615% 94.067% # ( 3, 4 ] 3163 3.298% 97.365% # ( 4, 6 ] 1995 2.080% 99.445% ( 6, 10 ] 442 0.461% 99.906% ( 10, 15 ] 70 0.073% 99.979% ( 15, 22 ] 9 0.009% 99.989% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 443825 Average: 3.5593 StdDev: 36.06 Min: 0 Median: 1.6938 Max: 5145 Percentiles: P50: 1.69 P75: 2.42 P99: 9.07 P99.9: 162.00 P99.99: 387.39 ------------------------------------------------------ [ 0, 1 ] 37834 8.525% 8.525% ## ( 1, 2 ] 265319 59.780% 68.305% ############ ( 2, 3 ] 70313 15.843% 84.147% ### ( 3, 4 ] 31692 7.141% 91.288% # ( 4, 6 ] 28056 6.321% 97.609% # ( 6, 10 ] 8040 1.812% 99.421% ( 10, 15 ] 1343 0.303% 99.723% ( 15, 22 ] 220 0.050% 99.773% ( 22, 34 ] 40 0.009% 99.782% ( 34, 51 ] 12 0.003% 99.785% ( 51, 76 ] 3 0.001% 99.785% ( 76, 110 ] 244 0.055% 99.840% ( 110, 170 ] 306 0.069% 99.909% ( 170, 250 ] 216 0.049% 99.958% ( 250, 380 ] 138 0.031% 99.989% ( 380, 580 ] 125 0.028% 100.017% ( 580, 870 ] 89 0.020% 100.037% ( 870, 1300 ] 37 0.008% 100.046% ( 1300, 1900 ] 13 0.003% 100.048% ( 1900, 2900 ] 10 0.002% 100.051% ( 2900, 4400 ] 16 0.004% 100.054% ( 4400, 6600 ] 7 0.002% 100.056% ** Level 4 read latency histogram (micros): Count: 8217 Average: 26.9269 StdDev: 163.50 Min: 0 Median: 1.9079 Max: 5367 Percentiles: P50: 1.91 P75: 3.24 P99: 549.18 P99.9: 2456.60 P99.99: 4596.13 ------------------------------------------------------ [ 0, 1 ] 496 6.036% 6.036% # ( 1, 2 ] 3979 48.424% 54.460% ########## ( 2, 3 ] 1493 18.170% 72.630% #### ( 3, 4 ] 810 9.858% 82.488% ## ( 4, 6 ] 601 7.314% 89.802% # ( 6, 10 ] 205 2.495% 92.296% ( 10, 15 ] 63 0.767% 93.063% ( 15, 22 ] 10 0.122% 93.185% ( 22, 34 ] 1 0.012% 93.197% ( 76, 110 ] 108 1.314% 94.511% ( 110, 170 ] 145 1.765% 96.276% ( 170, 250 ] 82 0.998% 97.274% ( 250, 380 ] 86 1.047% 98.321% ( 380, 580 ] 66 0.803% 99.124% ( 580, 870 ] 39 0.475% 99.598% ( 870, 1300 ] 13 0.158% 99.757% ( 1300, 1900 ] 9 0.110% 99.866% ( 1900, 2900 ] 5 0.061% 99.927% ( 2900, 4400 ] 5 0.061% 99.988% ( 4400, 6600 ] 2 0.024% 100.012% ** Level 5 read latency histogram (micros): Count: 80 Average: 843.2500 StdDev: 1053.91 Min: 79 Median: 302.0000 Max: 3781 Percentiles: P50: 302.00 P75: 1214.00 P99: 3781.00 P99.9: 3781.00 P99.99: 3781.00 ------------------------------------------------------ ( 76, 110 ] 16 20.000% 20.000% #### ( 110, 170 ] 15 18.750% 38.750% #### ( 170, 250 ] 5 6.250% 45.000% # ( 250, 380 ] 10 12.500% 57.500% ### ( 380, 580 ] 5 6.250% 63.750% # ( 580, 870 ] 5 6.250% 70.000% # ( 870, 1300 ] 5 6.250% 76.250% # ( 1300, 1900 ] 3 3.750% 80.000% # ( 1900, 2900 ] 9 11.250% 91.250% ## ( 2900, 4400 ] 7 8.750% 100.000% ## ** DB Stats ** Uptime(secs): 15.6 total, 3.1 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 314.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.278 H:M:S, 14.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 313.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.478 H:M:S, 15.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-09:20:19 ... thread 0: (1000000,6000000) ops and (254224.3,310064.0) ops/second in (3.933534,19.350842) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.56 GB 195.1 3.8 0.0 3.8 9.5 5.7 0.0 1.7 123.4 306.4 31.64 29.33 95 0.333 3965K 4178 0.0 0.0 L1 7/7 630.75 MB 0.0 2.0 1.8 0.2 2.0 1.8 0.2 1.1 231.4 230.6 8.97 8.67 3 2.989 2106K 6868 0.0 0.0 L2 1/0 51.49 MB 0.5 0.4 0.2 0.2 0.4 0.2 1.4 2.0 250.5 250.4 1.51 1.47 2 0.754 383K 198 0.0 0.0 L3 25/0 986.59 MB 1.0 2.8 1.1 1.7 2.8 1.1 0.4 2.5 216.4 215.8 13.19 12.02 9 1.466 2899K 7810 0.0 0.0 L4 175/0 9.47 GB 1.0 0.5 0.4 0.0 0.5 0.4 0.8 1.1 160.9 160.7 3.03 2.34 5 0.606 483K 295 0.0 0.0 L5 1060/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1286/15 101.78 GB 0.0 9.5 3.6 5.9 15.1 9.2 4.3 2.7 166.3 265.3 58.34 53.83 114 0.512 9839K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.5 3.6 5.9 15.1 9.2 4.2 2.7 166.3 265.3 58.34 53.83 114 0.512 9839K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.5 3.6 5.9 9.5 3.6 0.0 0.0 233.4 232.9 41.56 39.06 33 1.259 9839K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 345.4 16.78 14.77 81 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.6 total, 19.4 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.11 GB write, 790.38 MB/s write, 9.47 GB read, 495.43 MB/s read, 58.3 seconds Interval compaction: 15.11 GB write, 799.69 MB/s write, 9.47 GB read, 501.26 MB/s read, 58.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 27, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1865307 Average: 2.2674 StdDev: 10.82 Min: 0 Median: 1.5045 Max: 4052 Percentiles: P50: 1.50 P75: 1.89 P99: 5.82 P99.9: 11.02 P99.99: 16.84 ------------------------------------------------------ [ 0, 1 ] 314745 16.874% 16.874% ### ( 1, 2 ] 1224801 65.662% 82.536% ############# ( 2, 3 ] 175031 9.383% 91.919% ## ( 3, 4 ] 81334 4.360% 96.280% # ( 4, 6 ] 55631 2.982% 99.262% # ( 6, 10 ] 11484 0.616% 99.878% ( 10, 15 ] 2043 0.110% 99.987% ( 15, 22 ] 196 0.011% 99.998% ( 22, 34 ] 20 0.001% 99.999% ( 34, 51 ] 14 0.001% 100.000% ( 51, 76 ] 10 0.001% 100.000% ( 76, 110 ] 104 0.006% 100.006% ( 110, 170 ] 152 0.008% 100.014% ( 170, 250 ] 93 0.005% 100.019% ( 250, 380 ] 74 0.004% 100.023% ( 380, 580 ] 53 0.003% 100.026% ( 580, 870 ] 43 0.002% 100.028% ( 870, 1300 ] 23 0.001% 100.029% ( 1300, 1900 ] 14 0.001% 100.030% ( 1900, 2900 ] 8 0.000% 100.030% ( 2900, 4400 ] 6 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 450495 Average: 2.8680 StdDev: 18.40 Min: 0 Median: 1.6710 Max: 4013 Percentiles: P50: 1.67 P75: 2.32 P99: 7.81 P99.9: 13.68 P99.99: 94.56 ------------------------------------------------------ [ 0, 1 ] 38565 8.561% 8.561% ## ( 1, 2 ] 278202 61.755% 70.315% ############ ( 2, 3 ] 66167 14.688% 85.003% ### ( 3, 4 ] 31860 7.072% 92.075% # ( 4, 6 ] 28399 6.304% 98.379% # ( 6, 10 ] 6171 1.370% 99.749% ( 10, 15 ] 924 0.205% 99.954% ( 15, 22 ] 102 0.023% 99.977% ( 22, 34 ] 6 0.001% 99.978% ( 34, 51 ] 4 0.001% 99.979% ( 51, 76 ] 3 0.001% 99.980% ( 76, 110 ] 86 0.019% 99.999% ( 110, 170 ] 186 0.041% 100.040% ( 170, 250 ] 79 0.018% 100.057% ( 250, 380 ] 73 0.016% 100.074% ( 380, 580 ] 48 0.011% 100.084% ( 580, 870 ] 31 0.007% 100.091% ( 870, 1300 ] 9 0.002% 100.093% ( 1300, 1900 ] 3 0.001% 100.094% ( 1900, 2900 ] 7 0.002% 100.095% ( 2900, 4400 ] 5 0.001% 100.097% ** Level 2 read latency histogram (micros): Count: 95909 Average: 2.0244 StdDev: 8.08 Min: 1 Median: 1.3845 Max: 1591 Percentiles: P50: 1.38 P75: 1.80 P99: 5.57 P99.9: 9.95 P99.99: 30.45 ------------------------------------------------------ [ 0, 1 ] 25514 26.602% 26.602% ##### ( 1, 2 ] 58361 60.850% 87.453% ############ ( 2, 3 ] 6344 6.615% 94.067% # ( 3, 4 ] 3163 3.298% 97.365% # ( 4, 6 ] 1995 2.080% 99.445% ( 6, 10 ] 442 0.461% 99.906% ( 10, 15 ] 70 0.073% 99.979% ( 15, 22 ] 9 0.009% 99.989% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 443825 Average: 3.5593 StdDev: 36.06 Min: 0 Median: 1.6938 Max: 5145 Percentiles: P50: 1.69 P75: 2.42 P99: 9.07 P99.9: 162.00 P99.99: 387.39 ------------------------------------------------------ [ 0, 1 ] 37834 8.525% 8.525% ## ( 1, 2 ] 265319 59.780% 68.305% ############ ( 2, 3 ] 70313 15.843% 84.147% ### ( 3, 4 ] 31692 7.141% 91.288% # ( 4, 6 ] 28056 6.321% 97.609% # ( 6, 10 ] 8040 1.812% 99.421% ( 10, 15 ] 1343 0.303% 99.723% ( 15, 22 ] 220 0.050% 99.773% ( 22, 34 ] 40 0.009% 99.782% ( 34, 51 ] 12 0.003% 99.785% ( 51, 76 ] 3 0.001% 99.785% ( 76, 110 ] 244 0.055% 99.840% ( 110, 170 ] 306 0.069% 99.909% ( 170, 250 ] 216 0.049% 99.958% ( 250, 380 ] 138 0.031% 99.989% ( 380, 580 ] 125 0.028% 100.017% ( 580, 870 ] 89 0.020% 100.037% ( 870, 1300 ] 37 0.008% 100.046% ( 1300, 1900 ] 13 0.003% 100.048% ( 1900, 2900 ] 10 0.002% 100.051% ( 2900, 4400 ] 16 0.004% 100.054% ( 4400, 6600 ] 7 0.002% 100.056% ** Level 4 read latency histogram (micros): Count: 8217 Average: 26.9269 StdDev: 163.50 Min: 0 Median: 1.9079 Max: 5367 Percentiles: P50: 1.91 P75: 3.24 P99: 549.18 P99.9: 2456.60 P99.99: 4596.13 ------------------------------------------------------ [ 0, 1 ] 496 6.036% 6.036% # ( 1, 2 ] 3979 48.424% 54.460% ########## ( 2, 3 ] 1493 18.170% 72.630% #### ( 3, 4 ] 810 9.858% 82.488% ## ( 4, 6 ] 601 7.314% 89.802% # ( 6, 10 ] 205 2.495% 92.296% ( 10, 15 ] 63 0.767% 93.063% ( 15, 22 ] 10 0.122% 93.185% ( 22, 34 ] 1 0.012% 93.197% ( 76, 110 ] 108 1.314% 94.511% ( 110, 170 ] 145 1.765% 96.276% ( 170, 250 ] 82 0.998% 97.274% ( 250, 380 ] 86 1.047% 98.321% ( 380, 580 ] 66 0.803% 99.124% ( 580, 870 ] 39 0.475% 99.598% ( 870, 1300 ] 13 0.158% 99.757% ( 1300, 1900 ] 9 0.110% 99.866% ( 1900, 2900 ] 5 0.061% 99.927% ( 2900, 4400 ] 5 0.061% 99.988% ( 4400, 6600 ] 2 0.024% 100.012% ** Level 5 read latency histogram (micros): Count: 80 Average: 843.2500 StdDev: 1053.91 Min: 79 Median: 302.0000 Max: 3781 Percentiles: P50: 302.00 P75: 1214.00 P99: 3781.00 P99.9: 3781.00 P99.99: 3781.00 ------------------------------------------------------ ( 76, 110 ] 16 20.000% 20.000% #### ( 110, 170 ] 15 18.750% 38.750% #### ( 170, 250 ] 5 6.250% 45.000% # ( 250, 380 ] 10 12.500% 57.500% ### ( 380, 580 ] 5 6.250% 63.750% # ( 580, 870 ] 5 6.250% 70.000% # ( 870, 1300 ] 5 6.250% 76.250% # ( 1300, 1900 ] 3 3.750% 80.000% # ( 1900, 2900 ] 9 11.250% 91.250% ## ( 2900, 4400 ] 7 8.750% 100.000% ## ** DB Stats ** Uptime(secs): 19.6 total, 3.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 301.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.496 H:M:S, 17.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 250.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.218 H:M:S, 31.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-09:20:26 ... thread 0: (1000000,7000000) ops and (164005.4,275068.5) ops/second in (6.097360,25.448202) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/5 2.83 GB 182.5 4.6 0.0 4.6 11.1 6.6 0.0 1.7 120.9 295.6 38.55 34.73 111 0.347 4733K 4951 0.0 0.0 L1 9/0 1.04 GB 107.0 4.3 3.5 0.8 4.3 3.5 0.2 1.2 229.8 228.1 19.17 18.48 4 4.792 4472K 30K 0.0 0.0 L2 5/5 633.57 MB 0.0 0.4 0.2 0.2 0.4 0.2 2.6 2.0 250.5 250.4 1.51 1.47 2 0.754 383K 198 0.0 0.0 L3 37/17 1.60 GB 0.7 4.1 1.7 2.3 4.1 1.7 0.4 2.3 190.3 189.6 21.87 18.17 15 1.458 4227K 14K 0.0 0.0 L4 175/0 9.47 GB 1.0 0.5 0.4 0.0 0.5 0.4 0.8 1.1 160.9 160.7 3.03 2.34 5 0.606 483K 295 0.0 0.0 L5 1060/0 87.11 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1300/27 102.67 GB 0.0 13.8 5.9 7.9 20.3 12.4 5.5 3.1 167.5 247.0 84.14 75.18 137 0.614 14M 50K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.8 5.9 7.9 20.3 12.4 5.4 3.1 167.5 247.0 84.14 75.18 137 0.614 14M 50K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.8 5.9 7.9 13.7 5.8 0.0 0.0 222.1 221.3 63.46 57.84 43 1.476 14M 50K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 326.0 20.68 17.35 94 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.7 total, 25.5 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.30 GB write, 809.38 MB/s write, 13.76 GB read, 548.89 MB/s read, 84.1 seconds Interval compaction: 20.30 GB write, 816.62 MB/s write, 13.76 GB read, 553.80 MB/s read, 84.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 34, interval: 46 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2382264 Average: 2.3554 StdDev: 13.98 Min: 0 Median: 1.5183 Max: 7187 Percentiles: P50: 1.52 P75: 1.90 P99: 5.94 P99.9: 12.04 P99.99: 88.89 ------------------------------------------------------ [ 0, 1 ] 390439 16.389% 16.389% ### ( 1, 2 ] 1544859 64.848% 81.238% ############# ( 2, 3 ] 230157 9.661% 90.899% ## ( 3, 4 ] 112129 4.707% 95.606% # ( 4, 6 ] 83399 3.501% 99.107% # ( 6, 10 ] 17711 0.743% 99.850% ( 10, 15 ] 2911 0.122% 99.972% ( 15, 22 ] 285 0.012% 99.984% ( 22, 34 ] 23 0.001% 99.985% ( 34, 51 ] 17 0.001% 99.986% ( 51, 76 ] 13 0.001% 99.987% ( 76, 110 ] 221 0.009% 99.996% ( 110, 170 ] 237 0.010% 100.006% ( 170, 250 ] 145 0.006% 100.012% ( 250, 380 ] 111 0.005% 100.016% ( 380, 580 ] 114 0.005% 100.021% ( 580, 870 ] 82 0.003% 100.025% ( 870, 1300 ] 43 0.002% 100.027% ( 1300, 1900 ] 24 0.001% 100.028% ( 1900, 2900 ] 11 0.000% 100.028% ( 2900, 4400 ] 9 0.000% 100.028% ( 6600, 9900 ] 2 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 837640 Average: 3.7356 StdDev: 46.59 Min: 0 Median: 1.7232 Max: 7262 Percentiles: P50: 1.72 P75: 2.55 P99: 8.69 P99.9: 15.95 P99.99: 157.41 ------------------------------------------------------ [ 0, 1 ] 63585 7.591% 7.591% ## ( 1, 2 ] 491206 58.642% 66.233% ############ ( 2, 3 ] 134000 15.997% 82.230% ### ( 3, 4 ] 65778 7.853% 90.083% ## ( 4, 6 ] 64623 7.715% 97.798% ## ( 6, 10 ] 14980 1.788% 99.586% ( 10, 15 ] 2594 0.310% 99.896% ( 15, 22 ] 282 0.034% 99.929% ( 22, 34 ] 17 0.002% 99.931% ( 34, 51 ] 11 0.001% 99.933% ( 51, 76 ] 12 0.001% 99.934% ( 76, 110 ] 234 0.028% 99.962% ( 110, 170 ] 299 0.036% 99.998% ( 170, 250 ] 163 0.019% 100.017% ( 250, 380 ] 183 0.022% 100.039% ( 380, 580 ] 188 0.022% 100.061% ( 580, 870 ] 156 0.019% 100.080% ( 870, 1300 ] 112 0.013% 100.093% ( 1300, 1900 ] 46 0.005% 100.099% ( 1900, 2900 ] 54 0.006% 100.105% ( 2900, 4400 ] 50 0.006% 100.111% ( 4400, 6600 ] 8 0.001% 100.112% ( 6600, 9900 ] 5 0.001% 100.113% ** Level 2 read latency histogram (micros): Count: 95909 Average: 2.0244 StdDev: 8.08 Min: 1 Median: 1.3845 Max: 1591 Percentiles: P50: 1.38 P75: 1.80 P99: 5.57 P99.9: 9.95 P99.99: 30.45 ------------------------------------------------------ [ 0, 1 ] 25514 26.602% 26.602% ##### ( 1, 2 ] 58361 60.850% 87.453% ############ ( 2, 3 ] 6344 6.615% 94.067% # ( 3, 4 ] 3163 3.298% 97.365% # ( 4, 6 ] 1995 2.080% 99.445% ( 6, 10 ] 442 0.461% 99.906% ( 10, 15 ] 70 0.073% 99.979% ( 15, 22 ] 9 0.009% 99.989% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 753023 Average: 4.6526 StdDev: 57.85 Min: 0 Median: 1.7772 Max: 7260 Percentiles: P50: 1.78 P75: 2.70 P99: 9.38 P99.9: 231.30 P99.99: 514.83 ------------------------------------------------------ [ 0, 1 ] 46075 6.119% 6.119% # ( 1, 2 ] 425179 56.463% 62.582% ########### ( 2, 3 ] 133633 17.746% 80.328% #### ( 3, 4 ] 63867 8.481% 88.809% ## ( 4, 6 ] 63600 8.446% 97.255% ## ( 6, 10 ] 15553 2.065% 99.321% ( 10, 15 ] 2926 0.389% 99.709% ( 15, 22 ] 433 0.058% 99.767% ( 22, 34 ] 63 0.008% 99.775% ( 34, 51 ] 18 0.002% 99.777% ( 51, 76 ] 6 0.001% 99.778% ( 76, 110 ] 256 0.034% 99.812% ( 110, 170 ] 379 0.050% 99.863% ( 170, 250 ] 368 0.049% 99.911% ( 250, 380 ] 318 0.042% 99.954% ( 380, 580 ] 406 0.054% 100.008% ( 580, 870 ] 312 0.041% 100.049% ( 870, 1300 ] 150 0.020% 100.069% ( 1300, 1900 ] 66 0.009% 100.078% ( 1900, 2900 ] 66 0.009% 100.086% ( 2900, 4400 ] 80 0.011% 100.097% ( 4400, 6600 ] 18 0.002% 100.099% ( 6600, 9900 ] 1 0.000% 100.100% ** Level 4 read latency histogram (micros): Count: 8217 Average: 26.9269 StdDev: 163.50 Min: 0 Median: 1.9079 Max: 5367 Percentiles: P50: 1.91 P75: 3.24 P99: 549.18 P99.9: 2456.60 P99.99: 4596.13 ------------------------------------------------------ [ 0, 1 ] 496 6.036% 6.036% # ( 1, 2 ] 3979 48.424% 54.460% ########## ( 2, 3 ] 1493 18.170% 72.630% #### ( 3, 4 ] 810 9.858% 82.488% ## ( 4, 6 ] 601 7.314% 89.802% # ( 6, 10 ] 205 2.495% 92.296% ( 10, 15 ] 63 0.767% 93.063% ( 15, 22 ] 10 0.122% 93.185% ( 22, 34 ] 1 0.012% 93.197% ( 76, 110 ] 108 1.314% 94.511% ( 110, 170 ] 145 1.765% 96.276% ( 170, 250 ] 82 0.998% 97.274% ( 250, 380 ] 86 1.047% 98.321% ( 380, 580 ] 66 0.803% 99.124% ( 580, 870 ] 39 0.475% 99.598% ( 870, 1300 ] 13 0.158% 99.757% ( 1300, 1900 ] 9 0.110% 99.866% ( 1900, 2900 ] 5 0.061% 99.927% ( 2900, 4400 ] 5 0.061% 99.988% ( 4400, 6600 ] 2 0.024% 100.012% ** Level 5 read latency histogram (micros): Count: 80 Average: 843.2500 StdDev: 1053.91 Min: 79 Median: 302.0000 Max: 3781 Percentiles: P50: 302.00 P75: 1214.00 P99: 3781.00 P99.9: 3781.00 P99.99: 3781.00 ------------------------------------------------------ ( 76, 110 ] 16 20.000% 20.000% #### ( 110, 170 ] 15 18.750% 38.750% #### ( 170, 250 ] 5 6.250% 45.000% # ( 250, 380 ] 10 12.500% 57.500% ### ( 380, 580 ] 5 6.250% 63.750% # ( 580, 870 ] 5 6.250% 70.000% # ( 870, 1300 ] 5 6.250% 76.250% # ( 1300, 1900 ] 3 3.750% 80.000% # ( 1900, 2900 ] 9 11.250% 91.250% ## ( 2900, 4400 ] 7 8.750% 100.000% ## ** DB Stats ** Uptime(secs): 25.7 total, 6.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 268.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.632 H:M:S, 25.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 161.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.135 H:M:S, 51.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/20-09:20:30 ... thread 0: (1000000,8000000) ops and (246635.0,271160.9) ops/second in (4.054575,29.502777) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 3.81 GB 44.1 6.2 0.0 6.2 13.8 7.6 0.0 1.8 128.4 284.6 49.54 44.05 127 0.390 6459K 10K 0.0 0.0 L1 9/9 1.04 GB 0.0 4.3 3.5 0.8 4.3 3.5 0.2 1.2 229.8 228.1 19.17 18.48 4 4.792 4472K 30K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.6 2.0 250.5 250.4 1.51 1.47 2 0.754 383K 198 0.0 0.0 L3 25/0 995.99 MB 1.0 5.6 2.4 3.2 5.6 2.3 0.4 2.4 185.6 184.8 30.77 25.21 20 1.539 5800K 23K 0.0 0.0 L4 185/0 9.72 GB 1.0 1.8 1.7 0.1 1.8 1.7 0.8 1.1 139.0 138.7 13.24 8.53 28 0.473 1798K 1407 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1308/23 103.64 GB 0.0 18.3 7.7 10.5 25.8 15.2 6.5 3.4 163.7 230.9 114.23 97.73 181 0.631 18M 66K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.3 7.7 10.5 25.8 15.2 6.3 3.4 163.7 230.9 114.23 97.73 181 0.631 18M 66K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.3 7.7 10.5 18.2 7.7 0.0 0.0 208.3 207.5 89.76 77.75 74 1.213 18M 66K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 316.7 24.47 19.98 107 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.7 total, 29.5 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.76 GB write, 887.07 MB/s write, 18.26 GB read, 628.80 MB/s read, 114.2 seconds Interval compaction: 25.76 GB write, 893.93 MB/s write, 18.26 GB read, 633.66 MB/s read, 114.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 56, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2727105 Average: 2.4434 StdDev: 17.10 Min: 0 Median: 1.5269 Max: 7187 Percentiles: P50: 1.53 P75: 1.92 P99: 6.00 P99.9: 12.87 P99.99: 144.98 ------------------------------------------------------ [ 0, 1 ] 440270 16.144% 16.144% ### ( 1, 2 ] 1752285 64.254% 80.399% ############# ( 2, 3 ] 270343 9.913% 90.312% ## ( 3, 4 ] 133155 4.883% 95.194% # ( 4, 6 ] 103984 3.813% 99.007% # ( 6, 10 ] 22289 0.817% 99.825% ( 10, 15 ] 3575 0.131% 99.956% ( 15, 22 ] 359 0.013% 99.969% ( 22, 34 ] 30 0.001% 99.970% ( 34, 51 ] 18 0.001% 99.971% ( 51, 76 ] 15 0.001% 99.971% ( 76, 110 ] 301 0.011% 99.982% ( 110, 170 ] 359 0.013% 99.996% ( 170, 250 ] 233 0.009% 100.004% ( 250, 380 ] 202 0.007% 100.011% ( 380, 580 ] 186 0.007% 100.018% ( 580, 870 ] 125 0.005% 100.023% ( 870, 1300 ] 63 0.002% 100.025% ( 1300, 1900 ] 28 0.001% 100.026% ( 1900, 2900 ] 15 0.001% 100.027% ( 2900, 4400 ] 23 0.001% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ( 6600, 9900 ] 2 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 865404 Average: 3.7767 StdDev: 48.10 Min: 0 Median: 1.7299 Max: 8019 Percentiles: P50: 1.73 P75: 2.57 P99: 8.76 P99.9: 17.13 P99.99: 162.40 ------------------------------------------------------ [ 0, 1 ] 64267 7.426% 7.426% # ( 1, 2 ] 504745 58.325% 65.751% ############ ( 2, 3 ] 139999 16.177% 81.928% ### ( 3, 4 ] 68785 7.948% 89.877% ## ( 4, 6 ] 68067 7.865% 97.742% ## ( 6, 10 ] 15780 1.823% 99.565% ( 10, 15 ] 2805 0.324% 99.890% ( 15, 22 ] 301 0.035% 99.924% ( 22, 34 ] 17 0.002% 99.926% ( 34, 51 ] 11 0.001% 99.928% ( 51, 76 ] 12 0.001% 99.929% ( 76, 110 ] 250 0.029% 99.958% ( 110, 170 ] 320 0.037% 99.995% ( 170, 250 ] 177 0.020% 100.015% ( 250, 380 ] 187 0.022% 100.037% ( 380, 580 ] 196 0.023% 100.060% ( 580, 870 ] 161 0.019% 100.078% ( 870, 1300 ] 113 0.013% 100.091% ( 1300, 1900 ] 47 0.005% 100.097% ( 1900, 2900 ] 55 0.006% 100.103% ( 2900, 4400 ] 55 0.006% 100.109% ( 4400, 6600 ] 9 0.001% 100.110% ( 6600, 9900 ] 6 0.001% 100.111% ** Level 2 read latency histogram (micros): Count: 95909 Average: 2.0244 StdDev: 8.08 Min: 1 Median: 1.3845 Max: 1591 Percentiles: P50: 1.38 P75: 1.80 P99: 5.57 P99.9: 9.95 P99.99: 30.45 ------------------------------------------------------ [ 0, 1 ] 25514 26.602% 26.602% ##### ( 1, 2 ] 58361 60.850% 87.453% ############ ( 2, 3 ] 6344 6.615% 94.067% # ( 3, 4 ] 3163 3.298% 97.365% # ( 4, 6 ] 1995 2.080% 99.445% ( 6, 10 ] 442 0.461% 99.906% ( 10, 15 ] 70 0.073% 99.979% ( 15, 22 ] 9 0.009% 99.989% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1159414 Average: 4.4378 StdDev: 59.51 Min: 0 Median: 1.8393 Max: 7699 Percentiles: P50: 1.84 P75: 2.85 P99: 8.96 P99.9: 19.96 P99.99: 193.74 ------------------------------------------------------ [ 0, 1 ] 55645 4.799% 4.799% # ( 1, 2 ] 624383 53.853% 58.653% ########### ( 2, 3 ] 222773 19.214% 77.867% #### ( 3, 4 ] 111030 9.576% 87.443% ## ( 4, 6 ] 116867 10.080% 97.523% ## ( 6, 10 ] 23101 1.992% 99.516% ( 10, 15 ] 4074 0.351% 99.867% ( 15, 22 ] 538 0.046% 99.913% ( 22, 34 ] 69 0.006% 99.919% ( 34, 51 ] 21 0.002% 99.921% ( 51, 76 ] 11 0.001% 99.922% ( 76, 110 ] 263 0.023% 99.945% ( 110, 170 ] 402 0.035% 99.980% ( 170, 250 ] 408 0.035% 100.015% ( 250, 380 ] 339 0.029% 100.044% ( 380, 580 ] 433 0.037% 100.081% ( 580, 870 ] 337 0.029% 100.110% ( 870, 1300 ] 171 0.015% 100.125% ( 1300, 1900 ] 78 0.007% 100.132% ( 1900, 2900 ] 81 0.007% 100.139% ( 2900, 4400 ] 130 0.011% 100.150% ( 4400, 6600 ] 30 0.003% 100.153% ( 6600, 9900 ] 6 0.001% 100.153% ** Level 4 read latency histogram (micros): Count: 31269 Average: 64.4072 StdDev: 368.07 Min: 0 Median: 1.9488 Max: 11541 Percentiles: P50: 1.95 P75: 3.32 P99: 1603.35 P99.9: 4697.38 P99.99: 6466.31 ------------------------------------------------------ [ 0, 1 ] 1655 5.293% 5.293% # ( 1, 2 ] 14734 47.120% 52.413% ######### ( 2, 3 ] 5937 18.987% 71.400% #### ( 3, 4 ] 3477 11.120% 82.519% ## ( 4, 6 ] 2489 7.960% 90.479% ## ( 6, 10 ] 663 2.120% 92.600% ( 10, 15 ] 216 0.691% 93.290% ( 15, 22 ] 16 0.051% 93.342% ( 22, 34 ] 1 0.003% 93.345% ( 34, 51 ] 1 0.003% 93.348% ( 76, 110 ] 116 0.371% 93.719% ( 110, 170 ] 194 0.620% 94.339% ( 170, 250 ] 187 0.598% 94.937% ( 250, 380 ] 260 0.831% 95.769% ( 380, 580 ] 306 0.979% 96.748% ( 580, 870 ] 354 1.132% 97.880% ( 870, 1300 ] 277 0.886% 98.766% ( 1300, 1900 ] 145 0.464% 99.229% ( 1900, 2900 ] 102 0.326% 99.555% ( 2900, 4400 ] 103 0.329% 99.885% ( 4400, 6600 ] 35 0.112% 99.997% ( 6600, 9900 ] 5 0.016% 100.013% ( 9900, 14000 ] 2 0.006% 100.019% ** Level 5 read latency histogram (micros): Count: 140 Average: 905.5857 StdDev: 1066.26 Min: 79 Median: 380.0000 Max: 3781 Percentiles: P50: 380.00 P75: 1375.00 P99: 3781.00 P99.9: 3781.00 P99.99: 3781.00 ------------------------------------------------------ ( 76, 110 ] 21 15.000% 15.000% ### ( 110, 170 ] 21 15.000% 30.000% ### ( 170, 250 ] 12 8.571% 38.571% ## ( 250, 380 ] 16 11.429% 50.000% ## ( 380, 580 ] 16 11.429% 61.429% ## ( 580, 870 ] 10 7.143% 68.571% # ( 870, 1300 ] 8 5.714% 74.286% # ( 1300, 1900 ] 8 5.714% 80.000% # ( 1900, 2900 ] 14 10.000% 90.000% ## ( 2900, 4400 ] 14 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 29.7 total, 4.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 264.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.815 H:M:S, 26.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 242.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.183 H:M:S, 29.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-09:20:47 ... thread 0: (1000000,9000000) ops and (58148.5,192719.0) ops/second in (17.197338,46.700115) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 4.85 GB 182.1 8.5 0.0 8.5 17.1 8.6 0.0 2.0 142.0 284.8 61.65 55.51 150 0.411 8889K 16K 0.0 0.0 L1 9/9 1.04 GB 0.0 4.3 3.5 0.8 4.3 3.5 0.2 1.2 229.8 228.1 19.17 18.48 4 4.792 4472K 30K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 2.6 2.0 250.5 250.4 1.51 1.47 2 0.754 383K 198 0.0 0.0 L3 25/0 995.99 MB 1.0 5.6 2.4 3.2 5.6 2.3 0.4 2.4 185.6 184.8 30.77 25.21 20 1.539 5800K 23K 0.0 0.0 L4 185/0 9.72 GB 1.0 1.8 1.7 0.1 1.8 1.7 0.8 1.1 139.0 138.7 13.24 8.53 28 0.473 1798K 1407 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1306/19 104.68 GB 0.0 20.6 7.7 12.9 29.1 16.3 6.5 3.4 166.9 236.1 126.34 109.19 204 0.619 21M 72K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.6 7.7 12.9 29.1 16.3 6.3 3.4 166.9 236.1 126.34 109.19 204 0.619 21M 72K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.6 7.7 12.9 20.5 7.7 0.0 0.0 213.4 212.7 98.81 86.49 80 1.235 21M 72K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 320.4 27.52 22.70 124 0.222 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.9 total, 46.7 interval Flush(GB): cumulative 8.613, interval 8.613 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.13 GB write, 635.69 MB/s write, 20.59 GB read, 449.37 MB/s read, 126.3 seconds Interval compaction: 29.13 GB write, 638.79 MB/s write, 20.59 GB read, 451.56 MB/s read, 126.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 56, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 56, interval: 83 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3986083 Average: 2.6211 StdDev: 17.06 Min: 0 Median: 1.5015 Max: 7187 Percentiles: P50: 1.50 P75: 1.89 P99: 6.95 P99.9: 118.62 P99.99: 245.04 ------------------------------------------------------ [ 0, 1 ] 693453 17.397% 17.397% ### ( 1, 2 ] 2591244 65.007% 82.404% ############# ( 2, 3 ] 360781 9.051% 91.455% ## ( 3, 4 ] 168648 4.231% 95.686% # ( 4, 6 ] 124179 3.115% 98.801% # ( 6, 10 ] 33427 0.839% 99.640% ( 10, 15 ] 4928 0.124% 99.764% ( 15, 22 ] 620 0.016% 99.779% ( 22, 34 ] 40 0.001% 99.780% ( 34, 51 ] 20 0.001% 99.781% ( 51, 76 ] 58 0.001% 99.782% ( 76, 110 ] 4213 0.106% 99.888% ( 110, 170 ] 3383 0.085% 99.973% ( 170, 250 ] 736 0.018% 99.991% ( 250, 380 ] 606 0.015% 100.006% ( 380, 580 ] 459 0.012% 100.018% ( 580, 870 ] 198 0.005% 100.023% ( 870, 1300 ] 75 0.002% 100.025% ( 1300, 1900 ] 30 0.001% 100.025% ( 1900, 2900 ] 25 0.001% 100.026% ( 2900, 4400 ] 27 0.001% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ( 6600, 9900 ] 2 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1129375 Average: 3.5228 StdDev: 42.77 Min: 0 Median: 1.6278 Max: 8019 Percentiles: P50: 1.63 P75: 2.25 P99: 8.88 P99.9: 108.67 P99.99: 188.89 ------------------------------------------------------ [ 0, 1 ] 150645 13.339% 13.339% ### ( 1, 2 ] 659545 58.399% 71.738% ############ ( 2, 3 ] 149565 13.243% 84.981% ### ( 3, 4 ] 73451 6.504% 91.485% # ( 4, 6 ] 71042 6.290% 97.775% # ( 6, 10 ] 19194 1.700% 99.475% ( 10, 15 ] 3097 0.274% 99.749% ( 15, 22 ] 453 0.040% 99.789% ( 22, 34 ] 23 0.002% 99.791% ( 34, 51 ] 12 0.001% 99.792% ( 51, 76 ] 34 0.003% 99.795% ( 76, 110 ] 1233 0.109% 99.904% ( 110, 170 ] 914 0.081% 99.985% ( 170, 250 ] 229 0.020% 100.005% ( 250, 380 ] 219 0.019% 100.025% ( 380, 580 ] 218 0.019% 100.044% ( 580, 870 ] 169 0.015% 100.059% ( 870, 1300 ] 115 0.010% 100.069% ( 1300, 1900 ] 49 0.004% 100.074% ( 1900, 2900 ] 56 0.005% 100.079% ( 2900, 4400 ] 57 0.005% 100.084% ( 4400, 6600 ] 9 0.001% 100.084% ( 6600, 9900 ] 6 0.001% 100.085% ** Level 2 read latency histogram (micros): Count: 95909 Average: 2.0244 StdDev: 8.08 Min: 1 Median: 1.3845 Max: 1591 Percentiles: P50: 1.38 P75: 1.80 P99: 5.57 P99.9: 9.95 P99.99: 30.45 ------------------------------------------------------ [ 0, 1 ] 25514 26.602% 26.602% ##### ( 1, 2 ] 58361 60.850% 87.453% ############ ( 2, 3 ] 6344 6.615% 94.067% # ( 3, 4 ] 3163 3.298% 97.365% # ( 4, 6 ] 1995 2.080% 99.445% ( 6, 10 ] 442 0.461% 99.906% ( 10, 15 ] 70 0.073% 99.979% ( 15, 22 ] 9 0.009% 99.989% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1159414 Average: 4.4378 StdDev: 59.51 Min: 0 Median: 1.8393 Max: 7699 Percentiles: P50: 1.84 P75: 2.85 P99: 8.96 P99.9: 19.96 P99.99: 193.74 ------------------------------------------------------ [ 0, 1 ] 55645 4.799% 4.799% # ( 1, 2 ] 624383 53.853% 58.653% ########### ( 2, 3 ] 222773 19.214% 77.867% #### ( 3, 4 ] 111030 9.576% 87.443% ## ( 4, 6 ] 116867 10.080% 97.523% ## ( 6, 10 ] 23101 1.992% 99.516% ( 10, 15 ] 4074 0.351% 99.867% ( 15, 22 ] 538 0.046% 99.913% ( 22, 34 ] 69 0.006% 99.919% ( 34, 51 ] 21 0.002% 99.921% ( 51, 76 ] 11 0.001% 99.922% ( 76, 110 ] 263 0.023% 99.945% ( 110, 170 ] 402 0.035% 99.980% ( 170, 250 ] 408 0.035% 100.015% ( 250, 380 ] 339 0.029% 100.044% ( 380, 580 ] 433 0.037% 100.081% ( 580, 870 ] 337 0.029% 100.110% ( 870, 1300 ] 171 0.015% 100.125% ( 1300, 1900 ] 78 0.007% 100.132% ( 1900, 2900 ] 81 0.007% 100.139% ( 2900, 4400 ] 130 0.011% 100.150% ( 4400, 6600 ] 30 0.003% 100.153% ( 6600, 9900 ] 6 0.001% 100.153% ** Level 4 read latency histogram (micros): Count: 31269 Average: 64.4072 StdDev: 368.07 Min: 0 Median: 1.9488 Max: 11541 Percentiles: P50: 1.95 P75: 3.32 P99: 1603.35 P99.9: 4697.38 P99.99: 6466.31 ------------------------------------------------------ [ 0, 1 ] 1655 5.293% 5.293% # ( 1, 2 ] 14734 47.120% 52.413% ######### ( 2, 3 ] 5937 18.987% 71.400% #### ( 3, 4 ] 3477 11.120% 82.519% ## ( 4, 6 ] 2489 7.960% 90.479% ## ( 6, 10 ] 663 2.120% 92.600% ( 10, 15 ] 216 0.691% 93.290% ( 15, 22 ] 16 0.051% 93.342% ( 22, 34 ] 1 0.003% 93.345% ( 34, 51 ] 1 0.003% 93.348% ( 76, 110 ] 116 0.371% 93.719% ( 110, 170 ] 194 0.620% 94.339% ( 170, 250 ] 187 0.598% 94.937% ( 250, 380 ] 260 0.831% 95.769% ( 380, 580 ] 306 0.979% 96.748% ( 580, 870 ] 354 1.132% 97.880% ( 870, 1300 ] 277 0.886% 98.766% ( 1300, 1900 ] 145 0.464% 99.229% ( 1900, 2900 ] 102 0.326% 99.555% ( 2900, 4400 ] 103 0.329% 99.885% ( 4400, 6600 ] 35 0.112% 99.997% ( 6600, 9900 ] 5 0.016% 100.013% ( 9900, 14000 ] 2 0.006% 100.019% ** Level 5 read latency histogram (micros): Count: 140 Average: 905.5857 StdDev: 1066.26 Min: 79 Median: 380.0000 Max: 3781 Percentiles: P50: 380.00 P75: 1375.00 P99: 3781.00 P99.9: 3781.00 P99.99: 3781.00 ------------------------------------------------------ ( 76, 110 ] 21 15.000% 15.000% ### ( 110, 170 ] 21 15.000% 30.000% ### ( 170, 250 ] 12 8.571% 38.571% ## ( 250, 380 ] 16 11.429% 50.000% ## ( 380, 580 ] 16 11.429% 61.429% ## ( 580, 870 ] 10 7.143% 68.571% # ( 870, 1300 ] 8 5.714% 74.286% # ( 1300, 1900 ] 8 5.714% 80.000% # ( 1900, 2900 ] 14 10.000% 90.000% ## ( 2900, 4400 ] 14 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 46.9 total, 17.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 188.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.732 H:M:S, 46.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 57.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.917 H:M:S, 80.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/20-09:20:54 ... thread 0: (1000000,10000000) ops and (139685.3,185669.8) ops/second in (7.158947,53.859062) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 2.64 GB 31.5 8.9 0.0 8.9 18.3 9.5 0.0 1.9 136.9 283.0 66.26 58.98 163 0.406 9209K 16K 0.0 0.0 L1 16/16 1.55 GB 0.0 8.4 6.6 1.8 8.3 6.5 0.2 1.3 221.5 218.7 38.90 36.46 5 7.780 8749K 106K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 5.1 2.0 250.5 250.4 1.51 1.47 2 0.754 383K 198 0.0 0.0 L3 16/0 994.00 MB 1.0 7.7 3.7 4.0 7.6 3.6 1.6 2.1 163.6 162.6 48.08 35.15 36 1.335 7585K 46K 0.0 0.0 L4 175/0 9.57 GB 1.0 5.1 4.1 1.0 5.1 4.1 0.9 1.2 140.0 139.2 37.21 24.10 57 0.653 5141K 22K 0.0 0.0 L5 1104/0 90.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1325/29 105.41 GB 0.0 30.4 14.5 15.9 39.7 23.8 12.7 4.2 162.2 211.7 191.96 156.16 263 0.730 31M 192K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.4 14.5 15.9 39.7 23.8 12.6 4.2 162.2 211.7 191.96 156.16 263 0.730 31M 192K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.4 14.5 15.9 30.2 14.3 0.0 0.0 193.4 192.1 160.99 131.15 127 1.268 31M 192K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 313.3 30.96 25.01 136 0.228 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.1 total, 53.9 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 39.68 GB write, 751.28 MB/s write, 30.41 GB read, 575.71 MB/s read, 192.0 seconds Interval compaction: 39.68 GB write, 754.46 MB/s write, 30.41 GB read, 578.15 MB/s read, 192.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 66, pending-compaction-bytes-delays: 40, pending-compaction-bytes-stops: 0, total-delays: 63, total-stops: 66, interval: 129 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4406180 Average: 2.8005 StdDev: 28.46 Min: 0 Median: 1.5181 Max: 15711 Percentiles: P50: 1.52 P75: 1.91 P99: 7.43 P99.9: 121.98 P99.99: 312.49 ------------------------------------------------------ [ 0, 1 ] 733517 16.647% 16.647% ### ( 1, 2 ] 2836528 64.376% 81.024% ############# ( 2, 3 ] 427013 9.691% 90.715% ## ( 3, 4 ] 195228 4.431% 95.146% # ( 4, 6 ] 154864 3.515% 98.660% # ( 6, 10 ] 41982 0.953% 99.613% ( 10, 15 ] 6528 0.148% 99.761% ( 15, 22 ] 829 0.019% 99.780% ( 22, 34 ] 64 0.001% 99.782% ( 34, 51 ] 33 0.001% 99.782% ( 51, 76 ] 84 0.002% 99.784% ( 76, 110 ] 4405 0.100% 99.884% ( 110, 170 ] 3504 0.080% 99.964% ( 170, 250 ] 822 0.019% 99.982% ( 250, 380 ] 706 0.016% 99.998% ( 380, 580 ] 551 0.013% 100.011% ( 580, 870 ] 295 0.007% 100.018% ( 870, 1300 ] 151 0.003% 100.021% ( 1300, 1900 ] 73 0.002% 100.023% ( 1900, 2900 ] 59 0.001% 100.024% ( 2900, 4400 ] 84 0.002% 100.026% ( 4400, 6600 ] 23 0.001% 100.026% ( 6600, 9900 ] 7 0.000% 100.027% ( 14000, 22000 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1539279 Average: 4.2519 StdDev: 57.46 Min: 0 Median: 1.6984 Max: 11120 Percentiles: P50: 1.70 P75: 2.54 P99: 9.22 P99.9: 132.71 P99.99: 377.26 ------------------------------------------------------ [ 0, 1 ] 165454 10.749% 10.749% ## ( 1, 2 ] 865057 56.199% 66.948% ########### ( 2, 3 ] 228671 14.856% 81.803% ### ( 3, 4 ] 118386 7.691% 89.494% ## ( 4, 6 ] 121579 7.898% 97.393% ## ( 6, 10 ] 30762 1.998% 99.391% ( 10, 15 ] 5360 0.348% 99.739% ( 15, 22 ] 702 0.046% 99.785% ( 22, 34 ] 48 0.003% 99.788% ( 34, 51 ] 19 0.001% 99.789% ( 51, 76 ] 54 0.004% 99.793% ( 76, 110 ] 1267 0.082% 99.875% ( 110, 170 ] 1006 0.065% 99.941% ( 170, 250 ] 345 0.022% 99.963% ( 250, 380 ] 424 0.028% 99.991% ( 380, 580 ] 487 0.032% 100.022% ( 580, 870 ] 430 0.028% 100.050% ( 870, 1300 ] 273 0.018% 100.068% ( 1300, 1900 ] 131 0.009% 100.076% ( 1900, 2900 ] 115 0.007% 100.084% ( 2900, 4400 ] 154 0.010% 100.094% ( 4400, 6600 ] 26 0.002% 100.096% ( 6600, 9900 ] 11 0.001% 100.096% ( 9900, 14000 ] 1 0.000% 100.096% ** Level 2 read latency histogram (micros): Count: 95909 Average: 2.0244 StdDev: 8.08 Min: 1 Median: 1.3845 Max: 1591 Percentiles: P50: 1.38 P75: 1.80 P99: 5.57 P99.9: 9.95 P99.99: 30.45 ------------------------------------------------------ [ 0, 1 ] 25514 26.602% 26.602% ##### ( 1, 2 ] 58361 60.850% 87.453% ############ ( 2, 3 ] 6344 6.615% 94.067% # ( 3, 4 ] 3163 3.298% 97.365% # ( 4, 6 ] 1995 2.080% 99.445% ( 6, 10 ] 442 0.461% 99.906% ( 10, 15 ] 70 0.073% 99.979% ( 15, 22 ] 9 0.009% 99.989% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1935277 Average: 4.8622 StdDev: 68.08 Min: 0 Median: 1.8966 Max: 12251 Percentiles: P50: 1.90 P75: 2.99 P99: 9.06 P99.9: 16.61 P99.99: 154.86 ------------------------------------------------------ [ 0, 1 ] 73335 3.789% 3.789% # ( 1, 2 ] 997475 51.542% 55.331% ########## ( 2, 3 ] 385772 19.934% 75.265% #### ( 3, 4 ] 206757 10.684% 85.948% ## ( 4, 6 ] 221367 11.439% 97.387% ## ( 6, 10 ] 40857 2.111% 99.498% ( 10, 15 ] 7551 0.390% 99.888% ( 15, 22 ] 990 0.051% 99.939% ( 22, 34 ] 132 0.007% 99.946% ( 34, 51 ] 71 0.004% 99.950% ( 51, 76 ] 72 0.004% 99.954% ( 76, 110 ] 309 0.016% 99.970% ( 110, 170 ] 529 0.027% 99.997% ( 170, 250 ] 571 0.030% 100.026% ( 250, 380 ] 589 0.030% 100.057% ( 380, 580 ] 752 0.039% 100.096% ( 580, 870 ] 652 0.034% 100.129% ( 870, 1300 ] 418 0.022% 100.151% ( 1300, 1900 ] 173 0.009% 100.160% ( 1900, 2900 ] 157 0.008% 100.168% ( 2900, 4400 ] 273 0.014% 100.182% ( 4400, 6600 ] 70 0.004% 100.186% ( 6600, 9900 ] 14 0.001% 100.186% ( 9900, 14000 ] 2 0.000% 100.187% ** Level 4 read latency histogram (micros): Count: 249426 Average: 26.0515 StdDev: 237.65 Min: 0 Median: 1.9274 Max: 15553 Percentiles: P50: 1.93 P75: 3.18 P99: 673.58 P99.9: 3096.65 P99.99: 4087.02 ------------------------------------------------------ [ 0, 1 ] 8717 3.495% 3.495% # ( 1, 2 ] 125075 50.145% 53.640% ########## ( 2, 3 ] 48266 19.351% 72.991% #### ( 3, 4 ] 27608 11.069% 84.059% ## ( 4, 6 ] 27126 10.875% 94.935% ## ( 6, 10 ] 5756 2.308% 97.242% ( 10, 15 ] 1398 0.560% 97.803% ( 15, 22 ] 146 0.059% 97.861% ( 22, 34 ] 18 0.007% 97.869% ( 34, 51 ] 9 0.004% 97.872% ( 51, 76 ] 11 0.004% 97.877% ( 76, 110 ] 163 0.065% 97.942% ( 110, 170 ] 332 0.133% 98.075% ( 170, 250 ] 461 0.185% 98.260% ( 250, 380 ] 662 0.265% 98.525% ( 380, 580 ] 863 0.346% 98.871% ( 580, 870 ] 994 0.399% 99.270% ( 870, 1300 ] 788 0.316% 99.586% ( 1300, 1900 ] 421 0.169% 99.755% ( 1900, 2900 ] 318 0.127% 99.882% ( 2900, 4400 ] 340 0.136% 100.018% ( 4400, 6600 ] 119 0.048% 100.066% ( 6600, 9900 ] 18 0.007% 100.073% ( 9900, 14000 ] 6 0.002% 100.076% ( 14000, 22000 ] 2 0.001% 100.077% ** Level 5 read latency histogram (micros): Count: 300 Average: 1184.5233 StdDev: 1261.90 Min: 79 Median: 599.3333 Max: 5453 Percentiles: P50: 599.33 P75: 2002.56 P99: 5453.00 P99.9: 5453.00 P99.99: 5453.00 ------------------------------------------------------ ( 76, 110 ] 25 8.333% 8.333% ## ( 110, 170 ] 34 11.333% 19.667% ## ( 170, 250 ] 21 7.000% 26.667% # ( 250, 380 ] 36 12.000% 38.667% ## ( 380, 580 ] 32 10.667% 49.333% ## ( 580, 870 ] 30 10.000% 59.333% ## ( 870, 1300 ] 26 8.667% 68.000% ## ( 1300, 1900 ] 17 5.667% 73.667% # ( 1900, 2900 ] 39 13.000% 86.667% ### ( 2900, 4400 ] 34 11.333% 98.000% ## ( 4400, 6600 ] 6 2.000% 100.000% ** DB Stats ** Uptime(secs): 54.1 total, 7.2 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 181.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.979 H:M:S, 48.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 137.50 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.247 H:M:S, 59.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-09:20:57 ... thread 0: (1000000,11000000) ops and (304940.3,192515.0) ops/second in (3.279330,57.138392) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.62 GB 125.9 9.7 0.0 9.7 20.1 10.4 0.0 1.9 136.8 284.7 72.28 64.63 179 0.404 10M 17K 0.0 0.0 L1 16/16 1.55 GB 0.0 8.4 6.6 1.8 8.3 6.5 0.2 1.3 221.5 218.7 38.90 36.46 5 7.780 8749K 106K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 5.1 2.0 250.5 250.4 1.51 1.47 2 0.754 383K 198 0.0 0.0 L3 16/0 994.00 MB 1.0 7.7 3.7 4.0 7.6 3.6 1.6 2.1 163.6 162.6 48.08 35.15 36 1.335 7585K 46K 0.0 0.0 L4 175/0 9.57 GB 1.0 5.1 4.1 1.0 5.1 4.1 0.9 1.2 140.0 139.2 37.21 24.10 57 0.653 5141K 22K 0.0 0.0 L5 1104/0 90.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1329/29 106.39 GB 0.0 31.2 14.5 16.7 41.5 24.8 12.7 4.0 161.4 214.5 197.98 161.82 279 0.710 31M 193K 0.0 0.0 Int 0/0 0.00 KB 0.0 31.2 14.5 16.7 41.5 24.8 12.6 4.0 161.4 214.5 197.98 161.82 279 0.710 31M 193K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 31.2 14.5 16.7 31.0 14.3 0.0 0.0 194.8 193.5 164.09 134.19 130 1.262 31M 193K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 316.0 33.89 27.62 149 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.4 total, 57.1 interval Flush(GB): cumulative 10.458, interval 10.458 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 41.47 GB write, 740.16 MB/s write, 31.21 GB read, 557.08 MB/s read, 198.0 seconds Interval compaction: 41.47 GB write, 743.11 MB/s write, 31.21 GB read, 559.30 MB/s read, 198.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 71, pending-compaction-bytes-delays: 40, pending-compaction-bytes-stops: 0, total-delays: 63, total-stops: 71, interval: 134 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4730502 Average: 2.7665 StdDev: 27.66 Min: 0 Median: 1.5160 Max: 15711 Percentiles: P50: 1.52 P75: 1.90 P99: 7.31 P99.9: 117.41 P99.99: 297.68 ------------------------------------------------------ [ 0, 1 ] 788750 16.674% 16.674% ### ( 1, 2 ] 3055363 64.589% 81.262% ############# ( 2, 3 ] 456086 9.641% 90.904% ## ( 3, 4 ] 206927 4.374% 95.278% # ( 4, 6 ] 161617 3.416% 98.694% # ( 6, 10 ] 44226 0.935% 99.629% ( 10, 15 ] 6869 0.145% 99.775% ( 15, 22 ] 864 0.018% 99.793% ( 22, 34 ] 65 0.001% 99.794% ( 34, 51 ] 34 0.001% 99.795% ( 51, 76 ] 88 0.002% 99.797% ( 76, 110 ] 4444 0.094% 99.891% ( 110, 170 ] 3568 0.075% 99.966% ( 170, 250 ] 860 0.018% 99.984% ( 250, 380 ] 736 0.016% 100.000% ( 380, 580 ] 568 0.012% 100.012% ( 580, 870 ] 310 0.007% 100.018% ( 870, 1300 ] 159 0.003% 100.022% ( 1300, 1900 ] 73 0.002% 100.023% ( 1900, 2900 ] 61 0.001% 100.025% ( 2900, 4400 ] 85 0.002% 100.026% ( 4400, 6600 ] 23 0.000% 100.027% ( 6600, 9900 ] 7 0.000% 100.027% ( 14000, 22000 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1630866 Average: 4.1575 StdDev: 55.87 Min: 0 Median: 1.6872 Max: 11120 Percentiles: P50: 1.69 P75: 2.49 P99: 9.18 P99.9: 131.91 P99.99: 377.87 ------------------------------------------------------ [ 0, 1 ] 176365 10.814% 10.814% ## ( 1, 2 ] 929894 57.018% 67.833% ########### ( 2, 3 ] 237656 14.572% 82.405% ### ( 3, 4 ] 121496 7.450% 89.855% # ( 4, 6 ] 123422 7.568% 97.423% ## ( 6, 10 ] 32326 1.982% 99.405% ( 10, 15 ] 5483 0.336% 99.741% ( 15, 22 ] 715 0.044% 99.785% ( 22, 34 ] 48 0.003% 99.788% ( 34, 51 ] 20 0.001% 99.789% ( 51, 76 ] 55 0.003% 99.792% ( 76, 110 ] 1368 0.084% 99.876% ( 110, 170 ] 1060 0.065% 99.941% ( 170, 250 ] 369 0.023% 99.964% ( 250, 380 ] 433 0.027% 99.990% ( 380, 580 ] 491 0.030% 100.021% ( 580, 870 ] 437 0.027% 100.047% ( 870, 1300 ] 273 0.017% 100.064% ( 1300, 1900 ] 131 0.008% 100.072% ( 1900, 2900 ] 115 0.007% 100.079% ( 2900, 4400 ] 154 0.009% 100.089% ( 4400, 6600 ] 26 0.002% 100.090% ( 6600, 9900 ] 11 0.001% 100.091% ( 9900, 14000 ] 1 0.000% 100.091% ** Level 2 read latency histogram (micros): Count: 95909 Average: 2.0244 StdDev: 8.08 Min: 1 Median: 1.3845 Max: 1591 Percentiles: P50: 1.38 P75: 1.80 P99: 5.57 P99.9: 9.95 P99.99: 30.45 ------------------------------------------------------ [ 0, 1 ] 25514 26.602% 26.602% ##### ( 1, 2 ] 58361 60.850% 87.453% ############ ( 2, 3 ] 6344 6.615% 94.067% # ( 3, 4 ] 3163 3.298% 97.365% # ( 4, 6 ] 1995 2.080% 99.445% ( 6, 10 ] 442 0.461% 99.906% ( 10, 15 ] 70 0.073% 99.979% ( 15, 22 ] 9 0.009% 99.989% ( 22, 34 ] 2 0.002% 99.991% ( 34, 51 ] 2 0.002% 99.993% ( 51, 76 ] 1 0.001% 99.994% ( 250, 380 ] 2 0.002% 99.996% ( 380, 580 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1935277 Average: 4.8622 StdDev: 68.08 Min: 0 Median: 1.8966 Max: 12251 Percentiles: P50: 1.90 P75: 2.99 P99: 9.06 P99.9: 16.61 P99.99: 154.86 ------------------------------------------------------ [ 0, 1 ] 73335 3.789% 3.789% # ( 1, 2 ] 997475 51.542% 55.331% ########## ( 2, 3 ] 385772 19.934% 75.265% #### ( 3, 4 ] 206757 10.684% 85.948% ## ( 4, 6 ] 221367 11.439% 97.387% ## ( 6, 10 ] 40857 2.111% 99.498% ( 10, 15 ] 7551 0.390% 99.888% ( 15, 22 ] 990 0.051% 99.939% ( 22, 34 ] 132 0.007% 99.946% ( 34, 51 ] 71 0.004% 99.950% ( 51, 76 ] 72 0.004% 99.954% ( 76, 110 ] 309 0.016% 99.970% ( 110, 170 ] 529 0.027% 99.997% ( 170, 250 ] 571 0.030% 100.026% ( 250, 380 ] 589 0.030% 100.057% ( 380, 580 ] 752 0.039% 100.096% ( 580, 870 ] 652 0.034% 100.129% ( 870, 1300 ] 418 0.022% 100.151% ( 1300, 1900 ] 173 0.009% 100.160% ( 1900, 2900 ] 157 0.008% 100.168% ( 2900, 4400 ] 273 0.014% 100.182% ( 4400, 6600 ] 70 0.004% 100.186% ( 6600, 9900 ] 14 0.001% 100.186% ( 9900, 14000 ] 2 0.000% 100.187% ** Level 4 read latency histogram (micros): Count: 249426 Average: 26.0515 StdDev: 237.65 Min: 0 Median: 1.9274 Max: 15553 Percentiles: P50: 1.93 P75: 3.18 P99: 673.58 P99.9: 3096.65 P99.99: 4087.02 ------------------------------------------------------ [ 0, 1 ] 8717 3.495% 3.495% # ( 1, 2 ] 125075 50.145% 53.640% ########## ( 2, 3 ] 48266 19.351% 72.991% #### ( 3, 4 ] 27608 11.069% 84.059% ## ( 4, 6 ] 27126 10.875% 94.935% ## ( 6, 10 ] 5756 2.308% 97.242% ( 10, 15 ] 1398 0.560% 97.803% ( 15, 22 ] 146 0.059% 97.861% ( 22, 34 ] 18 0.007% 97.869% ( 34, 51 ] 9 0.004% 97.872% ( 51, 76 ] 11 0.004% 97.877% ( 76, 110 ] 163 0.065% 97.942% ( 110, 170 ] 332 0.133% 98.075% ( 170, 250 ] 461 0.185% 98.260% ( 250, 380 ] 662 0.265% 98.525% ( 380, 580 ] 863 0.346% 98.871% ( 580, 870 ] 994 0.399% 99.270% ( 870, 1300 ] 788 0.316% 99.586% ( 1300, 1900 ] 421 0.169% 99.755% ( 1900, 2900 ] 318 0.127% 99.882% ( 2900, 4400 ] 340 0.136% 100.018% ( 4400, 6600 ] 119 0.048% 100.066% ( 6600, 9900 ] 18 0.007% 100.073% ( 9900, 14000 ] 6 0.002% 100.076% ( 14000, 22000 ] 2 0.001% 100.077% ** Level 5 read latency histogram (micros): Count: 300 Average: 1184.5233 StdDev: 1261.90 Min: 79 Median: 599.3333 Max: 5453 Percentiles: P50: 599.33 P75: 2002.56 P99: 5453.00 P99.9: 5453.00 P99.99: 5453.00 ------------------------------------------------------ ( 76, 110 ] 25 8.333% 8.333% ## ( 110, 170 ] 34 11.333% 19.667% ## ( 170, 250 ] 21 7.000% 26.667% # ( 250, 380 ] 36 12.000% 38.667% ## ( 380, 580 ] 32 10.667% 49.333% ## ( 580, 870 ] 30 10.000% 59.333% ## ( 870, 1300 ] 26 8.667% 68.000% ## ( 1300, 1900 ] 17 5.667% 73.667% # ( 1900, 2900 ] 39 13.000% 86.667% ### ( 2900, 4400 ] 34 11.333% 98.000% ## ( 4400, 6600 ] 6 2.000% 100.000% ** DB Stats ** Uptime(secs): 57.4 total, 3.3 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 188.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.640 H:M:S, 46.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 300.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.661 H:M:S, 20.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.178 micros/op 193110 ops/sec 60.002 seconds 11586999 operations; 187.1 MB/s Microseconds per write: Count: 11586999 Average: 5.1784 StdDev: 429.86 Min: 0 Median: 1.7370 Max: 624210 Percentiles: P50: 1.74 P75: 2.74 P99: 8.92 P99.9: 1041.60 P99.99: 2556.13 ------------------------------------------------------ [ 0, 1 ] 1589211 13.715% 13.715% ### ( 1, 2 ] 5704305 49.230% 62.946% ########## ( 2, 3 ] 1889440 16.307% 79.252% ### ( 3, 4 ] 1577586 13.615% 92.867% ### ( 4, 6 ] 620373 5.354% 98.221% # ( 6, 10 ] 123700 1.068% 99.289% ( 10, 15 ] 40931 0.353% 99.642% ( 15, 22 ] 9950 0.086% 99.728% ( 22, 34 ] 2088 0.018% 99.746% ( 34, 51 ] 279 0.002% 99.749% ( 51, 76 ] 40 0.000% 99.749% ( 76, 110 ] 7835 0.068% 99.817% ( 110, 170 ] 3390 0.029% 99.846% ( 170, 250 ] 349 0.003% 99.849% ( 250, 380 ] 203 0.002% 99.851% ( 380, 580 ] 22 0.000% 99.851% ( 580, 870 ] 29 0.000% 99.851% ( 870, 1300 ] 14236 0.123% 99.974% ( 1300, 1900 ] 86 0.001% 99.975% ( 1900, 2900 ] 2724 0.024% 99.998% ( 2900, 4400 ] 153 0.001% 99.999% ( 4400, 6600 ] 22 0.000% 100.000% ( 6600, 9900 ] 7 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 5 0.000% 100.000% ( 22000, 33000 ] 6 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 233036 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11586999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11957782968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 690 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 27959687 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 37342161845 rocksdb.compact.write.bytes COUNT : 37111271409 rocksdb.flush.write.bytes COUNT : 11956279859 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 70 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 308 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11860021248 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4741120 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 37453200242 rocksdb.non.last.level.read.count COUNT : 9048708 rocksdb.block.checksum.compute.count COUNT : 9047398 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.388100 P95 : 3.896686 P99 : 7.306897 P100 : 624208.000000 COUNT : 11586999 SUM : 54643277 rocksdb.compaction.times.micros P50 : 959166.666667 P95 : 2666666.666667 P99 : 12572000.000000 P100 : 19731127.000000 COUNT : 134 SUM : 168581049 rocksdb.compaction.times.cpu_micros P50 : 731111.111111 P95 : 2200000.000000 P99 : 12572000.000000 P100 : 17987479.000000 COUNT : 134 SUM : 138600246 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 695.674157 P95 : 5555.000000 P99 : 55125.000000 P100 : 71626.000000 COUNT : 159 SUM : 319201 rocksdb.compaction.outfile.sync.micros P50 : 1179.909910 P95 : 90750.000000 P99 : 254160.000000 P100 : 299564.000000 COUNT : 484 SUM : 7582148 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 111.836735 P95 : 1518.571429 P99 : 4123.571429 P100 : 6332.000000 COUNT : 329 SUM : 117280 rocksdb.table.open.io.micros P50 : 1310.714286 P95 : 7458.000000 P99 : 12231.875000 P100 : 12905.000000 COUNT : 690 SUM : 1420738 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.696547 P95 : 8.283988 P99 : 11.951619 P100 : 17248.000000 COUNT : 9045492 SUM : 56485783 rocksdb.read.block.get.micros P50 : 389.459459 P95 : 3603.703704 P99 : 5620.000000 P100 : 8029.000000 COUNT : 1380 SUM : 1185268 rocksdb.write.raw.block.micros P50 : 0.513902 P95 : 0.976414 P99 : 2.938254 P100 : 17478.000000 COUNT : 11884271 SUM : 24975126 rocksdb.numfiles.in.singlecompaction P50 : 2.809524 P95 : 5.628571 P99 : 15.490000 P100 : 21.000000 COUNT : 186 SUM : 631 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563956 P95 : 1158.206050 P99 : 2387.850224 P100 : 619995.000000 COUNT : 151561 SUM : 27975845 rocksdb.sst.read.micros P50 : 1.624546 P95 : 5.008511 P99 : 8.791203 P100 : 15711.000000 COUNT : 9049074 SUM : 37430105 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11586999 SUM : 11957782968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214403.669725 P95 : 462785.714286 P99 : 802966.666667 P100 : 863795.000000 COUNT : 159 SUM : 35874560 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 464 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0