[2024-10-14 21:36:51.939235] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 22.11.4 initialization... [2024-10-14 21:36:51.939339] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid106859 ] Set seed to 1728934611936907 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-10-14 21:36:52.024624] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-10-14 21:36:52.060256] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-10-14 21:36:52.060302] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 106859' to capture a snapshot of events at runtime. [2024-10-14 21:36:52.060314] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid106859 for offline analysis/debug. [2024-10-14 21:36:52.060341] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Oct 14 21:36:56 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/10/14-21:36:59 ... thread 0: (1000000,1000000) ops and (364890.7,364890.7) ops/second in (2.740547,2.740547) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 504.02 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 362.3 2.26 2.04 12 0.188 0 0 0.0 0.0 L1 1/0 1.89 MB 0.2 0.2 0.2 0.1 0.2 0.2 0.1 1.3 246.9 246.7 1.02 0.99 1 1.020 255K 191 0.0 0.0 L2 3/2 298.63 MB 1.2 0.1 0.1 0.0 0.1 0.1 0.3 1.8 234.2 234.1 0.48 0.45 1 0.475 113K 31 0.0 0.0 L3 16/9 755.47 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 197.4 197.4 0.32 0.26 1 0.317 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/17 96.94 GB 0.0 0.4 0.3 0.1 1.2 1.1 0.4 1.5 104.5 305.5 4.07 3.74 15 0.272 432K 222 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.1 0.4 1.5 104.5 305.5 4.07 3.74 15 0.272 432K 222 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 234.9 234.8 1.81 1.70 3 0.604 432K 222 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 362.3 2.26 2.04 12 0.188 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.7 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.22 GB write, 420.98 MB/s write, 0.42 GB read, 144.04 MB/s read, 4.1 seconds Interval compaction: 1.22 GB write, 453.77 MB/s write, 0.42 GB read, 155.25 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 112371 Average: 1.8093 StdDev: 11.89 Min: 1 Median: 1.1831 Max: 2939 Percentiles: P50: 1.18 P75: 1.64 P99: 4.28 P99.9: 9.43 P99.99: 214.20 ------------------------------------------------------ [ 0, 1 ] 44913 39.968% 39.968% ######## ( 1, 2 ] 61578 54.799% 94.767% ########### ( 2, 3 ] 3266 2.906% 97.674% # ( 3, 4 ] 1366 1.216% 98.889% ( 4, 6 ] 915 0.814% 99.704% ( 6, 10 ] 260 0.231% 99.935% ( 10, 15 ] 38 0.034% 99.969% ( 15, 22 ] 12 0.011% 99.980% ( 22, 34 ] 2 0.002% 99.981% ( 34, 51 ] 1 0.001% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 7 0.006% 99.989% ( 170, 250 ] 5 0.004% 99.994% ( 250, 380 ] 6 0.005% 99.999% ( 380, 580 ] 2 0.002% 100.001% ( 580, 870 ] 1 0.001% 100.002% ( 870, 1300 ] 2 0.002% 100.004% ( 1300, 1900 ] 1 0.001% 100.004% ( 2900, 4400 ] 1 0.001% 100.005% ** Level 1 read latency histogram (micros): Count: 15896 Average: 3.2002 StdDev: 41.33 Min: 1 Median: 1.3658 Max: 3572 Percentiles: P50: 1.37 P75: 1.82 P99: 9.30 P99.9: 242.04 P99.99: 2310.40 ------------------------------------------------------ [ 0, 1 ] 4737 29.800% 29.800% ###### ( 1, 2 ] 8779 55.228% 85.028% ########### ( 2, 3 ] 1203 7.568% 92.596% ## ( 3, 4 ] 463 2.913% 95.508% # ( 4, 6 ] 356 2.240% 97.748% ( 6, 10 ] 241 1.516% 99.264% ( 10, 15 ] 37 0.233% 99.497% ( 15, 22 ] 5 0.031% 99.528% ( 22, 34 ] 1 0.006% 99.534% ( 34, 51 ] 23 0.145% 99.679% ( 51, 76 ] 25 0.157% 99.836% ( 76, 110 ] 2 0.013% 99.849% ( 170, 250 ] 9 0.057% 99.906% ( 250, 380 ] 5 0.031% 99.937% ( 380, 580 ] 4 0.025% 99.962% ( 580, 870 ] 2 0.013% 99.975% ( 1300, 1900 ] 2 0.013% 99.987% ( 1900, 2900 ] 1 0.006% 99.994% ( 2900, 4400 ] 1 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 15888 Average: 1.8686 StdDev: 21.11 Min: 0 Median: 1.1657 Max: 2636 Percentiles: P50: 1.17 P75: 1.62 P99: 3.41 P99.9: 9.06 P99.99: 303.46 ------------------------------------------------------ [ 0, 1 ] 6506 40.949% 40.949% ######## ( 1, 2 ] 8676 54.607% 95.556% ########### ( 2, 3 ] 497 3.128% 98.685% # ( 3, 4 ] 121 0.762% 99.446% ( 4, 6 ] 53 0.334% 99.780% ( 6, 10 ] 25 0.157% 99.937% ( 10, 15 ] 3 0.019% 99.956% ( 15, 22 ] 1 0.006% 99.962% ( 22, 34 ] 1 0.006% 99.969% ( 51, 76 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 1 0.006% 99.994% ( 1900, 2900 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 8023 Average: 12.6323 StdDev: 158.06 Min: 1 Median: 1.5895 Max: 5130 Percentiles: P50: 1.59 P75: 2.14 P99: 159.88 P99.9: 3323.43 P99.99: 5130.00 ------------------------------------------------------ [ 0, 1 ] 1347 16.789% 16.789% ### ( 1, 2 ] 4521 56.350% 73.140% ########### ( 2, 3 ] 1050 13.087% 86.227% ### ( 3, 4 ] 436 5.434% 91.661% # ( 4, 6 ] 354 4.412% 96.074% # ( 6, 10 ] 142 1.770% 97.844% ( 10, 15 ] 46 0.573% 98.417% ( 15, 22 ] 11 0.137% 98.554% ( 22, 34 ] 5 0.062% 98.616% ( 34, 51 ] 1 0.012% 98.629% ( 110, 170 ] 37 0.461% 99.090% ( 170, 250 ] 22 0.274% 99.364% ( 250, 380 ] 13 0.162% 99.526% ( 380, 580 ] 10 0.125% 99.651% ( 580, 870 ] 8 0.100% 99.751% ( 870, 1300 ] 4 0.050% 99.801% ( 1300, 1900 ] 2 0.025% 99.826% ( 1900, 2900 ] 5 0.062% 99.888% ( 2900, 4400 ] 7 0.087% 99.975% ( 4400, 6600 ] 3 0.037% 100.012% ** Level 4 read latency histogram (micros): Count: 35 Average: 2025.7143 StdDev: 1584.48 Min: 170 Median: 1480.0000 Max: 5249 Percentiles: P50: 1480.00 P75: 3275.00 P99: 5249.00 P99.9: 5249.00 P99.99: 5249.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 8 22.857% 37.143% ##### ( 870, 1300 ] 3 8.571% 45.714% ## ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 5 14.286% 85.714% ### ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 332.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.168 H:M:S, 5.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 358.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.168 H:M:S, 6.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/14-21:37:02 ... thread 0: (1000000,2000000) ops and (323657.8,343039.6) ops/second in (3.089683,5.830230) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 1.48 GB 12.6 0.6 0.0 0.6 2.4 1.8 0.0 1.3 83.4 325.1 7.56 6.95 28 0.270 639K 852 0.0 0.0 L1 1/1 1.89 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 246.9 246.7 1.02 0.99 1 1.020 255K 191 0.0 0.0 L2 1/1 121.08 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 234.2 234.1 0.48 0.45 1 0.475 113K 31 0.0 0.0 L3 77/34 932.52 MB 0.8 1.0 0.2 0.7 1.0 0.2 0.0 4.1 212.0 211.9 4.67 4.02 3 1.555 1004K 527 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1253/48 97.92 GB 0.0 1.9 0.5 1.5 3.7 2.3 0.4 2.1 144.5 277.6 13.72 12.41 33 0.416 2013K 1601 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 0.5 1.5 3.7 2.3 0.4 2.1 144.5 277.6 13.72 12.41 33 0.416 2013K 1601 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 0.5 1.5 1.9 0.5 0.0 0.0 230.9 230.7 8.59 7.84 7 1.227 2013K 1601 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 356.2 5.13 4.57 26 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.72 GB write, 629.83 MB/s write, 1.94 GB read, 327.92 MB/s read, 13.7 seconds Interval compaction: 3.72 GB write, 652.89 MB/s write, 1.94 GB read, 339.93 MB/s read, 13.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 356883 Average: 2.2056 StdDev: 12.94 Min: 0 Median: 1.4581 Max: 2939 Percentiles: P50: 1.46 P75: 1.86 P99: 5.76 P99.9: 9.83 P99.99: 15.06 ------------------------------------------------------ [ 0, 1 ] 77893 21.826% 21.826% #### ( 1, 2 ] 219486 61.501% 83.327% ############ ( 2, 3 ] 31374 8.791% 92.118% ## ( 3, 4 ] 13773 3.859% 95.977% # ( 4, 6 ] 12252 3.433% 99.410% # ( 6, 10 ] 1829 0.512% 99.923% ( 10, 15 ] 241 0.068% 99.990% ( 15, 22 ] 38 0.011% 100.001% ( 22, 34 ] 7 0.002% 100.003% ( 34, 51 ] 3 0.001% 100.004% ( 51, 76 ] 2 0.001% 100.004% ( 110, 170 ] 10 0.003% 100.007% ( 170, 250 ] 16 0.004% 100.011% ( 250, 380 ] 9 0.003% 100.014% ( 380, 580 ] 2 0.001% 100.015% ( 580, 870 ] 4 0.001% 100.016% ( 870, 1300 ] 4 0.001% 100.017% ( 1300, 1900 ] 7 0.002% 100.019% ( 1900, 2900 ] 3 0.001% 100.020% ( 2900, 4400 ] 2 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 53328 Average: 2.7193 StdDev: 22.59 Min: 1 Median: 1.5948 Max: 3572 Percentiles: P50: 1.59 P75: 2.08 P99: 7.77 P99.9: 50.02 P99.99: 676.74 ------------------------------------------------------ [ 0, 1 ] 7929 14.868% 14.868% ### ( 1, 2 ] 31499 59.067% 73.935% ############ ( 2, 3 ] 7040 13.201% 87.136% ### ( 3, 4 ] 3088 5.791% 92.927% # ( 4, 6 ] 2953 5.537% 98.464% # ( 6, 10 ] 648 1.215% 99.679% ( 10, 15 ] 87 0.163% 99.842% ( 15, 22 ] 8 0.015% 99.857% ( 22, 34 ] 2 0.004% 99.861% ( 34, 51 ] 23 0.043% 99.904% ( 51, 76 ] 26 0.049% 99.953% ( 76, 110 ] 2 0.004% 99.957% ( 170, 250 ] 9 0.017% 99.974% ( 250, 380 ] 5 0.009% 99.983% ( 380, 580 ] 4 0.008% 99.991% ( 580, 870 ] 2 0.004% 99.994% ( 1300, 1900 ] 2 0.004% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ( 2900, 4400 ] 1 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 28271 Average: 2.0186 StdDev: 15.84 Min: 0 Median: 1.3411 Max: 2636 Percentiles: P50: 1.34 P75: 1.76 P99: 5.37 P99.9: 9.39 P99.99: 183.83 ------------------------------------------------------ [ 0, 1 ] 8446 29.875% 29.875% ###### ( 1, 2 ] 16678 58.993% 88.868% ############ ( 2, 3 ] 1693 5.988% 94.857% # ( 3, 4 ] 780 2.759% 97.616% # ( 4, 6 ] 572 2.023% 99.639% ( 6, 10 ] 87 0.308% 99.947% ( 10, 15 ] 7 0.025% 99.972% ( 15, 22 ] 2 0.007% 99.979% ( 22, 34 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 193865 Average: 3.3036 StdDev: 35.74 Min: 0 Median: 1.5387 Max: 5130 Percentiles: P50: 1.54 P75: 1.97 P99: 9.15 P99.9: 212.61 P99.99: 683.26 ------------------------------------------------------ [ 0, 1 ] 36302 18.725% 18.725% #### ( 1, 2 ] 112553 58.057% 76.783% ############ ( 2, 3 ] 23737 12.244% 89.027% ## ( 3, 4 ] 9022 4.654% 93.681% # ( 4, 6 ] 7603 3.922% 97.602% # ( 6, 10 ] 3439 1.774% 99.376% ( 10, 15 ] 459 0.237% 99.613% ( 15, 22 ] 115 0.059% 99.672% ( 22, 34 ] 42 0.022% 99.694% ( 34, 51 ] 4 0.002% 99.696% ( 51, 76 ] 10 0.005% 99.701% ( 76, 110 ] 97 0.050% 99.751% ( 110, 170 ] 237 0.122% 99.874% ( 170, 250 ] 96 0.050% 99.923% ( 250, 380 ] 74 0.038% 99.961% ( 380, 580 ] 46 0.024% 99.985% ( 580, 870 ] 27 0.014% 99.999% ( 870, 1300 ] 13 0.007% 100.006% ( 1300, 1900 ] 3 0.002% 100.007% ( 1900, 2900 ] 6 0.003% 100.010% ( 2900, 4400 ] 7 0.004% 100.014% ( 4400, 6600 ] 3 0.002% 100.015% ** Level 4 read latency histogram (micros): Count: 35 Average: 2025.7143 StdDev: 1584.48 Min: 170 Median: 1480.0000 Max: 5249 Percentiles: P50: 1480.00 P75: 3275.00 P99: 5249.00 P99.9: 5249.00 P99.99: 5249.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 8 22.857% 37.143% ##### ( 870, 1300 ] 3 8.571% 45.714% ## ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 5 14.286% 85.714% ### ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 6.0 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 325.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.569 H:M:S, 9.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.401 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/14-21:37:05 ... thread 0: (1000000,3000000) ops and (332593.2,339485.3) ops/second in (3.006676,8.836906) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.46 GB 144.8 1.7 0.0 1.7 4.5 2.8 0.0 1.6 119.9 312.4 14.71 13.73 46 0.320 1791K 2052 0.0 0.0 L1 1/1 1.89 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 246.9 246.7 1.02 0.99 1 1.020 255K 191 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 234.2 234.1 0.48 0.45 1 0.475 113K 31 0.0 0.0 L3 39/0 995.72 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 213.1 213.0 5.68 4.97 4 1.419 1199K 527 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1228/9 98.90 GB 0.0 3.3 0.6 2.7 6.0 3.4 0.5 2.2 152.5 281.9 21.88 20.14 52 0.421 3359K 2801 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 0.6 2.7 6.0 3.4 0.4 2.2 152.5 281.9 21.88 20.14 52 0.421 3359K 2801 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 0.6 2.7 3.3 0.6 0.0 0.0 239.4 239.2 13.94 13.05 12 1.161 3359K 2801 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 356.7 7.95 7.09 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.02 GB write, 681.45 MB/s write, 3.26 GB read, 368.62 MB/s read, 21.9 seconds Interval compaction: 6.02 GB write, 697.92 MB/s write, 3.26 GB read, 377.53 MB/s read, 21.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 783718 Average: 2.2831 StdDev: 12.05 Min: 0 Median: 1.5045 Max: 3511 Percentiles: P50: 1.50 P75: 1.89 P99: 5.77 P99.9: 9.78 P99.99: 14.36 ------------------------------------------------------ [ 0, 1 ] 138433 17.664% 17.664% #### ( 1, 2 ] 502341 64.097% 81.761% ############# ( 2, 3 ] 77828 9.931% 91.691% ## ( 3, 4 ] 32897 4.198% 95.889% # ( 4, 6 ] 27529 3.513% 99.402% # ( 6, 10 ] 4135 0.528% 99.929% ( 10, 15 ] 546 0.070% 99.999% ( 15, 22 ] 67 0.009% 100.007% ( 22, 34 ] 9 0.001% 100.009% ( 34, 51 ] 8 0.001% 100.010% ( 51, 76 ] 2 0.000% 100.010% ( 76, 110 ] 44 0.006% 100.015% ( 110, 170 ] 65 0.008% 100.024% ( 170, 250 ] 44 0.006% 100.029% ( 250, 380 ] 28 0.004% 100.033% ( 380, 580 ] 17 0.002% 100.035% ( 580, 870 ] 16 0.002% 100.037% ( 870, 1300 ] 8 0.001% 100.038% ( 1300, 1900 ] 14 0.002% 100.040% ( 1900, 2900 ] 3 0.000% 100.040% ( 2900, 4400 ] 4 0.001% 100.041% ** Level 1 read latency histogram (micros): Count: 75723 Average: 2.6428 StdDev: 18.97 Min: 1 Median: 1.6130 Max: 3572 Percentiles: P50: 1.61 P75: 2.12 P99: 7.50 P99.9: 29.66 P99.99: 501.38 ------------------------------------------------------ [ 0, 1 ] 9791 12.930% 12.930% ### ( 1, 2 ] 45793 60.474% 73.404% ############ ( 2, 3 ] 10306 13.610% 87.015% ### ( 3, 4 ] 4387 5.793% 92.808% # ( 4, 6 ] 4369 5.770% 98.578% # ( 6, 10 ] 852 1.125% 99.703% ( 10, 15 ] 135 0.178% 99.881% ( 15, 22 ] 13 0.017% 99.898% ( 22, 34 ] 2 0.003% 99.901% ( 34, 51 ] 23 0.030% 99.931% ( 51, 76 ] 26 0.034% 99.966% ( 76, 110 ] 2 0.003% 99.968% ( 170, 250 ] 9 0.012% 99.980% ( 250, 380 ] 5 0.007% 99.987% ( 380, 580 ] 4 0.005% 99.992% ( 580, 870 ] 2 0.003% 99.995% ( 1300, 1900 ] 2 0.003% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28271 Average: 2.0186 StdDev: 15.84 Min: 0 Median: 1.3411 Max: 2636 Percentiles: P50: 1.34 P75: 1.76 P99: 5.37 P99.9: 9.39 P99.99: 183.83 ------------------------------------------------------ [ 0, 1 ] 8446 29.875% 29.875% ###### ( 1, 2 ] 16678 58.993% 88.868% ############ ( 2, 3 ] 1693 5.988% 94.857% # ( 3, 4 ] 780 2.759% 97.616% # ( 4, 6 ] 572 2.023% 99.639% ( 6, 10 ] 87 0.308% 99.947% ( 10, 15 ] 7 0.025% 99.972% ( 15, 22 ] 2 0.007% 99.979% ( 22, 34 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 215913 Average: 3.2283 StdDev: 34.24 Min: 0 Median: 1.5493 Max: 5130 Percentiles: P50: 1.55 P75: 1.98 P99: 9.02 P99.9: 197.01 P99.99: 670.32 ------------------------------------------------------ [ 0, 1 ] 38372 17.772% 17.772% #### ( 1, 2 ] 126672 58.668% 76.440% ############ ( 2, 3 ] 26659 12.347% 88.787% ## ( 3, 4 ] 10476 4.852% 93.639% # ( 4, 6 ] 8843 4.096% 97.735% # ( 6, 10 ] 3615 1.674% 99.409% ( 10, 15 ] 514 0.238% 99.647% ( 15, 22 ] 123 0.057% 99.704% ( 22, 34 ] 42 0.019% 99.723% ( 34, 51 ] 4 0.002% 99.725% ( 51, 76 ] 10 0.005% 99.730% ( 76, 110 ] 97 0.045% 99.775% ( 110, 170 ] 237 0.110% 99.885% ( 170, 250 ] 98 0.045% 99.930% ( 250, 380 ] 75 0.035% 99.965% ( 380, 580 ] 46 0.021% 99.986% ( 580, 870 ] 27 0.013% 99.999% ( 870, 1300 ] 13 0.006% 100.005% ( 1300, 1900 ] 3 0.001% 100.006% ( 1900, 2900 ] 7 0.003% 100.009% ( 2900, 4400 ] 7 0.003% 100.013% ( 4400, 6600 ] 3 0.001% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 2025.7143 StdDev: 1584.48 Min: 170 Median: 1480.0000 Max: 5249 Percentiles: P50: 1480.00 P75: 3275.00 P99: 5249.00 P99.9: 5249.00 P99.99: 5249.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 8 22.857% 37.143% ##### ( 870, 1300 ] 3 8.571% 45.714% ## ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 5 14.286% 85.714% ### ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.953 H:M:S, 10.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.384 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/10/14-21:37:08 ... thread 0: (1000000,4000000) ops and (335947.5,338593.9) ops/second in (2.976656,11.813562) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 2.34 GB 31.5 2.2 0.0 2.2 5.9 3.7 0.0 1.6 118.2 314.9 19.20 17.89 61 0.315 2302K 2553 0.0 0.0 L1 9/9 1.04 GB 0.0 1.3 1.2 0.1 1.3 1.2 0.1 1.0 229.6 228.7 5.77 5.59 2 2.884 1344K 4811 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 234.2 234.1 0.48 0.45 1 0.475 113K 31 0.0 0.0 L3 39/0 995.72 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 213.1 213.0 5.68 4.97 4 1.419 1199K 527 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1235/22 99.82 GB 0.0 4.8 1.6 3.2 8.5 5.3 0.5 2.3 157.9 279.1 31.11 28.89 68 0.458 4959K 7922 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 1.6 3.2 8.5 5.3 0.4 2.3 157.9 279.1 31.11 28.89 68 0.458 4959K 7922 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 1.6 3.2 4.8 1.6 0.0 0.0 239.0 238.6 20.55 19.47 15 1.370 4959K 7922 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 357.9 10.56 9.42 53 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.48 GB write, 721.95 MB/s write, 4.80 GB read, 408.42 MB/s read, 31.1 seconds Interval compaction: 8.48 GB write, 735.00 MB/s write, 4.80 GB read, 415.81 MB/s read, 31.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1015937 Average: 2.2361 StdDev: 13.42 Min: 0 Median: 1.4761 Max: 4160 Percentiles: P50: 1.48 P75: 1.87 P99: 5.70 P99.9: 9.76 P99.99: 14.69 ------------------------------------------------------ [ 0, 1 ] 197732 19.463% 19.463% #### ( 1, 2 ] 651606 64.138% 83.601% ############# ( 2, 3 ] 91978 9.054% 92.655% ## ( 3, 4 ] 38471 3.787% 96.442% # ( 4, 6 ] 30502 3.002% 99.444% # ( 6, 10 ] 4925 0.485% 99.929% ( 10, 15 ] 664 0.065% 99.994% ( 15, 22 ] 89 0.009% 100.003% ( 22, 34 ] 12 0.001% 100.004% ( 34, 51 ] 8 0.001% 100.005% ( 51, 76 ] 4 0.000% 100.005% ( 76, 110 ] 49 0.005% 100.010% ( 110, 170 ] 79 0.008% 100.018% ( 170, 250 ] 59 0.006% 100.024% ( 250, 380 ] 34 0.003% 100.027% ( 380, 580 ] 21 0.002% 100.029% ( 580, 870 ] 19 0.002% 100.031% ( 870, 1300 ] 12 0.001% 100.032% ( 1300, 1900 ] 17 0.002% 100.034% ( 1900, 2900 ] 4 0.000% 100.034% ( 2900, 4400 ] 8 0.001% 100.035% ** Level 1 read latency histogram (micros): Count: 116465 Average: 2.8522 StdDev: 21.45 Min: 0 Median: 1.5438 Max: 3572 Percentiles: P50: 1.54 P75: 1.95 P99: 8.32 P99.9: 136.48 P99.99: 1038.67 ------------------------------------------------------ [ 0, 1 ] 19048 16.355% 16.355% ### ( 1, 2 ] 72063 61.875% 78.230% ############ ( 2, 3 ] 12911 11.086% 89.316% ## ( 3, 4 ] 5399 4.636% 93.952% # ( 4, 6 ] 5038 4.326% 98.278% # ( 6, 10 ] 1450 1.245% 99.523% ( 10, 15 ] 249 0.214% 99.736% ( 15, 22 ] 19 0.016% 99.753% ( 22, 34 ] 4 0.003% 99.756% ( 34, 51 ] 23 0.020% 99.776% ( 51, 76 ] 29 0.025% 99.801% ( 76, 110 ] 98 0.084% 99.885% ( 110, 170 ] 42 0.036% 99.921% ( 170, 250 ] 31 0.027% 99.948% ( 250, 380 ] 18 0.015% 99.963% ( 380, 580 ] 21 0.018% 99.981% ( 580, 870 ] 9 0.008% 99.989% ( 870, 1300 ] 6 0.005% 99.994% ( 1300, 1900 ] 6 0.005% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 28271 Average: 2.0186 StdDev: 15.84 Min: 0 Median: 1.3411 Max: 2636 Percentiles: P50: 1.34 P75: 1.76 P99: 5.37 P99.9: 9.39 P99.99: 183.83 ------------------------------------------------------ [ 0, 1 ] 8446 29.875% 29.875% ###### ( 1, 2 ] 16678 58.993% 88.868% ############ ( 2, 3 ] 1693 5.988% 94.857% # ( 3, 4 ] 780 2.759% 97.616% # ( 4, 6 ] 572 2.023% 99.639% ( 6, 10 ] 87 0.308% 99.947% ( 10, 15 ] 7 0.025% 99.972% ( 15, 22 ] 2 0.007% 99.979% ( 22, 34 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 215913 Average: 3.2283 StdDev: 34.24 Min: 0 Median: 1.5493 Max: 5130 Percentiles: P50: 1.55 P75: 1.98 P99: 9.02 P99.9: 197.01 P99.99: 670.32 ------------------------------------------------------ [ 0, 1 ] 38372 17.772% 17.772% #### ( 1, 2 ] 126672 58.668% 76.440% ############ ( 2, 3 ] 26659 12.347% 88.787% ## ( 3, 4 ] 10476 4.852% 93.639% # ( 4, 6 ] 8843 4.096% 97.735% # ( 6, 10 ] 3615 1.674% 99.409% ( 10, 15 ] 514 0.238% 99.647% ( 15, 22 ] 123 0.057% 99.704% ( 22, 34 ] 42 0.019% 99.723% ( 34, 51 ] 4 0.002% 99.725% ( 51, 76 ] 10 0.005% 99.730% ( 76, 110 ] 97 0.045% 99.775% ( 110, 170 ] 237 0.110% 99.885% ( 170, 250 ] 98 0.045% 99.930% ( 250, 380 ] 75 0.035% 99.965% ( 380, 580 ] 46 0.021% 99.986% ( 580, 870 ] 27 0.013% 99.999% ( 870, 1300 ] 13 0.006% 100.005% ( 1300, 1900 ] 3 0.001% 100.006% ( 1900, 2900 ] 7 0.003% 100.009% ( 2900, 4400 ] 7 0.003% 100.013% ( 4400, 6600 ] 3 0.001% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 2025.7143 StdDev: 1584.48 Min: 170 Median: 1480.0000 Max: 5249 Percentiles: P50: 1480.00 P75: 3275.00 P99: 5249.00 P99.9: 5249.00 P99.99: 5249.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 8 22.857% 37.143% ##### ( 870, 1300 ] 3 8.571% 45.714% ## ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 5 14.286% 85.714% ### ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 327.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.358 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.405 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/14-21:37:11 ... thread 0: (1000000,5000000) ops and (285817.2,326534.8) ops/second in (3.498740,15.312302) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.32 GB 138.4 3.3 0.0 3.3 8.0 4.7 0.0 1.7 129.2 310.9 26.33 24.64 80 0.329 3454K 3808 0.0 0.0 L1 9/9 1.04 GB 0.0 1.3 1.2 0.1 1.3 1.2 0.1 1.0 229.6 228.7 5.77 5.59 2 2.884 1344K 4811 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.3 1.8 234.2 234.1 0.48 0.45 1 0.475 113K 31 0.0 0.0 L3 39/0 995.72 MB 1.0 1.2 0.4 0.8 1.2 0.4 0.0 3.3 213.1 213.0 5.68 4.97 4 1.419 1199K 527 0.0 0.0 L4 128/0 9.59 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1238/22 100.80 GB 0.0 5.9 1.6 4.3 10.6 6.3 0.5 2.3 158.1 283.0 38.25 35.65 87 0.440 6111K 9177 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 1.6 4.3 10.6 6.3 0.4 2.3 158.1 283.0 38.25 35.65 87 0.440 6111K 9177 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 1.6 4.3 5.9 1.6 0.0 0.0 243.2 242.8 24.87 23.71 19 1.309 6111K 9177 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.7 13.38 11.94 68 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.5 total, 15.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.57 GB write, 697.14 MB/s write, 5.91 GB read, 389.42 MB/s read, 38.2 seconds Interval compaction: 10.57 GB write, 706.86 MB/s write, 5.91 GB read, 394.85 MB/s read, 38.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 19, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1427194 Average: 2.2309 StdDev: 12.60 Min: 0 Median: 1.4815 Max: 4160 Percentiles: P50: 1.48 P75: 1.87 P99: 5.69 P99.9: 9.74 P99.99: 14.60 ------------------------------------------------------ [ 0, 1 ] 266100 18.645% 18.645% #### ( 1, 2 ] 929399 65.121% 83.766% ############# ( 2, 3 ] 129699 9.088% 92.853% ## ( 3, 4 ] 53510 3.749% 96.603% # ( 4, 6 ] 40559 2.842% 99.445% # ( 6, 10 ] 6960 0.488% 99.932% ( 10, 15 ] 895 0.063% 99.995% ( 15, 22 ] 117 0.008% 100.003% ( 22, 34 ] 16 0.001% 100.004% ( 34, 51 ] 13 0.001% 100.005% ( 51, 76 ] 5 0.000% 100.006% ( 76, 110 ] 89 0.006% 100.012% ( 110, 170 ] 113 0.008% 100.020% ( 170, 250 ] 86 0.006% 100.026% ( 250, 380 ] 54 0.004% 100.029% ( 380, 580 ] 30 0.002% 100.032% ( 580, 870 ] 30 0.002% 100.034% ( 870, 1300 ] 15 0.001% 100.035% ( 1300, 1900 ] 18 0.001% 100.036% ( 1900, 2900 ] 4 0.000% 100.036% ( 2900, 4400 ] 10 0.001% 100.037% ** Level 1 read latency histogram (micros): Count: 189690 Average: 2.7500 StdDev: 17.96 Min: 0 Median: 1.5411 Max: 3572 Percentiles: P50: 1.54 P75: 1.93 P99: 8.34 P99.9: 133.48 P99.99: 765.36 ------------------------------------------------------ [ 0, 1 ] 28609 15.082% 15.082% ### ( 1, 2 ] 122401 64.527% 79.609% ############# ( 2, 3 ] 20136 10.615% 90.224% ## ( 3, 4 ] 8097 4.269% 94.493% # ( 4, 6 ] 7019 3.700% 98.193% # ( 6, 10 ] 2614 1.378% 99.571% ( 10, 15 ] 369 0.195% 99.765% ( 15, 22 ] 26 0.014% 99.779% ( 22, 34 ] 5 0.003% 99.782% ( 34, 51 ] 23 0.012% 99.794% ( 51, 76 ] 30 0.016% 99.810% ( 76, 110 ] 140 0.074% 99.883% ( 110, 170 ] 80 0.042% 99.926% ( 170, 250 ] 50 0.026% 99.952% ( 250, 380 ] 31 0.016% 99.968% ( 380, 580 ] 34 0.018% 99.986% ( 580, 870 ] 11 0.006% 99.992% ( 870, 1300 ] 7 0.004% 99.996% ( 1300, 1900 ] 6 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28271 Average: 2.0186 StdDev: 15.84 Min: 0 Median: 1.3411 Max: 2636 Percentiles: P50: 1.34 P75: 1.76 P99: 5.37 P99.9: 9.39 P99.99: 183.83 ------------------------------------------------------ [ 0, 1 ] 8446 29.875% 29.875% ###### ( 1, 2 ] 16678 58.993% 88.868% ############ ( 2, 3 ] 1693 5.988% 94.857% # ( 3, 4 ] 780 2.759% 97.616% # ( 4, 6 ] 572 2.023% 99.639% ( 6, 10 ] 87 0.308% 99.947% ( 10, 15 ] 7 0.025% 99.972% ( 15, 22 ] 2 0.007% 99.979% ( 22, 34 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 215913 Average: 3.2283 StdDev: 34.24 Min: 0 Median: 1.5493 Max: 5130 Percentiles: P50: 1.55 P75: 1.98 P99: 9.02 P99.9: 197.01 P99.99: 670.32 ------------------------------------------------------ [ 0, 1 ] 38372 17.772% 17.772% #### ( 1, 2 ] 126672 58.668% 76.440% ############ ( 2, 3 ] 26659 12.347% 88.787% ## ( 3, 4 ] 10476 4.852% 93.639% # ( 4, 6 ] 8843 4.096% 97.735% # ( 6, 10 ] 3615 1.674% 99.409% ( 10, 15 ] 514 0.238% 99.647% ( 15, 22 ] 123 0.057% 99.704% ( 22, 34 ] 42 0.019% 99.723% ( 34, 51 ] 4 0.002% 99.725% ( 51, 76 ] 10 0.005% 99.730% ( 76, 110 ] 97 0.045% 99.775% ( 110, 170 ] 237 0.110% 99.885% ( 170, 250 ] 98 0.045% 99.930% ( 250, 380 ] 75 0.035% 99.965% ( 380, 580 ] 46 0.021% 99.986% ( 580, 870 ] 27 0.013% 99.999% ( 870, 1300 ] 13 0.006% 100.005% ( 1300, 1900 ] 3 0.001% 100.006% ( 1900, 2900 ] 7 0.003% 100.009% ( 2900, 4400 ] 7 0.003% 100.013% ( 4400, 6600 ] 3 0.001% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 2025.7143 StdDev: 1584.48 Min: 170 Median: 1480.0000 Max: 5249 Percentiles: P50: 1480.00 P75: 3275.00 P99: 5249.00 P99.9: 5249.00 P99.99: 5249.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 8 22.857% 37.143% ##### ( 870, 1300 ] 3 8.571% 45.714% ## ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 5 14.286% 85.714% ### ( 4400, 6600 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 15.5 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 316.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.189 H:M:S, 14.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 281.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.831 H:M:S, 23.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/14-21:37:21 ... thread 0: (1000000,6000000) ops and (104940.2,241531.0) ops/second in (9.529233,24.841535) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 2.57 GB 238.4 5.4 0.0 5.4 11.0 5.6 0.0 1.9 142.4 292.6 38.49 35.23 99 0.389 5563K 11K 0.0 0.0 L1 8/0 377.83 MB 37.8 4.1 3.0 1.1 4.0 2.9 0.1 1.4 219.3 217.3 18.94 17.78 3 6.312 4217K 37K 0.0 0.0 L2 8/8 1.01 GB 0.0 0.1 0.1 0.0 0.1 0.1 2.7 1.8 234.2 234.1 0.48 0.45 1 0.475 113K 31 0.0 0.0 L3 21/1 1.02 GB 0.9 2.1 1.2 0.9 2.1 1.2 0.5 1.8 139.9 139.7 15.59 10.21 24 0.650 2127K 1617 0.0 0.0 L4 153/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/13 101.74 GB 0.0 11.6 4.2 7.4 17.3 9.8 5.9 3.0 162.3 240.4 73.50 63.68 127 0.579 12M 51K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.6 4.2 7.4 17.3 9.8 5.9 3.0 162.3 240.4 73.50 63.68 127 0.579 12M 51K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.6 4.2 7.4 11.6 4.2 0.0 0.0 211.0 210.0 56.52 49.08 44 1.285 12M 51K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 341.4 16.97 14.59 83 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.1 total, 24.8 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.25 GB write, 705.12 MB/s write, 11.65 GB read, 475.96 MB/s read, 73.5 seconds Interval compaction: 17.25 GB write, 711.18 MB/s write, 11.65 GB read, 480.05 MB/s read, 73.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 43, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2240481 Average: 2.7795 StdDev: 33.92 Min: 0 Median: 1.4792 Max: 14505 Percentiles: P50: 1.48 P75: 1.86 P99: 6.22 P99.9: 134.50 P99.99: 292.03 ------------------------------------------------------ [ 0, 1 ] 418780 18.692% 18.692% #### ( 1, 2 ] 1463737 65.331% 84.023% ############# ( 2, 3 ] 192737 8.602% 92.625% ## ( 3, 4 ] 81881 3.655% 96.280% # ( 4, 6 ] 60063 2.681% 98.961% # ( 6, 10 ] 15926 0.711% 99.672% ( 10, 15 ] 1587 0.071% 99.742% ( 15, 22 ] 206 0.009% 99.752% ( 22, 34 ] 21 0.001% 99.753% ( 34, 51 ] 15 0.001% 99.753% ( 51, 76 ] 34 0.002% 99.755% ( 76, 110 ] 2335 0.104% 99.859% ( 110, 170 ] 2249 0.100% 99.959% ( 170, 250 ] 566 0.025% 99.985% ( 250, 380 ] 371 0.017% 100.001% ( 380, 580 ] 268 0.012% 100.013% ( 580, 870 ] 154 0.007% 100.020% ( 870, 1300 ] 63 0.003% 100.023% ( 1300, 1900 ] 37 0.002% 100.025% ( 1900, 2900 ] 26 0.001% 100.026% ( 2900, 4400 ] 39 0.002% 100.027% ( 4400, 6600 ] 15 0.001% 100.028% ( 6600, 9900 ] 12 0.001% 100.029% ( 9900, 14000 ] 1 0.000% 100.029% ( 14000, 22000 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 589772 Average: 7.3408 StdDev: 162.38 Min: 0 Median: 1.6470 Max: 32155 Percentiles: P50: 1.65 P75: 2.27 P99: 9.50 P99.9: 435.94 P99.99: 898.56 ------------------------------------------------------ [ 0, 1 ] 65098 11.038% 11.038% ## ( 1, 2 ] 355140 60.216% 71.254% ############ ( 2, 3 ] 80967 13.729% 84.983% ### ( 3, 4 ] 36967 6.268% 91.251% # ( 4, 6 ] 36252 6.147% 97.398% # ( 6, 10 ] 10815 1.834% 99.231% ( 10, 15 ] 1783 0.302% 99.534% ( 15, 22 ] 222 0.038% 99.571% ( 22, 34 ] 22 0.004% 99.575% ( 34, 51 ] 35 0.006% 99.581% ( 51, 76 ] 35 0.006% 99.587% ( 76, 110 ] 652 0.111% 99.698% ( 110, 170 ] 536 0.091% 99.788% ( 170, 250 ] 257 0.044% 99.832% ( 250, 380 ] 313 0.053% 99.885% ( 380, 580 ] 319 0.054% 99.939% ( 580, 870 ] 289 0.049% 99.988% ( 870, 1300 ] 181 0.031% 100.019% ( 1300, 1900 ] 95 0.016% 100.035% ( 1900, 2900 ] 90 0.015% 100.050% ( 2900, 4400 ] 147 0.025% 100.075% ( 4400, 6600 ] 44 0.007% 100.083% ( 6600, 9900 ] 64 0.011% 100.093% ( 9900, 14000 ] 20 0.003% 100.097% ( 14000, 22000 ] 10 0.002% 100.099% ( 22000, 33000 ] 2 0.000% 100.099% ** Level 2 read latency histogram (micros): Count: 28271 Average: 2.0186 StdDev: 15.84 Min: 0 Median: 1.3411 Max: 2636 Percentiles: P50: 1.34 P75: 1.76 P99: 5.37 P99.9: 9.39 P99.99: 183.83 ------------------------------------------------------ [ 0, 1 ] 8446 29.875% 29.875% ###### ( 1, 2 ] 16678 58.993% 88.868% ############ ( 2, 3 ] 1693 5.988% 94.857% # ( 3, 4 ] 780 2.759% 97.616% # ( 4, 6 ] 572 2.023% 99.639% ( 6, 10 ] 87 0.308% 99.947% ( 10, 15 ] 7 0.025% 99.972% ( 15, 22 ] 2 0.007% 99.979% ( 22, 34 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 243603 Average: 7.6077 StdDev: 95.99 Min: 0 Median: 1.5792 Max: 11142 Percentiles: P50: 1.58 P75: 2.05 P99: 12.94 P99.9: 1084.75 P99.99: 3104.63 ------------------------------------------------------ [ 0, 1 ] 40176 16.492% 16.492% ### ( 1, 2 ] 140925 57.850% 74.343% ############ ( 2, 3 ] 31477 12.921% 87.264% ### ( 3, 4 ] 13232 5.432% 92.696% # ( 4, 6 ] 10776 4.424% 97.119% # ( 6, 10 ] 4204 1.726% 98.845% ( 10, 15 ] 641 0.263% 99.108% ( 15, 22 ] 141 0.058% 99.166% ( 22, 34 ] 46 0.019% 99.185% ( 34, 51 ] 6 0.002% 99.188% ( 51, 76 ] 11 0.005% 99.192% ( 76, 110 ] 111 0.046% 99.238% ( 110, 170 ] 341 0.140% 99.378% ( 170, 250 ] 254 0.104% 99.482% ( 250, 380 ] 292 0.120% 99.602% ( 380, 580 ] 341 0.140% 99.742% ( 580, 870 ] 296 0.122% 99.863% ( 870, 1300 ] 179 0.073% 99.937% ( 1300, 1900 ] 71 0.029% 99.966% ( 1900, 2900 ] 51 0.021% 99.987% ( 2900, 4400 ] 56 0.023% 100.010% ( 4400, 6600 ] 8 0.003% 100.013% ( 6600, 9900 ] 5 0.002% 100.015% ( 9900, 14000 ] 1 0.000% 100.016% ** Level 4 read latency histogram (micros): Count: 35 Average: 2025.7143 StdDev: 1584.48 Min: 170 Median: 1480.0000 Max: 5249 Percentiles: P50: 1480.00 P75: 3275.00 P99: 5249.00 P99.9: 5249.00 P99.99: 5249.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 8 22.857% 37.143% ##### ( 870, 1300 ] 3 8.571% 45.714% ## ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 5 14.286% 85.714% ### ( 4400, 6600 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 80 Average: 1315.1250 StdDev: 1391.13 Min: 103 Median: 621.4286 Max: 6583 Percentiles: P50: 621.43 P75: 2207.69 P99: 6013.33 P99.9: 6541.33 P99.99: 6583.00 ------------------------------------------------------ ( 76, 110 ] 2 2.500% 2.500% # ( 110, 170 ] 7 8.750% 11.250% ## ( 170, 250 ] 9 11.250% 22.500% ## ( 250, 380 ] 9 11.250% 33.750% ## ( 380, 580 ] 12 15.000% 48.750% ### ( 580, 870 ] 7 8.750% 57.500% ## ( 870, 1300 ] 4 5.000% 62.500% # ( 1300, 1900 ] 6 7.500% 70.000% ## ( 1900, 2900 ] 13 16.250% 86.250% ### ( 2900, 4400 ] 8 10.000% 96.250% ## ( 4400, 6600 ] 3 3.750% 100.000% # ** DB Stats ** Uptime(secs): 25.1 total, 9.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 235.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.811 H:M:S, 35.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 103.28 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.622 H:M:S, 69.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/14-21:37:24 ... thread 0: (1000000,7000000) ops and (322827.3,250544.3) ops/second in (3.097631,27.939166) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 3.50 GB 56.6 6.2 0.0 6.2 12.8 6.6 0.0 1.9 140.1 291.2 44.95 41.02 116 0.388 6395K 12K 0.0 0.0 L1 8/8 377.83 MB 0.0 4.1 3.0 1.1 4.0 2.9 0.1 1.4 219.3 217.3 18.94 17.78 3 6.312 4217K 37K 0.0 0.0 L2 8/8 1.01 GB 0.0 0.1 0.1 0.0 0.1 0.1 2.7 1.8 234.2 234.1 0.48 0.45 1 0.475 113K 31 0.0 0.0 L3 21/1 1.02 GB 0.9 2.1 1.2 0.9 2.1 1.2 0.5 1.8 139.9 139.7 15.59 10.21 24 0.650 2127K 1617 0.0 0.0 L4 153/0 9.61 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1264/29 102.67 GB 0.0 12.4 4.2 8.2 19.0 10.8 5.9 2.9 159.4 243.8 79.96 69.47 144 0.555 12M 52K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.4 4.2 8.2 19.0 10.8 5.9 2.9 159.4 243.8 79.96 69.47 144 0.555 12M 52K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.4 4.2 8.2 12.4 4.2 0.0 0.0 212.1 211.2 60.10 52.33 47 1.279 12M 52K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 342.6 19.86 17.14 97 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.2 total, 27.9 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.04 GB write, 692.39 MB/s write, 12.45 GB read, 452.68 MB/s read, 80.0 seconds Interval compaction: 19.04 GB write, 697.68 MB/s write, 12.45 GB read, 456.14 MB/s read, 80.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 47, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 47, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2569795 Average: 2.7625 StdDev: 32.17 Min: 0 Median: 1.4971 Max: 14505 Percentiles: P50: 1.50 P75: 1.88 P99: 6.33 P99.9: 127.37 P99.99: 256.33 ------------------------------------------------------ [ 0, 1 ] 450072 17.514% 17.514% #### ( 1, 2 ] 1679340 65.349% 82.863% ############# ( 2, 3 ] 238563 9.283% 92.146% ## ( 3, 4 ] 99692 3.879% 96.026% # ( 4, 6 ] 74818 2.911% 98.937% # ( 6, 10 ] 19466 0.757% 99.695% ( 10, 15 ] 1910 0.074% 99.769% ( 15, 22 ] 242 0.009% 99.779% ( 22, 34 ] 23 0.001% 99.779% ( 34, 51 ] 16 0.001% 99.780% ( 51, 76 ] 38 0.001% 99.782% ( 76, 110 ] 2367 0.092% 99.874% ( 110, 170 ] 2349 0.091% 99.965% ( 170, 250 ] 624 0.024% 99.989% ( 250, 380 ] 411 0.016% 100.005% ( 380, 580 ] 306 0.012% 100.017% ( 580, 870 ] 162 0.006% 100.024% ( 870, 1300 ] 70 0.003% 100.026% ( 1300, 1900 ] 39 0.002% 100.028% ( 1900, 2900 ] 28 0.001% 100.029% ( 2900, 4400 ] 43 0.002% 100.031% ( 4400, 6600 ] 15 0.001% 100.031% ( 6600, 9900 ] 12 0.000% 100.032% ( 9900, 14000 ] 1 0.000% 100.032% ( 14000, 22000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 743881 Average: 6.4219 StdDev: 144.75 Min: 0 Median: 1.6370 Max: 32155 Percentiles: P50: 1.64 P75: 2.19 P99: 9.34 P99.9: 379.30 P99.99: 873.77 ------------------------------------------------------ [ 0, 1 ] 78876 10.603% 10.603% ## ( 1, 2 ] 460059 61.846% 72.449% ############ ( 2, 3 ] 99993 13.442% 85.891% ### ( 3, 4 ] 44692 6.008% 91.899% # ( 4, 6 ] 41575 5.589% 97.488% # ( 6, 10 ] 13488 1.813% 99.301% ( 10, 15 ] 2086 0.280% 99.582% ( 15, 22 ] 249 0.033% 99.615% ( 22, 34 ] 24 0.003% 99.618% ( 34, 51 ] 36 0.005% 99.623% ( 51, 76 ] 36 0.005% 99.628% ( 76, 110 ] 714 0.096% 99.724% ( 110, 170 ] 644 0.087% 99.811% ( 170, 250 ] 319 0.043% 99.853% ( 250, 380 ] 348 0.047% 99.900% ( 380, 580 ] 359 0.048% 99.949% ( 580, 870 ] 307 0.041% 99.990% ( 870, 1300 ] 184 0.025% 100.015% ( 1300, 1900 ] 97 0.013% 100.028% ( 1900, 2900 ] 90 0.012% 100.040% ( 2900, 4400 ] 147 0.020% 100.059% ( 4400, 6600 ] 44 0.006% 100.065% ( 6600, 9900 ] 64 0.009% 100.074% ( 9900, 14000 ] 20 0.003% 100.077% ( 14000, 22000 ] 10 0.001% 100.078% ( 22000, 33000 ] 2 0.000% 100.078% ** Level 2 read latency histogram (micros): Count: 28271 Average: 2.0186 StdDev: 15.84 Min: 0 Median: 1.3411 Max: 2636 Percentiles: P50: 1.34 P75: 1.76 P99: 5.37 P99.9: 9.39 P99.99: 183.83 ------------------------------------------------------ [ 0, 1 ] 8446 29.875% 29.875% ###### ( 1, 2 ] 16678 58.993% 88.868% ############ ( 2, 3 ] 1693 5.988% 94.857% # ( 3, 4 ] 780 2.759% 97.616% # ( 4, 6 ] 572 2.023% 99.639% ( 6, 10 ] 87 0.308% 99.947% ( 10, 15 ] 7 0.025% 99.972% ( 15, 22 ] 2 0.007% 99.979% ( 22, 34 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 260889 Average: 7.2579 StdDev: 92.76 Min: 0 Median: 1.5795 Max: 11142 Percentiles: P50: 1.58 P75: 2.03 P99: 11.70 P99.9: 1043.23 P99.99: 3058.33 ------------------------------------------------------ [ 0, 1 ] 42146 16.155% 16.155% ### ( 1, 2 ] 152381 58.408% 74.563% ############ ( 2, 3 ] 33608 12.882% 87.445% ### ( 3, 4 ] 14076 5.395% 92.841% # ( 4, 6 ] 11360 4.354% 97.195% # ( 6, 10 ] 4486 1.720% 98.914% ( 10, 15 ] 657 0.252% 99.166% ( 15, 22 ] 144 0.055% 99.222% ( 22, 34 ] 46 0.018% 99.239% ( 34, 51 ] 6 0.002% 99.241% ( 51, 76 ] 11 0.004% 99.246% ( 76, 110 ] 111 0.043% 99.288% ( 110, 170 ] 341 0.131% 99.419% ( 170, 250 ] 254 0.097% 99.516% ( 250, 380 ] 292 0.112% 99.628% ( 380, 580 ] 341 0.131% 99.759% ( 580, 870 ] 296 0.113% 99.872% ( 870, 1300 ] 179 0.069% 99.941% ( 1300, 1900 ] 71 0.027% 99.968% ( 1900, 2900 ] 51 0.020% 99.988% ( 2900, 4400 ] 56 0.021% 100.009% ( 4400, 6600 ] 8 0.003% 100.012% ( 6600, 9900 ] 5 0.002% 100.014% ( 9900, 14000 ] 1 0.000% 100.015% ** Level 4 read latency histogram (micros): Count: 35 Average: 2025.7143 StdDev: 1584.48 Min: 170 Median: 1480.0000 Max: 5249 Percentiles: P50: 1480.00 P75: 3275.00 P99: 5249.00 P99.9: 5249.00 P99.99: 5249.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 8 22.857% 37.143% ##### ( 870, 1300 ] 3 8.571% 45.714% ## ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 5 14.286% 85.714% ### ( 4400, 6600 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 80 Average: 1315.1250 StdDev: 1391.13 Min: 103 Median: 621.4286 Max: 6583 Percentiles: P50: 621.43 P75: 2207.69 P99: 6013.33 P99.9: 6541.33 P99.99: 6583.00 ------------------------------------------------------ ( 76, 110 ] 2 2.500% 2.500% # ( 110, 170 ] 7 8.750% 11.250% ## ( 170, 250 ] 9 11.250% 22.500% ## ( 250, 380 ] 9 11.250% 33.750% ## ( 380, 580 ] 12 15.000% 48.750% ### ( 580, 870 ] 7 8.750% 57.500% ## ( 870, 1300 ] 4 5.000% 62.500% # ( 1300, 1900 ] 6 7.500% 70.000% ## ( 1900, 2900 ] 13 16.250% 86.250% ### ( 2900, 4400 ] 8 10.000% 96.250% ## ( 4400, 6600 ] 3 3.750% 100.000% # ** DB Stats ** Uptime(secs): 28.2 total, 3.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 244.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.258 H:M:S, 32.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.447 H:M:S, 14.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/14-21:37:28 ... thread 0: (1000000,8000000) ops and (246181.2,249990.5) ops/second in (4.062049,32.001215) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 4.54 GB 169.9 7.3 0.0 7.3 14.9 7.6 0.0 1.9 142.3 291.5 52.25 47.91 135 0.387 7546K 14K 0.0 0.0 L1 8/8 377.83 MB 0.0 4.1 3.0 1.1 4.0 2.9 0.1 1.4 219.3 217.3 18.94 17.78 3 6.312 4217K 37K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.7 1.8 234.2 234.1 0.48 0.45 1 0.475 113K 31 0.0 0.0 L3 20/0 975.10 MB 1.0 3.3 2.2 1.0 3.3 2.2 0.5 1.5 158.8 158.5 21.01 15.22 25 0.841 2777K 1617 0.0 0.0 L4 167/0 9.69 GB 1.0 0.0 0.0 0.0 0.0 0.0 2.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1072/0 88.15 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1285/20 103.71 GB 0.0 14.7 5.2 9.5 22.3 12.8 8.0 2.9 162.2 245.9 92.67 81.35 164 0.565 14M 53K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.7 5.2 9.5 22.3 12.8 7.9 2.9 162.2 245.9 92.67 81.35 164 0.565 14M 53K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.7 5.2 9.5 14.6 5.2 0.0 0.0 215.0 214.1 69.93 61.66 52 1.345 14M 53K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 343.5 22.74 19.69 112 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.2 total, 32.0 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.25 GB write, 707.29 MB/s write, 14.68 GB read, 466.65 MB/s read, 92.7 seconds Interval compaction: 22.25 GB write, 712.01 MB/s write, 14.68 GB read, 469.77 MB/s read, 92.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 50, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 19, total-stops: 50, interval: 69 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3077174 Average: 2.7100 StdDev: 29.74 Min: 0 Median: 1.5099 Max: 14505 Percentiles: P50: 1.51 P75: 1.89 P99: 6.35 P99.9: 111.17 P99.99: 219.05 ------------------------------------------------------ [ 0, 1 ] 513001 16.671% 16.671% ### ( 1, 2 ] 2011211 65.359% 82.030% ############# ( 2, 3 ] 301559 9.800% 91.830% ## ( 3, 4 ] 123185 4.003% 95.833% # ( 4, 6 ] 95329 3.098% 98.931% # ( 6, 10 ] 24515 0.797% 99.728% ( 10, 15 ] 2463 0.080% 99.808% ( 15, 22 ] 287 0.009% 99.817% ( 22, 34 ] 28 0.001% 99.818% ( 34, 51 ] 22 0.001% 99.819% ( 51, 76 ] 39 0.001% 99.820% ( 76, 110 ] 2414 0.078% 99.899% ( 110, 170 ] 2411 0.078% 99.977% ( 170, 250 ] 661 0.021% 99.998% ( 250, 380 ] 438 0.014% 100.013% ( 380, 580 ] 332 0.011% 100.023% ( 580, 870 ] 180 0.006% 100.029% ( 870, 1300 ] 81 0.003% 100.032% ( 1300, 1900 ] 40 0.001% 100.033% ( 1900, 2900 ] 32 0.001% 100.034% ( 2900, 4400 ] 44 0.001% 100.036% ( 4400, 6600 ] 15 0.000% 100.036% ( 6600, 9900 ] 12 0.000% 100.037% ( 9900, 14000 ] 1 0.000% 100.037% ( 14000, 22000 ] 1 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 829468 Average: 6.0434 StdDev: 137.12 Min: 0 Median: 1.6390 Max: 32155 Percentiles: P50: 1.64 P75: 2.19 P99: 9.27 P99.9: 352.82 P99.99: 864.44 ------------------------------------------------------ [ 0, 1 ] 84541 10.192% 10.192% ## ( 1, 2 ] 516767 62.301% 72.493% ############ ( 2, 3 ] 112266 13.535% 86.028% ### ( 3, 4 ] 49734 5.996% 92.024% # ( 4, 6 ] 45508 5.486% 97.510% # ( 6, 10 ] 15107 1.821% 99.331% ( 10, 15 ] 2277 0.275% 99.606% ( 15, 22 ] 272 0.033% 99.639% ( 22, 34 ] 24 0.003% 99.642% ( 34, 51 ] 36 0.004% 99.646% ( 51, 76 ] 46 0.006% 99.652% ( 76, 110 ] 775 0.093% 99.745% ( 110, 170 ] 667 0.080% 99.825% ( 170, 250 ] 333 0.040% 99.866% ( 250, 380 ] 361 0.044% 99.909% ( 380, 580 ] 367 0.044% 99.953% ( 580, 870 ] 310 0.037% 99.991% ( 870, 1300 ] 185 0.022% 100.013% ( 1300, 1900 ] 97 0.012% 100.025% ( 1900, 2900 ] 90 0.011% 100.036% ( 2900, 4400 ] 147 0.018% 100.053% ( 4400, 6600 ] 44 0.005% 100.059% ( 6600, 9900 ] 64 0.008% 100.066% ( 9900, 14000 ] 20 0.002% 100.069% ( 14000, 22000 ] 10 0.001% 100.070% ( 22000, 33000 ] 2 0.000% 100.070% ** Level 2 read latency histogram (micros): Count: 28271 Average: 2.0186 StdDev: 15.84 Min: 0 Median: 1.3411 Max: 2636 Percentiles: P50: 1.34 P75: 1.76 P99: 5.37 P99.9: 9.39 P99.99: 183.83 ------------------------------------------------------ [ 0, 1 ] 8446 29.875% 29.875% ###### ( 1, 2 ] 16678 58.993% 88.868% ############ ( 2, 3 ] 1693 5.988% 94.857% # ( 3, 4 ] 780 2.759% 97.616% # ( 4, 6 ] 572 2.023% 99.639% ( 6, 10 ] 87 0.308% 99.947% ( 10, 15 ] 7 0.025% 99.972% ( 15, 22 ] 2 0.007% 99.979% ( 22, 34 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 272910 Average: 7.1665 StdDev: 91.05 Min: 0 Median: 1.5811 Max: 11142 Percentiles: P50: 1.58 P75: 2.03 P99: 11.74 P99.9: 1023.78 P99.99: 3026.13 ------------------------------------------------------ [ 0, 1 ] 43374 15.893% 15.893% ### ( 1, 2 ] 160175 58.692% 74.585% ############ ( 2, 3 ] 35109 12.865% 87.449% ### ( 3, 4 ] 14748 5.404% 92.853% # ( 4, 6 ] 11837 4.337% 97.191% # ( 6, 10 ] 4702 1.723% 98.914% ( 10, 15 ] 677 0.248% 99.162% ( 15, 22 ] 146 0.053% 99.215% ( 22, 34 ] 46 0.017% 99.232% ( 34, 51 ] 7 0.003% 99.235% ( 51, 76 ] 11 0.004% 99.239% ( 76, 110 ] 115 0.042% 99.281% ( 110, 170 ] 380 0.139% 99.420% ( 170, 250 ] 279 0.102% 99.522% ( 250, 380 ] 309 0.113% 99.635% ( 380, 580 ] 353 0.129% 99.765% ( 580, 870 ] 304 0.111% 99.876% ( 870, 1300 ] 182 0.067% 99.943% ( 1300, 1900 ] 73 0.027% 99.970% ( 1900, 2900 ] 51 0.019% 99.988% ( 2900, 4400 ] 56 0.021% 100.009% ( 4400, 6600 ] 8 0.003% 100.012% ( 6600, 9900 ] 5 0.002% 100.014% ( 9900, 14000 ] 1 0.000% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 2025.7143 StdDev: 1584.48 Min: 170 Median: 1480.0000 Max: 5249 Percentiles: P50: 1480.00 P75: 3275.00 P99: 5249.00 P99.9: 5249.00 P99.99: 5249.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 250, 380 ] 2 5.714% 8.571% # ( 380, 580 ] 2 5.714% 14.286% # ( 580, 870 ] 8 22.857% 37.143% ##### ( 870, 1300 ] 3 8.571% 45.714% ## ( 1300, 1900 ] 5 14.286% 60.000% ### ( 1900, 2900 ] 4 11.429% 71.429% ## ( 2900, 4400 ] 5 14.286% 85.714% ### ( 4400, 6600 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 140 Average: 1071.8786 StdDev: 1267.02 Min: 78 Median: 480.0000 Max: 6583 Percentiles: P50: 480.00 P75: 1700.00 P99: 5573.33 P99.9: 6497.33 P99.99: 6583.00 ------------------------------------------------------ ( 76, 110 ] 11 7.857% 7.857% ## ( 110, 170 ] 25 17.857% 25.714% #### ( 170, 250 ] 14 10.000% 35.714% ## ( 250, 380 ] 11 7.857% 43.571% ## ( 380, 580 ] 18 12.857% 56.429% ### ( 580, 870 ] 10 7.143% 63.571% # ( 870, 1300 ] 10 7.143% 70.714% # ( 1300, 1900 ] 9 6.429% 77.143% # ( 1900, 2900 ] 18 12.857% 90.000% ### ( 2900, 4400 ] 11 7.857% 97.857% ## ( 4400, 6600 ] 3 2.143% 100.000% ** DB Stats ** Uptime(secs): 32.2 total, 4.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 244.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.587 H:M:S, 32.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 242.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.329 H:M:S, 32.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/14-21:37:36 ... thread 0: (1000000,9000000) ops and (127383.6,225838.3) ops/second in (7.850303,39.851518) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 2.77 GB 151.0 8.0 0.0 8.0 16.5 8.5 0.0 1.9 141.4 291.3 57.89 52.93 152 0.381 8314K 14K 0.0 0.0 L1 9/0 1.07 GB 109.6 7.1 5.6 1.5 7.0 5.5 0.1 1.3 221.1 218.8 32.70 30.93 4 8.175 6958K 37K 0.0 0.0 L2 4/2 515.11 MB 2.6 0.1 0.1 0.0 0.1 0.1 4.6 1.8 234.2 234.1 0.48 0.45 1 0.475 113K 31 0.0 0.0 L3 21/8 1.95 GB 1.0 3.3 2.2 1.0 3.3 2.2 1.9 1.5 158.8 158.5 21.01 15.22 25 0.841 2777K 1617 0.0 0.0 L4 172/28 9.78 GB 0.9 0.1 0.0 0.0 0.1 0.0 2.8 2.2 133.9 132.0 0.68 0.43 1 0.679 92K 1306 0.0 0.0 L5 1076/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/47 104.53 GB 0.0 18.5 7.9 10.6 26.9 16.3 11.9 3.2 168.1 244.3 112.76 99.95 183 0.616 18M 55K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.5 7.9 10.6 26.9 16.3 11.9 3.2 168.1 244.3 112.76 99.95 183 0.616 18M 55K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.5 7.9 10.6 18.4 7.8 0.0 0.0 217.4 216.3 87.20 78.02 57 1.530 18M 55K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 340.1 25.56 21.94 126 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.1 total, 39.9 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.91 GB write, 687.66 MB/s write, 18.51 GB read, 473.15 MB/s read, 112.8 seconds Interval compaction: 26.91 GB write, 691.35 MB/s write, 18.51 GB read, 475.69 MB/s read, 112.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 52, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 34, total-stops: 52, interval: 86 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3852896 Average: 2.7153 StdDev: 29.88 Min: 0 Median: 1.5058 Max: 14505 Percentiles: P50: 1.51 P75: 1.89 P99: 6.55 P99.9: 111.54 P99.99: 236.65 ------------------------------------------------------ [ 0, 1 ] 647859 16.815% 16.815% ### ( 1, 2 ] 2527794 65.608% 82.422% ############# ( 2, 3 ] 369894 9.600% 92.023% ## ( 3, 4 ] 149146 3.871% 95.894% # ( 4, 6 ] 115168 2.989% 98.883% # ( 6, 10 ] 32603 0.846% 99.729% ( 10, 15 ] 3089 0.080% 99.809% ( 15, 22 ] 372 0.010% 99.819% ( 22, 34 ] 34 0.001% 99.820% ( 34, 51 ] 23 0.001% 99.821% ( 51, 76 ] 82 0.002% 99.823% ( 76, 110 ] 2906 0.075% 99.898% ( 110, 170 ] 2881 0.075% 99.973% ( 170, 250 ] 793 0.021% 99.993% ( 250, 380 ] 523 0.014% 100.007% ( 380, 580 ] 416 0.011% 100.018% ( 580, 870 ] 256 0.007% 100.024% ( 870, 1300 ] 113 0.003% 100.027% ( 1300, 1900 ] 66 0.002% 100.029% ( 1900, 2900 ] 50 0.001% 100.030% ( 2900, 4400 ] 63 0.002% 100.032% ( 4400, 6600 ] 17 0.000% 100.032% ( 6600, 9900 ] 15 0.000% 100.033% ( 9900, 14000 ] 1 0.000% 100.033% ( 14000, 22000 ] 1 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 1063150 Average: 6.0439 StdDev: 127.73 Min: 0 Median: 1.6519 Max: 32155 Percentiles: P50: 1.65 P75: 2.25 P99: 9.36 P99.9: 364.41 P99.99: 860.48 ------------------------------------------------------ [ 0, 1 ] 103104 9.698% 9.698% ## ( 1, 2 ] 657230 61.819% 71.517% ############ ( 2, 3 ] 147108 13.837% 85.354% ### ( 3, 4 ] 65889 6.198% 91.552% # ( 4, 6 ] 62380 5.867% 97.419% # ( 6, 10 ] 19989 1.880% 99.299% ( 10, 15 ] 3023 0.284% 99.584% ( 15, 22 ] 369 0.035% 99.618% ( 22, 34 ] 31 0.003% 99.621% ( 34, 51 ] 38 0.004% 99.625% ( 51, 76 ] 76 0.007% 99.632% ( 76, 110 ] 1050 0.099% 99.731% ( 110, 170 ] 892 0.084% 99.815% ( 170, 250 ] 481 0.045% 99.860% ( 250, 380 ] 485 0.046% 99.905% ( 380, 580 ] 477 0.045% 99.950% ( 580, 870 ] 436 0.041% 99.991% ( 870, 1300 ] 292 0.027% 100.019% ( 1300, 1900 ] 136 0.013% 100.032% ( 1900, 2900 ] 120 0.011% 100.043% ( 2900, 4400 ] 203 0.019% 100.062% ( 4400, 6600 ] 61 0.006% 100.068% ( 6600, 9900 ] 66 0.006% 100.074% ( 9900, 14000 ] 20 0.002% 100.076% ( 14000, 22000 ] 10 0.001% 100.077% ( 22000, 33000 ] 2 0.000% 100.077% ** Level 2 read latency histogram (micros): Count: 28271 Average: 2.0186 StdDev: 15.84 Min: 0 Median: 1.3411 Max: 2636 Percentiles: P50: 1.34 P75: 1.76 P99: 5.37 P99.9: 9.39 P99.99: 183.83 ------------------------------------------------------ [ 0, 1 ] 8446 29.875% 29.875% ###### ( 1, 2 ] 16678 58.993% 88.868% ############ ( 2, 3 ] 1693 5.988% 94.857% # ( 3, 4 ] 780 2.759% 97.616% # ( 4, 6 ] 572 2.023% 99.639% ( 6, 10 ] 87 0.308% 99.947% ( 10, 15 ] 7 0.025% 99.972% ( 15, 22 ] 2 0.007% 99.979% ( 22, 34 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 333017 Average: 8.9942 StdDev: 113.33 Min: 0 Median: 1.6376 Max: 11142 Percentiles: P50: 1.64 P75: 2.30 P99: 13.89 P99.9: 1236.27 P99.99: 3223.93 ------------------------------------------------------ [ 0, 1 ] 45166 13.563% 13.563% ### ( 1, 2 ] 190310 57.147% 70.710% ########### ( 2, 3 ] 46853 14.069% 84.779% ### ( 3, 4 ] 21199 6.366% 91.145% # ( 4, 6 ] 18952 5.691% 96.836% # ( 6, 10 ] 6367 1.912% 98.748% ( 10, 15 ] 1080 0.324% 99.072% ( 15, 22 ] 192 0.058% 99.130% ( 22, 34 ] 50 0.015% 99.145% ( 34, 51 ] 8 0.002% 99.147% ( 51, 76 ] 12 0.004% 99.151% ( 76, 110 ] 122 0.037% 99.187% ( 110, 170 ] 426 0.128% 99.315% ( 170, 250 ] 344 0.103% 99.419% ( 250, 380 ] 400 0.120% 99.539% ( 380, 580 ] 510 0.153% 99.692% ( 580, 870 ] 463 0.139% 99.831% ( 870, 1300 ] 270 0.081% 99.912% ( 1300, 1900 ] 129 0.039% 99.951% ( 1900, 2900 ] 105 0.032% 99.982% ( 2900, 4400 ] 119 0.036% 100.018% ( 4400, 6600 ] 22 0.007% 100.025% ( 6600, 9900 ] 8 0.002% 100.027% ( 9900, 14000 ] 1 0.000% 100.027% ** Level 4 read latency histogram (micros): Count: 45 Average: 1618.1111 StdDev: 1606.55 Min: 1 Median: 941.6667 Max: 5249 Percentiles: P50: 941.67 P75: 2587.50 P99: 5249.00 P99.9: 5249.00 P99.99: 5249.00 ------------------------------------------------------ [ 0, 1 ] 1 2.222% 2.222% ( 1, 2 ] 2 4.444% 6.667% # ( 2, 3 ] 1 2.222% 8.889% ( 3, 4 ] 2 4.444% 13.333% # ( 15, 22 ] 1 2.222% 15.556% ( 110, 170 ] 2 4.444% 20.000% # ( 170, 250 ] 1 2.222% 22.222% ( 250, 380 ] 2 4.444% 26.667% # ( 380, 580 ] 2 4.444% 31.111% # ( 580, 870 ] 8 17.778% 48.889% #### ( 870, 1300 ] 3 6.667% 55.556% # ( 1300, 1900 ] 6 13.333% 68.889% ### ( 1900, 2900 ] 4 8.889% 77.778% ## ( 2900, 4400 ] 5 11.111% 88.889% ## ( 4400, 6600 ] 5 11.111% 100.000% ## ** Level 5 read latency histogram (micros): Count: 160 Average: 1074.8438 StdDev: 1233.06 Min: 78 Median: 498.1818 Max: 6583 Percentiles: P50: 498.18 P75: 1736.36 P99: 5426.67 P99.9: 6482.67 P99.99: 6583.00 ------------------------------------------------------ ( 76, 110 ] 11 6.875% 6.875% # ( 110, 170 ] 26 16.250% 23.125% ### ( 170, 250 ] 17 10.625% 33.750% ## ( 250, 380 ] 13 8.125% 41.875% ## ( 380, 580 ] 22 13.750% 55.625% ### ( 580, 870 ] 11 6.875% 62.500% # ( 870, 1300 ] 12 7.500% 70.000% ## ( 1300, 1900 ] 11 6.875% 76.875% # ( 1900, 2900 ] 23 14.375% 91.250% ### ( 2900, 4400 ] 11 6.875% 98.125% # ( 4400, 6600 ] 3 1.875% 100.000% ** DB Stats ** Uptime(secs): 40.1 total, 7.9 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 221.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.509 H:M:S, 38.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 125.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.922 H:M:S, 62.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/10/14-21:37:41 ... thread 0: (1000000,10000000) ops and (204929.9,223557.4) ops/second in (4.879718,44.731236) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 3.81 GB 31.5 9.5 0.0 9.5 19.0 9.5 0.0 2.0 142.7 285.2 68.40 61.73 169 0.405 9912K 19K 0.0 0.0 L1 9/9 1.07 GB 0.0 7.1 5.6 1.5 7.0 5.5 0.1 1.3 221.1 218.8 32.70 30.93 4 8.175 6958K 37K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.6 1.8 234.2 234.1 0.48 0.45 1 0.475 113K 31 0.0 0.0 L3 14/0 998.02 MB 1.0 4.3 2.7 1.6 4.3 2.7 1.9 1.6 160.9 160.3 27.58 20.27 29 0.951 3896K 12K 0.0 0.0 L4 164/0 9.57 GB 1.0 2.5 1.5 1.0 2.5 1.5 2.8 1.6 150.0 148.6 17.02 11.79 17 1.001 2593K 24K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/26 105.54 GB 0.0 23.5 9.9 13.7 32.9 19.3 13.6 3.5 164.8 230.7 146.18 125.17 220 0.664 23M 94K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.5 9.9 13.7 32.9 19.3 13.6 3.5 164.8 230.7 146.18 125.17 220 0.664 23M 94K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.5 9.9 13.7 23.4 9.7 0.0 0.0 206.1 204.9 116.92 100.44 80 1.461 23M 94K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 333.7 29.26 24.73 140 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 44.9 total, 44.7 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.93 GB write, 750.30 MB/s write, 23.53 GB read, 536.10 MB/s read, 146.2 seconds Interval compaction: 32.93 GB write, 753.88 MB/s write, 23.53 GB read, 538.65 MB/s read, 146.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 24, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 24, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 19, pending-compaction-bytes-stops: 0, total-delays: 43, total-stops: 60, interval: 103 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4248366 Average: 2.7912 StdDev: 31.59 Min: 0 Median: 1.5162 Max: 14505 Percentiles: P50: 1.52 P75: 1.90 P99: 6.77 P99.9: 112.17 P99.99: 282.86 ------------------------------------------------------ [ 0, 1 ] 691158 16.269% 16.269% ### ( 1, 2 ] 2776238 65.348% 81.617% ############# ( 2, 3 ] 422219 9.938% 91.556% ## ( 3, 4 ] 171855 4.045% 95.601% # ( 4, 6 ] 137015 3.225% 98.826% # ( 6, 10 ] 38212 0.899% 99.725% ( 10, 15 ] 3804 0.090% 99.815% ( 15, 22 ] 437 0.010% 99.825% ( 22, 34 ] 41 0.001% 99.826% ( 34, 51 ] 26 0.001% 99.827% ( 51, 76 ] 84 0.002% 99.829% ( 76, 110 ] 2925 0.069% 99.898% ( 110, 170 ] 2926 0.069% 99.966% ( 170, 250 ] 852 0.020% 99.986% ( 250, 380 ] 598 0.014% 100.001% ( 380, 580 ] 522 0.012% 100.013% ( 580, 870 ] 352 0.008% 100.021% ( 870, 1300 ] 169 0.004% 100.025% ( 1300, 1900 ] 97 0.002% 100.027% ( 1900, 2900 ] 74 0.002% 100.029% ( 2900, 4400 ] 87 0.002% 100.031% ( 4400, 6600 ] 21 0.000% 100.032% ( 6600, 9900 ] 15 0.000% 100.032% ( 9900, 14000 ] 1 0.000% 100.032% ( 14000, 22000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 1325246 Average: 5.8093 StdDev: 117.72 Min: 0 Median: 1.6956 Max: 32155 Percentiles: P50: 1.70 P75: 2.46 P99: 9.42 P99.9: 266.04 P99.99: 673.28 ------------------------------------------------------ [ 0, 1 ] 112630 8.499% 8.499% ## ( 1, 2 ] 790671 59.662% 68.161% ############ ( 2, 3 ] 198205 14.956% 83.117% ### ( 3, 4 ] 93171 7.030% 90.148% # ( 4, 6 ] 93440 7.051% 97.198% # ( 6, 10 ] 27933 2.108% 99.306% ( 10, 15 ] 4575 0.345% 99.651% ( 15, 22 ] 556 0.042% 99.693% ( 22, 34 ] 53 0.004% 99.697% ( 34, 51 ] 41 0.003% 99.700% ( 51, 76 ] 91 0.007% 99.707% ( 76, 110 ] 1061 0.080% 99.787% ( 110, 170 ] 915 0.069% 99.856% ( 170, 250 ] 513 0.039% 99.895% ( 250, 380 ] 533 0.040% 99.935% ( 380, 580 ] 555 0.042% 99.977% ( 580, 870 ] 530 0.040% 100.017% ( 870, 1300 ] 382 0.029% 100.046% ( 1300, 1900 ] 159 0.012% 100.058% ( 1900, 2900 ] 145 0.011% 100.069% ( 2900, 4400 ] 240 0.018% 100.087% ( 4400, 6600 ] 68 0.005% 100.092% ( 6600, 9900 ] 66 0.005% 100.097% ( 9900, 14000 ] 20 0.002% 100.099% ( 14000, 22000 ] 10 0.001% 100.099% ( 22000, 33000 ] 2 0.000% 100.100% ** Level 2 read latency histogram (micros): Count: 28271 Average: 2.0186 StdDev: 15.84 Min: 0 Median: 1.3411 Max: 2636 Percentiles: P50: 1.34 P75: 1.76 P99: 5.37 P99.9: 9.39 P99.99: 183.83 ------------------------------------------------------ [ 0, 1 ] 8446 29.875% 29.875% ###### ( 1, 2 ] 16678 58.993% 88.868% ############ ( 2, 3 ] 1693 5.988% 94.857% # ( 3, 4 ] 780 2.759% 97.616% # ( 4, 6 ] 572 2.023% 99.639% ( 6, 10 ] 87 0.308% 99.947% ( 10, 15 ] 7 0.025% 99.972% ( 15, 22 ] 2 0.007% 99.979% ( 22, 34 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 759969 Average: 7.7489 StdDev: 95.76 Min: 0 Median: 1.7856 Max: 11142 Percentiles: P50: 1.79 P75: 2.78 P99: 9.90 P99.9: 707.27 P99.99: 1008.81 ------------------------------------------------------ [ 0, 1 ] 58533 7.702% 7.702% ## ( 1, 2 ] 409187 53.843% 61.545% ########### ( 2, 3 ] 131053 17.245% 78.789% ### ( 3, 4 ] 68254 8.981% 87.770% ## ( 4, 6 ] 70220 9.240% 97.010% ## ( 6, 10 ] 15516 2.042% 99.052% ( 10, 15 ] 2752 0.362% 99.414% ( 15, 22 ] 401 0.053% 99.467% ( 22, 34 ] 70 0.009% 99.476% ( 34, 51 ] 17 0.002% 99.478% ( 51, 76 ] 39 0.005% 99.483% ( 76, 110 ] 180 0.024% 99.507% ( 110, 170 ] 546 0.072% 99.579% ( 170, 250 ] 477 0.063% 99.642% ( 250, 380 ] 666 0.088% 99.729% ( 380, 580 ] 907 0.119% 99.849% ( 580, 870 ] 891 0.117% 99.966% ( 870, 1300 ] 570 0.075% 100.041% ( 1300, 1900 ] 257 0.034% 100.075% ( 1900, 2900 ] 185 0.024% 100.099% ( 2900, 4400 ] 188 0.025% 100.124% ( 4400, 6600 ] 35 0.005% 100.128% ( 6600, 9900 ] 9 0.001% 100.129% ( 9900, 14000 ] 1 0.000% 100.130% ** Level 4 read latency histogram (micros): Count: 37746 Average: 6.3182 StdDev: 99.13 Min: 0 Median: 1.7700 Max: 6163 Percentiles: P50: 1.77 P75: 2.69 P99: 8.41 P99.9: 767.03 P99.99: 2789.34 ------------------------------------------------------ [ 0, 1 ] 1969 5.216% 5.216% # ( 1, 2 ] 21954 58.162% 63.379% ############ ( 2, 3 ] 6340 16.796% 80.175% ### ( 3, 4 ] 3359 8.899% 89.074% ## ( 4, 6 ] 3512 9.304% 98.379% ## ( 6, 10 ] 389 1.031% 99.409% ( 10, 15 ] 85 0.225% 99.634% ( 15, 22 ] 14 0.037% 99.671% ( 22, 34 ] 2 0.005% 99.677% ( 34, 51 ] 3 0.008% 99.685% ( 76, 110 ] 9 0.024% 99.709% ( 110, 170 ] 7 0.019% 99.727% ( 170, 250 ] 28 0.074% 99.801% ( 250, 380 ] 14 0.037% 99.838% ( 380, 580 ] 11 0.029% 99.868% ( 580, 870 ] 19 0.050% 99.918% ( 870, 1300 ] 12 0.032% 99.950% ( 1300, 1900 ] 9 0.024% 99.974% ( 1900, 2900 ] 7 0.019% 99.992% ( 2900, 4400 ] 9 0.024% 100.016% ( 4400, 6600 ] 6 0.016% 100.032% ** Level 5 read latency histogram (micros): Count: 260 Average: 1066.1462 StdDev: 1262.82 Min: 78 Median: 480.0000 Max: 6583 Percentiles: P50: 480.00 P75: 1637.50 P99: 5646.67 P99.9: 6504.67 P99.99: 6583.00 ------------------------------------------------------ ( 76, 110 ] 24 9.231% 9.231% ## ( 110, 170 ] 45 17.308% 26.538% ### ( 170, 250 ] 22 8.462% 35.000% ## ( 250, 380 ] 23 8.846% 43.846% ## ( 380, 580 ] 32 12.308% 56.154% ## ( 580, 870 ] 18 6.923% 63.077% # ( 870, 1300 ] 22 8.462% 71.538% ## ( 1300, 1900 ] 16 6.154% 77.692% # ( 1900, 2900 ] 33 12.692% 90.385% ### ( 2900, 4400 ] 19 7.308% 97.692% # ( 4400, 6600 ] 6 2.308% 100.000% ** DB Stats ** Uptime(secs): 44.9 total, 4.9 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 218.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.663 H:M:S, 39.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 201.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.155 H:M:S, 44.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/14-21:37:50 ... thread 0: (1000000,11000000) ops and (101256.9,201439.0) ops/second in (9.875869,54.607105) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 4.78 GB 194.6 12.2 0.0 12.2 22.7 10.5 0.0 2.2 153.3 285.4 81.34 74.17 192 0.424 12M 26K 0.0 0.0 L1 9/9 1.07 GB 0.0 7.1 5.6 1.5 7.0 5.5 0.1 1.3 221.1 218.8 32.70 30.93 4 8.175 6958K 37K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.6 1.8 234.2 234.1 0.48 0.45 1 0.475 113K 31 0.0 0.0 L3 14/0 998.02 MB 1.0 4.3 2.7 1.6 4.3 2.7 1.9 1.6 160.9 160.3 27.58 20.27 29 0.951 3896K 12K 0.0 0.0 L4 164/0 9.57 GB 1.0 2.5 1.5 1.0 2.5 1.5 2.8 1.6 150.0 148.6 17.02 11.79 17 1.001 2593K 24K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/18 106.52 GB 0.0 26.2 9.9 16.3 36.6 20.2 13.6 3.5 168.5 235.3 159.12 137.61 243 0.655 26M 100K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.2 9.9 16.3 36.6 20.2 13.6 3.5 168.5 235.3 159.12 137.61 243 0.655 26M 100K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.2 9.9 16.3 26.0 9.7 0.0 0.0 211.0 209.9 127.01 110.36 87 1.460 26M 100K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.5 10.5 0.0 0.0 0.0 335.5 32.11 27.25 156 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.8 total, 54.6 interval Flush(GB): cumulative 10.520, interval 10.520 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.56 GB write, 682.80 MB/s write, 26.18 GB read, 488.91 MB/s read, 159.1 seconds Interval compaction: 36.56 GB write, 685.47 MB/s write, 26.18 GB read, 490.83 MB/s read, 159.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 33, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 33, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 22, pending-compaction-bytes-stops: 0, total-delays: 55, total-stops: 60, interval: 115 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5300363 Average: 2.6930 StdDev: 28.68 Min: 0 Median: 1.5065 Max: 14505 Percentiles: P50: 1.51 P75: 1.89 P99: 6.58 P99.9: 105.31 P99.99: 244.85 ------------------------------------------------------ [ 0, 1 ] 879058 16.585% 16.585% ### ( 1, 2 ] 3496572 65.969% 82.553% ############# ( 2, 3 ] 503381 9.497% 92.051% ## ( 3, 4 ] 205598 3.879% 95.929% # ( 4, 6 ] 156041 2.944% 98.873% # ( 6, 10 ] 46445 0.876% 99.750% ( 10, 15 ] 4431 0.084% 99.833% ( 15, 22 ] 515 0.010% 99.843% ( 22, 34 ] 48 0.001% 99.844% ( 34, 51 ] 34 0.001% 99.845% ( 51, 76 ] 91 0.002% 99.846% ( 76, 110 ] 3305 0.062% 99.909% ( 110, 170 ] 3383 0.064% 99.972% ( 170, 250 ] 995 0.019% 99.991% ( 250, 380 ] 692 0.013% 100.004% ( 380, 580 ] 589 0.011% 100.015% ( 580, 870 ] 384 0.007% 100.023% ( 870, 1300 ] 176 0.003% 100.026% ( 1300, 1900 ] 99 0.002% 100.028% ( 1900, 2900 ] 77 0.001% 100.029% ( 2900, 4400 ] 90 0.002% 100.031% ( 4400, 6600 ] 21 0.000% 100.031% ( 6600, 9900 ] 15 0.000% 100.032% ( 9900, 14000 ] 1 0.000% 100.032% ( 14000, 22000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 1428622 Average: 5.5585 StdDev: 113.43 Min: 0 Median: 1.6708 Max: 32155 Percentiles: P50: 1.67 P75: 2.37 P99: 9.36 P99.9: 246.99 P99.99: 668.55 ------------------------------------------------------ [ 0, 1 ] 140254 9.817% 9.817% ## ( 1, 2 ] 855835 59.906% 69.724% ############ ( 2, 3 ] 202927 14.204% 83.928% ### ( 3, 4 ] 95816 6.707% 90.635% # ( 4, 6 ] 94878 6.641% 97.276% # ( 6, 10 ] 29325 2.053% 99.329% ( 10, 15 ] 4631 0.324% 99.653% ( 15, 22 ] 583 0.041% 99.694% ( 22, 34 ] 56 0.004% 99.698% ( 34, 51 ] 41 0.003% 99.701% ( 51, 76 ] 134 0.009% 99.710% ( 76, 110 ] 1209 0.085% 99.795% ( 110, 170 ] 1003 0.070% 99.865% ( 170, 250 ] 522 0.037% 99.901% ( 250, 380 ] 541 0.038% 99.939% ( 380, 580 ] 563 0.039% 99.979% ( 580, 870 ] 531 0.037% 100.016% ( 870, 1300 ] 382 0.027% 100.043% ( 1300, 1900 ] 159 0.011% 100.054% ( 1900, 2900 ] 145 0.010% 100.064% ( 2900, 4400 ] 241 0.017% 100.081% ( 4400, 6600 ] 68 0.005% 100.086% ( 6600, 9900 ] 66 0.005% 100.090% ( 9900, 14000 ] 20 0.001% 100.092% ( 14000, 22000 ] 10 0.001% 100.092% ( 22000, 33000 ] 2 0.000% 100.092% ** Level 2 read latency histogram (micros): Count: 28271 Average: 2.0186 StdDev: 15.84 Min: 0 Median: 1.3411 Max: 2636 Percentiles: P50: 1.34 P75: 1.76 P99: 5.37 P99.9: 9.39 P99.99: 183.83 ------------------------------------------------------ [ 0, 1 ] 8446 29.875% 29.875% ###### ( 1, 2 ] 16678 58.993% 88.868% ############ ( 2, 3 ] 1693 5.988% 94.857% # ( 3, 4 ] 780 2.759% 97.616% # ( 4, 6 ] 572 2.023% 99.639% ( 6, 10 ] 87 0.308% 99.947% ( 10, 15 ] 7 0.025% 99.972% ( 15, 22 ] 2 0.007% 99.979% ( 22, 34 ] 1 0.004% 99.982% ( 51, 76 ] 1 0.004% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 1 0.004% 99.993% ( 250, 380 ] 1 0.004% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 759969 Average: 7.7489 StdDev: 95.76 Min: 0 Median: 1.7856 Max: 11142 Percentiles: P50: 1.79 P75: 2.78 P99: 9.90 P99.9: 707.27 P99.99: 1008.81 ------------------------------------------------------ [ 0, 1 ] 58533 7.702% 7.702% ## ( 1, 2 ] 409187 53.843% 61.545% ########### ( 2, 3 ] 131053 17.245% 78.789% ### ( 3, 4 ] 68254 8.981% 87.770% ## ( 4, 6 ] 70220 9.240% 97.010% ## ( 6, 10 ] 15516 2.042% 99.052% ( 10, 15 ] 2752 0.362% 99.414% ( 15, 22 ] 401 0.053% 99.467% ( 22, 34 ] 70 0.009% 99.476% ( 34, 51 ] 17 0.002% 99.478% ( 51, 76 ] 39 0.005% 99.483% ( 76, 110 ] 180 0.024% 99.507% ( 110, 170 ] 546 0.072% 99.579% ( 170, 250 ] 477 0.063% 99.642% ( 250, 380 ] 666 0.088% 99.729% ( 380, 580 ] 907 0.119% 99.849% ( 580, 870 ] 891 0.117% 99.966% ( 870, 1300 ] 570 0.075% 100.041% ( 1300, 1900 ] 257 0.034% 100.075% ( 1900, 2900 ] 185 0.024% 100.099% ( 2900, 4400 ] 188 0.025% 100.124% ( 4400, 6600 ] 35 0.005% 100.128% ( 6600, 9900 ] 9 0.001% 100.129% ( 9900, 14000 ] 1 0.000% 100.130% ** Level 4 read latency histogram (micros): Count: 37746 Average: 6.3182 StdDev: 99.13 Min: 0 Median: 1.7700 Max: 6163 Percentiles: P50: 1.77 P75: 2.69 P99: 8.41 P99.9: 767.03 P99.99: 2789.34 ------------------------------------------------------ [ 0, 1 ] 1969 5.216% 5.216% # ( 1, 2 ] 21954 58.162% 63.379% ############ ( 2, 3 ] 6340 16.796% 80.175% ### ( 3, 4 ] 3359 8.899% 89.074% ## ( 4, 6 ] 3512 9.304% 98.379% ## ( 6, 10 ] 389 1.031% 99.409% ( 10, 15 ] 85 0.225% 99.634% ( 15, 22 ] 14 0.037% 99.671% ( 22, 34 ] 2 0.005% 99.677% ( 34, 51 ] 3 0.008% 99.685% ( 76, 110 ] 9 0.024% 99.709% ( 110, 170 ] 7 0.019% 99.727% ( 170, 250 ] 28 0.074% 99.801% ( 250, 380 ] 14 0.037% 99.838% ( 380, 580 ] 11 0.029% 99.868% ( 580, 870 ] 19 0.050% 99.918% ( 870, 1300 ] 12 0.032% 99.950% ( 1300, 1900 ] 9 0.024% 99.974% ( 1900, 2900 ] 7 0.019% 99.992% ( 2900, 4400 ] 9 0.024% 100.016% ( 4400, 6600 ] 6 0.016% 100.032% ** Level 5 read latency histogram (micros): Count: 260 Average: 1066.1462 StdDev: 1262.82 Min: 78 Median: 480.0000 Max: 6583 Percentiles: P50: 480.00 P75: 1637.50 P99: 5646.67 P99.9: 6504.67 P99.99: 6583.00 ------------------------------------------------------ ( 76, 110 ] 24 9.231% 9.231% ## ( 110, 170 ] 45 17.308% 26.538% ### ( 170, 250 ] 22 8.462% 35.000% ## ( 250, 380 ] 23 8.846% 43.846% ## ( 380, 580 ] 32 12.308% 56.154% ## ( 580, 870 ] 18 6.923% 63.077% # ( 870, 1300 ] 22 8.462% 71.538% ## ( 1300, 1900 ] 16 6.154% 77.692% # ( 1900, 2900 ] 33 12.692% 90.385% ### ( 2900, 4400 ] 19 7.308% 97.692% # ( 4400, 6600 ] 6 2.308% 100.000% ** DB Stats ** Uptime(secs): 54.8 total, 9.9 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 197.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.481 H:M:S, 44.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 99.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.818 H:M:S, 69.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.448 micros/op 183558 ops/sec 60.101 seconds 11031999 operations; 177.9 MB/s Microseconds per write: Count: 11031999 Average: 5.4478 StdDev: 357.20 Min: 0 Median: 1.7371 Max: 671120 Percentiles: P50: 1.74 P75: 2.75 P99: 9.52 P99.9: 1109.34 P99.99: 2594.88 ------------------------------------------------------ [ 0, 1 ] 1487640 13.485% 13.485% ### ( 1, 2 ] 5464893 49.537% 63.022% ########## ( 2, 3 ] 1755190 15.910% 78.932% ### ( 3, 4 ] 1502035 13.615% 92.547% ### ( 4, 6 ] 592189 5.368% 97.915% # ( 6, 10 ] 136086 1.234% 99.148% ( 10, 15 ] 48001 0.435% 99.583% ( 15, 22 ] 11380 0.103% 99.687% ( 22, 34 ] 2422 0.022% 99.708% ( 34, 51 ] 290 0.003% 99.711% ( 51, 76 ] 38 0.000% 99.711% ( 76, 110 ] 7492 0.068% 99.779% ( 110, 170 ] 3203 0.029% 99.808% ( 170, 250 ] 323 0.003% 99.811% ( 250, 380 ] 206 0.002% 99.813% ( 380, 580 ] 29 0.000% 99.813% ( 580, 870 ] 16 0.000% 99.814% ( 870, 1300 ] 17129 0.155% 99.969% ( 1300, 1900 ] 81 0.001% 99.970% ( 1900, 2900 ] 3242 0.029% 99.999% ( 2900, 4400 ] 71 0.001% 100.000% ( 4400, 6600 ] 18 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 212974 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 11031999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11385022968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 594 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 29677789 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 32774106569 rocksdb.compact.write.bytes COUNT : 32542974790 rocksdb.flush.write.bytes COUNT : 11362086546 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 63 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 328 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11270268928 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4197376 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 32882338624 rocksdb.non.last.level.read.count COUNT : 7939938 rocksdb.block.checksum.compute.count COUNT : 7938813 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.389930 P95 : 3.928296 P99 : 8.039003 P100 : 671118.000000 COUNT : 11031999 SUM : 54954479 rocksdb.compaction.times.micros P50 : 990769.230769 P95 : 5730000.000000 P99 : 14960000.000000 P100 : 18902711.000000 COUNT : 88 SUM : 145911069 rocksdb.compaction.times.cpu_micros P50 : 947428.571429 P95 : 5473333.333333 P99 : 14960000.000000 P100 : 17497275.000000 COUNT : 88 SUM : 127857192 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 689.848485 P95 : 1263.450000 P99 : 17440.000000 P100 : 71913.000000 COUNT : 157 SUM : 215376 rocksdb.compaction.outfile.sync.micros P50 : 927.333333 P95 : 35266.666667 P99 : 105800.000000 P100 : 199918.000000 COUNT : 372 SUM : 2541498 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 95.241758 P95 : 804.750000 P99 : 2997.500000 P100 : 5003.000000 COUNT : 287 SUM : 62669 rocksdb.table.open.io.micros P50 : 1252.222222 P95 : 7647.391304 P99 : 12442.000000 P100 : 14888.000000 COUNT : 594 SUM : 1189906 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.593966 P95 : 7.512480 P99 : 10.971035 P100 : 32160.000000 COUNT : 7937367 SUM : 46876954 rocksdb.read.block.get.micros P50 : 394.754098 P95 : 3470.967742 P99 : 5580.235294 P100 : 11178.000000 COUNT : 1188 SUM : 992345 rocksdb.write.raw.block.micros P50 : 0.512507 P95 : 0.973764 P99 : 2.876806 P100 : 44606.000000 COUNT : 10636854 SUM : 20776067 rocksdb.numfiles.in.singlecompaction P50 : 3.250000 P95 : 7.833333 P99 : 20.862500 P100 : 35.000000 COUNT : 165 SUM : 659 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561362 P95 : 1147.523335 P99 : 2344.674282 P100 : 670935.000000 COUNT : 189370 SUM : 29698554 rocksdb.sst.read.micros P50 : 1.556685 P95 : 4.507034 P99 : 8.407233 P100 : 32155.000000 COUNT : 7940535 SUM : 30903349 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 11031999 SUM : 11385022968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 208965.517241 P95 : 353535.714286 P99 : 632350.000000 P100 : 758352.000000 COUNT : 157 SUM : 32278966 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 385 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0