[2024-11-29 17:46:53.969165] Starting SPDK v25.01-pre git sha1 35cd3e84d / DPDK 24.11.0-rc4 initialization... [2024-11-29 17:46:53.969266] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2834254 ] Set seed to 1732898813966770 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-29 17:46:54.131006] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.11.0-rc4 is used. There is no support for it in SPDK. Enabled only for validation. [2024-11-29 17:46:54.180930] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-29 17:46:54.204522] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-29 17:46:54.204562] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2834254' to capture a snapshot of events at runtime. [2024-11-29 17:46:54.204574] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-29 17:46:54.204582] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-29 17:46:54.204592] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2834254 for offline analysis/debug. [2024-11-29 17:46:54.205150] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Nov 29 17:46:58 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/29-17:47:01 ... thread 0: (1000000,1000000) ops and (351009.7,351009.7) ops/second in (2.848924,2.848924) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 378.01 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 346.2 2.37 2.11 12 0.197 0 0 0.0 0.0 L1 3/0 249.56 MB 25.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 254.9 254.7 0.99 0.95 1 0.988 255K 259 0.0 0.0 L2 3/2 191.05 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 244.3 244.1 0.79 0.75 2 0.395 195K 86 0.0 0.0 L3 10/0 867.22 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/6 96.94 GB 0.0 0.4 0.4 0.1 1.2 1.2 0.4 1.5 107.3 304.9 4.14 3.81 15 0.276 451K 345 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.4 0.1 1.2 1.2 0.2 1.5 107.3 304.9 4.14 3.81 15 0.276 451K 345 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.4 0.1 0.4 0.4 0.0 0.0 250.2 250.0 1.78 1.70 3 0.593 451K 345 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 346.2 2.37 2.11 12 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 414.74 MB/s write, 0.43 GB read, 146.02 MB/s read, 4.1 seconds Interval compaction: 1.23 GB write, 443.15 MB/s write, 0.43 GB read, 156.02 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 144727 Average: 2.0019 StdDev: 28.00 Min: 0 Median: 1.2749 Max: 8178 Percentiles: P50: 1.27 P75: 1.71 P99: 5.06 P99.9: 9.54 P99.99: 20.48 ------------------------------------------------------ [ 0, 1 ] 49647 34.304% 34.304% ####### ( 1, 2 ] 82649 57.107% 91.411% ########### ( 2, 3 ] 7042 4.866% 96.276% # ( 3, 4 ] 2932 2.026% 98.302% ( 4, 6 ] 1912 1.321% 99.623% ( 6, 10 ] 453 0.313% 99.936% ( 10, 15 ] 66 0.046% 99.982% ( 15, 22 ] 16 0.011% 99.993% ( 22, 34 ] 2 0.001% 99.994% ( 110, 170 ] 4 0.003% 99.997% ( 170, 250 ] 4 0.003% 100.000% ( 250, 380 ] 4 0.003% 100.003% ( 380, 580 ] 4 0.003% 100.006% ( 580, 870 ] 2 0.001% 100.007% ( 870, 1300 ] 2 0.001% 100.008% ( 2900, 4400 ] 2 0.001% 100.010% ( 4400, 6600 ] 1 0.001% 100.010% ( 6600, 9900 ] 1 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 570 Average: 6.9825 StdDev: 48.78 Min: 1 Median: 1.8935 Max: 906 Percentiles: P50: 1.89 P75: 2.76 P99: 128.00 P99.9: 906.00 P99.99: 906.00 ------------------------------------------------------ [ 0, 1 ] 50 8.772% 8.772% ## ( 1, 2 ] 263 46.140% 54.912% ######### ( 2, 3 ] 151 26.491% 81.404% ##### ( 3, 4 ] 58 10.175% 91.579% ## ( 4, 6 ] 28 4.912% 96.491% # ( 6, 10 ] 9 1.579% 98.070% ( 10, 15 ] 4 0.702% 98.772% ( 15, 22 ] 1 0.175% 98.947% ( 110, 170 ] 1 0.175% 99.123% ( 170, 250 ] 1 0.175% 99.298% ( 250, 380 ] 2 0.351% 99.649% ( 380, 580 ] 1 0.175% 99.825% ( 870, 1300 ] 1 0.175% 100.000% ** Level 2 read latency histogram (micros): Count: 31346 Average: 2.5310 StdDev: 18.79 Min: 0 Median: 1.5648 Max: 1985 Percentiles: P50: 1.56 P75: 1.94 P99: 6.53 P99.9: 12.93 P99.99: 566.54 ------------------------------------------------------ [ 0, 1 ] 3838 12.244% 12.244% ## ( 1, 2 ] 20954 66.847% 79.091% ############# ( 2, 3 ] 3619 11.545% 90.637% ## ( 3, 4 ] 1459 4.655% 95.291% # ( 4, 6 ] 1123 3.583% 98.874% # ( 6, 10 ] 300 0.957% 99.831% ( 10, 15 ] 37 0.118% 99.949% ( 15, 22 ] 4 0.013% 99.962% ( 22, 34 ] 2 0.006% 99.968% ( 51, 76 ] 2 0.006% 99.974% ( 110, 170 ] 1 0.003% 99.978% ( 250, 380 ] 2 0.006% 99.984% ( 380, 580 ] 2 0.006% 99.990% ( 870, 1300 ] 1 0.003% 99.994% ( 1300, 1900 ] 1 0.003% 99.997% ( 1900, 2900 ] 2 0.006% 100.003% ** Level 3 read latency histogram (micros): Count: 44 Average: 1611.4091 StdDev: 1299.70 Min: 253 Median: 1085.0000 Max: 4925 Percentiles: P50: 1085.00 P75: 2445.45 P99: 4925.00 P99.9: 4925.00 P99.99: 4925.00 ------------------------------------------------------ ( 250, 380 ] 5 11.364% 11.364% ## ( 380, 580 ] 9 20.455% 31.818% #### ( 580, 870 ] 7 15.909% 47.727% ### ( 870, 1300 ] 2 4.545% 52.273% # ( 1300, 1900 ] 4 9.091% 61.364% ## ( 1900, 2900 ] 11 25.000% 86.364% ##### ( 2900, 4400 ] 4 9.091% 95.455% ## ( 4400, 6600 ] 2 4.545% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1876.5333 StdDev: 1308.67 Min: 304 Median: 1300.0000 Max: 4892 Percentiles: P50: 1300.00 P75: 2685.71 P99: 4892.00 P99.9: 4892.00 P99.99: 4892.00 ------------------------------------------------------ ( 250, 380 ] 1 3.333% 3.333% # ( 380, 580 ] 4 13.333% 16.667% ### ( 580, 870 ] 2 6.667% 23.333% # ( 870, 1300 ] 8 26.667% 50.000% ##### ( 1300, 1900 ] 2 6.667% 56.667% # ( 1900, 2900 ] 7 23.333% 80.000% ##### ( 2900, 4400 ] 4 13.333% 93.333% ### ( 4400, 6600 ] 2 6.667% 100.000% # ** DB Stats ** Uptime(secs): 3.0 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 323.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.239 H:M:S, 7.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 345.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.239 H:M:S, 8.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-17:47:04 ... thread 0: (1000000,2000000) ops and (328350.6,339302.3) ops/second in (3.045525,5.894449) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/5 1.35 GB 81.8 0.7 0.0 0.7 2.5 1.8 0.0 1.4 94.2 321.8 8.02 7.42 29 0.277 767K 771 0.0 0.0 L1 3/3 249.56 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 254.9 254.7 0.99 0.95 1 0.988 255K 259 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 244.3 244.1 0.79 0.75 2 0.395 195K 86 0.0 0.0 L3 17/0 886.00 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 226.9 226.9 0.83 0.75 1 0.825 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 136.9 136.9 1.23 0.85 1 1.230 171K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/8 97.92 GB 0.0 1.5 0.7 0.8 3.3 2.5 0.4 1.9 131.3 285.2 11.86 10.73 34 0.349 1580K 1116 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.7 0.8 3.3 2.5 0.2 1.9 131.3 285.2 11.86 10.73 34 0.349 1580K 1116 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.7 0.8 1.5 0.7 0.0 0.0 232.4 232.2 6.70 6.12 8 0.837 1580K 1116 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.1 5.16 4.61 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.30 GB write, 555.21 MB/s write, 1.52 GB read, 255.51 MB/s read, 11.9 seconds Interval compaction: 3.30 GB write, 573.60 MB/s write, 1.52 GB read, 263.97 MB/s read, 11.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 409926 Average: 2.1286 StdDev: 19.26 Min: 0 Median: 1.4201 Max: 8178 Percentiles: P50: 1.42 P75: 1.82 P99: 5.47 P99.9: 9.76 P99.99: 14.28 ------------------------------------------------------ [ 0, 1 ] 97630 23.816% 23.816% ##### ( 1, 2 ] 255481 62.324% 86.140% ############ ( 2, 3 ] 34663 8.456% 94.596% ## ( 3, 4 ] 12155 2.965% 97.561% # ( 4, 6 ] 8028 1.958% 99.520% ( 6, 10 ] 1659 0.405% 99.924% ( 10, 15 ] 314 0.077% 100.001% ( 15, 22 ] 37 0.009% 100.010% ( 22, 34 ] 5 0.001% 100.011% ( 34, 51 ] 2 0.000% 100.012% ( 51, 76 ] 1 0.000% 100.012% ( 110, 170 ] 7 0.002% 100.014% ( 170, 250 ] 13 0.003% 100.017% ( 250, 380 ] 9 0.002% 100.019% ( 380, 580 ] 8 0.002% 100.021% ( 580, 870 ] 7 0.002% 100.023% ( 870, 1300 ] 6 0.001% 100.024% ( 1300, 1900 ] 2 0.000% 100.025% ( 1900, 2900 ] 2 0.000% 100.025% ( 2900, 4400 ] 3 0.001% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ( 6600, 9900 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 47751 Average: 2.1421 StdDev: 5.43 Min: 1 Median: 1.4891 Max: 906 Percentiles: P50: 1.49 P75: 1.87 P99: 5.49 P99.9: 11.69 P99.99: 187.99 ------------------------------------------------------ [ 0, 1 ] 8715 18.251% 18.251% #### ( 1, 2 ] 30994 64.908% 83.158% ############# ( 2, 3 ] 5280 11.057% 94.216% ## ( 3, 4 ] 1526 3.196% 97.412% # ( 4, 6 ] 1019 2.134% 99.546% ( 6, 10 ] 151 0.316% 99.862% ( 10, 15 ] 54 0.113% 99.975% ( 15, 22 ] 6 0.013% 99.987% ( 110, 170 ] 1 0.002% 99.990% ( 170, 250 ] 1 0.002% 99.992% ( 250, 380 ] 2 0.004% 99.996% ( 380, 580 ] 1 0.002% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47975 Average: 2.3898 StdDev: 15.20 Min: 0 Median: 1.5481 Max: 1985 Percentiles: P50: 1.55 P75: 1.92 P99: 5.97 P99.9: 11.77 P99.99: 400.25 ------------------------------------------------------ [ 0, 1 ] 6246 13.019% 13.019% ### ( 1, 2 ] 32371 67.475% 80.494% ############# ( 2, 3 ] 5561 11.591% 92.085% ## ( 3, 4 ] 1918 3.998% 96.083% # ( 4, 6 ] 1423 2.966% 99.050% # ( 6, 10 ] 391 0.815% 99.865% ( 10, 15 ] 48 0.100% 99.965% ( 15, 22 ] 4 0.008% 99.973% ( 22, 34 ] 3 0.006% 99.979% ( 51, 76 ] 2 0.004% 99.983% ( 110, 170 ] 1 0.002% 99.985% ( 250, 380 ] 2 0.004% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1300, 1900 ] 1 0.002% 99.998% ( 1900, 2900 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 42852 Average: 4.2765 StdDev: 66.53 Min: 1 Median: 1.7759 Max: 4925 Percentiles: P50: 1.78 P75: 2.49 P99: 7.43 P99.9: 318.21 P99.99: 3543.05 ------------------------------------------------------ [ 0, 1 ] 1907 4.450% 4.450% # ( 1, 2 ] 25158 58.709% 63.159% ############ ( 2, 3 ] 10376 24.214% 87.373% ##### ( 3, 4 ] 2302 5.372% 92.745% # ( 4, 6 ] 2520 5.881% 98.626% # ( 6, 10 ] 448 1.045% 99.671% ( 10, 15 ] 79 0.184% 99.855% ( 15, 22 ] 10 0.023% 99.879% ( 22, 34 ] 4 0.009% 99.888% ( 51, 76 ] 1 0.002% 99.890% ( 110, 170 ] 1 0.002% 99.893% ( 250, 380 ] 6 0.014% 99.907% ( 380, 580 ] 9 0.021% 99.928% ( 580, 870 ] 7 0.016% 99.944% ( 870, 1300 ] 3 0.007% 99.951% ( 1300, 1900 ] 4 0.009% 99.960% ( 1900, 2900 ] 11 0.026% 99.986% ( 2900, 4400 ] 4 0.009% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 180.8469 StdDev: 677.01 Min: 0 Median: 1.9115 Max: 4892 Percentiles: P50: 1.91 P75: 6.54 P99: 3950.00 P99.9: 4892.00 P99.99: 4892.00 ------------------------------------------------------ [ 0, 1 ] 57 17.812% 17.812% #### ( 1, 2 ] 113 35.312% 53.125% ####### ( 2, 3 ] 49 15.312% 68.438% ### ( 3, 4 ] 8 2.500% 70.938% # ( 4, 6 ] 8 2.500% 73.438% # ( 6, 10 ] 37 11.562% 85.000% ## ( 10, 15 ] 13 4.062% 89.062% # ( 15, 22 ] 2 0.625% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 4 1.250% 92.188% ( 580, 870 ] 2 0.625% 92.812% ( 870, 1300 ] 8 2.500% 95.312% # ( 1300, 1900 ] 2 0.625% 95.938% ( 1900, 2900 ] 7 2.188% 98.125% ( 2900, 4400 ] 4 1.250% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.618 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.379 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-17:47:07 ... thread 0: (1000000,3000000) ops and (329987.7,336139.5) ops/second in (3.030416,8.924865) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 1.78 GB 44.1 1.2 0.0 1.2 4.0 2.8 0.0 1.4 99.2 322.4 12.70 11.79 45 0.282 1279K 1239 0.0 0.0 L1 8/8 813.52 MB 0.0 1.0 0.8 0.2 1.0 0.8 0.2 1.3 237.3 236.6 4.50 4.37 2 2.251 1084K 2856 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 244.3 244.1 0.79 0.75 2 0.395 195K 86 0.0 0.0 L3 17/0 886.00 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 226.9 226.9 0.83 0.75 1 0.825 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 136.9 136.9 1.23 0.85 1 1.230 171K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/19 98.90 GB 0.0 2.8 1.3 1.5 5.6 4.0 0.4 2.0 143.5 284.7 20.04 18.52 51 0.393 2920K 4181 0.0 0.0 Int 0/0 0.00 KB 0.0 2.8 1.3 1.5 5.6 4.0 0.2 2.0 143.5 284.7 20.04 18.52 51 0.393 2920K 4181 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.8 1.3 1.5 2.8 1.3 0.0 0.0 238.6 238.2 12.06 11.35 11 1.096 2920K 4181 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 354.9 7.99 7.17 40 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.57 GB write, 625.64 MB/s write, 2.81 GB read, 315.36 MB/s read, 20.0 seconds Interval compaction: 5.57 GB write, 639.32 MB/s write, 2.81 GB read, 322.26 MB/s read, 20.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 664924 Average: 2.1240 StdDev: 16.76 Min: 0 Median: 1.4366 Max: 8178 Percentiles: P50: 1.44 P75: 1.83 P99: 5.40 P99.9: 9.81 P99.99: 14.38 ------------------------------------------------------ [ 0, 1 ] 146438 22.023% 22.023% #### ( 1, 2 ] 426047 64.075% 86.098% ############# ( 2, 3 ] 58476 8.794% 94.892% ## ( 3, 4 ] 19026 2.861% 97.754% # ( 4, 6 ] 11853 1.783% 99.536% ( 6, 10 ] 2542 0.382% 99.918% ( 10, 15 ] 543 0.082% 100.000% ( 15, 22 ] 53 0.008% 100.008% ( 22, 34 ] 10 0.002% 100.010% ( 34, 51 ] 4 0.001% 100.010% ( 51, 76 ] 3 0.000% 100.011% ( 110, 170 ] 8 0.001% 100.012% ( 170, 250 ] 24 0.004% 100.015% ( 250, 380 ] 16 0.002% 100.018% ( 380, 580 ] 8 0.001% 100.019% ( 580, 870 ] 13 0.002% 100.021% ( 870, 1300 ] 9 0.001% 100.022% ( 1300, 1900 ] 4 0.001% 100.023% ( 1900, 2900 ] 2 0.000% 100.023% ( 2900, 4400 ] 5 0.001% 100.024% ( 4400, 6600 ] 1 0.000% 100.024% ( 6600, 9900 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 118775 Average: 2.1299 StdDev: 8.97 Min: 1 Median: 1.4606 Max: 1314 Percentiles: P50: 1.46 P75: 1.84 P99: 5.23 P99.9: 10.97 P99.99: 333.24 ------------------------------------------------------ [ 0, 1 ] 23447 19.741% 19.741% #### ( 1, 2 ] 78036 65.701% 85.441% ############# ( 2, 3 ] 11707 9.856% 95.298% ## ( 3, 4 ] 3237 2.725% 98.023% # ( 4, 6 ] 1890 1.591% 99.614% ( 6, 10 ] 318 0.268% 99.882% ( 10, 15 ] 109 0.092% 99.974% ( 15, 22 ] 10 0.008% 99.982% ( 76, 110 ] 1 0.001% 99.983% ( 110, 170 ] 1 0.001% 99.984% ( 170, 250 ] 2 0.002% 99.986% ( 250, 380 ] 8 0.007% 99.992% ( 380, 580 ] 2 0.002% 99.994% ( 580, 870 ] 1 0.001% 99.995% ( 870, 1300 ] 4 0.003% 99.998% ( 1300, 1900 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47975 Average: 2.3898 StdDev: 15.20 Min: 0 Median: 1.5481 Max: 1985 Percentiles: P50: 1.55 P75: 1.92 P99: 5.97 P99.9: 11.77 P99.99: 400.25 ------------------------------------------------------ [ 0, 1 ] 6246 13.019% 13.019% ### ( 1, 2 ] 32371 67.475% 80.494% ############# ( 2, 3 ] 5561 11.591% 92.085% ## ( 3, 4 ] 1918 3.998% 96.083% # ( 4, 6 ] 1423 2.966% 99.050% # ( 6, 10 ] 391 0.815% 99.865% ( 10, 15 ] 48 0.100% 99.965% ( 15, 22 ] 4 0.008% 99.973% ( 22, 34 ] 3 0.006% 99.979% ( 51, 76 ] 2 0.004% 99.983% ( 110, 170 ] 1 0.002% 99.985% ( 250, 380 ] 2 0.004% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1300, 1900 ] 1 0.002% 99.998% ( 1900, 2900 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 42852 Average: 4.2765 StdDev: 66.53 Min: 1 Median: 1.7759 Max: 4925 Percentiles: P50: 1.78 P75: 2.49 P99: 7.43 P99.9: 318.21 P99.99: 3543.05 ------------------------------------------------------ [ 0, 1 ] 1907 4.450% 4.450% # ( 1, 2 ] 25158 58.709% 63.159% ############ ( 2, 3 ] 10376 24.214% 87.373% ##### ( 3, 4 ] 2302 5.372% 92.745% # ( 4, 6 ] 2520 5.881% 98.626% # ( 6, 10 ] 448 1.045% 99.671% ( 10, 15 ] 79 0.184% 99.855% ( 15, 22 ] 10 0.023% 99.879% ( 22, 34 ] 4 0.009% 99.888% ( 51, 76 ] 1 0.002% 99.890% ( 110, 170 ] 1 0.002% 99.893% ( 250, 380 ] 6 0.014% 99.907% ( 380, 580 ] 9 0.021% 99.928% ( 580, 870 ] 7 0.016% 99.944% ( 870, 1300 ] 3 0.007% 99.951% ( 1300, 1900 ] 4 0.009% 99.960% ( 1900, 2900 ] 11 0.026% 99.986% ( 2900, 4400 ] 4 0.009% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 180.8469 StdDev: 677.01 Min: 0 Median: 1.9115 Max: 4892 Percentiles: P50: 1.91 P75: 6.54 P99: 3950.00 P99.9: 4892.00 P99.99: 4892.00 ------------------------------------------------------ [ 0, 1 ] 57 17.812% 17.812% #### ( 1, 2 ] 113 35.312% 53.125% ####### ( 2, 3 ] 49 15.312% 68.438% ### ( 3, 4 ] 8 2.500% 70.938% # ( 4, 6 ] 8 2.500% 73.438% # ( 6, 10 ] 37 11.562% 85.000% ## ( 10, 15 ] 13 4.062% 89.062% # ( 15, 22 ] 2 0.625% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 4 1.250% 92.188% ( 580, 870 ] 2 0.625% 92.812% ( 870, 1300 ] 8 2.500% 95.312% # ( 1300, 1900 ] 2 0.625% 95.938% ( 1900, 2900 ] 7 2.188% 98.125% ( 2900, 4400 ] 4 1.250% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 323.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.009 H:M:S, 11.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.391 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-17:47:10 ... thread 0: (1000000,4000000) ops and (327991.7,334064.9) ops/second in (3.048858,11.973723) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 2.77 GB 151.1 2.1 0.0 2.1 5.8 3.8 0.0 1.6 113.8 317.8 18.82 17.55 62 0.304 2174K 2212 0.0 0.0 L1 8/8 813.52 MB 0.0 1.0 0.8 0.2 1.0 0.8 0.2 1.3 237.3 236.6 4.50 4.37 2 2.251 1084K 2856 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 244.3 244.1 0.79 0.75 2 0.395 195K 86 0.0 0.0 L3 17/0 886.00 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 226.9 226.9 0.83 0.75 1 0.825 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 136.9 136.9 1.23 0.85 1 1.230 171K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/19 99.88 GB 0.0 3.7 1.3 2.4 7.4 5.0 0.4 2.0 143.6 290.3 26.17 24.28 68 0.385 3816K 5154 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 1.3 2.4 7.4 5.0 0.2 2.0 143.6 290.3 26.17 24.28 68 0.385 3816K 5154 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 1.3 2.4 3.7 1.3 0.0 0.0 244.8 244.5 15.35 14.58 14 1.097 3816K 5154 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 355.2 10.82 9.70 54 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.42 GB write, 624.11 MB/s write, 3.67 GB read, 308.82 MB/s read, 26.2 seconds Interval compaction: 7.42 GB write, 634.28 MB/s write, 3.67 GB read, 313.86 MB/s read, 26.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 16, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1026735 Average: 2.1687 StdDev: 14.76 Min: 0 Median: 1.4704 Max: 8178 Percentiles: P50: 1.47 P75: 1.85 P99: 5.43 P99.9: 9.77 P99.99: 14.23 ------------------------------------------------------ [ 0, 1 ] 196642 19.152% 19.152% #### ( 1, 2 ] 673302 65.577% 84.729% ############# ( 2, 3 ] 100335 9.772% 94.501% ## ( 3, 4 ] 32380 3.154% 97.655% # ( 4, 6 ] 19310 1.881% 99.536% ( 6, 10 ] 3965 0.386% 99.922% ( 10, 15 ] 825 0.080% 100.002% ( 15, 22 ] 71 0.007% 100.009% ( 22, 34 ] 11 0.001% 100.010% ( 34, 51 ] 6 0.001% 100.011% ( 51, 76 ] 4 0.000% 100.011% ( 76, 110 ] 18 0.002% 100.013% ( 110, 170 ] 28 0.003% 100.016% ( 170, 250 ] 46 0.004% 100.020% ( 250, 380 ] 27 0.003% 100.023% ( 380, 580 ] 16 0.002% 100.024% ( 580, 870 ] 21 0.002% 100.026% ( 870, 1300 ] 13 0.001% 100.028% ( 1300, 1900 ] 9 0.001% 100.029% ( 1900, 2900 ] 3 0.000% 100.029% ( 2900, 4400 ] 6 0.001% 100.030% ( 4400, 6600 ] 1 0.000% 100.030% ( 6600, 9900 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 196275 Average: 2.2551 StdDev: 8.62 Min: 1 Median: 1.5060 Max: 1314 Percentiles: P50: 1.51 P75: 1.88 P99: 5.46 P99.9: 13.57 P99.99: 374.17 ------------------------------------------------------ [ 0, 1 ] 31514 16.056% 16.056% ### ( 1, 2 ] 131679 67.089% 83.145% ############# ( 2, 3 ] 22307 11.365% 94.510% ## ( 3, 4 ] 6156 3.136% 97.647% # ( 4, 6 ] 3645 1.857% 99.504% ( 6, 10 ] 650 0.331% 99.835% ( 10, 15 ] 179 0.091% 99.926% ( 15, 22 ] 17 0.009% 99.935% ( 22, 34 ] 1 0.001% 99.935% ( 51, 76 ] 2 0.001% 99.936% ( 76, 110 ] 47 0.024% 99.960% ( 110, 170 ] 28 0.014% 99.975% ( 170, 250 ] 17 0.009% 99.983% ( 250, 380 ] 14 0.007% 99.990% ( 380, 580 ] 8 0.004% 99.994% ( 580, 870 ] 5 0.003% 99.997% ( 870, 1300 ] 4 0.002% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 47975 Average: 2.3898 StdDev: 15.20 Min: 0 Median: 1.5481 Max: 1985 Percentiles: P50: 1.55 P75: 1.92 P99: 5.97 P99.9: 11.77 P99.99: 400.25 ------------------------------------------------------ [ 0, 1 ] 6246 13.019% 13.019% ### ( 1, 2 ] 32371 67.475% 80.494% ############# ( 2, 3 ] 5561 11.591% 92.085% ## ( 3, 4 ] 1918 3.998% 96.083% # ( 4, 6 ] 1423 2.966% 99.050% # ( 6, 10 ] 391 0.815% 99.865% ( 10, 15 ] 48 0.100% 99.965% ( 15, 22 ] 4 0.008% 99.973% ( 22, 34 ] 3 0.006% 99.979% ( 51, 76 ] 2 0.004% 99.983% ( 110, 170 ] 1 0.002% 99.985% ( 250, 380 ] 2 0.004% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1300, 1900 ] 1 0.002% 99.998% ( 1900, 2900 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 42852 Average: 4.2765 StdDev: 66.53 Min: 1 Median: 1.7759 Max: 4925 Percentiles: P50: 1.78 P75: 2.49 P99: 7.43 P99.9: 318.21 P99.99: 3543.05 ------------------------------------------------------ [ 0, 1 ] 1907 4.450% 4.450% # ( 1, 2 ] 25158 58.709% 63.159% ############ ( 2, 3 ] 10376 24.214% 87.373% ##### ( 3, 4 ] 2302 5.372% 92.745% # ( 4, 6 ] 2520 5.881% 98.626% # ( 6, 10 ] 448 1.045% 99.671% ( 10, 15 ] 79 0.184% 99.855% ( 15, 22 ] 10 0.023% 99.879% ( 22, 34 ] 4 0.009% 99.888% ( 51, 76 ] 1 0.002% 99.890% ( 110, 170 ] 1 0.002% 99.893% ( 250, 380 ] 6 0.014% 99.907% ( 380, 580 ] 9 0.021% 99.928% ( 580, 870 ] 7 0.016% 99.944% ( 870, 1300 ] 3 0.007% 99.951% ( 1300, 1900 ] 4 0.009% 99.960% ( 1900, 2900 ] 11 0.026% 99.986% ( 2900, 4400 ] 4 0.009% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 180.8469 StdDev: 677.01 Min: 0 Median: 1.9115 Max: 4892 Percentiles: P50: 1.91 P75: 6.54 P99: 3950.00 P99.9: 4892.00 P99.99: 4892.00 ------------------------------------------------------ [ 0, 1 ] 57 17.812% 17.812% #### ( 1, 2 ] 113 35.312% 53.125% ####### ( 2, 3 ] 49 15.312% 68.438% ### ( 3, 4 ] 8 2.500% 70.938% # ( 4, 6 ] 8 2.500% 73.438% # ( 6, 10 ] 37 11.562% 85.000% ## ( 10, 15 ] 13 4.062% 89.062% # ( 15, 22 ] 2 0.625% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 4 1.250% 92.188% ( 580, 870 ] 2 0.625% 92.812% ( 870, 1300 ] 8 2.500% 95.312% # ( 1300, 1900 ] 2 0.625% 95.938% ( 1900, 2900 ] 7 2.188% 98.125% ( 2900, 4400 ] 4 1.250% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 323.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.416 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.408 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-17:47:14 ... thread 0: (1000000,5000000) ops and (233849.1,307692.6) ops/second in (4.276261,16.249984) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 2.64 GB 12.6 2.9 0.0 2.9 7.6 4.7 0.0 1.6 120.6 315.5 24.55 22.89 78 0.315 3006K 3074 0.0 0.0 L1 16/16 1.83 GB 0.0 2.9 1.8 1.0 2.9 1.8 0.2 1.6 235.7 234.3 12.53 12.13 3 4.175 2997K 16K 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 244.3 244.1 0.79 0.75 2 0.395 195K 86 0.0 0.0 L3 17/0 886.00 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 226.9 226.9 0.83 0.75 1 0.825 190K 0 0.0 0.0 L4 174/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 136.9 136.9 1.23 0.85 1 1.230 171K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/31 100.79 GB 0.0 6.3 2.3 4.0 11.0 7.0 0.4 2.3 161.9 281.3 39.92 37.39 85 0.470 6560K 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.3 2.3 4.0 11.0 7.0 0.2 2.3 161.9 281.3 39.92 37.39 85 0.470 6560K 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.3 2.3 4.0 6.3 2.3 0.0 0.0 244.9 244.1 26.39 25.29 18 1.466 6560K 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.8 13.53 12.09 67 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.4 total, 16.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.97 GB write, 682.71 MB/s write, 6.31 GB read, 392.85 MB/s read, 39.9 seconds Interval compaction: 10.97 GB write, 690.92 MB/s write, 6.31 GB read, 397.57 MB/s read, 39.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 19, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1354791 Average: 2.2306 StdDev: 15.45 Min: 0 Median: 1.4653 Max: 8178 Percentiles: P50: 1.47 P75: 1.85 P99: 5.51 P99.9: 11.09 P99.99: 122.22 ------------------------------------------------------ [ 0, 1 ] 262708 19.391% 19.391% #### ( 1, 2 ] 891267 65.786% 85.177% ############# ( 2, 3 ] 127420 9.405% 94.582% ## ( 3, 4 ] 41440 3.059% 97.641% # ( 4, 6 ] 24321 1.795% 99.436% ( 6, 10 ] 6036 0.446% 99.882% ( 10, 15 ] 1123 0.083% 99.965% ( 15, 22 ] 139 0.010% 99.975% ( 22, 34 ] 17 0.001% 99.976% ( 34, 51 ] 11 0.001% 99.977% ( 51, 76 ] 7 0.001% 99.978% ( 76, 110 ] 126 0.009% 99.987% ( 110, 170 ] 199 0.015% 100.002% ( 170, 250 ] 124 0.009% 100.011% ( 250, 380 ] 81 0.006% 100.017% ( 380, 580 ] 57 0.004% 100.021% ( 580, 870 ] 39 0.003% 100.024% ( 870, 1300 ] 20 0.001% 100.025% ( 1300, 1900 ] 12 0.001% 100.026% ( 1900, 2900 ] 6 0.000% 100.027% ( 2900, 4400 ] 9 0.001% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ( 6600, 9900 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 301480 Average: 2.3482 StdDev: 11.12 Min: 1 Median: 1.4878 Max: 1359 Percentiles: P50: 1.49 P75: 1.86 P99: 5.72 P99.9: 92.17 P99.99: 578.86 ------------------------------------------------------ [ 0, 1 ] 52717 17.486% 17.486% ### ( 1, 2 ] 200941 66.652% 84.138% ############# ( 2, 3 ] 31069 10.305% 94.443% ## ( 3, 4 ] 9099 3.018% 97.461% # ( 4, 6 ] 5392 1.789% 99.250% ( 6, 10 ] 1586 0.526% 99.776% ( 10, 15 ] 264 0.088% 99.863% ( 15, 22 ] 46 0.015% 99.879% ( 22, 34 ] 2 0.001% 99.879% ( 51, 76 ] 14 0.005% 99.884% ( 76, 110 ] 102 0.034% 99.918% ( 110, 170 ] 146 0.048% 99.966% ( 170, 250 ] 27 0.009% 99.975% ( 250, 380 ] 19 0.006% 99.981% ( 380, 580 ] 26 0.009% 99.990% ( 580, 870 ] 15 0.005% 99.995% ( 870, 1300 ] 12 0.004% 99.999% ( 1300, 1900 ] 3 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 47975 Average: 2.3898 StdDev: 15.20 Min: 0 Median: 1.5481 Max: 1985 Percentiles: P50: 1.55 P75: 1.92 P99: 5.97 P99.9: 11.77 P99.99: 400.25 ------------------------------------------------------ [ 0, 1 ] 6246 13.019% 13.019% ### ( 1, 2 ] 32371 67.475% 80.494% ############# ( 2, 3 ] 5561 11.591% 92.085% ## ( 3, 4 ] 1918 3.998% 96.083% # ( 4, 6 ] 1423 2.966% 99.050% # ( 6, 10 ] 391 0.815% 99.865% ( 10, 15 ] 48 0.100% 99.965% ( 15, 22 ] 4 0.008% 99.973% ( 22, 34 ] 3 0.006% 99.979% ( 51, 76 ] 2 0.004% 99.983% ( 110, 170 ] 1 0.002% 99.985% ( 250, 380 ] 2 0.004% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1300, 1900 ] 1 0.002% 99.998% ( 1900, 2900 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 42852 Average: 4.2765 StdDev: 66.53 Min: 1 Median: 1.7759 Max: 4925 Percentiles: P50: 1.78 P75: 2.49 P99: 7.43 P99.9: 318.21 P99.99: 3543.05 ------------------------------------------------------ [ 0, 1 ] 1907 4.450% 4.450% # ( 1, 2 ] 25158 58.709% 63.159% ############ ( 2, 3 ] 10376 24.214% 87.373% ##### ( 3, 4 ] 2302 5.372% 92.745% # ( 4, 6 ] 2520 5.881% 98.626% # ( 6, 10 ] 448 1.045% 99.671% ( 10, 15 ] 79 0.184% 99.855% ( 15, 22 ] 10 0.023% 99.879% ( 22, 34 ] 4 0.009% 99.888% ( 51, 76 ] 1 0.002% 99.890% ( 110, 170 ] 1 0.002% 99.893% ( 250, 380 ] 6 0.014% 99.907% ( 380, 580 ] 9 0.021% 99.928% ( 580, 870 ] 7 0.016% 99.944% ( 870, 1300 ] 3 0.007% 99.951% ( 1300, 1900 ] 4 0.009% 99.960% ( 1900, 2900 ] 11 0.026% 99.986% ( 2900, 4400 ] 4 0.009% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 320 Average: 180.8469 StdDev: 677.01 Min: 0 Median: 1.9115 Max: 4892 Percentiles: P50: 1.91 P75: 6.54 P99: 3950.00 P99.9: 4892.00 P99.99: 4892.00 ------------------------------------------------------ [ 0, 1 ] 57 17.812% 17.812% #### ( 1, 2 ] 113 35.312% 53.125% ####### ( 2, 3 ] 49 15.312% 68.438% ### ( 3, 4 ] 8 2.500% 70.938% # ( 4, 6 ] 8 2.500% 73.438% # ( 6, 10 ] 37 11.562% 85.000% ## ( 10, 15 ] 13 4.062% 89.062% # ( 15, 22 ] 2 0.625% 89.688% ( 110, 170 ] 1 0.312% 90.000% ( 170, 250 ] 2 0.625% 90.625% ( 250, 380 ] 1 0.312% 90.938% ( 380, 580 ] 4 1.250% 92.188% ( 580, 870 ] 2 0.625% 92.812% ( 870, 1300 ] 8 2.500% 95.312% # ( 1300, 1900 ] 2 0.625% 95.938% ( 1900, 2900 ] 7 2.188% 98.125% ( 2900, 4400 ] 4 1.250% 99.375% ( 4400, 6600 ] 2 0.625% 100.000% ** DB Stats ** Uptime(secs): 16.4 total, 4.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 299.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.076 H:M:S, 18.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 230.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.660 H:M:S, 38.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-17:47:32 ... thread 0: (1000000,6000000) ops and (56510.2,176751.8) ops/second in (17.695914,33.945898) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 2/2 1.35 GB 0.0 5.8 0.0 5.8 11.5 5.6 0.0 2.0 155.1 305.1 38.56 36.32 99 0.390 6073K 11K 0.0 0.0 L1 9/9 1.01 GB 0.0 7.0 4.1 2.9 6.9 4.0 0.2 1.7 229.0 226.2 31.22 29.81 4 7.806 7261K 86K 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 3.1 1.5 244.3 244.1 0.79 0.75 2 0.395 195K 86 0.0 0.0 L3 31/9 3.04 GB 2.0 0.2 0.2 0.0 0.2 0.2 3.1 1.0 226.9 226.9 0.83 0.75 1 0.825 190K 0 0.0 0.0 L4 184/25 10.55 GB 1.1 0.2 0.2 0.0 0.2 0.2 0.8 1.0 136.9 136.9 1.23 0.85 1 1.230 171K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1271/45 101.70 GB 0.0 13.4 4.6 8.8 18.9 10.2 7.2 3.3 188.3 266.8 72.63 68.49 107 0.679 13M 98K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.4 4.6 8.8 18.9 10.2 7.1 3.3 188.3 266.8 72.63 68.49 107 0.679 13M 98K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.4 4.6 8.8 13.3 4.5 0.0 0.0 243.1 241.4 56.27 53.88 25 2.251 13M 98K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 354.2 16.36 14.61 82 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.1 total, 33.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.92 GB write, 567.54 MB/s write, 13.36 GB read, 400.68 MB/s read, 72.6 seconds Interval compaction: 18.92 GB write, 570.80 MB/s write, 13.36 GB read, 402.98 MB/s read, 72.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 20, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2639225 Average: 2.4121 StdDev: 16.27 Min: 0 Median: 1.4505 Max: 8178 Percentiles: P50: 1.45 P75: 1.83 P99: 5.74 P99.9: 108.49 P99.99: 271.04 ------------------------------------------------------ [ 0, 1 ] 537819 20.378% 20.378% #### ( 1, 2 ] 1735208 65.747% 86.125% ############# ( 2, 3 ] 226205 8.571% 94.696% ## ( 3, 4 ] 75509 2.861% 97.557% # ( 4, 6 ] 43765 1.658% 99.215% ( 6, 10 ] 13799 0.523% 99.738% ( 10, 15 ] 2212 0.084% 99.822% ( 15, 22 ] 560 0.021% 99.843% ( 22, 34 ] 27 0.001% 99.844% ( 34, 51 ] 15 0.001% 99.844% ( 51, 76 ] 39 0.001% 99.846% ( 76, 110 ] 1494 0.057% 99.903% ( 110, 170 ] 1699 0.064% 99.967% ( 170, 250 ] 545 0.021% 99.988% ( 250, 380 ] 402 0.015% 100.003% ( 380, 580 ] 268 0.010% 100.013% ( 580, 870 ] 134 0.005% 100.018% ( 870, 1300 ] 44 0.002% 100.020% ( 1300, 1900 ] 21 0.001% 100.020% ( 1900, 2900 ] 11 0.000% 100.021% ( 2900, 4400 ] 16 0.001% 100.021% ( 4400, 6600 ] 2 0.000% 100.022% ( 6600, 9900 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 770896 Average: 2.6860 StdDev: 22.40 Min: 1 Median: 1.4634 Max: 4277 Percentiles: P50: 1.46 P75: 1.85 P99: 6.78 P99.9: 143.51 P99.99: 626.05 ------------------------------------------------------ [ 0, 1 ] 156686 20.325% 20.325% #### ( 1, 2 ] 493626 64.033% 84.358% ############# ( 2, 3 ] 71334 9.253% 93.611% ## ( 3, 4 ] 23146 3.002% 96.614% # ( 4, 6 ] 17200 2.231% 98.845% ( 6, 10 ] 6110 0.793% 99.638% ( 10, 15 ] 773 0.100% 99.738% ( 15, 22 ] 192 0.025% 99.763% ( 22, 34 ] 9 0.001% 99.764% ( 34, 51 ] 2 0.000% 99.764% ( 51, 76 ] 60 0.008% 99.772% ( 76, 110 ] 603 0.078% 99.850% ( 110, 170 ] 695 0.090% 99.940% ( 170, 250 ] 163 0.021% 99.961% ( 250, 380 ] 102 0.013% 99.975% ( 380, 580 ] 110 0.014% 99.989% ( 580, 870 ] 75 0.010% 99.999% ( 870, 1300 ] 64 0.008% 100.007% ( 1300, 1900 ] 21 0.003% 100.010% ( 1900, 2900 ] 4 0.001% 100.010% ( 2900, 4400 ] 11 0.001% 100.012% ** Level 2 read latency histogram (micros): Count: 47975 Average: 2.3898 StdDev: 15.20 Min: 0 Median: 1.5481 Max: 1985 Percentiles: P50: 1.55 P75: 1.92 P99: 5.97 P99.9: 11.77 P99.99: 400.25 ------------------------------------------------------ [ 0, 1 ] 6246 13.019% 13.019% ### ( 1, 2 ] 32371 67.475% 80.494% ############# ( 2, 3 ] 5561 11.591% 92.085% ## ( 3, 4 ] 1918 3.998% 96.083% # ( 4, 6 ] 1423 2.966% 99.050% # ( 6, 10 ] 391 0.815% 99.865% ( 10, 15 ] 48 0.100% 99.965% ( 15, 22 ] 4 0.008% 99.973% ( 22, 34 ] 3 0.006% 99.979% ( 51, 76 ] 2 0.004% 99.983% ( 110, 170 ] 1 0.002% 99.985% ( 250, 380 ] 2 0.004% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1300, 1900 ] 1 0.002% 99.998% ( 1900, 2900 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 42852 Average: 4.2765 StdDev: 66.53 Min: 1 Median: 1.7759 Max: 4925 Percentiles: P50: 1.78 P75: 2.49 P99: 7.43 P99.9: 318.21 P99.99: 3543.05 ------------------------------------------------------ [ 0, 1 ] 1907 4.450% 4.450% # ( 1, 2 ] 25158 58.709% 63.159% ############ ( 2, 3 ] 10376 24.214% 87.373% ##### ( 3, 4 ] 2302 5.372% 92.745% # ( 4, 6 ] 2520 5.881% 98.626% # ( 6, 10 ] 448 1.045% 99.671% ( 10, 15 ] 79 0.184% 99.855% ( 15, 22 ] 10 0.023% 99.879% ( 22, 34 ] 4 0.009% 99.888% ( 51, 76 ] 1 0.002% 99.890% ( 110, 170 ] 1 0.002% 99.893% ( 250, 380 ] 6 0.014% 99.907% ( 380, 580 ] 9 0.021% 99.928% ( 580, 870 ] 7 0.016% 99.944% ( 870, 1300 ] 3 0.007% 99.951% ( 1300, 1900 ] 4 0.009% 99.960% ( 1900, 2900 ] 11 0.026% 99.986% ( 2900, 4400 ] 4 0.009% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 4 read latency histogram (micros): Count: 2719 Average: 148.2648 StdDev: 439.54 Min: 0 Median: 3.2139 Max: 4892 Percentiles: P50: 3.21 P75: 9.23 P99: 2573.18 P99.9: 4606.07 P99.99: 4892.00 ------------------------------------------------------ [ 0, 1 ] 82 3.016% 3.016% # ( 1, 2 ] 682 25.083% 28.099% ##### ( 2, 3 ] 520 19.125% 47.223% #### ( 3, 4 ] 353 12.983% 60.206% ### ( 4, 6 ] 298 10.960% 71.166% ## ( 6, 10 ] 129 4.744% 75.910% # ( 10, 15 ] 39 1.434% 77.345% ( 15, 22 ] 12 0.441% 77.786% ( 76, 110 ] 11 0.405% 78.191% ( 110, 170 ] 51 1.876% 80.066% ( 170, 250 ] 94 3.457% 83.523% # ( 250, 380 ] 117 4.303% 87.826% # ( 380, 580 ] 127 4.671% 92.497% # ( 580, 870 ] 93 3.420% 95.918% # ( 870, 1300 ] 52 1.912% 97.830% ( 1300, 1900 ] 17 0.625% 98.455% ( 1900, 2900 ] 22 0.809% 99.264% ( 2900, 4400 ] 17 0.625% 99.890% ( 4400, 6600 ] 3 0.110% 100.000% ** DB Stats ** Uptime(secs): 34.1 total, 17.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 172.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.912 H:M:S, 52.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 55.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:14.836 H:M:S, 83.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/29-17:47:36 ... thread 0: (1000000,7000000) ops and (218884.0,181749.6) ops/second in (4.568631,38.514529) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 2.33 GB 69.2 6.5 0.0 6.5 13.1 6.6 0.0 2.0 145.7 295.4 45.37 41.34 114 0.398 6713K 12K 0.0 0.0 L1 9/9 1.01 GB 0.0 7.0 4.1 2.9 6.9 4.0 0.2 1.7 229.0 226.2 31.22 29.81 4 7.806 7261K 86K 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 3.1 1.5 244.3 244.1 0.79 0.75 2 0.395 195K 86 0.0 0.0 L3 14/1 920.23 MB 0.9 0.2 0.2 0.0 0.2 0.2 3.1 1.0 226.9 226.9 0.83 0.75 1 0.825 190K 0 0.0 0.0 L4 175/18 11.02 GB 1.0 2.7 2.3 0.4 2.7 2.3 0.8 1.2 118.6 118.4 23.08 12.78 18 1.282 2705K 1510 0.0 0.0 L5 1064/0 87.42 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/34 102.68 GB 0.0 16.5 6.7 9.8 23.0 13.3 8.9 3.5 166.6 232.8 101.29 85.44 139 0.729 17M 100K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.5 6.7 9.8 23.0 13.3 8.8 3.5 166.6 232.8 101.29 85.44 139 0.729 17M 100K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.5 6.7 9.8 16.4 6.6 0.0 0.0 209.5 208.2 80.57 68.19 44 1.831 17M 100K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 328.5 20.71 17.24 95 0.218 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.7 total, 38.5 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.03 GB write, 609.07 MB/s write, 16.48 GB read, 436.00 MB/s read, 101.3 seconds Interval compaction: 23.03 GB write, 612.16 MB/s write, 16.48 GB read, 438.21 MB/s read, 101.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 42, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 42, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3004858 Average: 2.6448 StdDev: 29.49 Min: 0 Median: 1.4909 Max: 10225 Percentiles: P50: 1.49 P75: 1.88 P99: 5.97 P99.9: 102.89 P99.99: 271.82 ------------------------------------------------------ [ 0, 1 ] 551756 18.362% 18.362% #### ( 1, 2 ] 1936642 64.450% 82.812% ############# ( 2, 3 ] 311250 10.358% 93.171% ## ( 3, 4 ] 102480 3.410% 96.581% # ( 4, 6 ] 73652 2.451% 99.032% ( 6, 10 ] 20729 0.690% 99.722% ( 10, 15 ] 3375 0.112% 99.834% ( 15, 22 ] 690 0.023% 99.857% ( 22, 34 ] 31 0.001% 99.858% ( 34, 51 ] 19 0.001% 99.859% ( 51, 76 ] 40 0.001% 99.860% ( 76, 110 ] 1506 0.050% 99.911% ( 110, 170 ] 1738 0.058% 99.968% ( 170, 250 ] 578 0.019% 99.988% ( 250, 380 ] 438 0.015% 100.002% ( 380, 580 ] 299 0.010% 100.012% ( 580, 870 ] 171 0.006% 100.018% ( 870, 1300 ] 65 0.002% 100.020% ( 1300, 1900 ] 59 0.002% 100.022% ( 1900, 2900 ] 58 0.002% 100.024% ( 2900, 4400 ] 68 0.002% 100.026% ( 4400, 6600 ] 15 0.000% 100.027% ( 6600, 9900 ] 9 0.000% 100.027% ( 9900, 14000 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1297619 Average: 5.0049 StdDev: 84.18 Min: 1 Median: 1.6591 Max: 10699 Percentiles: P50: 1.66 P75: 2.36 P99: 8.54 P99.9: 95.07 P99.99: 245.07 ------------------------------------------------------ [ 0, 1 ] 162153 12.496% 12.496% ## ( 1, 2 ] 738399 56.904% 69.400% ########### ( 2, 3 ] 204564 15.765% 85.165% ### ( 3, 4 ] 84678 6.526% 91.691% # ( 4, 6 ] 82812 6.382% 98.072% # ( 6, 10 ] 18951 1.460% 99.533% ( 10, 15 ] 3765 0.290% 99.823% ( 15, 22 ] 551 0.042% 99.865% ( 22, 34 ] 36 0.003% 99.868% ( 34, 51 ] 7 0.001% 99.869% ( 51, 76 ] 66 0.005% 99.874% ( 76, 110 ] 605 0.047% 99.920% ( 110, 170 ] 708 0.055% 99.975% ( 170, 250 ] 207 0.016% 99.991% ( 250, 380 ] 184 0.014% 100.005% ( 380, 580 ] 275 0.021% 100.026% ( 580, 870 ] 270 0.021% 100.047% ( 870, 1300 ] 273 0.021% 100.068% ( 1300, 1900 ] 185 0.014% 100.082% ( 1900, 2900 ] 261 0.020% 100.103% ( 2900, 4400 ] 282 0.022% 100.124% ( 4400, 6600 ] 67 0.005% 100.129% ( 6600, 9900 ] 23 0.002% 100.131% ( 9900, 14000 ] 2 0.000% 100.131% ** Level 2 read latency histogram (micros): Count: 47975 Average: 2.3898 StdDev: 15.20 Min: 0 Median: 1.5481 Max: 1985 Percentiles: P50: 1.55 P75: 1.92 P99: 5.97 P99.9: 11.77 P99.99: 400.25 ------------------------------------------------------ [ 0, 1 ] 6246 13.019% 13.019% ### ( 1, 2 ] 32371 67.475% 80.494% ############# ( 2, 3 ] 5561 11.591% 92.085% ## ( 3, 4 ] 1918 3.998% 96.083% # ( 4, 6 ] 1423 2.966% 99.050% # ( 6, 10 ] 391 0.815% 99.865% ( 10, 15 ] 48 0.100% 99.965% ( 15, 22 ] 4 0.008% 99.973% ( 22, 34 ] 3 0.006% 99.979% ( 51, 76 ] 2 0.004% 99.983% ( 110, 170 ] 1 0.002% 99.985% ( 250, 380 ] 2 0.004% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1300, 1900 ] 1 0.002% 99.998% ( 1900, 2900 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 43173 Average: 6.7996 StdDev: 102.57 Min: 1 Median: 1.7800 Max: 4925 Percentiles: P50: 1.78 P75: 2.50 P99: 8.01 P99.9: 1694.23 P99.99: 4368.27 ------------------------------------------------------ [ 0, 1 ] 1907 4.417% 4.417% # ( 1, 2 ] 25231 58.442% 62.859% ############ ( 2, 3 ] 10510 24.344% 87.203% ##### ( 3, 4 ] 2328 5.392% 92.595% # ( 4, 6 ] 2536 5.874% 98.469% # ( 6, 10 ] 456 1.056% 99.525% ( 10, 15 ] 79 0.183% 99.708% ( 15, 22 ] 10 0.023% 99.731% ( 22, 34 ] 4 0.009% 99.741% ( 51, 76 ] 1 0.002% 99.743% ( 110, 170 ] 2 0.005% 99.748% ( 250, 380 ] 7 0.016% 99.764% ( 380, 580 ] 14 0.032% 99.796% ( 580, 870 ] 15 0.035% 99.831% ( 870, 1300 ] 18 0.042% 99.873% ( 1300, 1900 ] 18 0.042% 99.914% ( 1900, 2900 ] 18 0.042% 99.956% ( 2900, 4400 ] 15 0.035% 99.991% ( 4400, 6600 ] 4 0.009% 100.000% ** Level 4 read latency histogram (micros): Count: 96659 Average: 35.2916 StdDev: 271.62 Min: 0 Median: 2.0331 Max: 9165 Percentiles: P50: 2.03 P75: 3.13 P99: 961.57 P99.9: 3664.88 P99.99: 4217.80 ------------------------------------------------------ [ 0, 1 ] 1396 1.444% 1.444% ( 1, 2 ] 46155 47.750% 49.195% ########## ( 2, 3 ] 23554 24.368% 73.563% ##### ( 3, 4 ] 10941 11.319% 84.882% ## ( 4, 6 ] 9818 10.157% 95.039% ## ( 6, 10 ] 1711 1.770% 96.809% ( 10, 15 ] 394 0.408% 97.217% ( 15, 22 ] 59 0.061% 97.278% ( 22, 34 ] 7 0.007% 97.285% ( 34, 51 ] 3 0.003% 97.288% ( 51, 76 ] 3 0.003% 97.292% ( 76, 110 ] 22 0.023% 97.314% ( 110, 170 ] 78 0.081% 97.395% ( 170, 250 ] 192 0.199% 97.594% ( 250, 380 ] 291 0.301% 97.895% ( 380, 580 ] 459 0.475% 98.370% ( 580, 870 ] 527 0.545% 98.915% ( 870, 1300 ] 387 0.400% 99.315% ( 1300, 1900 ] 246 0.255% 99.570% ( 1900, 2900 ] 199 0.206% 99.775% ( 2900, 4400 ] 236 0.244% 100.020% ( 4400, 6600 ] 46 0.048% 100.067% ( 6600, 9900 ] 8 0.008% 100.076% ** Level 5 read latency histogram (micros): Count: 100 Average: 1137.4100 StdDev: 1285.49 Min: 86 Median: 580.0000 Max: 6044 Percentiles: P50: 580.00 P75: 1525.00 P99: 6044.00 P99.9: 6044.00 P99.99: 6044.00 ------------------------------------------------------ ( 76, 110 ] 3 3.000% 3.000% # ( 110, 170 ] 9 9.000% 12.000% ## ( 170, 250 ] 10 10.000% 22.000% ## ( 250, 380 ] 16 16.000% 38.000% ### ( 380, 580 ] 12 12.000% 50.000% ## ( 580, 870 ] 8 8.000% 58.000% ## ( 870, 1300 ] 14 14.000% 72.000% ### ( 1300, 1900 ] 8 8.000% 80.000% ## ( 1900, 2900 ] 9 9.000% 89.000% ## ( 2900, 4400 ] 6 6.000% 95.000% # ( 4400, 6600 ] 5 5.000% 100.000% # ** DB Stats ** Uptime(secs): 38.7 total, 4.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 177.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.643 H:M:S, 50.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 215.42 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.731 H:M:S, 37.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/29-17:47:40 ... thread 0: (1000000,8000000) ops and (316399.5,191961.2) ops/second in (3.160561,41.675090) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/6 3.25 GB 169.9 7.3 0.0 7.3 14.9 7.6 0.0 2.0 145.4 295.4 51.54 47.10 130 0.396 7608K 13K 0.0 0.0 L1 9/9 1.01 GB 0.0 7.0 4.1 2.9 6.9 4.0 0.2 1.7 229.0 226.2 31.22 29.81 4 7.806 7261K 86K 0.0 0.0 L2 1/0 3.83 MB 0.0 0.2 0.1 0.1 0.2 0.1 3.1 1.5 244.3 244.1 0.79 0.75 2 0.395 195K 86 0.0 0.0 L3 14/1 920.23 MB 0.9 0.2 0.2 0.0 0.2 0.2 3.1 1.0 226.9 226.9 0.83 0.75 1 0.825 190K 0 0.0 0.0 L4 175/18 11.02 GB 1.0 2.7 2.3 0.4 2.7 2.3 0.8 1.2 118.6 118.4 23.08 12.78 18 1.282 2705K 1510 0.0 0.0 L5 1064/0 87.42 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1276/34 103.60 GB 0.0 17.3 6.7 10.6 24.8 14.2 8.9 3.3 165.3 236.4 107.46 91.19 155 0.693 17M 101K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.3 6.7 10.6 24.8 14.2 8.8 3.3 165.3 236.4 107.46 91.19 155 0.693 17M 101K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.3 6.7 10.6 17.2 6.6 0.0 0.0 211.4 210.2 83.99 71.54 47 1.787 17M 101K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 330.2 23.46 19.65 108 0.217 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.9 total, 41.7 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.81 GB write, 606.71 MB/s write, 17.34 GB read, 424.15 MB/s read, 107.5 seconds Interval compaction: 24.81 GB write, 609.55 MB/s write, 17.34 GB read, 426.14 MB/s read, 107.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 47, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 47, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3356046 Average: 2.6400 StdDev: 28.14 Min: 0 Median: 1.5136 Max: 10225 Percentiles: P50: 1.51 P75: 1.90 P99: 5.99 P99.9: 90.94 P99.99: 228.93 ------------------------------------------------------ [ 0, 1 ] 571698 17.035% 17.035% ### ( 1, 2 ] 2153970 64.182% 81.217% ############# ( 2, 3 ] 380022 11.324% 92.540% ## ( 3, 4 ] 124543 3.711% 96.251% # ( 4, 6 ] 92789 2.765% 99.016% # ( 6, 10 ] 24208 0.721% 99.737% ( 10, 15 ] 3943 0.117% 99.855% ( 15, 22 ] 759 0.023% 99.877% ( 22, 34 ] 37 0.001% 99.879% ( 34, 51 ] 20 0.001% 99.879% ( 51, 76 ] 41 0.001% 99.880% ( 76, 110 ] 1506 0.045% 99.925% ( 110, 170 ] 1744 0.052% 99.977% ( 170, 250 ] 587 0.017% 99.995% ( 250, 380 ] 447 0.013% 100.008% ( 380, 580 ] 303 0.009% 100.017% ( 580, 870 ] 176 0.005% 100.022% ( 870, 1300 ] 72 0.002% 100.024% ( 1300, 1900 ] 59 0.002% 100.026% ( 1900, 2900 ] 60 0.002% 100.028% ( 2900, 4400 ] 70 0.002% 100.030% ( 4400, 6600 ] 15 0.000% 100.030% ( 6600, 9900 ] 9 0.000% 100.031% ( 9900, 14000 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 1381398 Average: 4.8948 StdDev: 81.69 Min: 1 Median: 1.6637 Max: 10699 Percentiles: P50: 1.66 P75: 2.36 P99: 8.56 P99.9: 99.69 P99.99: 280.01 ------------------------------------------------------ [ 0, 1 ] 165408 11.974% 11.974% ## ( 1, 2 ] 791464 57.294% 69.268% ########### ( 2, 3 ] 221044 16.001% 85.270% ### ( 3, 4 ] 89425 6.474% 91.743% # ( 4, 6 ] 87093 6.305% 98.048% # ( 6, 10 ] 20575 1.489% 99.537% ( 10, 15 ] 3861 0.279% 99.817% ( 15, 22 ] 560 0.041% 99.858% ( 22, 34 ] 39 0.003% 99.860% ( 34, 51 ] 7 0.001% 99.861% ( 51, 76 ] 80 0.006% 99.867% ( 76, 110 ] 661 0.048% 99.915% ( 110, 170 ] 751 0.054% 99.969% ( 170, 250 ] 242 0.018% 99.986% ( 250, 380 ] 216 0.016% 100.002% ( 380, 580 ] 300 0.022% 100.024% ( 580, 870 ] 278 0.020% 100.044% ( 870, 1300 ] 278 0.020% 100.064% ( 1300, 1900 ] 186 0.013% 100.077% ( 1900, 2900 ] 261 0.019% 100.096% ( 2900, 4400 ] 282 0.020% 100.117% ( 4400, 6600 ] 67 0.005% 100.122% ( 6600, 9900 ] 23 0.002% 100.123% ( 9900, 14000 ] 2 0.000% 100.123% ** Level 2 read latency histogram (micros): Count: 47975 Average: 2.3898 StdDev: 15.20 Min: 0 Median: 1.5481 Max: 1985 Percentiles: P50: 1.55 P75: 1.92 P99: 5.97 P99.9: 11.77 P99.99: 400.25 ------------------------------------------------------ [ 0, 1 ] 6246 13.019% 13.019% ### ( 1, 2 ] 32371 67.475% 80.494% ############# ( 2, 3 ] 5561 11.591% 92.085% ## ( 3, 4 ] 1918 3.998% 96.083% # ( 4, 6 ] 1423 2.966% 99.050% # ( 6, 10 ] 391 0.815% 99.865% ( 10, 15 ] 48 0.100% 99.965% ( 15, 22 ] 4 0.008% 99.973% ( 22, 34 ] 3 0.006% 99.979% ( 51, 76 ] 2 0.004% 99.983% ( 110, 170 ] 1 0.002% 99.985% ( 250, 380 ] 2 0.004% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1300, 1900 ] 1 0.002% 99.998% ( 1900, 2900 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 43537 Average: 6.8539 StdDev: 102.36 Min: 1 Median: 1.7839 Max: 4925 Percentiles: P50: 1.78 P75: 2.51 P99: 8.12 P99.9: 1682.10 P99.99: 4364.63 ------------------------------------------------------ [ 0, 1 ] 1907 4.380% 4.380% # ( 1, 2 ] 25336 58.194% 62.574% ############ ( 2, 3 ] 10703 24.584% 87.158% ##### ( 3, 4 ] 2362 5.425% 92.583% # ( 4, 6 ] 2548 5.852% 98.436% # ( 6, 10 ] 463 1.063% 99.499% ( 10, 15 ] 79 0.181% 99.681% ( 15, 22 ] 10 0.023% 99.704% ( 22, 34 ] 4 0.009% 99.713% ( 51, 76 ] 1 0.002% 99.715% ( 76, 110 ] 2 0.005% 99.720% ( 110, 170 ] 6 0.014% 99.734% ( 170, 250 ] 3 0.007% 99.740% ( 250, 380 ] 8 0.018% 99.759% ( 380, 580 ] 15 0.034% 99.793% ( 580, 870 ] 16 0.037% 99.830% ( 870, 1300 ] 19 0.044% 99.874% ( 1300, 1900 ] 18 0.041% 99.915% ( 1900, 2900 ] 18 0.041% 99.956% ( 2900, 4400 ] 15 0.034% 99.991% ( 4400, 6600 ] 4 0.009% 100.000% ** Level 4 read latency histogram (micros): Count: 96659 Average: 35.2916 StdDev: 271.62 Min: 0 Median: 2.0331 Max: 9165 Percentiles: P50: 2.03 P75: 3.13 P99: 961.57 P99.9: 3664.88 P99.99: 4217.80 ------------------------------------------------------ [ 0, 1 ] 1396 1.444% 1.444% ( 1, 2 ] 46155 47.750% 49.195% ########## ( 2, 3 ] 23554 24.368% 73.563% ##### ( 3, 4 ] 10941 11.319% 84.882% ## ( 4, 6 ] 9818 10.157% 95.039% ## ( 6, 10 ] 1711 1.770% 96.809% ( 10, 15 ] 394 0.408% 97.217% ( 15, 22 ] 59 0.061% 97.278% ( 22, 34 ] 7 0.007% 97.285% ( 34, 51 ] 3 0.003% 97.288% ( 51, 76 ] 3 0.003% 97.292% ( 76, 110 ] 22 0.023% 97.314% ( 110, 170 ] 78 0.081% 97.395% ( 170, 250 ] 192 0.199% 97.594% ( 250, 380 ] 291 0.301% 97.895% ( 380, 580 ] 459 0.475% 98.370% ( 580, 870 ] 527 0.545% 98.915% ( 870, 1300 ] 387 0.400% 99.315% ( 1300, 1900 ] 246 0.255% 99.570% ( 1900, 2900 ] 199 0.206% 99.775% ( 2900, 4400 ] 236 0.244% 100.020% ( 4400, 6600 ] 46 0.048% 100.067% ( 6600, 9900 ] 8 0.008% 100.076% ** Level 5 read latency histogram (micros): Count: 100 Average: 1137.4100 StdDev: 1285.49 Min: 86 Median: 580.0000 Max: 6044 Percentiles: P50: 580.00 P75: 1525.00 P99: 6044.00 P99.9: 6044.00 P99.99: 6044.00 ------------------------------------------------------ ( 76, 110 ] 3 3.000% 3.000% # ( 110, 170 ] 9 9.000% 12.000% ## ( 170, 250 ] 10 10.000% 22.000% ## ( 250, 380 ] 16 16.000% 38.000% ### ( 380, 580 ] 12 12.000% 50.000% ## ( 580, 870 ] 8 8.000% 58.000% ## ( 870, 1300 ] 14 14.000% 72.000% ### ( 1300, 1900 ] 8 8.000% 80.000% ## ( 1900, 2900 ] 9 9.000% 89.000% ## ( 2900, 4400 ] 6 6.000% 95.000% # ( 4400, 6600 ] 5 5.000% 100.000% # ** DB Stats ** Uptime(secs): 41.9 total, 3.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 188.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.108 H:M:S, 48.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 311.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.465 H:M:S, 14.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/29-17:47:44 ... thread 0: (1000000,9000000) ops and (231811.5,195699.2) ops/second in (4.313850,45.988940) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/7 2.95 GB 151.0 8.6 0.0 8.6 17.2 8.6 0.0 2.0 147.8 295.4 59.65 54.77 151 0.395 8951K 14K 0.0 0.0 L1 12/0 1.34 GB 136.9 9.3 5.5 3.9 9.2 5.4 0.2 1.7 221.3 218.9 43.23 40.31 5 8.647 8659K 86K 0.0 0.0 L2 7/5 300.95 MB 0.9 0.2 0.1 0.1 0.2 0.1 4.1 1.5 244.3 244.1 0.79 0.75 2 0.395 195K 86 0.0 0.0 L3 29/6 1.61 GB 0.9 0.2 0.2 0.0 0.2 0.2 3.8 1.0 226.9 226.9 0.83 0.75 1 0.825 190K 0 0.0 0.0 L4 167/4 9.73 GB 1.0 4.2 2.3 1.8 4.1 2.3 0.9 1.8 139.9 139.6 30.39 18.73 19 1.600 2708K 1510 0.0 0.0 L5 1080/0 88.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1307/22 104.63 GB 0.0 22.5 8.1 14.4 31.0 16.6 11.9 3.6 170.6 235.1 134.89 115.33 178 0.758 20M 102K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.5 8.1 14.4 31.0 16.6 11.8 3.6 170.6 235.1 134.89 115.33 178 0.758 20M 102K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.5 8.1 14.4 22.4 8.0 0.0 0.0 212.5 211.3 108.32 92.91 54 2.006 20M 102K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 331.9 26.57 22.41 124 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.2 total, 46.0 interval Flush(GB): cumulative 8.613, interval 8.613 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.97 GB write, 686.53 MB/s write, 22.47 GB read, 498.28 MB/s read, 134.9 seconds Interval compaction: 30.97 GB write, 689.45 MB/s write, 22.47 GB read, 500.39 MB/s read, 134.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 19, pending-compaction-bytes-stops: 0, total-delays: 29, total-stops: 49, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3715031 Average: 2.6085 StdDev: 26.92 Min: 0 Median: 1.5153 Max: 10225 Percentiles: P50: 1.52 P75: 1.90 P99: 5.96 P99.9: 85.17 P99.99: 219.25 ------------------------------------------------------ [ 0, 1 ] 622469 16.755% 16.755% ### ( 1, 2 ] 2396962 64.521% 81.276% ############# ( 2, 3 ] 421790 11.354% 92.630% ## ( 3, 4 ] 137357 3.697% 96.327% # ( 4, 6 ] 101178 2.723% 99.050% # ( 6, 10 ] 25946 0.698% 99.749% ( 10, 15 ] 4327 0.116% 99.865% ( 15, 22 ] 773 0.021% 99.886% ( 22, 34 ] 38 0.001% 99.887% ( 34, 51 ] 23 0.001% 99.888% ( 51, 76 ] 42 0.001% 99.889% ( 76, 110 ] 1528 0.041% 99.930% ( 110, 170 ] 1839 0.050% 99.980% ( 170, 250 ] 631 0.017% 99.997% ( 250, 380 ] 463 0.012% 100.009% ( 380, 580 ] 313 0.008% 100.017% ( 580, 870 ] 189 0.005% 100.023% ( 870, 1300 ] 77 0.002% 100.025% ( 1300, 1900 ] 62 0.002% 100.026% ( 1900, 2900 ] 61 0.002% 100.028% ( 2900, 4400 ] 70 0.002% 100.030% ( 4400, 6600 ] 15 0.000% 100.030% ( 6600, 9900 ] 9 0.000% 100.030% ( 9900, 14000 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 1573954 Average: 4.7758 StdDev: 77.40 Min: 1 Median: 1.6556 Max: 10699 Percentiles: P50: 1.66 P75: 2.31 P99: 8.64 P99.9: 133.34 P99.99: 396.95 ------------------------------------------------------ [ 0, 1 ] 183419 11.653% 11.653% ## ( 1, 2 ] 920688 58.495% 70.149% ############ ( 2, 3 ] 247142 15.702% 85.851% ### ( 3, 4 ] 97257 6.179% 92.030% # ( 4, 6 ] 93762 5.957% 97.987% # ( 6, 10 ] 24187 1.537% 99.524% ( 10, 15 ] 4028 0.256% 99.779% ( 15, 22 ] 586 0.037% 99.817% ( 22, 34 ] 42 0.003% 99.819% ( 34, 51 ] 12 0.001% 99.820% ( 51, 76 ] 90 0.006% 99.826% ( 76, 110 ] 780 0.050% 99.875% ( 110, 170 ] 1000 0.064% 99.939% ( 170, 250 ] 419 0.027% 99.966% ( 250, 380 ] 351 0.022% 99.988% ( 380, 580 ] 420 0.027% 100.015% ( 580, 870 ] 364 0.023% 100.038% ( 870, 1300 ] 308 0.020% 100.057% ( 1300, 1900 ] 193 0.012% 100.070% ( 1900, 2900 ] 263 0.017% 100.086% ( 2900, 4400 ] 287 0.018% 100.104% ( 4400, 6600 ] 67 0.004% 100.109% ( 6600, 9900 ] 23 0.001% 100.110% ( 9900, 14000 ] 2 0.000% 100.110% ** Level 2 read latency histogram (micros): Count: 47975 Average: 2.3898 StdDev: 15.20 Min: 0 Median: 1.5481 Max: 1985 Percentiles: P50: 1.55 P75: 1.92 P99: 5.97 P99.9: 11.77 P99.99: 400.25 ------------------------------------------------------ [ 0, 1 ] 6246 13.019% 13.019% ### ( 1, 2 ] 32371 67.475% 80.494% ############# ( 2, 3 ] 5561 11.591% 92.085% ## ( 3, 4 ] 1918 3.998% 96.083% # ( 4, 6 ] 1423 2.966% 99.050% # ( 6, 10 ] 391 0.815% 99.865% ( 10, 15 ] 48 0.100% 99.965% ( 15, 22 ] 4 0.008% 99.973% ( 22, 34 ] 3 0.006% 99.979% ( 51, 76 ] 2 0.004% 99.983% ( 110, 170 ] 1 0.002% 99.985% ( 250, 380 ] 2 0.004% 99.990% ( 380, 580 ] 2 0.004% 99.994% ( 870, 1300 ] 1 0.002% 99.996% ( 1300, 1900 ] 1 0.002% 99.998% ( 1900, 2900 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 43607 Average: 6.9793 StdDev: 102.56 Min: 1 Median: 1.7845 Max: 4925 Percentiles: P50: 1.78 P75: 2.51 P99: 8.28 P99.9: 1679.77 P99.99: 4363.93 ------------------------------------------------------ [ 0, 1 ] 1907 4.373% 4.373% # ( 1, 2 ] 25363 58.163% 62.536% ############ ( 2, 3 ] 10725 24.595% 87.131% ##### ( 3, 4 ] 2363 5.419% 92.549% # ( 4, 6 ] 2549 5.845% 98.395% # ( 6, 10 ] 464 1.064% 99.459% ( 10, 15 ] 79 0.181% 99.640% ( 15, 22 ] 10 0.023% 99.663% ( 22, 34 ] 4 0.009% 99.672% ( 51, 76 ] 1 0.002% 99.674% ( 76, 110 ] 2 0.005% 99.679% ( 110, 170 ] 11 0.025% 99.704% ( 170, 250 ] 8 0.018% 99.723% ( 250, 380 ] 11 0.025% 99.748% ( 380, 580 ] 17 0.039% 99.787% ( 580, 870 ] 18 0.041% 99.828% ( 870, 1300 ] 20 0.046% 99.874% ( 1300, 1900 ] 18 0.041% 99.915% ( 1900, 2900 ] 18 0.041% 99.956% ( 2900, 4400 ] 15 0.034% 99.991% ( 4400, 6600 ] 4 0.009% 100.000% ** Level 4 read latency histogram (micros): Count: 99305 Average: 35.1183 StdDev: 268.97 Min: 0 Median: 2.0367 Max: 9165 Percentiles: P50: 2.04 P75: 3.14 P99: 952.96 P99.9: 3648.06 P99.99: 4216.12 ------------------------------------------------------ [ 0, 1 ] 1411 1.421% 1.421% ( 1, 2 ] 47356 47.687% 49.108% ########## ( 2, 3 ] 24172 24.341% 73.449% ##### ( 3, 4 ] 11203 11.281% 84.731% ## ( 4, 6 ] 10142 10.213% 94.944% ## ( 6, 10 ] 1793 1.806% 96.749% ( 10, 15 ] 405 0.408% 97.157% ( 15, 22 ] 60 0.060% 97.218% ( 22, 34 ] 8 0.008% 97.226% ( 34, 51 ] 3 0.003% 97.229% ( 51, 76 ] 3 0.003% 97.232% ( 76, 110 ] 24 0.024% 97.256% ( 110, 170 ] 90 0.091% 97.347% ( 170, 250 ] 210 0.211% 97.558% ( 250, 380 ] 320 0.322% 97.880% ( 380, 580 ] 496 0.499% 98.380% ( 580, 870 ] 539 0.543% 98.923% ( 870, 1300 ] 404 0.407% 99.329% ( 1300, 1900 ] 250 0.252% 99.581% ( 1900, 2900 ] 200 0.201% 99.782% ( 2900, 4400 ] 236 0.238% 100.020% ( 4400, 6600 ] 46 0.046% 100.066% ( 6600, 9900 ] 8 0.008% 100.075% ** Level 5 read latency histogram (micros): Count: 180 Average: 966.3722 StdDev: 1186.22 Min: 85 Median: 424.4444 Max: 6044 Percentiles: P50: 424.44 P75: 1257.00 P99: 5940.00 P99.9: 6044.00 P99.99: 6044.00 ------------------------------------------------------ ( 76, 110 ] 13 7.222% 7.222% # ( 110, 170 ] 36 20.000% 27.222% #### ( 170, 250 ] 18 10.000% 37.222% ## ( 250, 380 ] 19 10.556% 47.778% ## ( 380, 580 ] 18 10.000% 57.778% ## ( 580, 870 ] 13 7.222% 65.000% # ( 870, 1300 ] 20 11.111% 76.111% ## ( 1300, 1900 ] 10 5.556% 81.667% # ( 1900, 2900 ] 17 9.444% 91.111% ## ( 2900, 4400 ] 10 5.556% 96.667% # ( 4400, 6600 ] 6 3.333% 100.000% # ** DB Stats ** Uptime(secs): 46.2 total, 4.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 191.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.703 H:M:S, 47.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 228.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.595 H:M:S, 37.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.014 micros/op 166288 ops/sec 60.064 seconds 9987999 operations; 161.1 MB/s Microseconds per write: Count: 9987999 Average: 6.0136 StdDev: 381.78 Min: 1 Median: 1.7467 Max: 647635 Percentiles: P50: 1.75 P75: 2.76 P99: 8.87 P99.9: 1176.52 P99.99: 2738.05 ------------------------------------------------------ [ 0, 1 ] 1300635 13.022% 13.022% ### ( 1, 2 ] 4946346 49.523% 62.545% ########## ( 2, 3 ] 1632716 16.347% 78.892% ### ( 3, 4 ] 1388617 13.903% 92.795% ### ( 4, 6 ] 544641 5.453% 98.247% # ( 6, 10 ] 104580 1.047% 99.295% ( 10, 15 ] 29651 0.297% 99.591% ( 15, 22 ] 7895 0.079% 99.670% ( 22, 34 ] 1672 0.017% 99.687% ( 34, 51 ] 201 0.002% 99.689% ( 51, 76 ] 30 0.000% 99.689% ( 76, 110 ] 6741 0.067% 99.757% ( 110, 170 ] 2935 0.029% 99.786% ( 170, 250 ] 337 0.003% 99.790% ( 250, 380 ] 132 0.001% 99.791% ( 380, 580 ] 38 0.000% 99.791% ( 580, 870 ] 26 0.000% 99.792% ( 870, 1300 ] 15176 0.152% 99.944% ( 1300, 1900 ] 37 0.000% 99.944% ( 1900, 2900 ] 5482 0.055% 99.999% ( 2900, 4400 ] 64 0.001% 100.000% ( 4400, 6600 ] 15 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 4 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 176986 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9987999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10307614968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 544 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32611981 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30737138385 rocksdb.compact.write.bytes COUNT : 30551742326 rocksdb.flush.write.bytes COUNT : 10304960908 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 76 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 326 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10221895680 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3996672 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29246539908 rocksdb.non.last.level.read.count COUNT : 7061352 rocksdb.block.checksum.compute.count COUNT : 7444368 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.384401 P95 : 3.896605 P99 : 7.327894 P100 : 647628.000000 COUNT : 9987999 SUM : 55341879 rocksdb.compaction.times.micros P50 : 1103513.513514 P95 : 7077500.000000 P99 : 16160000.000000 P100 : 18698196.000000 COUNT : 73 SUM : 130541535 rocksdb.compaction.times.cpu_micros P50 : 909354.838710 P95 : 6023333.333333 P99 : 16160000.000000 P100 : 17679850.000000 COUNT : 73 SUM : 110734779 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 686.333333 P95 : 1615.000000 P99 : 9256.500000 P100 : 10949.000000 COUNT : 139 SUM : 127745 rocksdb.compaction.outfile.sync.micros P50 : 1026.157895 P95 : 61250.000000 P99 : 128556.000000 P100 : 128556.000000 COUNT : 339 SUM : 3013496 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 97.464646 P95 : 1034.833333 P99 : 3215.000000 P100 : 4058.000000 COUNT : 237 SUM : 57966 rocksdb.table.open.io.micros P50 : 1478.846154 P95 : 7260.000000 P99 : 11212.000000 P100 : 13419.000000 COUNT : 544 SUM : 1130510 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.610837 P95 : 7.334896 P99 : 9.958413 P100 : 11147.000000 COUNT : 7442721 SUM : 44666059 rocksdb.read.block.get.micros P50 : 481.010101 P95 : 3262.500000 P99 : 5321.411765 P100 : 8250.000000 COUNT : 1088 SUM : 922448 rocksdb.write.raw.block.micros P50 : 0.512130 P95 : 0.973047 P99 : 2.784064 P100 : 16767.000000 COUNT : 9895098 SUM : 19694808 rocksdb.numfiles.in.singlecompaction P50 : 3.348684 P95 : 7.900000 P99 : 21.265000 P100 : 27.000000 COUNT : 121 SUM : 501 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559396 P95 : 1180.186158 P99 : 2557.048490 P100 : 647418.000000 COUNT : 196123 SUM : 32627426 rocksdb.sst.read.micros P50 : 1.562593 P95 : 4.307767 P99 : 7.666128 P100 : 10699.000000 COUNT : 7061500 SUM : 27851833 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9987999 SUM : 10307614968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211224.489796 P95 : 382375.000000 P99 : 725633.333333 P100 : 815095.000000 COUNT : 139 SUM : 30322921 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 326 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0