[2024-12-08 00:34:10.452304] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-12-08 00:34:10.452576] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1211211 ] Set seed to 1733614450445464 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-08 00:34:10.566722] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-08 00:34:10.608681] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-08 00:34:10.608730] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1211211' to capture a snapshot of events at runtime. [2024-12-08 00:34:10.608740] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-08 00:34:10.608751] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-08 00:34:10.608758] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1211211 for offline analysis/debug. [2024-12-08 00:34:10.608844] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 8 00:34:14 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/08-00:34:17 ... thread 0: (1000000,1000000) ops and (329095.6,329095.6) ops/second in (3.038631,3.038631) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 692.96 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 344.3 2.56 2.27 12 0.213 0 0 0.0 0.0 L2 3/2 237.30 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 245.1 245.0 1.42 1.35 2 0.712 354K 170 0.0 0.0 L3 11/0 944.90 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.66 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.51 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 87.6 308.9 3.98 3.63 14 0.285 354K 170 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 87.6 308.9 3.98 3.63 14 0.285 354K 170 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 245.1 245.0 1.42 1.35 2 0.712 354K 170 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 344.3 2.56 2.27 12 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 379.92 MB/s write, 0.34 GB read, 107.73 MB/s read, 4.0 seconds Interval compaction: 1.20 GB write, 404.82 MB/s write, 0.34 GB read, 114.79 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 148464 Average: 2.0827 StdDev: 17.70 Min: 1 Median: 1.3648 Max: 3658 Percentiles: P50: 1.36 P75: 1.79 P99: 5.47 P99.9: 9.94 P99.99: 24.77 ------------------------------------------------------ [ 0, 1 ] 42339 28.518% 28.518% ###### ( 1, 2 ] 87421 58.884% 87.402% ############ ( 2, 3 ] 10724 7.223% 94.625% # ( 3, 4 ] 4217 2.840% 97.465% # ( 4, 6 ] 3093 2.083% 99.549% ( 6, 10 ] 532 0.358% 99.907% ( 10, 15 ] 113 0.076% 99.983% ( 15, 22 ] 11 0.007% 99.991% ( 22, 34 ] 5 0.003% 99.994% ( 34, 51 ] 2 0.001% 99.995% ( 110, 170 ] 7 0.005% 100.000% ( 170, 250 ] 3 0.002% 100.002% ( 250, 380 ] 5 0.003% 100.005% ( 380, 580 ] 1 0.001% 100.006% ( 870, 1300 ] 2 0.001% 100.007% ( 1300, 1900 ] 3 0.002% 100.009% ( 2900, 4400 ] 3 0.002% 100.011% ** Level 2 read latency histogram (micros): Count: 83255 Average: 2.2119 StdDev: 17.95 Min: 1 Median: 1.3756 Max: 2575 Percentiles: P50: 1.38 P75: 1.79 P99: 5.71 P99.9: 34.49 P99.99: 547.45 ------------------------------------------------------ [ 0, 1 ] 22898 27.503% 27.503% ###### ( 1, 2 ] 49865 59.894% 87.398% ############ ( 2, 3 ] 5879 7.061% 94.459% # ( 3, 4 ] 2345 2.817% 97.276% # ( 4, 6 ] 1677 2.014% 99.290% ( 6, 10 ] 400 0.480% 99.771% ( 10, 15 ] 91 0.109% 99.880% ( 15, 22 ] 11 0.013% 99.893% ( 22, 34 ] 5 0.006% 99.899% ( 34, 51 ] 26 0.031% 99.930% ( 51, 76 ] 26 0.031% 99.962% ( 76, 110 ] 3 0.004% 99.965% ( 110, 170 ] 7 0.008% 99.974% ( 170, 250 ] 7 0.008% 99.982% ( 250, 380 ] 5 0.006% 99.988% ( 380, 580 ] 2 0.002% 99.990% ( 580, 870 ] 2 0.002% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.996% ( 1900, 2900 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 55 Average: 1654.4545 StdDev: 1602.33 Min: 147 Median: 913.0000 Max: 6936 Percentiles: P50: 913.00 P75: 2525.00 P99: 6936.00 P99.9: 6936.00 P99.99: 6936.00 ------------------------------------------------------ ( 110, 170 ] 1 1.818% 1.818% ( 170, 250 ] 2 3.636% 5.455% # ( 250, 380 ] 10 18.182% 23.636% #### ( 380, 580 ] 6 10.909% 34.545% ## ( 580, 870 ] 8 14.545% 49.091% ### ( 870, 1300 ] 5 9.091% 58.182% ## ( 1300, 1900 ] 3 5.455% 63.636% # ( 1900, 2900 ] 10 18.182% 81.818% #### ( 2900, 4400 ] 5 9.091% 90.909% ## ( 4400, 6600 ] 4 7.273% 98.182% # ( 6600, 9900 ] 1 1.818% 100.000% ** Level 4 read latency histogram (micros): Count: 20 Average: 1887.9500 StdDev: 1363.24 Min: 261 Median: 1540.0000 Max: 4964 Percentiles: P50: 1540.00 P75: 3200.00 P99: 4964.00 P99.9: 4964.00 P99.99: 4964.00 ------------------------------------------------------ ( 250, 380 ] 1 5.000% 5.000% # ( 380, 580 ] 3 15.000% 20.000% ### ( 580, 870 ] 2 10.000% 30.000% ## ( 870, 1300 ] 2 10.000% 40.000% ## ( 1300, 1900 ] 5 25.000% 65.000% ##### ( 1900, 2900 ] 1 5.000% 70.000% # ( 2900, 4400 ] 5 25.000% 95.000% ##### ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 303.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.409 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.409 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/08-00:34:20 ... thread 0: (1000000,2000000) ops and (350690.0,339549.8) ops/second in (2.851521,5.890152) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 1.29 GB 50.4 0.6 0.0 0.6 2.3 1.8 0.0 1.3 76.1 321.4 7.45 6.83 28 0.266 575K 590 0.0 0.0 L1 4/4 314.57 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 244.4 244.1 1.29 1.25 1 1.289 319K 419 0.0 0.0 L2 1/0 50.29 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 245.1 245.0 1.42 1.35 2 0.712 354K 170 0.0 0.0 L3 18/0 963.89 MB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 229.5 229.5 0.81 0.76 1 0.815 189K 0 0.0 0.0 L4 170/0 9.45 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 135.9 135.9 1.24 0.87 1 1.237 170K 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/13 97.92 GB 0.0 1.5 0.8 0.7 3.3 2.6 0.6 1.9 129.9 279.4 12.21 11.05 33 0.370 1610K 1179 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.8 0.7 3.3 2.6 0.6 1.9 129.9 279.4 12.21 11.05 33 0.370 1610K 1179 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.8 0.7 1.5 0.8 0.0 0.0 227.3 227.1 6.98 6.40 7 0.997 1610K 1179 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.2 5.23 4.65 26 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.33 GB write, 560.12 MB/s write, 1.55 GB read, 260.38 MB/s read, 12.2 seconds Interval compaction: 3.33 GB write, 579.07 MB/s write, 1.55 GB read, 269.19 MB/s read, 12.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 404716 Average: 2.1455 StdDev: 12.44 Min: 1 Median: 1.4567 Max: 3658 Percentiles: P50: 1.46 P75: 1.85 P99: 5.54 P99.9: 9.85 P99.99: 14.39 ------------------------------------------------------ [ 0, 1 ] 84795 20.952% 20.952% #### ( 1, 2 ] 257423 63.606% 84.558% ############# ( 2, 3 ] 38124 9.420% 93.978% ## ( 3, 4 ] 13547 3.347% 97.325% # ( 4, 6 ] 8815 2.178% 99.503% ( 6, 10 ] 1672 0.413% 99.916% ( 10, 15 ] 341 0.084% 100.000% ( 15, 22 ] 37 0.009% 100.009% ( 22, 34 ] 12 0.003% 100.012% ( 34, 51 ] 4 0.001% 100.013% ( 110, 170 ] 13 0.003% 100.017% ( 170, 250 ] 11 0.003% 100.019% ( 250, 380 ] 14 0.003% 100.023% ( 380, 580 ] 3 0.001% 100.023% ( 580, 870 ] 4 0.001% 100.024% ( 870, 1300 ] 3 0.001% 100.025% ( 1300, 1900 ] 5 0.001% 100.026% ( 1900, 2900 ] 1 0.000% 100.027% ( 2900, 4400 ] 3 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 50238 Average: 2.1506 StdDev: 11.10 Min: 1 Median: 1.4770 Max: 2251 Percentiles: P50: 1.48 P75: 1.85 P99: 5.40 P99.9: 9.61 P99.99: 248.10 ------------------------------------------------------ [ 0, 1 ] 9095 18.104% 18.104% #### ( 1, 2 ] 33596 66.874% 84.978% ############# ( 2, 3 ] 4746 9.447% 94.425% ## ( 3, 4 ] 1657 3.298% 97.723% # ( 4, 6 ] 914 1.819% 99.542% ( 6, 10 ] 199 0.396% 99.938% ( 10, 15 ] 22 0.044% 99.982% ( 15, 22 ] 3 0.006% 99.988% ( 170, 250 ] 1 0.002% 99.990% ( 250, 380 ] 3 0.006% 99.996% ( 580, 870 ] 1 0.002% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 88134 Average: 2.2205 StdDev: 17.45 Min: 1 Median: 1.3916 Max: 2575 Percentiles: P50: 1.39 P75: 1.81 P99: 5.73 P99.9: 24.08 P99.99: 498.66 ------------------------------------------------------ [ 0, 1 ] 23241 26.370% 26.370% ##### ( 1, 2 ] 53184 60.344% 86.715% ############ ( 2, 3 ] 6570 7.455% 94.169% # ( 3, 4 ] 2648 3.005% 97.174% # ( 4, 6 ] 1863 2.114% 99.287% ( 6, 10 ] 431 0.489% 99.776% ( 10, 15 ] 97 0.110% 99.887% ( 15, 22 ] 11 0.012% 99.899% ( 22, 34 ] 5 0.006% 99.905% ( 34, 51 ] 26 0.030% 99.934% ( 51, 76 ] 26 0.030% 99.964% ( 76, 110 ] 3 0.003% 99.967% ( 110, 170 ] 7 0.008% 99.975% ( 170, 250 ] 7 0.008% 99.983% ( 250, 380 ] 5 0.006% 99.989% ( 380, 580 ] 2 0.002% 99.991% ( 580, 870 ] 2 0.002% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 42756 Average: 4.4184 StdDev: 82.69 Min: 1 Median: 1.5803 Max: 6936 Percentiles: P50: 1.58 P75: 1.96 P99: 5.96 P99.9: 415.54 P99.99: 4798.42 ------------------------------------------------------ [ 0, 1 ] 4933 11.538% 11.538% ## ( 1, 2 ] 28340 66.283% 77.821% ############# ( 2, 3 ] 6576 15.380% 93.201% ### ( 3, 4 ] 1437 3.361% 96.562% # ( 4, 6 ] 1064 2.489% 99.050% ( 6, 10 ] 278 0.650% 99.701% ( 10, 15 ] 58 0.136% 99.836% ( 15, 22 ] 4 0.009% 99.846% ( 22, 34 ] 2 0.005% 99.850% ( 34, 51 ] 1 0.002% 99.853% ( 51, 76 ] 3 0.007% 99.860% ( 110, 170 ] 2 0.005% 99.864% ( 170, 250 ] 3 0.007% 99.871% ( 250, 380 ] 11 0.026% 99.897% ( 380, 580 ] 7 0.016% 99.913% ( 580, 870 ] 9 0.021% 99.935% ( 870, 1300 ] 5 0.012% 99.946% ( 1300, 1900 ] 3 0.007% 99.953% ( 1900, 2900 ] 10 0.023% 99.977% ( 2900, 4400 ] 5 0.012% 99.988% ( 4400, 6600 ] 4 0.009% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 127.7065 StdDev: 577.95 Min: 0 Median: 1.8302 Max: 4964 Percentiles: P50: 1.83 P75: 5.94 P99: 3770.00 P99.9: 4964.00 P99.99: 4964.00 ------------------------------------------------------ [ 0, 1 ] 67 21.613% 21.613% #### ( 1, 2 ] 106 34.194% 55.806% ####### ( 2, 3 ] 37 11.935% 67.742% ## ( 3, 4 ] 6 1.935% 69.677% ( 4, 6 ] 17 5.484% 75.161% # ( 6, 10 ] 33 10.645% 85.806% ## ( 10, 15 ] 13 4.194% 90.000% # ( 15, 22 ] 4 1.290% 91.290% ( 22, 34 ] 3 0.968% 92.258% ( 110, 170 ] 2 0.645% 92.903% ( 170, 250 ] 2 0.645% 93.548% ( 250, 380 ] 1 0.323% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 2 0.645% 95.484% ( 870, 1300 ] 2 0.645% 96.129% ( 1300, 1900 ] 5 1.613% 97.742% ( 1900, 2900 ] 1 0.323% 98.065% ( 2900, 4400 ] 5 1.613% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 829.5500 StdDev: 996.22 Min: 133 Median: 328.0000 Max: 3775 Percentiles: P50: 328.00 P75: 1085.00 P99: 3775.00 P99.9: 3775.00 P99.99: 3775.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 4 20.000% 35.000% #### ( 250, 380 ] 5 25.000% 60.000% ##### ( 380, 580 ] 1 5.000% 65.000% # ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 2.9 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.618 H:M:S, 10.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 345.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.209 H:M:S, 7.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/08-00:34:23 ... thread 0: (1000000,3000000) ops and (333382.2,337468.8) ops/second in (2.999560,8.889712) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/8 1.72 GB 119.6 1.4 0.0 1.4 4.1 2.8 0.0 1.5 104.1 316.9 13.31 12.34 45 0.296 1407K 1464 0.0 0.0 L1 4/0 363.00 MB 36.3 1.2 0.9 0.3 1.2 0.9 0.2 1.4 237.3 236.6 5.04 4.90 2 2.520 1214K 3466 0.0 0.0 L2 1/0 50.29 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.5 1.8 245.1 245.0 1.42 1.35 2 0.712 354K 170 0.0 0.0 L3 14/0 849.03 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.5 1.0 229.5 229.5 0.81 0.76 1 0.815 189K 0 0.0 0.0 L4 174/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.6 1.0 135.9 135.9 1.24 0.87 1 1.237 170K 0 0.0 0.0 L5 1048/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/8 98.90 GB 0.0 3.2 1.4 1.8 6.0 4.2 2.5 2.2 150.5 280.2 21.83 20.22 51 0.428 3336K 5100 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 1.4 1.8 6.0 4.2 2.5 2.2 150.5 280.2 21.83 20.22 51 0.428 3336K 5100 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 1.4 1.8 3.2 1.4 0.0 0.0 238.2 237.8 13.80 13.06 11 1.254 3336K 5100 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.9 8.03 7.16 40 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.97 GB write, 672.75 MB/s write, 3.21 GB read, 361.49 MB/s read, 21.8 seconds Interval compaction: 5.97 GB write, 687.83 MB/s write, 3.21 GB read, 369.60 MB/s read, 21.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 702308 Average: 2.1025 StdDev: 11.63 Min: 1 Median: 1.4346 Max: 3658 Percentiles: P50: 1.43 P75: 1.83 P99: 5.44 P99.9: 9.77 P99.99: 14.12 ------------------------------------------------------ [ 0, 1 ] 156615 22.300% 22.300% #### ( 1, 2 ] 447630 63.737% 86.037% ############# ( 2, 3 ] 60021 8.546% 94.583% ## ( 3, 4 ] 21744 3.096% 97.679% # ( 4, 6 ] 12927 1.841% 99.520% ( 6, 10 ] 2834 0.404% 99.924% ( 10, 15 ] 568 0.081% 100.004% ( 15, 22 ] 71 0.010% 100.015% ( 22, 34 ] 18 0.003% 100.017% ( 34, 51 ] 4 0.001% 100.018% ( 51, 76 ] 2 0.000% 100.018% ( 110, 170 ] 18 0.003% 100.021% ( 170, 250 ] 18 0.003% 100.023% ( 250, 380 ] 19 0.003% 100.026% ( 380, 580 ] 7 0.001% 100.027% ( 580, 870 ] 9 0.001% 100.028% ( 870, 1300 ] 6 0.001% 100.029% ( 1300, 1900 ] 9 0.001% 100.030% ( 1900, 2900 ] 2 0.000% 100.030% ( 2900, 4400 ] 4 0.001% 100.031% ** Level 1 read latency histogram (micros): Count: 79920 Average: 2.2666 StdDev: 14.48 Min: 1 Median: 1.4910 Max: 2251 Percentiles: P50: 1.49 P75: 1.86 P99: 5.38 P99.9: 9.75 P99.99: 582.32 ------------------------------------------------------ [ 0, 1 ] 13271 16.605% 16.605% ### ( 1, 2 ] 54359 68.017% 84.622% ############## ( 2, 3 ] 7819 9.784% 94.406% ## ( 3, 4 ] 2709 3.390% 97.795% # ( 4, 6 ] 1400 1.752% 99.547% ( 6, 10 ] 301 0.377% 99.924% ( 10, 15 ] 36 0.045% 99.969% ( 15, 22 ] 4 0.005% 99.974% ( 34, 51 ] 1 0.001% 99.975% ( 170, 250 ] 2 0.003% 99.977% ( 250, 380 ] 5 0.006% 99.984% ( 380, 580 ] 5 0.006% 99.990% ( 580, 870 ] 1 0.001% 99.991% ( 870, 1300 ] 3 0.004% 99.995% ( 1300, 1900 ] 3 0.004% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 88134 Average: 2.2205 StdDev: 17.45 Min: 1 Median: 1.3916 Max: 2575 Percentiles: P50: 1.39 P75: 1.81 P99: 5.73 P99.9: 24.08 P99.99: 498.66 ------------------------------------------------------ [ 0, 1 ] 23241 26.370% 26.370% ##### ( 1, 2 ] 53184 60.344% 86.715% ############ ( 2, 3 ] 6570 7.455% 94.169% # ( 3, 4 ] 2648 3.005% 97.174% # ( 4, 6 ] 1863 2.114% 99.287% ( 6, 10 ] 431 0.489% 99.776% ( 10, 15 ] 97 0.110% 99.887% ( 15, 22 ] 11 0.012% 99.899% ( 22, 34 ] 5 0.006% 99.905% ( 34, 51 ] 26 0.030% 99.934% ( 51, 76 ] 26 0.030% 99.964% ( 76, 110 ] 3 0.003% 99.967% ( 110, 170 ] 7 0.008% 99.975% ( 170, 250 ] 7 0.008% 99.983% ( 250, 380 ] 5 0.006% 99.989% ( 380, 580 ] 2 0.002% 99.991% ( 580, 870 ] 2 0.002% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 42756 Average: 4.4184 StdDev: 82.69 Min: 1 Median: 1.5803 Max: 6936 Percentiles: P50: 1.58 P75: 1.96 P99: 5.96 P99.9: 415.54 P99.99: 4798.42 ------------------------------------------------------ [ 0, 1 ] 4933 11.538% 11.538% ## ( 1, 2 ] 28340 66.283% 77.821% ############# ( 2, 3 ] 6576 15.380% 93.201% ### ( 3, 4 ] 1437 3.361% 96.562% # ( 4, 6 ] 1064 2.489% 99.050% ( 6, 10 ] 278 0.650% 99.701% ( 10, 15 ] 58 0.136% 99.836% ( 15, 22 ] 4 0.009% 99.846% ( 22, 34 ] 2 0.005% 99.850% ( 34, 51 ] 1 0.002% 99.853% ( 51, 76 ] 3 0.007% 99.860% ( 110, 170 ] 2 0.005% 99.864% ( 170, 250 ] 3 0.007% 99.871% ( 250, 380 ] 11 0.026% 99.897% ( 380, 580 ] 7 0.016% 99.913% ( 580, 870 ] 9 0.021% 99.935% ( 870, 1300 ] 5 0.012% 99.946% ( 1300, 1900 ] 3 0.007% 99.953% ( 1900, 2900 ] 10 0.023% 99.977% ( 2900, 4400 ] 5 0.012% 99.988% ( 4400, 6600 ] 4 0.009% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 127.7065 StdDev: 577.95 Min: 0 Median: 1.8302 Max: 4964 Percentiles: P50: 1.83 P75: 5.94 P99: 3770.00 P99.9: 4964.00 P99.99: 4964.00 ------------------------------------------------------ [ 0, 1 ] 67 21.613% 21.613% #### ( 1, 2 ] 106 34.194% 55.806% ####### ( 2, 3 ] 37 11.935% 67.742% ## ( 3, 4 ] 6 1.935% 69.677% ( 4, 6 ] 17 5.484% 75.161% # ( 6, 10 ] 33 10.645% 85.806% ## ( 10, 15 ] 13 4.194% 90.000% # ( 15, 22 ] 4 1.290% 91.290% ( 22, 34 ] 3 0.968% 92.258% ( 110, 170 ] 2 0.645% 92.903% ( 170, 250 ] 2 0.645% 93.548% ( 250, 380 ] 1 0.323% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 2 0.645% 95.484% ( 870, 1300 ] 2 0.645% 96.129% ( 1300, 1900 ] 5 1.613% 97.742% ( 1900, 2900 ] 1 0.323% 98.065% ( 2900, 4400 ] 5 1.613% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 783.2000 StdDev: 950.23 Min: 79 Median: 305.7143 Max: 3775 Percentiles: P50: 305.71 P75: 1156.67 P99: 3775.00 P99.9: 3775.00 P99.99: 3775.00 ------------------------------------------------------ ( 76, 110 ] 6 15.000% 15.000% ### ( 110, 170 ] 4 10.000% 25.000% ## ( 170, 250 ] 7 17.500% 42.500% #### ( 250, 380 ] 7 17.500% 60.000% #### ( 380, 580 ] 2 5.000% 65.000% # ( 580, 870 ] 2 5.000% 70.000% # ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 3 7.500% 85.000% ## ( 1900, 2900 ] 4 10.000% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.001 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.383 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/08-00:34:26 ... thread 0: (1000000,4000000) ops and (334384.9,336692.5) ops/second in (2.990566,11.880278) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.64 GB 239.1 2.5 0.0 2.5 6.1 3.7 0.0 1.7 124.3 310.6 20.27 18.94 62 0.327 2558K 2674 0.0 0.0 L1 4/0 363.00 MB 36.3 1.2 0.9 0.3 1.2 0.9 0.2 1.4 237.3 236.6 5.04 4.90 2 2.520 1214K 3466 0.0 0.0 L2 1/0 50.29 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.5 1.8 245.1 245.0 1.42 1.35 2 0.712 354K 170 0.0 0.0 L3 14/0 849.03 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.5 1.0 229.5 229.5 0.81 0.76 1 0.815 189K 0 0.0 0.0 L4 174/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.6 1.0 135.9 135.9 1.24 0.87 1 1.237 170K 0 0.0 0.0 L5 1048/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/4 99.82 GB 0.0 4.3 1.4 2.9 8.0 5.1 2.5 2.2 153.5 284.6 28.79 26.82 68 0.423 4488K 6310 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 1.4 2.9 8.0 5.1 2.5 2.2 153.5 284.6 28.79 26.82 68 0.423 4488K 6310 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 1.4 2.9 4.3 1.4 0.0 0.0 243.6 243.2 18.15 17.31 15 1.210 4488K 6310 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 355.1 10.64 9.51 53 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.00 GB write, 678.19 MB/s write, 4.32 GB read, 365.87 MB/s read, 28.8 seconds Interval compaction: 8.00 GB write, 689.56 MB/s write, 4.32 GB read, 372.01 MB/s read, 28.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 948043 Average: 2.0487 StdDev: 11.46 Min: 1 Median: 1.3995 Max: 3819 Percentiles: P50: 1.40 P75: 1.80 P99: 5.29 P99.9: 9.83 P99.99: 14.46 ------------------------------------------------------ [ 0, 1 ] 236748 24.972% 24.972% ##### ( 1, 2 ] 593915 62.646% 87.619% ############# ( 2, 3 ] 72339 7.630% 95.249% ## ( 3, 4 ] 26000 2.742% 97.992% # ( 4, 6 ] 14793 1.560% 99.552% ( 6, 10 ] 3448 0.364% 99.916% ( 10, 15 ] 791 0.083% 99.999% ( 15, 22 ] 95 0.010% 100.009% ( 22, 34 ] 18 0.002% 100.011% ( 34, 51 ] 5 0.001% 100.011% ( 51, 76 ] 2 0.000% 100.012% ( 110, 170 ] 21 0.002% 100.014% ( 170, 250 ] 25 0.003% 100.017% ( 250, 380 ] 27 0.003% 100.019% ( 380, 580 ] 10 0.001% 100.020% ( 580, 870 ] 13 0.001% 100.022% ( 870, 1300 ] 13 0.001% 100.023% ( 1300, 1900 ] 10 0.001% 100.024% ( 1900, 2900 ] 2 0.000% 100.024% ( 2900, 4400 ] 5 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 79920 Average: 2.2666 StdDev: 14.48 Min: 1 Median: 1.4910 Max: 2251 Percentiles: P50: 1.49 P75: 1.86 P99: 5.38 P99.9: 9.75 P99.99: 582.32 ------------------------------------------------------ [ 0, 1 ] 13271 16.605% 16.605% ### ( 1, 2 ] 54359 68.017% 84.622% ############## ( 2, 3 ] 7819 9.784% 94.406% ## ( 3, 4 ] 2709 3.390% 97.795% # ( 4, 6 ] 1400 1.752% 99.547% ( 6, 10 ] 301 0.377% 99.924% ( 10, 15 ] 36 0.045% 99.969% ( 15, 22 ] 4 0.005% 99.974% ( 34, 51 ] 1 0.001% 99.975% ( 170, 250 ] 2 0.003% 99.977% ( 250, 380 ] 5 0.006% 99.984% ( 380, 580 ] 5 0.006% 99.990% ( 580, 870 ] 1 0.001% 99.991% ( 870, 1300 ] 3 0.004% 99.995% ( 1300, 1900 ] 3 0.004% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 88134 Average: 2.2205 StdDev: 17.45 Min: 1 Median: 1.3916 Max: 2575 Percentiles: P50: 1.39 P75: 1.81 P99: 5.73 P99.9: 24.08 P99.99: 498.66 ------------------------------------------------------ [ 0, 1 ] 23241 26.370% 26.370% ##### ( 1, 2 ] 53184 60.344% 86.715% ############ ( 2, 3 ] 6570 7.455% 94.169% # ( 3, 4 ] 2648 3.005% 97.174% # ( 4, 6 ] 1863 2.114% 99.287% ( 6, 10 ] 431 0.489% 99.776% ( 10, 15 ] 97 0.110% 99.887% ( 15, 22 ] 11 0.012% 99.899% ( 22, 34 ] 5 0.006% 99.905% ( 34, 51 ] 26 0.030% 99.934% ( 51, 76 ] 26 0.030% 99.964% ( 76, 110 ] 3 0.003% 99.967% ( 110, 170 ] 7 0.008% 99.975% ( 170, 250 ] 7 0.008% 99.983% ( 250, 380 ] 5 0.006% 99.989% ( 380, 580 ] 2 0.002% 99.991% ( 580, 870 ] 2 0.002% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 42756 Average: 4.4184 StdDev: 82.69 Min: 1 Median: 1.5803 Max: 6936 Percentiles: P50: 1.58 P75: 1.96 P99: 5.96 P99.9: 415.54 P99.99: 4798.42 ------------------------------------------------------ [ 0, 1 ] 4933 11.538% 11.538% ## ( 1, 2 ] 28340 66.283% 77.821% ############# ( 2, 3 ] 6576 15.380% 93.201% ### ( 3, 4 ] 1437 3.361% 96.562% # ( 4, 6 ] 1064 2.489% 99.050% ( 6, 10 ] 278 0.650% 99.701% ( 10, 15 ] 58 0.136% 99.836% ( 15, 22 ] 4 0.009% 99.846% ( 22, 34 ] 2 0.005% 99.850% ( 34, 51 ] 1 0.002% 99.853% ( 51, 76 ] 3 0.007% 99.860% ( 110, 170 ] 2 0.005% 99.864% ( 170, 250 ] 3 0.007% 99.871% ( 250, 380 ] 11 0.026% 99.897% ( 380, 580 ] 7 0.016% 99.913% ( 580, 870 ] 9 0.021% 99.935% ( 870, 1300 ] 5 0.012% 99.946% ( 1300, 1900 ] 3 0.007% 99.953% ( 1900, 2900 ] 10 0.023% 99.977% ( 2900, 4400 ] 5 0.012% 99.988% ( 4400, 6600 ] 4 0.009% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 127.7065 StdDev: 577.95 Min: 0 Median: 1.8302 Max: 4964 Percentiles: P50: 1.83 P75: 5.94 P99: 3770.00 P99.9: 4964.00 P99.99: 4964.00 ------------------------------------------------------ [ 0, 1 ] 67 21.613% 21.613% #### ( 1, 2 ] 106 34.194% 55.806% ####### ( 2, 3 ] 37 11.935% 67.742% ## ( 3, 4 ] 6 1.935% 69.677% ( 4, 6 ] 17 5.484% 75.161% # ( 6, 10 ] 33 10.645% 85.806% ## ( 10, 15 ] 13 4.194% 90.000% # ( 15, 22 ] 4 1.290% 91.290% ( 22, 34 ] 3 0.968% 92.258% ( 110, 170 ] 2 0.645% 92.903% ( 170, 250 ] 2 0.645% 93.548% ( 250, 380 ] 1 0.323% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 2 0.645% 95.484% ( 870, 1300 ] 2 0.645% 96.129% ( 1300, 1900 ] 5 1.613% 97.742% ( 1900, 2900 ] 1 0.323% 98.065% ( 2900, 4400 ] 5 1.613% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 783.2000 StdDev: 950.23 Min: 79 Median: 305.7143 Max: 3775 Percentiles: P50: 305.71 P75: 1156.67 P99: 3775.00 P99.9: 3775.00 P99.99: 3775.00 ------------------------------------------------------ ( 76, 110 ] 6 15.000% 15.000% ### ( 110, 170 ] 4 10.000% 25.000% ## ( 170, 250 ] 7 17.500% 42.500% #### ( 250, 380 ] 7 17.500% 60.000% #### ( 380, 580 ] 2 5.000% 65.000% # ( 580, 870 ] 2 5.000% 70.000% # ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 3 7.500% 85.000% ## ( 1900, 2900 ] 4 10.000% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.363 H:M:S, 11.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.362 H:M:S, 12.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/08-00:34:29 ... thread 0: (1000000,5000000) ops and (334316.1,336214.5) ops/second in (2.991181,14.871459) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/16 3.63 GB 0.0 3.6 0.0 3.6 8.2 4.7 0.0 1.8 133.7 308.6 27.34 25.62 80 0.342 3709K 3887 0.0 0.0 L1 4/4 363.00 MB 0.0 1.2 0.9 0.3 1.2 0.9 0.2 1.4 237.3 236.6 5.04 4.90 2 2.520 1214K 3466 0.0 0.0 L2 1/0 50.29 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.5 1.8 245.1 245.0 1.42 1.35 2 0.712 354K 170 0.0 0.0 L3 14/0 849.03 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.5 1.0 229.5 229.5 0.81 0.76 1 0.815 189K 0 0.0 0.0 L4 174/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.6 1.0 135.9 135.9 1.24 0.87 1 1.237 170K 0 0.0 0.0 L5 1048/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/20 100.80 GB 0.0 5.4 1.4 4.0 10.1 6.1 2.5 2.2 154.9 288.2 35.85 33.50 86 0.417 5639K 7523 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 1.4 4.0 10.1 6.1 2.5 2.2 154.9 288.2 35.85 33.50 86 0.417 5639K 7523 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 1.4 4.0 5.4 1.4 0.0 0.0 247.9 247.6 22.40 21.49 19 1.179 5639K 7523 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 355.9 13.45 12.01 67 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.1 total, 14.9 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.09 GB write, 685.62 MB/s write, 5.42 GB read, 368.50 MB/s read, 35.9 seconds Interval compaction: 10.09 GB write, 694.81 MB/s write, 5.42 GB read, 373.43 MB/s read, 35.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1199716 Average: 2.0544 StdDev: 13.06 Min: 0 Median: 1.3834 Max: 4175 Percentiles: P50: 1.38 P75: 1.79 P99: 5.22 P99.9: 9.96 P99.99: 19.87 ------------------------------------------------------ [ 0, 1 ] 313760 26.153% 26.153% ##### ( 1, 2 ] 746137 62.193% 88.346% ############ ( 2, 3 ] 86221 7.187% 95.532% # ( 3, 4 ] 31131 2.595% 98.127% # ( 4, 6 ] 17124 1.427% 99.555% ( 6, 10 ] 4185 0.349% 99.903% ( 10, 15 ] 951 0.079% 99.983% ( 15, 22 ] 125 0.010% 99.993% ( 22, 34 ] 20 0.002% 99.995% ( 34, 51 ] 9 0.001% 99.996% ( 51, 76 ] 3 0.000% 99.996% ( 76, 110 ] 56 0.005% 100.001% ( 110, 170 ] 86 0.007% 100.008% ( 170, 250 ] 43 0.004% 100.011% ( 250, 380 ] 40 0.003% 100.015% ( 380, 580 ] 18 0.002% 100.016% ( 580, 870 ] 22 0.002% 100.018% ( 870, 1300 ] 16 0.001% 100.019% ( 1300, 1900 ] 14 0.001% 100.020% ( 1900, 2900 ] 4 0.000% 100.021% ( 2900, 4400 ] 8 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 79921 Average: 2.2707 StdDev: 14.52 Min: 1 Median: 1.4910 Max: 2251 Percentiles: P50: 1.49 P75: 1.86 P99: 5.38 P99.9: 9.76 P99.99: 582.29 ------------------------------------------------------ [ 0, 1 ] 13271 16.605% 16.605% ### ( 1, 2 ] 54359 68.016% 84.621% ############## ( 2, 3 ] 7819 9.783% 94.404% ## ( 3, 4 ] 2709 3.390% 97.794% # ( 4, 6 ] 1400 1.752% 99.546% ( 6, 10 ] 301 0.377% 99.922% ( 10, 15 ] 36 0.045% 99.967% ( 15, 22 ] 4 0.005% 99.972% ( 34, 51 ] 1 0.001% 99.974% ( 170, 250 ] 2 0.003% 99.976% ( 250, 380 ] 6 0.008% 99.984% ( 380, 580 ] 5 0.006% 99.990% ( 580, 870 ] 1 0.001% 99.991% ( 870, 1300 ] 3 0.004% 99.995% ( 1300, 1900 ] 3 0.004% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 88134 Average: 2.2205 StdDev: 17.45 Min: 1 Median: 1.3916 Max: 2575 Percentiles: P50: 1.39 P75: 1.81 P99: 5.73 P99.9: 24.08 P99.99: 498.66 ------------------------------------------------------ [ 0, 1 ] 23241 26.370% 26.370% ##### ( 1, 2 ] 53184 60.344% 86.715% ############ ( 2, 3 ] 6570 7.455% 94.169% # ( 3, 4 ] 2648 3.005% 97.174% # ( 4, 6 ] 1863 2.114% 99.287% ( 6, 10 ] 431 0.489% 99.776% ( 10, 15 ] 97 0.110% 99.887% ( 15, 22 ] 11 0.012% 99.899% ( 22, 34 ] 5 0.006% 99.905% ( 34, 51 ] 26 0.030% 99.934% ( 51, 76 ] 26 0.030% 99.964% ( 76, 110 ] 3 0.003% 99.967% ( 110, 170 ] 7 0.008% 99.975% ( 170, 250 ] 7 0.008% 99.983% ( 250, 380 ] 5 0.006% 99.989% ( 380, 580 ] 2 0.002% 99.991% ( 580, 870 ] 2 0.002% 99.993% ( 870, 1300 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 42756 Average: 4.4184 StdDev: 82.69 Min: 1 Median: 1.5803 Max: 6936 Percentiles: P50: 1.58 P75: 1.96 P99: 5.96 P99.9: 415.54 P99.99: 4798.42 ------------------------------------------------------ [ 0, 1 ] 4933 11.538% 11.538% ## ( 1, 2 ] 28340 66.283% 77.821% ############# ( 2, 3 ] 6576 15.380% 93.201% ### ( 3, 4 ] 1437 3.361% 96.562% # ( 4, 6 ] 1064 2.489% 99.050% ( 6, 10 ] 278 0.650% 99.701% ( 10, 15 ] 58 0.136% 99.836% ( 15, 22 ] 4 0.009% 99.846% ( 22, 34 ] 2 0.005% 99.850% ( 34, 51 ] 1 0.002% 99.853% ( 51, 76 ] 3 0.007% 99.860% ( 110, 170 ] 2 0.005% 99.864% ( 170, 250 ] 3 0.007% 99.871% ( 250, 380 ] 11 0.026% 99.897% ( 380, 580 ] 7 0.016% 99.913% ( 580, 870 ] 9 0.021% 99.935% ( 870, 1300 ] 5 0.012% 99.946% ( 1300, 1900 ] 3 0.007% 99.953% ( 1900, 2900 ] 10 0.023% 99.977% ( 2900, 4400 ] 5 0.012% 99.988% ( 4400, 6600 ] 4 0.009% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 127.7065 StdDev: 577.95 Min: 0 Median: 1.8302 Max: 4964 Percentiles: P50: 1.83 P75: 5.94 P99: 3770.00 P99.9: 4964.00 P99.99: 4964.00 ------------------------------------------------------ [ 0, 1 ] 67 21.613% 21.613% #### ( 1, 2 ] 106 34.194% 55.806% ####### ( 2, 3 ] 37 11.935% 67.742% ## ( 3, 4 ] 6 1.935% 69.677% ( 4, 6 ] 17 5.484% 75.161% # ( 6, 10 ] 33 10.645% 85.806% ## ( 10, 15 ] 13 4.194% 90.000% # ( 15, 22 ] 4 1.290% 91.290% ( 22, 34 ] 3 0.968% 92.258% ( 110, 170 ] 2 0.645% 92.903% ( 170, 250 ] 2 0.645% 93.548% ( 250, 380 ] 1 0.323% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 2 0.645% 95.484% ( 870, 1300 ] 2 0.645% 96.129% ( 1300, 1900 ] 5 1.613% 97.742% ( 1900, 2900 ] 1 0.323% 98.065% ( 2900, 4400 ] 5 1.613% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 783.2000 StdDev: 950.23 Min: 79 Median: 305.7143 Max: 3775 Percentiles: P50: 305.71 P75: 1156.67 P99: 3775.00 P99.9: 3775.00 P99.99: 3775.00 ------------------------------------------------------ ( 76, 110 ] 6 15.000% 15.000% ### ( 110, 170 ] 4 10.000% 25.000% ## ( 170, 250 ] 7 17.500% 42.500% #### ( 250, 380 ] 7 17.500% 60.000% #### ( 380, 580 ] 2 5.000% 65.000% # ( 580, 870 ] 2 5.000% 70.000% # ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 3 7.500% 85.000% ## ( 1900, 2900 ] 4 10.000% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.1 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 326.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.741 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.04 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.378 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/08-00:34:48 ... thread 0: (1000000,6000000) ops and (52052.0,176040.8) ops/second in (19.211552,34.083011) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/5 1007.02 MB 6.3 4.4 0.0 4.4 10.0 5.7 0.0 1.8 134.2 307.8 33.34 31.18 98 0.340 4541K 4796 0.0 0.0 L1 8/8 906.82 MB 0.0 5.1 4.5 0.7 5.1 4.4 0.2 1.1 221.2 217.8 23.83 22.01 3 7.944 5353K 81K 0.0 0.0 L2 18/14 2.19 GB 5.2 0.3 0.2 0.2 0.3 0.2 3.5 1.8 245.1 245.0 1.42 1.35 2 0.712 354K 170 0.0 0.0 L3 21/7 1.71 GB 0.9 0.2 0.2 0.0 0.2 0.2 1.4 1.0 229.5 229.5 0.81 0.76 1 0.815 189K 0 0.0 0.0 L4 174/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.6 1.0 135.9 135.9 1.24 0.87 1 1.237 170K 0 0.0 0.0 L5 1048/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/34 101.71 GB 0.0 10.2 5.0 5.2 15.8 10.6 6.4 2.8 172.3 266.4 60.65 56.17 105 0.578 10M 86K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 5.0 5.2 15.8 10.6 6.4 2.8 172.3 266.4 60.65 56.17 105 0.578 10M 86K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 5.0 5.2 10.1 4.9 0.0 0.0 236.6 234.6 44.17 41.54 23 1.920 10M 86K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 351.7 16.48 14.63 82 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.3 total, 34.1 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.78 GB write, 471.29 MB/s write, 10.20 GB read, 304.78 MB/s read, 60.6 seconds Interval compaction: 15.78 GB write, 474.04 MB/s write, 10.20 GB read, 306.56 MB/s read, 60.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 15, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2356664 Average: 2.6164 StdDev: 20.64 Min: 0 Median: 1.3505 Max: 4722 Percentiles: P50: 1.35 P75: 1.76 P99: 5.80 P99.9: 150.71 P99.99: 419.75 ------------------------------------------------------ [ 0, 1 ] 674651 28.627% 28.627% ###### ( 1, 2 ] 1436879 60.971% 89.598% ############ ( 2, 3 ] 139017 5.899% 95.497% # ( 3, 4 ] 52692 2.236% 97.733% ( 4, 6 ] 33169 1.407% 99.140% ( 6, 10 ] 8549 0.363% 99.503% ( 10, 15 ] 2074 0.088% 99.591% ( 15, 22 ] 328 0.014% 99.605% ( 22, 34 ] 25 0.001% 99.606% ( 34, 51 ] 10 0.000% 99.607% ( 51, 76 ] 87 0.004% 99.610% ( 76, 110 ] 4503 0.191% 99.801% ( 110, 170 ] 3426 0.145% 99.947% ( 170, 250 ] 516 0.022% 99.969% ( 250, 380 ] 430 0.018% 99.987% ( 380, 580 ] 369 0.016% 100.003% ( 580, 870 ] 182 0.008% 100.010% ( 870, 1300 ] 55 0.002% 100.013% ( 1300, 1900 ] 25 0.001% 100.014% ( 1900, 2900 ] 35 0.001% 100.015% ( 2900, 4400 ] 25 0.001% 100.016% ( 4400, 6600 ] 1 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 237866 Average: 3.9256 StdDev: 34.65 Min: 1 Median: 1.5123 Max: 4765 Percentiles: P50: 1.51 P75: 1.94 P99: 9.17 P99.9: 185.23 P99.99: 367.12 ------------------------------------------------------ [ 0, 1 ] 47913 20.143% 20.143% #### ( 1, 2 ] 138640 58.285% 78.428% ############ ( 2, 3 ] 26122 10.982% 89.410% ## ( 3, 4 ] 11863 4.987% 94.397% # ( 4, 6 ] 9217 3.875% 98.272% # ( 6, 10 ] 2184 0.918% 99.190% ( 10, 15 ] 398 0.167% 99.357% ( 15, 22 ] 53 0.022% 99.379% ( 22, 34 ] 4 0.002% 99.381% ( 34, 51 ] 2 0.001% 99.382% ( 51, 76 ] 12 0.005% 99.387% ( 76, 110 ] 629 0.264% 99.651% ( 110, 170 ] 567 0.238% 99.890% ( 170, 250 ] 132 0.055% 99.945% ( 250, 380 ] 119 0.050% 99.995% ( 380, 580 ] 134 0.056% 100.052% ( 580, 870 ] 57 0.024% 100.076% ( 870, 1300 ] 49 0.021% 100.096% ( 1300, 1900 ] 18 0.008% 100.104% ( 1900, 2900 ] 8 0.003% 100.107% ( 2900, 4400 ] 2 0.001% 100.108% ( 4400, 6600 ] 2 0.001% 100.109% ** Level 2 read latency histogram (micros): Count: 88464 Average: 2.4747 StdDev: 20.77 Min: 1 Median: 1.3947 Max: 2575 Percentiles: P50: 1.39 P75: 1.81 P99: 5.85 P99.9: 121.83 P99.99: 892.02 ------------------------------------------------------ [ 0, 1 ] 23241 26.272% 26.272% ##### ( 1, 2 ] 53187 60.123% 86.394% ############ ( 2, 3 ] 6584 7.443% 93.837% # ( 3, 4 ] 2701 3.053% 96.890% # ( 4, 6 ] 2015 2.278% 99.168% ( 6, 10 ] 465 0.526% 99.694% ( 10, 15 ] 101 0.114% 99.808% ( 15, 22 ] 17 0.019% 99.827% ( 22, 34 ] 5 0.006% 99.833% ( 34, 51 ] 26 0.029% 99.862% ( 51, 76 ] 26 0.029% 99.891% ( 76, 110 ] 3 0.003% 99.895% ( 110, 170 ] 23 0.026% 99.921% ( 170, 250 ] 24 0.027% 99.948% ( 250, 380 ] 17 0.019% 99.967% ( 380, 580 ] 12 0.014% 99.981% ( 580, 870 ] 8 0.009% 99.990% ( 870, 1300 ] 3 0.003% 99.993% ( 1300, 1900 ] 3 0.003% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 55926 Average: 4.9789 StdDev: 79.14 Min: 1 Median: 1.6648 Max: 6936 Percentiles: P50: 1.66 P75: 2.25 P99: 8.50 P99.9: 763.39 P99.99: 4251.85 ------------------------------------------------------ [ 0, 1 ] 5087 9.096% 9.096% ## ( 1, 2 ] 34408 61.524% 70.620% ############ ( 2, 3 ] 9891 17.686% 88.306% #### ( 3, 4 ] 2971 5.312% 93.618% # ( 4, 6 ] 2545 4.551% 98.169% # ( 6, 10 ] 744 1.330% 99.499% ( 10, 15 ] 129 0.231% 99.730% ( 15, 22 ] 16 0.029% 99.759% ( 22, 34 ] 2 0.004% 99.762% ( 34, 51 ] 1 0.002% 99.764% ( 51, 76 ] 3 0.005% 99.769% ( 76, 110 ] 1 0.002% 99.771% ( 110, 170 ] 4 0.007% 99.778% ( 170, 250 ] 13 0.023% 99.802% ( 250, 380 ] 20 0.036% 99.837% ( 380, 580 ] 18 0.032% 99.869% ( 580, 870 ] 27 0.048% 99.918% ( 870, 1300 ] 16 0.029% 99.946% ( 1300, 1900 ] 6 0.011% 99.957% ( 1900, 2900 ] 13 0.023% 99.980% ( 2900, 4400 ] 6 0.011% 99.991% ( 4400, 6600 ] 4 0.007% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 127.7065 StdDev: 577.95 Min: 0 Median: 1.8302 Max: 4964 Percentiles: P50: 1.83 P75: 5.94 P99: 3770.00 P99.9: 4964.00 P99.99: 4964.00 ------------------------------------------------------ [ 0, 1 ] 67 21.613% 21.613% #### ( 1, 2 ] 106 34.194% 55.806% ####### ( 2, 3 ] 37 11.935% 67.742% ## ( 3, 4 ] 6 1.935% 69.677% ( 4, 6 ] 17 5.484% 75.161% # ( 6, 10 ] 33 10.645% 85.806% ## ( 10, 15 ] 13 4.194% 90.000% # ( 15, 22 ] 4 1.290% 91.290% ( 22, 34 ] 3 0.968% 92.258% ( 110, 170 ] 2 0.645% 92.903% ( 170, 250 ] 2 0.645% 93.548% ( 250, 380 ] 1 0.323% 93.871% ( 380, 580 ] 3 0.968% 94.839% ( 580, 870 ] 2 0.645% 95.484% ( 870, 1300 ] 2 0.645% 96.129% ( 1300, 1900 ] 5 1.613% 97.742% ( 1900, 2900 ] 1 0.323% 98.065% ( 2900, 4400 ] 5 1.613% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 783.2000 StdDev: 950.23 Min: 79 Median: 305.7143 Max: 3775 Percentiles: P50: 305.71 P75: 1156.67 P99: 3775.00 P99.9: 3775.00 P99.99: 3775.00 ------------------------------------------------------ ( 76, 110 ] 6 15.000% 15.000% ### ( 110, 170 ] 4 10.000% 25.000% ## ( 170, 250 ] 7 17.500% 42.500% #### ( 250, 380 ] 7 17.500% 60.000% #### ( 380, 580 ] 2 5.000% 65.000% # ( 580, 870 ] 2 5.000% 70.000% # ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 3 7.500% 85.000% ## ( 1900, 2900 ] 4 10.000% 95.000% ## ( 2900, 4400 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 34.3 total, 19.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 172.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.153 H:M:S, 52.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 51.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:16.412 H:M:S, 85.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/08-00:34:55 ... thread 0: (1000000,7000000) ops and (154128.8,172536.7) ops/second in (6.488079,40.571090) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.97 GB 69.2 5.0 0.0 5.0 11.7 6.6 0.0 1.8 121.7 281.8 42.45 36.75 111 0.382 5244K 5700 0.0 0.0 L1 8/8 906.82 MB 0.0 5.1 4.5 0.7 5.1 4.4 0.2 1.1 221.2 217.8 23.83 22.01 3 7.944 5353K 81K 0.0 0.0 L2 1/1 128.78 MB 0.0 0.3 0.2 0.2 0.3 0.2 3.5 1.8 245.1 245.0 1.42 1.35 2 0.712 354K 170 0.0 0.0 L3 17/3 1.08 GB 1.0 3.3 2.2 1.1 3.3 2.2 1.4 1.5 155.4 154.6 21.94 15.66 9 2.437 3462K 18K 0.0 0.0 L4 176/1 9.41 GB 1.0 2.7 2.6 0.1 2.7 2.6 0.8 1.0 120.8 120.6 22.92 12.96 36 0.637 2753K 2190 0.0 0.0 L5 1084/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1297/22 102.67 GB 0.0 16.6 9.5 7.1 23.1 16.1 9.6 3.5 150.7 210.2 112.56 88.74 161 0.699 17M 108K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.6 9.5 7.1 23.1 16.1 9.6 3.5 150.7 210.2 112.56 88.74 161 0.699 17M 108K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.6 9.5 7.1 16.5 9.4 0.0 0.0 188.4 187.1 90.06 71.30 68 1.324 17M 108K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 302.3 22.51 17.44 93 0.242 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 40.8 total, 40.6 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.10 GB write, 580.20 MB/s write, 16.57 GB read, 416.07 MB/s read, 112.6 seconds Interval compaction: 23.10 GB write, 583.05 MB/s write, 16.57 GB read, 418.11 MB/s read, 112.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 53, interval: 63 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2732131 Average: 2.8691 StdDev: 28.82 Min: 0 Median: 1.4141 Max: 6449 Percentiles: P50: 1.41 P75: 1.83 P99: 6.61 P99.9: 151.20 P99.99: 534.47 ------------------------------------------------------ [ 0, 1 ] 687887 25.178% 25.178% ##### ( 1, 2 ] 1637704 59.942% 85.120% ############ ( 2, 3 ] 216064 7.908% 93.028% ## ( 3, 4 ] 91740 3.358% 96.386% # ( 4, 6 ] 68927 2.523% 98.909% # ( 6, 10 ] 16286 0.596% 99.505% ( 10, 15 ] 3337 0.122% 99.627% ( 15, 22 ] 456 0.017% 99.644% ( 22, 34 ] 32 0.001% 99.645% ( 34, 51 ] 12 0.000% 99.645% ( 51, 76 ] 90 0.003% 99.649% ( 76, 110 ] 4506 0.165% 99.814% ( 110, 170 ] 3437 0.126% 99.939% ( 170, 250 ] 536 0.020% 99.959% ( 250, 380 ] 482 0.018% 99.977% ( 380, 580 ] 471 0.017% 99.994% ( 580, 870 ] 306 0.011% 100.005% ( 870, 1300 ] 160 0.006% 100.011% ( 1300, 1900 ] 62 0.002% 100.013% ( 1900, 2900 ] 74 0.003% 100.016% ( 2900, 4400 ] 63 0.002% 100.018% ( 4400, 6600 ] 8 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 939628 Average: 6.4927 StdDev: 100.19 Min: 1 Median: 1.8265 Max: 12767 Percentiles: P50: 1.83 P75: 2.79 P99: 9.34 P99.9: 129.68 P99.99: 336.82 ------------------------------------------------------ [ 0, 1 ] 60104 6.397% 6.397% # ( 1, 2 ] 495705 52.755% 59.152% ########### ( 2, 3 ] 189133 20.128% 79.281% #### ( 3, 4 ] 87000 9.259% 88.540% ## ( 4, 6 ] 80670 8.585% 97.125% ## ( 6, 10 ] 21129 2.249% 99.373% ( 10, 15 ] 3547 0.377% 99.751% ( 15, 22 ] 475 0.051% 99.802% ( 22, 34 ] 46 0.005% 99.806% ( 34, 51 ] 18 0.002% 99.808% ( 51, 76 ] 16 0.002% 99.810% ( 76, 110 ] 644 0.069% 99.879% ( 110, 170 ] 617 0.066% 99.944% ( 170, 250 ] 218 0.023% 99.967% ( 250, 380 ] 319 0.034% 100.001% ( 380, 580 ] 495 0.053% 100.054% ( 580, 870 ] 451 0.048% 100.102% ( 870, 1300 ] 348 0.037% 100.139% ( 1300, 1900 ] 205 0.022% 100.161% ( 1900, 2900 ] 221 0.024% 100.184% ( 2900, 4400 ] 242 0.026% 100.210% ( 4400, 6600 ] 74 0.008% 100.218% ( 6600, 9900 ] 22 0.002% 100.220% ( 9900, 14000 ] 4 0.000% 100.221% ** Level 2 read latency histogram (micros): Count: 100906 Average: 2.6382 StdDev: 21.01 Min: 1 Median: 1.4498 Max: 2575 Percentiles: P50: 1.45 P75: 1.87 P99: 6.65 P99.9: 157.34 P99.99: 948.21 ------------------------------------------------------ [ 0, 1 ] 23444 23.234% 23.234% ##### ( 1, 2 ] 60044 59.505% 82.738% ############ ( 2, 3 ] 9485 9.400% 92.138% ## ( 3, 4 ] 3762 3.728% 95.866% # ( 4, 6 ] 3036 3.009% 98.875% # ( 6, 10 ] 780 0.773% 99.648% ( 10, 15 ] 150 0.149% 99.797% ( 15, 22 ] 21 0.021% 99.818% ( 22, 34 ] 6 0.006% 99.824% ( 34, 51 ] 26 0.026% 99.849% ( 51, 76 ] 26 0.026% 99.875% ( 76, 110 ] 3 0.003% 99.878% ( 110, 170 ] 28 0.028% 99.906% ( 170, 250 ] 29 0.029% 99.935% ( 250, 380 ] 23 0.023% 99.957% ( 380, 580 ] 18 0.018% 99.975% ( 580, 870 ] 14 0.014% 99.989% ( 870, 1300 ] 5 0.005% 99.994% ( 1300, 1900 ] 3 0.003% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 812972 Average: 7.6375 StdDev: 114.36 Min: 1 Median: 1.9756 Max: 11516 Percentiles: P50: 1.98 P75: 2.97 P99: 8.90 P99.9: 13.83 P99.99: 14.86 ------------------------------------------------------ [ 0, 1 ] 12669 1.558% 1.558% ( 1, 2 ] 403648 49.651% 51.209% ########## ( 2, 3 ] 198651 24.435% 75.644% ##### ( 3, 4 ] 91405 11.243% 86.888% ## ( 4, 6 ] 86335 10.620% 97.507% ## ( 6, 10 ] 16730 2.058% 99.565% ( 10, 15 ] 3555 0.437% 100.003% ( 15, 22 ] 436 0.054% 100.056% ( 22, 34 ] 37 0.005% 100.061% ( 34, 51 ] 22 0.003% 100.063% ( 51, 76 ] 11 0.001% 100.065% ( 76, 110 ] 12 0.001% 100.066% ( 110, 170 ] 58 0.007% 100.073% ( 170, 250 ] 136 0.017% 100.090% ( 250, 380 ] 251 0.031% 100.121% ( 380, 580 ] 388 0.048% 100.169% ( 580, 870 ] 517 0.064% 100.232% ( 870, 1300 ] 376 0.046% 100.279% ( 1300, 1900 ] 272 0.033% 100.312% ( 1900, 2900 ] 263 0.032% 100.344% ( 2900, 4400 ] 304 0.037% 100.382% ( 4400, 6600 ] 95 0.012% 100.393% ( 6600, 9900 ] 19 0.002% 100.396% ( 9900, 14000 ] 3 0.000% 100.396% ** Level 4 read latency histogram (micros): Count: 28074 Average: 141.1328 StdDev: 594.58 Min: 0 Median: 2.0642 Max: 12096 Percentiles: P50: 2.06 P75: 3.37 P99: 3506.10 P99.9: 6079.07 P99.99: 8576.51 ------------------------------------------------------ [ 0, 1 ] 673 2.397% 2.397% ( 1, 2 ] 12961 46.167% 48.565% ######### ( 2, 3 ] 6273 22.345% 70.909% #### ( 3, 4 ] 3080 10.971% 81.880% ## ( 4, 6 ] 1830 6.518% 88.399% # ( 6, 10 ] 610 2.173% 90.571% ( 10, 15 ] 117 0.417% 90.988% ( 15, 22 ] 39 0.139% 91.127% ( 22, 34 ] 12 0.043% 91.170% ( 34, 51 ] 5 0.018% 91.188% ( 51, 76 ] 1 0.004% 91.191% ( 76, 110 ] 1 0.004% 91.195% ( 110, 170 ] 20 0.071% 91.266% ( 170, 250 ] 87 0.310% 91.576% ( 250, 380 ] 144 0.513% 92.089% ( 380, 580 ] 274 0.976% 93.065% ( 580, 870 ] 471 1.678% 94.742% ( 870, 1300 ] 433 1.542% 96.285% ( 1300, 1900 ] 350 1.247% 97.532% ( 1900, 2900 ] 287 1.022% 98.554% ( 2900, 4400 ] 310 1.104% 99.658% ( 4400, 6600 ] 89 0.317% 99.975% ( 6600, 9900 ] 7 0.025% 100.000% ( 9900, 14000 ] 2 0.007% 100.007% ** Level 5 read latency histogram (micros): Count: 220 Average: 1439.4045 StdDev: 1462.34 Min: 79 Median: 835.8824 Max: 6790 Percentiles: P50: 835.88 P75: 2257.14 P99: 6537.14 P99.9: 6790.00 P99.99: 6790.00 ------------------------------------------------------ ( 76, 110 ] 9 4.091% 4.091% # ( 110, 170 ] 11 5.000% 9.091% # ( 170, 250 ] 18 8.182% 17.273% ## ( 250, 380 ] 29 13.182% 30.455% ### ( 380, 580 ] 28 12.727% 43.182% ### ( 580, 870 ] 17 7.727% 50.909% ## ( 870, 1300 ] 24 10.909% 61.818% ## ( 1300, 1900 ] 19 8.636% 70.455% ## ( 1900, 2900 ] 28 12.727% 83.182% ### ( 2900, 4400 ] 28 12.727% 95.909% ### ( 4400, 6600 ] 7 3.182% 99.091% # ( 6600, 9900 ] 2 0.909% 100.000% ** DB Stats ** Uptime(secs): 40.8 total, 6.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 168.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.681 H:M:S, 53.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 151.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.528 H:M:S, 54.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/08-00:34:58 ... thread 0: (1000000,8000000) ops and (318994.6,183041.5) ops/second in (3.134849,43.705939) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 2.89 GB 176.2 6.0 0.0 6.0 13.5 7.6 0.0 1.8 125.1 283.7 48.83 42.73 127 0.384 6204K 6810 0.0 0.0 L1 8/8 906.82 MB 0.0 5.1 4.5 0.7 5.1 4.4 0.2 1.1 221.2 217.8 23.83 22.01 3 7.944 5353K 81K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 3.5 1.8 245.1 245.0 1.42 1.35 2 0.712 354K 170 0.0 0.0 L3 13/0 951.90 MB 1.0 3.5 2.4 1.2 3.5 2.4 1.4 1.5 157.1 156.2 23.06 16.60 10 2.306 3679K 19K 0.0 0.0 L4 181/0 9.69 GB 1.0 3.0 2.9 0.1 3.0 2.9 0.9 1.0 125.0 124.8 24.50 14.28 40 0.612 3051K 2728 0.0 0.0 L5 1084/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1301/17 103.59 GB 0.0 18.0 9.9 8.1 25.4 17.4 9.6 3.4 151.4 214.2 121.64 96.96 182 0.668 18M 111K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.0 9.9 8.1 25.4 17.4 9.6 3.4 151.4 214.2 121.64 96.96 182 0.668 18M 111K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.0 9.9 8.1 17.9 9.8 0.0 0.0 191.0 189.8 96.41 77.13 76 1.269 18M 111K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 307.1 25.23 19.84 106 0.238 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.9 total, 43.7 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.44 GB write, 593.30 MB/s write, 17.98 GB read, 419.44 MB/s read, 121.6 seconds Interval compaction: 25.44 GB write, 596.01 MB/s write, 17.98 GB read, 421.35 MB/s read, 121.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 59, interval: 69 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3036532 Average: 2.8256 StdDev: 27.76 Min: 0 Median: 1.4341 Max: 6449 Percentiles: P50: 1.43 P75: 1.85 P99: 6.40 P99.9: 144.88 P99.99: 485.36 ------------------------------------------------------ [ 0, 1 ] 720348 23.723% 23.723% ##### ( 1, 2 ] 1838070 60.532% 84.255% ############ ( 2, 3 ] 259383 8.542% 92.797% ## ( 3, 4 ] 106276 3.500% 96.297% # ( 4, 6 ] 80280 2.644% 98.940% # ( 6, 10 ] 18194 0.599% 99.540% ( 10, 15 ] 3788 0.125% 99.664% ( 15, 22 ] 483 0.016% 99.680% ( 22, 34 ] 33 0.001% 99.681% ( 34, 51 ] 14 0.000% 99.682% ( 51, 76 ] 91 0.003% 99.685% ( 76, 110 ] 4532 0.149% 99.834% ( 110, 170 ] 3446 0.113% 99.948% ( 170, 250 ] 550 0.018% 99.966% ( 250, 380 ] 488 0.016% 99.982% ( 380, 580 ] 479 0.016% 99.997% ( 580, 870 ] 311 0.010% 100.008% ( 870, 1300 ] 165 0.005% 100.013% ( 1300, 1900 ] 65 0.002% 100.015% ( 1900, 2900 ] 75 0.002% 100.018% ( 2900, 4400 ] 67 0.002% 100.020% ( 4400, 6600 ] 8 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1093754 Average: 5.9869 StdDev: 92.97 Min: 1 Median: 1.8025 Max: 12767 Percentiles: P50: 1.80 P75: 2.72 P99: 9.26 P99.9: 130.33 P99.99: 345.44 ------------------------------------------------------ [ 0, 1 ] 69315 6.337% 6.337% # ( 1, 2 ] 595105 54.409% 60.747% ########### ( 2, 3 ] 216958 19.836% 80.583% #### ( 3, 4 ] 94246 8.617% 89.200% ## ( 4, 6 ] 87584 8.008% 97.207% ## ( 6, 10 ] 24075 2.201% 99.408% ( 10, 15 ] 3773 0.345% 99.753% ( 15, 22 ] 503 0.046% 99.799% ( 22, 34 ] 46 0.004% 99.804% ( 34, 51 ] 18 0.002% 99.805% ( 51, 76 ] 25 0.002% 99.807% ( 76, 110 ] 774 0.071% 99.878% ( 110, 170 ] 703 0.064% 99.942% ( 170, 250 ] 259 0.024% 99.966% ( 250, 380 ] 355 0.032% 99.999% ( 380, 580 ] 525 0.048% 100.047% ( 580, 870 ] 458 0.042% 100.089% ( 870, 1300 ] 350 0.032% 100.121% ( 1300, 1900 ] 205 0.019% 100.139% ( 1900, 2900 ] 221 0.020% 100.159% ( 2900, 4400 ] 242 0.022% 100.182% ( 4400, 6600 ] 74 0.007% 100.188% ( 6600, 9900 ] 22 0.002% 100.190% ( 9900, 14000 ] 4 0.000% 100.191% ** Level 2 read latency histogram (micros): Count: 100906 Average: 2.6382 StdDev: 21.01 Min: 1 Median: 1.4498 Max: 2575 Percentiles: P50: 1.45 P75: 1.87 P99: 6.65 P99.9: 157.34 P99.99: 948.21 ------------------------------------------------------ [ 0, 1 ] 23444 23.234% 23.234% ##### ( 1, 2 ] 60044 59.505% 82.738% ############ ( 2, 3 ] 9485 9.400% 92.138% ## ( 3, 4 ] 3762 3.728% 95.866% # ( 4, 6 ] 3036 3.009% 98.875% # ( 6, 10 ] 780 0.773% 99.648% ( 10, 15 ] 150 0.149% 99.797% ( 15, 22 ] 21 0.021% 99.818% ( 22, 34 ] 6 0.006% 99.824% ( 34, 51 ] 26 0.026% 99.849% ( 51, 76 ] 26 0.026% 99.875% ( 76, 110 ] 3 0.003% 99.878% ( 110, 170 ] 28 0.028% 99.906% ( 170, 250 ] 29 0.029% 99.935% ( 250, 380 ] 23 0.023% 99.957% ( 380, 580 ] 18 0.018% 99.975% ( 580, 870 ] 14 0.014% 99.989% ( 870, 1300 ] 5 0.005% 99.994% ( 1300, 1900 ] 3 0.003% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 881625 Average: 7.2640 StdDev: 109.83 Min: 1 Median: 1.9679 Max: 11516 Percentiles: P50: 1.97 P75: 2.96 P99: 8.84 P99.9: 13.66 P99.99: 14.72 ------------------------------------------------------ [ 0, 1 ] 13639 1.547% 1.547% ( 1, 2 ] 441320 50.058% 51.605% ########## ( 2, 3 ] 214883 24.374% 75.978% ##### ( 3, 4 ] 98022 11.118% 87.096% ## ( 4, 6 ] 92278 10.467% 97.563% ## ( 6, 10 ] 17857 2.025% 99.589% ( 10, 15 ] 3748 0.425% 100.014% ( 15, 22 ] 450 0.051% 100.065% ( 22, 34 ] 38 0.004% 100.069% ( 34, 51 ] 22 0.002% 100.072% ( 51, 76 ] 12 0.001% 100.073% ( 76, 110 ] 12 0.001% 100.074% ( 110, 170 ] 58 0.007% 100.081% ( 170, 250 ] 140 0.016% 100.097% ( 250, 380 ] 252 0.029% 100.125% ( 380, 580 ] 389 0.044% 100.170% ( 580, 870 ] 517 0.059% 100.228% ( 870, 1300 ] 376 0.043% 100.271% ( 1300, 1900 ] 272 0.031% 100.302% ( 1900, 2900 ] 263 0.030% 100.332% ( 2900, 4400 ] 304 0.034% 100.366% ( 4400, 6600 ] 95 0.011% 100.377% ( 6600, 9900 ] 19 0.002% 100.379% ( 9900, 14000 ] 3 0.000% 100.379% ** Level 4 read latency histogram (micros): Count: 30458 Average: 132.2811 StdDev: 572.37 Min: 0 Median: 2.0367 Max: 12096 Percentiles: P50: 2.04 P75: 3.35 P99: 3390.74 P99.9: 6020.14 P99.99: 8464.12 ------------------------------------------------------ [ 0, 1 ] 765 2.512% 2.512% # ( 1, 2 ] 14217 46.677% 49.189% ######### ( 2, 3 ] 6725 22.080% 71.269% #### ( 3, 4 ] 3288 10.795% 82.064% ## ( 4, 6 ] 1937 6.360% 88.423% # ( 6, 10 ] 663 2.177% 90.600% ( 10, 15 ] 124 0.407% 91.007% ( 15, 22 ] 43 0.141% 91.148% ( 22, 34 ] 12 0.039% 91.188% ( 34, 51 ] 7 0.023% 91.211% ( 51, 76 ] 1 0.003% 91.214% ( 76, 110 ] 22 0.072% 91.286% ( 110, 170 ] 68 0.223% 91.510% ( 170, 250 ] 132 0.433% 91.943% ( 250, 380 ] 181 0.594% 92.537% ( 380, 580 ] 305 1.001% 93.539% ( 580, 870 ] 487 1.599% 95.138% ( 870, 1300 ] 438 1.438% 96.576% ( 1300, 1900 ] 350 1.149% 97.725% ( 1900, 2900 ] 287 0.942% 98.667% ( 2900, 4400 ] 310 1.018% 99.685% ( 4400, 6600 ] 89 0.292% 99.977% ( 6600, 9900 ] 7 0.023% 100.000% ( 9900, 14000 ] 2 0.007% 100.007% ** Level 5 read latency histogram (micros): Count: 220 Average: 1439.4045 StdDev: 1462.34 Min: 79 Median: 835.8824 Max: 6790 Percentiles: P50: 835.88 P75: 2257.14 P99: 6537.14 P99.9: 6790.00 P99.99: 6790.00 ------------------------------------------------------ ( 76, 110 ] 9 4.091% 4.091% # ( 110, 170 ] 11 5.000% 9.091% # ( 170, 250 ] 18 8.182% 17.273% ## ( 250, 380 ] 29 13.182% 30.455% ### ( 380, 580 ] 28 12.727% 43.182% ### ( 580, 870 ] 17 7.727% 50.909% ## ( 870, 1300 ] 24 10.909% 61.818% ## ( 1300, 1900 ] 19 8.636% 70.455% ## ( 1900, 2900 ] 28 12.727% 83.182% ### ( 2900, 4400 ] 28 12.727% 95.909% ### ( 4400, 6600 ] 7 3.182% 99.091% # ( 6600, 9900 ] 2 0.909% 100.000% ** DB Stats ** Uptime(secs): 43.9 total, 3.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 179.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.100 H:M:S, 50.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 313.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.419 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/08-00:35:01 ... thread 0: (1000000,9000000) ops and (316287.7,192030.2) ops/second in (3.161678,46.867617) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 2.95 GB 56.7 6.5 0.0 6.5 15.1 8.5 0.0 1.8 123.7 285.8 53.98 47.50 143 0.378 6780K 7422 0.0 0.0 L1 21/21 1.80 GB 0.0 7.0 5.4 1.5 6.9 5.3 0.2 1.3 207.5 204.8 34.33 30.22 4 8.582 6312K 81K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 3.5 1.8 245.1 245.0 1.42 1.35 2 0.712 354K 170 0.0 0.0 L3 13/0 951.90 MB 1.0 3.5 2.4 1.2 3.5 2.4 1.4 1.5 157.1 156.2 23.06 16.60 10 2.306 3679K 19K 0.0 0.0 L4 181/0 9.69 GB 1.0 3.0 2.9 0.1 3.0 2.9 0.9 1.0 125.0 124.8 24.50 14.28 40 0.612 3051K 2728 0.0 0.0 L5 1084/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1317/35 104.56 GB 0.0 20.3 10.8 9.5 28.8 19.3 9.6 3.4 151.7 214.6 137.29 109.94 199 0.690 20M 112K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.3 10.8 9.5 28.8 19.3 9.6 3.4 151.7 214.6 137.29 109.94 199 0.690 20M 112K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.3 10.8 9.5 20.2 10.7 0.0 0.0 191.0 189.8 109.10 87.45 79 1.381 20M 112K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 310.6 28.20 22.49 120 0.235 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.1 total, 46.9 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.77 GB write, 625.96 MB/s write, 20.35 GB read, 442.63 MB/s read, 137.3 seconds Interval compaction: 28.77 GB write, 628.62 MB/s write, 20.35 GB read, 444.51 MB/s read, 137.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 63, interval: 73 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3306095 Average: 2.7851 StdDev: 27.02 Min: 0 Median: 1.4384 Max: 6449 Percentiles: P50: 1.44 P75: 1.85 P99: 6.07 P99.9: 140.77 P99.99: 447.49 ------------------------------------------------------ [ 0, 1 ] 767755 23.222% 23.222% ##### ( 1, 2 ] 2019342 61.079% 84.302% ############ ( 2, 3 ] 284974 8.620% 92.921% ## ( 3, 4 ] 115916 3.506% 96.428% # ( 4, 6 ] 84693 2.562% 98.989% # ( 6, 10 ] 19242 0.582% 99.571% ( 10, 15 ] 3891 0.118% 99.689% ( 15, 22 ] 502 0.015% 99.704% ( 22, 34 ] 34 0.001% 99.705% ( 34, 51 ] 15 0.000% 99.706% ( 51, 76 ] 92 0.003% 99.708% ( 76, 110 ] 4549 0.138% 99.846% ( 110, 170 ] 3481 0.105% 99.951% ( 170, 250 ] 595 0.018% 99.969% ( 250, 380 ] 515 0.016% 99.985% ( 380, 580 ] 502 0.015% 100.000% ( 580, 870 ] 323 0.010% 100.010% ( 870, 1300 ] 174 0.005% 100.015% ( 1300, 1900 ] 69 0.002% 100.017% ( 1900, 2900 ] 75 0.002% 100.019% ( 2900, 4400 ] 70 0.002% 100.022% ( 4400, 6600 ] 8 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1160113 Average: 5.8535 StdDev: 90.60 Min: 1 Median: 1.7809 Max: 12767 Percentiles: P50: 1.78 P75: 2.67 P99: 9.24 P99.9: 142.08 P99.99: 374.30 ------------------------------------------------------ [ 0, 1 ] 81813 7.052% 7.052% # ( 1, 2 ] 638028 54.997% 62.049% ########### ( 2, 3 ] 223311 19.249% 81.298% #### ( 3, 4 ] 96275 8.299% 89.597% ## ( 4, 6 ] 88848 7.659% 97.256% ## ( 6, 10 ] 24951 2.151% 99.406% ( 10, 15 ] 3836 0.331% 99.737% ( 15, 22 ] 511 0.044% 99.781% ( 22, 34 ] 48 0.004% 99.785% ( 34, 51 ] 19 0.002% 99.787% ( 51, 76 ] 26 0.002% 99.789% ( 76, 110 ] 864 0.074% 99.864% ( 110, 170 ] 791 0.068% 99.932% ( 170, 250 ] 305 0.026% 99.958% ( 250, 380 ] 388 0.033% 99.991% ( 380, 580 ] 557 0.048% 100.039% ( 580, 870 ] 488 0.042% 100.082% ( 870, 1300 ] 366 0.032% 100.113% ( 1300, 1900 ] 209 0.018% 100.131% ( 1900, 2900 ] 222 0.019% 100.150% ( 2900, 4400 ] 243 0.021% 100.171% ( 4400, 6600 ] 74 0.006% 100.178% ( 6600, 9900 ] 22 0.002% 100.179% ( 9900, 14000 ] 4 0.000% 100.180% ** Level 2 read latency histogram (micros): Count: 100906 Average: 2.6382 StdDev: 21.01 Min: 1 Median: 1.4498 Max: 2575 Percentiles: P50: 1.45 P75: 1.87 P99: 6.65 P99.9: 157.34 P99.99: 948.21 ------------------------------------------------------ [ 0, 1 ] 23444 23.234% 23.234% ##### ( 1, 2 ] 60044 59.505% 82.738% ############ ( 2, 3 ] 9485 9.400% 92.138% ## ( 3, 4 ] 3762 3.728% 95.866% # ( 4, 6 ] 3036 3.009% 98.875% # ( 6, 10 ] 780 0.773% 99.648% ( 10, 15 ] 150 0.149% 99.797% ( 15, 22 ] 21 0.021% 99.818% ( 22, 34 ] 6 0.006% 99.824% ( 34, 51 ] 26 0.026% 99.849% ( 51, 76 ] 26 0.026% 99.875% ( 76, 110 ] 3 0.003% 99.878% ( 110, 170 ] 28 0.028% 99.906% ( 170, 250 ] 29 0.029% 99.935% ( 250, 380 ] 23 0.023% 99.957% ( 380, 580 ] 18 0.018% 99.975% ( 580, 870 ] 14 0.014% 99.989% ( 870, 1300 ] 5 0.005% 99.994% ( 1300, 1900 ] 3 0.003% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 881625 Average: 7.2640 StdDev: 109.83 Min: 1 Median: 1.9679 Max: 11516 Percentiles: P50: 1.97 P75: 2.96 P99: 8.84 P99.9: 13.66 P99.99: 14.72 ------------------------------------------------------ [ 0, 1 ] 13639 1.547% 1.547% ( 1, 2 ] 441320 50.058% 51.605% ########## ( 2, 3 ] 214883 24.374% 75.978% ##### ( 3, 4 ] 98022 11.118% 87.096% ## ( 4, 6 ] 92278 10.467% 97.563% ## ( 6, 10 ] 17857 2.025% 99.589% ( 10, 15 ] 3748 0.425% 100.014% ( 15, 22 ] 450 0.051% 100.065% ( 22, 34 ] 38 0.004% 100.069% ( 34, 51 ] 22 0.002% 100.072% ( 51, 76 ] 12 0.001% 100.073% ( 76, 110 ] 12 0.001% 100.074% ( 110, 170 ] 58 0.007% 100.081% ( 170, 250 ] 140 0.016% 100.097% ( 250, 380 ] 252 0.029% 100.125% ( 380, 580 ] 389 0.044% 100.170% ( 580, 870 ] 517 0.059% 100.228% ( 870, 1300 ] 376 0.043% 100.271% ( 1300, 1900 ] 272 0.031% 100.302% ( 1900, 2900 ] 263 0.030% 100.332% ( 2900, 4400 ] 304 0.034% 100.366% ( 4400, 6600 ] 95 0.011% 100.377% ( 6600, 9900 ] 19 0.002% 100.379% ( 9900, 14000 ] 3 0.000% 100.379% ** Level 4 read latency histogram (micros): Count: 30458 Average: 132.2811 StdDev: 572.37 Min: 0 Median: 2.0367 Max: 12096 Percentiles: P50: 2.04 P75: 3.35 P99: 3390.74 P99.9: 6020.14 P99.99: 8464.12 ------------------------------------------------------ [ 0, 1 ] 765 2.512% 2.512% # ( 1, 2 ] 14217 46.677% 49.189% ######### ( 2, 3 ] 6725 22.080% 71.269% #### ( 3, 4 ] 3288 10.795% 82.064% ## ( 4, 6 ] 1937 6.360% 88.423% # ( 6, 10 ] 663 2.177% 90.600% ( 10, 15 ] 124 0.407% 91.007% ( 15, 22 ] 43 0.141% 91.148% ( 22, 34 ] 12 0.039% 91.188% ( 34, 51 ] 7 0.023% 91.211% ( 51, 76 ] 1 0.003% 91.214% ( 76, 110 ] 22 0.072% 91.286% ( 110, 170 ] 68 0.223% 91.510% ( 170, 250 ] 132 0.433% 91.943% ( 250, 380 ] 181 0.594% 92.537% ( 380, 580 ] 305 1.001% 93.539% ( 580, 870 ] 487 1.599% 95.138% ( 870, 1300 ] 438 1.438% 96.576% ( 1300, 1900 ] 350 1.149% 97.725% ( 1900, 2900 ] 287 0.942% 98.667% ( 2900, 4400 ] 310 1.018% 99.685% ( 4400, 6600 ] 89 0.292% 99.977% ( 6600, 9900 ] 7 0.023% 100.000% ( 9900, 14000 ] 2 0.007% 100.007% ** Level 5 read latency histogram (micros): Count: 220 Average: 1439.4045 StdDev: 1462.34 Min: 79 Median: 835.8824 Max: 6790 Percentiles: P50: 835.88 P75: 2257.14 P99: 6537.14 P99.9: 6790.00 P99.99: 6790.00 ------------------------------------------------------ ( 76, 110 ] 9 4.091% 4.091% # ( 110, 170 ] 11 5.000% 9.091% # ( 170, 250 ] 18 8.182% 17.273% ## ( 250, 380 ] 29 13.182% 30.455% ### ( 380, 580 ] 28 12.727% 43.182% ### ( 580, 870 ] 17 7.727% 50.909% ## ( 870, 1300 ] 24 10.909% 61.818% ## ( 1300, 1900 ] 19 8.636% 70.455% ## ( 1900, 2900 ] 28 12.727% 83.182% ### ( 2900, 4400 ] 28 12.727% 95.909% ### ( 4400, 6600 ] 7 3.182% 99.091% # ( 6600, 9900 ] 2 0.909% 100.000% ** DB Stats ** Uptime(secs): 47.1 total, 3.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 188.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.584 H:M:S, 48.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 311.29 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.484 H:M:S, 15.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/08-00:35:07 ... thread 0: (1000000,10000000) ops and (185987.6,191408.4) ops/second in (5.376702,52.244319) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.93 GB 182.5 7.8 0.0 7.8 17.3 9.5 0.0 1.8 129.6 287.6 61.73 54.88 163 0.379 8123K 8759 0.0 0.0 L1 21/21 1.80 GB 0.0 7.0 5.4 1.5 6.9 5.3 0.2 1.3 207.5 204.8 34.33 30.22 4 8.582 6312K 81K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 3.5 1.8 245.1 245.0 1.42 1.35 2 0.712 354K 170 0.0 0.0 L3 13/0 951.90 MB 1.0 3.5 2.4 1.2 3.5 2.4 1.4 1.5 157.1 156.2 23.06 16.60 10 2.306 3679K 19K 0.0 0.0 L4 181/0 9.69 GB 1.0 3.0 2.9 0.1 3.0 2.9 0.9 1.0 125.0 124.8 24.50 14.28 40 0.612 3051K 2728 0.0 0.0 L5 1084/0 89.20 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1317/31 105.55 GB 0.0 21.6 10.8 10.8 31.0 20.2 9.6 3.3 152.8 219.2 145.04 117.32 219 0.662 21M 113K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.6 10.8 10.8 31.0 20.2 9.6 3.3 152.8 219.2 145.04 117.32 219 0.662 21M 113K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.6 10.8 10.8 21.5 10.7 0.0 0.0 194.3 193.2 114.02 92.30 84 1.357 21M 113K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 314.8 31.02 25.02 135 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.4 total, 52.2 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.05 GB write, 606.21 MB/s write, 21.64 GB read, 422.48 MB/s read, 145.0 seconds Interval compaction: 31.05 GB write, 608.52 MB/s write, 21.64 GB read, 424.09 MB/s read, 145.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 65, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 65, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3801398 Average: 2.7073 StdDev: 25.54 Min: 0 Median: 1.4408 Max: 6449 Percentiles: P50: 1.44 P75: 1.85 P99: 5.97 P99.9: 133.01 P99.99: 393.71 ------------------------------------------------------ [ 0, 1 ] 864550 22.743% 22.743% ##### ( 1, 2 ] 2350695 61.838% 84.581% ############ ( 2, 3 ] 327955 8.627% 93.208% ## ( 3, 4 ] 129660 3.411% 96.619% # ( 4, 6 ] 92007 2.420% 99.039% ( 6, 10 ] 21906 0.576% 99.615% ( 10, 15 ] 4125 0.109% 99.724% ( 15, 22 ] 537 0.014% 99.738% ( 22, 34 ] 36 0.001% 99.739% ( 34, 51 ] 16 0.000% 99.739% ( 51, 76 ] 93 0.002% 99.742% ( 76, 110 ] 4645 0.122% 99.864% ( 110, 170 ] 3576 0.094% 99.958% ( 170, 250 ] 634 0.017% 99.975% ( 250, 380 ] 547 0.014% 99.989% ( 380, 580 ] 523 0.014% 100.003% ( 580, 870 ] 337 0.009% 100.012% ( 870, 1300 ] 180 0.005% 100.016% ( 1300, 1900 ] 72 0.002% 100.018% ( 1900, 2900 ] 76 0.002% 100.020% ( 2900, 4400 ] 72 0.002% 100.022% ( 4400, 6600 ] 8 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1253384 Average: 5.6212 StdDev: 87.23 Min: 1 Median: 1.7535 Max: 12767 Percentiles: P50: 1.75 P75: 2.61 P99: 9.21 P99.9: 145.10 P99.99: 377.97 ------------------------------------------------------ [ 0, 1 ] 99779 7.961% 7.961% ## ( 1, 2 ] 699263 55.790% 63.751% ########### ( 2, 3 ] 231718 18.487% 82.238% #### ( 3, 4 ] 98641 7.870% 90.108% ## ( 4, 6 ] 90593 7.228% 97.336% # ( 6, 10 ] 25994 2.074% 99.410% ( 10, 15 ] 3915 0.312% 99.722% ( 15, 22 ] 515 0.041% 99.763% ( 22, 34 ] 49 0.004% 99.767% ( 34, 51 ] 19 0.002% 99.769% ( 51, 76 ] 28 0.002% 99.771% ( 76, 110 ] 1072 0.086% 99.857% ( 110, 170 ] 931 0.074% 99.931% ( 170, 250 ] 343 0.027% 99.958% ( 250, 380 ] 405 0.032% 99.991% ( 380, 580 ] 572 0.046% 100.036% ( 580, 870 ] 492 0.039% 100.075% ( 870, 1300 ] 367 0.029% 100.105% ( 1300, 1900 ] 209 0.017% 100.121% ( 1900, 2900 ] 222 0.018% 100.139% ( 2900, 4400 ] 243 0.019% 100.158% ( 4400, 6600 ] 74 0.006% 100.164% ( 6600, 9900 ] 22 0.002% 100.166% ( 9900, 14000 ] 4 0.000% 100.166% ** Level 2 read latency histogram (micros): Count: 100906 Average: 2.6382 StdDev: 21.01 Min: 1 Median: 1.4498 Max: 2575 Percentiles: P50: 1.45 P75: 1.87 P99: 6.65 P99.9: 157.34 P99.99: 948.21 ------------------------------------------------------ [ 0, 1 ] 23444 23.234% 23.234% ##### ( 1, 2 ] 60044 59.505% 82.738% ############ ( 2, 3 ] 9485 9.400% 92.138% ## ( 3, 4 ] 3762 3.728% 95.866% # ( 4, 6 ] 3036 3.009% 98.875% # ( 6, 10 ] 780 0.773% 99.648% ( 10, 15 ] 150 0.149% 99.797% ( 15, 22 ] 21 0.021% 99.818% ( 22, 34 ] 6 0.006% 99.824% ( 34, 51 ] 26 0.026% 99.849% ( 51, 76 ] 26 0.026% 99.875% ( 76, 110 ] 3 0.003% 99.878% ( 110, 170 ] 28 0.028% 99.906% ( 170, 250 ] 29 0.029% 99.935% ( 250, 380 ] 23 0.023% 99.957% ( 380, 580 ] 18 0.018% 99.975% ( 580, 870 ] 14 0.014% 99.989% ( 870, 1300 ] 5 0.005% 99.994% ( 1300, 1900 ] 3 0.003% 99.997% ( 1900, 2900 ] 3 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 881625 Average: 7.2640 StdDev: 109.83 Min: 1 Median: 1.9679 Max: 11516 Percentiles: P50: 1.97 P75: 2.96 P99: 8.84 P99.9: 13.66 P99.99: 14.72 ------------------------------------------------------ [ 0, 1 ] 13639 1.547% 1.547% ( 1, 2 ] 441320 50.058% 51.605% ########## ( 2, 3 ] 214883 24.374% 75.978% ##### ( 3, 4 ] 98022 11.118% 87.096% ## ( 4, 6 ] 92278 10.467% 97.563% ## ( 6, 10 ] 17857 2.025% 99.589% ( 10, 15 ] 3748 0.425% 100.014% ( 15, 22 ] 450 0.051% 100.065% ( 22, 34 ] 38 0.004% 100.069% ( 34, 51 ] 22 0.002% 100.072% ( 51, 76 ] 12 0.001% 100.073% ( 76, 110 ] 12 0.001% 100.074% ( 110, 170 ] 58 0.007% 100.081% ( 170, 250 ] 140 0.016% 100.097% ( 250, 380 ] 252 0.029% 100.125% ( 380, 580 ] 389 0.044% 100.170% ( 580, 870 ] 517 0.059% 100.228% ( 870, 1300 ] 376 0.043% 100.271% ( 1300, 1900 ] 272 0.031% 100.302% ( 1900, 2900 ] 263 0.030% 100.332% ( 2900, 4400 ] 304 0.034% 100.366% ( 4400, 6600 ] 95 0.011% 100.377% ( 6600, 9900 ] 19 0.002% 100.379% ( 9900, 14000 ] 3 0.000% 100.379% ** Level 4 read latency histogram (micros): Count: 30458 Average: 132.2811 StdDev: 572.37 Min: 0 Median: 2.0367 Max: 12096 Percentiles: P50: 2.04 P75: 3.35 P99: 3390.74 P99.9: 6020.14 P99.99: 8464.12 ------------------------------------------------------ [ 0, 1 ] 765 2.512% 2.512% # ( 1, 2 ] 14217 46.677% 49.189% ######### ( 2, 3 ] 6725 22.080% 71.269% #### ( 3, 4 ] 3288 10.795% 82.064% ## ( 4, 6 ] 1937 6.360% 88.423% # ( 6, 10 ] 663 2.177% 90.600% ( 10, 15 ] 124 0.407% 91.007% ( 15, 22 ] 43 0.141% 91.148% ( 22, 34 ] 12 0.039% 91.188% ( 34, 51 ] 7 0.023% 91.211% ( 51, 76 ] 1 0.003% 91.214% ( 76, 110 ] 22 0.072% 91.286% ( 110, 170 ] 68 0.223% 91.510% ( 170, 250 ] 132 0.433% 91.943% ( 250, 380 ] 181 0.594% 92.537% ( 380, 580 ] 305 1.001% 93.539% ( 580, 870 ] 487 1.599% 95.138% ( 870, 1300 ] 438 1.438% 96.576% ( 1300, 1900 ] 350 1.149% 97.725% ( 1900, 2900 ] 287 0.942% 98.667% ( 2900, 4400 ] 310 1.018% 99.685% ( 4400, 6600 ] 89 0.292% 99.977% ( 6600, 9900 ] 7 0.023% 100.000% ( 9900, 14000 ] 2 0.007% 100.007% ** Level 5 read latency histogram (micros): Count: 220 Average: 1439.4045 StdDev: 1462.34 Min: 79 Median: 835.8824 Max: 6790 Percentiles: P50: 835.88 P75: 2257.14 P99: 6537.14 P99.9: 6790.00 P99.99: 6790.00 ------------------------------------------------------ ( 76, 110 ] 9 4.091% 4.091% # ( 110, 170 ] 11 5.000% 9.091% # ( 170, 250 ] 18 8.182% 17.273% ## ( 250, 380 ] 29 13.182% 30.455% ### ( 380, 580 ] 28 12.727% 43.182% ### ( 580, 870 ] 17 7.727% 50.909% ## ( 870, 1300 ] 24 10.909% 61.818% ## ( 1300, 1900 ] 19 8.636% 70.455% ## ( 1900, 2900 ] 28 12.727% 83.182% ### ( 2900, 4400 ] 28 12.727% 95.909% ### ( 4400, 6600 ] 7 3.182% 99.091% # ( 6600, 9900 ] 2 0.909% 100.000% ** DB Stats ** Uptime(secs): 52.4 total, 5.4 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 187.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:25.178 H:M:S, 48.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 183.05 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.593 H:M:S, 48.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.941 micros/op 168319 ops/sec 60.058 seconds 10108999 operations; 163.1 MB/s Microseconds per write: Count: 10108999 Average: 5.9411 StdDev: 482.37 Min: 1 Median: 1.7492 Max: 648672 Percentiles: P50: 1.75 P75: 2.76 P99: 8.32 P99.9: 1165.62 P99.99: 2751.82 ------------------------------------------------------ [ 0, 1 ] 1221431 12.083% 12.083% ## ( 1, 2 ] 5116302 50.611% 62.694% ########## ( 2, 3 ] 1645649 16.279% 78.973% ### ( 3, 4 ] 1420123 14.048% 93.021% ### ( 4, 6 ] 552084 5.461% 98.482% # ( 6, 10 ] 90059 0.891% 99.373% ( 10, 15 ] 25894 0.256% 99.629% ( 15, 22 ] 7133 0.071% 99.700% ( 22, 34 ] 1621 0.016% 99.716% ( 34, 51 ] 255 0.003% 99.719% ( 51, 76 ] 58 0.001% 99.719% ( 76, 110 ] 6905 0.068% 99.787% ( 110, 170 ] 2903 0.029% 99.816% ( 170, 250 ] 328 0.003% 99.819% ( 250, 380 ] 109 0.001% 99.821% ( 380, 580 ] 23 0.000% 99.821% ( 580, 870 ] 30 0.000% 99.821% ( 870, 1300 ] 11612 0.115% 99.936% ( 1300, 1900 ] 20 0.000% 99.936% ( 1900, 2900 ] 6397 0.063% 99.999% ( 2900, 4400 ] 21 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 2 0.000% 100.000% ( 110000, 170000 ] 3 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 570000, 860000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 182537 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10108999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10432486968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 491 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32339829 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 26968983826 rocksdb.compact.write.bytes COUNT : 26797961610 rocksdb.flush.write.bytes COUNT : 10370930810 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 52 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 257 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10287432704 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4104192 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27062388233 rocksdb.non.last.level.read.count COUNT : 6537508 rocksdb.block.checksum.compute.count COUNT : 6536578 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.389141 P95 : 3.862742 P99 : 6.426127 P100 : 648670.000000 COUNT : 10108999 SUM : 55229135 rocksdb.compaction.times.micros P50 : 888333.333333 P95 : 3684000.000000 P99 : 15280000.000000 P100 : 18789729.000000 COUNT : 84 SUM : 114020620 rocksdb.compaction.times.cpu_micros P50 : 871724.137931 P95 : 2833333.333333 P99 : 15280000.000000 P100 : 17112224.000000 COUNT : 84 SUM : 92299967 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 682.466667 P95 : 7095.000000 P99 : 158900.000000 P100 : 290186.000000 COUNT : 137 SUM : 689360 rocksdb.compaction.outfile.sync.micros P50 : 1165.974026 P95 : 68333.333333 P99 : 121400.000000 P100 : 136037.000000 COUNT : 324 SUM : 3502021 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 105.142857 P95 : 1480.000000 P99 : 4070.000000 P100 : 7602.000000 COUNT : 244 SUM : 89288 rocksdb.table.open.io.micros P50 : 1747.692308 P95 : 8639.400000 P99 : 13082.230769 P100 : 16102.000000 COUNT : 491 SUM : 1181935 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.608072 P95 : 7.705395 P99 : 11.362027 P100 : 12787.000000 COUNT : 6535081 SUM : 43012092 rocksdb.read.block.get.micros P50 : 459.487179 P95 : 3772.916667 P99 : 5662.250000 P100 : 7004.000000 COUNT : 982 SUM : 960149 rocksdb.write.raw.block.micros P50 : 0.514067 P95 : 0.976727 P99 : 2.872770 P100 : 29317.000000 COUNT : 9001941 SUM : 19002649 rocksdb.numfiles.in.singlecompaction P50 : 3.064815 P95 : 4.350000 P99 : 21.090000 P100 : 31.000000 COUNT : 113 SUM : 408 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562171 P95 : 1235.348083 P99 : 2649.448708 P100 : 648486.000000 COUNT : 163377 SUM : 32351425 rocksdb.sst.read.micros P50 : 1.546226 P95 : 4.488690 P99 : 8.462868 P100 : 12767.000000 COUNT : 6537550 SUM : 29724920 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10108999 SUM : 10432486968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215652.173913 P95 : 461700.000000 P99 : 760675.000000 P100 : 832522.000000 COUNT : 137 SUM : 31377563 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 297 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0