[2024-11-27 18:32:48.889249] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 22.11.4 initialization... [2024-11-27 18:32:48.889405] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4138692 ] Set seed to 1732728768885775 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-27 18:32:48.996272] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-27 18:32:49.034529] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-27 18:32:49.034575] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 4138692' to capture a snapshot of events at runtime. [2024-11-27 18:32:49.034586] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-27 18:32:49.034596] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-27 18:32:49.034604] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid4138692 for offline analysis/debug. [2024-11-27 18:32:49.034680] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 27 18:32:53 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/27-18:32:56 ... thread 0: (1000000,1000000) ops and (333753.6,333753.6) ops/second in (2.996222,2.996222) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 503.98 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 341.9 2.58 2.31 12 0.215 0 0 0.0 0.0 L1 2/0 187.03 MB 18.7 0.2 0.2 0.0 0.2 0.2 0.2 1.0 258.1 257.9 0.73 0.70 1 0.732 191K 116 0.0 0.0 L2 3/2 190.69 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 253.1 253.0 0.76 0.73 2 0.380 195K 91 0.0 0.0 L3 11/0 930.32 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1179/6 97.00 GB 0.0 0.4 0.3 0.1 1.2 1.2 0.4 1.4 93.7 310.2 4.07 3.75 15 0.272 387K 207 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.2 0.2 1.4 93.7 310.2 4.07 3.75 15 0.272 387K 207 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 255.5 255.4 1.49 1.43 3 0.498 387K 207 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 341.9 2.58 2.31 12 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 396.35 MB/s write, 0.37 GB read, 119.72 MB/s read, 4.1 seconds Interval compaction: 1.23 GB write, 421.40 MB/s write, 0.37 GB read, 127.29 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 141137 Average: 1.9432 StdDev: 20.11 Min: 0 Median: 1.2618 Max: 3217 Percentiles: P50: 1.26 P75: 1.69 P99: 4.41 P99.9: 9.65 P99.99: 228.86 ------------------------------------------------------ [ 0, 1 ] 48837 34.603% 34.603% ####### ( 1, 2 ] 83002 58.810% 93.412% ############ ( 2, 3 ] 5509 3.903% 97.315% # ( 3, 4 ] 2137 1.514% 98.830% ( 4, 6 ] 1166 0.826% 99.656% ( 6, 10 ] 379 0.269% 99.924% ( 10, 15 ] 68 0.048% 99.972% ( 15, 22 ] 13 0.009% 99.982% ( 22, 34 ] 1 0.001% 99.982% ( 34, 51 ] 1 0.001% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 110, 170 ] 4 0.003% 99.987% ( 170, 250 ] 8 0.006% 99.992% ( 250, 380 ] 4 0.003% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 1 0.001% 99.996% ( 1900, 2900 ] 2 0.001% 99.998% ( 2900, 4400 ] 4 0.003% 100.001% ** Level 1 read latency histogram (micros): Count: 481 Average: 6.2287 StdDev: 55.39 Min: 0 Median: 1.5259 Max: 1109 Percentiles: P50: 1.53 P75: 1.94 P99: 16.33 P99.9: 1093.17 P99.99: 1109.00 ------------------------------------------------------ [ 0, 1 ] 88 18.295% 18.295% #### ( 1, 2 ] 290 60.291% 78.586% ############ ( 2, 3 ] 48 9.979% 88.565% ## ( 3, 4 ] 32 6.653% 95.218% # ( 4, 6 ] 15 3.119% 98.337% # ( 6, 10 ] 1 0.208% 98.545% ( 10, 15 ] 2 0.416% 98.960% ( 15, 22 ] 1 0.208% 99.168% ( 170, 250 ] 2 0.416% 99.584% ( 380, 580 ] 1 0.208% 99.792% ( 870, 1300 ] 1 0.208% 100.000% ** Level 2 read latency histogram (micros): Count: 39888 Average: 2.2667 StdDev: 12.00 Min: 1 Median: 1.5079 Max: 1590 Percentiles: P50: 1.51 P75: 1.87 P99: 5.77 P99.9: 9.92 P99.99: 382.22 ------------------------------------------------------ [ 0, 1 ] 6036 15.132% 15.132% ### ( 1, 2 ] 27383 68.650% 83.782% ############## ( 2, 3 ] 3851 9.655% 93.437% ## ( 3, 4 ] 1295 3.247% 96.683% # ( 4, 6 ] 1043 2.615% 99.298% # ( 6, 10 ] 246 0.617% 99.915% ( 10, 15 ] 21 0.053% 99.967% ( 15, 22 ] 3 0.008% 99.975% ( 22, 34 ] 1 0.003% 99.977% ( 51, 76 ] 1 0.003% 99.980% ( 110, 170 ] 2 0.005% 99.985% ( 170, 250 ] 2 0.005% 99.990% ( 250, 380 ] 1 0.003% 99.992% ( 380, 580 ] 1 0.003% 99.995% ( 580, 870 ] 1 0.003% 99.997% ( 1300, 1900 ] 2 0.005% 100.003% ** Level 3 read latency histogram (micros): Count: 50 Average: 1463.6400 StdDev: 1136.46 Min: 118 Median: 1054.2857 Max: 4564 Percentiles: P50: 1054.29 P75: 2288.89 P99: 4564.00 P99.9: 4564.00 P99.99: 4564.00 ------------------------------------------------------ ( 110, 170 ] 3 6.000% 6.000% # ( 250, 380 ] 2 4.000% 10.000% # ( 380, 580 ] 6 12.000% 22.000% ## ( 580, 870 ] 11 22.000% 44.000% #### ( 870, 1300 ] 7 14.000% 58.000% ### ( 1300, 1900 ] 5 10.000% 68.000% ## ( 1900, 2900 ] 9 18.000% 86.000% #### ( 2900, 4400 ] 6 12.000% 98.000% ## ( 4400, 6600 ] 1 2.000% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 1491.4000 StdDev: 1260.39 Min: 112 Median: 941.6667 Max: 4477 Percentiles: P50: 941.67 P75: 2275.00 P99: 4477.00 P99.9: 4477.00 P99.99: 4477.00 ------------------------------------------------------ ( 110, 170 ] 3 12.000% 12.000% ## ( 170, 250 ] 1 4.000% 16.000% # ( 380, 580 ] 2 8.000% 24.000% ## ( 580, 870 ] 6 24.000% 48.000% ##### ( 870, 1300 ] 3 12.000% 60.000% ## ( 1300, 1900 ] 3 12.000% 72.000% ## ( 1900, 2900 ] 2 8.000% 80.000% ## ( 2900, 4400 ] 4 16.000% 96.000% ### ( 4400, 6600 ] 1 4.000% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 308.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.415 H:M:S, 13.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.415 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-18:32:59 ... thread 0: (1000000,2000000) ops and (327252.3,330471.0) ops/second in (3.055746,6.051968) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 1.48 GB 50.4 0.6 0.0 0.6 2.4 1.8 0.0 1.3 75.6 327.7 7.50 6.87 28 0.268 575K 613 0.0 0.0 L1 2/2 187.03 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 258.1 257.9 0.73 0.70 1 0.732 191K 116 0.0 0.0 L2 1/0 3.63 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 253.1 253.0 0.76 0.73 2 0.380 195K 91 0.0 0.0 L3 18/0 949.15 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 219.5 219.5 0.85 0.78 1 0.852 189K 0 0.0 0.0 L4 173/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 139.9 140.0 1.20 0.84 1 1.202 170K 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/14 97.98 GB 0.0 1.3 0.7 0.6 3.1 2.5 0.4 1.7 118.1 289.1 11.04 9.93 33 0.335 1323K 820 0.0 0.0 Int 0/0 0.00 KB 0.0 1.3 0.7 0.6 3.1 2.5 0.2 1.7 118.1 289.1 11.04 9.93 33 0.335 1323K 820 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.3 0.7 0.6 1.3 0.7 0.0 0.0 232.1 232.0 5.62 5.08 7 0.802 1323K 820 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 348.3 5.43 4.84 26 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.12 GB write, 511.42 MB/s write, 1.27 GB read, 208.85 MB/s read, 11.0 seconds Interval compaction: 3.12 GB write, 527.44 MB/s write, 1.27 GB read, 215.39 MB/s read, 11.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 390167 Average: 2.1002 StdDev: 16.83 Min: 0 Median: 1.4125 Max: 3365 Percentiles: P50: 1.41 P75: 1.80 P99: 5.09 P99.9: 9.37 P99.99: 14.54 ------------------------------------------------------ [ 0, 1 ] 91769 23.520% 23.520% ##### ( 1, 2 ] 250443 64.189% 87.709% ############# ( 2, 3 ] 30483 7.813% 95.522% ## ( 3, 4 ] 10600 2.717% 98.239% # ( 4, 6 ] 5466 1.401% 99.640% ( 6, 10 ] 1208 0.310% 99.949% ( 10, 15 ] 176 0.045% 99.994% ( 15, 22 ] 23 0.006% 100.000% ( 22, 34 ] 2 0.001% 100.001% ( 34, 51 ] 3 0.001% 100.002% ( 51, 76 ] 2 0.001% 100.002% ( 110, 170 ] 7 0.002% 100.004% ( 170, 250 ] 15 0.004% 100.008% ( 250, 380 ] 11 0.003% 100.011% ( 380, 580 ] 2 0.001% 100.011% ( 580, 870 ] 1 0.000% 100.011% ( 870, 1300 ] 5 0.001% 100.013% ( 1300, 1900 ] 5 0.001% 100.014% ( 1900, 2900 ] 3 0.001% 100.015% ( 2900, 4400 ] 7 0.002% 100.016% ** Level 1 read latency histogram (micros): Count: 28638 Average: 2.1254 StdDev: 7.30 Min: 0 Median: 1.4771 Max: 1109 Percentiles: P50: 1.48 P75: 1.85 P99: 5.18 P99.9: 9.72 P99.99: 215.45 ------------------------------------------------------ [ 0, 1 ] 5159 18.015% 18.015% #### ( 1, 2 ] 19201 67.047% 85.062% ############# ( 2, 3 ] 2840 9.917% 94.979% ## ( 3, 4 ] 889 3.104% 98.083% # ( 4, 6 ] 446 1.557% 99.640% ( 6, 10 ] 80 0.279% 99.920% ( 10, 15 ] 15 0.052% 99.972% ( 15, 22 ] 2 0.007% 99.979% ( 34, 51 ] 1 0.003% 99.983% ( 110, 170 ] 1 0.003% 99.986% ( 170, 250 ] 2 0.007% 99.993% ( 380, 580 ] 1 0.003% 99.997% ( 870, 1300 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2714 StdDev: 10.95 Min: 1 Median: 1.5275 Max: 1590 Percentiles: P50: 1.53 P75: 1.89 P99: 5.75 P99.9: 9.93 P99.99: 276.40 ------------------------------------------------------ [ 0, 1 ] 6741 14.053% 14.053% ### ( 1, 2 ] 32688 68.144% 82.197% ############## ( 2, 3 ] 5365 11.184% 93.381% ## ( 3, 4 ] 1593 3.321% 96.702% # ( 4, 6 ] 1257 2.620% 99.322% # ( 6, 10 ] 282 0.588% 99.910% ( 10, 15 ] 27 0.056% 99.967% ( 15, 22 ] 5 0.010% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 110, 170 ] 2 0.004% 99.985% ( 170, 250 ] 2 0.004% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 580, 870 ] 1 0.002% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 42803 Average: 3.8288 StdDev: 63.42 Min: 1 Median: 1.4973 Max: 4564 Percentiles: P50: 1.50 P75: 1.86 P99: 5.63 P99.9: 499.91 P99.99: 3579.92 ------------------------------------------------------ [ 0, 1 ] 6887 16.090% 16.090% ### ( 1, 2 ] 29185 68.184% 84.274% ############## ( 2, 3 ] 4728 11.046% 95.320% ## ( 3, 4 ] 1009 2.357% 97.678% ( 4, 6 ] 695 1.624% 99.301% ( 6, 10 ] 193 0.451% 99.752% ( 10, 15 ] 46 0.107% 99.860% ( 15, 22 ] 7 0.016% 99.876% ( 110, 170 ] 4 0.009% 99.886% ( 250, 380 ] 2 0.005% 99.890% ( 380, 580 ] 7 0.016% 99.907% ( 580, 870 ] 12 0.028% 99.935% ( 870, 1300 ] 7 0.016% 99.951% ( 1300, 1900 ] 5 0.012% 99.963% ( 1900, 2900 ] 9 0.021% 99.984% ( 2900, 4400 ] 6 0.014% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 124.5097 StdDev: 540.75 Min: 0 Median: 1.4615 Max: 4477 Percentiles: P50: 1.46 P75: 4.65 P99: 3612.50 P99.9: 4477.00 P99.99: 4477.00 ------------------------------------------------------ [ 0, 1 ] 107 34.516% 34.516% ####### ( 1, 2 ] 104 33.548% 68.065% ####### ( 2, 3 ] 12 3.871% 71.935% # ( 3, 4 ] 4 1.290% 73.226% ( 4, 6 ] 17 5.484% 78.710% # ( 6, 10 ] 36 11.613% 90.323% ## ( 10, 15 ] 2 0.645% 90.968% ( 76, 110 ] 2 0.645% 91.613% ( 110, 170 ] 3 0.968% 92.581% ( 170, 250 ] 1 0.323% 92.903% ( 250, 380 ] 1 0.323% 93.226% ( 380, 580 ] 2 0.645% 93.871% ( 580, 870 ] 6 1.935% 95.806% ( 870, 1300 ] 3 0.968% 96.774% ( 1300, 1900 ] 3 0.968% 97.742% ( 1900, 2900 ] 2 0.645% 98.387% ( 2900, 4400 ] 4 1.290% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 315.28 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.858 H:M:S, 13.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.443 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-18:33:02 ... thread 0: (1000000,3000000) ops and (359040.9,339475.3) ops/second in (2.785198,8.837166) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.60 GB 138.5 1.4 0.0 1.4 4.1 2.7 0.0 1.5 106.4 319.1 13.03 12.08 44 0.296 1407K 1448 0.0 0.0 L1 8/0 938.67 MB 93.9 1.1 0.9 0.2 1.1 0.9 0.2 1.2 240.4 239.5 4.71 4.57 2 2.354 1149K 4034 0.0 0.0 L2 1/0 3.63 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 253.1 253.0 0.76 0.73 2 0.380 195K 91 0.0 0.0 L3 18/0 949.15 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 219.5 219.5 0.85 0.78 1 0.852 189K 0 0.0 0.0 L4 173/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 139.9 140.0 1.20 0.84 1 1.202 170K 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/4 98.84 GB 0.0 3.0 1.4 1.6 5.7 4.1 0.4 2.1 149.2 283.8 20.55 19.00 50 0.411 3112K 5573 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 1.4 1.6 5.7 4.1 0.2 2.1 149.2 283.8 20.55 19.00 50 0.411 3112K 5573 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 1.4 1.6 3.0 1.4 0.0 0.0 241.5 241.0 12.70 11.98 11 1.154 3112K 5573 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 352.9 7.85 7.02 39 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.69 GB write, 645.92 MB/s write, 2.99 GB read, 339.55 MB/s read, 20.5 seconds Interval compaction: 5.69 GB write, 659.77 MB/s write, 2.99 GB read, 346.83 MB/s read, 20.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 675921 Average: 2.0843 StdDev: 14.14 Min: 0 Median: 1.4225 Max: 3365 Percentiles: P50: 1.42 P75: 1.81 P99: 5.12 P99.9: 9.62 P99.99: 14.77 ------------------------------------------------------ [ 0, 1 ] 151976 22.484% 22.484% #### ( 1, 2 ] 440243 65.132% 87.617% ############# ( 2, 3 ] 54070 7.999% 95.616% ## ( 3, 4 ] 17814 2.636% 98.252% # ( 4, 6 ] 9027 1.336% 99.587% ( 6, 10 ] 2337 0.346% 99.933% ( 10, 15 ] 406 0.060% 99.993% ( 15, 22 ] 47 0.007% 100.000% ( 22, 34 ] 7 0.001% 100.001% ( 34, 51 ] 4 0.001% 100.001% ( 51, 76 ] 5 0.001% 100.002% ( 110, 170 ] 13 0.002% 100.004% ( 170, 250 ] 22 0.003% 100.007% ( 250, 380 ] 16 0.002% 100.010% ( 380, 580 ] 3 0.000% 100.010% ( 580, 870 ] 6 0.001% 100.011% ( 870, 1300 ] 9 0.001% 100.012% ( 1300, 1900 ] 8 0.001% 100.014% ( 1900, 2900 ] 3 0.000% 100.014% ( 2900, 4400 ] 8 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 48001 Average: 2.3351 StdDev: 16.55 Min: 0 Median: 1.4834 Max: 1759 Percentiles: P50: 1.48 P75: 1.85 P99: 5.13 P99.9: 10.40 P99.99: 1041.99 ------------------------------------------------------ [ 0, 1 ] 8217 17.118% 17.118% ### ( 1, 2 ] 32651 68.021% 85.140% ############## ( 2, 3 ] 4809 10.019% 95.158% ## ( 3, 4 ] 1454 3.029% 98.188% # ( 4, 6 ] 688 1.433% 99.621% ( 6, 10 ] 132 0.275% 99.896% ( 10, 15 ] 25 0.052% 99.948% ( 15, 22 ] 3 0.006% 99.954% ( 34, 51 ] 1 0.002% 99.956% ( 110, 170 ] 2 0.004% 99.960% ( 170, 250 ] 2 0.004% 99.965% ( 250, 380 ] 4 0.008% 99.973% ( 380, 580 ] 5 0.010% 99.983% ( 580, 870 ] 2 0.004% 99.988% ( 870, 1300 ] 3 0.006% 99.994% ( 1300, 1900 ] 3 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2714 StdDev: 10.95 Min: 1 Median: 1.5275 Max: 1590 Percentiles: P50: 1.53 P75: 1.89 P99: 5.75 P99.9: 9.93 P99.99: 276.40 ------------------------------------------------------ [ 0, 1 ] 6741 14.053% 14.053% ### ( 1, 2 ] 32688 68.144% 82.197% ############## ( 2, 3 ] 5365 11.184% 93.381% ## ( 3, 4 ] 1593 3.321% 96.702% # ( 4, 6 ] 1257 2.620% 99.322% # ( 6, 10 ] 282 0.588% 99.910% ( 10, 15 ] 27 0.056% 99.967% ( 15, 22 ] 5 0.010% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 110, 170 ] 2 0.004% 99.985% ( 170, 250 ] 2 0.004% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 580, 870 ] 1 0.002% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 42803 Average: 3.8288 StdDev: 63.42 Min: 1 Median: 1.4973 Max: 4564 Percentiles: P50: 1.50 P75: 1.86 P99: 5.63 P99.9: 499.91 P99.99: 3579.92 ------------------------------------------------------ [ 0, 1 ] 6887 16.090% 16.090% ### ( 1, 2 ] 29185 68.184% 84.274% ############## ( 2, 3 ] 4728 11.046% 95.320% ## ( 3, 4 ] 1009 2.357% 97.678% ( 4, 6 ] 695 1.624% 99.301% ( 6, 10 ] 193 0.451% 99.752% ( 10, 15 ] 46 0.107% 99.860% ( 15, 22 ] 7 0.016% 99.876% ( 110, 170 ] 4 0.009% 99.886% ( 250, 380 ] 2 0.005% 99.890% ( 380, 580 ] 7 0.016% 99.907% ( 580, 870 ] 12 0.028% 99.935% ( 870, 1300 ] 7 0.016% 99.951% ( 1300, 1900 ] 5 0.012% 99.963% ( 1900, 2900 ] 9 0.021% 99.984% ( 2900, 4400 ] 6 0.014% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 124.5097 StdDev: 540.75 Min: 0 Median: 1.4615 Max: 4477 Percentiles: P50: 1.46 P75: 4.65 P99: 3612.50 P99.9: 4477.00 P99.99: 4477.00 ------------------------------------------------------ [ 0, 1 ] 107 34.516% 34.516% ####### ( 1, 2 ] 104 33.548% 68.065% ####### ( 2, 3 ] 12 3.871% 71.935% # ( 3, 4 ] 4 1.290% 73.226% ( 4, 6 ] 17 5.484% 78.710% # ( 6, 10 ] 36 11.613% 90.323% ## ( 10, 15 ] 2 0.645% 90.968% ( 76, 110 ] 2 0.645% 91.613% ( 110, 170 ] 3 0.968% 92.581% ( 170, 250 ] 1 0.323% 92.903% ( 250, 380 ] 1 0.323% 93.226% ( 380, 580 ] 2 0.645% 93.871% ( 580, 870 ] 6 1.935% 95.806% ( 870, 1300 ] 3 0.968% 96.774% ( 1300, 1900 ] 3 0.968% 97.742% ( 1900, 2900 ] 2 0.645% 98.387% ( 2900, 4400 ] 4 1.290% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** DB Stats ** Uptime(secs): 9.0 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 327.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.047 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 353.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.189 H:M:S, 6.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-18:33:05 ... thread 0: (1000000,4000000) ops and (335389.2,338444.5) ops/second in (2.981611,11.818777) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.58 GB 207.7 2.2 0.0 2.2 5.8 3.7 0.0 1.6 116.7 316.6 18.89 17.57 61 0.310 2238K 2313 0.0 0.0 L1 8/0 938.67 MB 93.9 1.1 0.9 0.2 1.1 0.9 0.2 1.2 240.4 239.5 4.71 4.57 2 2.354 1149K 4034 0.0 0.0 L2 1/0 3.63 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 253.1 253.0 0.76 0.73 2 0.380 195K 91 0.0 0.0 L3 18/0 949.15 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 219.5 219.5 0.85 0.78 1 0.852 189K 0 0.0 0.0 L4 173/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 139.9 140.0 1.20 0.84 1 1.202 170K 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/8 99.82 GB 0.0 3.8 1.4 2.4 7.5 5.1 0.4 2.0 147.1 289.9 26.42 24.50 67 0.394 3944K 6438 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 1.4 2.4 7.5 5.1 0.2 2.0 147.1 289.9 26.42 24.50 67 0.394 3944K 6438 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 1.4 2.4 3.8 1.4 0.0 0.0 246.3 245.8 15.77 15.00 14 1.127 3944K 6438 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 355.2 10.64 9.50 53 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.48 GB write, 637.60 MB/s write, 3.79 GB read, 323.44 MB/s read, 26.4 seconds Interval compaction: 7.48 GB write, 647.83 MB/s write, 3.79 GB read, 328.63 MB/s read, 26.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 918513 Average: 2.0387 StdDev: 14.34 Min: 0 Median: 1.3900 Max: 3803 Percentiles: P50: 1.39 P75: 1.78 P99: 4.96 P99.9: 9.66 P99.99: 16.14 ------------------------------------------------------ [ 0, 1 ] 230036 25.044% 25.044% ##### ( 1, 2 ] 587751 63.989% 89.034% ############# ( 2, 3 ] 64588 7.032% 96.066% # ( 3, 4 ] 21833 2.377% 98.443% ( 4, 6 ] 10641 1.159% 99.601% ( 6, 10 ] 3003 0.327% 99.928% ( 10, 15 ] 557 0.061% 99.989% ( 15, 22 ] 81 0.009% 99.997% ( 22, 34 ] 10 0.001% 99.999% ( 34, 51 ] 4 0.000% 99.999% ( 51, 76 ] 5 0.001% 100.000% ( 76, 110 ] 1 0.000% 100.000% ( 110, 170 ] 18 0.002% 100.002% ( 170, 250 ] 31 0.003% 100.005% ( 250, 380 ] 22 0.002% 100.007% ( 380, 580 ] 4 0.000% 100.008% ( 580, 870 ] 11 0.001% 100.009% ( 870, 1300 ] 11 0.001% 100.010% ( 1300, 1900 ] 9 0.001% 100.011% ( 1900, 2900 ] 5 0.001% 100.012% ( 2900, 4400 ] 11 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 48001 Average: 2.3351 StdDev: 16.55 Min: 0 Median: 1.4834 Max: 1759 Percentiles: P50: 1.48 P75: 1.85 P99: 5.13 P99.9: 10.40 P99.99: 1041.99 ------------------------------------------------------ [ 0, 1 ] 8217 17.118% 17.118% ### ( 1, 2 ] 32651 68.021% 85.140% ############## ( 2, 3 ] 4809 10.019% 95.158% ## ( 3, 4 ] 1454 3.029% 98.188% # ( 4, 6 ] 688 1.433% 99.621% ( 6, 10 ] 132 0.275% 99.896% ( 10, 15 ] 25 0.052% 99.948% ( 15, 22 ] 3 0.006% 99.954% ( 34, 51 ] 1 0.002% 99.956% ( 110, 170 ] 2 0.004% 99.960% ( 170, 250 ] 2 0.004% 99.965% ( 250, 380 ] 4 0.008% 99.973% ( 380, 580 ] 5 0.010% 99.983% ( 580, 870 ] 2 0.004% 99.988% ( 870, 1300 ] 3 0.006% 99.994% ( 1300, 1900 ] 3 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2714 StdDev: 10.95 Min: 1 Median: 1.5275 Max: 1590 Percentiles: P50: 1.53 P75: 1.89 P99: 5.75 P99.9: 9.93 P99.99: 276.40 ------------------------------------------------------ [ 0, 1 ] 6741 14.053% 14.053% ### ( 1, 2 ] 32688 68.144% 82.197% ############## ( 2, 3 ] 5365 11.184% 93.381% ## ( 3, 4 ] 1593 3.321% 96.702% # ( 4, 6 ] 1257 2.620% 99.322% # ( 6, 10 ] 282 0.588% 99.910% ( 10, 15 ] 27 0.056% 99.967% ( 15, 22 ] 5 0.010% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 110, 170 ] 2 0.004% 99.985% ( 170, 250 ] 2 0.004% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 580, 870 ] 1 0.002% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 42803 Average: 3.8288 StdDev: 63.42 Min: 1 Median: 1.4973 Max: 4564 Percentiles: P50: 1.50 P75: 1.86 P99: 5.63 P99.9: 499.91 P99.99: 3579.92 ------------------------------------------------------ [ 0, 1 ] 6887 16.090% 16.090% ### ( 1, 2 ] 29185 68.184% 84.274% ############## ( 2, 3 ] 4728 11.046% 95.320% ## ( 3, 4 ] 1009 2.357% 97.678% ( 4, 6 ] 695 1.624% 99.301% ( 6, 10 ] 193 0.451% 99.752% ( 10, 15 ] 46 0.107% 99.860% ( 15, 22 ] 7 0.016% 99.876% ( 110, 170 ] 4 0.009% 99.886% ( 250, 380 ] 2 0.005% 99.890% ( 380, 580 ] 7 0.016% 99.907% ( 580, 870 ] 12 0.028% 99.935% ( 870, 1300 ] 7 0.016% 99.951% ( 1300, 1900 ] 5 0.012% 99.963% ( 1900, 2900 ] 9 0.021% 99.984% ( 2900, 4400 ] 6 0.014% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 124.5097 StdDev: 540.75 Min: 0 Median: 1.4615 Max: 4477 Percentiles: P50: 1.46 P75: 4.65 P99: 3612.50 P99.9: 4477.00 P99.99: 4477.00 ------------------------------------------------------ [ 0, 1 ] 107 34.516% 34.516% ####### ( 1, 2 ] 104 33.548% 68.065% ####### ( 2, 3 ] 12 3.871% 71.935% # ( 3, 4 ] 4 1.290% 73.226% ( 4, 6 ] 17 5.484% 78.710% # ( 6, 10 ] 36 11.613% 90.323% ## ( 10, 15 ] 2 0.645% 90.968% ( 76, 110 ] 2 0.645% 91.613% ( 110, 170 ] 3 0.968% 92.581% ( 170, 250 ] 1 0.323% 92.903% ( 250, 380 ] 1 0.323% 93.226% ( 380, 580 ] 2 0.645% 93.871% ( 580, 870 ] 6 1.935% 95.806% ( 870, 1300 ] 3 0.968% 96.774% ( 1300, 1900 ] 3 0.968% 97.742% ( 1900, 2900 ] 2 0.645% 98.387% ( 2900, 4400 ] 4 1.290% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 327.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.420 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.08 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.373 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-18:33:07 ... thread 0: (1000000,5000000) ops and (349772.3,340651.0) ops/second in (2.859003,14.677780) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/4 3.56 GB 339.8 3.3 0.0 3.3 7.9 4.7 0.0 1.7 129.2 314.3 25.84 24.16 80 0.323 3390K 3469 0.0 0.0 L1 8/0 938.67 MB 93.9 1.1 0.9 0.2 1.1 0.9 0.2 1.2 240.4 239.5 4.71 4.57 2 2.354 1149K 4034 0.0 0.0 L2 1/0 3.63 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 253.1 253.0 0.76 0.73 2 0.380 195K 91 0.0 0.0 L3 18/0 949.15 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 219.5 219.5 0.85 0.78 1 0.852 189K 0 0.0 0.0 L4 173/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 139.9 140.0 1.20 0.84 1 1.202 170K 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/4 100.80 GB 0.0 4.9 1.4 3.5 9.6 6.1 0.4 2.0 150.4 293.7 33.37 31.08 86 0.388 5095K 7594 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 1.4 3.5 9.6 6.1 0.2 2.0 150.4 293.7 33.37 31.08 86 0.388 5095K 7594 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 1.4 3.5 4.9 1.4 0.0 0.0 251.3 250.9 19.97 19.12 18 1.110 5095K 7594 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.4 13.39 11.97 68 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.9 total, 14.7 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.57 GB write, 658.98 MB/s write, 4.90 GB read, 337.52 MB/s read, 33.4 seconds Interval compaction: 9.57 GB write, 667.49 MB/s write, 4.90 GB read, 341.88 MB/s read, 33.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 14, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1174297 Average: 2.0224 StdDev: 14.09 Min: 0 Median: 1.3803 Max: 3803 Percentiles: P50: 1.38 P75: 1.77 P99: 4.87 P99.9: 9.74 P99.99: 16.46 ------------------------------------------------------ [ 0, 1 ] 302327 25.745% 25.745% ##### ( 1, 2 ] 748931 63.777% 89.522% ############# ( 2, 3 ] 78868 6.716% 96.239% # ( 3, 4 ] 26936 2.294% 98.532% ( 4, 6 ] 12633 1.076% 99.608% ( 6, 10 ] 3671 0.313% 99.921% ( 10, 15 ] 791 0.067% 99.988% ( 15, 22 ] 113 0.010% 99.998% ( 22, 34 ] 11 0.001% 99.999% ( 34, 51 ] 4 0.000% 99.999% ( 51, 76 ] 6 0.001% 99.999% ( 76, 110 ] 1 0.000% 100.000% ( 110, 170 ] 25 0.002% 100.002% ( 170, 250 ] 39 0.003% 100.005% ( 250, 380 ] 29 0.002% 100.007% ( 380, 580 ] 8 0.001% 100.008% ( 580, 870 ] 15 0.001% 100.009% ( 870, 1300 ] 14 0.001% 100.011% ( 1300, 1900 ] 11 0.001% 100.012% ( 1900, 2900 ] 5 0.000% 100.012% ( 2900, 4400 ] 14 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 48001 Average: 2.3351 StdDev: 16.55 Min: 0 Median: 1.4834 Max: 1759 Percentiles: P50: 1.48 P75: 1.85 P99: 5.13 P99.9: 10.40 P99.99: 1041.99 ------------------------------------------------------ [ 0, 1 ] 8217 17.118% 17.118% ### ( 1, 2 ] 32651 68.021% 85.140% ############## ( 2, 3 ] 4809 10.019% 95.158% ## ( 3, 4 ] 1454 3.029% 98.188% # ( 4, 6 ] 688 1.433% 99.621% ( 6, 10 ] 132 0.275% 99.896% ( 10, 15 ] 25 0.052% 99.948% ( 15, 22 ] 3 0.006% 99.954% ( 34, 51 ] 1 0.002% 99.956% ( 110, 170 ] 2 0.004% 99.960% ( 170, 250 ] 2 0.004% 99.965% ( 250, 380 ] 4 0.008% 99.973% ( 380, 580 ] 5 0.010% 99.983% ( 580, 870 ] 2 0.004% 99.988% ( 870, 1300 ] 3 0.006% 99.994% ( 1300, 1900 ] 3 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2714 StdDev: 10.95 Min: 1 Median: 1.5275 Max: 1590 Percentiles: P50: 1.53 P75: 1.89 P99: 5.75 P99.9: 9.93 P99.99: 276.40 ------------------------------------------------------ [ 0, 1 ] 6741 14.053% 14.053% ### ( 1, 2 ] 32688 68.144% 82.197% ############## ( 2, 3 ] 5365 11.184% 93.381% ## ( 3, 4 ] 1593 3.321% 96.702% # ( 4, 6 ] 1257 2.620% 99.322% # ( 6, 10 ] 282 0.588% 99.910% ( 10, 15 ] 27 0.056% 99.967% ( 15, 22 ] 5 0.010% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 110, 170 ] 2 0.004% 99.985% ( 170, 250 ] 2 0.004% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 580, 870 ] 1 0.002% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 42803 Average: 3.8288 StdDev: 63.42 Min: 1 Median: 1.4973 Max: 4564 Percentiles: P50: 1.50 P75: 1.86 P99: 5.63 P99.9: 499.91 P99.99: 3579.92 ------------------------------------------------------ [ 0, 1 ] 6887 16.090% 16.090% ### ( 1, 2 ] 29185 68.184% 84.274% ############## ( 2, 3 ] 4728 11.046% 95.320% ## ( 3, 4 ] 1009 2.357% 97.678% ( 4, 6 ] 695 1.624% 99.301% ( 6, 10 ] 193 0.451% 99.752% ( 10, 15 ] 46 0.107% 99.860% ( 15, 22 ] 7 0.016% 99.876% ( 110, 170 ] 4 0.009% 99.886% ( 250, 380 ] 2 0.005% 99.890% ( 380, 580 ] 7 0.016% 99.907% ( 580, 870 ] 12 0.028% 99.935% ( 870, 1300 ] 7 0.016% 99.951% ( 1300, 1900 ] 5 0.012% 99.963% ( 1900, 2900 ] 9 0.021% 99.984% ( 2900, 4400 ] 6 0.014% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 124.5097 StdDev: 540.75 Min: 0 Median: 1.4615 Max: 4477 Percentiles: P50: 1.46 P75: 4.65 P99: 3612.50 P99.9: 4477.00 P99.99: 4477.00 ------------------------------------------------------ [ 0, 1 ] 107 34.516% 34.516% ####### ( 1, 2 ] 104 33.548% 68.065% ####### ( 2, 3 ] 12 3.871% 71.935% # ( 3, 4 ] 4 1.290% 73.226% ( 4, 6 ] 17 5.484% 78.710% # ( 6, 10 ] 36 11.613% 90.323% ## ( 10, 15 ] 2 0.645% 90.968% ( 76, 110 ] 2 0.645% 91.613% ( 110, 170 ] 3 0.968% 92.581% ( 170, 250 ] 1 0.323% 92.903% ( 250, 380 ] 1 0.323% 93.226% ( 380, 580 ] 2 0.645% 93.871% ( 580, 870 ] 6 1.935% 95.806% ( 870, 1300 ] 3 0.968% 96.774% ( 1300, 1900 ] 3 0.968% 97.742% ( 1900, 2900 ] 2 0.645% 98.387% ( 2900, 4400 ] 4 1.290% 99.677% ( 4400, 6600 ] 1 0.323% 100.000% ** DB Stats ** Uptime(secs): 14.9 total, 2.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 330.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.664 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 344.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.244 H:M:S, 8.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-18:33:34 ... thread 0: (1000000,6000000) ops and (38301.0,147106.5) ops/second in (26.108993,40.786773) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/4 440.75 MB 0.0 4.3 0.0 4.3 9.9 5.6 0.0 1.8 135.8 312.3 32.46 30.42 98 0.331 4477K 4606 0.0 0.0 L1 3/3 334.87 MB 0.0 6.1 5.0 1.1 6.0 4.9 0.2 1.2 220.7 216.3 28.20 25.09 3 9.400 6319K 125K 0.0 0.0 L2 3/0 261.19 MB 2.6 0.2 0.1 0.1 0.2 0.1 4.6 1.5 253.1 253.0 0.76 0.73 2 0.380 195K 91 0.0 0.0 L3 41/9 4.29 GB 3.2 0.2 0.2 0.0 0.2 0.2 4.4 1.0 219.5 219.5 0.85 0.78 1 0.852 189K 0 0.0 0.0 L4 184/18 10.67 GB 1.1 0.2 0.2 0.0 0.2 0.2 0.9 1.0 139.9 140.0 1.20 0.84 1 1.202 170K 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1275/34 101.61 GB 0.0 10.9 5.5 5.5 16.4 10.9 10.1 2.9 176.1 264.4 63.48 57.87 105 0.605 11M 130K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.9 5.5 5.5 16.4 10.9 10.0 2.9 176.1 264.4 63.48 57.87 105 0.605 11M 130K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.9 5.5 5.5 10.8 5.3 0.0 0.0 235.6 232.9 47.45 43.55 23 2.063 11M 130K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 357.7 16.03 14.32 82 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.0 total, 40.8 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.39 GB write, 409.59 MB/s write, 10.92 GB read, 272.87 MB/s read, 63.5 seconds Interval compaction: 16.39 GB write, 411.49 MB/s write, 10.92 GB read, 274.13 MB/s read, 63.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 15, interval: 29 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2465129 Average: 2.9998 StdDev: 36.99 Min: 0 Median: 1.3197 Max: 27775 Percentiles: P50: 1.32 P75: 1.73 P99: 8.00 P99.9: 167.54 P99.99: 547.48 ------------------------------------------------------ [ 0, 1 ] 748347 30.357% 30.357% ###### ( 1, 2 ] 1514790 61.449% 91.806% ############ ( 2, 3 ] 105605 4.284% 96.090% # ( 3, 4 ] 41640 1.689% 97.779% ( 4, 6 ] 26617 1.080% 98.859% ( 6, 10 ] 6957 0.282% 99.141% ( 10, 15 ] 1701 0.069% 99.210% ( 15, 22 ] 439 0.018% 99.228% ( 22, 34 ] 14 0.001% 99.228% ( 34, 51 ] 7 0.000% 99.229% ( 51, 76 ] 1542 0.063% 99.291% ( 76, 110 ] 8662 0.351% 99.643% ( 110, 170 ] 6614 0.268% 99.911% ( 170, 250 ] 896 0.036% 99.947% ( 250, 380 ] 606 0.025% 99.972% ( 380, 580 ] 532 0.022% 99.994% ( 580, 870 ] 199 0.008% 100.002% ( 870, 1300 ] 36 0.001% 100.003% ( 1300, 1900 ] 24 0.001% 100.004% ( 1900, 2900 ] 34 0.001% 100.005% ( 2900, 4400 ] 41 0.002% 100.007% ( 4400, 6600 ] 4 0.000% 100.007% ( 6600, 9900 ] 1 0.000% 100.007% ( 9900, 14000 ] 1 0.000% 100.007% ( 22000, 33000 ] 3 0.000% 100.007% ** Level 1 read latency histogram (micros): Count: 370395 Average: 4.7205 StdDev: 126.54 Min: 0 Median: 1.4248 Max: 30968 Percentiles: P50: 1.42 P75: 1.86 P99: 8.49 P99.9: 156.35 P99.99: 291.37 ------------------------------------------------------ [ 0, 1 ] 94889 25.618% 25.618% ##### ( 1, 2 ] 212612 57.401% 83.020% ########### ( 2, 3 ] 29419 7.943% 90.962% ## ( 3, 4 ] 14476 3.908% 94.871% # ( 4, 6 ] 13910 3.755% 98.626% # ( 6, 10 ] 2228 0.602% 99.228% ( 10, 15 ] 465 0.126% 99.353% ( 15, 22 ] 98 0.026% 99.380% ( 22, 34 ] 3 0.001% 99.380% ( 34, 51 ] 3 0.001% 99.381% ( 51, 76 ] 167 0.045% 99.426% ( 76, 110 ] 1150 0.310% 99.737% ( 110, 170 ] 784 0.212% 99.948% ( 170, 250 ] 119 0.032% 99.981% ( 250, 380 ] 113 0.031% 100.011% ( 380, 580 ] 85 0.023% 100.034% ( 580, 870 ] 49 0.013% 100.047% ( 870, 1300 ] 33 0.009% 100.056% ( 1300, 1900 ] 30 0.008% 100.064% ( 1900, 2900 ] 17 0.005% 100.069% ( 2900, 4400 ] 37 0.010% 100.079% ( 4400, 6600 ] 17 0.005% 100.083% ( 6600, 9900 ] 11 0.003% 100.086% ( 9900, 14000 ] 4 0.001% 100.087% ( 14000, 22000 ] 4 0.001% 100.089% ( 22000, 33000 ] 2 0.001% 100.089% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2714 StdDev: 10.95 Min: 1 Median: 1.5275 Max: 1590 Percentiles: P50: 1.53 P75: 1.89 P99: 5.75 P99.9: 9.93 P99.99: 276.40 ------------------------------------------------------ [ 0, 1 ] 6741 14.053% 14.053% ### ( 1, 2 ] 32688 68.144% 82.197% ############## ( 2, 3 ] 5365 11.184% 93.381% ## ( 3, 4 ] 1593 3.321% 96.702% # ( 4, 6 ] 1257 2.620% 99.322% # ( 6, 10 ] 282 0.588% 99.910% ( 10, 15 ] 27 0.056% 99.967% ( 15, 22 ] 5 0.010% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 110, 170 ] 2 0.004% 99.985% ( 170, 250 ] 2 0.004% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 580, 870 ] 1 0.002% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 42803 Average: 3.8288 StdDev: 63.42 Min: 1 Median: 1.4973 Max: 4564 Percentiles: P50: 1.50 P75: 1.86 P99: 5.63 P99.9: 499.91 P99.99: 3579.92 ------------------------------------------------------ [ 0, 1 ] 6887 16.090% 16.090% ### ( 1, 2 ] 29185 68.184% 84.274% ############## ( 2, 3 ] 4728 11.046% 95.320% ## ( 3, 4 ] 1009 2.357% 97.678% ( 4, 6 ] 695 1.624% 99.301% ( 6, 10 ] 193 0.451% 99.752% ( 10, 15 ] 46 0.107% 99.860% ( 15, 22 ] 7 0.016% 99.876% ( 110, 170 ] 4 0.009% 99.886% ( 250, 380 ] 2 0.005% 99.890% ( 380, 580 ] 7 0.016% 99.907% ( 580, 870 ] 12 0.028% 99.935% ( 870, 1300 ] 7 0.016% 99.951% ( 1300, 1900 ] 5 0.012% 99.963% ( 1900, 2900 ] 9 0.021% 99.984% ( 2900, 4400 ] 6 0.014% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 4711 Average: 123.1093 StdDev: 950.42 Min: 0 Median: 2.4884 Max: 27193 Percentiles: P50: 2.49 P75: 4.37 P99: 2089.00 P99.9: 8726.85 P99.99: 18046.24 ------------------------------------------------------ [ 0, 1 ] 174 3.693% 3.693% # ( 1, 2 ] 1718 36.468% 40.161% ####### ( 2, 3 ] 949 20.144% 60.306% #### ( 3, 4 ] 609 12.927% 73.233% ### ( 4, 6 ] 452 9.595% 82.827% ## ( 6, 10 ] 162 3.439% 86.266% # ( 10, 15 ] 34 0.722% 86.988% ( 15, 22 ] 9 0.191% 87.179% ( 22, 34 ] 2 0.042% 87.221% ( 76, 110 ] 17 0.361% 87.582% ( 110, 170 ] 81 1.719% 89.302% ( 170, 250 ] 111 2.356% 91.658% ( 250, 380 ] 143 3.035% 94.693% # ( 380, 580 ] 78 1.656% 96.349% ( 580, 870 ] 78 1.656% 98.005% ( 870, 1300 ] 28 0.594% 98.599% ( 1300, 1900 ] 17 0.361% 98.960% ( 1900, 2900 ] 10 0.212% 99.172% ( 2900, 4400 ] 28 0.594% 99.767% ( 4400, 6600 ] 5 0.106% 99.873% ( 6600, 9900 ] 2 0.042% 99.915% ( 9900, 14000 ] 1 0.021% 99.936% ( 14000, 22000 ] 5 0.106% 100.042% ( 22000, 33000 ] 3 0.064% 100.106% ** DB Stats ** Uptime(secs): 41.0 total, 26.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 144.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.330 H:M:S, 59.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 37.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:22.667 H:M:S, 86.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/27-18:33:40 ... thread 0: (1000000,7000000) ops and (163116.0,149198.4) ops/second in (6.130606,46.917379) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 5/5 1006.86 MB 0.0 5.0 0.0 5.0 11.6 6.6 0.0 1.8 122.6 284.4 41.63 35.90 112 0.372 5181K 5564 0.0 0.0 L1 2/2 105.75 MB 0.0 6.8 5.4 1.4 6.7 5.3 0.2 1.2 208.5 204.7 33.57 28.66 4 8.393 6767K 125K 0.0 0.0 L2 6/6 470.21 MB 0.0 0.2 0.1 0.1 0.2 0.1 5.2 1.5 253.1 253.0 0.76 0.73 2 0.380 195K 91 0.0 0.0 L3 15/10 1.17 GB 0.2 0.7 0.6 0.1 0.7 0.6 4.4 1.2 155.6 155.4 4.88 3.46 5 0.976 509K 622 0.0 0.0 L4 148/0 9.62 GB 1.0 4.2 3.6 0.6 4.2 3.6 1.1 1.2 116.5 116.3 36.97 20.62 28 1.320 3361K 2252 0.0 0.0 L5 1096/0 90.25 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/23 102.58 GB 0.0 17.0 9.7 7.2 23.4 16.2 15.5 3.6 147.4 203.4 117.81 89.37 151 0.780 16M 133K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.0 9.7 7.2 23.4 16.2 15.4 3.6 147.4 203.4 117.81 89.37 151 0.780 16M 133K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.0 9.7 7.2 16.8 9.6 0.0 0.0 180.9 179.4 95.98 72.31 57 1.684 16M 133K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 308.7 21.84 17.06 94 0.232 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.1 total, 46.9 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.40 GB write, 508.64 MB/s write, 16.95 GB read, 368.55 MB/s read, 117.8 seconds Interval compaction: 23.40 GB write, 510.69 MB/s write, 16.95 GB read, 370.04 MB/s read, 117.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 53, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2749308 Average: 3.1814 StdDev: 42.28 Min: 0 Median: 1.3680 Max: 27775 Percentiles: P50: 1.37 P75: 1.78 P99: 8.39 P99.9: 168.02 P99.99: 717.27 ------------------------------------------------------ [ 0, 1 ] 759569 27.628% 27.628% ###### ( 1, 2 ] 1671487 60.797% 88.424% ############ ( 2, 3 ] 163168 5.935% 94.359% # ( 3, 4 ] 68727 2.500% 96.859% ( 4, 6 ] 51517 1.874% 98.733% ( 6, 10 ] 12308 0.448% 99.180% ( 10, 15 ] 2594 0.094% 99.275% ( 15, 22 ] 541 0.020% 99.294% ( 22, 34 ] 19 0.001% 99.295% ( 34, 51 ] 9 0.000% 99.295% ( 51, 76 ] 1543 0.056% 99.352% ( 76, 110 ] 8668 0.315% 99.667% ( 110, 170 ] 6627 0.241% 99.908% ( 170, 250 ] 916 0.033% 99.941% ( 250, 380 ] 636 0.023% 99.964% ( 380, 580 ] 581 0.021% 99.986% ( 580, 870 ] 260 0.009% 99.995% ( 870, 1300 ] 98 0.004% 99.999% ( 1300, 1900 ] 69 0.003% 100.001% ( 1900, 2900 ] 73 0.003% 100.004% ( 2900, 4400 ] 87 0.003% 100.007% ( 4400, 6600 ] 15 0.001% 100.007% ( 6600, 9900 ] 5 0.000% 100.008% ( 9900, 14000 ] 1 0.000% 100.008% ( 22000, 33000 ] 3 0.000% 100.008% ** Level 1 read latency histogram (micros): Count: 1558998 Average: 8.0642 StdDev: 130.87 Min: 0 Median: 1.8716 Max: 30968 Percentiles: P50: 1.87 P75: 2.84 P99: 9.44 P99.9: 139.70 P99.99: 400.81 ------------------------------------------------------ [ 0, 1 ] 105285 6.753% 6.753% # ( 1, 2 ] 773540 49.618% 56.371% ########## ( 2, 3 ] 346519 22.227% 78.598% #### ( 3, 4 ] 146916 9.424% 88.022% ## ( 4, 6 ] 143369 9.196% 97.218% ## ( 6, 10 ] 32346 2.075% 99.293% ( 10, 15 ] 6663 0.427% 99.720% ( 15, 22 ] 937 0.060% 99.780% ( 22, 34 ] 63 0.004% 99.784% ( 34, 51 ] 13 0.001% 99.785% ( 51, 76 ] 172 0.011% 99.796% ( 76, 110 ] 1179 0.076% 99.872% ( 110, 170 ] 891 0.057% 99.929% ( 170, 250 ] 327 0.021% 99.950% ( 250, 380 ] 544 0.035% 99.985% ( 380, 580 ] 789 0.051% 100.036% ( 580, 870 ] 946 0.061% 100.096% ( 870, 1300 ] 714 0.046% 100.142% ( 1300, 1900 ] 480 0.031% 100.173% ( 1900, 2900 ] 611 0.039% 100.212% ( 2900, 4400 ] 635 0.041% 100.253% ( 4400, 6600 ] 163 0.010% 100.263% ( 6600, 9900 ] 54 0.003% 100.267% ( 9900, 14000 ] 9 0.001% 100.267% ( 14000, 22000 ] 5 0.000% 100.268% ( 22000, 33000 ] 2 0.000% 100.268% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2714 StdDev: 10.95 Min: 1 Median: 1.5275 Max: 1590 Percentiles: P50: 1.53 P75: 1.89 P99: 5.75 P99.9: 9.93 P99.99: 276.40 ------------------------------------------------------ [ 0, 1 ] 6741 14.053% 14.053% ### ( 1, 2 ] 32688 68.144% 82.197% ############## ( 2, 3 ] 5365 11.184% 93.381% ## ( 3, 4 ] 1593 3.321% 96.702% # ( 4, 6 ] 1257 2.620% 99.322% # ( 6, 10 ] 282 0.588% 99.910% ( 10, 15 ] 27 0.056% 99.967% ( 15, 22 ] 5 0.010% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 110, 170 ] 2 0.004% 99.985% ( 170, 250 ] 2 0.004% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 580, 870 ] 1 0.002% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 73667 Average: 9.9469 StdDev: 130.62 Min: 1 Median: 1.6846 Max: 7189 Percentiles: P50: 1.68 P75: 2.36 P99: 9.72 P99.9: 2274.14 P99.99: 4759.33 ------------------------------------------------------ [ 0, 1 ] 7177 9.742% 9.742% ## ( 1, 2 ] 43318 58.802% 68.545% ############ ( 2, 3 ] 13048 17.712% 86.257% #### ( 3, 4 ] 4551 6.178% 92.435% # ( 4, 6 ] 4041 5.485% 97.920% # ( 6, 10 ] 857 1.163% 99.084% ( 10, 15 ] 160 0.217% 99.301% ( 15, 22 ] 29 0.039% 99.340% ( 22, 34 ] 4 0.005% 99.346% ( 76, 110 ] 12 0.016% 99.362% ( 110, 170 ] 27 0.037% 99.399% ( 170, 250 ] 36 0.049% 99.448% ( 250, 380 ] 51 0.069% 99.517% ( 380, 580 ] 80 0.109% 99.625% ( 580, 870 ] 82 0.111% 99.737% ( 870, 1300 ] 57 0.077% 99.814% ( 1300, 1900 ] 46 0.062% 99.876% ( 1900, 2900 ] 49 0.067% 99.943% ( 2900, 4400 ] 34 0.046% 99.989% ( 4400, 6600 ] 10 0.014% 100.003% ( 6600, 9900 ] 1 0.001% 100.004% ** Level 4 read latency histogram (micros): Count: 168686 Average: 28.6796 StdDev: 285.94 Min: 0 Median: 1.9920 Max: 27193 Percentiles: P50: 1.99 P75: 3.00 P99: 740.31 P99.9: 3379.06 P99.99: 4241.66 ------------------------------------------------------ [ 0, 1 ] 2417 1.433% 1.433% ( 1, 2 ] 82586 48.958% 50.391% ########## ( 2, 3 ] 41477 24.588% 74.980% ##### ( 3, 4 ] 18701 11.086% 86.066% ## ( 4, 6 ] 15770 9.349% 95.415% ## ( 6, 10 ] 3320 1.968% 97.383% ( 10, 15 ] 642 0.381% 97.763% ( 15, 22 ] 97 0.058% 97.821% ( 22, 34 ] 19 0.011% 97.832% ( 34, 51 ] 6 0.004% 97.836% ( 51, 76 ] 3 0.002% 97.837% ( 76, 110 ] 45 0.027% 97.864% ( 110, 170 ] 181 0.107% 97.971% ( 170, 250 ] 326 0.193% 98.165% ( 250, 380 ] 439 0.260% 98.425% ( 380, 580 ] 597 0.354% 98.779% ( 580, 870 ] 675 0.400% 99.179% ( 870, 1300 ] 528 0.313% 99.492% ( 1300, 1900 ] 346 0.205% 99.697% ( 1900, 2900 ] 258 0.153% 99.850% ( 2900, 4400 ] 264 0.157% 100.007% ( 4400, 6600 ] 77 0.046% 100.052% ( 6600, 9900 ] 11 0.007% 100.059% ( 9900, 14000 ] 4 0.002% 100.061% ( 14000, 22000 ] 7 0.004% 100.065% ( 22000, 33000 ] 3 0.002% 100.067% ** Level 5 read latency histogram (micros): Count: 280 Average: 1311.8714 StdDev: 1228.26 Min: 84 Median: 802.5581 Max: 6248 Percentiles: P50: 802.56 P75: 2038.89 P99: 5720.00 P99.9: 6248.00 P99.99: 6248.00 ------------------------------------------------------ ( 76, 110 ] 3 1.071% 1.071% ( 110, 170 ] 15 5.357% 6.429% # ( 170, 250 ] 13 4.643% 11.071% # ( 250, 380 ] 29 10.357% 21.429% ## ( 380, 580 ] 47 16.786% 38.214% ### ( 580, 870 ] 43 15.357% 53.571% ### ( 870, 1300 ] 34 12.143% 65.714% ## ( 1300, 1900 ] 21 7.500% 73.214% ## ( 1900, 2900 ] 36 12.857% 86.071% ### ( 2900, 4400 ] 32 11.429% 97.500% ## ( 4400, 6600 ] 7 2.500% 100.000% # ** DB Stats ** Uptime(secs): 47.1 total, 6.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 146.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.612 H:M:S, 58.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 160.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.282 H:M:S, 53.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/11/27-18:33:43 ... thread 0: (1000000,8000000) ops and (271519.7,158101.7) ops/second in (3.682974,50.600353) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.97 GB 69.2 5.6 0.0 5.6 13.2 7.6 0.0 1.7 120.2 282.5 47.70 41.04 127 0.376 5820K 6296 0.0 0.0 L1 2/2 105.75 MB 0.0 6.8 5.4 1.4 6.7 5.3 0.2 1.2 208.5 204.7 33.57 28.66 4 8.393 6767K 125K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 5.2 1.5 253.1 253.0 0.76 0.73 2 0.380 195K 91 0.0 0.0 L3 19/0 923.72 MB 0.9 2.2 1.1 1.1 2.2 1.1 4.4 2.0 156.9 156.5 14.40 10.34 11 1.310 1902K 4391 0.0 0.0 L4 148/0 9.66 GB 1.0 5.3 4.3 1.0 5.3 4.3 1.1 1.2 123.8 123.6 43.64 25.76 36 1.212 4462K 3596 0.0 0.0 L5 1104/0 90.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1285/11 103.56 GB 0.0 20.1 10.9 9.2 27.5 18.3 16.2 3.6 147.0 201.2 140.08 106.52 180 0.778 19M 139K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.1 10.9 9.2 27.5 18.3 16.1 3.6 147.0 201.2 140.08 106.52 180 0.778 19M 139K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.1 10.9 9.2 20.0 10.8 0.0 0.0 179.3 178.0 114.80 86.83 73 1.573 19M 139K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 306.5 25.28 19.69 107 0.236 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.8 total, 50.6 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.53 GB write, 554.98 MB/s write, 20.11 GB read, 405.35 MB/s read, 140.1 seconds Interval compaction: 27.53 GB write, 557.06 MB/s write, 20.11 GB read, 406.87 MB/s read, 140.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 60, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3123789 Average: 3.1948 StdDev: 43.99 Min: 0 Median: 1.4112 Max: 27775 Percentiles: P50: 1.41 P75: 1.82 P99: 8.16 P99.9: 165.00 P99.99: 586.71 ------------------------------------------------------ [ 0, 1 ] 780978 25.001% 25.001% ##### ( 1, 2 ] 1898992 60.791% 85.792% ############ ( 2, 3 ] 232711 7.450% 93.242% # ( 3, 4 ] 95695 3.063% 96.305% # ( 4, 6 ] 75090 2.404% 98.709% ( 6, 10 ] 16818 0.538% 99.248% ( 10, 15 ] 3370 0.108% 99.355% ( 15, 22 ] 611 0.020% 99.375% ( 22, 34 ] 25 0.001% 99.376% ( 34, 51 ] 13 0.000% 99.376% ( 51, 76 ] 1545 0.049% 99.426% ( 76, 110 ] 8700 0.279% 99.704% ( 110, 170 ] 6675 0.214% 99.918% ( 170, 250 ] 960 0.031% 99.949% ( 250, 380 ] 673 0.022% 99.970% ( 380, 580 ] 615 0.020% 99.990% ( 580, 870 ] 286 0.009% 99.999% ( 870, 1300 ] 107 0.003% 100.002% ( 1300, 1900 ] 75 0.002% 100.005% ( 1900, 2900 ] 78 0.002% 100.007% ( 2900, 4400 ] 99 0.003% 100.010% ( 4400, 6600 ] 26 0.001% 100.011% ( 6600, 9900 ] 14 0.000% 100.012% ( 9900, 14000 ] 1 0.000% 100.012% ( 22000, 33000 ] 3 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 1708794 Average: 7.7587 StdDev: 126.27 Min: 0 Median: 1.8729 Max: 30968 Percentiles: P50: 1.87 P75: 2.83 P99: 9.39 P99.9: 133.70 P99.99: 383.35 ------------------------------------------------------ [ 0, 1 ] 106903 6.256% 6.256% # ( 1, 2 ] 856380 50.116% 56.372% ########## ( 2, 3 ] 383619 22.450% 78.822% #### ( 3, 4 ] 159741 9.348% 88.170% ## ( 4, 6 ] 154731 9.055% 97.225% ## ( 6, 10 ] 35743 2.092% 99.317% ( 10, 15 ] 7174 0.420% 99.736% ( 15, 22 ] 1001 0.059% 99.795% ( 22, 34 ] 66 0.004% 99.799% ( 34, 51 ] 14 0.001% 99.800% ( 51, 76 ] 173 0.010% 99.810% ( 76, 110 ] 1182 0.069% 99.879% ( 110, 170 ] 907 0.053% 99.932% ( 170, 250 ] 364 0.021% 99.953% ( 250, 380 ] 611 0.036% 99.989% ( 380, 580 ] 842 0.049% 100.038% ( 580, 870 ] 993 0.058% 100.097% ( 870, 1300 ] 752 0.044% 100.141% ( 1300, 1900 ] 501 0.029% 100.170% ( 1900, 2900 ] 624 0.037% 100.206% ( 2900, 4400 ] 646 0.038% 100.244% ( 4400, 6600 ] 167 0.010% 100.254% ( 6600, 9900 ] 56 0.003% 100.257% ( 9900, 14000 ] 9 0.001% 100.258% ( 14000, 22000 ] 5 0.000% 100.258% ( 22000, 33000 ] 2 0.000% 100.258% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2714 StdDev: 10.95 Min: 1 Median: 1.5275 Max: 1590 Percentiles: P50: 1.53 P75: 1.89 P99: 5.75 P99.9: 9.93 P99.99: 276.40 ------------------------------------------------------ [ 0, 1 ] 6741 14.053% 14.053% ### ( 1, 2 ] 32688 68.144% 82.197% ############## ( 2, 3 ] 5365 11.184% 93.381% ## ( 3, 4 ] 1593 3.321% 96.702% # ( 4, 6 ] 1257 2.620% 99.322% # ( 6, 10 ] 282 0.588% 99.910% ( 10, 15 ] 27 0.056% 99.967% ( 15, 22 ] 5 0.010% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 110, 170 ] 2 0.004% 99.985% ( 170, 250 ] 2 0.004% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 580, 870 ] 1 0.002% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 338180 Average: 6.3086 StdDev: 114.00 Min: 1 Median: 1.8884 Max: 8393 Percentiles: P50: 1.89 P75: 2.80 P99: 8.44 P99.9: 193.48 P99.99: 572.04 ------------------------------------------------------ [ 0, 1 ] 9593 2.837% 2.837% # ( 1, 2 ] 179528 53.087% 55.923% ########### ( 2, 3 ] 80908 23.925% 79.848% ##### ( 3, 4 ] 31673 9.366% 89.213% ## ( 4, 6 ] 30186 8.926% 98.139% ## ( 6, 10 ] 4775 1.412% 99.551% ( 10, 15 ] 892 0.264% 99.815% ( 15, 22 ] 104 0.031% 99.846% ( 22, 34 ] 16 0.005% 99.851% ( 34, 51 ] 2 0.001% 99.851% ( 51, 76 ] 1 0.000% 99.852% ( 76, 110 ] 44 0.013% 99.865% ( 110, 170 ] 89 0.026% 99.891% ( 170, 250 ] 105 0.031% 99.922% ( 250, 380 ] 114 0.034% 99.956% ( 380, 580 ] 121 0.036% 99.991% ( 580, 870 ] 117 0.035% 100.026% ( 870, 1300 ] 71 0.021% 100.047% ( 1300, 1900 ] 54 0.016% 100.063% ( 1900, 2900 ] 59 0.017% 100.080% ( 2900, 4400 ] 67 0.020% 100.100% ( 4400, 6600 ] 22 0.007% 100.107% ( 6600, 9900 ] 45 0.013% 100.120% ** Level 4 read latency histogram (micros): Count: 213483 Average: 25.7742 StdDev: 263.64 Min: 0 Median: 1.9718 Max: 27193 Percentiles: P50: 1.97 P75: 2.97 P99: 653.21 P99.9: 3268.56 P99.99: 4272.74 ------------------------------------------------------ [ 0, 1 ] 3020 1.415% 1.415% ( 1, 2 ] 106735 49.997% 51.412% ########## ( 2, 3 ] 51973 24.345% 75.757% ##### ( 3, 4 ] 22844 10.701% 86.457% ## ( 4, 6 ] 19262 9.023% 95.480% ## ( 6, 10 ] 4310 2.019% 97.499% ( 10, 15 ] 795 0.372% 97.871% ( 15, 22 ] 106 0.050% 97.921% ( 22, 34 ] 19 0.009% 97.930% ( 34, 51 ] 7 0.003% 97.933% ( 51, 76 ] 7 0.003% 97.937% ( 76, 110 ] 75 0.035% 97.972% ( 110, 170 ] 270 0.126% 98.098% ( 170, 250 ] 429 0.201% 98.299% ( 250, 380 ] 546 0.256% 98.555% ( 380, 580 ] 752 0.352% 98.907% ( 580, 870 ] 785 0.368% 99.275% ( 870, 1300 ] 608 0.285% 99.560% ( 1300, 1900 ] 378 0.177% 99.737% ( 1900, 2900 ] 278 0.130% 99.867% ( 2900, 4400 ] 287 0.134% 100.001% ( 4400, 6600 ] 82 0.038% 100.040% ( 6600, 9900 ] 15 0.007% 100.047% ( 9900, 14000 ] 4 0.002% 100.049% ( 14000, 22000 ] 7 0.003% 100.052% ( 22000, 33000 ] 3 0.001% 100.053% ** Level 5 read latency histogram (micros): Count: 320 Average: 1270.9000 StdDev: 1239.78 Min: 84 Median: 765.1064 Max: 6248 Percentiles: P50: 765.11 P75: 1926.32 P99: 5817.78 P99.9: 6248.00 P99.99: 6248.00 ------------------------------------------------------ ( 76, 110 ] 6 1.875% 1.875% ( 110, 170 ] 22 6.875% 8.750% # ( 170, 250 ] 19 5.938% 14.688% # ( 250, 380 ] 31 9.688% 24.375% ## ( 380, 580 ] 52 16.250% 40.625% ### ( 580, 870 ] 47 14.688% 55.312% ### ( 870, 1300 ] 36 11.250% 66.562% ## ( 1300, 1900 ] 26 8.125% 74.688% ## ( 1900, 2900 ] 38 11.875% 86.562% ## ( 2900, 4400 ] 34 10.625% 97.188% ## ( 4400, 6600 ] 9 2.812% 100.000% # ** DB Stats ** Uptime(secs): 50.8 total, 3.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 155.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.466 H:M:S, 56.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 267.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.853 H:M:S, 23.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-18:33:46 ... thread 0: (1000000,9000000) ops and (332027.1,167872.4) ops/second in (3.011802,53.612155) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 1.97 GB 169.9 6.5 0.0 6.5 15.0 8.5 0.0 1.8 122.7 284.9 53.92 46.88 144 0.374 6716K 7268 0.0 0.0 L1 11/0 1.08 GB 110.8 7.9 6.4 1.5 7.8 6.3 0.2 1.2 209.3 205.9 38.75 33.52 5 7.750 7897K 130K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 5.2 1.5 253.1 253.0 0.76 0.73 2 0.380 195K 91 0.0 0.0 L3 19/0 923.72 MB 0.9 2.2 1.1 1.1 2.2 1.1 4.4 2.0 156.9 156.5 14.40 10.34 11 1.310 1902K 4391 0.0 0.0 L4 148/0 9.66 GB 1.0 5.3 4.3 1.0 5.3 4.3 1.1 1.2 123.8 123.6 43.64 25.76 36 1.212 4462K 3596 0.0 0.0 L5 1104/0 90.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1294/4 104.54 GB 0.0 22.1 11.9 10.2 30.5 20.3 16.2 3.6 149.1 205.9 151.48 117.23 198 0.765 21M 145K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.1 11.9 10.2 30.5 20.3 16.1 3.6 149.1 205.9 151.48 117.23 198 0.765 21M 145K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.1 11.9 10.2 21.9 11.7 0.0 0.0 183.1 181.8 123.37 95.01 77 1.602 21M 145K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 311.4 28.12 22.22 121 0.232 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.8 total, 53.6 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.45 GB write, 579.60 MB/s write, 22.05 GB read, 419.73 MB/s read, 151.5 seconds Interval compaction: 30.45 GB write, 581.65 MB/s write, 22.05 GB read, 421.22 MB/s read, 151.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 64, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 64, interval: 78 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3428799 Average: 3.1013 StdDev: 42.07 Min: 0 Median: 1.4158 Max: 27775 Percentiles: P50: 1.42 P75: 1.82 P99: 7.73 P99.9: 161.72 P99.99: 543.59 ------------------------------------------------------ [ 0, 1 ] 841963 24.556% 24.556% ##### ( 1, 2 ] 2098393 61.199% 85.755% ############ ( 2, 3 ] 260620 7.601% 93.356% ## ( 3, 4 ] 105079 3.065% 96.420% # ( 4, 6 ] 80492 2.348% 98.768% ( 6, 10 ] 18418 0.537% 99.305% ( 10, 15 ] 3688 0.108% 99.412% ( 15, 22 ] 644 0.019% 99.431% ( 22, 34 ] 30 0.001% 99.432% ( 34, 51 ] 15 0.000% 99.433% ( 51, 76 ] 1549 0.045% 99.478% ( 76, 110 ] 8712 0.254% 99.732% ( 110, 170 ] 6690 0.195% 99.927% ( 170, 250 ] 972 0.028% 99.955% ( 250, 380 ] 684 0.020% 99.975% ( 380, 580 ] 620 0.018% 99.993% ( 580, 870 ] 292 0.009% 100.002% ( 870, 1300 ] 110 0.003% 100.005% ( 1300, 1900 ] 81 0.002% 100.007% ( 1900, 2900 ] 78 0.002% 100.010% ( 2900, 4400 ] 99 0.003% 100.013% ( 4400, 6600 ] 26 0.001% 100.013% ( 6600, 9900 ] 14 0.000% 100.014% ( 9900, 14000 ] 1 0.000% 100.014% ( 22000, 33000 ] 3 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 1735702 Average: 7.6970 StdDev: 125.34 Min: 0 Median: 1.8669 Max: 30968 Percentiles: P50: 1.87 P75: 2.82 P99: 9.39 P99.9: 138.54 P99.99: 388.50 ------------------------------------------------------ [ 0, 1 ] 109617 6.315% 6.315% # ( 1, 2 ] 874676 50.393% 56.709% ########## ( 2, 3 ] 387593 22.331% 79.039% #### ( 3, 4 ] 160494 9.247% 88.286% ## ( 4, 6 ] 155283 8.946% 97.232% ## ( 6, 10 ] 36191 2.085% 99.317% ( 10, 15 ] 7190 0.414% 99.732% ( 15, 22 ] 1002 0.058% 99.789% ( 22, 34 ] 66 0.004% 99.793% ( 34, 51 ] 15 0.001% 99.794% ( 51, 76 ] 173 0.010% 99.804% ( 76, 110 ] 1214 0.070% 99.874% ( 110, 170 ] 951 0.055% 99.929% ( 170, 250 ] 394 0.023% 99.951% ( 250, 380 ] 633 0.036% 99.988% ( 380, 580 ] 857 0.049% 100.037% ( 580, 870 ] 996 0.057% 100.095% ( 870, 1300 ] 756 0.044% 100.138% ( 1300, 1900 ] 504 0.029% 100.167% ( 1900, 2900 ] 624 0.036% 100.203% ( 2900, 4400 ] 646 0.037% 100.240% ( 4400, 6600 ] 167 0.010% 100.250% ( 6600, 9900 ] 56 0.003% 100.253% ( 9900, 14000 ] 9 0.001% 100.254% ( 14000, 22000 ] 5 0.000% 100.254% ( 22000, 33000 ] 2 0.000% 100.254% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2714 StdDev: 10.95 Min: 1 Median: 1.5275 Max: 1590 Percentiles: P50: 1.53 P75: 1.89 P99: 5.75 P99.9: 9.93 P99.99: 276.40 ------------------------------------------------------ [ 0, 1 ] 6741 14.053% 14.053% ### ( 1, 2 ] 32688 68.144% 82.197% ############## ( 2, 3 ] 5365 11.184% 93.381% ## ( 3, 4 ] 1593 3.321% 96.702% # ( 4, 6 ] 1257 2.620% 99.322% # ( 6, 10 ] 282 0.588% 99.910% ( 10, 15 ] 27 0.056% 99.967% ( 15, 22 ] 5 0.010% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 110, 170 ] 2 0.004% 99.985% ( 170, 250 ] 2 0.004% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 580, 870 ] 1 0.002% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 338180 Average: 6.3086 StdDev: 114.00 Min: 1 Median: 1.8884 Max: 8393 Percentiles: P50: 1.89 P75: 2.80 P99: 8.44 P99.9: 193.48 P99.99: 572.04 ------------------------------------------------------ [ 0, 1 ] 9593 2.837% 2.837% # ( 1, 2 ] 179528 53.087% 55.923% ########### ( 2, 3 ] 80908 23.925% 79.848% ##### ( 3, 4 ] 31673 9.366% 89.213% ## ( 4, 6 ] 30186 8.926% 98.139% ## ( 6, 10 ] 4775 1.412% 99.551% ( 10, 15 ] 892 0.264% 99.815% ( 15, 22 ] 104 0.031% 99.846% ( 22, 34 ] 16 0.005% 99.851% ( 34, 51 ] 2 0.001% 99.851% ( 51, 76 ] 1 0.000% 99.852% ( 76, 110 ] 44 0.013% 99.865% ( 110, 170 ] 89 0.026% 99.891% ( 170, 250 ] 105 0.031% 99.922% ( 250, 380 ] 114 0.034% 99.956% ( 380, 580 ] 121 0.036% 99.991% ( 580, 870 ] 117 0.035% 100.026% ( 870, 1300 ] 71 0.021% 100.047% ( 1300, 1900 ] 54 0.016% 100.063% ( 1900, 2900 ] 59 0.017% 100.080% ( 2900, 4400 ] 67 0.020% 100.100% ( 4400, 6600 ] 22 0.007% 100.107% ( 6600, 9900 ] 45 0.013% 100.120% ** Level 4 read latency histogram (micros): Count: 213483 Average: 25.7742 StdDev: 263.64 Min: 0 Median: 1.9718 Max: 27193 Percentiles: P50: 1.97 P75: 2.97 P99: 653.21 P99.9: 3268.56 P99.99: 4272.74 ------------------------------------------------------ [ 0, 1 ] 3020 1.415% 1.415% ( 1, 2 ] 106735 49.997% 51.412% ########## ( 2, 3 ] 51973 24.345% 75.757% ##### ( 3, 4 ] 22844 10.701% 86.457% ## ( 4, 6 ] 19262 9.023% 95.480% ## ( 6, 10 ] 4310 2.019% 97.499% ( 10, 15 ] 795 0.372% 97.871% ( 15, 22 ] 106 0.050% 97.921% ( 22, 34 ] 19 0.009% 97.930% ( 34, 51 ] 7 0.003% 97.933% ( 51, 76 ] 7 0.003% 97.937% ( 76, 110 ] 75 0.035% 97.972% ( 110, 170 ] 270 0.126% 98.098% ( 170, 250 ] 429 0.201% 98.299% ( 250, 380 ] 546 0.256% 98.555% ( 380, 580 ] 752 0.352% 98.907% ( 580, 870 ] 785 0.368% 99.275% ( 870, 1300 ] 608 0.285% 99.560% ( 1300, 1900 ] 378 0.177% 99.737% ( 1900, 2900 ] 278 0.130% 99.867% ( 2900, 4400 ] 287 0.134% 100.001% ( 4400, 6600 ] 82 0.038% 100.040% ( 6600, 9900 ] 15 0.007% 100.047% ( 9900, 14000 ] 4 0.002% 100.049% ( 14000, 22000 ] 7 0.003% 100.052% ( 22000, 33000 ] 3 0.001% 100.053% ** Level 5 read latency histogram (micros): Count: 320 Average: 1270.9000 StdDev: 1239.78 Min: 84 Median: 765.1064 Max: 6248 Percentiles: P50: 765.11 P75: 1926.32 P99: 5817.78 P99.9: 6248.00 P99.99: 6248.00 ------------------------------------------------------ ( 76, 110 ] 6 1.875% 1.875% ( 110, 170 ] 22 6.875% 8.750% # ( 170, 250 ] 19 5.938% 14.688% # ( 250, 380 ] 31 9.688% 24.375% ## ( 380, 580 ] 52 16.250% 40.625% ### ( 580, 870 ] 47 14.688% 55.312% ### ( 870, 1300 ] 36 11.250% 66.562% ## ( 1300, 1900 ] 26 8.125% 74.688% ## ( 1900, 2900 ] 38 11.875% 86.562% ## ( 2900, 4400 ] 34 10.625% 97.188% ## ( 4400, 6600 ] 9 2.812% 100.000% # ** DB Stats ** Uptime(secs): 53.8 total, 3.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 164.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.864 H:M:S, 53.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-18:33:49 ... thread 0: (1000000,10000000) ops and (331070.7,176576.6) ops/second in (3.020503,56.632658) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 2.89 GB 6.3 7.6 0.0 7.6 17.0 9.5 0.0 1.8 127.4 286.9 60.80 53.40 161 0.378 7867K 8479 0.0 0.0 L1 11/11 1.08 GB 0.0 7.9 6.4 1.5 7.8 6.3 0.2 1.2 209.3 205.9 38.75 33.52 5 7.750 7897K 130K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 5.2 1.5 253.1 253.0 0.76 0.73 2 0.380 195K 91 0.0 0.0 L3 19/0 923.72 MB 0.9 2.2 1.1 1.1 2.2 1.1 4.4 2.0 156.9 156.5 14.40 10.34 11 1.310 1902K 4391 0.0 0.0 L4 148/0 9.66 GB 1.0 5.3 4.3 1.0 5.3 4.3 1.1 1.2 123.8 123.6 43.64 25.76 36 1.212 4462K 3596 0.0 0.0 L5 1104/0 90.92 GB 0.9 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/23 105.46 GB 0.0 23.2 11.9 11.3 32.5 21.2 16.2 3.4 149.8 210.0 158.36 123.74 215 0.737 22M 146K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.2 11.9 11.3 32.5 21.2 16.1 3.4 149.8 210.0 158.36 123.74 215 0.737 22M 146K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.2 11.9 11.3 23.0 11.7 0.0 0.0 185.8 184.6 127.61 99.18 81 1.575 22M 146K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 315.5 30.74 24.56 134 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.8 total, 56.6 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 32.48 GB write, 585.36 MB/s write, 23.16 GB read, 417.38 MB/s read, 158.4 seconds Interval compaction: 32.48 GB write, 587.31 MB/s write, 23.16 GB read, 418.77 MB/s read, 158.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 68, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3683543 Average: 3.0266 StdDev: 40.71 Min: 0 Median: 1.4109 Max: 27775 Percentiles: P50: 1.41 P75: 1.82 P99: 7.34 P99.9: 159.73 P99.99: 531.64 ------------------------------------------------------ [ 0, 1 ] 913315 24.794% 24.794% ##### ( 1, 2 ] 2259613 61.343% 86.138% ############ ( 2, 3 ] 274934 7.464% 93.602% # ( 3, 4 ] 110051 2.988% 96.589% # ( 4, 6 ] 82470 2.239% 98.828% ( 6, 10 ] 18920 0.514% 99.342% ( 10, 15 ] 3930 0.107% 99.449% ( 15, 22 ] 667 0.018% 99.467% ( 22, 34 ] 32 0.001% 99.468% ( 34, 51 ] 16 0.000% 99.468% ( 51, 76 ] 1551 0.042% 99.510% ( 76, 110 ] 8770 0.238% 99.748% ( 110, 170 ] 6745 0.183% 99.931% ( 170, 250 ] 988 0.027% 99.958% ( 250, 380 ] 698 0.019% 99.977% ( 380, 580 ] 626 0.017% 99.994% ( 580, 870 ] 299 0.008% 100.002% ( 870, 1300 ] 113 0.003% 100.005% ( 1300, 1900 ] 82 0.002% 100.008% ( 1900, 2900 ] 80 0.002% 100.010% ( 2900, 4400 ] 100 0.003% 100.012% ( 4400, 6600 ] 26 0.001% 100.013% ( 6600, 9900 ] 14 0.000% 100.013% ( 9900, 14000 ] 1 0.000% 100.014% ( 22000, 33000 ] 3 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 1738343 Average: 7.6934 StdDev: 125.25 Min: 0 Median: 1.8659 Max: 30968 Percentiles: P50: 1.87 P75: 2.82 P99: 9.40 P99.9: 139.86 P99.99: 389.33 ------------------------------------------------------ [ 0, 1 ] 110328 6.347% 6.347% # ( 1, 2 ] 876338 50.412% 56.759% ########## ( 2, 3 ] 387693 22.302% 79.061% #### ( 3, 4 ] 160544 9.235% 88.297% ## ( 4, 6 ] 155304 8.934% 97.231% ## ( 6, 10 ] 36221 2.084% 99.315% ( 10, 15 ] 7192 0.414% 99.728% ( 15, 22 ] 1003 0.058% 99.786% ( 22, 34 ] 66 0.004% 99.790% ( 34, 51 ] 15 0.001% 99.791% ( 51, 76 ] 173 0.010% 99.801% ( 76, 110 ] 1242 0.071% 99.872% ( 110, 170 ] 976 0.056% 99.928% ( 170, 250 ] 397 0.023% 99.951% ( 250, 380 ] 637 0.037% 99.988% ( 380, 580 ] 861 0.050% 100.037% ( 580, 870 ] 996 0.057% 100.095% ( 870, 1300 ] 756 0.043% 100.138% ( 1300, 1900 ] 504 0.029% 100.167% ( 1900, 2900 ] 624 0.036% 100.203% ( 2900, 4400 ] 646 0.037% 100.240% ( 4400, 6600 ] 167 0.010% 100.250% ( 6600, 9900 ] 56 0.003% 100.253% ( 9900, 14000 ] 9 0.001% 100.253% ( 14000, 22000 ] 5 0.000% 100.254% ( 22000, 33000 ] 2 0.000% 100.254% ** Level 2 read latency histogram (micros): Count: 47969 Average: 2.2714 StdDev: 10.95 Min: 1 Median: 1.5275 Max: 1590 Percentiles: P50: 1.53 P75: 1.89 P99: 5.75 P99.9: 9.93 P99.99: 276.40 ------------------------------------------------------ [ 0, 1 ] 6741 14.053% 14.053% ### ( 1, 2 ] 32688 68.144% 82.197% ############## ( 2, 3 ] 5365 11.184% 93.381% ## ( 3, 4 ] 1593 3.321% 96.702% # ( 4, 6 ] 1257 2.620% 99.322% # ( 6, 10 ] 282 0.588% 99.910% ( 10, 15 ] 27 0.056% 99.967% ( 15, 22 ] 5 0.010% 99.977% ( 22, 34 ] 1 0.002% 99.979% ( 51, 76 ] 1 0.002% 99.981% ( 110, 170 ] 2 0.004% 99.985% ( 170, 250 ] 2 0.004% 99.990% ( 250, 380 ] 1 0.002% 99.992% ( 380, 580 ] 1 0.002% 99.994% ( 580, 870 ] 1 0.002% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 338180 Average: 6.3086 StdDev: 114.00 Min: 1 Median: 1.8884 Max: 8393 Percentiles: P50: 1.89 P75: 2.80 P99: 8.44 P99.9: 193.48 P99.99: 572.04 ------------------------------------------------------ [ 0, 1 ] 9593 2.837% 2.837% # ( 1, 2 ] 179528 53.087% 55.923% ########### ( 2, 3 ] 80908 23.925% 79.848% ##### ( 3, 4 ] 31673 9.366% 89.213% ## ( 4, 6 ] 30186 8.926% 98.139% ## ( 6, 10 ] 4775 1.412% 99.551% ( 10, 15 ] 892 0.264% 99.815% ( 15, 22 ] 104 0.031% 99.846% ( 22, 34 ] 16 0.005% 99.851% ( 34, 51 ] 2 0.001% 99.851% ( 51, 76 ] 1 0.000% 99.852% ( 76, 110 ] 44 0.013% 99.865% ( 110, 170 ] 89 0.026% 99.891% ( 170, 250 ] 105 0.031% 99.922% ( 250, 380 ] 114 0.034% 99.956% ( 380, 580 ] 121 0.036% 99.991% ( 580, 870 ] 117 0.035% 100.026% ( 870, 1300 ] 71 0.021% 100.047% ( 1300, 1900 ] 54 0.016% 100.063% ( 1900, 2900 ] 59 0.017% 100.080% ( 2900, 4400 ] 67 0.020% 100.100% ( 4400, 6600 ] 22 0.007% 100.107% ( 6600, 9900 ] 45 0.013% 100.120% ** Level 4 read latency histogram (micros): Count: 213483 Average: 25.7742 StdDev: 263.64 Min: 0 Median: 1.9718 Max: 27193 Percentiles: P50: 1.97 P75: 2.97 P99: 653.21 P99.9: 3268.56 P99.99: 4272.74 ------------------------------------------------------ [ 0, 1 ] 3020 1.415% 1.415% ( 1, 2 ] 106735 49.997% 51.412% ########## ( 2, 3 ] 51973 24.345% 75.757% ##### ( 3, 4 ] 22844 10.701% 86.457% ## ( 4, 6 ] 19262 9.023% 95.480% ## ( 6, 10 ] 4310 2.019% 97.499% ( 10, 15 ] 795 0.372% 97.871% ( 15, 22 ] 106 0.050% 97.921% ( 22, 34 ] 19 0.009% 97.930% ( 34, 51 ] 7 0.003% 97.933% ( 51, 76 ] 7 0.003% 97.937% ( 76, 110 ] 75 0.035% 97.972% ( 110, 170 ] 270 0.126% 98.098% ( 170, 250 ] 429 0.201% 98.299% ( 250, 380 ] 546 0.256% 98.555% ( 380, 580 ] 752 0.352% 98.907% ( 580, 870 ] 785 0.368% 99.275% ( 870, 1300 ] 608 0.285% 99.560% ( 1300, 1900 ] 378 0.177% 99.737% ( 1900, 2900 ] 278 0.130% 99.867% ( 2900, 4400 ] 287 0.134% 100.001% ( 4400, 6600 ] 82 0.038% 100.040% ( 6600, 9900 ] 15 0.007% 100.047% ( 9900, 14000 ] 4 0.002% 100.049% ( 14000, 22000 ] 7 0.003% 100.052% ( 22000, 33000 ] 3 0.001% 100.053% ** Level 5 read latency histogram (micros): Count: 320 Average: 1270.9000 StdDev: 1239.78 Min: 84 Median: 765.1064 Max: 6248 Percentiles: P50: 765.11 P75: 1926.32 P99: 5817.78 P99.9: 6248.00 P99.99: 6248.00 ------------------------------------------------------ ( 76, 110 ] 6 1.875% 1.875% ( 110, 170 ] 22 6.875% 8.750% # ( 170, 250 ] 19 5.938% 14.688% # ( 250, 380 ] 31 9.688% 24.375% ## ( 380, 580 ] 52 16.250% 40.625% ### ( 580, 870 ] 47 14.688% 55.312% ### ( 870, 1300 ] 36 11.250% 66.562% ## ( 1300, 1900 ] 26 8.125% 74.688% ## ( 1900, 2900 ] 38 11.875% 86.562% ## ( 2900, 4400 ] 34 10.625% 97.188% ## ( 4400, 6600 ] 9 2.812% 100.000% # ** DB Stats ** Uptime(secs): 56.8 total, 3.0 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 173.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.268 H:M:S, 51.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.404 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.489 micros/op 182175 ops/sec 60.003 seconds 10930999 operations; 176.5 MB/s Microseconds per write: Count: 10930999 Average: 5.4892 StdDev: 483.56 Min: 0 Median: 1.7363 Max: 685394 Percentiles: P50: 1.74 P75: 2.73 P99: 8.65 P99.9: 1092.23 P99.99: 2757.81 ------------------------------------------------------ [ 0, 1 ] 1433498 13.114% 13.114% ### ( 1, 2 ] 5475819 50.094% 63.208% ########## ( 2, 3 ] 1777724 16.263% 79.472% ### ( 3, 4 ] 1498157 13.706% 93.177% ### ( 4, 6 ] 562363 5.145% 98.322% # ( 6, 10 ] 111854 1.023% 99.345% ( 10, 15 ] 34913 0.319% 99.665% ( 15, 22 ] 8736 0.080% 99.744% ( 22, 34 ] 1713 0.016% 99.760% ( 34, 51 ] 234 0.002% 99.762% ( 51, 76 ] 40 0.000% 99.763% ( 76, 110 ] 7659 0.070% 99.833% ( 110, 170 ] 2904 0.027% 99.859% ( 170, 250 ] 335 0.003% 99.862% ( 250, 380 ] 158 0.001% 99.864% ( 380, 580 ] 19 0.000% 99.864% ( 580, 870 ] 25 0.000% 99.864% ( 870, 1300 ] 7579 0.069% 99.934% ( 1300, 1900 ] 22 0.000% 99.934% ( 1900, 2900 ] 7174 0.066% 99.999% ( 2900, 4400 ] 28 0.000% 100.000% ( 4400, 6600 ] 4 0.000% 100.000% ( 6600, 9900 ] 8 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 19 0.000% 100.000% ( 570000, 860000 ] 4 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 170672 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10930999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11280790968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 540 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30124280 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 26556827391 rocksdb.compact.write.bytes COUNT : 26380722683 rocksdb.flush.write.bytes COUNT : 11163490899 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 73 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 316 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 11073618944 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4426752 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 26665889365 rocksdb.non.last.level.read.count COUNT : 6433882 rocksdb.block.checksum.compute.count COUNT : 6432875 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.369410 P95 : 3.865561 P99 : 6.837945 P100 : 685392.000000 COUNT : 10930999 SUM : 54807809 rocksdb.compaction.times.micros P50 : 1170857.142857 P95 : 2833333.333333 P99 : 23492192.000000 P100 : 23492192.000000 COUNT : 84 SUM : 130645269 rocksdb.compaction.times.cpu_micros P50 : 900000.000000 P95 : 1882500.000000 P99 : 15280000.000000 P100 : 20519659.000000 COUNT : 84 SUM : 102167386 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 679.024390 P95 : 5720.000000 P99 : 190800.000000 P100 : 229586.000000 COUNT : 148 SUM : 791829 rocksdb.compaction.outfile.sync.micros P50 : 1129.402174 P95 : 97431.818182 P99 : 168733.333333 P100 : 270039.000000 COUNT : 319 SUM : 5526824 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 102.166667 P95 : 2157.692308 P99 : 3252.500000 P100 : 4926.000000 COUNT : 253 SUM : 87176 rocksdb.table.open.io.micros P50 : 1579.207921 P95 : 8129.268293 P99 : 9867.804878 P100 : 11430.000000 COUNT : 540 SUM : 1260852 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.603440 P95 : 7.744207 P99 : 12.499657 P100 : 30973.000000 COUNT : 6431406 SUM : 46528897 rocksdb.read.block.get.micros P50 : 456.190476 P95 : 3687.500000 P99 : 5162.666667 P100 : 7445.000000 COUNT : 1080 SUM : 1029356 rocksdb.write.raw.block.micros P50 : 0.512972 P95 : 0.974647 P99 : 2.839488 P100 : 44157.000000 COUNT : 9105283 SUM : 19499052 rocksdb.numfiles.in.singlecompaction P50 : 3.307229 P95 : 4.966667 P99 : 25.000000 P100 : 25.000000 COUNT : 131 SUM : 511 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563881 P95 : 1988.333100 P99 : 2721.578874 P100 : 685192.000000 COUNT : 131196 SUM : 30138387 rocksdb.sst.read.micros P50 : 1.566435 P95 : 4.628017 P99 : 9.098942 P100 : 30968.000000 COUNT : 6434237 SUM : 33736352 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10930999 SUM : 11280790968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 208681.318681 P95 : 478800.000000 P99 : 774160.000000 P100 : 851712.000000 COUNT : 148 SUM : 33392435 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 328 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0