[2024-11-29 09:18:50.530831] Starting SPDK v25.01-pre git sha1 8ca38af96 / DPDK 24.03.0 initialization... [2024-11-29 09:18:50.531095] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3817993 ] Set seed to 1732868330524092 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-29 09:18:50.654702] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-29 09:18:50.762185] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-29 09:18:50.762232] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3817993' to capture a snapshot of events at runtime. [2024-11-29 09:18:50.762242] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-29 09:18:50.762252] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-29 09:18:50.762261] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3817993 for offline analysis/debug. [2024-11-29 09:18:50.763601] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Nov 29 09:18:56 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/29-09:18:59 ... thread 0: (1000000,1000000) ops and (357528.3,357528.3) ops/second in (2.796981,2.796981) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 440.40 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 347.9 2.35 2.13 12 0.196 0 0 0.0 0.0 L1 3/1 250.40 MB 24.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 256.9 255.8 0.98 0.95 1 0.979 255K 1032 0.0 0.0 L2 2/2 160.25 MB 0.0 0.3 0.1 0.1 0.3 0.1 0.0 2.0 249.0 248.5 1.04 1.00 2 0.519 262K 436 0.0 0.0 L3 9/0 755.91 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 245/8 20.02 GB 0.0 0.5 0.4 0.1 1.3 1.2 0.1 1.6 116.7 303.6 4.37 4.08 15 0.291 517K 1468 0.0 0.0 Int 0/0 0.00 KB 0.0 0.5 0.4 0.1 1.3 1.2 0.1 1.6 116.7 303.6 4.37 4.08 15 0.291 517K 1468 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.5 0.4 0.1 0.5 0.4 0.0 0.0 252.8 252.1 2.02 1.95 3 0.672 517K 1468 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 347.9 2.35 2.13 12 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.9 total, 2.8 interval Flush(GB): cumulative 0.799, interval 0.799 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.29 GB write, 460.80 MB/s write, 0.50 GB read, 177.17 MB/s read, 4.4 seconds Interval compaction: 1.29 GB write, 473.72 MB/s write, 0.50 GB read, 182.13 MB/s read, 4.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 129147 Average: 1.9874 StdDev: 13.16 Min: 1 Median: 1.3248 Max: 3224 Percentiles: P50: 1.32 P75: 1.75 P99: 5.33 P99.9: 9.83 P99.99: 141.28 ------------------------------------------------------ [ 0, 1 ] 39932 30.920% 30.920% ###### ( 1, 2 ] 75870 58.747% 89.667% ############ ( 2, 3 ] 7851 6.079% 95.746% # ( 3, 4 ] 2904 2.249% 97.995% ( 4, 6 ] 1956 1.515% 99.509% ( 6, 10 ] 529 0.410% 99.919% ( 10, 15 ] 79 0.061% 99.980% ( 15, 22 ] 11 0.009% 99.988% ( 22, 34 ] 1 0.001% 99.989% ( 34, 51 ] 1 0.001% 99.990% ( 110, 170 ] 4 0.003% 99.993% ( 170, 250 ] 8 0.006% 99.999% ( 250, 380 ] 3 0.002% 100.002% ( 380, 580 ] 5 0.004% 100.005% ( 580, 870 ] 2 0.002% 100.007% ( 1900, 2900 ] 2 0.002% 100.009% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 2535 Average: 3.3830 StdDev: 28.91 Min: 1 Median: 1.6053 Max: 1047 Percentiles: P50: 1.61 P75: 2.00 P99: 7.33 P99.9: 473.00 P99.99: 1047.00 ------------------------------------------------------ [ 0, 1 ] 296 11.677% 11.677% ## ( 1, 2 ] 1605 63.314% 74.990% ############# ( 2, 3 ] 380 14.990% 89.980% ### ( 3, 4 ] 133 5.247% 95.227% # ( 4, 6 ] 89 3.511% 98.738% # ( 6, 10 ] 20 0.789% 99.527% ( 10, 15 ] 7 0.276% 99.803% ( 15, 22 ] 1 0.039% 99.842% ( 250, 380 ] 1 0.039% 99.882% ( 380, 580 ] 1 0.039% 99.921% ( 870, 1300 ] 2 0.079% 100.000% ** Level 2 read latency histogram (micros): Count: 66775 Average: 2.3005 StdDev: 11.78 Min: 1 Median: 1.4039 Max: 1068 Percentiles: P50: 1.40 P75: 1.82 P99: 6.29 P99.9: 56.87 P99.99: 360.17 ------------------------------------------------------ [ 0, 1 ] 17299 25.906% 25.906% ##### ( 1, 2 ] 39830 59.648% 85.554% ############ ( 2, 3 ] 5473 8.196% 93.751% ## ( 3, 4 ] 1970 2.950% 96.701% # ( 4, 6 ] 1499 2.245% 98.946% ( 6, 10 ] 514 0.770% 99.715% ( 10, 15 ] 93 0.139% 99.855% ( 15, 22 ] 19 0.028% 99.883% ( 22, 34 ] 2 0.003% 99.886% ( 34, 51 ] 2 0.003% 99.889% ( 51, 76 ] 35 0.052% 99.942% ( 76, 110 ] 8 0.012% 99.954% ( 110, 170 ] 3 0.004% 99.958% ( 170, 250 ] 13 0.019% 99.978% ( 250, 380 ] 11 0.016% 99.994% ( 380, 580 ] 4 0.006% 100.000% ( 580, 870 ] 5 0.007% 100.007% ( 870, 1300 ] 4 0.006% 100.013% ** Level 3 read latency histogram (micros): Count: 44 Average: 2606.0682 StdDev: 1690.20 Min: 104 Median: 2525.0000 Max: 6016 Percentiles: P50: 2525.00 P75: 3757.14 P99: 6016.00 P99.9: 6016.00 P99.99: 6016.00 ------------------------------------------------------ ( 76, 110 ] 2 4.545% 4.545% # ( 110, 170 ] 1 2.273% 6.818% ( 250, 380 ] 1 2.273% 9.091% ( 380, 580 ] 5 11.364% 20.455% ## ( 580, 870 ] 2 4.545% 25.000% # ( 870, 1300 ] 1 2.273% 27.273% ( 1300, 1900 ] 5 11.364% 38.636% ## ( 1900, 2900 ] 8 18.182% 56.818% #### ( 2900, 4400 ] 14 31.818% 88.636% ###### ( 4400, 6600 ] 6 13.636% 102.273% ### ** Level 4 read latency histogram (micros): Count: 30 Average: 2634.1667 StdDev: 1547.28 Min: 105 Median: 2900.0000 Max: 6252 Percentiles: P50: 2900.00 P75: 3922.73 P99: 6252.00 P99.9: 6252.00 P99.99: 6252.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 170, 250 ] 1 3.333% 6.667% # ( 250, 380 ] 1 3.333% 10.000% # ( 380, 580 ] 1 3.333% 13.333% # ( 580, 870 ] 2 6.667% 20.000% # ( 870, 1300 ] 2 6.667% 26.667% # ( 1300, 1900 ] 2 6.667% 33.333% # ( 1900, 2900 ] 5 16.667% 50.000% ### ( 2900, 4400 ] 11 36.667% 86.667% ####### ( 4400, 6600 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 2.9 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 341.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.209 H:M:S, 7.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 351.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.209 H:M:S, 7.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/29-09:19:02 ... thread 0: (1000000,2000000) ops and (325298.5,340652.8) ops/second in (3.074100,5.871081) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.41 GB 87.5 0.9 0.0 0.9 2.6 1.8 0.0 1.5 102.0 312.6 8.64 8.02 29 0.298 894K 5144 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 256.9 255.8 0.98 0.95 1 0.979 255K 1032 0.0 0.0 L2 1/1 49.27 MB 0.0 0.3 0.1 0.2 0.3 0.1 0.2 2.3 247.7 246.9 1.24 1.20 3 0.415 312K 969 0.0 0.0 L3 18/9 1.09 GB 0.4 0.5 0.4 0.1 0.5 0.4 0.0 1.4 219.7 219.0 2.30 2.16 3 0.766 512K 1542 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 254/18 21.00 GB 0.0 1.9 0.7 1.2 3.7 2.5 0.4 2.1 147.8 285.8 13.16 12.33 36 0.365 1975K 8687 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 0.7 1.2 3.7 2.5 0.4 2.1 147.8 285.8 13.16 12.33 36 0.365 1975K 8687 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 0.7 1.2 1.9 0.7 0.0 0.0 245.0 243.9 7.94 7.67 10 0.794 1975K 8687 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 349.5 5.22 4.66 26 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.9 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.67 GB write, 631.74 MB/s write, 1.90 GB read, 326.80 MB/s read, 13.2 seconds Interval compaction: 3.67 GB write, 640.19 MB/s write, 1.90 GB read, 331.17 MB/s read, 13.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 381635 Average: 2.3251 StdDev: 12.53 Min: 1 Median: 1.5419 Max: 3224 Percentiles: P50: 1.54 P75: 1.94 P99: 5.84 P99.9: 11.88 P99.99: 20.26 ------------------------------------------------------ [ 0, 1 ] 59771 15.662% 15.662% ### ( 1, 2 ] 241829 63.367% 79.028% ############# ( 2, 3 ] 49613 13.000% 92.029% ### ( 3, 4 ] 16042 4.203% 96.232% # ( 4, 6 ] 11504 3.014% 99.246% # ( 6, 10 ] 2315 0.607% 99.853% ( 10, 15 ] 482 0.126% 99.979% ( 15, 22 ] 57 0.015% 99.994% ( 22, 34 ] 9 0.002% 99.997% ( 34, 51 ] 5 0.001% 99.998% ( 51, 76 ] 1 0.000% 99.998% ( 76, 110 ] 4 0.001% 99.999% ( 110, 170 ] 19 0.005% 100.004% ( 170, 250 ] 28 0.007% 100.012% ( 250, 380 ] 13 0.003% 100.015% ( 380, 580 ] 9 0.002% 100.017% ( 580, 870 ] 7 0.002% 100.019% ( 870, 1300 ] 3 0.001% 100.020% ( 1300, 1900 ] 4 0.001% 100.021% ( 1900, 2900 ] 4 0.001% 100.022% ( 2900, 4400 ] 2 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 63597 Average: 2.9246 StdDev: 14.58 Min: 1 Median: 1.7488 Max: 1602 Percentiles: P50: 1.75 P75: 2.45 P99: 8.21 P99.9: 77.25 P99.99: 817.84 ------------------------------------------------------ [ 0, 1 ] 2484 3.906% 3.906% # ( 1, 2 ] 39150 61.560% 65.465% ############ ( 2, 3 ] 13330 20.960% 86.425% #### ( 3, 4 ] 3934 6.186% 92.611% # ( 4, 6 ] 3623 5.697% 98.308% # ( 6, 10 ] 797 1.253% 99.561% ( 10, 15 ] 192 0.302% 99.863% ( 15, 22 ] 18 0.028% 99.892% ( 22, 34 ] 5 0.008% 99.899% ( 76, 110 ] 11 0.017% 99.917% ( 110, 170 ] 17 0.027% 99.943% ( 170, 250 ] 11 0.017% 99.961% ( 250, 380 ] 6 0.009% 99.970% ( 380, 580 ] 11 0.017% 99.987% ( 580, 870 ] 2 0.003% 99.991% ( 870, 1300 ] 5 0.008% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 77812 Average: 2.5017 StdDev: 14.61 Min: 1 Median: 1.4459 Max: 1293 Percentiles: P50: 1.45 P75: 1.86 P99: 6.64 P99.9: 91.06 P99.99: 386.25 ------------------------------------------------------ [ 0, 1 ] 17959 23.080% 23.080% ##### ( 1, 2 ] 46981 60.378% 83.458% ############ ( 2, 3 ] 7569 9.727% 93.185% ## ( 3, 4 ] 2520 3.239% 96.423% # ( 4, 6 ] 1906 2.449% 98.873% ( 6, 10 ] 618 0.794% 99.667% ( 10, 15 ] 110 0.141% 99.809% ( 15, 22 ] 22 0.028% 99.837% ( 22, 34 ] 2 0.003% 99.839% ( 34, 51 ] 2 0.003% 99.842% ( 51, 76 ] 35 0.045% 99.887% ( 76, 110 ] 23 0.030% 99.916% ( 110, 170 ] 19 0.024% 99.941% ( 170, 250 ] 18 0.023% 99.964% ( 250, 380 ] 20 0.026% 99.990% ( 380, 580 ] 7 0.009% 99.999% ( 580, 870 ] 8 0.010% 100.009% ( 870, 1300 ] 7 0.009% 100.018% ** Level 3 read latency histogram (micros): Count: 218481 Average: 3.5729 StdDev: 47.50 Min: 0 Median: 1.5965 Max: 6016 Percentiles: P50: 1.60 P75: 1.97 P99: 8.59 P99.9: 227.71 P99.99: 814.83 ------------------------------------------------------ [ 0, 1 ] 22311 10.212% 10.212% ## ( 1, 2 ] 145727 66.700% 76.912% ############# ( 2, 3 ] 27950 12.793% 89.705% ### ( 3, 4 ] 10744 4.918% 94.622% # ( 4, 6 ] 7251 3.319% 97.941% # ( 6, 10 ] 3571 1.634% 99.576% ( 10, 15 ] 222 0.102% 99.677% ( 15, 22 ] 33 0.015% 99.692% ( 22, 34 ] 6 0.003% 99.695% ( 34, 51 ] 2 0.001% 99.696% ( 76, 110 ] 102 0.047% 99.743% ( 110, 170 ] 262 0.120% 99.863% ( 170, 250 ] 113 0.052% 99.914% ( 250, 380 ] 65 0.030% 99.944% ( 380, 580 ] 71 0.032% 99.977% ( 580, 870 ] 36 0.016% 99.993% ( 870, 1300 ] 9 0.004% 99.997% ( 1300, 1900 ] 6 0.003% 100.000% ( 1900, 2900 ] 8 0.004% 100.004% ( 2900, 4400 ] 15 0.007% 100.011% ( 4400, 6600 ] 6 0.003% 100.013% ** Level 4 read latency histogram (micros): Count: 30 Average: 2634.1667 StdDev: 1547.28 Min: 105 Median: 2900.0000 Max: 6252 Percentiles: P50: 2900.00 P75: 3922.73 P99: 6252.00 P99.9: 6252.00 P99.99: 6252.00 ------------------------------------------------------ ( 76, 110 ] 1 3.333% 3.333% # ( 170, 250 ] 1 3.333% 6.667% # ( 250, 380 ] 1 3.333% 10.000% # ( 380, 580 ] 1 3.333% 13.333% # ( 580, 870 ] 2 6.667% 20.000% # ( 870, 1300 ] 2 6.667% 26.667% # ( 1300, 1900 ] 2 6.667% 33.333% # ( 1900, 2900 ] 5 16.667% 50.000% ### ( 2900, 4400 ] 11 36.667% 86.667% ####### ( 4400, 6600 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 6.0 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 330.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.569 H:M:S, 9.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.360 H:M:S, 11.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/29-09:19:05 ... thread 0: (1000000,3000000) ops and (327770.3,336247.6) ops/second in (3.050917,8.921998) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.32 GB 37.6 1.7 0.0 1.7 4.4 2.7 0.0 1.6 117.1 307.4 14.50 13.51 45 0.322 1724K 9355 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 256.9 255.8 0.98 0.95 1 0.979 255K 1032 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.2 2.3 247.7 246.9 1.24 1.20 3 0.415 312K 969 0.0 0.0 L3 20/0 977.87 MB 1.0 1.3 0.4 0.9 1.3 0.4 0.0 3.2 234.6 231.7 5.58 5.17 4 1.396 1330K 16K 0.0 0.0 L4 122/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 208.8 208.8 0.82 0.74 1 0.825 174K 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 265/12 21.90 GB 0.0 3.7 0.9 2.7 6.3 3.6 0.4 2.3 161.7 280.2 23.13 21.57 54 0.428 3798K 27K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 0.9 2.7 6.3 3.6 0.4 2.3 161.7 280.2 23.13 21.57 54 0.428 3798K 27K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 0.9 2.7 3.6 0.9 0.0 0.0 246.2 244.4 15.19 14.49 15 1.013 3798K 27K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 348.6 7.94 7.08 39 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.9 interval Flush(GB): cumulative 2.702, interval 2.702 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.33 GB write, 719.75 MB/s write, 3.65 GB read, 415.44 MB/s read, 23.1 seconds Interval compaction: 6.33 GB write, 726.08 MB/s write, 3.65 GB read, 419.09 MB/s read, 23.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 697034 Average: 2.3535 StdDev: 11.68 Min: 1 Median: 1.5402 Max: 3224 Percentiles: P50: 1.54 P75: 1.92 P99: 5.82 P99.9: 12.71 P99.99: 161.32 ------------------------------------------------------ [ 0, 1 ] 99798 14.318% 14.318% ### ( 1, 2 ] 460433 66.056% 80.374% ############# ( 2, 3 ] 88142 12.645% 93.019% ### ( 3, 4 ] 25608 3.674% 96.693% # ( 4, 6 ] 17637 2.530% 99.223% # ( 6, 10 ] 4314 0.619% 99.842% ( 10, 15 ] 752 0.108% 99.950% ( 15, 22 ] 85 0.012% 99.962% ( 22, 34 ] 11 0.002% 99.964% ( 34, 51 ] 6 0.001% 99.964% ( 51, 76 ] 1 0.000% 99.965% ( 76, 110 ] 51 0.007% 99.972% ( 110, 170 ] 150 0.022% 99.993% ( 170, 250 ] 66 0.009% 100.003% ( 250, 380 ] 40 0.006% 100.009% ( 380, 580 ] 38 0.005% 100.014% ( 580, 870 ] 18 0.003% 100.017% ( 870, 1300 ] 10 0.001% 100.018% ( 1300, 1900 ] 4 0.001% 100.019% ( 1900, 2900 ] 6 0.001% 100.020% ( 2900, 4400 ] 2 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 63597 Average: 2.9246 StdDev: 14.58 Min: 1 Median: 1.7488 Max: 1602 Percentiles: P50: 1.75 P75: 2.45 P99: 8.21 P99.9: 77.25 P99.99: 817.84 ------------------------------------------------------ [ 0, 1 ] 2484 3.906% 3.906% # ( 1, 2 ] 39150 61.560% 65.465% ############ ( 2, 3 ] 13330 20.960% 86.425% #### ( 3, 4 ] 3934 6.186% 92.611% # ( 4, 6 ] 3623 5.697% 98.308% # ( 6, 10 ] 797 1.253% 99.561% ( 10, 15 ] 192 0.302% 99.863% ( 15, 22 ] 18 0.028% 99.892% ( 22, 34 ] 5 0.008% 99.899% ( 76, 110 ] 11 0.017% 99.917% ( 110, 170 ] 17 0.027% 99.943% ( 170, 250 ] 11 0.017% 99.961% ( 250, 380 ] 6 0.009% 99.970% ( 380, 580 ] 11 0.017% 99.987% ( 580, 870 ] 2 0.003% 99.991% ( 870, 1300 ] 5 0.008% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 86855 Average: 2.5154 StdDev: 14.34 Min: 1 Median: 1.4669 Max: 1293 Percentiles: P50: 1.47 P75: 1.88 P99: 6.98 P99.9: 84.71 P99.99: 412.86 ------------------------------------------------------ [ 0, 1 ] 18612 21.429% 21.429% #### ( 1, 2 ] 53150 61.194% 82.623% ############ ( 2, 3 ] 8789 10.119% 92.742% ## ( 3, 4 ] 3012 3.468% 96.210% # ( 4, 6 ] 2232 2.570% 98.780% # ( 6, 10 ] 785 0.904% 99.683% ( 10, 15 ] 121 0.139% 99.823% ( 15, 22 ] 22 0.025% 99.848% ( 22, 34 ] 2 0.002% 99.850% ( 34, 51 ] 2 0.002% 99.853% ( 51, 76 ] 35 0.040% 99.893% ( 76, 110 ] 24 0.028% 99.921% ( 110, 170 ] 19 0.022% 99.942% ( 170, 250 ] 20 0.023% 99.965% ( 250, 380 ] 20 0.023% 99.988% ( 380, 580 ] 8 0.009% 99.998% ( 580, 870 ] 8 0.009% 100.007% ( 870, 1300 ] 8 0.009% 100.016% ** Level 3 read latency histogram (micros): Count: 272411 Average: 3.5129 StdDev: 43.71 Min: 0 Median: 1.5999 Max: 6016 Percentiles: P50: 1.60 P75: 1.97 P99: 8.68 P99.9: 237.72 P99.99: 839.32 ------------------------------------------------------ [ 0, 1 ] 27023 9.920% 9.920% ## ( 1, 2 ] 182008 66.814% 76.734% ############# ( 2, 3 ] 36689 13.468% 90.202% ### ( 3, 4 ] 12393 4.549% 94.751% # ( 4, 6 ] 8568 3.145% 97.897% # ( 6, 10 ] 4491 1.649% 99.545% ( 10, 15 ] 368 0.135% 99.680% ( 15, 22 ] 42 0.015% 99.696% ( 22, 34 ] 6 0.002% 99.698% ( 34, 51 ] 2 0.001% 99.699% ( 51, 76 ] 1 0.000% 99.699% ( 76, 110 ] 133 0.049% 99.748% ( 110, 170 ] 291 0.107% 99.855% ( 170, 250 ] 146 0.054% 99.908% ( 250, 380 ] 83 0.030% 99.939% ( 380, 580 ] 87 0.032% 99.971% ( 580, 870 ] 59 0.022% 99.992% ( 870, 1300 ] 14 0.005% 99.997% ( 1300, 1900 ] 7 0.003% 100.000% ( 1900, 2900 ] 8 0.003% 100.003% ( 2900, 4400 ] 15 0.006% 100.008% ( 4400, 6600 ] 6 0.002% 100.011% ** Level 4 read latency histogram (micros): Count: 60 Average: 1355.1667 StdDev: 1685.57 Min: 1 Median: 315.0000 Max: 6252 Percentiles: P50: 315.00 P75: 2900.00 P99: 6252.00 P99.9: 6252.00 P99.99: 6252.00 ------------------------------------------------------ [ 0, 1 ] 10 16.667% 16.667% ### ( 1, 2 ] 6 10.000% 26.667% ## ( 2, 3 ] 2 3.333% 30.000% # ( 6, 10 ] 1 1.667% 31.667% ( 76, 110 ] 7 11.667% 43.333% ## ( 170, 250 ] 2 3.333% 46.667% # ( 250, 380 ] 4 6.667% 53.333% # ( 380, 580 ] 2 3.333% 56.667% # ( 580, 870 ] 2 3.333% 60.000% # ( 870, 1300 ] 2 3.333% 63.333% # ( 1300, 1900 ] 2 3.333% 66.667% # ( 1900, 2900 ] 5 8.333% 75.000% ## ( 2900, 4400 ] 11 18.333% 93.333% #### ( 4400, 6600 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 327.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.980 H:M:S, 10.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.411 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-09:19:08 ... thread 0: (1000000,4000000) ops and (318398.7,331600.3) ops/second in (3.140716,12.062714) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/8 3.30 GB 169.1 2.8 0.0 2.8 6.4 3.7 0.0 1.7 130.2 303.1 21.74 20.35 63 0.345 2873K 15K 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 256.9 255.8 0.98 0.95 1 0.979 255K 1032 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.2 2.3 247.7 246.9 1.24 1.20 3 0.415 312K 969 0.0 0.0 L3 20/0 977.87 MB 1.0 1.3 0.4 0.9 1.3 0.4 0.0 3.2 234.6 231.7 5.58 5.17 4 1.396 1330K 16K 0.0 0.0 L4 122/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 208.8 208.8 0.82 0.74 1 0.825 174K 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 267/8 22.88 GB 0.0 4.8 0.9 3.8 8.4 4.6 0.4 2.3 160.4 283.6 30.37 28.41 72 0.422 4947K 33K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 0.9 3.8 8.4 4.6 0.4 2.3 160.4 283.6 30.37 28.41 72 0.422 4947K 33K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 0.9 3.8 4.7 0.9 0.0 0.0 249.6 247.9 19.52 18.74 19 1.027 4947K 33K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 347.7 10.85 9.67 53 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 12.1 interval Flush(GB): cumulative 3.685, interval 3.685 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.41 GB write, 709.17 MB/s write, 4.76 GB read, 401.21 MB/s read, 30.4 seconds Interval compaction: 8.41 GB write, 713.78 MB/s write, 4.76 GB read, 403.82 MB/s read, 30.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 18, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1124662 Average: 2.4087 StdDev: 11.63 Min: 0 Median: 1.5540 Max: 3224 Percentiles: P50: 1.55 P75: 1.93 P99: 5.89 P99.9: 12.98 P99.99: 156.09 ------------------------------------------------------ [ 0, 1 ] 146635 13.038% 13.038% ### ( 1, 2 ] 750387 66.721% 79.759% ############# ( 2, 3 ] 148596 13.213% 92.972% ### ( 3, 4 ] 40774 3.625% 96.597% # ( 4, 6 ] 28525 2.536% 99.134% # ( 6, 10 ] 7927 0.705% 99.838% ( 10, 15 ] 1162 0.103% 99.942% ( 15, 22 ] 116 0.010% 99.952% ( 22, 34 ] 15 0.001% 99.953% ( 34, 51 ] 10 0.001% 99.954% ( 51, 76 ] 6 0.001% 99.955% ( 76, 110 ] 173 0.015% 99.970% ( 110, 170 ] 291 0.026% 99.996% ( 170, 250 ] 134 0.012% 100.008% ( 250, 380 ] 84 0.007% 100.015% ( 380, 580 ] 83 0.007% 100.023% ( 580, 870 ] 33 0.003% 100.026% ( 870, 1300 ] 22 0.002% 100.028% ( 1300, 1900 ] 7 0.001% 100.028% ( 1900, 2900 ] 8 0.001% 100.029% ( 2900, 4400 ] 2 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 63597 Average: 2.9246 StdDev: 14.58 Min: 1 Median: 1.7488 Max: 1602 Percentiles: P50: 1.75 P75: 2.45 P99: 8.21 P99.9: 77.25 P99.99: 817.84 ------------------------------------------------------ [ 0, 1 ] 2484 3.906% 3.906% # ( 1, 2 ] 39150 61.560% 65.465% ############ ( 2, 3 ] 13330 20.960% 86.425% #### ( 3, 4 ] 3934 6.186% 92.611% # ( 4, 6 ] 3623 5.697% 98.308% # ( 6, 10 ] 797 1.253% 99.561% ( 10, 15 ] 192 0.302% 99.863% ( 15, 22 ] 18 0.028% 99.892% ( 22, 34 ] 5 0.008% 99.899% ( 76, 110 ] 11 0.017% 99.917% ( 110, 170 ] 17 0.027% 99.943% ( 170, 250 ] 11 0.017% 99.961% ( 250, 380 ] 6 0.009% 99.970% ( 380, 580 ] 11 0.017% 99.987% ( 580, 870 ] 2 0.003% 99.991% ( 870, 1300 ] 5 0.008% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 86855 Average: 2.5154 StdDev: 14.34 Min: 1 Median: 1.4669 Max: 1293 Percentiles: P50: 1.47 P75: 1.88 P99: 6.98 P99.9: 84.71 P99.99: 412.86 ------------------------------------------------------ [ 0, 1 ] 18612 21.429% 21.429% #### ( 1, 2 ] 53150 61.194% 82.623% ############ ( 2, 3 ] 8789 10.119% 92.742% ## ( 3, 4 ] 3012 3.468% 96.210% # ( 4, 6 ] 2232 2.570% 98.780% # ( 6, 10 ] 785 0.904% 99.683% ( 10, 15 ] 121 0.139% 99.823% ( 15, 22 ] 22 0.025% 99.848% ( 22, 34 ] 2 0.002% 99.850% ( 34, 51 ] 2 0.002% 99.853% ( 51, 76 ] 35 0.040% 99.893% ( 76, 110 ] 24 0.028% 99.921% ( 110, 170 ] 19 0.022% 99.942% ( 170, 250 ] 20 0.023% 99.965% ( 250, 380 ] 20 0.023% 99.988% ( 380, 580 ] 8 0.009% 99.998% ( 580, 870 ] 8 0.009% 100.007% ( 870, 1300 ] 8 0.009% 100.016% ** Level 3 read latency histogram (micros): Count: 272411 Average: 3.5129 StdDev: 43.71 Min: 0 Median: 1.5999 Max: 6016 Percentiles: P50: 1.60 P75: 1.97 P99: 8.68 P99.9: 237.72 P99.99: 839.32 ------------------------------------------------------ [ 0, 1 ] 27023 9.920% 9.920% ## ( 1, 2 ] 182008 66.814% 76.734% ############# ( 2, 3 ] 36689 13.468% 90.202% ### ( 3, 4 ] 12393 4.549% 94.751% # ( 4, 6 ] 8568 3.145% 97.897% # ( 6, 10 ] 4491 1.649% 99.545% ( 10, 15 ] 368 0.135% 99.680% ( 15, 22 ] 42 0.015% 99.696% ( 22, 34 ] 6 0.002% 99.698% ( 34, 51 ] 2 0.001% 99.699% ( 51, 76 ] 1 0.000% 99.699% ( 76, 110 ] 133 0.049% 99.748% ( 110, 170 ] 291 0.107% 99.855% ( 170, 250 ] 146 0.054% 99.908% ( 250, 380 ] 83 0.030% 99.939% ( 380, 580 ] 87 0.032% 99.971% ( 580, 870 ] 59 0.022% 99.992% ( 870, 1300 ] 14 0.005% 99.997% ( 1300, 1900 ] 7 0.003% 100.000% ( 1900, 2900 ] 8 0.003% 100.003% ( 2900, 4400 ] 15 0.006% 100.008% ( 4400, 6600 ] 6 0.002% 100.011% ** Level 4 read latency histogram (micros): Count: 60 Average: 1355.1667 StdDev: 1685.57 Min: 1 Median: 315.0000 Max: 6252 Percentiles: P50: 315.00 P75: 2900.00 P99: 6252.00 P99.9: 6252.00 P99.99: 6252.00 ------------------------------------------------------ [ 0, 1 ] 10 16.667% 16.667% ### ( 1, 2 ] 6 10.000% 26.667% ## ( 2, 3 ] 2 3.333% 30.000% # ( 6, 10 ] 1 1.667% 31.667% ( 76, 110 ] 7 11.667% 43.333% ## ( 170, 250 ] 2 3.333% 46.667% # ( 250, 380 ] 4 6.667% 53.333% # ( 380, 580 ] 2 3.333% 56.667% # ( 580, 870 ] 2 3.333% 60.000% # ( 870, 1300 ] 2 3.333% 63.333% # ( 1300, 1900 ] 2 3.333% 66.667% # ( 1900, 2900 ] 5 8.333% 75.000% ## ( 2900, 4400 ] 11 18.333% 93.333% #### ( 4400, 6600 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.415 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 313.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.435 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-09:19:12 ... thread 0: (1000000,5000000) ops and (257445.8,313538.1) ops/second in (3.884312,15.947026) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.69 GB 250.4 3.6 0.0 3.6 8.3 4.7 0.0 1.7 131.2 304.6 27.81 26.05 81 0.343 3704K 19K 0.0 0.0 L1 16/0 1.59 GB 163.0 1.9 1.9 0.0 1.8 1.8 0.1 1.0 233.5 226.2 8.31 7.94 2 4.156 1971K 61K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.2 2.3 247.7 246.9 1.24 1.20 3 0.415 312K 969 0.0 0.0 L3 20/0 977.87 MB 1.0 1.3 0.4 0.9 1.3 0.4 0.0 3.2 234.6 231.7 5.58 5.17 4 1.396 1330K 16K 0.0 0.0 L4 122/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 208.8 208.8 0.82 0.74 1 0.825 174K 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 281/4 23.86 GB 0.0 7.2 2.6 4.6 11.8 7.2 0.4 2.5 168.6 277.0 43.77 41.10 91 0.481 7494K 98K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.2 2.6 4.6 11.8 7.2 0.4 2.5 168.6 277.0 43.77 41.10 91 0.481 7494K 98K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.2 2.6 4.6 7.1 2.5 0.0 0.0 246.7 243.4 29.91 28.73 23 1.300 7494K 98K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 349.4 13.86 12.36 68 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.0 total, 15.9 interval Flush(GB): cumulative 4.729, interval 4.729 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.84 GB write, 756.43 MB/s write, 7.21 GB read, 460.42 MB/s read, 43.8 seconds Interval compaction: 11.84 GB write, 760.15 MB/s write, 7.21 GB read, 462.68 MB/s read, 43.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 22, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 22, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1489275 Average: 2.3613 StdDev: 12.49 Min: 0 Median: 1.5253 Max: 3555 Percentiles: P50: 1.53 P75: 1.90 P99: 5.85 P99.9: 12.98 P99.99: 162.37 ------------------------------------------------------ [ 0, 1 ] 222812 14.961% 14.961% ### ( 1, 2 ] 993427 66.705% 81.667% ############# ( 2, 3 ] 178588 11.992% 93.658% ## ( 3, 4 ] 48776 3.275% 96.933% # ( 4, 6 ] 33234 2.232% 99.165% ( 6, 10 ] 10094 0.678% 99.843% ( 10, 15 ] 1432 0.096% 99.939% ( 15, 22 ] 160 0.011% 99.950% ( 22, 34 ] 18 0.001% 99.951% ( 34, 51 ] 13 0.001% 99.952% ( 51, 76 ] 7 0.000% 99.952% ( 76, 110 ] 236 0.016% 99.968% ( 110, 170 ] 377 0.025% 99.993% ( 170, 250 ] 164 0.011% 100.004% ( 250, 380 ] 109 0.007% 100.012% ( 380, 580 ] 111 0.007% 100.019% ( 580, 870 ] 44 0.003% 100.022% ( 870, 1300 ] 28 0.002% 100.024% ( 1300, 1900 ] 8 0.001% 100.024% ( 1900, 2900 ] 11 0.001% 100.025% ( 2900, 4400 ] 5 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 63677 Average: 3.4284 StdDev: 31.92 Min: 0 Median: 1.7491 Max: 3849 Percentiles: P50: 1.75 P75: 2.46 P99: 8.44 P99.9: 193.06 P99.99: 1615.88 ------------------------------------------------------ [ 0, 1 ] 2503 3.931% 3.931% # ( 1, 2 ] 39163 61.503% 65.433% ############ ( 2, 3 ] 13331 20.935% 86.369% #### ( 3, 4 ] 3934 6.178% 92.547% # ( 4, 6 ] 3623 5.690% 98.236% # ( 6, 10 ] 797 1.252% 99.488% ( 10, 15 ] 193 0.303% 99.791% ( 15, 22 ] 18 0.028% 99.819% ( 22, 34 ] 5 0.008% 99.827% ( 76, 110 ] 17 0.027% 99.854% ( 110, 170 ] 25 0.039% 99.893% ( 170, 250 ] 15 0.024% 99.917% ( 250, 380 ] 12 0.019% 99.936% ( 380, 580 ] 16 0.025% 99.961% ( 580, 870 ] 4 0.006% 99.967% ( 870, 1300 ] 12 0.019% 99.986% ( 1300, 1900 ] 5 0.008% 99.994% ( 1900, 2900 ] 3 0.005% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 86855 Average: 2.5154 StdDev: 14.34 Min: 1 Median: 1.4669 Max: 1293 Percentiles: P50: 1.47 P75: 1.88 P99: 6.98 P99.9: 84.71 P99.99: 412.86 ------------------------------------------------------ [ 0, 1 ] 18612 21.429% 21.429% #### ( 1, 2 ] 53150 61.194% 82.623% ############ ( 2, 3 ] 8789 10.119% 92.742% ## ( 3, 4 ] 3012 3.468% 96.210% # ( 4, 6 ] 2232 2.570% 98.780% # ( 6, 10 ] 785 0.904% 99.683% ( 10, 15 ] 121 0.139% 99.823% ( 15, 22 ] 22 0.025% 99.848% ( 22, 34 ] 2 0.002% 99.850% ( 34, 51 ] 2 0.002% 99.853% ( 51, 76 ] 35 0.040% 99.893% ( 76, 110 ] 24 0.028% 99.921% ( 110, 170 ] 19 0.022% 99.942% ( 170, 250 ] 20 0.023% 99.965% ( 250, 380 ] 20 0.023% 99.988% ( 380, 580 ] 8 0.009% 99.998% ( 580, 870 ] 8 0.009% 100.007% ( 870, 1300 ] 8 0.009% 100.016% ** Level 3 read latency histogram (micros): Count: 272411 Average: 3.5129 StdDev: 43.71 Min: 0 Median: 1.5999 Max: 6016 Percentiles: P50: 1.60 P75: 1.97 P99: 8.68 P99.9: 237.72 P99.99: 839.32 ------------------------------------------------------ [ 0, 1 ] 27023 9.920% 9.920% ## ( 1, 2 ] 182008 66.814% 76.734% ############# ( 2, 3 ] 36689 13.468% 90.202% ### ( 3, 4 ] 12393 4.549% 94.751% # ( 4, 6 ] 8568 3.145% 97.897% # ( 6, 10 ] 4491 1.649% 99.545% ( 10, 15 ] 368 0.135% 99.680% ( 15, 22 ] 42 0.015% 99.696% ( 22, 34 ] 6 0.002% 99.698% ( 34, 51 ] 2 0.001% 99.699% ( 51, 76 ] 1 0.000% 99.699% ( 76, 110 ] 133 0.049% 99.748% ( 110, 170 ] 291 0.107% 99.855% ( 170, 250 ] 146 0.054% 99.908% ( 250, 380 ] 83 0.030% 99.939% ( 380, 580 ] 87 0.032% 99.971% ( 580, 870 ] 59 0.022% 99.992% ( 870, 1300 ] 14 0.005% 99.997% ( 1300, 1900 ] 7 0.003% 100.000% ( 1900, 2900 ] 8 0.003% 100.003% ( 2900, 4400 ] 15 0.006% 100.008% ( 4400, 6600 ] 6 0.002% 100.011% ** Level 4 read latency histogram (micros): Count: 60 Average: 1355.1667 StdDev: 1685.57 Min: 1 Median: 315.0000 Max: 6252 Percentiles: P50: 315.00 P75: 2900.00 P99: 6252.00 P99.9: 6252.00 P99.99: 6252.00 ------------------------------------------------------ [ 0, 1 ] 10 16.667% 16.667% ### ( 1, 2 ] 6 10.000% 26.667% ## ( 2, 3 ] 2 3.333% 30.000% # ( 6, 10 ] 1 1.667% 31.667% ( 76, 110 ] 7 11.667% 43.333% ## ( 170, 250 ] 2 3.333% 46.667% # ( 250, 380 ] 4 6.667% 53.333% # ( 380, 580 ] 2 3.333% 56.667% # ( 580, 870 ] 2 3.333% 60.000% # ( 870, 1300 ] 2 3.333% 63.333% # ( 1300, 1900 ] 2 3.333% 66.667% # ( 1900, 2900 ] 5 8.333% 75.000% ## ( 2900, 4400 ] 11 18.333% 93.333% #### ( 4400, 6600 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 16.0 total, 3.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 307.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.634 H:M:S, 16.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 253.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.219 H:M:S, 31.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-09:19:15 ... thread 0: (1000000,6000000) ops and (356274.1,319934.2) ops/second in (2.806828,18.753854) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/19 3.55 GB 0.0 4.4 0.0 4.4 9.9 5.6 0.0 1.8 133.9 304.8 33.35 31.29 97 0.344 4534K 24K 0.0 0.0 L1 16/16 1.59 GB 0.0 1.9 1.9 0.0 1.8 1.8 0.1 1.0 233.5 226.2 8.31 7.94 2 4.156 1971K 61K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.1 0.2 0.3 0.1 0.2 2.3 247.7 246.9 1.24 1.20 3 0.415 312K 969 0.0 0.0 L3 20/0 977.87 MB 1.0 1.3 0.4 0.9 1.3 0.4 0.0 3.2 234.6 231.7 5.58 5.17 4 1.396 1330K 16K 0.0 0.0 L4 122/0 9.76 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 208.8 208.8 0.82 0.74 1 0.825 174K 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 285/35 24.72 GB 0.0 8.0 2.6 5.4 13.5 8.1 0.4 2.4 166.2 280.2 49.31 46.33 107 0.461 8324K 102K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.0 2.6 5.4 13.5 8.1 0.4 2.4 166.2 280.2 49.31 46.33 107 0.461 8324K 102K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.0 2.6 5.4 7.9 2.5 0.0 0.0 248.4 245.3 33.00 31.77 26 1.269 8324K 102K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 350.9 16.31 14.56 81 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.8 total, 18.8 interval Flush(GB): cumulative 5.589, interval 5.589 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.49 GB write, 733.63 MB/s write, 8.00 GB read, 435.21 MB/s read, 49.3 seconds Interval compaction: 13.49 GB write, 736.71 MB/s write, 8.00 GB read, 437.03 MB/s read, 49.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 25, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1692580 Average: 2.3762 StdDev: 13.17 Min: 0 Median: 1.5085 Max: 3555 Percentiles: P50: 1.51 P75: 1.88 P99: 5.81 P99.9: 14.38 P99.99: 191.92 ------------------------------------------------------ [ 0, 1 ] 272761 16.115% 16.115% ### ( 1, 2 ] 1127899 66.638% 82.753% ############# ( 2, 3 ] 190390 11.249% 94.001% ## ( 3, 4 ] 52785 3.119% 97.120% # ( 4, 6 ] 35067 2.072% 99.192% ( 6, 10 ] 10605 0.627% 99.818% ( 10, 15 ] 1578 0.093% 99.912% ( 15, 22 ] 176 0.010% 99.922% ( 22, 34 ] 22 0.001% 99.923% ( 34, 51 ] 14 0.001% 99.924% ( 51, 76 ] 8 0.000% 99.925% ( 76, 110 ] 328 0.019% 99.944% ( 110, 170 ] 719 0.042% 99.987% ( 170, 250 ] 218 0.013% 99.999% ( 250, 380 ] 146 0.009% 100.008% ( 380, 580 ] 148 0.009% 100.017% ( 580, 870 ] 55 0.003% 100.020% ( 870, 1300 ] 32 0.002% 100.022% ( 1300, 1900 ] 13 0.001% 100.023% ( 1900, 2900 ] 12 0.001% 100.023% ( 2900, 4400 ] 6 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 75531 Average: 3.3679 StdDev: 29.89 Min: 0 Median: 1.6993 Max: 3849 Percentiles: P50: 1.70 P75: 2.34 P99: 8.61 P99.9: 172.08 P99.99: 1473.63 ------------------------------------------------------ [ 0, 1 ] 5204 6.890% 6.890% # ( 1, 2 ] 46565 61.650% 68.540% ############ ( 2, 3 ] 14168 18.758% 87.298% #### ( 3, 4 ] 4383 5.803% 93.101% # ( 4, 6 ] 3831 5.072% 98.173% # ( 6, 10 ] 956 1.266% 99.439% ( 10, 15 ] 209 0.277% 99.715% ( 15, 22 ] 22 0.029% 99.744% ( 22, 34 ] 6 0.008% 99.752% ( 76, 110 ] 36 0.048% 99.800% ( 110, 170 ] 75 0.099% 99.899% ( 170, 250 ] 18 0.024% 99.923% ( 250, 380 ] 15 0.020% 99.943% ( 380, 580 ] 17 0.023% 99.966% ( 580, 870 ] 4 0.005% 99.971% ( 870, 1300 ] 13 0.017% 99.988% ( 1300, 1900 ] 5 0.007% 99.995% ( 1900, 2900 ] 3 0.004% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 86855 Average: 2.5154 StdDev: 14.34 Min: 1 Median: 1.4669 Max: 1293 Percentiles: P50: 1.47 P75: 1.88 P99: 6.98 P99.9: 84.71 P99.99: 412.86 ------------------------------------------------------ [ 0, 1 ] 18612 21.429% 21.429% #### ( 1, 2 ] 53150 61.194% 82.623% ############ ( 2, 3 ] 8789 10.119% 92.742% ## ( 3, 4 ] 3012 3.468% 96.210% # ( 4, 6 ] 2232 2.570% 98.780% # ( 6, 10 ] 785 0.904% 99.683% ( 10, 15 ] 121 0.139% 99.823% ( 15, 22 ] 22 0.025% 99.848% ( 22, 34 ] 2 0.002% 99.850% ( 34, 51 ] 2 0.002% 99.853% ( 51, 76 ] 35 0.040% 99.893% ( 76, 110 ] 24 0.028% 99.921% ( 110, 170 ] 19 0.022% 99.942% ( 170, 250 ] 20 0.023% 99.965% ( 250, 380 ] 20 0.023% 99.988% ( 380, 580 ] 8 0.009% 99.998% ( 580, 870 ] 8 0.009% 100.007% ( 870, 1300 ] 8 0.009% 100.016% ** Level 3 read latency histogram (micros): Count: 272411 Average: 3.5129 StdDev: 43.71 Min: 0 Median: 1.5999 Max: 6016 Percentiles: P50: 1.60 P75: 1.97 P99: 8.68 P99.9: 237.72 P99.99: 839.32 ------------------------------------------------------ [ 0, 1 ] 27023 9.920% 9.920% ## ( 1, 2 ] 182008 66.814% 76.734% ############# ( 2, 3 ] 36689 13.468% 90.202% ### ( 3, 4 ] 12393 4.549% 94.751% # ( 4, 6 ] 8568 3.145% 97.897% # ( 6, 10 ] 4491 1.649% 99.545% ( 10, 15 ] 368 0.135% 99.680% ( 15, 22 ] 42 0.015% 99.696% ( 22, 34 ] 6 0.002% 99.698% ( 34, 51 ] 2 0.001% 99.699% ( 51, 76 ] 1 0.000% 99.699% ( 76, 110 ] 133 0.049% 99.748% ( 110, 170 ] 291 0.107% 99.855% ( 170, 250 ] 146 0.054% 99.908% ( 250, 380 ] 83 0.030% 99.939% ( 380, 580 ] 87 0.032% 99.971% ( 580, 870 ] 59 0.022% 99.992% ( 870, 1300 ] 14 0.005% 99.997% ( 1300, 1900 ] 7 0.003% 100.000% ( 1900, 2900 ] 8 0.003% 100.003% ( 2900, 4400 ] 15 0.006% 100.008% ( 4400, 6600 ] 6 0.002% 100.011% ** Level 4 read latency histogram (micros): Count: 60 Average: 1355.1667 StdDev: 1685.57 Min: 1 Median: 315.0000 Max: 6252 Percentiles: P50: 315.00 P75: 2900.00 P99: 6252.00 P99.9: 6252.00 P99.99: 6252.00 ------------------------------------------------------ [ 0, 1 ] 10 16.667% 16.667% ### ( 1, 2 ] 6 10.000% 26.667% ## ( 2, 3 ] 2 3.333% 30.000% # ( 6, 10 ] 1 1.667% 31.667% ( 76, 110 ] 7 11.667% 43.333% ## ( 170, 250 ] 2 3.333% 46.667% # ( 250, 380 ] 4 6.667% 53.333% # ( 380, 580 ] 2 3.333% 56.667% # ( 580, 870 ] 2 3.333% 60.000% # ( 870, 1300 ] 2 3.333% 63.333% # ( 1300, 1900 ] 2 3.333% 66.667% # ( 1900, 2900 ] 5 8.333% 75.000% ## ( 2900, 4400 ] 11 18.333% 93.333% #### ( 4400, 6600 ] 4 6.667% 100.000% # ** DB Stats ** Uptime(secs): 18.8 total, 2.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 313.53 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.849 H:M:S, 15.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 350.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.215 H:M:S, 7.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.261 micros/op 306663 ops/sec 20.074 seconds 6155999 operations; 297.1 MB/s Microseconds per write: Count: 6155999 Average: 3.2609 StdDev: 249.35 Min: 0 Median: 1.7283 Max: 212756 Percentiles: P50: 1.73 P75: 2.68 P99: 6.32 P99.9: 87.43 P99.99: 1158.67 ------------------------------------------------------ [ 0, 1 ] 788607 12.810% 12.810% ### ( 1, 2 ] 3143542 51.065% 63.875% ########## ( 2, 3 ] 999860 16.242% 80.117% ### ( 3, 4 ] 853957 13.872% 93.989% ### ( 4, 6 ] 305124 4.957% 98.946% # ( 6, 10 ] 41499 0.674% 99.620% ( 10, 15 ] 10881 0.177% 99.796% ( 15, 22 ] 4058 0.066% 99.862% ( 22, 34 ] 725 0.012% 99.874% ( 34, 51 ] 95 0.002% 99.876% ( 51, 76 ] 10 0.000% 99.876% ( 76, 110 ] 4418 0.072% 99.948% ( 110, 170 ] 1604 0.026% 99.974% ( 170, 250 ] 165 0.003% 99.976% ( 250, 380 ] 45 0.001% 99.977% ( 380, 580 ] 8 0.000% 99.977% ( 580, 870 ] 6 0.000% 99.977% ( 870, 1300 ] 1161 0.019% 99.996% ( 1300, 1900 ] 3 0.000% 99.996% ( 1900, 2900 ] 212 0.003% 100.000% ( 2900, 4400 ] 2 0.000% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 9 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 151656 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6155999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6352990968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 179 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3709912 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9372192655 rocksdb.compact.write.bytes COUNT : 9216212255 rocksdb.flush.write.bytes COUNT : 6264825126 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 10 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 108 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6224805888 rocksdb.memtable.garbage.bytes.at.flush COUNT : 12062720 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 9419664720 rocksdb.non.last.level.read.count COUNT : 2271534 rocksdb.block.checksum.compute.count COUNT : 2271186 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.361820 P95 : 3.786034 P99 : 5.788749 P100 : 212750.000000 COUNT : 6155999 SUM : 17235910 rocksdb.compaction.times.micros P50 : 1019375.000000 P95 : 3810000.000000 P99 : 7333247.000000 P100 : 7333247.000000 COUNT : 27 SUM : 33958972 rocksdb.compaction.times.cpu_micros P50 : 998125.000000 P95 : 3810000.000000 P99 : 6982061.000000 P100 : 6982061.000000 COUNT : 27 SUM : 32711442 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 797.500000 P95 : 1498.000000 P99 : 1498.000000 P100 : 1498.000000 COUNT : 85 SUM : 69461 rocksdb.compaction.outfile.sync.micros P50 : 797.500000 P95 : 1442.500000 P99 : 2033.000000 P100 : 2033.000000 COUNT : 81 SUM : 68215 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 89.761905 P95 : 245.428571 P99 : 374.800000 P100 : 2179.000000 COUNT : 116 SUM : 14862 rocksdb.table.open.io.micros P50 : 1262.375000 P95 : 14044.444444 P99 : 17651.000000 P100 : 17651.000000 COUNT : 179 SUM : 448838 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.586691 P95 : 5.954242 P99 : 9.602210 P100 : 4575.000000 COUNT : 2270872 SUM : 10323101 rocksdb.read.block.get.micros P50 : 481.587302 P95 : 3907.142857 P99 : 5884.000000 P100 : 6357.000000 COUNT : 358 SUM : 334598 rocksdb.write.raw.block.micros P50 : 0.510498 P95 : 0.969947 P99 : 2.754370 P100 : 2524.000000 COUNT : 3763164 SUM : 6948169 rocksdb.numfiles.in.singlecompaction P50 : 3.352941 P95 : 9.200000 P99 : 30.160000 P100 : 31.000000 COUNT : 32 SUM : 150 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561847 P95 : 1148.539519 P99 : 2381.132075 P100 : 212519.000000 COUNT : 12800 SUM : 3711318 rocksdb.sst.read.micros P50 : 1.524448 P95 : 3.505888 P99 : 6.202360 P100 : 6252.000000 COUNT : 2271873 SUM : 5871438 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6155999 SUM : 6352990968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211230.769231 P95 : 329772.727273 P99 : 369954.545455 P100 : 371765.000000 COUNT : 85 SUM : 17034671 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 112 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0