[2024-12-10 03:56:27.686967] Starting SPDK v25.01-pre git sha1 1ae735a5d / DPDK 24.03.0 initialization... [2024-12-10 03:56:27.687245] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2554237 ] Set seed to 1733799387680166 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-10 03:56:27.825548] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-10 03:56:27.935141] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-10 03:56:27.935188] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2554237' to capture a snapshot of events at runtime. [2024-12-10 03:56:27.935198] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-10 03:56:27.935208] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-10 03:56:27.935216] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2554237 for offline analysis/debug. [2024-12-10 03:56:27.936622] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Dec 10 03:56:33 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/10-03:56:36 ... thread 0: (1000000,1000000) ops and (364038.1,364038.1) ops/second in (2.746965,2.746965) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 566.23 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 357.4 2.29 2.06 12 0.191 0 0 0.0 0.0 L2 3/2 250.36 MB 0.1 0.4 0.2 0.2 0.4 0.2 0.1 2.0 254.3 253.6 1.48 1.44 2 0.741 382K 1049 0.0 0.0 L3 9/0 790.74 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 245/8 20.02 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.8 1.5 100.0 316.6 3.77 3.50 14 0.269 382K 1049 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.7 1.5 100.0 316.6 3.77 3.50 14 0.269 382K 1049 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 254.3 253.6 1.48 1.44 2 0.741 382K 1049 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 357.4 2.29 2.06 12 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.9 total, 2.8 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 418.49 MB/s write, 0.37 GB read, 132.19 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 434.04 MB/s write, 0.37 GB read, 137.10 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 101112 Average: 1.9506 StdDev: 14.36 Min: 1 Median: 1.3024 Max: 3237 Percentiles: P50: 1.30 P75: 1.71 P99: 4.13 P99.9: 9.85 P99.99: 424.44 ------------------------------------------------------ [ 0, 1 ] 31681 31.333% 31.333% ###### ( 1, 2 ] 62419 61.733% 93.065% ############ ( 2, 3 ] 4366 4.318% 97.383% # ( 3, 4 ] 1589 1.572% 98.955% ( 4, 6 ] 723 0.715% 99.670% ( 6, 10 ] 243 0.240% 99.910% ( 10, 15 ] 57 0.056% 99.966% ( 15, 22 ] 8 0.008% 99.974% ( 22, 34 ] 1 0.001% 99.975% ( 51, 76 ] 2 0.002% 99.977% ( 110, 170 ] 6 0.006% 99.983% ( 170, 250 ] 5 0.005% 99.988% ( 250, 380 ] 2 0.002% 99.990% ( 380, 580 ] 4 0.004% 99.994% ( 580, 870 ] 2 0.002% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 3 0.003% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 51575 Average: 2.4992 StdDev: 50.06 Min: 0 Median: 1.3471 Max: 6563 Percentiles: P50: 1.35 P75: 1.74 P99: 5.30 P99.9: 11.63 P99.99: 1852.72 ------------------------------------------------------ [ 0, 1 ] 14494 28.103% 28.103% ###### ( 1, 2 ] 32542 63.096% 91.199% ############# ( 2, 3 ] 2611 5.063% 96.262% # ( 3, 4 ] 1020 1.978% 98.239% ( 4, 6 ] 606 1.175% 99.414% ( 6, 10 ] 240 0.465% 99.880% ( 10, 15 ] 35 0.068% 99.948% ( 15, 22 ] 8 0.016% 99.963% ( 22, 34 ] 1 0.002% 99.965% ( 34, 51 ] 2 0.004% 99.969% ( 51, 76 ] 1 0.002% 99.971% ( 170, 250 ] 2 0.004% 99.975% ( 250, 380 ] 4 0.008% 99.983% ( 870, 1300 ] 3 0.006% 99.988% ( 1300, 1900 ] 2 0.004% 99.992% ( 1900, 2900 ] 1 0.002% 99.994% ( 4400, 6600 ] 4 0.008% 100.002% ** Level 3 read latency histogram (micros): Count: 55 Average: 3442.6000 StdDev: 2291.35 Min: 63 Median: 3212.5000 Max: 8910 Percentiles: P50: 3212.50 P75: 5119.23 P99: 8910.00 P99.9: 8910.00 P99.99: 8910.00 ------------------------------------------------------ ( 51, 76 ] 1 1.818% 1.818% ( 110, 170 ] 2 3.636% 5.455% # ( 380, 580 ] 2 3.636% 9.091% # ( 580, 870 ] 3 5.455% 14.545% # ( 870, 1300 ] 3 5.455% 20.000% # ( 1300, 1900 ] 4 7.273% 27.273% # ( 1900, 2900 ] 10 18.182% 45.455% #### ( 2900, 4400 ] 12 21.818% 67.273% #### ( 4400, 6600 ] 13 23.636% 90.909% ##### ( 6600, 9900 ] 5 9.091% 100.000% ## ** Level 4 read latency histogram (micros): Count: 15 Average: 2987.9333 StdDev: 2169.49 Min: 134 Median: 2733.3333 Max: 6505 Percentiles: P50: 2733.33 P75: 4950.00 P99: 6505.00 P99.9: 6505.00 P99.99: 6505.00 ------------------------------------------------------ ( 110, 170 ] 1 6.667% 6.667% # ( 170, 250 ] 1 6.667% 13.333% # ( 380, 580 ] 1 6.667% 20.000% # ( 870, 1300 ] 2 13.333% 33.333% ### ( 1900, 2900 ] 3 20.000% 53.333% #### ( 2900, 4400 ] 2 13.333% 66.667% ### ( 4400, 6600 ] 5 33.333% 100.000% ####### ** Level 5 read latency histogram (micros): Count: 20 Average: 591.6500 StdDev: 693.39 Min: 85 Median: 162.5000 Max: 2104 Percentiles: P50: 162.50 P75: 797.50 P99: 2104.00 P99.9: 2104.00 P99.99: 2104.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 8 40.000% 55.000% ######## ( 170, 250 ] 1 5.000% 60.000% # ( 580, 870 ] 4 20.000% 80.000% #### ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 2.9 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 345.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.193 H:M:S, 6.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 357.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.193 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/10-03:56:39 ... thread 0: (1000000,2000000) ops and (327716.0,344923.5) ops/second in (3.051423,5.798388) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 1.17 GB 12.6 0.2 0.0 0.2 2.0 1.8 0.0 1.1 41.3 340.6 6.09 5.52 27 0.226 255K 1173 0.0 0.0 L1 1/1 15.11 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 244.4 242.3 1.54 1.50 1 1.545 383K 3105 0.0 0.0 L2 2/2 138.92 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.4 2.0 254.3 253.6 1.48 1.44 2 0.741 382K 1049 0.0 0.0 L3 18/15 1.12 GB 0.2 0.4 0.3 0.0 0.4 0.3 0.3 1.1 227.7 227.2 1.70 1.62 3 0.567 393K 779 0.0 0.0 L4 122/0 9.71 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 211.0 211.0 0.55 0.50 1 0.545 116K 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 265/30 21.00 GB 0.0 1.5 1.0 0.5 3.2 2.8 1.6 1.8 132.7 292.7 11.37 10.57 34 0.334 1532K 6106 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 1.0 0.5 3.2 2.8 1.4 1.8 132.7 292.7 11.37 10.57 34 0.334 1532K 6106 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 1.0 0.5 1.5 1.0 0.0 0.0 241.9 240.9 6.24 6.00 8 0.780 1532K 6106 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 355.6 5.13 4.57 26 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.8 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.25 GB write, 563.46 MB/s write, 1.47 GB read, 255.57 MB/s read, 11.4 seconds Interval compaction: 3.25 GB write, 573.38 MB/s write, 1.47 GB read, 260.07 MB/s read, 11.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 338891 Average: 2.5698 StdDev: 15.37 Min: 1 Median: 1.5960 Max: 3567 Percentiles: P50: 1.60 P75: 2.00 P99: 5.97 P99.9: 14.10 P99.99: 247.15 ------------------------------------------------------ [ 0, 1 ] 44710 13.193% 13.193% ### ( 1, 2 ] 209294 61.759% 74.952% ############ ( 2, 3 ] 54594 16.110% 91.061% ### ( 3, 4 ] 14977 4.419% 95.481% # ( 4, 6 ] 12117 3.575% 99.056% # ( 6, 10 ] 2415 0.713% 99.769% ( 10, 15 ] 543 0.160% 99.929% ( 15, 22 ] 52 0.015% 99.944% ( 22, 34 ] 8 0.002% 99.947% ( 34, 51 ] 1 0.000% 99.947% ( 51, 76 ] 3 0.001% 99.948% ( 76, 110 ] 19 0.006% 99.953% ( 110, 170 ] 73 0.022% 99.975% ( 170, 250 ] 53 0.016% 99.991% ( 250, 380 ] 32 0.009% 100.000% ( 380, 580 ] 35 0.010% 100.010% ( 580, 870 ] 27 0.008% 100.018% ( 870, 1300 ] 7 0.002% 100.020% ( 1300, 1900 ] 6 0.002% 100.022% ( 1900, 2900 ] 1 0.000% 100.022% ( 2900, 4400 ] 2 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 54365 Average: 2.9886 StdDev: 13.96 Min: 1 Median: 1.8111 Max: 1609 Percentiles: P50: 1.81 P75: 2.56 P99: 7.86 P99.9: 126.91 P99.99: 572.06 ------------------------------------------------------ [ 0, 1 ] 1876 3.451% 3.451% # ( 1, 2 ] 31200 57.390% 60.841% ########### ( 2, 3 ] 13811 25.404% 86.245% ##### ( 3, 4 ] 3554 6.537% 92.782% # ( 4, 6 ] 3065 5.638% 98.420% # ( 6, 10 ] 679 1.249% 99.669% ( 10, 15 ] 94 0.173% 99.842% ( 15, 22 ] 12 0.022% 99.864% ( 22, 34 ] 1 0.002% 99.866% ( 34, 51 ] 1 0.002% 99.868% ( 76, 110 ] 12 0.022% 99.890% ( 110, 170 ] 20 0.037% 99.926% ( 170, 250 ] 17 0.031% 99.958% ( 250, 380 ] 7 0.013% 99.971% ( 380, 580 ] 11 0.020% 99.991% ( 580, 870 ] 1 0.002% 99.993% ( 870, 1300 ] 2 0.004% 99.996% ( 1300, 1900 ] 2 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 94427 Average: 2.5571 StdDev: 37.56 Min: 0 Median: 1.4936 Max: 6563 Percentiles: P50: 1.49 P75: 1.88 P99: 5.77 P99.9: 13.60 P99.99: 1037.41 ------------------------------------------------------ [ 0, 1 ] 17223 18.239% 18.239% #### ( 1, 2 ] 60761 64.347% 82.587% ############# ( 2, 3 ] 10286 10.893% 93.480% ## ( 3, 4 ] 3147 3.333% 96.812% # ( 4, 6 ] 2328 2.465% 99.278% ( 6, 10 ] 535 0.567% 99.844% ( 10, 15 ] 73 0.077% 99.922% ( 15, 22 ] 10 0.011% 99.932% ( 22, 34 ] 1 0.001% 99.933% ( 34, 51 ] 3 0.003% 99.936% ( 51, 76 ] 2 0.002% 99.939% ( 76, 110 ] 7 0.007% 99.946% ( 110, 170 ] 15 0.016% 99.962% ( 170, 250 ] 12 0.013% 99.975% ( 250, 380 ] 6 0.006% 99.981% ( 380, 580 ] 5 0.005% 99.986% ( 580, 870 ] 2 0.002% 99.988% ( 870, 1300 ] 4 0.004% 99.993% ( 1300, 1900 ] 2 0.002% 99.995% ( 1900, 2900 ] 1 0.001% 99.996% ( 4400, 6600 ] 4 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 188046 Average: 4.4755 StdDev: 74.26 Min: 1 Median: 1.7100 Max: 8910 Percentiles: P50: 1.71 P75: 2.38 P99: 9.16 P99.9: 294.17 P99.99: 824.50 ------------------------------------------------------ [ 0, 1 ] 13961 7.424% 7.424% # ( 1, 2 ] 112765 59.967% 67.391% ############ ( 2, 3 ] 37810 20.107% 87.498% #### ( 3, 4 ] 10394 5.527% 93.025% # ( 4, 6 ] 8810 4.685% 97.710% # ( 6, 10 ] 3067 1.631% 99.341% ( 10, 15 ] 501 0.266% 99.608% ( 15, 22 ] 65 0.035% 99.642% ( 22, 34 ] 6 0.003% 99.645% ( 34, 51 ] 2 0.001% 99.646% ( 51, 76 ] 12 0.006% 99.653% ( 76, 110 ] 79 0.042% 99.695% ( 110, 170 ] 214 0.114% 99.809% ( 170, 250 ] 139 0.074% 99.882% ( 250, 380 ] 97 0.052% 99.934% ( 380, 580 ] 74 0.039% 99.973% ( 580, 870 ] 37 0.020% 99.993% ( 870, 1300 ] 11 0.006% 99.999% ( 1300, 1900 ] 8 0.004% 100.003% ( 1900, 2900 ] 13 0.007% 100.010% ( 2900, 4400 ] 13 0.007% 100.017% ( 4400, 6600 ] 13 0.007% 100.024% ( 6600, 9900 ] 5 0.003% 100.027% ** Level 4 read latency histogram (micros): Count: 45 Average: 1018.2222 StdDev: 1874.77 Min: 1 Median: 23.2000 Max: 6505 Percentiles: P50: 23.20 P75: 1031.25 P99: 6402.00 P99.9: 6505.00 P99.99: 6505.00 ------------------------------------------------------ [ 0, 1 ] 9 20.000% 20.000% #### ( 1, 2 ] 9 20.000% 40.000% #### ( 4, 6 ] 1 2.222% 42.222% ( 6, 10 ] 1 2.222% 44.444% ( 10, 15 ] 1 2.222% 46.667% ( 15, 22 ] 1 2.222% 48.889% ( 22, 34 ] 5 11.111% 60.000% ## ( 51, 76 ] 1 2.222% 62.222% ( 110, 170 ] 1 2.222% 64.444% ( 170, 250 ] 2 4.444% 68.889% # ( 380, 580 ] 2 4.444% 73.333% # ( 870, 1300 ] 2 4.444% 77.778% # ( 1900, 2900 ] 3 6.667% 84.444% # ( 2900, 4400 ] 2 4.444% 88.889% # ( 4400, 6600 ] 5 11.111% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 591.6500 StdDev: 693.39 Min: 85 Median: 162.5000 Max: 2104 Percentiles: P50: 162.50 P75: 797.50 P99: 2104.00 P99.9: 2104.00 P99.99: 2104.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 8 40.000% 55.000% ######## ( 170, 250 ] 1 5.000% 60.000% # ( 580, 870 ] 4 20.000% 80.000% #### ( 1300, 1900 ] 2 10.000% 90.000% ## ( 1900, 2900 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 5.9 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 333.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.581 H:M:S, 9.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.388 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/10-03:56:42 ... thread 0: (1000000,3000000) ops and (319104.1,335864.9) ops/second in (3.133774,8.932162) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.41 GB 87.5 1.1 0.0 1.1 3.9 2.8 0.0 1.4 89.9 314.2 12.59 11.48 44 0.286 1149K 6002 0.0 0.0 L1 4/0 245.05 MB 24.5 1.1 1.1 0.0 1.1 1.1 0.2 1.0 222.2 219.2 5.16 4.82 2 2.579 1163K 15K 0.0 0.0 L2 4/3 511.22 MB 1.3 0.4 0.2 0.2 0.4 0.2 0.9 2.0 254.3 253.6 1.48 1.44 2 0.741 382K 1049 0.0 0.0 L3 15/3 757.57 MB 0.5 1.4 0.5 1.0 1.4 0.5 0.3 3.1 225.0 223.1 6.59 6.04 5 1.317 1505K 12K 0.0 0.0 L4 122/0 9.54 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 211.0 211.0 0.55 0.50 1 0.545 116K 0 0.0 0.0 L5 116/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 272/14 21.96 GB 0.0 4.2 1.9 2.3 6.9 4.6 3.2 2.5 161.3 267.3 26.36 24.27 54 0.488 4318K 35K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.2 1.9 2.3 6.9 4.6 3.1 2.5 161.3 267.3 26.36 24.27 54 0.488 4318K 35K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.2 1.9 2.3 4.1 1.8 0.0 0.0 232.0 230.1 18.33 17.17 14 1.309 4318K 35K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.4 8.03 7.11 40 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.9 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.88 GB write, 779.78 MB/s write, 4.15 GB read, 470.54 MB/s read, 26.4 seconds Interval compaction: 6.88 GB write, 788.69 MB/s write, 4.15 GB read, 475.91 MB/s read, 26.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 692225 Average: 2.9402 StdDev: 18.65 Min: 1 Median: 1.6706 Max: 3926 Percentiles: P50: 1.67 P75: 2.26 P99: 7.48 P99.9: 98.99 P99.99: 321.24 ------------------------------------------------------ [ 0, 1 ] 65543 9.468% 9.468% ## ( 1, 2 ] 418384 60.440% 69.909% ############ ( 2, 3 ] 133855 19.337% 89.246% #### ( 3, 4 ] 34852 5.035% 94.281% # ( 4, 6 ] 29909 4.321% 98.601% # ( 6, 10 ] 7452 1.077% 99.678% ( 10, 15 ] 1301 0.188% 99.866% ( 15, 22 ] 169 0.024% 99.890% ( 22, 34 ] 23 0.003% 99.894% ( 34, 51 ] 8 0.001% 99.895% ( 51, 76 ] 6 0.001% 99.896% ( 76, 110 ] 47 0.007% 99.902% ( 110, 170 ] 272 0.039% 99.942% ( 170, 250 ] 247 0.036% 99.977% ( 250, 380 ] 162 0.023% 100.001% ( 380, 580 ] 142 0.021% 100.021% ( 580, 870 ] 106 0.015% 100.037% ( 870, 1300 ] 33 0.005% 100.041% ( 1300, 1900 ] 11 0.002% 100.043% ( 1900, 2900 ] 4 0.001% 100.043% ( 2900, 4400 ] 3 0.000% 100.044% ** Level 1 read latency histogram (micros): Count: 136195 Average: 3.3039 StdDev: 19.66 Min: 1 Median: 1.7862 Max: 2383 Percentiles: P50: 1.79 P75: 2.52 P99: 8.69 P99.9: 202.58 P99.99: 655.41 ------------------------------------------------------ [ 0, 1 ] 4886 3.588% 3.588% # ( 1, 2 ] 80405 59.037% 62.624% ############ ( 2, 3 ] 32465 23.837% 86.461% ##### ( 3, 4 ] 7975 5.856% 92.317% # ( 4, 6 ] 7570 5.558% 97.875% # ( 6, 10 ] 2281 1.675% 99.550% ( 10, 15 ] 244 0.179% 99.729% ( 15, 22 ] 35 0.026% 99.755% ( 22, 34 ] 7 0.005% 99.760% ( 34, 51 ] 1 0.001% 99.761% ( 51, 76 ] 3 0.002% 99.763% ( 76, 110 ] 49 0.036% 99.799% ( 110, 170 ] 115 0.084% 99.883% ( 170, 250 ] 56 0.041% 99.924% ( 250, 380 ] 49 0.036% 99.960% ( 380, 580 ] 37 0.027% 99.988% ( 580, 870 ] 13 0.010% 99.997% ( 870, 1300 ] 8 0.006% 100.003% ( 1300, 1900 ] 6 0.004% 100.007% ( 1900, 2900 ] 1 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 136330 Average: 2.9230 StdDev: 33.42 Min: 0 Median: 1.5803 Max: 6563 Percentiles: P50: 1.58 P75: 1.98 P99: 7.33 P99.9: 165.42 P99.99: 983.09 ------------------------------------------------------ [ 0, 1 ] 18838 13.818% 13.818% ### ( 1, 2 ] 85009 62.355% 76.173% ############ ( 2, 3 ] 20794 15.253% 91.426% ### ( 3, 4 ] 5385 3.950% 95.376% # ( 4, 6 ] 4481 3.287% 98.663% # ( 6, 10 ] 1386 1.017% 99.679% ( 10, 15 ] 177 0.130% 99.809% ( 15, 22 ] 23 0.017% 99.826% ( 22, 34 ] 4 0.003% 99.829% ( 34, 51 ] 3 0.002% 99.831% ( 51, 76 ] 2 0.001% 99.833% ( 76, 110 ] 15 0.011% 99.844% ( 110, 170 ] 83 0.061% 99.905% ( 170, 250 ] 45 0.033% 99.938% ( 250, 380 ] 31 0.023% 99.960% ( 380, 580 ] 25 0.018% 99.979% ( 580, 870 ] 13 0.010% 99.988% ( 870, 1300 ] 9 0.007% 99.995% ( 1300, 1900 ] 2 0.001% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 4400, 6600 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 259343 Average: 4.3945 StdDev: 65.51 Min: 1 Median: 1.7393 Max: 8910 Percentiles: P50: 1.74 P75: 2.45 P99: 9.29 P99.9: 312.55 P99.99: 846.15 ------------------------------------------------------ [ 0, 1 ] 16213 6.252% 6.252% # ( 1, 2 ] 153472 59.177% 65.429% ############ ( 2, 3 ] 55495 21.398% 86.827% #### ( 3, 4 ] 14803 5.708% 92.535% # ( 4, 6 ] 13009 5.016% 97.551% # ( 6, 10 ] 4570 1.762% 99.313% ( 10, 15 ] 702 0.271% 99.584% ( 15, 22 ] 94 0.036% 99.620% ( 22, 34 ] 8 0.003% 99.623% ( 34, 51 ] 3 0.001% 99.624% ( 51, 76 ] 12 0.005% 99.629% ( 76, 110 ] 95 0.037% 99.666% ( 110, 170 ] 323 0.125% 99.790% ( 170, 250 ] 212 0.082% 99.872% ( 250, 380 ] 151 0.058% 99.930% ( 380, 580 ] 100 0.039% 99.969% ( 580, 870 ] 60 0.023% 99.992% ( 870, 1300 ] 20 0.008% 100.000% ( 1300, 1900 ] 15 0.006% 100.005% ( 1900, 2900 ] 16 0.006% 100.012% ( 2900, 4400 ] 14 0.005% 100.017% ( 4400, 6600 ] 13 0.005% 100.022% ( 6600, 9900 ] 5 0.002% 100.024% ** Level 4 read latency histogram (micros): Count: 45 Average: 1018.2222 StdDev: 1874.77 Min: 1 Median: 23.2000 Max: 6505 Percentiles: P50: 23.20 P75: 1031.25 P99: 6402.00 P99.9: 6505.00 P99.99: 6505.00 ------------------------------------------------------ [ 0, 1 ] 9 20.000% 20.000% #### ( 1, 2 ] 9 20.000% 40.000% #### ( 4, 6 ] 1 2.222% 42.222% ( 6, 10 ] 1 2.222% 44.444% ( 10, 15 ] 1 2.222% 46.667% ( 15, 22 ] 1 2.222% 48.889% ( 22, 34 ] 5 11.111% 60.000% ## ( 51, 76 ] 1 2.222% 62.222% ( 110, 170 ] 1 2.222% 64.444% ( 170, 250 ] 2 4.444% 68.889% # ( 380, 580 ] 2 4.444% 73.333% # ( 870, 1300 ] 2 4.444% 77.778% # ( 1900, 2900 ] 3 6.667% 84.444% # ( 2900, 4400 ] 2 4.444% 88.889% # ( 4400, 6600 ] 5 11.111% 100.000% ## ** Level 5 read latency histogram (micros): Count: 60 Average: 873.9667 StdDev: 1075.56 Min: 85 Median: 324.2857 Max: 4959 Percentiles: P50: 324.29 P75: 1420.00 P99: 4959.00 P99.9: 4959.00 P99.99: 4959.00 ------------------------------------------------------ ( 76, 110 ] 4 6.667% 6.667% # ( 110, 170 ] 13 21.667% 28.333% #### ( 170, 250 ] 9 15.000% 43.333% ### ( 250, 380 ] 7 11.667% 55.000% ## ( 380, 580 ] 3 5.000% 60.000% # ( 580, 870 ] 7 11.667% 71.667% ## ( 870, 1300 ] 1 1.667% 73.333% ( 1300, 1900 ] 5 8.333% 81.667% ## ( 1900, 2900 ] 7 11.667% 93.333% ## ( 2900, 4400 ] 3 5.000% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 9.0 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.037 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 314.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.456 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/10-03:56:45 ... thread 0: (1000000,4000000) ops and (328743.4,334055.8) ops/second in (3.041886,11.974048) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/11 2.32 GB 6.3 2.2 0.0 2.2 5.9 3.7 0.0 1.6 115.0 306.2 19.68 18.17 61 0.323 2299K 12K 0.0 0.0 L1 4/4 245.05 MB 0.0 1.1 1.1 0.0 1.1 1.1 0.2 1.0 222.2 219.2 5.16 4.82 2 2.579 1163K 15K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 254.3 253.6 1.48 1.44 2 0.741 382K 1049 0.0 0.0 L3 18/0 952.07 MB 1.0 2.3 1.0 1.4 2.3 0.9 0.3 2.4 222.4 220.1 10.76 9.94 8 1.345 2429K 24K 0.0 0.0 L4 123/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.1 1.0 211.0 211.0 0.55 0.50 1 0.545 116K 0 0.0 0.0 L5 120/0 9.84 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 277/15 22.86 GB 0.0 6.1 2.4 3.8 9.8 6.0 3.8 2.7 167.3 266.2 37.62 34.86 74 0.508 6392K 53K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 2.4 3.8 9.8 6.0 3.7 2.7 167.3 266.2 37.62 34.86 74 0.508 6392K 53K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 2.4 3.8 6.1 2.3 0.0 0.0 233.9 231.9 26.91 25.39 21 1.282 6392K 53K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 352.3 10.71 9.48 53 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 12.0 interval Flush(GB): cumulative 3.685, interval 3.685 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.78 GB write, 829.08 MB/s write, 6.15 GB read, 521.10 MB/s read, 37.6 seconds Interval compaction: 9.78 GB write, 836.15 MB/s write, 6.15 GB read, 525.55 MB/s read, 37.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 938074 Average: 2.8278 StdDev: 17.92 Min: 1 Median: 1.6397 Max: 4118 Percentiles: P50: 1.64 P75: 2.16 P99: 7.03 P99.9: 92.42 P99.99: 309.81 ------------------------------------------------------ [ 0, 1 ] 101348 10.804% 10.804% ## ( 1, 2 ] 574796 61.274% 72.078% ############ ( 2, 3 ] 168713 17.985% 90.063% #### ( 3, 4 ] 44111 4.702% 94.765% # ( 4, 6 ] 37467 3.994% 98.759% # ( 6, 10 ] 8782 0.936% 99.695% ( 10, 15 ] 1597 0.170% 99.866% ( 15, 22 ] 203 0.022% 99.887% ( 22, 34 ] 27 0.003% 99.890% ( 34, 51 ] 11 0.001% 99.891% ( 51, 76 ] 8 0.001% 99.892% ( 76, 110 ] 151 0.016% 99.908% ( 110, 170 ] 397 0.042% 99.951% ( 170, 250 ] 285 0.030% 99.981% ( 250, 380 ] 183 0.020% 100.001% ( 380, 580 ] 158 0.017% 100.017% ( 580, 870 ] 114 0.012% 100.030% ( 870, 1300 ] 37 0.004% 100.033% ( 1300, 1900 ] 13 0.001% 100.035% ( 1900, 2900 ] 6 0.001% 100.035% ( 2900, 4400 ] 5 0.001% 100.036% ** Level 1 read latency histogram (micros): Count: 224867 Average: 3.2001 StdDev: 17.41 Min: 1 Median: 1.7805 Max: 2383 Percentiles: P50: 1.78 P75: 2.51 P99: 8.69 P99.9: 171.18 P99.99: 559.68 ------------------------------------------------------ [ 0, 1 ] 8207 3.650% 3.650% # ( 1, 2 ] 133538 59.385% 63.035% ############ ( 2, 3 ] 52985 23.563% 86.598% ##### ( 3, 4 ] 12914 5.743% 92.341% # ( 4, 6 ] 12262 5.453% 97.794% # ( 6, 10 ] 4034 1.794% 99.588% ( 10, 15 ] 417 0.185% 99.773% ( 15, 22 ] 57 0.025% 99.799% ( 22, 34 ] 9 0.004% 99.803% ( 34, 51 ] 1 0.000% 99.803% ( 51, 76 ] 3 0.001% 99.804% ( 76, 110 ] 61 0.027% 99.831% ( 110, 170 ] 153 0.068% 99.899% ( 170, 250 ] 77 0.034% 99.934% ( 250, 380 ] 78 0.035% 99.968% ( 380, 580 ] 54 0.024% 99.992% ( 580, 870 ] 26 0.012% 100.004% ( 870, 1300 ] 9 0.004% 100.008% ( 1300, 1900 ] 6 0.003% 100.011% ( 1900, 2900 ] 1 0.000% 100.011% ** Level 2 read latency histogram (micros): Count: 136330 Average: 2.9230 StdDev: 33.42 Min: 0 Median: 1.5803 Max: 6563 Percentiles: P50: 1.58 P75: 1.98 P99: 7.33 P99.9: 165.42 P99.99: 983.09 ------------------------------------------------------ [ 0, 1 ] 18838 13.818% 13.818% ### ( 1, 2 ] 85009 62.355% 76.173% ############ ( 2, 3 ] 20794 15.253% 91.426% ### ( 3, 4 ] 5385 3.950% 95.376% # ( 4, 6 ] 4481 3.287% 98.663% # ( 6, 10 ] 1386 1.017% 99.679% ( 10, 15 ] 177 0.130% 99.809% ( 15, 22 ] 23 0.017% 99.826% ( 22, 34 ] 4 0.003% 99.829% ( 34, 51 ] 3 0.002% 99.831% ( 51, 76 ] 2 0.001% 99.833% ( 76, 110 ] 15 0.011% 99.844% ( 110, 170 ] 83 0.061% 99.905% ( 170, 250 ] 45 0.033% 99.938% ( 250, 380 ] 31 0.023% 99.960% ( 380, 580 ] 25 0.018% 99.979% ( 580, 870 ] 13 0.010% 99.988% ( 870, 1300 ] 9 0.007% 99.995% ( 1300, 1900 ] 2 0.001% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 4400, 6600 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 311394 Average: 4.2609 StdDev: 60.35 Min: 0 Median: 1.7464 Max: 8910 Percentiles: P50: 1.75 P75: 2.46 P99: 9.30 P99.9: 306.86 P99.99: 845.27 ------------------------------------------------------ [ 0, 1 ] 18405 5.911% 5.911% # ( 1, 2 ] 183947 59.072% 64.983% ############ ( 2, 3 ] 68297 21.933% 86.915% #### ( 3, 4 ] 17457 5.606% 92.521% # ( 4, 6 ] 15612 5.014% 97.535% # ( 6, 10 ] 5527 1.775% 99.310% ( 10, 15 ] 818 0.263% 99.573% ( 15, 22 ] 110 0.035% 99.608% ( 22, 34 ] 8 0.003% 99.610% ( 34, 51 ] 4 0.001% 99.612% ( 51, 76 ] 14 0.004% 99.616% ( 76, 110 ] 143 0.046% 99.662% ( 110, 170 ] 420 0.135% 99.797% ( 170, 250 ] 241 0.077% 99.874% ( 250, 380 ] 182 0.058% 99.933% ( 380, 580 ] 112 0.036% 99.969% ( 580, 870 ] 72 0.023% 99.992% ( 870, 1300 ] 23 0.007% 99.999% ( 1300, 1900 ] 16 0.005% 100.004% ( 1900, 2900 ] 16 0.005% 100.010% ( 2900, 4400 ] 14 0.004% 100.014% ( 4400, 6600 ] 13 0.004% 100.018% ( 6600, 9900 ] 5 0.002% 100.020% ** Level 4 read latency histogram (micros): Count: 45 Average: 1018.2222 StdDev: 1874.77 Min: 1 Median: 23.2000 Max: 6505 Percentiles: P50: 23.20 P75: 1031.25 P99: 6402.00 P99.9: 6505.00 P99.99: 6505.00 ------------------------------------------------------ [ 0, 1 ] 9 20.000% 20.000% #### ( 1, 2 ] 9 20.000% 40.000% #### ( 4, 6 ] 1 2.222% 42.222% ( 6, 10 ] 1 2.222% 44.444% ( 10, 15 ] 1 2.222% 46.667% ( 15, 22 ] 1 2.222% 48.889% ( 22, 34 ] 5 11.111% 60.000% ## ( 51, 76 ] 1 2.222% 62.222% ( 110, 170 ] 1 2.222% 64.444% ( 170, 250 ] 2 4.444% 68.889% # ( 380, 580 ] 2 4.444% 73.333% # ( 870, 1300 ] 2 4.444% 77.778% # ( 1900, 2900 ] 3 6.667% 84.444% # ( 2900, 4400 ] 2 4.444% 88.889% # ( 4400, 6600 ] 5 11.111% 100.000% ## ** Level 5 read latency histogram (micros): Count: 80 Average: 836.0625 StdDev: 1037.45 Min: 85 Median: 305.7143 Max: 4959 Percentiles: P50: 305.71 P75: 1300.00 P99: 4840.00 P99.9: 4959.00 P99.99: 4959.00 ------------------------------------------------------ ( 76, 110 ] 6 7.500% 7.500% ## ( 110, 170 ] 22 27.500% 35.000% ###### ( 170, 250 ] 9 11.250% 46.250% ## ( 250, 380 ] 7 8.750% 55.000% ## ( 380, 580 ] 4 5.000% 60.000% # ( 580, 870 ] 10 12.500% 72.500% ### ( 870, 1300 ] 2 2.500% 75.000% # ( 1300, 1900 ] 6 7.500% 82.500% ## ( 1900, 2900 ] 8 10.000% 92.500% ## ( 2900, 4400 ] 5 6.250% 98.750% # ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.455 H:M:S, 12.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.418 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/10-03:56:49 ... thread 0: (1000000,5000000) ops and (287251.7,323513.3) ops/second in (3.481268,15.455316) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.30 GB 81.3 3.0 0.0 3.0 7.7 4.7 0.0 1.6 120.2 305.9 25.65 23.75 79 0.325 3129K 16K 0.0 0.0 L1 4/4 245.05 MB 0.0 1.1 1.1 0.0 1.1 1.1 0.2 1.0 222.2 219.2 5.16 4.82 2 2.579 1163K 15K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 254.3 253.6 1.48 1.44 2 0.741 382K 1049 0.0 0.0 L3 18/0 952.07 MB 1.0 2.3 1.0 1.4 2.3 0.9 0.3 2.4 222.4 220.1 10.76 9.94 8 1.345 2429K 24K 0.0 0.0 L4 123/0 9.53 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.1 1.0 211.0 211.0 0.55 0.50 1 0.545 116K 0 0.0 0.0 L5 120/0 9.84 GB 0.1 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 283/19 23.84 GB 0.0 6.9 2.4 4.6 11.6 7.0 3.8 2.5 163.2 271.5 43.59 40.45 92 0.474 7223K 57K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.9 2.4 4.6 11.6 7.0 3.7 2.5 163.2 271.5 43.59 40.45 92 0.474 7223K 57K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.9 2.4 4.6 6.9 2.3 0.0 0.0 236.9 235.0 30.02 28.44 24 1.251 7223K 57K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 352.2 13.57 12.01 68 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.5 interval Flush(GB): cumulative 4.668, interval 4.668 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.56 GB write, 760.53 MB/s write, 6.95 GB read, 457.07 MB/s read, 43.6 seconds Interval compaction: 11.56 GB write, 765.56 MB/s write, 6.95 GB read, 460.09 MB/s read, 43.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 16, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1374873 Average: 2.7184 StdDev: 16.27 Min: 0 Median: 1.6253 Max: 4118 Percentiles: P50: 1.63 P75: 2.09 P99: 6.86 P99.9: 16.29 P99.99: 232.94 ------------------------------------------------------ [ 0, 1 ] 148706 10.816% 10.816% ## ( 1, 2 ] 861492 62.660% 73.476% ############# ( 2, 3 ] 239857 17.446% 90.921% ### ( 3, 4 ] 58843 4.280% 95.201% # ( 4, 6 ] 49466 3.598% 98.799% # ( 6, 10 ] 12835 0.934% 99.733% ( 10, 15 ] 2256 0.164% 99.897% ( 15, 22 ] 256 0.019% 99.915% ( 22, 34 ] 33 0.002% 99.918% ( 34, 51 ] 13 0.001% 99.919% ( 51, 76 ] 14 0.001% 99.920% ( 76, 110 ] 202 0.015% 99.935% ( 110, 170 ] 499 0.036% 99.971% ( 170, 250 ] 340 0.025% 99.996% ( 250, 380 ] 207 0.015% 100.011% ( 380, 580 ] 192 0.014% 100.025% ( 580, 870 ] 135 0.010% 100.034% ( 870, 1300 ] 44 0.003% 100.038% ( 1300, 1900 ] 19 0.001% 100.039% ( 1900, 2900 ] 6 0.000% 100.039% ( 2900, 4400 ] 6 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 224867 Average: 3.2001 StdDev: 17.41 Min: 1 Median: 1.7805 Max: 2383 Percentiles: P50: 1.78 P75: 2.51 P99: 8.69 P99.9: 171.18 P99.99: 559.68 ------------------------------------------------------ [ 0, 1 ] 8207 3.650% 3.650% # ( 1, 2 ] 133538 59.385% 63.035% ############ ( 2, 3 ] 52985 23.563% 86.598% ##### ( 3, 4 ] 12914 5.743% 92.341% # ( 4, 6 ] 12262 5.453% 97.794% # ( 6, 10 ] 4034 1.794% 99.588% ( 10, 15 ] 417 0.185% 99.773% ( 15, 22 ] 57 0.025% 99.799% ( 22, 34 ] 9 0.004% 99.803% ( 34, 51 ] 1 0.000% 99.803% ( 51, 76 ] 3 0.001% 99.804% ( 76, 110 ] 61 0.027% 99.831% ( 110, 170 ] 153 0.068% 99.899% ( 170, 250 ] 77 0.034% 99.934% ( 250, 380 ] 78 0.035% 99.968% ( 380, 580 ] 54 0.024% 99.992% ( 580, 870 ] 26 0.012% 100.004% ( 870, 1300 ] 9 0.004% 100.008% ( 1300, 1900 ] 6 0.003% 100.011% ( 1900, 2900 ] 1 0.000% 100.011% ** Level 2 read latency histogram (micros): Count: 136330 Average: 2.9230 StdDev: 33.42 Min: 0 Median: 1.5803 Max: 6563 Percentiles: P50: 1.58 P75: 1.98 P99: 7.33 P99.9: 165.42 P99.99: 983.09 ------------------------------------------------------ [ 0, 1 ] 18838 13.818% 13.818% ### ( 1, 2 ] 85009 62.355% 76.173% ############ ( 2, 3 ] 20794 15.253% 91.426% ### ( 3, 4 ] 5385 3.950% 95.376% # ( 4, 6 ] 4481 3.287% 98.663% # ( 6, 10 ] 1386 1.017% 99.679% ( 10, 15 ] 177 0.130% 99.809% ( 15, 22 ] 23 0.017% 99.826% ( 22, 34 ] 4 0.003% 99.829% ( 34, 51 ] 3 0.002% 99.831% ( 51, 76 ] 2 0.001% 99.833% ( 76, 110 ] 15 0.011% 99.844% ( 110, 170 ] 83 0.061% 99.905% ( 170, 250 ] 45 0.033% 99.938% ( 250, 380 ] 31 0.023% 99.960% ( 380, 580 ] 25 0.018% 99.979% ( 580, 870 ] 13 0.010% 99.988% ( 870, 1300 ] 9 0.007% 99.995% ( 1300, 1900 ] 2 0.001% 99.996% ( 1900, 2900 ] 1 0.001% 99.997% ( 4400, 6600 ] 4 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 311394 Average: 4.2609 StdDev: 60.35 Min: 0 Median: 1.7464 Max: 8910 Percentiles: P50: 1.75 P75: 2.46 P99: 9.30 P99.9: 306.86 P99.99: 845.27 ------------------------------------------------------ [ 0, 1 ] 18405 5.911% 5.911% # ( 1, 2 ] 183947 59.072% 64.983% ############ ( 2, 3 ] 68297 21.933% 86.915% #### ( 3, 4 ] 17457 5.606% 92.521% # ( 4, 6 ] 15612 5.014% 97.535% # ( 6, 10 ] 5527 1.775% 99.310% ( 10, 15 ] 818 0.263% 99.573% ( 15, 22 ] 110 0.035% 99.608% ( 22, 34 ] 8 0.003% 99.610% ( 34, 51 ] 4 0.001% 99.612% ( 51, 76 ] 14 0.004% 99.616% ( 76, 110 ] 143 0.046% 99.662% ( 110, 170 ] 420 0.135% 99.797% ( 170, 250 ] 241 0.077% 99.874% ( 250, 380 ] 182 0.058% 99.933% ( 380, 580 ] 112 0.036% 99.969% ( 580, 870 ] 72 0.023% 99.992% ( 870, 1300 ] 23 0.007% 99.999% ( 1300, 1900 ] 16 0.005% 100.004% ( 1900, 2900 ] 16 0.005% 100.010% ( 2900, 4400 ] 14 0.004% 100.014% ( 4400, 6600 ] 13 0.004% 100.018% ( 6600, 9900 ] 5 0.002% 100.020% ** Level 4 read latency histogram (micros): Count: 45 Average: 1018.2222 StdDev: 1874.77 Min: 1 Median: 23.2000 Max: 6505 Percentiles: P50: 23.20 P75: 1031.25 P99: 6402.00 P99.9: 6505.00 P99.99: 6505.00 ------------------------------------------------------ [ 0, 1 ] 9 20.000% 20.000% #### ( 1, 2 ] 9 20.000% 40.000% #### ( 4, 6 ] 1 2.222% 42.222% ( 6, 10 ] 1 2.222% 44.444% ( 10, 15 ] 1 2.222% 46.667% ( 15, 22 ] 1 2.222% 48.889% ( 22, 34 ] 5 11.111% 60.000% ## ( 51, 76 ] 1 2.222% 62.222% ( 110, 170 ] 1 2.222% 64.444% ( 170, 250 ] 2 4.444% 68.889% # ( 380, 580 ] 2 4.444% 73.333% # ( 870, 1300 ] 2 4.444% 77.778% # ( 1900, 2900 ] 3 6.667% 84.444% # ( 2900, 4400 ] 2 4.444% 88.889% # ( 4400, 6600 ] 5 11.111% 100.000% ## ** Level 5 read latency histogram (micros): Count: 80 Average: 836.0625 StdDev: 1037.45 Min: 85 Median: 305.7143 Max: 4959 Percentiles: P50: 305.71 P75: 1300.00 P99: 4840.00 P99.9: 4959.00 P99.99: 4959.00 ------------------------------------------------------ ( 76, 110 ] 6 7.500% 7.500% ## ( 110, 170 ] 22 27.500% 35.000% ###### ( 170, 250 ] 9 11.250% 46.250% ## ( 250, 380 ] 7 8.750% 55.000% ## ( 380, 580 ] 4 5.000% 60.000% # ( 580, 870 ] 10 12.500% 72.500% ### ( 870, 1300 ] 2 2.500% 75.000% # ( 1300, 1900 ] 6 7.500% 82.500% ## ( 1900, 2900 ] 8 10.000% 92.500% ## ( 2900, 4400 ] 5 6.250% 98.750% # ( 4400, 6600 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 15.6 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 316.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.260 H:M:S, 14.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 282.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.805 H:M:S, 23.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.536 micros/op 282811 ops/sec 20.024 seconds 5662999 operations; 274.0 MB/s Microseconds per write: Count: 5662999 Average: 3.5359 StdDev: 240.54 Min: 0 Median: 1.7177 Max: 245556 Percentiles: P50: 1.72 P75: 2.70 P99: 7.49 P99.9: 99.43 P99.99: 1274.98 ------------------------------------------------------ [ 0, 1 ] 813509 14.365% 14.365% ### ( 1, 2 ] 2811568 49.648% 64.013% ########## ( 2, 3 ] 894756 15.800% 79.813% ### ( 3, 4 ] 774289 13.673% 93.486% ### ( 4, 6 ] 294702 5.204% 98.690% # ( 6, 10 ] 47085 0.831% 99.522% ( 10, 15 ] 13616 0.240% 99.762% ( 15, 22 ] 4165 0.074% 99.836% ( 22, 34 ] 768 0.014% 99.849% ( 34, 51 ] 107 0.002% 99.851% ( 51, 76 ] 17 0.000% 99.851% ( 76, 110 ] 3996 0.071% 99.922% ( 110, 170 ] 1543 0.027% 99.949% ( 170, 250 ] 163 0.003% 99.952% ( 250, 380 ] 46 0.001% 99.953% ( 380, 580 ] 5 0.000% 99.953% ( 580, 870 ] 5 0.000% 99.953% ( 870, 1300 ] 2222 0.039% 99.992% ( 1300, 1900 ] 2 0.000% 99.992% ( 1900, 2900 ] 421 0.007% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ( 4400, 6600 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 170000, 250000 ] 8 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 171684 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5662999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5844214968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 197 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4920201 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 10564747292 rocksdb.compact.write.bytes COUNT : 10397134276 rocksdb.flush.write.bytes COUNT : 5803693256 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 23 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 89 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5766191104 rocksdb.memtable.garbage.bytes.at.flush COUNT : 10763264 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 10616691103 rocksdb.non.last.level.read.count COUNT : 2562625 rocksdb.block.checksum.compute.count COUNT : 2562254 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.359281 P95 : 3.834431 P99 : 5.935828 P100 : 245552.000000 COUNT : 5662999 SUM : 17466212 rocksdb.compaction.times.micros P50 : 1090714.285714 P95 : 3355000.000000 P99 : 3612415.000000 P100 : 3612415.000000 COUNT : 27 SUM : 32878789 rocksdb.compaction.times.cpu_micros P50 : 1090714.285714 P95 : 3318864.000000 P99 : 3318864.000000 P100 : 3318864.000000 COUNT : 27 SUM : 31257395 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 699.411765 P95 : 1284.074074 P99 : 1439.000000 P100 : 1439.000000 COUNT : 80 SUM : 61540 rocksdb.compaction.outfile.sync.micros P50 : 736.836735 P95 : 1485.000000 P99 : 1897.000000 P100 : 2217.000000 COUNT : 103 SUM : 79773 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 96.469388 P95 : 248.888889 P99 : 352.916667 P100 : 353.000000 COUNT : 125 SUM : 14818 rocksdb.table.open.io.micros P50 : 1353.571429 P95 : 16766.666667 P99 : 22165.000000 P100 : 22540.000000 COUNT : 197 SUM : 596798 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.673998 P95 : 7.140723 P99 : 9.983510 P100 : 3933.000000 COUNT : 2562150 SUM : 12580145 rocksdb.read.block.get.micros P50 : 550.833333 P95 : 4991.250000 P99 : 8274.750000 P100 : 9176.000000 COUNT : 394 SUM : 440519 rocksdb.write.raw.block.micros P50 : 0.511984 P95 : 0.972769 P99 : 2.881102 P100 : 4804.000000 COUNT : 3925179 SUM : 7341258 rocksdb.numfiles.in.singlecompaction P50 : 3.333333 P95 : 8.266667 P99 : 12.700000 P100 : 15.000000 COUNT : 46 SUM : 181 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560534 P95 : 1143.668016 P99 : 2340.760095 P100 : 245365.000000 COUNT : 24844 SUM : 4923152 rocksdb.sst.read.micros P50 : 1.633653 P95 : 4.077130 P99 : 7.835617 P100 : 8910.000000 COUNT : 2563403 SUM : 7705826 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5662999 SUM : 5844214968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 209344.262295 P95 : 322222.222222 P99 : 361113.000000 P100 : 361113.000000 COUNT : 80 SUM : 15803863 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 112 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0