[2024-07-14 06:24:22.916698] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 24.03.0 initialization... [2024-07-14 06:24:22.916798] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3581836 ] Set seed to 1720931062914363 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-14 06:24:23.018056] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-14 06:24:23.234412] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-14 06:24:23.234450] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3581836' to capture a snapshot of events at runtime. [2024-07-14 06:24:23.234461] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-14 06:24:23.234470] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-14 06:24:23.234478] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3581836 for offline analysis/debug. [2024-07-14 06:24:23.234555] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Jul 14 06:24:32 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/14-06:24:35 ... thread 0: (1000000,1000000) ops and (343629.3,343629.3) ops/second in (2.910113,2.910113) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 566.96 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 360.2 2.45 2.20 12 0.204 0 0 0.0 0.0 L1 3/3 251.77 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 256.0 255.8 0.98 0.96 1 0.984 255K 181 0.0 0.0 L2 1/0 48.91 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 248.6 248.5 0.45 0.43 1 0.448 113K 25 0.0 0.0 L3 19/0 944.34 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.3 201.3 0.31 0.26 1 0.310 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1187/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 101.6 312.0 4.19 3.84 15 0.279 432K 206 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 101.6 312.0 4.19 3.84 15 0.279 432K 206 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 244.3 244.2 1.74 1.64 3 0.581 432K 206 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 360.2 2.45 2.20 12 0.204 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 421.51 MB/s write, 0.42 GB read, 137.26 MB/s read, 4.2 seconds Interval compaction: 1.28 GB write, 449.07 MB/s write, 0.42 GB read, 146.23 MB/s read, 4.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 103865 Average: 1.8769 StdDev: 10.76 Min: 0 Median: 1.2808 Max: 2140 Percentiles: P50: 1.28 P75: 1.67 P99: 3.73 P99.9: 9.89 P99.99: 444.54 ------------------------------------------------------ [ 0, 1 ] 33389 32.147% 32.147% ###### ( 1, 2 ] 66039 63.582% 95.728% ############# ( 2, 3 ] 2532 2.438% 98.166% ( 3, 4 ] 1182 1.138% 99.304% ( 4, 6 ] 404 0.389% 99.693% ( 6, 10 ] 221 0.213% 99.906% ( 10, 15 ] 61 0.059% 99.964% ( 15, 22 ] 8 0.008% 99.972% ( 22, 34 ] 1 0.001% 99.973% ( 34, 51 ] 2 0.002% 99.975% ( 51, 76 ] 2 0.002% 99.977% ( 110, 170 ] 6 0.006% 99.983% ( 170, 250 ] 4 0.004% 99.987% ( 250, 380 ] 2 0.002% 99.988% ( 380, 580 ] 5 0.005% 99.993% ( 580, 870 ] 4 0.004% 99.997% ( 870, 1300 ] 1 0.001% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 1 read latency histogram (micros): Count: 31347 Average: 2.1484 StdDev: 15.37 Min: 1 Median: 1.2820 Max: 1655 Percentiles: P50: 1.28 P75: 1.67 P99: 5.34 P99.9: 71.83 P99.99: 994.03 ------------------------------------------------------ [ 0, 1 ] 10032 32.003% 32.003% ###### ( 1, 2 ] 20003 63.812% 95.815% ############# ( 2, 3 ] 577 1.841% 97.655% ( 3, 4 ] 306 0.976% 98.631% ( 4, 6 ] 174 0.555% 99.187% ( 6, 10 ] 132 0.421% 99.608% ( 10, 15 ] 41 0.131% 99.738% ( 15, 22 ] 9 0.029% 99.767% ( 34, 51 ] 6 0.019% 99.786% ( 51, 76 ] 44 0.140% 99.927% ( 76, 110 ] 8 0.026% 99.952% ( 110, 170 ] 2 0.006% 99.959% ( 170, 250 ] 5 0.016% 99.974% ( 250, 380 ] 4 0.013% 99.987% ( 580, 870 ] 1 0.003% 99.990% ( 870, 1300 ] 3 0.010% 100.000% ( 1300, 1900 ] 1 0.003% 100.003% ** Level 2 read latency histogram (micros): Count: 15859 Average: 1.8965 StdDev: 8.34 Min: 0 Median: 1.3035 Max: 932 Percentiles: P50: 1.30 P75: 1.70 P99: 3.72 P99.9: 10.57 P99.99: 462.82 ------------------------------------------------------ [ 0, 1 ] 4923 31.042% 31.042% ###### ( 1, 2 ] 9907 62.469% 93.512% ############ ( 2, 3 ] 745 4.698% 98.209% # ( 3, 4 ] 175 1.103% 99.313% ( 4, 6 ] 69 0.435% 99.748% ( 6, 10 ] 23 0.145% 99.893% ( 10, 15 ] 10 0.063% 99.956% ( 15, 22 ] 3 0.019% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 380, 580 ] 1 0.006% 99.994% ( 870, 1300 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 95 Average: 1800.1158 StdDev: 2279.53 Min: 1 Median: 725.0000 Max: 8286 Percentiles: P50: 725.00 P75: 3355.36 P99: 8286.00 P99.9: 8286.00 P99.99: 8286.00 ------------------------------------------------------ [ 0, 1 ] 18 18.947% 18.947% #### ( 1, 2 ] 14 14.737% 33.684% ### ( 2, 3 ] 1 1.053% 34.737% ( 4, 6 ] 2 2.105% 36.842% ( 6, 10 ] 1 1.053% 37.895% ( 51, 76 ] 1 1.053% 38.947% ( 170, 250 ] 2 2.105% 41.053% ( 250, 380 ] 1 1.053% 42.105% ( 380, 580 ] 3 3.158% 45.263% # ( 580, 870 ] 9 9.474% 54.737% ## ( 870, 1300 ] 5 5.263% 60.000% # ( 1300, 1900 ] 7 7.368% 67.368% # ( 1900, 2900 ] 3 3.158% 70.526% # ( 2900, 4400 ] 14 14.737% 85.263% ### ( 4400, 6600 ] 8 8.421% 93.684% ## ( 6600, 9900 ] 6 6.316% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 4012.9000 StdDev: 1692.35 Min: 869 Median: 3900.0000 Max: 6851 Percentiles: P50: 3900.00 P75: 5133.33 P99: 6851.00 P99.9: 6851.00 P99.99: 6851.00 ------------------------------------------------------ ( 580, 870 ] 1 5.000% 5.000% # ( 870, 1300 ] 2 10.000% 15.000% ## ( 1300, 1900 ] 1 5.000% 20.000% # ( 2900, 4400 ] 9 45.000% 65.000% ######### ( 4400, 6600 ] 6 30.000% 95.000% ###### ( 6600, 9900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 317.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.385 H:M:S, 12.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 337.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.385 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-06:24:38 ... thread 0: (1000000,2000000) ops and (336377.9,339964.9) ops/second in (2.972847,5.882960) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.23 GB 18.9 0.6 0.0 0.6 2.4 1.8 0.0 1.3 77.0 333.4 7.37 6.77 28 0.263 575K 630 0.0 0.0 L1 6/6 565.51 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 242.8 242.4 3.37 3.28 2 1.686 831K 1350 0.0 0.0 L2 1/0 48.91 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 248.6 248.5 0.45 0.43 1 0.448 113K 25 0.0 0.0 L3 19/0 944.34 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.3 201.3 0.31 0.26 1 0.310 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1193/15 97.98 GB 0.0 1.5 0.6 0.9 3.4 2.5 0.2 1.8 135.6 299.8 11.50 10.73 32 0.359 1583K 2005 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.4 2.5 0.1 1.8 135.6 299.8 11.50 10.73 32 0.359 1583K 2005 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 249.5 249.1 6.25 6.05 6 1.042 1583K 2005 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 360.3 5.25 4.69 26 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.37 GB write, 567.48 MB/s write, 1.52 GB read, 256.72 MB/s read, 11.5 seconds Interval compaction: 3.37 GB write, 585.84 MB/s write, 1.52 GB read, 265.03 MB/s read, 11.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 385537 Average: 2.1805 StdDev: 10.91 Min: 0 Median: 1.4963 Max: 3879 Percentiles: P50: 1.50 P75: 1.87 P99: 5.51 P99.9: 9.81 P99.99: 14.95 ------------------------------------------------------ [ 0, 1 ] 66291 17.194% 17.194% ### ( 1, 2 ] 254822 66.095% 83.290% ############# ( 2, 3 ] 44705 11.596% 94.885% ## ( 3, 4 ] 10231 2.654% 97.539% # ( 4, 6 ] 7467 1.937% 99.476% ( 6, 10 ] 1716 0.445% 99.921% ( 10, 15 ] 270 0.070% 99.991% ( 15, 22 ] 39 0.010% 100.001% ( 22, 34 ] 7 0.002% 100.003% ( 34, 51 ] 5 0.001% 100.004% ( 51, 76 ] 3 0.001% 100.005% ( 110, 170 ] 16 0.004% 100.009% ( 170, 250 ] 6 0.002% 100.011% ( 250, 380 ] 5 0.001% 100.012% ( 380, 580 ] 10 0.003% 100.015% ( 580, 870 ] 7 0.002% 100.016% ( 870, 1300 ] 6 0.002% 100.018% ( 1300, 1900 ] 2 0.001% 100.018% ( 1900, 2900 ] 3 0.001% 100.019% ( 2900, 4400 ] 1 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 105039 Average: 2.2556 StdDev: 12.92 Min: 0 Median: 1.4830 Max: 1927 Percentiles: P50: 1.48 P75: 1.86 P99: 5.52 P99.9: 14.71 P99.99: 429.61 ------------------------------------------------------ [ 0, 1 ] 18999 18.088% 18.088% #### ( 1, 2 ] 69407 66.077% 84.165% ############# ( 2, 3 ] 11695 11.134% 95.299% ## ( 3, 4 ] 2454 2.336% 97.635% ( 4, 6 ] 1884 1.794% 99.429% ( 6, 10 ] 429 0.408% 99.837% ( 10, 15 ] 70 0.067% 99.904% ( 15, 22 ] 14 0.013% 99.917% ( 22, 34 ] 2 0.002% 99.919% ( 34, 51 ] 7 0.007% 99.926% ( 51, 76 ] 44 0.042% 99.968% ( 76, 110 ] 8 0.008% 99.975% ( 110, 170 ] 3 0.003% 99.978% ( 170, 250 ] 5 0.005% 99.983% ( 250, 380 ] 7 0.007% 99.990% ( 380, 580 ] 2 0.002% 99.991% ( 580, 870 ] 1 0.001% 99.992% ( 870, 1300 ] 3 0.003% 99.995% ( 1300, 1900 ] 4 0.004% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15859 Average: 1.8965 StdDev: 8.34 Min: 0 Median: 1.3035 Max: 932 Percentiles: P50: 1.30 P75: 1.70 P99: 3.72 P99.9: 10.57 P99.99: 462.82 ------------------------------------------------------ [ 0, 1 ] 4923 31.042% 31.042% ###### ( 1, 2 ] 9907 62.469% 93.512% ############ ( 2, 3 ] 745 4.698% 98.209% # ( 3, 4 ] 175 1.103% 99.313% ( 4, 6 ] 69 0.435% 99.748% ( 6, 10 ] 23 0.145% 99.893% ( 10, 15 ] 10 0.063% 99.956% ( 15, 22 ] 3 0.019% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 380, 580 ] 1 0.006% 99.994% ( 870, 1300 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 95 Average: 1800.1158 StdDev: 2279.53 Min: 1 Median: 725.0000 Max: 8286 Percentiles: P50: 725.00 P75: 3355.36 P99: 8286.00 P99.9: 8286.00 P99.99: 8286.00 ------------------------------------------------------ [ 0, 1 ] 18 18.947% 18.947% #### ( 1, 2 ] 14 14.737% 33.684% ### ( 2, 3 ] 1 1.053% 34.737% ( 4, 6 ] 2 2.105% 36.842% ( 6, 10 ] 1 1.053% 37.895% ( 51, 76 ] 1 1.053% 38.947% ( 170, 250 ] 2 2.105% 41.053% ( 250, 380 ] 1 1.053% 42.105% ( 380, 580 ] 3 3.158% 45.263% # ( 580, 870 ] 9 9.474% 54.737% ## ( 870, 1300 ] 5 5.263% 60.000% # ( 1300, 1900 ] 7 7.368% 67.368% # ( 1900, 2900 ] 3 3.158% 70.526% # ( 2900, 4400 ] 14 14.737% 85.263% ### ( 4400, 6600 ] 8 8.421% 93.684% ## ( 6600, 9900 ] 6 6.316% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 4012.9000 StdDev: 1692.35 Min: 869 Median: 3900.0000 Max: 6851 Percentiles: P50: 3900.00 P75: 5133.33 P99: 6851.00 P99.9: 6851.00 P99.99: 6851.00 ------------------------------------------------------ ( 580, 870 ] 1 5.000% 5.000% # ( 870, 1300 ] 2 10.000% 15.000% ## ( 1300, 1900 ] 1 5.000% 20.000% # ( 2900, 4400 ] 9 45.000% 65.000% ######### ( 4400, 6600 ] 6 30.000% 95.000% ###### ( 6600, 9900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.798 H:M:S, 13.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.412 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-06:24:41 ... thread 0: (1000000,3000000) ops and (362653.8,347205.7) ops/second in (2.757451,8.640411) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 2.09 GB 107.0 1.4 0.0 1.4 4.1 2.7 0.0 1.5 107.0 321.0 12.95 12.02 44 0.294 1407K 1427 0.0 0.0 L1 6/6 565.51 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 242.8 242.4 3.37 3.28 2 1.686 831K 1350 0.0 0.0 L2 1/0 48.91 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 248.6 248.5 0.45 0.43 1 0.448 113K 25 0.0 0.0 L3 19/0 944.34 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.3 201.3 0.31 0.26 1 0.310 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1197/15 98.84 GB 0.0 2.3 0.6 1.7 5.0 3.3 0.2 1.9 139.3 301.4 17.08 15.98 48 0.356 2415K 2802 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 0.6 1.7 5.0 3.3 0.1 1.9 139.3 301.4 17.08 15.98 48 0.356 2415K 2802 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 0.6 1.7 2.3 0.6 0.0 0.0 253.3 253.0 9.39 9.13 9 1.043 2415K 2802 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 360.6 7.69 6.85 39 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.8 total, 8.6 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.03 GB write, 582.81 MB/s write, 2.32 GB read, 269.30 MB/s read, 17.1 seconds Interval compaction: 5.03 GB write, 595.64 MB/s write, 2.32 GB read, 275.24 MB/s read, 17.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 684801 Average: 2.2522 StdDev: 10.77 Min: 0 Median: 1.5440 Max: 3879 Percentiles: P50: 1.54 P75: 1.92 P99: 5.61 P99.9: 9.99 P99.99: 14.48 ------------------------------------------------------ [ 0, 1 ] 94549 13.807% 13.807% ### ( 1, 2 ] 455578 66.527% 80.334% ############# ( 2, 3 ] 95108 13.888% 94.222% ### ( 3, 4 ] 20352 2.972% 97.194% # ( 4, 6 ] 15364 2.244% 99.438% ( 6, 10 ] 3176 0.464% 99.902% ( 10, 15 ] 678 0.099% 100.001% ( 15, 22 ] 70 0.010% 100.011% ( 22, 34 ] 9 0.001% 100.012% ( 34, 51 ] 7 0.001% 100.013% ( 51, 76 ] 4 0.001% 100.014% ( 110, 170 ] 21 0.003% 100.017% ( 170, 250 ] 12 0.002% 100.019% ( 250, 380 ] 7 0.001% 100.020% ( 380, 580 ] 12 0.002% 100.021% ( 580, 870 ] 17 0.002% 100.024% ( 870, 1300 ] 9 0.001% 100.025% ( 1300, 1900 ] 4 0.001% 100.026% ( 1900, 2900 ] 4 0.001% 100.026% ( 2900, 4400 ] 2 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 171512 Average: 2.2637 StdDev: 10.12 Min: 0 Median: 1.5362 Max: 1927 Percentiles: P50: 1.54 P75: 1.91 P99: 5.55 P99.9: 12.50 P99.99: 265.76 ------------------------------------------------------ [ 0, 1 ] 24446 14.253% 14.253% ### ( 1, 2 ] 114347 66.670% 80.923% ############# ( 2, 3 ] 23563 13.738% 94.662% ### ( 3, 4 ] 4690 2.735% 97.396% # ( 4, 6 ] 3549 2.069% 99.465% ( 6, 10 ] 686 0.400% 99.865% ( 10, 15 ] 119 0.069% 99.935% ( 15, 22 ] 22 0.013% 99.948% ( 22, 34 ] 3 0.002% 99.949% ( 34, 51 ] 7 0.004% 99.953% ( 51, 76 ] 46 0.027% 99.980% ( 76, 110 ] 8 0.005% 99.985% ( 110, 170 ] 3 0.002% 99.987% ( 170, 250 ] 5 0.003% 99.990% ( 250, 380 ] 7 0.004% 99.994% ( 380, 580 ] 2 0.001% 99.995% ( 580, 870 ] 1 0.001% 99.995% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 4 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15859 Average: 1.8965 StdDev: 8.34 Min: 0 Median: 1.3035 Max: 932 Percentiles: P50: 1.30 P75: 1.70 P99: 3.72 P99.9: 10.57 P99.99: 462.82 ------------------------------------------------------ [ 0, 1 ] 4923 31.042% 31.042% ###### ( 1, 2 ] 9907 62.469% 93.512% ############ ( 2, 3 ] 745 4.698% 98.209% # ( 3, 4 ] 175 1.103% 99.313% ( 4, 6 ] 69 0.435% 99.748% ( 6, 10 ] 23 0.145% 99.893% ( 10, 15 ] 10 0.063% 99.956% ( 15, 22 ] 3 0.019% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 380, 580 ] 1 0.006% 99.994% ( 870, 1300 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 95 Average: 1800.1158 StdDev: 2279.53 Min: 1 Median: 725.0000 Max: 8286 Percentiles: P50: 725.00 P75: 3355.36 P99: 8286.00 P99.9: 8286.00 P99.99: 8286.00 ------------------------------------------------------ [ 0, 1 ] 18 18.947% 18.947% #### ( 1, 2 ] 14 14.737% 33.684% ### ( 2, 3 ] 1 1.053% 34.737% ( 4, 6 ] 2 2.105% 36.842% ( 6, 10 ] 1 1.053% 37.895% ( 51, 76 ] 1 1.053% 38.947% ( 170, 250 ] 2 2.105% 41.053% ( 250, 380 ] 1 1.053% 42.105% ( 380, 580 ] 3 3.158% 45.263% # ( 580, 870 ] 9 9.474% 54.737% ## ( 870, 1300 ] 5 5.263% 60.000% # ( 1300, 1900 ] 7 7.368% 67.368% # ( 1900, 2900 ] 3 3.158% 70.526% # ( 2900, 4400 ] 14 14.737% 85.263% ### ( 4400, 6600 ] 8 8.421% 93.684% ## ( 6600, 9900 ] 6 6.316% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 4012.9000 StdDev: 1692.35 Min: 869 Median: 3900.0000 Max: 6851 Percentiles: P50: 3900.00 P75: 5133.33 P99: 6851.00 P99.9: 6851.00 P99.99: 6851.00 ------------------------------------------------------ ( 580, 870 ] 1 5.000% 5.000% # ( 870, 1300 ] 2 10.000% 15.000% ## ( 1300, 1900 ] 1 5.000% 20.000% # ( 2900, 4400 ] 9 45.000% 65.000% ######### ( 4400, 6600 ] 6 30.000% 95.000% ###### ( 6600, 9900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 8.8 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 334.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.988 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 356.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.190 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-06:24:44 ... thread 0: (1000000,4000000) ops and (313523.7,338124.5) ops/second in (3.189552,11.829963) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.34 GB 207.7 2.5 0.0 2.5 6.2 3.7 0.0 1.7 124.4 313.9 20.26 18.91 62 0.327 2558K 2650 0.0 0.0 L1 12/0 1.34 GB 137.6 2.2 1.3 0.9 2.1 1.3 0.1 1.7 233.5 232.6 9.43 9.15 3 3.144 2236K 8542 0.0 0.0 L2 1/0 48.91 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 248.6 248.5 0.45 0.43 1 0.448 113K 25 0.0 0.0 L3 19/0 944.34 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.3 201.3 0.31 0.26 1 0.310 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1200/4 99.88 GB 0.0 4.8 1.4 3.4 8.5 5.2 0.2 2.3 160.8 286.6 30.45 28.74 67 0.454 4971K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 1.4 3.4 8.5 5.2 0.1 2.3 160.8 286.6 30.45 28.74 67 0.454 4971K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 1.4 3.4 4.8 1.4 0.0 0.0 248.4 247.8 19.71 19.18 14 1.408 4971K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 357.9 10.74 9.57 53 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.52 GB write, 725.97 MB/s write, 4.78 GB read, 407.29 MB/s read, 30.5 seconds Interval compaction: 8.52 GB write, 737.65 MB/s write, 4.78 GB read, 413.84 MB/s read, 30.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1008683 Average: 2.2850 StdDev: 11.36 Min: 0 Median: 1.5478 Max: 3879 Percentiles: P50: 1.55 P75: 1.92 P99: 5.64 P99.9: 11.39 P99.99: 18.20 ------------------------------------------------------ [ 0, 1 ] 134993 13.383% 13.383% ### ( 1, 2 ] 674217 66.841% 80.224% ############# ( 2, 3 ] 142224 14.100% 94.324% ### ( 3, 4 ] 29416 2.916% 97.241% # ( 4, 6 ] 21593 2.141% 99.381% ( 6, 10 ] 4900 0.486% 99.867% ( 10, 15 ] 1193 0.118% 99.985% ( 15, 22 ] 103 0.010% 99.996% ( 22, 34 ] 11 0.001% 99.997% ( 34, 51 ] 10 0.001% 99.998% ( 51, 76 ] 6 0.001% 99.998% ( 76, 110 ] 45 0.004% 100.003% ( 110, 170 ] 72 0.007% 100.010% ( 170, 250 ] 35 0.003% 100.013% ( 250, 380 ] 27 0.003% 100.016% ( 380, 580 ] 30 0.003% 100.019% ( 580, 870 ] 25 0.002% 100.022% ( 870, 1300 ] 13 0.001% 100.023% ( 1300, 1900 ] 6 0.001% 100.023% ( 1900, 2900 ] 6 0.001% 100.024% ( 2900, 4400 ] 4 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 219888 Average: 2.4359 StdDev: 14.33 Min: 0 Median: 1.5605 Max: 1927 Percentiles: P50: 1.56 P75: 1.94 P99: 5.65 P99.9: 15.81 P99.99: 580.81 ------------------------------------------------------ [ 0, 1 ] 27761 12.625% 12.625% ### ( 1, 2 ] 146617 66.678% 79.303% ############# ( 2, 3 ] 33196 15.097% 94.400% ### ( 3, 4 ] 6215 2.826% 97.226% # ( 4, 6 ] 4718 2.146% 99.372% ( 6, 10 ] 975 0.443% 99.815% ( 10, 15 ] 183 0.083% 99.899% ( 15, 22 ] 27 0.012% 99.911% ( 22, 34 ] 5 0.002% 99.913% ( 34, 51 ] 7 0.003% 99.916% ( 51, 76 ] 46 0.021% 99.937% ( 76, 110 ] 22 0.010% 99.947% ( 110, 170 ] 42 0.019% 99.966% ( 170, 250 ] 18 0.008% 99.975% ( 250, 380 ] 19 0.009% 99.983% ( 380, 580 ] 15 0.007% 99.990% ( 580, 870 ] 4 0.002% 99.992% ( 870, 1300 ] 6 0.003% 99.995% ( 1300, 1900 ] 11 0.005% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 15859 Average: 1.8965 StdDev: 8.34 Min: 0 Median: 1.3035 Max: 932 Percentiles: P50: 1.30 P75: 1.70 P99: 3.72 P99.9: 10.57 P99.99: 462.82 ------------------------------------------------------ [ 0, 1 ] 4923 31.042% 31.042% ###### ( 1, 2 ] 9907 62.469% 93.512% ############ ( 2, 3 ] 745 4.698% 98.209% # ( 3, 4 ] 175 1.103% 99.313% ( 4, 6 ] 69 0.435% 99.748% ( 6, 10 ] 23 0.145% 99.893% ( 10, 15 ] 10 0.063% 99.956% ( 15, 22 ] 3 0.019% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 380, 580 ] 1 0.006% 99.994% ( 870, 1300 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 95 Average: 1800.1158 StdDev: 2279.53 Min: 1 Median: 725.0000 Max: 8286 Percentiles: P50: 725.00 P75: 3355.36 P99: 8286.00 P99.9: 8286.00 P99.99: 8286.00 ------------------------------------------------------ [ 0, 1 ] 18 18.947% 18.947% #### ( 1, 2 ] 14 14.737% 33.684% ### ( 2, 3 ] 1 1.053% 34.737% ( 4, 6 ] 2 2.105% 36.842% ( 6, 10 ] 1 1.053% 37.895% ( 51, 76 ] 1 1.053% 38.947% ( 170, 250 ] 2 2.105% 41.053% ( 250, 380 ] 1 1.053% 42.105% ( 380, 580 ] 3 3.158% 45.263% # ( 580, 870 ] 9 9.474% 54.737% ## ( 870, 1300 ] 5 5.263% 60.000% # ( 1300, 1900 ] 7 7.368% 67.368% # ( 1900, 2900 ] 3 3.158% 70.526% # ( 2900, 4400 ] 14 14.737% 85.263% ### ( 4400, 6600 ] 8 8.421% 93.684% ## ( 6600, 9900 ] 6 6.316% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 4012.9000 StdDev: 1692.35 Min: 869 Median: 3900.0000 Max: 6851 Percentiles: P50: 3900.00 P75: 5133.33 P99: 6851.00 P99.9: 6851.00 P99.99: 6851.00 ------------------------------------------------------ ( 580, 870 ] 1 5.000% 5.000% # ( 870, 1300 ] 2 10.000% 15.000% ## ( 1300, 1900 ] 1 5.000% 20.000% # ( 2900, 4400 ] 9 45.000% 65.000% ######### ( 4400, 6600 ] 6 30.000% 95.000% ###### ( 6600, 9900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 327.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.584 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 308.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.596 H:M:S, 18.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-06:24:47 ... thread 0: (1000000,5000000) ops and (338686.5,338236.7) ops/second in (2.952583,14.782546) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/4 3.32 GB 314.7 3.3 0.0 3.3 8.1 4.7 0.0 1.7 129.4 313.8 26.28 24.61 79 0.333 3454K 3613 0.0 0.0 L1 12/0 1.34 GB 137.6 2.2 1.3 0.9 2.1 1.3 0.1 1.7 233.5 232.6 9.43 9.15 3 3.144 2236K 8542 0.0 0.0 L2 1/0 48.91 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 248.6 248.5 0.45 0.43 1 0.448 113K 25 0.0 0.0 L3 19/0 944.34 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.3 201.3 0.31 0.26 1 0.310 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1205/4 100.86 GB 0.0 5.6 1.4 4.2 10.4 6.1 0.2 2.2 158.4 291.1 36.47 34.44 84 0.434 5867K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.6 1.4 4.2 10.4 6.1 0.1 2.2 158.4 291.1 36.47 34.44 84 0.434 5867K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.6 1.4 4.2 5.6 1.4 0.0 0.0 251.2 250.6 23.00 22.42 17 1.353 5867K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 360.1 13.47 12.02 67 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.0 total, 14.8 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.37 GB write, 708.96 MB/s write, 5.64 GB read, 385.87 MB/s read, 36.5 seconds Interval compaction: 10.37 GB write, 718.09 MB/s write, 5.64 GB read, 390.84 MB/s read, 36.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 19, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1271300 Average: 2.2365 StdDev: 11.04 Min: 0 Median: 1.5236 Max: 3879 Percentiles: P50: 1.52 P75: 1.90 P99: 5.55 P99.9: 11.26 P99.99: 18.32 ------------------------------------------------------ [ 0, 1 ] 188848 14.855% 14.855% ### ( 1, 2 ] 853289 67.119% 81.974% ############# ( 2, 3 ] 163255 12.842% 94.816% ### ( 3, 4 ] 34316 2.699% 97.515% # ( 4, 6 ] 24361 1.916% 99.431% ( 6, 10 ] 5594 0.440% 99.871% ( 10, 15 ] 1452 0.114% 99.985% ( 15, 22 ] 124 0.010% 99.995% ( 22, 34 ] 16 0.001% 99.996% ( 34, 51 ] 12 0.001% 99.997% ( 51, 76 ] 8 0.001% 99.998% ( 76, 110 ] 45 0.004% 100.002% ( 110, 170 ] 79 0.006% 100.008% ( 170, 250 ] 40 0.003% 100.011% ( 250, 380 ] 31 0.002% 100.013% ( 380, 580 ] 37 0.003% 100.016% ( 580, 870 ] 29 0.002% 100.019% ( 870, 1300 ] 16 0.001% 100.020% ( 1300, 1900 ] 8 0.001% 100.020% ( 1900, 2900 ] 7 0.001% 100.021% ( 2900, 4400 ] 5 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 219888 Average: 2.4359 StdDev: 14.33 Min: 0 Median: 1.5605 Max: 1927 Percentiles: P50: 1.56 P75: 1.94 P99: 5.65 P99.9: 15.81 P99.99: 580.81 ------------------------------------------------------ [ 0, 1 ] 27761 12.625% 12.625% ### ( 1, 2 ] 146617 66.678% 79.303% ############# ( 2, 3 ] 33196 15.097% 94.400% ### ( 3, 4 ] 6215 2.826% 97.226% # ( 4, 6 ] 4718 2.146% 99.372% ( 6, 10 ] 975 0.443% 99.815% ( 10, 15 ] 183 0.083% 99.899% ( 15, 22 ] 27 0.012% 99.911% ( 22, 34 ] 5 0.002% 99.913% ( 34, 51 ] 7 0.003% 99.916% ( 51, 76 ] 46 0.021% 99.937% ( 76, 110 ] 22 0.010% 99.947% ( 110, 170 ] 42 0.019% 99.966% ( 170, 250 ] 18 0.008% 99.975% ( 250, 380 ] 19 0.009% 99.983% ( 380, 580 ] 15 0.007% 99.990% ( 580, 870 ] 4 0.002% 99.992% ( 870, 1300 ] 6 0.003% 99.995% ( 1300, 1900 ] 11 0.005% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 15859 Average: 1.8965 StdDev: 8.34 Min: 0 Median: 1.3035 Max: 932 Percentiles: P50: 1.30 P75: 1.70 P99: 3.72 P99.9: 10.57 P99.99: 462.82 ------------------------------------------------------ [ 0, 1 ] 4923 31.042% 31.042% ###### ( 1, 2 ] 9907 62.469% 93.512% ############ ( 2, 3 ] 745 4.698% 98.209% # ( 3, 4 ] 175 1.103% 99.313% ( 4, 6 ] 69 0.435% 99.748% ( 6, 10 ] 23 0.145% 99.893% ( 10, 15 ] 10 0.063% 99.956% ( 15, 22 ] 3 0.019% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 380, 580 ] 1 0.006% 99.994% ( 870, 1300 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 95 Average: 1800.1158 StdDev: 2279.53 Min: 1 Median: 725.0000 Max: 8286 Percentiles: P50: 725.00 P75: 3355.36 P99: 8286.00 P99.9: 8286.00 P99.99: 8286.00 ------------------------------------------------------ [ 0, 1 ] 18 18.947% 18.947% #### ( 1, 2 ] 14 14.737% 33.684% ### ( 2, 3 ] 1 1.053% 34.737% ( 4, 6 ] 2 2.105% 36.842% ( 6, 10 ] 1 1.053% 37.895% ( 51, 76 ] 1 1.053% 38.947% ( 170, 250 ] 2 2.105% 41.053% ( 250, 380 ] 1 1.053% 42.105% ( 380, 580 ] 3 3.158% 45.263% # ( 580, 870 ] 9 9.474% 54.737% ## ( 870, 1300 ] 5 5.263% 60.000% # ( 1300, 1900 ] 7 7.368% 67.368% # ( 1900, 2900 ] 3 3.158% 70.526% # ( 2900, 4400 ] 14 14.737% 85.263% ### ( 4400, 6600 ] 8 8.421% 93.684% ## ( 6600, 9900 ] 6 6.316% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 4012.9000 StdDev: 1692.35 Min: 869 Median: 3900.0000 Max: 6851 Percentiles: P50: 3900.00 P75: 5133.33 P99: 6851.00 P99.9: 6851.00 P99.99: 6851.00 ------------------------------------------------------ ( 580, 870 ] 1 5.000% 5.000% # ( 870, 1300 ] 2 10.000% 15.000% ## ( 1300, 1900 ] 1 5.000% 20.000% # ( 2900, 4400 ] 9 45.000% 65.000% ######### ( 4400, 6600 ] 6 30.000% 95.000% ###### ( 6600, 9900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.0 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 328.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.977 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.392 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-06:25:15 ... thread 0: (1000000,6000000) ops and (35446.8,139554.8) ops/second in (28.211326,42.993872) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 3/2 377.74 MB 6.3 4.4 0.0 4.4 10.0 5.7 0.0 1.8 135.7 311.3 32.97 30.93 98 0.336 4541K 4694 0.0 0.0 L1 1/1 60.91 MB 0.0 7.4 5.2 2.2 7.2 5.0 0.1 1.4 215.3 211.3 35.05 31.44 4 8.761 7660K 138K 0.0 0.0 L2 41/38 5.08 GB 3.9 0.1 0.1 0.0 0.1 0.1 5.1 1.8 248.6 248.5 0.45 0.43 1 0.448 113K 25 0.0 0.0 L3 19/14 944.34 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 201.3 201.3 0.31 0.26 1 0.310 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1220/55 101.66 GB 0.0 11.9 5.3 6.6 17.4 10.8 5.2 3.1 177.3 259.4 68.77 63.05 104 0.661 12M 142K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.9 5.3 6.6 17.4 10.8 5.2 3.1 177.3 259.4 68.77 63.05 104 0.661 12M 142K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.9 5.3 6.6 11.8 5.1 0.0 0.0 231.6 228.9 52.64 48.67 22 2.393 12M 142K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 359.2 16.13 14.38 82 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.2 total, 43.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.43 GB write, 413.18 MB/s write, 11.90 GB read, 282.28 MB/s read, 68.8 seconds Interval compaction: 17.43 GB write, 415.00 MB/s write, 11.90 GB read, 283.53 MB/s read, 68.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 19, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2529022 Average: 3.2057 StdDev: 18.92 Min: 0 Median: 1.4573 Max: 4167 Percentiles: P50: 1.46 P75: 1.83 P99: 9.26 P99.9: 169.22 P99.99: 502.23 ------------------------------------------------------ [ 0, 1 ] 483742 19.128% 19.128% #### ( 1, 2 ] 1707261 67.507% 86.634% ############## ( 2, 3 ] 208015 8.225% 94.860% ## ( 3, 4 ] 55181 2.182% 97.041% ( 4, 6 ] 40441 1.599% 98.641% ( 6, 10 ] 11149 0.441% 99.081% ( 10, 15 ] 2961 0.117% 99.198% ( 15, 22 ] 668 0.026% 99.225% ( 22, 34 ] 36 0.001% 99.226% ( 34, 51 ] 14 0.001% 99.227% ( 51, 76 ] 32 0.001% 99.228% ( 76, 110 ] 8984 0.355% 99.583% ( 110, 170 ] 8115 0.321% 99.904% ( 170, 250 ] 979 0.039% 99.943% ( 250, 380 ] 759 0.030% 99.973% ( 380, 580 ] 707 0.028% 100.001% ( 580, 870 ] 216 0.009% 100.009% ( 870, 1300 ] 41 0.002% 100.011% ( 1300, 1900 ] 16 0.001% 100.012% ( 1900, 2900 ] 15 0.001% 100.012% ( 2900, 4400 ] 14 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 610397 Average: 3.0017 StdDev: 22.04 Min: 0 Median: 1.4523 Max: 3936 Percentiles: P50: 1.45 P75: 1.84 P99: 8.16 P99.9: 162.58 P99.99: 773.01 ------------------------------------------------------ [ 0, 1 ] 126990 20.804% 20.804% #### ( 1, 2 ] 394039 64.555% 85.359% ############# ( 2, 3 ] 52339 8.575% 93.934% ## ( 3, 4 ] 15386 2.521% 96.454% # ( 4, 6 ] 13639 2.234% 98.689% ( 6, 10 ] 3518 0.576% 99.265% ( 10, 15 ] 878 0.144% 99.409% ( 15, 22 ] 244 0.040% 99.449% ( 22, 34 ] 9 0.001% 99.450% ( 34, 51 ] 8 0.001% 99.452% ( 51, 76 ] 50 0.008% 99.460% ( 76, 110 ] 1423 0.233% 99.693% ( 110, 170 ] 1443 0.236% 99.929% ( 170, 250 ] 133 0.022% 99.951% ( 250, 380 ] 100 0.016% 99.968% ( 380, 580 ] 114 0.019% 99.986% ( 580, 870 ] 36 0.006% 99.992% ( 870, 1300 ] 32 0.005% 99.997% ( 1300, 1900 ] 19 0.003% 100.000% ( 1900, 2900 ] 16 0.003% 100.003% ( 2900, 4400 ] 3 0.000% 100.004% ** Level 2 read latency histogram (micros): Count: 15872 Average: 2.1745 StdDev: 13.22 Min: 0 Median: 1.3041 Max: 932 Percentiles: P50: 1.30 P75: 1.70 P99: 3.79 P99.9: 143.84 P99.99: 560.43 ------------------------------------------------------ [ 0, 1 ] 4923 31.017% 31.017% ###### ( 1, 2 ] 9907 62.418% 93.435% ############ ( 2, 3 ] 745 4.694% 98.129% # ( 3, 4 ] 175 1.103% 99.231% ( 4, 6 ] 69 0.435% 99.666% ( 6, 10 ] 23 0.145% 99.811% ( 10, 15 ] 10 0.063% 99.874% ( 15, 22 ] 3 0.019% 99.893% ( 110, 170 ] 2 0.013% 99.905% ( 170, 250 ] 4 0.025% 99.931% ( 250, 380 ] 4 0.025% 99.956% ( 380, 580 ] 6 0.038% 99.994% ( 870, 1300 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 23706 Average: 14.3967 StdDev: 190.09 Min: 1 Median: 1.9041 Max: 8286 Percentiles: P50: 1.90 P75: 2.73 P99: 215.81 P99.9: 3360.07 P99.99: 8286.00 ------------------------------------------------------ [ 0, 1 ] 450 1.898% 1.898% ( 1, 2 ] 12613 53.206% 55.104% ########### ( 2, 3 ] 6422 27.090% 82.194% ##### ( 3, 4 ] 1536 6.479% 88.674% # ( 4, 6 ] 1680 7.087% 95.761% # ( 6, 10 ] 572 2.413% 98.173% ( 10, 15 ] 81 0.342% 98.515% ( 15, 22 ] 14 0.059% 98.574% ( 22, 34 ] 1 0.004% 98.578% ( 51, 76 ] 1 0.004% 98.583% ( 76, 110 ] 13 0.055% 98.637% ( 110, 170 ] 48 0.202% 98.840% ( 170, 250 ] 68 0.287% 99.127% ( 250, 380 ] 46 0.194% 99.321% ( 380, 580 ] 58 0.245% 99.566% ( 580, 870 ] 50 0.211% 99.776% ( 870, 1300 ] 12 0.051% 99.827% ( 1300, 1900 ] 11 0.046% 99.873% ( 1900, 2900 ] 3 0.013% 99.886% ( 2900, 4400 ] 14 0.059% 99.945% ( 4400, 6600 ] 8 0.034% 99.979% ( 6600, 9900 ] 6 0.025% 100.004% ** Level 4 read latency histogram (micros): Count: 20 Average: 4012.9000 StdDev: 1692.35 Min: 869 Median: 3900.0000 Max: 6851 Percentiles: P50: 3900.00 P75: 5133.33 P99: 6851.00 P99.9: 6851.00 P99.99: 6851.00 ------------------------------------------------------ ( 580, 870 ] 1 5.000% 5.000% # ( 870, 1300 ] 2 10.000% 15.000% ## ( 1300, 1900 ] 1 5.000% 20.000% # ( 2900, 4400 ] 9 45.000% 65.000% ######### ( 4400, 6600 ] 6 30.000% 95.000% ###### ( 6600, 9900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 43.2 total, 28.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 136.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.698 H:M:S, 61.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 34.89 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:24.722 H:M:S, 87.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 8.770 micros/op 114024 ops/sec 60.092 seconds 6851999 operations; 110.5 MB/s Microseconds per write: Count: 6851999 Average: 8.7700 StdDev: 274.55 Min: 1 Median: 1.7285 Max: 271559 Percentiles: P50: 1.73 P75: 2.70 P99: 11.15 P99.9: 2085.41 P99.99: 2820.69 ------------------------------------------------------ [ 0, 1 ] 972019 14.186% 14.186% ### ( 1, 2 ] 3368765 49.165% 63.351% ########## ( 2, 3 ] 1141258 16.656% 80.006% ### ( 3, 4 ] 883765 12.898% 92.904% ### ( 4, 6 ] 313380 4.574% 97.478% # ( 6, 10 ] 96706 1.411% 98.889% ( 10, 15 ] 33126 0.483% 99.373% ( 15, 22 ] 6507 0.095% 99.468% ( 22, 34 ] 865 0.013% 99.480% ( 34, 51 ] 137 0.002% 99.482% ( 51, 76 ] 4 0.000% 99.482% ( 76, 110 ] 5287 0.077% 99.560% ( 110, 170 ] 1328 0.019% 99.579% ( 170, 250 ] 193 0.003% 99.582% ( 250, 380 ] 123 0.002% 99.584% ( 380, 580 ] 12 0.000% 99.584% ( 580, 870 ] 8 0.000% 99.584% ( 870, 1300 ] 20094 0.293% 99.877% ( 1300, 1900 ] 15 0.000% 99.877% ( 1900, 2900 ] 8387 0.122% 100.000% ( 2900, 4400 ] 3 0.000% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 9 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 187442 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6851999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 7071262968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 289 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 41365243 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 24518562834 rocksdb.compact.write.bytes COUNT : 24354562260 rocksdb.flush.write.bytes COUNT : 7068165341 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 12 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 118 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 7011177472 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2731008 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 24572378802 rocksdb.non.last.level.read.count COUNT : 5947168 rocksdb.block.checksum.compute.count COUNT : 5946602 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.364729 P95 : 3.917857 P99 : 9.358603 P100 : 271556.000000 COUNT : 6851999 SUM : 56851212 rocksdb.compaction.times.micros P50 : 1074736.842105 P95 : 5620000.000000 P99 : 25613433.000000 P100 : 25613433.000000 COUNT : 36 SUM : 78168479 rocksdb.compaction.times.cpu_micros P50 : 1054285.714286 P95 : 5620000.000000 P99 : 22288018.000000 P100 : 22288018.000000 COUNT : 36 SUM : 72358848 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 658.076923 P95 : 1118.444444 P99 : 1324.000000 P100 : 1558.000000 COUNT : 96 SUM : 63435 rocksdb.compaction.outfile.sync.micros P50 : 769.691781 P95 : 1352.500000 P99 : 1870.500000 P100 : 3923.000000 COUNT : 259 SUM : 213081 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 100.555556 P95 : 326.266667 P99 : 376.186667 P100 : 622.000000 COUNT : 144 SUM : 19721 rocksdb.table.open.io.micros P50 : 1319.565217 P95 : 8415.000000 P99 : 19898.181818 P100 : 21946.000000 COUNT : 289 SUM : 703015 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.640502 P95 : 7.021811 P99 : 12.510913 P100 : 6825.000000 COUNT : 5946013 SUM : 32584674 rocksdb.read.block.get.micros P50 : 540.416667 P95 : 3621.428571 P99 : 7515.750000 P100 : 8424.000000 COUNT : 578 SUM : 552063 rocksdb.write.raw.block.micros P50 : 0.510801 P95 : 0.970523 P99 : 2.621050 P100 : 4521.000000 COUNT : 7611705 SUM : 13059439 rocksdb.numfiles.in.singlecompaction P50 : 3.469697 P95 : 16.050000 P99 : 37.000000 P100 : 37.000000 COUNT : 57 SUM : 327 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565131 P95 : 1214.636348 P99 : 2606.277433 P100 : 271345.000000 COUNT : 247957 SUM : 41384933 rocksdb.sst.read.micros P50 : 1.603197 P95 : 4.128265 P99 : 9.277269 P100 : 8286.000000 COUNT : 5947615 SUM : 20715586 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6851999 SUM : 7071262968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 200344.827586 P95 : 335090.909091 P99 : 387600.000000 P100 : 429985.000000 COUNT : 96 SUM : 18977401 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 254 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0