[2024-11-20 18:31:54.213094] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-11-20 18:31:54.213258] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3277750 ] Set seed to 1732123914209079 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 18:31:54.319164] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 18:31:54.360906] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 18:31:54.360957] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3277750' to capture a snapshot of events at runtime. [2024-11-20 18:31:54.360968] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 18:31:54.360979] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 18:31:54.360986] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3277750 for offline analysis/debug. [2024-11-20 18:31:54.361076] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 18:31:58 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-18:32:01 ... thread 0: (1000000,1000000) ops and (327756.2,327756.2) ops/second in (3.051048,3.051048) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 503.96 MB 18.9 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 344.5 2.56 2.30 12 0.213 0 0 0.0 0.0 L1 2/0 187.54 MB 18.8 0.2 0.2 0.0 0.2 0.2 0.2 1.0 254.0 253.8 0.74 0.71 1 0.744 191K 130 0.0 0.0 L2 3/2 190.19 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 252.6 252.5 0.76 0.73 2 0.379 194K 81 0.0 0.0 L3 8/0 678.22 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 112/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1168/7 97.00 GB 0.0 0.4 0.3 0.1 1.2 1.2 1.1 1.4 93.7 310.7 4.06 3.75 15 0.271 386K 211 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.2 1.1 1.4 93.7 310.7 4.06 3.75 15 0.271 386K 211 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 253.3 253.2 1.50 1.44 3 0.501 386K 211 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 344.5 2.56 2.30 12 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.3 total, 3.1 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 386.54 MB/s write, 0.37 GB read, 116.54 MB/s read, 4.1 seconds Interval compaction: 1.23 GB write, 413.51 MB/s write, 0.37 GB read, 124.67 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 145262 Average: 1.8740 StdDev: 18.20 Min: 0 Median: 1.2343 Max: 4413 Percentiles: P50: 1.23 P75: 1.67 P99: 4.04 P99.9: 9.75 P99.99: 209.70 ------------------------------------------------------ [ 0, 1 ] 52991 36.480% 36.480% ####### ( 1, 2 ] 83837 57.714% 94.194% ############ ( 2, 3 ] 5007 3.447% 97.641% # ( 3, 4 ] 1957 1.347% 98.988% ( 4, 6 ] 916 0.631% 99.619% ( 6, 10 ] 436 0.300% 99.919% ( 10, 15 ] 83 0.057% 99.976% ( 15, 22 ] 8 0.006% 99.981% ( 22, 34 ] 2 0.001% 99.983% ( 34, 51 ] 1 0.001% 99.983% ( 51, 76 ] 1 0.001% 99.984% ( 110, 170 ] 5 0.003% 99.988% ( 170, 250 ] 7 0.005% 99.992% ( 250, 380 ] 4 0.003% 99.995% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.001% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ( 4400, 6600 ] 1 0.001% 100.001% ** Level 1 read latency histogram (micros): Count: 357 Average: 27.6162 StdDev: 248.46 Min: 1 Median: 1.5705 Max: 3662 Percentiles: P50: 1.57 P75: 1.98 P99: 642.35 P99.9: 3662.00 P99.99: 3662.00 ------------------------------------------------------ [ 0, 1 ] 53 14.846% 14.846% ### ( 1, 2 ] 220 61.625% 76.471% ############ ( 2, 3 ] 38 10.644% 87.115% ## ( 3, 4 ] 18 5.042% 92.157% # ( 4, 6 ] 10 2.801% 94.958% # ( 6, 10 ] 4 1.120% 96.078% ( 10, 15 ] 4 1.120% 97.199% ( 15, 22 ] 1 0.280% 97.479% ( 110, 170 ] 1 0.280% 97.759% ( 170, 250 ] 1 0.280% 98.039% ( 250, 380 ] 3 0.840% 98.880% ( 580, 870 ] 2 0.560% 99.440% ( 1900, 2900 ] 1 0.280% 99.720% ( 2900, 4400 ] 1 0.280% 100.000% ** Level 2 read latency histogram (micros): Count: 41890 Average: 2.1027 StdDev: 6.43 Min: 1 Median: 1.4638 Max: 986 Percentiles: P50: 1.46 P75: 1.82 P99: 5.53 P99.9: 9.95 P99.99: 20.34 ------------------------------------------------------ [ 0, 1 ] 7353 17.553% 17.553% #### ( 1, 2 ] 29307 69.962% 87.515% ############## ( 2, 3 ] 3045 7.269% 94.784% # ( 3, 4 ] 1286 3.070% 97.854% # ( 4, 6 ] 630 1.504% 99.358% ( 6, 10 ] 232 0.554% 99.912% ( 10, 15 ] 31 0.074% 99.986% ( 15, 22 ] 5 0.012% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 1 0.002% 100.002% ( 580, 870 ] 1 0.002% 100.005% ( 870, 1300 ] 1 0.002% 100.007% ** Level 3 read latency histogram (micros): Count: 55 Average: 1573.6000 StdDev: 1413.30 Min: 168 Median: 999.0000 Max: 6597 Percentiles: P50: 999.00 P75: 2364.29 P99: 5995.00 P99.9: 6539.50 P99.99: 6593.95 ------------------------------------------------------ ( 110, 170 ] 1 1.818% 1.818% ( 170, 250 ] 3 5.455% 7.273% # ( 250, 380 ] 4 7.273% 14.545% # ( 380, 580 ] 3 5.455% 20.000% # ( 580, 870 ] 15 27.273% 47.273% ##### ( 870, 1300 ] 5 9.091% 56.364% ## ( 1300, 1900 ] 7 12.727% 69.091% ### ( 1900, 2900 ] 7 12.727% 81.818% ### ( 2900, 4400 ] 8 14.545% 96.364% ### ( 4400, 6600 ] 2 3.636% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 1768.5500 StdDev: 1522.53 Min: 259 Median: 870.0000 Max: 5757 Percentiles: P50: 870.00 P75: 2900.00 P99: 5757.00 P99.9: 5757.00 P99.99: 5757.00 ------------------------------------------------------ ( 250, 380 ] 3 15.000% 15.000% ### ( 380, 580 ] 1 5.000% 20.000% # ( 580, 870 ] 6 30.000% 50.000% ###### ( 870, 1300 ] 1 5.000% 55.000% # ( 1300, 1900 ] 3 15.000% 70.000% ### ( 1900, 2900 ] 1 5.000% 75.000% # ( 2900, 4400 ] 3 15.000% 90.000% ### ( 4400, 6600 ] 2 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 435.8000 StdDev: 494.34 Min: 80 Median: 104.3333 Max: 1576 Percentiles: P50: 104.33 P75: 870.00 P99: 1576.00 P99.9: 1576.00 P99.99: 1576.00 ------------------------------------------------------ ( 76, 110 ] 12 60.000% 60.000% ############ ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 1 5.000% 70.000% # ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 4 20.000% 95.000% #### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 3.3 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 301.36 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.438 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.31 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.438 H:M:S, 14.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-18:32:04 ... thread 0: (1000000,2000000) ops and (351080.2,339017.5) ops/second in (2.848352,5.899400) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.41 GB 88.1 0.9 0.0 0.9 2.6 1.8 0.0 1.5 104.0 319.2 8.48 7.88 29 0.293 895K 1002 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 254.0 253.8 0.74 0.71 1 0.744 191K 130 0.0 0.0 L2 1/0 2.61 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 1.5 252.6 252.5 0.76 0.73 2 0.379 194K 81 0.0 0.0 L3 48/0 982.66 MB 1.0 0.5 0.4 0.2 0.5 0.4 0.1 1.5 198.0 197.9 2.84 2.45 3 0.947 571K 371 0.0 0.0 L4 124/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1220/8 97.92 GB 0.0 1.8 0.7 1.1 3.6 2.5 1.4 2.0 142.3 284.6 12.83 11.77 35 0.366 1853K 1584 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.7 1.1 3.6 2.5 1.4 2.0 142.3 284.6 12.83 11.77 35 0.366 1853K 1584 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.7 1.1 1.8 0.7 0.0 0.0 239.5 239.3 7.62 7.10 9 0.847 1853K 1584 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.8 5.21 4.67 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.56 GB write, 597.08 MB/s write, 1.78 GB read, 298.54 MB/s read, 12.8 seconds Interval compaction: 3.56 GB write, 618.64 MB/s write, 1.78 GB read, 309.32 MB/s read, 12.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 382796 Average: 2.0113 StdDev: 15.13 Min: 0 Median: 1.3457 Max: 4413 Percentiles: P50: 1.35 P75: 1.76 P99: 5.22 P99.9: 9.86 P99.99: 17.16 ------------------------------------------------------ [ 0, 1 ] 110835 28.954% 28.954% ###### ( 1, 2 ] 233047 60.880% 89.834% ############ ( 2, 3 ] 22767 5.948% 95.782% # ( 3, 4 ] 9186 2.400% 98.182% ( 4, 6 ] 5147 1.345% 99.526% ( 6, 10 ] 1483 0.387% 99.914% ( 10, 15 ] 286 0.075% 99.988% ( 15, 22 ] 25 0.007% 99.995% ( 22, 34 ] 4 0.001% 99.996% ( 34, 51 ] 4 0.001% 99.997% ( 51, 76 ] 2 0.001% 99.997% ( 110, 170 ] 9 0.002% 100.000% ( 170, 250 ] 17 0.004% 100.004% ( 250, 380 ] 7 0.002% 100.006% ( 380, 580 ] 3 0.001% 100.007% ( 580, 870 ] 2 0.001% 100.007% ( 870, 1300 ] 9 0.002% 100.010% ( 1300, 1900 ] 5 0.001% 100.011% ( 1900, 2900 ] 3 0.001% 100.012% ( 2900, 4400 ] 2 0.001% 100.012% ( 4400, 6600 ] 1 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 47953 Average: 2.5467 StdDev: 21.58 Min: 1 Median: 1.6242 Max: 3662 Percentiles: P50: 1.62 P75: 2.01 P99: 6.17 P99.9: 13.06 P99.99: 25.61 ------------------------------------------------------ [ 0, 1 ] 4236 8.834% 8.834% ## ( 1, 2 ] 31625 65.950% 74.784% ############# ( 2, 3 ] 7299 15.221% 90.005% ### ( 3, 4 ] 2500 5.213% 95.218% # ( 4, 6 ] 1797 3.747% 98.966% # ( 6, 10 ] 393 0.820% 99.785% ( 10, 15 ] 90 0.188% 99.973% ( 15, 22 ] 7 0.015% 99.987% ( 22, 34 ] 4 0.008% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 3 0.006% 100.006% ( 580, 870 ] 2 0.004% 100.010% ( 1900, 2900 ] 1 0.002% 100.013% ( 2900, 4400 ] 1 0.002% 100.015% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.1115 StdDev: 6.02 Min: 1 Median: 1.4760 Max: 986 Percentiles: P50: 1.48 P75: 1.83 P99: 5.50 P99.9: 9.94 P99.99: 19.48 ------------------------------------------------------ [ 0, 1 ] 8015 16.710% 16.710% ### ( 1, 2 ] 33549 69.943% 86.653% ############## ( 2, 3 ] 3914 8.160% 94.813% ## ( 3, 4 ] 1462 3.048% 97.861% # ( 4, 6 ] 730 1.522% 99.383% ( 6, 10 ] 252 0.525% 99.908% ( 10, 15 ] 36 0.075% 99.983% ( 15, 22 ] 5 0.010% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ( 870, 1300 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 47971 Average: 4.2045 StdDev: 71.74 Min: 0 Median: 1.6107 Max: 6597 Percentiles: P50: 1.61 P75: 1.99 P99: 6.76 P99.9: 237.05 P99.99: 2500.41 ------------------------------------------------------ [ 0, 1 ] 4671 9.737% 9.737% ## ( 1, 2 ] 31628 65.932% 75.669% ############# ( 2, 3 ] 7020 14.634% 90.302% ### ( 3, 4 ] 2442 5.091% 95.393% # ( 4, 6 ] 1660 3.460% 98.853% # ( 6, 10 ] 368 0.767% 99.621% ( 10, 15 ] 87 0.181% 99.802% ( 15, 22 ] 31 0.065% 99.867% ( 22, 34 ] 5 0.010% 99.877% ( 34, 51 ] 1 0.002% 99.879% ( 110, 170 ] 5 0.010% 99.890% ( 170, 250 ] 6 0.013% 99.902% ( 250, 380 ] 6 0.013% 99.915% ( 380, 580 ] 4 0.008% 99.923% ( 580, 870 ] 15 0.031% 99.954% ( 870, 1300 ] 6 0.013% 99.967% ( 1300, 1900 ] 7 0.015% 99.981% ( 1900, 2900 ] 7 0.015% 99.996% ( 2900, 4400 ] 8 0.017% 100.013% ( 4400, 6600 ] 2 0.004% 100.017% ** Level 4 read latency histogram (micros): Count: 20 Average: 1768.5500 StdDev: 1522.53 Min: 259 Median: 870.0000 Max: 5757 Percentiles: P50: 870.00 P75: 2900.00 P99: 5757.00 P99.9: 5757.00 P99.99: 5757.00 ------------------------------------------------------ ( 250, 380 ] 3 15.000% 15.000% ### ( 380, 580 ] 1 5.000% 20.000% # ( 580, 870 ] 6 30.000% 50.000% ###### ( 870, 1300 ] 1 5.000% 55.000% # ( 1300, 1900 ] 3 15.000% 70.000% ### ( 1900, 2900 ] 1 5.000% 75.000% # ( 2900, 4400 ] 3 15.000% 90.000% ### ( 4400, 6600 ] 2 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 435.8000 StdDev: 494.34 Min: 80 Median: 104.3333 Max: 1576 Percentiles: P50: 104.33 P75: 870.00 P99: 1576.00 P99.9: 1576.00 P99.99: 1576.00 ------------------------------------------------------ ( 76, 110 ] 12 60.000% 60.000% ############ ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 1 5.000% 70.000% # ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 4 20.000% 95.000% #### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 321.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.637 H:M:S, 10.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 345.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.198 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-18:32:07 ... thread 0: (1000000,3000000) ops and (336060.9,338026.2) ops/second in (2.975651,8.875051) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.40 GB 214.0 2.0 0.0 2.0 4.7 2.8 0.0 1.7 130.8 314.6 15.41 14.45 47 0.328 2046K 2167 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 254.0 253.8 0.74 0.71 1 0.744 191K 130 0.0 0.0 L2 1/0 2.61 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 1.5 252.6 252.5 0.76 0.73 2 0.379 194K 81 0.0 0.0 L3 48/0 982.66 MB 1.0 0.5 0.4 0.2 0.5 0.4 0.1 1.5 198.0 197.9 2.84 2.45 3 0.947 571K 371 0.0 0.0 L4 124/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1222/4 98.90 GB 0.0 2.9 0.7 2.2 5.7 3.4 1.4 2.0 149.8 293.1 19.76 18.34 53 0.373 3004K 2749 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 0.7 2.2 5.7 3.4 1.4 2.0 149.8 293.1 19.76 18.34 53 0.373 3004K 2749 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 0.7 2.2 2.9 0.7 0.0 0.0 250.6 250.3 11.81 11.21 13 0.908 3004K 2749 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 356.7 7.95 7.13 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.66 GB write, 637.12 MB/s write, 2.89 GB read, 325.56 MB/s read, 19.8 seconds Interval compaction: 5.66 GB write, 652.41 MB/s write, 2.89 GB read, 333.38 MB/s read, 19.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 640769 Average: 1.9788 StdDev: 14.41 Min: 0 Median: 1.3304 Max: 4413 Percentiles: P50: 1.33 P75: 1.74 P99: 4.99 P99.9: 9.96 P99.99: 18.01 ------------------------------------------------------ [ 0, 1 ] 191032 29.813% 29.813% ###### ( 1, 2 ] 391529 61.103% 90.916% ############ ( 2, 3 ] 34792 5.430% 96.346% # ( 3, 4 ] 13532 2.112% 98.457% ( 4, 6 ] 7013 1.094% 99.552% ( 6, 10 ] 2250 0.351% 99.903% ( 10, 15 ] 535 0.083% 99.987% ( 15, 22 ] 51 0.008% 99.995% ( 22, 34 ] 5 0.001% 99.995% ( 34, 51 ] 6 0.001% 99.996% ( 51, 76 ] 6 0.001% 99.997% ( 76, 110 ] 1 0.000% 99.997% ( 110, 170 ] 12 0.002% 99.999% ( 170, 250 ] 25 0.004% 100.003% ( 250, 380 ] 12 0.002% 100.005% ( 380, 580 ] 6 0.001% 100.006% ( 580, 870 ] 11 0.002% 100.008% ( 870, 1300 ] 10 0.002% 100.009% ( 1300, 1900 ] 8 0.001% 100.010% ( 1900, 2900 ] 5 0.001% 100.011% ( 2900, 4400 ] 4 0.001% 100.012% ( 4400, 6600 ] 1 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 47953 Average: 2.5467 StdDev: 21.58 Min: 1 Median: 1.6242 Max: 3662 Percentiles: P50: 1.62 P75: 2.01 P99: 6.17 P99.9: 13.06 P99.99: 25.61 ------------------------------------------------------ [ 0, 1 ] 4236 8.834% 8.834% ## ( 1, 2 ] 31625 65.950% 74.784% ############# ( 2, 3 ] 7299 15.221% 90.005% ### ( 3, 4 ] 2500 5.213% 95.218% # ( 4, 6 ] 1797 3.747% 98.966% # ( 6, 10 ] 393 0.820% 99.785% ( 10, 15 ] 90 0.188% 99.973% ( 15, 22 ] 7 0.015% 99.987% ( 22, 34 ] 4 0.008% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 3 0.006% 100.006% ( 580, 870 ] 2 0.004% 100.010% ( 1900, 2900 ] 1 0.002% 100.013% ( 2900, 4400 ] 1 0.002% 100.015% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.1115 StdDev: 6.02 Min: 1 Median: 1.4760 Max: 986 Percentiles: P50: 1.48 P75: 1.83 P99: 5.50 P99.9: 9.94 P99.99: 19.48 ------------------------------------------------------ [ 0, 1 ] 8015 16.710% 16.710% ### ( 1, 2 ] 33549 69.943% 86.653% ############## ( 2, 3 ] 3914 8.160% 94.813% ## ( 3, 4 ] 1462 3.048% 97.861% # ( 4, 6 ] 730 1.522% 99.383% ( 6, 10 ] 252 0.525% 99.908% ( 10, 15 ] 36 0.075% 99.983% ( 15, 22 ] 5 0.010% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ( 870, 1300 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 47971 Average: 4.2045 StdDev: 71.74 Min: 0 Median: 1.6107 Max: 6597 Percentiles: P50: 1.61 P75: 1.99 P99: 6.76 P99.9: 237.05 P99.99: 2500.41 ------------------------------------------------------ [ 0, 1 ] 4671 9.737% 9.737% ## ( 1, 2 ] 31628 65.932% 75.669% ############# ( 2, 3 ] 7020 14.634% 90.302% ### ( 3, 4 ] 2442 5.091% 95.393% # ( 4, 6 ] 1660 3.460% 98.853% # ( 6, 10 ] 368 0.767% 99.621% ( 10, 15 ] 87 0.181% 99.802% ( 15, 22 ] 31 0.065% 99.867% ( 22, 34 ] 5 0.010% 99.877% ( 34, 51 ] 1 0.002% 99.879% ( 110, 170 ] 5 0.010% 99.890% ( 170, 250 ] 6 0.013% 99.902% ( 250, 380 ] 6 0.013% 99.915% ( 380, 580 ] 4 0.008% 99.923% ( 580, 870 ] 15 0.031% 99.954% ( 870, 1300 ] 6 0.013% 99.967% ( 1300, 1900 ] 7 0.015% 99.981% ( 1900, 2900 ] 7 0.015% 99.996% ( 2900, 4400 ] 8 0.017% 100.013% ( 4400, 6600 ] 2 0.004% 100.017% ** Level 4 read latency histogram (micros): Count: 20 Average: 1768.5500 StdDev: 1522.53 Min: 259 Median: 870.0000 Max: 5757 Percentiles: P50: 870.00 P75: 2900.00 P99: 5757.00 P99.9: 5757.00 P99.99: 5757.00 ------------------------------------------------------ ( 250, 380 ] 3 15.000% 15.000% ### ( 380, 580 ] 1 5.000% 20.000% # ( 580, 870 ] 6 30.000% 50.000% ###### ( 870, 1300 ] 1 5.000% 55.000% # ( 1300, 1900 ] 3 15.000% 70.000% ### ( 1900, 2900 ] 1 5.000% 75.000% # ( 2900, 4400 ] 3 15.000% 90.000% ### ( 4400, 6600 ] 2 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 435.8000 StdDev: 494.34 Min: 80 Median: 104.3333 Max: 1576 Percentiles: P50: 104.33 P75: 870.00 P99: 1576.00 P99.9: 1576.00 P99.99: 1576.00 ------------------------------------------------------ ( 76, 110 ] 12 60.000% 60.000% ############ ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 1 5.000% 70.000% # ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 4 20.000% 95.000% #### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.997 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.360 H:M:S, 12.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-18:32:10 ... thread 0: (1000000,4000000) ops and (333512.1,336886.3) ops/second in (2.998392,11.873443) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/18 3.38 GB 0.0 2.8 0.0 2.8 6.5 3.7 0.0 1.7 133.7 314.7 21.21 19.91 64 0.331 2878K 2994 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 254.0 253.8 0.74 0.71 1 0.744 191K 130 0.0 0.0 L2 1/0 2.61 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 1.5 252.6 252.5 0.76 0.73 2 0.379 194K 81 0.0 0.0 L3 48/0 982.66 MB 1.0 0.5 0.4 0.2 0.5 0.4 0.1 1.5 198.0 197.9 2.84 2.45 3 0.947 571K 371 0.0 0.0 L4 124/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1227/18 99.89 GB 0.0 3.7 0.7 3.0 7.4 4.4 1.4 2.0 147.9 298.1 25.55 23.80 70 0.365 3836K 3576 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 0.7 3.0 7.4 4.4 1.4 2.0 147.9 298.1 25.55 23.80 70 0.365 3836K 3576 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 0.7 3.0 3.7 0.7 0.0 0.0 254.4 254.2 14.85 14.20 16 0.928 3836K 3576 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 359.1 10.70 9.60 54 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.44 GB write, 630.14 MB/s write, 3.69 GB read, 312.56 MB/s read, 25.6 seconds Interval compaction: 7.44 GB write, 641.45 MB/s write, 3.69 GB read, 318.16 MB/s read, 25.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 883715 Average: 1.9807 StdDev: 13.53 Min: 0 Median: 1.3258 Max: 4413 Percentiles: P50: 1.33 P75: 1.73 P99: 4.87 P99.9: 10.47 P99.99: 126.25 ------------------------------------------------------ [ 0, 1 ] 265491 30.043% 30.043% ###### ( 1, 2 ] 541285 61.251% 91.294% ############ ( 2, 3 ] 46404 5.251% 96.545% # ( 3, 4 ] 17876 2.023% 98.568% ( 4, 6 ] 8736 0.989% 99.556% ( 6, 10 ] 2972 0.336% 99.892% ( 10, 15 ] 722 0.082% 99.974% ( 15, 22 ] 79 0.009% 99.983% ( 22, 34 ] 9 0.001% 99.984% ( 34, 51 ] 8 0.001% 99.985% ( 51, 76 ] 8 0.001% 99.986% ( 76, 110 ] 22 0.002% 99.988% ( 110, 170 ] 54 0.006% 99.994% ( 170, 250 ] 56 0.006% 100.001% ( 250, 380 ] 31 0.004% 100.004% ( 380, 580 ] 12 0.001% 100.006% ( 580, 870 ] 16 0.002% 100.007% ( 870, 1300 ] 16 0.002% 100.009% ( 1300, 1900 ] 10 0.001% 100.010% ( 1900, 2900 ] 5 0.001% 100.011% ( 2900, 4400 ] 5 0.001% 100.012% ( 4400, 6600 ] 1 0.000% 100.012% ** Level 1 read latency histogram (micros): Count: 47953 Average: 2.5467 StdDev: 21.58 Min: 1 Median: 1.6242 Max: 3662 Percentiles: P50: 1.62 P75: 2.01 P99: 6.17 P99.9: 13.06 P99.99: 25.61 ------------------------------------------------------ [ 0, 1 ] 4236 8.834% 8.834% ## ( 1, 2 ] 31625 65.950% 74.784% ############# ( 2, 3 ] 7299 15.221% 90.005% ### ( 3, 4 ] 2500 5.213% 95.218% # ( 4, 6 ] 1797 3.747% 98.966% # ( 6, 10 ] 393 0.820% 99.785% ( 10, 15 ] 90 0.188% 99.973% ( 15, 22 ] 7 0.015% 99.987% ( 22, 34 ] 4 0.008% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 3 0.006% 100.006% ( 580, 870 ] 2 0.004% 100.010% ( 1900, 2900 ] 1 0.002% 100.013% ( 2900, 4400 ] 1 0.002% 100.015% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.1115 StdDev: 6.02 Min: 1 Median: 1.4760 Max: 986 Percentiles: P50: 1.48 P75: 1.83 P99: 5.50 P99.9: 9.94 P99.99: 19.48 ------------------------------------------------------ [ 0, 1 ] 8015 16.710% 16.710% ### ( 1, 2 ] 33549 69.943% 86.653% ############## ( 2, 3 ] 3914 8.160% 94.813% ## ( 3, 4 ] 1462 3.048% 97.861% # ( 4, 6 ] 730 1.522% 99.383% ( 6, 10 ] 252 0.525% 99.908% ( 10, 15 ] 36 0.075% 99.983% ( 15, 22 ] 5 0.010% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ( 870, 1300 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 47971 Average: 4.2045 StdDev: 71.74 Min: 0 Median: 1.6107 Max: 6597 Percentiles: P50: 1.61 P75: 1.99 P99: 6.76 P99.9: 237.05 P99.99: 2500.41 ------------------------------------------------------ [ 0, 1 ] 4671 9.737% 9.737% ## ( 1, 2 ] 31628 65.932% 75.669% ############# ( 2, 3 ] 7020 14.634% 90.302% ### ( 3, 4 ] 2442 5.091% 95.393% # ( 4, 6 ] 1660 3.460% 98.853% # ( 6, 10 ] 368 0.767% 99.621% ( 10, 15 ] 87 0.181% 99.802% ( 15, 22 ] 31 0.065% 99.867% ( 22, 34 ] 5 0.010% 99.877% ( 34, 51 ] 1 0.002% 99.879% ( 110, 170 ] 5 0.010% 99.890% ( 170, 250 ] 6 0.013% 99.902% ( 250, 380 ] 6 0.013% 99.915% ( 380, 580 ] 4 0.008% 99.923% ( 580, 870 ] 15 0.031% 99.954% ( 870, 1300 ] 6 0.013% 99.967% ( 1300, 1900 ] 7 0.015% 99.981% ( 1900, 2900 ] 7 0.015% 99.996% ( 2900, 4400 ] 8 0.017% 100.013% ( 4400, 6600 ] 2 0.004% 100.017% ** Level 4 read latency histogram (micros): Count: 20 Average: 1768.5500 StdDev: 1522.53 Min: 259 Median: 870.0000 Max: 5757 Percentiles: P50: 870.00 P75: 2900.00 P99: 5757.00 P99.9: 5757.00 P99.99: 5757.00 ------------------------------------------------------ ( 250, 380 ] 3 15.000% 15.000% ### ( 380, 580 ] 1 5.000% 20.000% # ( 580, 870 ] 6 30.000% 50.000% ###### ( 870, 1300 ] 1 5.000% 55.000% # ( 1300, 1900 ] 3 15.000% 70.000% ### ( 1900, 2900 ] 1 5.000% 75.000% # ( 2900, 4400 ] 3 15.000% 90.000% ### ( 4400, 6600 ] 2 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 435.8000 StdDev: 494.34 Min: 80 Median: 104.3333 Max: 1576 Percentiles: P50: 104.33 P75: 870.00 P99: 1576.00 P99.9: 1576.00 P99.99: 1576.00 ------------------------------------------------------ ( 76, 110 ] 12 60.000% 60.000% ############ ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 1 5.000% 70.000% # ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 4 20.000% 95.000% #### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.375 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.378 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-18:32:19 ... thread 0: (1000000,5000000) ops and (106537.5,235185.5) ops/second in (9.386370,21.259813) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 4.30 GB 125.4 4.9 0.0 4.9 9.5 4.7 0.0 2.0 157.2 308.1 31.66 29.95 84 0.377 5052K 8530 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 254.0 253.8 0.74 0.71 1 0.744 191K 130 0.0 0.0 L2 1/0 2.61 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 1.5 252.6 252.5 0.76 0.73 2 0.379 194K 81 0.0 0.0 L3 48/0 982.66 MB 1.0 0.5 0.4 0.2 0.5 0.4 0.1 1.5 198.0 197.9 2.84 2.45 3 0.947 571K 371 0.0 0.0 L4 124/0 9.67 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1036/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1227/14 100.80 GB 0.0 5.8 0.7 5.1 10.4 5.3 1.4 2.2 164.4 297.2 36.00 33.84 90 0.400 6009K 9112 0.0 0.0 Int 0/0 0.00 KB 0.0 5.8 0.7 5.1 10.4 5.3 1.4 2.2 164.4 297.2 36.00 33.84 90 0.400 6009K 9112 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.8 0.7 5.1 5.8 0.7 0.0 0.0 262.1 261.7 22.58 21.82 21 1.075 6009K 9112 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.9 13.42 12.02 69 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.5 total, 21.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.45 GB write, 498.15 MB/s write, 5.78 GB read, 275.63 MB/s read, 36.0 seconds Interval compaction: 10.45 GB write, 503.14 MB/s write, 5.78 GB read, 278.39 MB/s read, 36.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 14, interval: 24 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1974276 Average: 2.0786 StdDev: 11.15 Min: 0 Median: 1.3956 Max: 4413 Percentiles: P50: 1.40 P75: 1.78 P99: 5.22 P99.9: 11.09 P99.99: 114.66 ------------------------------------------------------ [ 0, 1 ] 477373 24.180% 24.180% ##### ( 1, 2 ] 1288484 65.264% 89.443% ############# ( 2, 3 ] 128134 6.490% 95.933% # ( 3, 4 ] 47352 2.398% 98.332% ( 4, 6 ] 21696 1.099% 99.431% ( 6, 10 ] 8909 0.451% 99.882% ( 10, 15 ] 1624 0.082% 99.964% ( 15, 22 ] 154 0.008% 99.972% ( 22, 34 ] 16 0.001% 99.973% ( 34, 51 ] 10 0.001% 99.973% ( 51, 76 ] 27 0.001% 99.975% ( 76, 110 ] 271 0.014% 99.989% ( 110, 170 ] 368 0.019% 100.007% ( 170, 250 ] 153 0.008% 100.015% ( 250, 380 ] 80 0.004% 100.019% ( 380, 580 ] 61 0.003% 100.022% ( 580, 870 ] 40 0.002% 100.024% ( 870, 1300 ] 23 0.001% 100.025% ( 1300, 1900 ] 13 0.001% 100.026% ( 1900, 2900 ] 5 0.000% 100.026% ( 2900, 4400 ] 8 0.000% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 47953 Average: 2.5467 StdDev: 21.58 Min: 1 Median: 1.6242 Max: 3662 Percentiles: P50: 1.62 P75: 2.01 P99: 6.17 P99.9: 13.06 P99.99: 25.61 ------------------------------------------------------ [ 0, 1 ] 4236 8.834% 8.834% ## ( 1, 2 ] 31625 65.950% 74.784% ############# ( 2, 3 ] 7299 15.221% 90.005% ### ( 3, 4 ] 2500 5.213% 95.218% # ( 4, 6 ] 1797 3.747% 98.966% # ( 6, 10 ] 393 0.820% 99.785% ( 10, 15 ] 90 0.188% 99.973% ( 15, 22 ] 7 0.015% 99.987% ( 22, 34 ] 4 0.008% 99.996% ( 110, 170 ] 1 0.002% 99.998% ( 170, 250 ] 1 0.002% 100.000% ( 250, 380 ] 3 0.006% 100.006% ( 580, 870 ] 2 0.004% 100.010% ( 1900, 2900 ] 1 0.002% 100.013% ( 2900, 4400 ] 1 0.002% 100.015% ** Level 2 read latency histogram (micros): Count: 47966 Average: 2.1115 StdDev: 6.02 Min: 1 Median: 1.4760 Max: 986 Percentiles: P50: 1.48 P75: 1.83 P99: 5.50 P99.9: 9.94 P99.99: 19.48 ------------------------------------------------------ [ 0, 1 ] 8015 16.710% 16.710% ### ( 1, 2 ] 33549 69.943% 86.653% ############## ( 2, 3 ] 3914 8.160% 94.813% ## ( 3, 4 ] 1462 3.048% 97.861% # ( 4, 6 ] 730 1.522% 99.383% ( 6, 10 ] 252 0.525% 99.908% ( 10, 15 ] 36 0.075% 99.983% ( 15, 22 ] 5 0.010% 99.994% ( 170, 250 ] 1 0.002% 99.996% ( 250, 380 ] 1 0.002% 99.998% ( 580, 870 ] 1 0.002% 100.000% ( 870, 1300 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 47971 Average: 4.2045 StdDev: 71.74 Min: 0 Median: 1.6107 Max: 6597 Percentiles: P50: 1.61 P75: 1.99 P99: 6.76 P99.9: 237.05 P99.99: 2500.41 ------------------------------------------------------ [ 0, 1 ] 4671 9.737% 9.737% ## ( 1, 2 ] 31628 65.932% 75.669% ############# ( 2, 3 ] 7020 14.634% 90.302% ### ( 3, 4 ] 2442 5.091% 95.393% # ( 4, 6 ] 1660 3.460% 98.853% # ( 6, 10 ] 368 0.767% 99.621% ( 10, 15 ] 87 0.181% 99.802% ( 15, 22 ] 31 0.065% 99.867% ( 22, 34 ] 5 0.010% 99.877% ( 34, 51 ] 1 0.002% 99.879% ( 110, 170 ] 5 0.010% 99.890% ( 170, 250 ] 6 0.013% 99.902% ( 250, 380 ] 6 0.013% 99.915% ( 380, 580 ] 4 0.008% 99.923% ( 580, 870 ] 15 0.031% 99.954% ( 870, 1300 ] 6 0.013% 99.967% ( 1300, 1900 ] 7 0.015% 99.981% ( 1900, 2900 ] 7 0.015% 99.996% ( 2900, 4400 ] 8 0.017% 100.013% ( 4400, 6600 ] 2 0.004% 100.017% ** Level 4 read latency histogram (micros): Count: 20 Average: 1768.5500 StdDev: 1522.53 Min: 259 Median: 870.0000 Max: 5757 Percentiles: P50: 870.00 P75: 2900.00 P99: 5757.00 P99.9: 5757.00 P99.99: 5757.00 ------------------------------------------------------ ( 250, 380 ] 3 15.000% 15.000% ### ( 380, 580 ] 1 5.000% 20.000% # ( 580, 870 ] 6 30.000% 50.000% ###### ( 870, 1300 ] 1 5.000% 55.000% # ( 1300, 1900 ] 3 15.000% 70.000% ### ( 1900, 2900 ] 1 5.000% 75.000% # ( 2900, 4400 ] 3 15.000% 90.000% ### ( 4400, 6600 ] 2 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 20 Average: 435.8000 StdDev: 494.34 Min: 80 Median: 104.3333 Max: 1576 Percentiles: P50: 104.33 P75: 870.00 P99: 1576.00 P99.9: 1576.00 P99.99: 1576.00 ------------------------------------------------------ ( 76, 110 ] 12 60.000% 60.000% ############ ( 250, 380 ] 1 5.000% 65.000% # ( 380, 580 ] 1 5.000% 70.000% # ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 4 20.000% 95.000% #### ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 21.5 total, 9.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 229.15 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.782 H:M:S, 36.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 104.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.407 H:M:S, 68.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-18:32:24 ... thread 0: (1000000,6000000) ops and (200570.9,228609.9) ops/second in (4.985769,26.245582) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/7 2.21 GB 25.2 5.6 0.0 5.6 11.2 5.7 0.0 2.0 152.3 306.1 37.63 35.37 102 0.369 5819K 9229 0.0 0.0 L1 13/13 1.52 GB 0.0 3.3 3.3 0.0 3.2 3.2 0.2 1.0 233.4 230.1 14.29 13.80 2 7.147 3387K 46K 0.0 0.0 L2 3/2 260.17 MB 1.3 0.2 0.1 0.1 0.2 0.1 1.9 1.5 252.6 252.5 0.76 0.73 2 0.379 194K 81 0.0 0.0 L3 37/13 1.73 GB 1.0 1.3 1.0 0.3 1.3 1.0 0.7 1.3 190.7 190.4 6.89 5.84 8 0.862 1298K 1179 0.0 0.0 L4 138/0 9.47 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.8 1.0 177.0 177.0 0.50 0.40 1 0.499 89K 0 0.0 0.0 L5 1044/0 86.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1245/35 101.74 GB 0.0 10.4 4.5 5.9 16.0 10.1 4.6 2.8 177.5 273.0 60.08 56.15 115 0.522 10M 57K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.4 4.5 5.9 16.0 10.1 4.6 2.8 177.5 273.0 60.08 56.15 115 0.522 10M 57K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.4 4.5 5.9 10.4 4.4 0.0 0.0 244.6 243.2 43.59 41.54 31 1.406 10M 57K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 351.6 16.49 14.61 84 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.5 total, 26.2 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.01 GB write, 619.77 MB/s write, 10.41 GB read, 402.95 MB/s read, 60.1 seconds Interval compaction: 16.01 GB write, 624.80 MB/s write, 10.41 GB read, 406.22 MB/s read, 60.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 18, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2394928 Average: 2.1736 StdDev: 12.74 Min: 0 Median: 1.4169 Max: 4413 Percentiles: P50: 1.42 P75: 1.80 P99: 5.55 P99.9: 12.57 P99.99: 141.15 ------------------------------------------------------ [ 0, 1 ] 547723 22.870% 22.870% ##### ( 1, 2 ] 1558434 65.072% 87.942% ############# ( 2, 3 ] 173893 7.261% 95.203% # ( 3, 4 ] 64307 2.685% 97.888% # ( 4, 6 ] 34401 1.436% 99.325% ( 6, 10 ] 12635 0.528% 99.852% ( 10, 15 ] 2218 0.093% 99.945% ( 15, 22 ] 228 0.010% 99.955% ( 22, 34 ] 24 0.001% 99.956% ( 34, 51 ] 12 0.001% 99.956% ( 51, 76 ] 33 0.001% 99.957% ( 76, 110 ] 483 0.020% 99.978% ( 110, 170 ] 575 0.024% 100.002% ( 170, 250 ] 198 0.008% 100.010% ( 250, 380 ] 123 0.005% 100.015% ( 380, 580 ] 127 0.005% 100.020% ( 580, 870 ] 83 0.003% 100.024% ( 870, 1300 ] 44 0.002% 100.026% ( 1300, 1900 ] 17 0.001% 100.026% ( 1900, 2900 ] 11 0.000% 100.027% ( 2900, 4400 ] 10 0.000% 100.027% ( 4400, 6600 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 243469 Average: 3.4108 StdDev: 29.08 Min: 1 Median: 1.8345 Max: 4375 Percentiles: P50: 1.83 P75: 2.71 P99: 8.01 P99.9: 12.96 P99.99: 14.52 ------------------------------------------------------ [ 0, 1 ] 7072 2.905% 2.905% # ( 1, 2 ] 137401 56.435% 59.339% ########### ( 2, 3 ] 54026 22.190% 81.529% #### ( 3, 4 ] 21814 8.960% 90.489% ## ( 4, 6 ] 18927 7.774% 98.263% ## ( 6, 10 ] 3568 1.465% 99.729% ( 10, 15 ] 705 0.290% 100.018% ( 15, 22 ] 79 0.032% 100.051% ( 22, 34 ] 10 0.004% 100.055% ( 34, 51 ] 2 0.001% 100.055% ( 51, 76 ] 1 0.000% 100.056% ( 76, 110 ] 23 0.009% 100.065% ( 110, 170 ] 46 0.019% 100.084% ( 170, 250 ] 31 0.013% 100.097% ( 250, 380 ] 48 0.020% 100.117% ( 380, 580 ] 53 0.022% 100.138% ( 580, 870 ] 50 0.021% 100.159% ( 870, 1300 ] 25 0.010% 100.169% ( 1300, 1900 ] 10 0.004% 100.173% ( 1900, 2900 ] 5 0.002% 100.175% ( 2900, 4400 ] 5 0.002% 100.177% ** Level 2 read latency histogram (micros): Count: 48290 Average: 2.9132 StdDev: 30.97 Min: 1 Median: 1.4795 Max: 2514 Percentiles: P50: 1.48 P75: 1.84 P99: 5.69 P99.9: 235.91 P99.99: 1402.60 ------------------------------------------------------ [ 0, 1 ] 8016 16.600% 16.600% ### ( 1, 2 ] 33639 69.660% 86.260% ############## ( 2, 3 ] 4027 8.339% 94.599% ## ( 3, 4 ] 1494 3.094% 97.693% # ( 4, 6 ] 747 1.547% 99.240% ( 6, 10 ] 259 0.536% 99.776% ( 10, 15 ] 36 0.075% 99.851% ( 15, 22 ] 5 0.010% 99.861% ( 76, 110 ] 1 0.002% 99.863% ( 110, 170 ] 7 0.014% 99.878% ( 170, 250 ] 13 0.027% 99.905% ( 250, 380 ] 8 0.017% 99.921% ( 380, 580 ] 15 0.031% 99.952% ( 580, 870 ] 11 0.023% 99.975% ( 870, 1300 ] 7 0.014% 99.990% ( 1300, 1900 ] 1 0.002% 99.992% ( 1900, 2900 ] 5 0.010% 100.002% ** Level 3 read latency histogram (micros): Count: 200680 Average: 6.3972 StdDev: 69.63 Min: 0 Median: 1.7929 Max: 6597 Percentiles: P50: 1.79 P75: 2.63 P99: 9.88 P99.9: 483.20 P99.99: 661.81 ------------------------------------------------------ [ 0, 1 ] 7841 3.907% 3.907% # ( 1, 2 ] 116658 58.131% 62.039% ############ ( 2, 3 ] 41193 20.527% 82.565% #### ( 3, 4 ] 16722 8.333% 90.898% ## ( 4, 6 ] 12852 6.404% 97.302% # ( 6, 10 ] 3515 1.752% 99.054% ( 10, 15 ] 578 0.288% 99.342% ( 15, 22 ] 109 0.054% 99.396% ( 22, 34 ] 13 0.006% 99.403% ( 34, 51 ] 3 0.001% 99.404% ( 51, 76 ] 1 0.000% 99.405% ( 76, 110 ] 57 0.028% 99.433% ( 110, 170 ] 251 0.125% 99.558% ( 170, 250 ] 296 0.147% 99.706% ( 250, 380 ] 254 0.127% 99.832% ( 380, 580 ] 270 0.135% 99.967% ( 580, 870 ] 177 0.088% 100.055% ( 870, 1300 ] 77 0.038% 100.093% ( 1300, 1900 ] 15 0.007% 100.101% ( 1900, 2900 ] 50 0.025% 100.126% ( 2900, 4400 ] 24 0.012% 100.138% ( 4400, 6600 ] 2 0.001% 100.139% ** Level 4 read latency histogram (micros): Count: 40 Average: 899.6500 StdDev: 1384.63 Min: 1 Median: 282.5000 Max: 5757 Percentiles: P50: 282.50 P75: 870.00 P99: 5757.00 P99.9: 5757.00 P99.99: 5757.00 ------------------------------------------------------ [ 0, 1 ] 3 7.500% 7.500% ## ( 1, 2 ] 7 17.500% 25.000% #### ( 2, 3 ] 2 5.000% 30.000% # ( 3, 4 ] 1 2.500% 32.500% # ( 4, 6 ] 1 2.500% 35.000% # ( 6, 10 ] 1 2.500% 37.500% # ( 15, 22 ] 2 5.000% 42.500% # ( 22, 34 ] 1 2.500% 45.000% # ( 170, 250 ] 1 2.500% 47.500% # ( 250, 380 ] 4 10.000% 57.500% ## ( 380, 580 ] 1 2.500% 60.000% # ( 580, 870 ] 6 15.000% 75.000% ### ( 870, 1300 ] 1 2.500% 77.500% # ( 1300, 1900 ] 3 7.500% 85.000% ## ( 1900, 2900 ] 1 2.500% 87.500% # ( 2900, 4400 ] 3 7.500% 95.000% ## ( 4400, 6600 ] 2 5.000% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 730.0667 StdDev: 853.31 Min: 80 Median: 333.5714 Max: 3330 Percentiles: P50: 333.57 P75: 1042.00 P99: 3330.00 P99.9: 3330.00 P99.99: 3330.00 ------------------------------------------------------ ( 76, 110 ] 15 25.000% 25.000% ##### ( 110, 170 ] 5 8.333% 33.333% ## ( 170, 250 ] 1 1.667% 35.000% ( 250, 380 ] 14 23.333% 58.333% ##### ( 380, 580 ] 3 5.000% 63.333% # ( 580, 870 ] 3 5.000% 68.333% # ( 870, 1300 ] 10 16.667% 85.000% ### ( 1300, 1900 ] 2 3.333% 88.333% # ( 1900, 2900 ] 5 8.333% 96.667% ## ( 2900, 4400 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 26.5 total, 5.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 223.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.951 H:M:S, 37.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 197.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.169 H:M:S, 43.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-18:32:28 ... thread 0: (1000000,7000000) ops and (314353.1,237879.1) ops/second in (3.181136,29.426718) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 3.13 GB 94.4 6.1 0.0 6.1 12.7 6.6 0.0 1.9 147.1 305.9 42.38 39.68 117 0.362 6331K 9742 0.0 0.0 L1 13/13 1.52 GB 0.0 3.3 3.3 0.0 3.2 3.2 0.2 1.0 233.4 230.1 14.29 13.80 2 7.147 3387K 46K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.9 1.5 252.6 252.5 0.76 0.73 2 0.379 194K 81 0.0 0.0 L3 17/0 991.18 MB 1.0 2.3 1.2 1.0 2.3 1.2 0.7 1.8 194.6 194.2 12.00 10.32 11 1.091 2317K 3938 0.0 0.0 L4 161/0 9.50 GB 1.0 0.4 0.4 0.0 0.4 0.4 1.6 1.0 170.5 170.3 2.37 1.92 6 0.394 394K 389 0.0 0.0 L5 1056/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1264/24 102.66 GB 0.0 12.2 5.0 7.2 18.7 11.5 6.3 2.8 174.1 267.1 71.80 66.45 138 0.520 12M 60K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.2 5.0 7.2 18.7 11.5 6.3 2.8 174.1 267.1 71.80 66.45 138 0.520 12M 60K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.2 5.0 7.2 12.1 5.0 0.0 0.0 238.1 236.9 52.50 49.43 41 1.281 12M 60K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 349.2 19.30 17.03 97 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.6 total, 29.4 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.73 GB write, 647.08 MB/s write, 12.21 GB read, 421.79 MB/s read, 71.8 seconds Interval compaction: 18.73 GB write, 651.76 MB/s write, 12.21 GB read, 424.84 MB/s read, 71.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 27, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 27, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2724021 Average: 2.2276 StdDev: 12.69 Min: 0 Median: 1.4425 Max: 4413 Percentiles: P50: 1.44 P75: 1.83 P99: 5.72 P99.9: 12.64 P99.99: 137.77 ------------------------------------------------------ [ 0, 1 ] 579249 21.264% 21.264% #### ( 1, 2 ] 1769060 64.943% 86.207% ############# ( 2, 3 ] 225196 8.267% 94.474% ## ( 3, 4 ] 81552 2.994% 97.468% # ( 4, 6 ] 48389 1.776% 99.245% ( 6, 10 ] 16420 0.603% 99.847% ( 10, 15 ] 2714 0.100% 99.947% ( 15, 22 ] 279 0.010% 99.957% ( 22, 34 ] 27 0.001% 99.958% ( 34, 51 ] 14 0.001% 99.959% ( 51, 76 ] 37 0.001% 99.960% ( 76, 110 ] 514 0.019% 99.979% ( 110, 170 ] 643 0.024% 100.003% ( 170, 250 ] 235 0.009% 100.011% ( 250, 380 ] 161 0.006% 100.017% ( 380, 580 ] 152 0.006% 100.023% ( 580, 870 ] 102 0.004% 100.027% ( 870, 1300 ] 56 0.002% 100.029% ( 1300, 1900 ] 21 0.001% 100.029% ( 1900, 2900 ] 12 0.000% 100.030% ( 2900, 4400 ] 10 0.000% 100.030% ( 4400, 6600 ] 1 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 304427 Average: 3.4184 StdDev: 27.66 Min: 1 Median: 1.8120 Max: 4375 Percentiles: P50: 1.81 P75: 2.65 P99: 8.28 P99.9: 14.01 P99.99: 48.49 ------------------------------------------------------ [ 0, 1 ] 9550 3.137% 3.137% # ( 1, 2 ] 175686 57.710% 60.847% ############ ( 2, 3 ] 65779 21.607% 82.455% #### ( 3, 4 ] 25583 8.404% 90.859% ## ( 4, 6 ] 22036 7.239% 98.097% # ( 6, 10 ] 4820 1.583% 99.680% ( 10, 15 ] 833 0.274% 99.954% ( 15, 22 ] 95 0.031% 99.985% ( 22, 34 ] 12 0.004% 99.989% ( 34, 51 ] 3 0.001% 99.990% ( 51, 76 ] 1 0.000% 99.990% ( 76, 110 ] 42 0.014% 100.004% ( 110, 170 ] 85 0.028% 100.032% ( 170, 250 ] 64 0.021% 100.053% ( 250, 380 ] 78 0.026% 100.079% ( 380, 580 ] 73 0.024% 100.103% ( 580, 870 ] 65 0.021% 100.124% ( 870, 1300 ] 33 0.011% 100.135% ( 1300, 1900 ] 11 0.004% 100.139% ( 1900, 2900 ] 5 0.002% 100.140% ( 2900, 4400 ] 5 0.002% 100.142% ** Level 2 read latency histogram (micros): Count: 48628 Average: 2.9132 StdDev: 30.86 Min: 1 Median: 1.4822 Max: 2514 Percentiles: P50: 1.48 P75: 1.84 P99: 5.72 P99.9: 233.83 P99.99: 1382.32 ------------------------------------------------------ [ 0, 1 ] 8018 16.488% 16.488% ### ( 1, 2 ] 33793 69.493% 85.981% ############## ( 2, 3 ] 4150 8.534% 94.516% ## ( 3, 4 ] 1520 3.126% 97.641% # ( 4, 6 ] 770 1.583% 99.225% ( 6, 10 ] 268 0.551% 99.776% ( 10, 15 ] 37 0.076% 99.852% ( 15, 22 ] 5 0.010% 99.862% ( 76, 110 ] 1 0.002% 99.864% ( 110, 170 ] 7 0.014% 99.879% ( 170, 250 ] 13 0.027% 99.905% ( 250, 380 ] 8 0.016% 99.922% ( 380, 580 ] 15 0.031% 99.953% ( 580, 870 ] 11 0.023% 99.975% ( 870, 1300 ] 7 0.014% 99.990% ( 1300, 1900 ] 1 0.002% 99.992% ( 1900, 2900 ] 5 0.010% 100.002% ** Level 3 read latency histogram (micros): Count: 342390 Average: 5.5803 StdDev: 57.57 Min: 0 Median: 1.8144 Max: 6597 Percentiles: P50: 1.81 P75: 2.67 P99: 9.70 P99.9: 424.35 P99.99: 605.14 ------------------------------------------------------ [ 0, 1 ] 10517 3.072% 3.072% # ( 1, 2 ] 197305 57.626% 60.697% ############ ( 2, 3 ] 73240 21.391% 82.088% #### ( 3, 4 ] 28304 8.267% 90.355% ## ( 4, 6 ] 23566 6.883% 97.238% # ( 6, 10 ] 6529 1.907% 99.145% ( 10, 15 ] 1044 0.305% 99.449% ( 15, 22 ] 188 0.055% 99.504% ( 22, 34 ] 23 0.007% 99.511% ( 34, 51 ] 4 0.001% 99.512% ( 51, 76 ] 3 0.001% 99.513% ( 76, 110 ] 92 0.027% 99.540% ( 110, 170 ] 389 0.114% 99.654% ( 170, 250 ] 408 0.119% 99.773% ( 250, 380 ] 354 0.103% 99.876% ( 380, 580 ] 368 0.107% 99.984% ( 580, 870 ] 251 0.073% 100.057% ( 870, 1300 ] 110 0.032% 100.089% ( 1300, 1900 ] 25 0.007% 100.096% ( 1900, 2900 ] 55 0.016% 100.112% ( 2900, 4400 ] 24 0.007% 100.119% ( 4400, 6600 ] 2 0.001% 100.120% ** Level 4 read latency histogram (micros): Count: 160 Average: 262.9000 StdDev: 794.52 Min: 1 Median: 1.9348 Max: 5757 Percentiles: P50: 1.93 P75: 21.07 P99: 4840.00 P99.9: 5757.00 P99.99: 5757.00 ------------------------------------------------------ [ 0, 1 ] 37 23.125% 23.125% ##### ( 1, 2 ] 46 28.750% 51.875% ###### ( 2, 3 ] 14 8.750% 60.625% ## ( 3, 4 ] 2 1.250% 61.875% ( 4, 6 ] 3 1.875% 63.750% ( 6, 10 ] 4 2.500% 66.250% # ( 10, 15 ] 1 0.625% 66.875% ( 15, 22 ] 15 9.375% 76.250% ## ( 22, 34 ] 1 0.625% 76.875% ( 110, 170 ] 4 2.500% 79.375% # ( 170, 250 ] 4 2.500% 81.875% # ( 250, 380 ] 7 4.375% 86.250% # ( 380, 580 ] 2 1.250% 87.500% ( 580, 870 ] 9 5.625% 93.125% # ( 870, 1300 ] 2 1.250% 94.375% ( 1300, 1900 ] 3 1.875% 96.250% ( 1900, 2900 ] 1 0.625% 96.875% ( 2900, 4400 ] 3 1.875% 98.750% ( 4400, 6600 ] 2 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 874.8083 StdDev: 1067.23 Min: 80 Median: 366.3158 Max: 5884 Percentiles: P50: 366.32 P75: 1134.62 P99: 5280.00 P99.9: 5884.00 P99.99: 5884.00 ------------------------------------------------------ ( 76, 110 ] 19 15.833% 15.833% ### ( 110, 170 ] 18 15.000% 30.833% ### ( 170, 250 ] 6 5.000% 35.833% # ( 250, 380 ] 19 15.833% 51.667% ### ( 380, 580 ] 9 7.500% 59.167% ## ( 580, 870 ] 11 9.167% 68.333% ## ( 870, 1300 ] 13 10.833% 79.167% ## ( 1300, 1900 ] 4 3.333% 82.500% # ( 1900, 2900 ] 14 11.667% 94.167% ## ( 2900, 4400 ] 5 4.167% 98.333% # ( 4400, 6600 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 29.6 total, 3.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 232.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.425 H:M:S, 35.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 309.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.474 H:M:S, 14.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-18:32:33 ... thread 0: (1000000,8000000) ops and (189564.0,230534.4) ops/second in (5.275263,34.701981) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 4.18 GB 144.8 7.4 0.0 7.4 15.0 7.6 0.0 2.0 150.0 304.8 50.39 47.28 138 0.365 7674K 11K 0.0 0.0 L1 13/13 1.52 GB 0.0 3.3 3.3 0.0 3.2 3.2 0.2 1.0 233.4 230.1 14.29 13.80 2 7.147 3387K 46K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 1.9 1.5 252.6 252.5 0.76 0.73 2 0.379 194K 81 0.0 0.0 L3 17/0 991.18 MB 1.0 2.3 1.2 1.0 2.3 1.2 0.7 1.8 194.6 194.2 12.00 10.32 11 1.091 2317K 3938 0.0 0.0 L4 161/0 9.50 GB 1.0 0.4 0.4 0.0 0.4 0.4 1.6 1.0 170.5 170.3 2.37 1.92 6 0.394 394K 389 0.0 0.0 L5 1056/0 87.54 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/24 103.70 GB 0.0 13.5 5.0 8.5 21.1 12.6 6.3 2.8 173.2 270.3 79.81 74.05 159 0.502 13M 62K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.5 5.0 8.5 21.1 12.6 6.3 2.8 173.2 270.3 79.81 74.05 159 0.502 13M 62K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.5 5.0 8.5 13.4 5.0 0.0 0.0 240.7 239.6 57.44 54.28 46 1.249 13M 62K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 349.1 22.37 19.77 113 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.9 total, 34.7 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.07 GB write, 617.84 MB/s write, 13.50 GB read, 395.96 MB/s read, 79.8 seconds Interval compaction: 21.07 GB write, 621.63 MB/s write, 13.50 GB read, 398.39 MB/s read, 79.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 23, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 23, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 29, interval: 52 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3185657 Average: 2.2351 StdDev: 12.48 Min: 0 Median: 1.4519 Max: 4413 Percentiles: P50: 1.45 P75: 1.83 P99: 5.72 P99.9: 12.51 P99.99: 133.55 ------------------------------------------------------ [ 0, 1 ] 651325 20.446% 20.446% #### ( 1, 2 ] 2083647 65.407% 85.853% ############# ( 2, 3 ] 273064 8.572% 94.424% ## ( 3, 4 ] 96988 3.045% 97.469% # ( 4, 6 ] 56733 1.781% 99.250% ( 6, 10 ] 19132 0.601% 99.850% ( 10, 15 ] 3160 0.099% 99.950% ( 15, 22 ] 333 0.010% 99.960% ( 22, 34 ] 34 0.001% 99.961% ( 34, 51 ] 15 0.000% 99.962% ( 51, 76 ] 39 0.001% 99.963% ( 76, 110 ] 590 0.019% 99.981% ( 110, 170 ] 712 0.022% 100.004% ( 170, 250 ] 279 0.009% 100.012% ( 250, 380 ] 194 0.006% 100.018% ( 380, 580 ] 176 0.006% 100.024% ( 580, 870 ] 119 0.004% 100.028% ( 870, 1300 ] 60 0.002% 100.030% ( 1300, 1900 ] 24 0.001% 100.030% ( 1900, 2900 ] 13 0.000% 100.031% ( 2900, 4400 ] 12 0.000% 100.031% ( 4400, 6600 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 475858 Average: 3.0818 StdDev: 22.91 Min: 1 Median: 1.6848 Max: 4375 Percentiles: P50: 1.68 P75: 2.33 P99: 8.16 P99.9: 19.38 P99.99: 154.98 ------------------------------------------------------ [ 0, 1 ] 38168 8.021% 8.021% ## ( 1, 2 ] 291707 61.301% 69.322% ############ ( 2, 3 ] 81533 17.134% 86.456% ### ( 3, 4 ] 30607 6.432% 92.888% # ( 4, 6 ] 25261 5.309% 98.197% # ( 6, 10 ] 7072 1.486% 99.683% ( 10, 15 ] 965 0.203% 99.885% ( 15, 22 ] 112 0.024% 99.909% ( 22, 34 ] 15 0.003% 99.912% ( 34, 51 ] 5 0.001% 99.913% ( 51, 76 ] 15 0.003% 99.916% ( 76, 110 ] 182 0.038% 99.955% ( 110, 170 ] 226 0.047% 100.002% ( 170, 250 ] 101 0.021% 100.023% ( 250, 380 ] 103 0.022% 100.045% ( 380, 580 ] 88 0.018% 100.063% ( 580, 870 ] 76 0.016% 100.079% ( 870, 1300 ] 34 0.007% 100.087% ( 1300, 1900 ] 11 0.002% 100.089% ( 1900, 2900 ] 5 0.001% 100.090% ( 2900, 4400 ] 5 0.001% 100.091% ** Level 2 read latency histogram (micros): Count: 48628 Average: 2.9132 StdDev: 30.86 Min: 1 Median: 1.4822 Max: 2514 Percentiles: P50: 1.48 P75: 1.84 P99: 5.72 P99.9: 233.83 P99.99: 1382.32 ------------------------------------------------------ [ 0, 1 ] 8018 16.488% 16.488% ### ( 1, 2 ] 33793 69.493% 85.981% ############## ( 2, 3 ] 4150 8.534% 94.516% ## ( 3, 4 ] 1520 3.126% 97.641% # ( 4, 6 ] 770 1.583% 99.225% ( 6, 10 ] 268 0.551% 99.776% ( 10, 15 ] 37 0.076% 99.852% ( 15, 22 ] 5 0.010% 99.862% ( 76, 110 ] 1 0.002% 99.864% ( 110, 170 ] 7 0.014% 99.879% ( 170, 250 ] 13 0.027% 99.905% ( 250, 380 ] 8 0.016% 99.922% ( 380, 580 ] 15 0.031% 99.953% ( 580, 870 ] 11 0.023% 99.975% ( 870, 1300 ] 7 0.014% 99.990% ( 1300, 1900 ] 1 0.002% 99.992% ( 1900, 2900 ] 5 0.010% 100.002% ** Level 3 read latency histogram (micros): Count: 342390 Average: 5.5803 StdDev: 57.57 Min: 0 Median: 1.8144 Max: 6597 Percentiles: P50: 1.81 P75: 2.67 P99: 9.70 P99.9: 424.35 P99.99: 605.14 ------------------------------------------------------ [ 0, 1 ] 10517 3.072% 3.072% # ( 1, 2 ] 197305 57.626% 60.697% ############ ( 2, 3 ] 73240 21.391% 82.088% #### ( 3, 4 ] 28304 8.267% 90.355% ## ( 4, 6 ] 23566 6.883% 97.238% # ( 6, 10 ] 6529 1.907% 99.145% ( 10, 15 ] 1044 0.305% 99.449% ( 15, 22 ] 188 0.055% 99.504% ( 22, 34 ] 23 0.007% 99.511% ( 34, 51 ] 4 0.001% 99.512% ( 51, 76 ] 3 0.001% 99.513% ( 76, 110 ] 92 0.027% 99.540% ( 110, 170 ] 389 0.114% 99.654% ( 170, 250 ] 408 0.119% 99.773% ( 250, 380 ] 354 0.103% 99.876% ( 380, 580 ] 368 0.107% 99.984% ( 580, 870 ] 251 0.073% 100.057% ( 870, 1300 ] 110 0.032% 100.089% ( 1300, 1900 ] 25 0.007% 100.096% ( 1900, 2900 ] 55 0.016% 100.112% ( 2900, 4400 ] 24 0.007% 100.119% ( 4400, 6600 ] 2 0.001% 100.120% ** Level 4 read latency histogram (micros): Count: 160 Average: 262.9000 StdDev: 794.52 Min: 1 Median: 1.9348 Max: 5757 Percentiles: P50: 1.93 P75: 21.07 P99: 4840.00 P99.9: 5757.00 P99.99: 5757.00 ------------------------------------------------------ [ 0, 1 ] 37 23.125% 23.125% ##### ( 1, 2 ] 46 28.750% 51.875% ###### ( 2, 3 ] 14 8.750% 60.625% ## ( 3, 4 ] 2 1.250% 61.875% ( 4, 6 ] 3 1.875% 63.750% ( 6, 10 ] 4 2.500% 66.250% # ( 10, 15 ] 1 0.625% 66.875% ( 15, 22 ] 15 9.375% 76.250% ## ( 22, 34 ] 1 0.625% 76.875% ( 110, 170 ] 4 2.500% 79.375% # ( 170, 250 ] 4 2.500% 81.875% # ( 250, 380 ] 7 4.375% 86.250% # ( 380, 580 ] 2 1.250% 87.500% ( 580, 870 ] 9 5.625% 93.125% # ( 870, 1300 ] 2 1.250% 94.375% ( 1300, 1900 ] 3 1.875% 96.250% ( 1900, 2900 ] 1 0.625% 96.875% ( 2900, 4400 ] 3 1.875% 98.750% ( 4400, 6600 ] 2 1.250% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 874.8083 StdDev: 1067.23 Min: 80 Median: 366.3158 Max: 5884 Percentiles: P50: 366.32 P75: 1134.62 P99: 5280.00 P99.9: 5884.00 P99.99: 5884.00 ------------------------------------------------------ ( 76, 110 ] 19 15.833% 15.833% ### ( 110, 170 ] 18 15.000% 30.833% ### ( 170, 250 ] 6 5.000% 35.833% # ( 250, 380 ] 19 15.833% 51.667% ### ( 380, 580 ] 9 7.500% 59.167% ## ( 580, 870 ] 11 9.167% 68.333% ## ( 870, 1300 ] 13 10.833% 79.167% ## ( 1300, 1900 ] 4 3.333% 82.500% # ( 1900, 2900 ] 14 11.667% 94.167% ## ( 2900, 4400 ] 5 4.167% 98.333% # ( 4400, 6600 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 34.9 total, 5.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 225.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.865 H:M:S, 36.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 186.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.440 H:M:S, 46.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-18:32:44 ... thread 0: (1000000,9000000) ops and (92460.7,197726.6) ops/second in (10.815405,45.517386) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/15 3.13 GB 25.2 8.7 0.0 8.7 17.2 8.5 0.0 2.0 152.1 301.8 58.39 54.62 155 0.377 9017K 14K 0.0 0.0 L1 18/18 2.17 GB 0.0 6.7 5.2 1.5 6.6 5.1 0.2 1.3 230.2 227.1 29.97 28.70 3 9.991 6474K 46K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.1 1.5 252.6 252.5 0.76 0.73 2 0.379 194K 81 0.0 0.0 L3 19/0 947.74 MB 0.9 3.7 1.9 1.8 3.7 1.9 1.4 2.0 194.8 193.8 19.65 17.04 17 1.156 3833K 18K 0.0 0.0 L4 163/0 9.75 GB 1.0 1.9 1.7 0.2 1.9 1.7 1.6 1.1 172.4 171.8 11.12 8.81 21 0.529 1931K 5752 0.0 0.0 L5 1068/0 88.58 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1284/33 104.56 GB 0.0 21.2 8.9 12.3 29.6 17.3 9.2 3.5 181.1 253.1 119.89 109.89 198 0.606 21M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.2 8.9 12.3 29.6 17.3 9.2 3.5 181.1 253.1 119.89 109.89 198 0.606 21M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.2 8.9 12.3 21.1 8.8 0.0 0.0 229.6 228.2 94.56 87.65 71 1.332 21M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 345.7 25.33 22.24 127 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.7 total, 45.5 interval Flush(GB): cumulative 8.552, interval 8.552 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 29.63 GB write, 663.43 MB/s write, 21.21 GB read, 474.86 MB/s read, 119.9 seconds Interval compaction: 29.63 GB write, 666.54 MB/s write, 21.21 GB read, 477.08 MB/s read, 119.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 27, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 27, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 24, pending-compaction-bytes-stops: 0, total-delays: 51, total-stops: 33, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3881748 Average: 2.3983 StdDev: 15.05 Min: 0 Median: 1.4707 Max: 4625 Percentiles: P50: 1.47 P75: 1.85 P99: 5.91 P99.9: 15.77 P99.99: 210.12 ------------------------------------------------------ [ 0, 1 ] 750918 19.345% 19.345% #### ( 1, 2 ] 2528305 65.133% 84.478% ############# ( 2, 3 ] 355365 9.155% 93.633% ## ( 3, 4 ] 129493 3.336% 96.969% # ( 4, 6 ] 82353 2.122% 99.090% ( 6, 10 ] 27107 0.698% 99.789% ( 10, 15 ] 4274 0.110% 99.899% ( 15, 22 ] 465 0.012% 99.911% ( 22, 34 ] 38 0.001% 99.912% ( 34, 51 ] 16 0.000% 99.912% ( 51, 76 ] 52 0.001% 99.913% ( 76, 110 ] 1201 0.031% 99.944% ( 110, 170 ] 1505 0.039% 99.983% ( 170, 250 ] 534 0.014% 99.997% ( 250, 380 ] 416 0.011% 100.008% ( 380, 580 ] 398 0.010% 100.018% ( 580, 870 ] 227 0.006% 100.024% ( 870, 1300 ] 133 0.003% 100.027% ( 1300, 1900 ] 46 0.001% 100.028% ( 1900, 2900 ] 23 0.001% 100.029% ( 2900, 4400 ] 14 0.000% 100.029% ( 4400, 6600 ] 2 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 1094145 Average: 3.3376 StdDev: 28.91 Min: 1 Median: 1.6987 Max: 7297 Percentiles: P50: 1.70 P75: 2.43 P99: 8.44 P99.9: 14.56 P99.99: 96.81 ------------------------------------------------------ [ 0, 1 ] 98892 9.038% 9.038% ## ( 1, 2 ] 641459 58.627% 67.665% ############ ( 2, 3 ] 185564 16.960% 84.625% ### ( 3, 4 ] 76323 6.976% 91.600% # ( 4, 6 ] 69057 6.312% 97.912% # ( 6, 10 ] 19551 1.787% 99.698% ( 10, 15 ] 2417 0.221% 99.919% ( 15, 22 ] 365 0.033% 99.953% ( 22, 34 ] 30 0.003% 99.955% ( 34, 51 ] 8 0.001% 99.956% ( 51, 76 ] 47 0.004% 99.961% ( 76, 110 ] 527 0.048% 100.009% ( 110, 170 ] 437 0.040% 100.049% ( 170, 250 ] 255 0.023% 100.072% ( 250, 380 ] 273 0.025% 100.097% ( 380, 580 ] 278 0.025% 100.122% ( 580, 870 ] 246 0.022% 100.145% ( 870, 1300 ] 119 0.011% 100.156% ( 1300, 1900 ] 44 0.004% 100.160% ( 1900, 2900 ] 21 0.002% 100.162% ( 2900, 4400 ] 16 0.001% 100.163% ( 6600, 9900 ] 2 0.000% 100.163% ** Level 2 read latency histogram (micros): Count: 48628 Average: 2.9132 StdDev: 30.86 Min: 1 Median: 1.4822 Max: 2514 Percentiles: P50: 1.48 P75: 1.84 P99: 5.72 P99.9: 233.83 P99.99: 1382.32 ------------------------------------------------------ [ 0, 1 ] 8018 16.488% 16.488% ### ( 1, 2 ] 33793 69.493% 85.981% ############## ( 2, 3 ] 4150 8.534% 94.516% ## ( 3, 4 ] 1520 3.126% 97.641% # ( 4, 6 ] 770 1.583% 99.225% ( 6, 10 ] 268 0.551% 99.776% ( 10, 15 ] 37 0.076% 99.852% ( 15, 22 ] 5 0.010% 99.862% ( 76, 110 ] 1 0.002% 99.864% ( 110, 170 ] 7 0.014% 99.879% ( 170, 250 ] 13 0.027% 99.905% ( 250, 380 ] 8 0.016% 99.922% ( 380, 580 ] 15 0.031% 99.953% ( 580, 870 ] 11 0.023% 99.975% ( 870, 1300 ] 7 0.014% 99.990% ( 1300, 1900 ] 1 0.002% 99.992% ( 1900, 2900 ] 5 0.010% 100.002% ** Level 3 read latency histogram (micros): Count: 685000 Average: 5.3696 StdDev: 54.21 Min: 0 Median: 1.8697 Max: 6597 Percentiles: P50: 1.87 P75: 2.80 P99: 9.26 P99.9: 239.32 P99.99: 360.44 ------------------------------------------------------ [ 0, 1 ] 17036 2.487% 2.487% ( 1, 2 ] 374226 54.632% 57.119% ########### ( 2, 3 ] 152842 22.313% 79.431% #### ( 3, 4 ] 65801 9.606% 89.037% ## ( 4, 6 ] 58095 8.481% 97.518% ## ( 6, 10 ] 12449 1.817% 99.336% ( 10, 15 ] 2200 0.321% 99.657% ( 15, 22 ] 306 0.045% 99.701% ( 22, 34 ] 28 0.004% 99.706% ( 34, 51 ] 10 0.001% 99.707% ( 51, 76 ] 7 0.001% 99.708% ( 76, 110 ] 190 0.028% 99.736% ( 110, 170 ] 586 0.086% 99.821% ( 170, 250 ] 622 0.091% 99.912% ( 250, 380 ] 628 0.092% 100.004% ( 380, 580 ] 635 0.093% 100.096% ( 580, 870 ] 492 0.072% 100.168% ( 870, 1300 ] 225 0.033% 100.201% ( 1300, 1900 ] 71 0.010% 100.212% ( 1900, 2900 ] 74 0.011% 100.222% ( 2900, 4400 ] 44 0.006% 100.229% ( 4400, 6600 ] 4 0.001% 100.229% ** Level 4 read latency histogram (micros): Count: 21219 Average: 10.0823 StdDev: 109.68 Min: 1 Median: 1.6976 Max: 5757 Percentiles: P50: 1.70 P75: 2.30 P99: 134.05 P99.9: 1346.86 P99.99: 4373.88 ------------------------------------------------------ [ 0, 1 ] 894 4.213% 4.213% # ( 1, 2 ] 13927 65.635% 69.848% ############# ( 2, 3 ] 3634 17.126% 86.974% ### ( 3, 4 ] 1441 6.791% 93.765% # ( 4, 6 ] 882 4.157% 97.922% # ( 6, 10 ] 171 0.806% 98.728% ( 10, 15 ] 22 0.104% 98.831% ( 15, 22 ] 18 0.085% 98.916% ( 22, 34 ] 4 0.019% 98.935% ( 34, 51 ] 1 0.005% 98.940% ( 51, 76 ] 4 0.019% 98.958% ( 76, 110 ] 4 0.019% 98.977% ( 110, 170 ] 12 0.057% 99.034% ( 170, 250 ] 29 0.137% 99.171% ( 250, 380 ] 31 0.146% 99.317% ( 380, 580 ] 43 0.203% 99.519% ( 580, 870 ] 53 0.250% 99.769% ( 870, 1300 ] 27 0.127% 99.896% ( 1300, 1900 ] 10 0.047% 99.943% ( 1900, 2900 ] 3 0.014% 99.958% ( 2900, 4400 ] 7 0.033% 99.991% ( 4400, 6600 ] 2 0.009% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 891.0167 StdDev: 1056.22 Min: 79 Median: 380.0000 Max: 5884 Percentiles: P50: 380.00 P75: 1224.12 P99: 4620.00 P99.9: 5884.00 P99.99: 5884.00 ------------------------------------------------------ ( 76, 110 ] 25 13.889% 13.889% ### ( 110, 170 ] 27 15.000% 28.889% ### ( 170, 250 ] 14 7.778% 36.667% ## ( 250, 380 ] 24 13.333% 50.000% ### ( 380, 580 ] 18 10.000% 60.000% ## ( 580, 870 ] 13 7.222% 67.222% # ( 870, 1300 ] 17 9.444% 76.667% ## ( 1300, 1900 ] 9 5.000% 81.667% # ( 1900, 2900 ] 23 12.778% 94.444% ### ( 2900, 4400 ] 8 4.444% 98.889% # ( 4400, 6600 ] 2 1.111% 100.000% ** DB Stats ** Uptime(secs): 45.7 total, 10.8 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 193.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.617 H:M:S, 45.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 91.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.752 H:M:S, 71.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.275 micros/op 159353 ops/sec 60.143 seconds 9583999 operations; 154.4 MB/s Microseconds per write: Count: 9583999 Average: 6.2754 StdDev: 252.86 Min: 1 Median: 1.7503 Max: 247991 Percentiles: P50: 1.75 P75: 2.81 P99: 9.67 P99.9: 1191.41 P99.99: 2698.80 ------------------------------------------------------ [ 0, 1 ] 1193737 12.456% 12.456% ## ( 1, 2 ] 4795832 50.040% 62.496% ########## ( 2, 3 ] 1478740 15.429% 77.925% ### ( 3, 4 ] 1347551 14.060% 91.985% ### ( 4, 6 ] 553447 5.775% 97.760% # ( 6, 10 ] 129558 1.352% 99.112% ( 10, 15 ] 39649 0.414% 99.525% ( 15, 22 ] 9421 0.098% 99.624% ( 22, 34 ] 1724 0.018% 99.642% ( 34, 51 ] 199 0.002% 99.644% ( 51, 76 ] 27 0.000% 99.644% ( 76, 110 ] 6366 0.066% 99.710% ( 110, 170 ] 2893 0.030% 99.741% ( 170, 250 ] 303 0.003% 99.744% ( 250, 380 ] 158 0.002% 99.745% ( 380, 580 ] 21 0.000% 99.746% ( 580, 870 ] 13 0.000% 99.746% ( 870, 1300 ] 19768 0.206% 99.952% ( 1300, 1900 ] 51 0.001% 99.953% ( 1900, 2900 ] 4485 0.047% 99.999% ( 2900, 4400 ] 24 0.000% 100.000% ( 4400, 6600 ] 12 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 214091 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9583999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9890686968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 460 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33458329 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 29273300787 rocksdb.compact.write.bytes COUNT : 29073160755 rocksdb.flush.write.bytes COUNT : 9842731373 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 44 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 211 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9763172352 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3617792 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 29359601740 rocksdb.non.last.level.read.count COUNT : 7096128 rocksdb.block.checksum.compute.count COUNT : 7095252 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.402417 P95 : 3.965417 P99 : 8.472682 P100 : 247986.000000 COUNT : 9583999 SUM : 55564366 rocksdb.compaction.times.micros P50 : 924482.758621 P95 : 3687500.000000 P99 : 15679178.000000 P100 : 15679178.000000 COUNT : 75 SUM : 102112087 rocksdb.compaction.times.cpu_micros P50 : 886562.500000 P95 : 3687500.000000 P99 : 14894215.000000 P100 : 14894215.000000 COUNT : 75 SUM : 95077709 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 698.023256 P95 : 1268.727273 P99 : 19120.000000 P100 : 34401.000000 COUNT : 136 SUM : 160960 rocksdb.compaction.outfile.sync.micros P50 : 872.721519 P95 : 13209.285714 P99 : 66083.333333 P100 : 85181.000000 COUNT : 307 SUM : 1009729 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 91.853933 P95 : 316.772727 P99 : 531.000000 P100 : 692.000000 COUNT : 247 SUM : 29414 rocksdb.table.open.io.micros P50 : 1173.965517 P95 : 6490.000000 P99 : 10856.666667 P100 : 13651.000000 COUNT : 460 SUM : 825701 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.564413 P95 : 6.753962 P99 : 9.877541 P100 : 7303.000000 COUNT : 7093844 SUM : 35028351 rocksdb.read.block.get.micros P50 : 382.222222 P95 : 2900.000000 P99 : 4315.384615 P100 : 6733.000000 COUNT : 920 SUM : 684393 rocksdb.write.raw.block.micros P50 : 0.511784 P95 : 0.972389 P99 : 2.888860 P100 : 9548.000000 COUNT : 9424859 SUM : 16854831 rocksdb.numfiles.in.singlecompaction P50 : 3.230769 P95 : 5.466667 P99 : 20.880000 P100 : 29.000000 COUNT : 116 SUM : 438 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559095 P95 : 1147.966072 P99 : 2395.137185 P100 : 247780.000000 COUNT : 231330 SUM : 33478575 rocksdb.sst.read.micros P50 : 1.529181 P95 : 3.925457 P99 : 7.470989 P100 : 7297.000000 COUNT : 7096154 SUM : 20741505 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9583999 SUM : 9890686968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210000.000000 P95 : 342000.000000 P99 : 417866.000000 P100 : 417866.000000 COUNT : 136 SUM : 27129425 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 296 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0