[2024-12-14 02:13:26.279586] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 22.11.4 initialization... [2024-12-14 02:13:26.279875] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid197105 ] Set seed to 1734138806272821 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-14 02:13:26.383748] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-14 02:13:26.406655] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-14 02:13:26.406698] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 197105' to capture a snapshot of events at runtime. [2024-12-14 02:13:26.406709] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-14 02:13:26.406720] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-14 02:13:26.406728] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid197105 for offline analysis/debug. [2024-12-14 02:13:26.407276] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 14 02:13:30 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/14-02:13:38 ... thread 0: (1000000,1000000) ops and (133228.4,133228.4) ops/second in (7.505905,7.505905) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 818.33 MB 50.3 0.4 0.0 0.4 1.2 0.8 0.0 1.5 40.1 126.9 9.42 3.94 10 0.942 383K 517 0.0 0.0 L1 2/0 87.39 MB 8.7 0.6 0.4 0.2 0.6 0.4 0.0 1.4 107.5 107.3 5.35 2.66 1 5.348 583K 1067 0.0 0.0 L2 6/4 486.34 MB 2.0 0.0 0.0 0.0 0.0 0.0 0.5 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 50/26 3.65 GB 1.8 3.5 2.3 1.2 3.4 2.2 0.0 1.5 102.7 101.6 34.40 16.60 16 2.150 2121K 344 0.0 0.0 L4 187/10 11.40 GB 1.1 2.4 1.9 0.5 2.4 1.9 0.0 1.3 109.2 108.3 22.42 11.55 17 1.319 1447K 0 0.0 0.0 L5 1096/0 90.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1347/44 106.59 GB 0.0 6.8 4.5 2.2 7.5 5.3 0.5 9.4 96.9 107.4 71.59 34.76 44 1.627 4536K 1928 0.0 0.0 Int 0/0 0.00 KB 0.0 6.8 4.5 2.2 7.5 5.3 0.5 9.4 96.9 107.4 71.59 34.76 44 1.627 4536K 1928 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.8 4.5 2.2 6.7 4.5 0.0 0.0 106.9 105.9 64.89 32.37 35 1.854 4536K 1928 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 122.1 6.71 2.38 9 0.745 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.7 total, 7.5 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.51 GB write, 999.32 MB/s write, 6.77 GB read, 901.03 MB/s read, 71.6 seconds Interval compaction: 7.51 GB write, 1024.49 MB/s write, 6.77 GB read, 923.73 MB/s read, 71.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 30, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 30, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 261203 Average: 10.1286 StdDev: 149.20 Min: 1 Median: 1.8713 Max: 17422 Percentiles: P50: 1.87 P75: 2.88 P99: 9.70 P99.9: 2198.19 P99.99: 4063.29 ------------------------------------------------------ [ 0, 1 ] 11360 4.349% 4.349% # ( 1, 2 ] 136854 52.394% 56.743% ########## ( 2, 3 ] 54168 20.738% 77.481% #### ( 3, 4 ] 26249 10.049% 87.530% ## ( 4, 6 ] 25104 9.611% 97.141% ## ( 6, 10 ] 5248 2.009% 99.150% ( 10, 15 ] 947 0.363% 99.513% ( 15, 22 ] 118 0.045% 99.558% ( 22, 34 ] 15 0.006% 99.564% ( 34, 51 ] 13 0.005% 99.569% ( 51, 76 ] 9 0.003% 99.572% ( 76, 110 ] 4 0.002% 99.574% ( 110, 170 ] 9 0.003% 99.577% ( 170, 250 ] 38 0.015% 99.592% ( 250, 380 ] 80 0.031% 99.622% ( 380, 580 ] 116 0.044% 99.667% ( 580, 870 ] 196 0.075% 99.742% ( 870, 1300 ] 218 0.083% 99.825% ( 1300, 1900 ] 147 0.056% 99.881% ( 1900, 2900 ] 167 0.064% 99.945% ( 2900, 4400 ] 152 0.058% 100.003% ( 4400, 6600 ] 29 0.011% 100.015% ( 6600, 9900 ] 9 0.003% 100.018% ( 9900, 14000 ] 3 0.001% 100.019% ( 14000, 22000 ] 2 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 86810 Average: 14.4933 StdDev: 192.24 Min: 1 Median: 1.9967 Max: 26686 Percentiles: P50: 2.00 P75: 3.14 P99: 13.54 P99.9: 2748.24 P99.99: 5864.41 ------------------------------------------------------ [ 0, 1 ] 2014 2.320% 2.320% ( 1, 2 ] 41527 47.837% 50.157% ########## ( 2, 3 ] 20225 23.298% 73.455% ##### ( 3, 4 ] 9578 11.033% 84.488% ## ( 4, 6 ] 9794 11.282% 95.770% ## ( 6, 10 ] 2509 2.890% 98.660% # ( 10, 15 ] 416 0.479% 99.140% ( 15, 22 ] 65 0.075% 99.214% ( 22, 34 ] 8 0.009% 99.224% ( 34, 51 ] 5 0.006% 99.229% ( 51, 76 ] 5 0.006% 99.235% ( 76, 110 ] 1 0.001% 99.236% ( 110, 170 ] 6 0.007% 99.243% ( 170, 250 ] 18 0.021% 99.264% ( 250, 380 ] 30 0.035% 99.298% ( 380, 580 ] 61 0.070% 99.369% ( 580, 870 ] 136 0.157% 99.525% ( 870, 1300 ] 131 0.151% 99.676% ( 1300, 1900 ] 117 0.135% 99.811% ( 1900, 2900 ] 91 0.105% 99.916% ( 2900, 4400 ] 55 0.063% 99.979% ( 4400, 6600 ] 14 0.016% 99.995% ( 6600, 9900 ] 1 0.001% 99.997% ( 14000, 22000 ] 1 0.001% 99.998% ( 22000, 33000 ] 1 0.001% 99.999% ** Level 2 read latency histogram (micros): Count: 493435 Average: 13.9130 StdDev: 171.32 Min: 1 Median: 2.0211 Max: 22161 Percentiles: P50: 2.02 P75: 3.12 P99: 12.56 P99.9: 1677.70 P99.99: 2459.95 ------------------------------------------------------ [ 0, 1 ] 11773 2.386% 2.386% ( 1, 2 ] 232435 47.105% 49.491% ######### ( 2, 3 ] 119156 24.148% 73.640% ##### ( 3, 4 ] 53869 10.917% 84.557% ## ( 4, 6 ] 54326 11.010% 95.567% ## ( 6, 10 ] 15454 3.132% 98.699% # ( 10, 15 ] 2909 0.590% 99.288% ( 15, 22 ] 493 0.100% 99.388% ( 22, 34 ] 72 0.015% 99.403% ( 34, 51 ] 34 0.007% 99.409% ( 51, 76 ] 45 0.009% 99.419% ( 76, 110 ] 13 0.003% 99.421% ( 110, 170 ] 49 0.010% 99.431% ( 170, 250 ] 99 0.020% 99.451% ( 250, 380 ] 240 0.049% 99.500% ( 380, 580 ] 446 0.090% 99.590% ( 580, 870 ] 559 0.113% 99.704% ( 870, 1300 ] 646 0.131% 99.834% ( 1300, 1900 ] 514 0.104% 99.939% ( 1900, 2900 ] 453 0.092% 100.030% ( 2900, 4400 ] 376 0.076% 100.107% ( 4400, 6600 ] 115 0.023% 100.130% ( 6600, 9900 ] 18 0.004% 100.134% ( 9900, 14000 ] 3 0.001% 100.134% ( 22000, 33000 ] 1 0.000% 100.134% ** Level 3 read latency histogram (micros): Count: 721103 Average: 13.0067 StdDev: 183.63 Min: 1 Median: 1.9831 Max: 33318 Percentiles: P50: 1.98 P75: 3.00 P99: 9.79 P99.9: 1148.27 P99.99: 1646.01 ------------------------------------------------------ [ 0, 1 ] 12447 1.726% 1.726% ( 1, 2 ] 354106 49.106% 50.832% ########## ( 2, 3 ] 173978 24.127% 74.959% ##### ( 3, 4 ] 79784 11.064% 86.023% ## ( 4, 6 ] 77224 10.709% 96.732% ## ( 6, 10 ] 17254 2.393% 99.125% ( 10, 15 ] 3007 0.417% 99.542% ( 15, 22 ] 369 0.051% 99.593% ( 22, 34 ] 39 0.005% 99.599% ( 34, 51 ] 54 0.007% 99.606% ( 51, 76 ] 39 0.005% 99.611% ( 76, 110 ] 21 0.003% 99.614% ( 110, 170 ] 40 0.006% 99.620% ( 170, 250 ] 104 0.014% 99.634% ( 250, 380 ] 211 0.029% 99.664% ( 380, 580 ] 458 0.064% 99.727% ( 580, 870 ] 726 0.101% 99.828% ( 870, 1300 ] 808 0.112% 99.940% ( 1300, 1900 ] 631 0.088% 100.027% ( 1900, 2900 ] 641 0.089% 100.116% ( 2900, 4400 ] 515 0.071% 100.188% ( 4400, 6600 ] 172 0.024% 100.211% ( 6600, 9900 ] 17 0.002% 100.214% ( 9900, 14000 ] 5 0.001% 100.215% ( 14000, 22000 ] 2 0.000% 100.215% ( 22000, 33000 ] 4 0.001% 100.215% ( 33000, 50000 ] 1 0.000% 100.216% ** Level 4 read latency histogram (micros): Count: 173667 Average: 34.8985 StdDev: 306.37 Min: 1 Median: 2.0199 Max: 32648 Percentiles: P50: 2.02 P75: 3.11 P99: 1090.98 P99.9: 3965.55 P99.99: 5199.94 ------------------------------------------------------ [ 0, 1 ] 2949 1.698% 1.698% ( 1, 2 ] 83047 47.820% 49.518% ########## ( 2, 3 ] 42146 24.268% 73.786% ##### ( 3, 4 ] 19184 11.046% 84.832% ## ( 4, 6 ] 17752 10.222% 95.054% ## ( 6, 10 ] 4224 2.432% 97.487% ( 10, 15 ] 737 0.424% 97.911% ( 15, 22 ] 80 0.046% 97.957% ( 22, 34 ] 10 0.006% 97.963% ( 34, 51 ] 10 0.006% 97.969% ( 51, 76 ] 20 0.012% 97.980% ( 76, 110 ] 6 0.003% 97.983% ( 110, 170 ] 38 0.022% 98.005% ( 170, 250 ] 108 0.062% 98.068% ( 250, 380 ] 184 0.106% 98.174% ( 380, 580 ] 418 0.241% 98.414% ( 580, 870 ] 654 0.377% 98.791% ( 870, 1300 ] 707 0.407% 99.198% ( 1300, 1900 ] 545 0.314% 99.512% ( 1900, 2900 ] 398 0.229% 99.741% ( 2900, 4400 ] 389 0.224% 99.965% ( 4400, 6600 ] 120 0.069% 100.034% ( 6600, 9900 ] 19 0.011% 100.045% ( 9900, 14000 ] 1 0.001% 100.045% ( 14000, 22000 ] 3 0.002% 100.047% ( 22000, 33000 ] 1 0.001% 100.048% ** Level 5 read latency histogram (micros): Count: 12493 Average: 1758.6081 StdDev: 1587.56 Min: 89 Median: 1215.8326 Max: 35826 Percentiles: P50: 1215.83 P75: 2475.05 P99: 6594.07 P99.9: 11368.39 P99.99: 29564.42 ------------------------------------------------------ ( 76, 110 ] 13 0.104% 0.104% ( 110, 170 ] 89 0.712% 0.816% ( 170, 250 ] 198 1.585% 2.401% ( 250, 380 ] 595 4.763% 7.164% # ( 380, 580 ] 1370 10.966% 18.130% ## ( 580, 870 ] 2151 17.218% 35.348% ### ( 870, 1300 ] 2276 18.218% 53.566% #### ( 1300, 1900 ] 1787 14.304% 67.870% ### ( 1900, 2900 ] 1549 12.399% 80.269% ## ( 2900, 4400 ] 1626 13.015% 93.284% ### ( 4400, 6600 ] 716 5.731% 99.015% # ( 6600, 9900 ] 108 0.864% 99.880% ( 9900, 14000 ] 7 0.056% 99.936% ( 14000, 22000 ] 4 0.032% 99.968% ( 22000, 33000 ] 4 0.032% 100.000% ( 33000, 50000 ] 1 0.008% 100.008% ** DB Stats ** Uptime(secs): 7.7 total, 7.5 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 127.87 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.616 H:M:S, 47.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 131.07 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.616 H:M:S, 48.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/14-02:13:45 ... thread 0: (1000000,2000000) ops and (132107.9,132665.8) ops/second in (7.569570,15.075475) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1007.28 MB 62.9 1.0 0.0 1.0 2.9 1.8 0.0 1.6 50.0 138.2 21.41 9.84 24 0.892 1087K 1390 0.0 0.0 L1 2/0 185.34 MB 18.5 1.5 1.2 0.3 1.5 1.2 0.0 1.2 129.8 129.4 11.89 7.17 2 5.945 1567K 4491 0.0 0.0 L2 8/7 869.00 MB 1.3 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 18/15 1.25 GB 0.1 5.5 2.6 2.8 5.4 2.6 0.0 2.1 108.1 107.1 51.89 26.26 21 2.471 3311K 3363 0.0 0.0 L4 177/0 9.46 GB 1.0 7.5 4.2 3.3 7.4 4.1 0.4 1.7 116.7 114.9 66.05 35.82 54 1.223 3879K 2147 0.0 0.0 L5 1152/0 94.80 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1365/26 107.52 GB 0.0 15.6 8.1 7.4 17.2 9.8 6.3 9.3 105.3 116.7 151.23 79.09 101 1.497 9845K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.6 8.1 7.4 17.2 9.8 6.3 9.3 105.3 116.7 151.23 79.09 101 1.497 9845K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.6 8.1 7.4 15.4 7.9 0.0 0.0 116.5 115.2 136.79 73.65 80 1.710 9845K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 130.8 14.45 5.44 21 0.688 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.3 total, 15.1 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.23 GB write, 1155.75 MB/s write, 15.56 GB read, 1043.60 MB/s read, 151.2 seconds Interval compaction: 17.23 GB write, 1170.25 MB/s write, 15.56 GB read, 1056.69 MB/s read, 151.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 60, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 689524 Average: 10.1047 StdDev: 140.07 Min: 1 Median: 1.8767 Max: 17422 Percentiles: P50: 1.88 P75: 2.86 P99: 9.77 P99.9: 1782.04 P99.99: 3787.22 ------------------------------------------------------ [ 0, 1 ] 27172 3.941% 3.941% # ( 1, 2 ] 362270 52.539% 56.480% ########### ( 2, 3 ] 147648 21.413% 77.893% #### ( 3, 4 ] 66490 9.643% 87.536% ## ( 4, 6 ] 65358 9.479% 97.014% ## ( 6, 10 ] 14508 2.104% 99.119% ( 10, 15 ] 2337 0.339% 99.457% ( 15, 22 ] 269 0.039% 99.496% ( 22, 34 ] 28 0.004% 99.501% ( 34, 51 ] 20 0.003% 99.503% ( 51, 76 ] 31 0.004% 99.508% ( 76, 110 ] 14 0.002% 99.510% ( 110, 170 ] 52 0.008% 99.517% ( 170, 250 ] 98 0.014% 99.532% ( 250, 380 ] 252 0.037% 99.568% ( 380, 580 ] 469 0.068% 99.636% ( 580, 870 ] 725 0.105% 99.741% ( 870, 1300 ] 744 0.108% 99.849% ( 1300, 1900 ] 435 0.063% 99.912% ( 1900, 2900 ] 344 0.050% 99.962% ( 2900, 4400 ] 323 0.047% 100.009% ( 4400, 6600 ] 101 0.015% 100.024% ( 6600, 9900 ] 13 0.002% 100.026% ( 9900, 14000 ] 6 0.001% 100.027% ( 14000, 22000 ] 3 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 170997 Average: 15.6968 StdDev: 186.66 Min: 1 Median: 2.0093 Max: 26686 Percentiles: P50: 2.01 P75: 3.09 P99: 15.46 P99.9: 2795.97 P99.99: 5060.02 ------------------------------------------------------ [ 0, 1 ] 3400 1.988% 1.988% ( 1, 2 ] 81711 47.785% 49.773% ########## ( 2, 3 ] 41538 24.292% 74.065% ##### ( 3, 4 ] 18467 10.800% 84.865% ## ( 4, 6 ] 18611 10.884% 95.748% ## ( 6, 10 ] 4783 2.797% 98.546% # ( 10, 15 ] 769 0.450% 98.995% ( 15, 22 ] 122 0.071% 99.067% ( 22, 34 ] 14 0.008% 99.075% ( 34, 51 ] 7 0.004% 99.079% ( 51, 76 ] 14 0.008% 99.087% ( 76, 110 ] 1 0.001% 99.088% ( 110, 170 ] 18 0.011% 99.098% ( 170, 250 ] 33 0.019% 99.118% ( 250, 380 ] 86 0.050% 99.168% ( 380, 580 ] 225 0.132% 99.299% ( 580, 870 ] 332 0.194% 99.494% ( 870, 1300 ] 332 0.194% 99.688% ( 1300, 1900 ] 208 0.122% 99.809% ( 1900, 2900 ] 173 0.101% 99.911% ( 2900, 4400 ] 126 0.074% 99.984% ( 4400, 6600 ] 33 0.019% 100.004% ( 6600, 9900 ] 5 0.003% 100.006% ( 9900, 14000 ] 1 0.001% 100.007% ( 14000, 22000 ] 1 0.001% 100.008% ( 22000, 33000 ] 1 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 493436 Average: 13.9186 StdDev: 171.37 Min: 1 Median: 2.0211 Max: 22161 Percentiles: P50: 2.02 P75: 3.12 P99: 12.56 P99.9: 1678.87 P99.99: 2460.92 ------------------------------------------------------ [ 0, 1 ] 11773 2.386% 2.386% ( 1, 2 ] 232435 47.105% 49.491% ######### ( 2, 3 ] 119156 24.148% 73.640% ##### ( 3, 4 ] 53869 10.917% 84.557% ## ( 4, 6 ] 54326 11.010% 95.566% ## ( 6, 10 ] 15454 3.132% 98.698% # ( 10, 15 ] 2909 0.590% 99.288% ( 15, 22 ] 493 0.100% 99.388% ( 22, 34 ] 72 0.015% 99.402% ( 34, 51 ] 34 0.007% 99.409% ( 51, 76 ] 45 0.009% 99.418% ( 76, 110 ] 13 0.003% 99.421% ( 110, 170 ] 49 0.010% 99.431% ( 170, 250 ] 99 0.020% 99.451% ( 250, 380 ] 240 0.049% 99.500% ( 380, 580 ] 446 0.090% 99.590% ( 580, 870 ] 559 0.113% 99.703% ( 870, 1300 ] 646 0.131% 99.834% ( 1300, 1900 ] 514 0.104% 99.938% ( 1900, 2900 ] 454 0.092% 100.030% ( 2900, 4400 ] 376 0.076% 100.107% ( 4400, 6600 ] 115 0.023% 100.130% ( 6600, 9900 ] 18 0.004% 100.134% ( 9900, 14000 ] 3 0.001% 100.134% ( 22000, 33000 ] 1 0.000% 100.134% ** Level 3 read latency histogram (micros): Count: 1687393 Average: 11.8762 StdDev: 166.77 Min: 1 Median: 1.9897 Max: 33318 Percentiles: P50: 1.99 P75: 3.00 P99: 9.77 P99.9: 1017.86 P99.99: 1500.80 ------------------------------------------------------ [ 0, 1 ] 25899 1.535% 1.535% ( 1, 2 ] 826341 48.971% 50.506% ########## ( 2, 3 ] 413759 24.521% 75.027% ##### ( 3, 4 ] 184224 10.918% 85.945% ## ( 4, 6 ] 180900 10.721% 96.665% ## ( 6, 10 ] 41763 2.475% 99.140% ( 10, 15 ] 7303 0.433% 99.573% ( 15, 22 ] 898 0.053% 99.626% ( 22, 34 ] 87 0.005% 99.631% ( 34, 51 ] 133 0.008% 99.639% ( 51, 76 ] 160 0.009% 99.649% ( 76, 110 ] 43 0.003% 99.651% ( 110, 170 ] 91 0.005% 99.657% ( 170, 250 ] 219 0.013% 99.670% ( 250, 380 ] 502 0.030% 99.699% ( 380, 580 ] 1094 0.065% 99.764% ( 580, 870 ] 1704 0.101% 99.865% ( 870, 1300 ] 1703 0.101% 99.966% ( 1300, 1900 ] 1199 0.071% 100.037% ( 1900, 2900 ] 1172 0.069% 100.107% ( 2900, 4400 ] 1139 0.068% 100.174% ( 4400, 6600 ] 349 0.021% 100.195% ( 6600, 9900 ] 57 0.003% 100.198% ( 9900, 14000 ] 9 0.001% 100.199% ( 14000, 22000 ] 6 0.000% 100.199% ( 22000, 33000 ] 4 0.000% 100.199% ( 33000, 50000 ] 1 0.000% 100.199% ** Level 4 read latency histogram (micros): Count: 857580 Average: 21.4123 StdDev: 224.21 Min: 1 Median: 1.9800 Max: 32648 Percentiles: P50: 1.98 P75: 3.02 P99: 406.89 P99.9: 2713.62 P99.99: 3655.55 ------------------------------------------------------ [ 0, 1 ] 14916 1.739% 1.739% ( 1, 2 ] 422317 49.245% 50.985% ########## ( 2, 3 ] 203944 23.781% 74.766% ##### ( 3, 4 ] 90578 10.562% 85.328% ## ( 4, 6 ] 89182 10.399% 95.727% ## ( 6, 10 ] 22513 2.625% 98.352% # ( 10, 15 ] 3633 0.424% 98.776% ( 15, 22 ] 465 0.054% 98.830% ( 22, 34 ] 35 0.004% 98.834% ( 34, 51 ] 83 0.010% 98.844% ( 51, 76 ] 96 0.011% 98.855% ( 76, 110 ] 32 0.004% 98.859% ( 110, 170 ] 123 0.014% 98.873% ( 170, 250 ] 311 0.036% 98.909% ( 250, 380 ] 592 0.069% 98.979% ( 380, 580 ] 1370 0.160% 99.138% ( 580, 870 ] 2101 0.245% 99.383% ( 870, 1300 ] 2158 0.252% 99.635% ( 1300, 1900 ] 1424 0.166% 99.801% ( 1900, 2900 ] 1044 0.122% 99.923% ( 2900, 4400 ] 1146 0.134% 100.056% ( 4400, 6600 ] 336 0.039% 100.096% ( 6600, 9900 ] 61 0.007% 100.103% ( 9900, 14000 ] 5 0.001% 100.103% ( 14000, 22000 ] 4 0.000% 100.104% ( 22000, 33000 ] 1 0.000% 100.104% ** Level 5 read latency histogram (micros): Count: 30836 Average: 1449.4898 StdDev: 1356.63 Min: 84 Median: 998.0075 Max: 35826 Percentiles: P50: 998.01 P75: 1800.80 P99: 6346.13 P99.9: 9698.39 P99.99: 21904.46 ------------------------------------------------------ ( 76, 110 ] 36 0.117% 0.117% ( 110, 170 ] 309 1.002% 1.119% ( 170, 250 ] 706 2.290% 3.408% ( 250, 380 ] 1902 6.168% 9.576% # ( 380, 580 ] 4127 13.384% 22.960% ### ( 580, 870 ] 6442 20.891% 43.851% #### ( 870, 1300 ] 6369 20.654% 64.506% #### ( 1300, 1900 ] 3877 12.573% 77.079% ### ( 1900, 2900 ] 2836 9.197% 86.276% ## ( 2900, 4400 ] 2955 9.583% 95.859% ## ( 4400, 6600 ] 1095 3.551% 99.410% # ( 6600, 9900 ] 161 0.522% 99.932% ( 9900, 14000 ] 11 0.036% 99.968% ( 14000, 22000 ] 7 0.023% 99.990% ( 22000, 33000 ] 4 0.013% 100.003% ( 33000, 50000 ] 1 0.003% 100.006% ** DB Stats ** Uptime(secs): 15.3 total, 7.6 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 128.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.264 H:M:S, 47.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.647 H:M:S, 48.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/12/14-02:13:50 ... thread 0: (1000000,3000000) ops and (192994.2,148097.1) ops/second in (5.181503,20.256978) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.91 GB 69.2 2.0 0.0 2.0 4.7 2.8 0.0 1.7 65.7 158.0 30.68 16.28 40 0.767 2046K 2472 0.0 0.0 L1 2/2 185.34 MB 0.0 1.5 1.2 0.3 1.5 1.2 0.0 1.2 129.8 129.4 11.89 7.17 2 5.945 1567K 4491 0.0 0.0 L2 1/1 128.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/4 1.19 GB 0.9 7.3 3.4 4.0 7.3 3.3 0.0 2.2 117.6 116.7 63.81 34.99 28 2.279 4844K 10K 0.0 0.0 L4 188/15 10.20 GB 1.0 9.2 5.0 4.2 9.1 4.8 0.5 1.8 120.6 118.6 78.23 43.63 63 1.242 5143K 5603 0.0 0.0 L5 1152/0 94.80 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1376/31 108.41 GB 0.0 20.0 9.6 10.4 22.6 12.1 6.3 8.2 111.0 125.2 184.61 102.07 133 1.388 13M 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.0 9.6 10.4 22.6 12.1 6.3 8.2 111.0 125.2 184.61 102.07 133 1.388 13M 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.0 9.6 10.4 19.8 9.4 0.0 0.0 124.0 122.6 165.30 94.01 99 1.670 13M 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 146.9 19.30 8.06 34 0.568 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.4 total, 20.3 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.57 GB write, 1130.15 MB/s write, 20.01 GB read, 1002.33 MB/s read, 184.6 seconds Interval compaction: 22.57 GB write, 1140.70 MB/s write, 20.01 GB read, 1011.69 MB/s read, 184.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 68, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1023142 Average: 9.4464 StdDev: 128.99 Min: 1 Median: 1.8697 Max: 17595 Percentiles: P50: 1.87 P75: 2.84 P99: 9.75 P99.9: 1570.85 P99.99: 3445.64 ------------------------------------------------------ [ 0, 1 ] 39640 3.874% 3.874% # ( 1, 2 ] 542653 53.038% 56.912% ########### ( 2, 3 ] 220537 21.555% 78.467% #### ( 3, 4 ] 96952 9.476% 87.943% ## ( 4, 6 ] 94265 9.213% 97.156% ## ( 6, 10 ] 20122 1.967% 99.123% ( 10, 15 ] 3280 0.321% 99.444% ( 15, 22 ] 378 0.037% 99.481% ( 22, 34 ] 38 0.004% 99.484% ( 34, 51 ] 45 0.004% 99.489% ( 51, 76 ] 37 0.004% 99.492% ( 76, 110 ] 31 0.003% 99.495% ( 110, 170 ] 125 0.012% 99.507% ( 170, 250 ] 267 0.026% 99.534% ( 250, 380 ] 491 0.048% 99.582% ( 380, 580 ] 851 0.083% 99.665% ( 580, 870 ] 1110 0.108% 99.773% ( 870, 1300 ] 1041 0.102% 99.875% ( 1300, 1900 ] 569 0.056% 99.931% ( 1900, 2900 ] 461 0.045% 99.976% ( 2900, 4400 ] 406 0.040% 100.015% ( 4400, 6600 ] 112 0.011% 100.026% ( 6600, 9900 ] 16 0.002% 100.028% ( 9900, 14000 ] 6 0.001% 100.028% ( 14000, 22000 ] 4 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 409396 Average: 10.5649 StdDev: 142.41 Min: 1 Median: 1.9643 Max: 26686 Percentiles: P50: 1.96 P75: 2.94 P99: 9.95 P99.9: 1520.56 P99.99: 2671.08 ------------------------------------------------------ [ 0, 1 ] 6514 1.591% 1.591% ( 1, 2 ] 205520 50.201% 51.792% ########## ( 2, 3 ] 100811 24.624% 76.416% ##### ( 3, 4 ] 41602 10.162% 86.578% ## ( 4, 6 ] 40796 9.965% 96.543% ## ( 6, 10 ] 10177 2.486% 99.029% ( 10, 15 ] 1557 0.380% 99.409% ( 15, 22 ] 210 0.051% 99.460% ( 22, 34 ] 19 0.005% 99.465% ( 34, 51 ] 24 0.006% 99.471% ( 51, 76 ] 28 0.007% 99.478% ( 76, 110 ] 11 0.003% 99.480% ( 110, 170 ] 39 0.010% 99.490% ( 170, 250 ] 76 0.019% 99.509% ( 250, 380 ] 153 0.037% 99.546% ( 380, 580 ] 357 0.087% 99.633% ( 580, 870 ] 506 0.124% 99.757% ( 870, 1300 ] 480 0.117% 99.874% ( 1300, 1900 ] 290 0.071% 99.945% ( 1900, 2900 ] 240 0.059% 100.003% ( 2900, 4400 ] 192 0.047% 100.050% ( 4400, 6600 ] 37 0.009% 100.059% ( 6600, 9900 ] 5 0.001% 100.061% ( 9900, 14000 ] 1 0.000% 100.061% ( 14000, 22000 ] 3 0.001% 100.062% ( 22000, 33000 ] 1 0.000% 100.062% ** Level 2 read latency histogram (micros): Count: 493436 Average: 13.9186 StdDev: 171.37 Min: 1 Median: 2.0211 Max: 22161 Percentiles: P50: 2.02 P75: 3.12 P99: 12.56 P99.9: 1678.87 P99.99: 2460.92 ------------------------------------------------------ [ 0, 1 ] 11773 2.386% 2.386% ( 1, 2 ] 232435 47.105% 49.491% ######### ( 2, 3 ] 119156 24.148% 73.640% ##### ( 3, 4 ] 53869 10.917% 84.557% ## ( 4, 6 ] 54326 11.010% 95.566% ## ( 6, 10 ] 15454 3.132% 98.698% # ( 10, 15 ] 2909 0.590% 99.288% ( 15, 22 ] 493 0.100% 99.388% ( 22, 34 ] 72 0.015% 99.402% ( 34, 51 ] 34 0.007% 99.409% ( 51, 76 ] 45 0.009% 99.418% ( 76, 110 ] 13 0.003% 99.421% ( 110, 170 ] 49 0.010% 99.431% ( 170, 250 ] 99 0.020% 99.451% ( 250, 380 ] 240 0.049% 99.500% ( 380, 580 ] 446 0.090% 99.590% ( 580, 870 ] 559 0.113% 99.703% ( 870, 1300 ] 646 0.131% 99.834% ( 1300, 1900 ] 514 0.104% 99.938% ( 1900, 2900 ] 454 0.092% 100.030% ( 2900, 4400 ] 376 0.076% 100.107% ( 4400, 6600 ] 115 0.023% 100.130% ( 6600, 9900 ] 18 0.004% 100.134% ( 9900, 14000 ] 3 0.001% 100.134% ( 22000, 33000 ] 1 0.000% 100.134% ** Level 3 read latency histogram (micros): Count: 2194094 Average: 10.9516 StdDev: 155.14 Min: 1 Median: 1.9777 Max: 33318 Percentiles: P50: 1.98 P75: 2.98 P99: 9.71 P99.9: 966.49 P99.99: 1463.54 ------------------------------------------------------ [ 0, 1 ] 32803 1.495% 1.495% ( 1, 2 ] 1088490 49.610% 51.105% ########## ( 2, 3 ] 535905 24.425% 75.530% ##### ( 3, 4 ] 236135 10.762% 86.292% ## ( 4, 6 ] 229557 10.462% 96.755% ## ( 6, 10 ] 53126 2.421% 99.176% ( 10, 15 ] 8972 0.409% 99.585% ( 15, 22 ] 1097 0.050% 99.635% ( 22, 34 ] 102 0.005% 99.640% ( 34, 51 ] 187 0.009% 99.648% ( 51, 76 ] 195 0.009% 99.657% ( 76, 110 ] 57 0.003% 99.660% ( 110, 170 ] 140 0.006% 99.666% ( 170, 250 ] 324 0.015% 99.681% ( 250, 380 ] 734 0.033% 99.714% ( 380, 580 ] 1466 0.067% 99.781% ( 580, 870 ] 2150 0.098% 99.879% ( 870, 1300 ] 2054 0.094% 99.973% ( 1300, 1900 ] 1400 0.064% 100.036% ( 1900, 2900 ] 1373 0.063% 100.099% ( 2900, 4400 ] 1311 0.060% 100.159% ( 4400, 6600 ] 367 0.017% 100.176% ( 6600, 9900 ] 60 0.003% 100.178% ( 9900, 14000 ] 10 0.000% 100.179% ( 14000, 22000 ] 8 0.000% 100.179% ( 22000, 33000 ] 4 0.000% 100.179% ( 33000, 50000 ] 1 0.000% 100.179% ** Level 4 read latency histogram (micros): Count: 1246966 Average: 20.2853 StdDev: 211.63 Min: 1 Median: 1.9784 Max: 32648 Percentiles: P50: 1.98 P75: 3.00 P99: 372.85 P99.9: 2433.54 P99.99: 3356.74 ------------------------------------------------------ [ 0, 1 ] 20330 1.630% 1.630% ( 1, 2 ] 616497 49.440% 51.070% ########## ( 2, 3 ] 298079 23.904% 74.974% ##### ( 3, 4 ] 130758 10.486% 85.461% ## ( 4, 6 ] 127870 10.254% 95.715% ## ( 6, 10 ] 32639 2.617% 98.333% # ( 10, 15 ] 5255 0.421% 98.754% ( 15, 22 ] 630 0.051% 98.804% ( 22, 34 ] 53 0.004% 98.809% ( 34, 51 ] 118 0.009% 98.818% ( 51, 76 ] 148 0.012% 98.830% ( 76, 110 ] 57 0.005% 98.835% ( 110, 170 ] 293 0.023% 98.858% ( 170, 250 ] 658 0.053% 98.911% ( 250, 380 ] 1176 0.094% 99.005% ( 380, 580 ] 2296 0.184% 99.189% ( 580, 870 ] 3202 0.257% 99.446% ( 870, 1300 ] 3059 0.245% 99.691% ( 1300, 1900 ] 1837 0.147% 99.839% ( 1900, 2900 ] 1432 0.115% 99.954% ( 2900, 4400 ] 1492 0.120% 100.073% ( 4400, 6600 ] 417 0.033% 100.107% ( 6600, 9900 ] 75 0.006% 100.113% ( 9900, 14000 ] 7 0.001% 100.113% ( 14000, 22000 ] 5 0.000% 100.114% ( 22000, 33000 ] 1 0.000% 100.114% ** Level 5 read latency histogram (micros): Count: 46760 Average: 1287.3002 StdDev: 1247.67 Min: 82 Median: 863.7843 Max: 35826 Percentiles: P50: 863.78 P75: 1571.76 P99: 6111.42 P99.9: 9447.54 P99.99: 20510.22 ------------------------------------------------------ ( 76, 110 ] 86 0.184% 0.184% ( 110, 170 ] 726 1.553% 1.737% ( 170, 250 ] 1745 3.732% 5.468% # ( 250, 380 ] 3808 8.144% 13.612% ## ( 380, 580 ] 7199 15.396% 29.008% ### ( 580, 870 ] 10031 21.452% 50.460% #### ( 870, 1300 ] 9141 19.549% 70.009% #### ( 1300, 1900 ] 5153 11.020% 81.029% ## ( 1900, 2900 ] 3699 7.911% 88.939% ## ( 2900, 4400 ] 3732 7.981% 96.920% ## ( 4400, 6600 ] 1250 2.673% 99.594% # ( 6600, 9900 ] 166 0.355% 99.949% ( 9900, 14000 ] 12 0.026% 99.974% ( 14000, 22000 ] 9 0.019% 99.994% ( 22000, 33000 ] 4 0.009% 100.002% ( 33000, 50000 ] 1 0.002% 100.004% ** DB Stats ** Uptime(secs): 20.4 total, 5.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 144.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.590 H:M:S, 42.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 189.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.326 H:M:S, 25.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/12/14-02:13:54 ... thread 0: (1000000,4000000) ops and (267384.9,166688.2) ops/second in (3.739927,23.996905) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/10 1.84 GB 0.0 3.0 0.0 3.0 6.6 3.7 0.0 1.8 78.7 176.9 38.43 22.93 59 0.651 3070K 3453 0.0 0.0 L1 7/7 671.32 MB 0.0 2.7 2.2 0.4 2.7 2.2 0.0 1.2 146.9 146.4 18.62 12.71 3 6.206 2777K 10K 0.0 0.0 L2 1/0 128.78 MB 1.3 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 24/4 1.22 GB 1.0 8.2 3.9 4.3 8.1 3.8 0.0 2.1 122.2 121.3 68.35 38.87 32 2.136 5709K 15K 0.0 0.0 L4 184/18 9.97 GB 0.9 11.0 5.4 5.6 10.8 5.2 0.5 2.0 126.6 124.3 89.23 52.16 69 1.293 6587K 7707 0.0 0.0 L5 1160/0 95.46 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1386/39 109.28 GB 0.0 24.8 11.5 13.3 28.2 14.9 7.5 7.6 118.4 134.7 214.62 126.67 163 1.317 18M 36K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.8 11.5 13.3 28.2 14.9 7.5 7.6 118.4 134.7 214.62 126.67 163 1.317 18M 36K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.8 11.5 13.3 24.5 11.3 0.0 0.0 132.5 131.1 191.70 115.96 114 1.682 18M 36K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 164.9 22.93 10.71 49 0.468 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.2 total, 24.0 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.23 GB write, 1195.31 MB/s write, 24.81 GB read, 1050.39 MB/s read, 214.6 seconds Interval compaction: 28.23 GB write, 1204.73 MB/s write, 24.81 GB read, 1058.67 MB/s read, 214.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 68, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1354865 Average: 8.6653 StdDev: 119.82 Min: 1 Median: 1.8343 Max: 19894 Percentiles: P50: 1.83 P75: 2.76 P99: 9.66 P99.9: 1284.55 P99.99: 3008.42 ------------------------------------------------------ [ 0, 1 ] 59978 4.427% 4.427% # ( 1, 2 ] 740101 54.625% 59.052% ########### ( 2, 3 ] 282992 20.887% 79.939% #### ( 3, 4 ] 120913 8.924% 88.864% ## ( 4, 6 ] 115622 8.534% 97.398% ## ( 6, 10 ] 23744 1.752% 99.150% ( 10, 15 ] 3796 0.280% 99.430% ( 15, 22 ] 452 0.033% 99.464% ( 22, 34 ] 44 0.003% 99.467% ( 34, 51 ] 49 0.004% 99.471% ( 51, 76 ] 40 0.003% 99.473% ( 76, 110 ] 57 0.004% 99.478% ( 110, 170 ] 340 0.025% 99.503% ( 170, 250 ] 642 0.047% 99.550% ( 250, 380 ] 876 0.065% 99.615% ( 380, 580 ] 1265 0.093% 99.708% ( 580, 870 ] 1449 0.107% 99.815% ( 870, 1300 ] 1193 0.088% 99.903% ( 1300, 1900 ] 636 0.047% 99.950% ( 1900, 2900 ] 509 0.038% 99.988% ( 2900, 4400 ] 436 0.032% 100.020% ( 4400, 6600 ] 113 0.008% 100.028% ( 6600, 9900 ] 18 0.001% 100.030% ( 9900, 14000 ] 7 0.001% 100.030% ( 14000, 22000 ] 7 0.001% 100.031% ** Level 1 read latency histogram (micros): Count: 524394 Average: 9.4322 StdDev: 131.39 Min: 1 Median: 1.9439 Max: 26686 Percentiles: P50: 1.94 P75: 2.91 P99: 9.80 P99.9: 1278.30 P99.99: 2448.44 ------------------------------------------------------ [ 0, 1 ] 8533 1.627% 1.627% ( 1, 2 ] 268728 51.245% 52.873% ########## ( 2, 3 ] 127523 24.318% 77.191% ##### ( 3, 4 ] 51838 9.885% 87.076% ## ( 4, 6 ] 50307 9.593% 96.669% ## ( 6, 10 ] 12878 2.456% 99.125% ( 10, 15 ] 1779 0.339% 99.465% ( 15, 22 ] 231 0.044% 99.509% ( 22, 34 ] 21 0.004% 99.513% ( 34, 51 ] 33 0.006% 99.519% ( 51, 76 ] 37 0.007% 99.526% ( 76, 110 ] 17 0.003% 99.529% ( 110, 170 ] 66 0.013% 99.542% ( 170, 250 ] 125 0.024% 99.566% ( 250, 380 ] 224 0.043% 99.608% ( 380, 580 ] 441 0.084% 99.692% ( 580, 870 ] 592 0.113% 99.805% ( 870, 1300 ] 523 0.100% 99.905% ( 1300, 1900 ] 309 0.059% 99.964% ( 1900, 2900 ] 249 0.047% 100.011% ( 2900, 4400 ] 201 0.038% 100.050% ( 4400, 6600 ] 37 0.007% 100.057% ( 6600, 9900 ] 6 0.001% 100.058% ( 9900, 14000 ] 1 0.000% 100.058% ( 14000, 22000 ] 4 0.001% 100.059% ( 22000, 33000 ] 1 0.000% 100.059% ** Level 2 read latency histogram (micros): Count: 493436 Average: 13.9186 StdDev: 171.37 Min: 1 Median: 2.0211 Max: 22161 Percentiles: P50: 2.02 P75: 3.12 P99: 12.56 P99.9: 1678.87 P99.99: 2460.92 ------------------------------------------------------ [ 0, 1 ] 11773 2.386% 2.386% ( 1, 2 ] 232435 47.105% 49.491% ######### ( 2, 3 ] 119156 24.148% 73.640% ##### ( 3, 4 ] 53869 10.917% 84.557% ## ( 4, 6 ] 54326 11.010% 95.566% ## ( 6, 10 ] 15454 3.132% 98.698% # ( 10, 15 ] 2909 0.590% 99.288% ( 15, 22 ] 493 0.100% 99.388% ( 22, 34 ] 72 0.015% 99.402% ( 34, 51 ] 34 0.007% 99.409% ( 51, 76 ] 45 0.009% 99.418% ( 76, 110 ] 13 0.003% 99.421% ( 110, 170 ] 49 0.010% 99.431% ( 170, 250 ] 99 0.020% 99.451% ( 250, 380 ] 240 0.049% 99.500% ( 380, 580 ] 446 0.090% 99.590% ( 580, 870 ] 559 0.113% 99.703% ( 870, 1300 ] 646 0.131% 99.834% ( 1300, 1900 ] 514 0.104% 99.938% ( 1900, 2900 ] 454 0.092% 100.030% ( 2900, 4400 ] 376 0.076% 100.107% ( 4400, 6600 ] 115 0.023% 100.130% ( 6600, 9900 ] 18 0.004% 100.134% ( 9900, 14000 ] 3 0.001% 100.134% ( 22000, 33000 ] 1 0.000% 100.134% ** Level 3 read latency histogram (micros): Count: 2402393 Average: 10.5217 StdDev: 149.78 Min: 1 Median: 1.9683 Max: 33318 Percentiles: P50: 1.97 P75: 2.96 P99: 9.68 P99.9: 939.77 P99.99: 1442.90 ------------------------------------------------------ [ 0, 1 ] 36852 1.534% 1.534% ( 1, 2 ] 1202508 50.055% 51.589% ########## ( 2, 3 ] 584148 24.315% 75.904% ##### ( 3, 4 ] 254729 10.603% 86.507% ## ( 4, 6 ] 247262 10.292% 96.799% ## ( 6, 10 ] 57419 2.390% 99.189% ( 10, 15 ] 9427 0.392% 99.582% ( 15, 22 ] 1138 0.047% 99.629% ( 22, 34 ] 108 0.004% 99.634% ( 34, 51 ] 210 0.009% 99.642% ( 51, 76 ] 208 0.009% 99.651% ( 76, 110 ] 70 0.003% 99.654% ( 110, 170 ] 215 0.009% 99.663% ( 170, 250 ] 449 0.019% 99.682% ( 250, 380 ] 900 0.037% 99.719% ( 380, 580 ] 1659 0.069% 99.788% ( 580, 870 ] 2336 0.097% 99.885% ( 870, 1300 ] 2173 0.090% 99.976% ( 1300, 1900 ] 1435 0.060% 100.036% ( 1900, 2900 ] 1402 0.058% 100.094% ( 2900, 4400 ] 1328 0.055% 100.149% ( 4400, 6600 ] 370 0.015% 100.165% ( 6600, 9900 ] 61 0.003% 100.167% ( 9900, 14000 ] 11 0.000% 100.168% ( 14000, 22000 ] 8 0.000% 100.168% ( 22000, 33000 ] 4 0.000% 100.168% ( 33000, 50000 ] 1 0.000% 100.168% ** Level 4 read latency histogram (micros): Count: 1519491 Average: 19.0500 StdDev: 202.35 Min: 1 Median: 1.9636 Max: 32648 Percentiles: P50: 1.96 P75: 2.97 P99: 336.56 P99.9: 2221.91 P99.99: 3190.28 ------------------------------------------------------ [ 0, 1 ] 24459 1.610% 1.610% ( 1, 2 ] 763044 50.217% 51.827% ########## ( 2, 3 ] 362755 23.873% 75.700% ##### ( 3, 4 ] 154276 10.153% 85.853% ## ( 4, 6 ] 149917 9.866% 95.720% ## ( 6, 10 ] 39073 2.571% 98.291% # ( 10, 15 ] 6071 0.400% 98.691% ( 15, 22 ] 718 0.047% 98.738% ( 22, 34 ] 58 0.004% 98.742% ( 34, 51 ] 147 0.010% 98.751% ( 51, 76 ] 161 0.011% 98.762% ( 76, 110 ] 128 0.008% 98.770% ( 110, 170 ] 785 0.052% 98.822% ( 170, 250 ] 1373 0.090% 98.912% ( 250, 380 ] 1999 0.132% 99.044% ( 380, 580 ] 3223 0.212% 99.256% ( 580, 870 ] 3887 0.256% 99.512% ( 870, 1300 ] 3385 0.223% 99.735% ( 1300, 1900 ] 2010 0.132% 99.867% ( 1900, 2900 ] 1561 0.103% 99.970% ( 2900, 4400 ] 1597 0.105% 100.075% ( 4400, 6600 ] 427 0.028% 100.103% ( 6600, 9900 ] 80 0.005% 100.108% ( 9900, 14000 ] 9 0.001% 100.109% ( 14000, 22000 ] 9 0.001% 100.109% ( 22000, 33000 ] 2 0.000% 100.109% ** Level 5 read latency histogram (micros): Count: 64520 Average: 1097.7281 StdDev: 1183.00 Min: 82 Median: 729.4669 Max: 35826 Percentiles: P50: 729.47 P75: 1267.88 P99: 5838.58 P99.9: 9362.63 P99.99: 20774.00 ------------------------------------------------------ ( 76, 110 ] 390 0.604% 0.604% ( 110, 170 ] 2587 4.010% 4.614% # ( 170, 250 ] 4588 7.111% 11.725% # ( 250, 380 ] 7114 11.026% 22.751% ## ( 380, 580 ] 10872 16.851% 39.602% ### ( 580, 870 ] 13017 20.175% 59.777% #### ( 870, 1300 ] 10615 16.452% 76.229% ### ( 1300, 1900 ] 5678 8.800% 85.029% ## ( 1900, 2900 ] 4160 6.448% 91.477% # ( 2900, 4400 ] 4024 6.237% 97.714% # ( 4400, 6600 ] 1269 1.967% 99.681% ( 6600, 9900 ] 169 0.262% 99.943% ( 9900, 14000 ] 17 0.026% 99.969% ( 14000, 22000 ] 16 0.025% 99.994% ( 22000, 33000 ] 7 0.011% 100.005% ( 33000, 50000 ] 1 0.002% 100.006% ** DB Stats ** Uptime(secs): 24.2 total, 3.7 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 162.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.590 H:M:S, 35.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 263.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/14-02:13:58 ... thread 0: (1000000,5000000) ops and (273041.1,180770.7) ops/second in (3.662452,27.659357) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.83 GB 75.5 3.7 0.0 3.7 8.4 4.7 0.0 1.8 83.8 191.2 45.11 29.00 79 0.571 3837K 4244 0.0 0.0 L1 7/7 671.32 MB 0.0 2.7 2.2 0.4 2.7 2.2 0.0 1.2 146.9 146.4 18.62 12.71 3 6.206 2777K 10K 0.0 0.0 L3 19/0 992.21 MB 1.0 8.2 3.9 4.3 8.1 3.8 0.2 2.1 122.2 121.3 68.35 38.87 32 2.136 5709K 15K 0.0 0.0 L4 182/0 9.73 GB 1.0 12.2 5.7 6.5 12.0 5.5 0.5 2.1 130.3 128.0 95.89 57.65 73 1.314 7714K 26K 0.0 0.0 L5 1168/0 96.06 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1393/21 110.24 GB 0.0 26.7 11.8 14.9 31.2 16.3 6.6 6.6 120.0 140.0 227.97 138.23 187 1.219 20M 55K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.7 11.8 14.9 31.2 16.3 6.6 6.6 120.0 140.0 227.97 138.23 187 1.219 20M 55K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.7 11.8 14.9 26.4 11.5 0.0 0.0 135.9 134.4 201.33 124.35 121 1.664 20M 55K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 182.1 26.64 13.88 66 0.404 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.8 total, 27.7 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.17 GB write, 1145.93 MB/s write, 26.72 GB read, 982.52 MB/s read, 228.0 seconds Interval compaction: 31.17 GB write, 1153.77 MB/s write, 26.72 GB read, 989.23 MB/s read, 228.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 68, interval: 69 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1588428 Average: 10.1368 StdDev: 115.11 Min: 0 Median: 1.7866 Max: 19894 Percentiles: P50: 1.79 P75: 2.70 P99: 160.85 P99.9: 1186.67 P99.99: 2658.79 ------------------------------------------------------ [ 0, 1 ] 112005 7.051% 7.051% # ( 1, 2 ] 867274 54.600% 61.651% ########### ( 2, 3 ] 304294 19.157% 80.808% #### ( 3, 4 ] 130343 8.206% 89.014% ## ( 4, 6 ] 121704 7.662% 96.675% ## ( 6, 10 ] 24833 1.563% 98.239% ( 10, 15 ] 4043 0.255% 98.493% ( 15, 22 ] 490 0.031% 98.524% ( 22, 34 ] 47 0.003% 98.527% ( 34, 51 ] 51 0.003% 98.530% ( 51, 76 ] 44 0.003% 98.533% ( 76, 110 ] 1454 0.092% 98.625% ( 110, 170 ] 7036 0.443% 99.068% ( 170, 250 ] 4586 0.289% 99.356% ( 250, 380 ] 2787 0.175% 99.532% ( 380, 580 ] 2784 0.175% 99.707% ( 580, 870 ] 2064 0.130% 99.837% ( 870, 1300 ] 1360 0.086% 99.923% ( 1300, 1900 ] 669 0.042% 99.965% ( 1900, 2900 ] 530 0.033% 99.998% ( 2900, 4400 ] 451 0.028% 100.027% ( 4400, 6600 ] 113 0.007% 100.034% ( 6600, 9900 ] 18 0.001% 100.035% ( 9900, 14000 ] 7 0.000% 100.035% ( 14000, 22000 ] 7 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 525161 Average: 9.7363 StdDev: 131.77 Min: 1 Median: 1.9454 Max: 26686 Percentiles: P50: 1.95 P75: 2.91 P99: 10.17 P99.9: 1279.51 P99.99: 2453.94 ------------------------------------------------------ [ 0, 1 ] 8533 1.625% 1.625% ( 1, 2 ] 268730 51.171% 52.796% ########## ( 2, 3 ] 127538 24.286% 77.081% ##### ( 3, 4 ] 51849 9.873% 86.954% ## ( 4, 6 ] 50317 9.581% 96.536% ## ( 6, 10 ] 12881 2.453% 98.988% ( 10, 15 ] 1779 0.339% 99.327% ( 15, 22 ] 231 0.044% 99.371% ( 22, 34 ] 21 0.004% 99.375% ( 34, 51 ] 33 0.006% 99.381% ( 51, 76 ] 37 0.007% 99.388% ( 76, 110 ] 81 0.015% 99.404% ( 110, 170 ] 370 0.070% 99.474% ( 170, 250 ] 310 0.059% 99.533% ( 250, 380 ] 305 0.058% 99.591% ( 380, 580 ] 504 0.096% 99.687% ( 580, 870 ] 614 0.117% 99.804% ( 870, 1300 ] 528 0.101% 99.905% ( 1300, 1900 ] 309 0.059% 99.964% ( 1900, 2900 ] 250 0.048% 100.011% ( 2900, 4400 ] 202 0.038% 100.050% ( 4400, 6600 ] 37 0.007% 100.057% ( 6600, 9900 ] 6 0.001% 100.058% ( 9900, 14000 ] 1 0.000% 100.058% ( 14000, 22000 ] 4 0.001% 100.059% ( 22000, 33000 ] 1 0.000% 100.059% ** Level 2 read latency histogram (micros): Count: 493436 Average: 13.9186 StdDev: 171.37 Min: 1 Median: 2.0211 Max: 22161 Percentiles: P50: 2.02 P75: 3.12 P99: 12.56 P99.9: 1678.87 P99.99: 2460.92 ------------------------------------------------------ [ 0, 1 ] 11773 2.386% 2.386% ( 1, 2 ] 232435 47.105% 49.491% ######### ( 2, 3 ] 119156 24.148% 73.640% ##### ( 3, 4 ] 53869 10.917% 84.557% ## ( 4, 6 ] 54326 11.010% 95.566% ## ( 6, 10 ] 15454 3.132% 98.698% # ( 10, 15 ] 2909 0.590% 99.288% ( 15, 22 ] 493 0.100% 99.388% ( 22, 34 ] 72 0.015% 99.402% ( 34, 51 ] 34 0.007% 99.409% ( 51, 76 ] 45 0.009% 99.418% ( 76, 110 ] 13 0.003% 99.421% ( 110, 170 ] 49 0.010% 99.431% ( 170, 250 ] 99 0.020% 99.451% ( 250, 380 ] 240 0.049% 99.500% ( 380, 580 ] 446 0.090% 99.590% ( 580, 870 ] 559 0.113% 99.703% ( 870, 1300 ] 646 0.131% 99.834% ( 1300, 1900 ] 514 0.104% 99.938% ( 1900, 2900 ] 454 0.092% 100.030% ( 2900, 4400 ] 376 0.076% 100.107% ( 4400, 6600 ] 115 0.023% 100.130% ( 6600, 9900 ] 18 0.004% 100.134% ( 9900, 14000 ] 3 0.001% 100.134% ( 22000, 33000 ] 1 0.000% 100.134% ** Level 3 read latency histogram (micros): Count: 2444566 Average: 10.4581 StdDev: 148.60 Min: 1 Median: 1.9638 Max: 33318 Percentiles: P50: 1.96 P75: 2.96 P99: 9.71 P99.9: 931.01 P99.99: 1437.18 ------------------------------------------------------ [ 0, 1 ] 39107 1.600% 1.600% ( 1, 2 ] 1227652 50.220% 51.819% ########## ( 2, 3 ] 592590 24.241% 76.060% ##### ( 3, 4 ] 257737 10.543% 86.604% ## ( 4, 6 ] 249482 10.206% 96.809% ## ( 6, 10 ] 57748 2.362% 99.172% ( 10, 15 ] 9487 0.388% 99.560% ( 15, 22 ] 1144 0.047% 99.607% ( 22, 34 ] 108 0.004% 99.611% ( 34, 51 ] 210 0.009% 99.620% ( 51, 76 ] 208 0.009% 99.628% ( 76, 110 ] 132 0.005% 99.633% ( 110, 170 ] 508 0.021% 99.654% ( 170, 250 ] 603 0.025% 99.679% ( 250, 380 ] 993 0.041% 99.720% ( 380, 580 ] 1735 0.071% 99.790% ( 580, 870 ] 2368 0.097% 99.887% ( 870, 1300 ] 2181 0.089% 99.977% ( 1300, 1900 ] 1437 0.059% 100.035% ( 1900, 2900 ] 1404 0.057% 100.093% ( 2900, 4400 ] 1329 0.054% 100.147% ( 4400, 6600 ] 370 0.015% 100.162% ( 6600, 9900 ] 61 0.002% 100.165% ( 9900, 14000 ] 11 0.000% 100.165% ( 14000, 22000 ] 8 0.000% 100.166% ( 22000, 33000 ] 4 0.000% 100.166% ( 33000, 50000 ] 1 0.000% 100.166% ** Level 4 read latency histogram (micros): Count: 1682071 Average: 18.5078 StdDev: 193.39 Min: 1 Median: 1.9465 Max: 32648 Percentiles: P50: 1.95 P75: 2.95 P99: 320.72 P99.9: 2008.17 P99.99: 3005.88 ------------------------------------------------------ [ 0, 1 ] 30169 1.794% 1.794% ( 1, 2 ] 856728 50.933% 52.726% ########## ( 2, 3 ] 395431 23.509% 76.235% ##### ( 3, 4 ] 165305 9.827% 86.063% ## ( 4, 6 ] 158363 9.415% 95.477% ## ( 6, 10 ] 42577 2.531% 98.009% # ( 10, 15 ] 6495 0.386% 98.395% ( 15, 22 ] 796 0.047% 98.442% ( 22, 34 ] 65 0.004% 98.446% ( 34, 51 ] 149 0.009% 98.455% ( 51, 76 ] 161 0.010% 98.464% ( 76, 110 ] 713 0.042% 98.507% ( 110, 170 ] 3579 0.213% 98.719% ( 170, 250 ] 3145 0.187% 98.906% ( 250, 380 ] 2894 0.172% 99.078% ( 380, 580 ] 3966 0.236% 99.314% ( 580, 870 ] 4200 0.250% 99.564% ( 870, 1300 ] 3458 0.206% 99.770% ( 1300, 1900 ] 2025 0.120% 99.890% ( 1900, 2900 ] 1571 0.093% 99.983% ( 2900, 4400 ] 1598 0.095% 100.078% ( 4400, 6600 ] 427 0.025% 100.104% ( 6600, 9900 ] 80 0.005% 100.108% ( 9900, 14000 ] 9 0.001% 100.109% ( 14000, 22000 ] 9 0.001% 100.110% ( 22000, 33000 ] 2 0.000% 100.110% ** Level 5 read latency histogram (micros): Count: 102689 Average: 778.7483 StdDev: 1032.39 Min: 77 Median: 437.7092 Max: 35826 Percentiles: P50: 437.71 P75: 901.30 P99: 5178.60 P99.9: 8636.84 P99.99: 19365.55 ------------------------------------------------------ ( 76, 110 ] 3795 3.696% 3.696% # ( 110, 170 ] 18376 17.895% 21.590% #### ( 170, 250 ] 13347 12.997% 34.588% ### ( 250, 380 ] 11627 11.323% 45.910% ## ( 380, 580 ] 14554 14.173% 60.083% ### ( 580, 870 ] 14516 14.136% 74.219% ### ( 870, 1300 ] 11014 10.726% 84.945% ## ( 1300, 1900 ] 5743 5.593% 90.537% # ( 1900, 2900 ] 4200 4.090% 94.627% # ( 2900, 4400 ] 4041 3.935% 98.563% # ( 4400, 6600 ] 1269 1.236% 99.798% ( 6600, 9900 ] 169 0.165% 99.963% ( 9900, 14000 ] 17 0.017% 99.980% ( 14000, 22000 ] 16 0.016% 99.995% ( 22000, 33000 ] 7 0.007% 100.002% ( 33000, 50000 ] 1 0.001% 100.003% ** DB Stats ** Uptime(secs): 27.9 total, 3.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 176.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.683 H:M:S, 31.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 268.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.093 H:M:S, 2.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-02:14:09 ... thread 0: (1000000,6000000) ops and (92613.3,156018.6) ops/second in (10.797584,38.456941) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/10 3.80 GB 200.3 6.2 0.0 6.2 11.9 5.6 0.0 2.1 109.9 209.8 57.88 41.23 99 0.585 6459K 15K 0.0 0.0 L1 7/7 671.32 MB 0.0 2.7 2.2 0.4 2.7 2.2 0.0 1.2 146.9 146.4 18.62 12.71 3 6.206 2777K 10K 0.0 0.0 L3 19/0 992.21 MB 1.0 8.2 3.9 4.3 8.1 3.8 0.2 2.1 122.2 121.3 68.35 38.87 32 2.136 5709K 15K 0.0 0.0 L4 182/0 9.73 GB 1.0 12.2 5.7 6.5 12.0 5.5 0.5 2.1 130.3 128.0 95.89 57.65 73 1.314 7714K 26K 0.0 0.0 L5 1168/0 96.06 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1391/17 111.21 GB 0.0 29.2 11.8 17.4 34.6 17.2 6.6 6.1 124.4 147.2 240.73 150.47 207 1.163 22M 67K 0.0 0.0 Int 0/0 0.00 KB 0.0 29.2 11.8 17.4 34.6 17.2 6.6 6.1 124.4 147.2 240.73 150.47 207 1.163 22M 67K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 29.2 11.8 17.4 28.9 11.5 0.0 0.0 141.9 140.4 211.03 133.91 126 1.675 22M 67K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 195.1 29.70 16.55 81 0.367 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.6 total, 38.5 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.60 GB write, 916.72 MB/s write, 29.24 GB read, 774.81 MB/s read, 240.7 seconds Interval compaction: 34.60 GB write, 921.22 MB/s write, 29.24 GB read, 778.62 MB/s read, 240.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 68, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2325451 Average: 13.0612 StdDev: 101.84 Min: 0 Median: 1.6651 Max: 19894 Percentiles: P50: 1.67 P75: 2.51 P99: 222.66 P99.9: 863.04 P99.99: 1805.75 ------------------------------------------------------ [ 0, 1 ] 352956 15.178% 15.178% ### ( 1, 2 ] 1217482 52.355% 67.533% ########## ( 2, 3 ] 341816 14.699% 82.232% ### ( 3, 4 ] 147600 6.347% 88.579% # ( 4, 6 ] 134581 5.787% 94.366% # ( 6, 10 ] 26959 1.159% 95.525% ( 10, 15 ] 4557 0.196% 95.721% ( 15, 22 ] 561 0.024% 95.745% ( 22, 34 ] 57 0.002% 95.748% ( 34, 51 ] 52 0.002% 95.750% ( 51, 76 ] 47 0.002% 95.752% ( 76, 110 ] 11930 0.513% 96.265% ( 110, 170 ] 51502 2.215% 98.480% ( 170, 250 ] 18378 0.790% 99.270% ( 250, 380 ] 6507 0.280% 99.550% ( 380, 580 ] 5477 0.236% 99.785% ( 580, 870 ] 2729 0.117% 99.903% ( 870, 1300 ] 1445 0.062% 99.965% ( 1300, 1900 ] 691 0.030% 99.995% ( 1900, 2900 ] 561 0.024% 100.019% ( 2900, 4400 ] 468 0.020% 100.039% ( 4400, 6600 ] 114 0.005% 100.044% ( 6600, 9900 ] 18 0.001% 100.045% ( 9900, 14000 ] 7 0.000% 100.045% ( 14000, 22000 ] 7 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 528105 Average: 10.6326 StdDev: 132.18 Min: 1 Median: 1.9508 Max: 26686 Percentiles: P50: 1.95 P75: 2.93 P99: 119.78 P99.9: 1279.67 P99.99: 2452.76 ------------------------------------------------------ [ 0, 1 ] 8533 1.616% 1.616% ( 1, 2 ] 268730 50.886% 52.501% ########## ( 2, 3 ] 127538 24.150% 76.652% ##### ( 3, 4 ] 51849 9.818% 86.470% ## ( 4, 6 ] 50317 9.528% 95.997% ## ( 6, 10 ] 12881 2.439% 98.436% ( 10, 15 ] 1779 0.337% 98.773% ( 15, 22 ] 231 0.044% 98.817% ( 22, 34 ] 21 0.004% 98.821% ( 34, 51 ] 33 0.006% 98.827% ( 51, 76 ] 37 0.007% 98.834% ( 76, 110 ] 537 0.102% 98.936% ( 110, 170 ] 2074 0.393% 99.329% ( 170, 250 ] 832 0.158% 99.486% ( 250, 380 ] 423 0.080% 99.566% ( 380, 580 ] 615 0.116% 99.683% ( 580, 870 ] 641 0.121% 99.804% ( 870, 1300 ] 531 0.101% 99.905% ( 1300, 1900 ] 312 0.059% 99.964% ( 1900, 2900 ] 250 0.047% 100.011% ( 2900, 4400 ] 202 0.038% 100.049% ( 4400, 6600 ] 37 0.007% 100.056% ( 6600, 9900 ] 6 0.001% 100.058% ( 9900, 14000 ] 1 0.000% 100.058% ( 14000, 22000 ] 4 0.001% 100.059% ( 22000, 33000 ] 1 0.000% 100.059% ** Level 2 read latency histogram (micros): Count: 493436 Average: 13.9186 StdDev: 171.37 Min: 1 Median: 2.0211 Max: 22161 Percentiles: P50: 2.02 P75: 3.12 P99: 12.56 P99.9: 1678.87 P99.99: 2460.92 ------------------------------------------------------ [ 0, 1 ] 11773 2.386% 2.386% ( 1, 2 ] 232435 47.105% 49.491% ######### ( 2, 3 ] 119156 24.148% 73.640% ##### ( 3, 4 ] 53869 10.917% 84.557% ## ( 4, 6 ] 54326 11.010% 95.566% ## ( 6, 10 ] 15454 3.132% 98.698% # ( 10, 15 ] 2909 0.590% 99.288% ( 15, 22 ] 493 0.100% 99.388% ( 22, 34 ] 72 0.015% 99.402% ( 34, 51 ] 34 0.007% 99.409% ( 51, 76 ] 45 0.009% 99.418% ( 76, 110 ] 13 0.003% 99.421% ( 110, 170 ] 49 0.010% 99.431% ( 170, 250 ] 99 0.020% 99.451% ( 250, 380 ] 240 0.049% 99.500% ( 380, 580 ] 446 0.090% 99.590% ( 580, 870 ] 559 0.113% 99.703% ( 870, 1300 ] 646 0.131% 99.834% ( 1300, 1900 ] 514 0.104% 99.938% ( 1900, 2900 ] 454 0.092% 100.030% ( 2900, 4400 ] 376 0.076% 100.107% ( 4400, 6600 ] 115 0.023% 100.130% ( 6600, 9900 ] 18 0.004% 100.134% ( 9900, 14000 ] 3 0.001% 100.134% ( 22000, 33000 ] 1 0.000% 100.134% ** Level 3 read latency histogram (micros): Count: 2447976 Average: 10.6791 StdDev: 148.68 Min: 1 Median: 1.9652 Max: 33318 Percentiles: P50: 1.97 P75: 2.96 P99: 9.94 P99.9: 931.80 P99.99: 1438.51 ------------------------------------------------------ [ 0, 1 ] 39107 1.598% 1.598% ( 1, 2 ] 1227652 50.150% 51.747% ########## ( 2, 3 ] 592594 24.208% 75.955% ##### ( 3, 4 ] 257750 10.529% 86.484% ## ( 4, 6 ] 249515 10.193% 96.677% ## ( 6, 10 ] 57751 2.359% 99.036% ( 10, 15 ] 9488 0.388% 99.423% ( 15, 22 ] 1146 0.047% 99.470% ( 22, 34 ] 108 0.004% 99.474% ( 34, 51 ] 210 0.009% 99.483% ( 51, 76 ] 208 0.008% 99.492% ( 76, 110 ] 622 0.025% 99.517% ( 110, 170 ] 2462 0.101% 99.618% ( 170, 250 ] 1185 0.048% 99.666% ( 250, 380 ] 1165 0.048% 99.714% ( 380, 580 ] 1851 0.076% 99.789% ( 580, 870 ] 2400 0.098% 99.887% ( 870, 1300 ] 2185 0.089% 99.976% ( 1300, 1900 ] 1439 0.059% 100.035% ( 1900, 2900 ] 1405 0.057% 100.093% ( 2900, 4400 ] 1330 0.054% 100.147% ( 4400, 6600 ] 370 0.015% 100.162% ( 6600, 9900 ] 61 0.002% 100.165% ( 9900, 14000 ] 11 0.000% 100.165% ( 14000, 22000 ] 8 0.000% 100.165% ( 22000, 33000 ] 4 0.000% 100.165% ( 33000, 50000 ] 1 0.000% 100.166% ** Level 4 read latency histogram (micros): Count: 1709496 Average: 20.7210 StdDev: 193.13 Min: 1 Median: 1.9625 Max: 32648 Percentiles: P50: 1.96 P75: 3.00 P99: 366.25 P99.9: 1994.62 P99.99: 3001.42 ------------------------------------------------------ [ 0, 1 ] 30169 1.765% 1.765% ( 1, 2 ] 856741 50.117% 51.881% ########## ( 2, 3 ] 395493 23.135% 75.016% ##### ( 3, 4 ] 166071 9.715% 84.731% ## ( 4, 6 ] 159635 9.338% 94.069% ## ( 6, 10 ] 42688 2.497% 96.566% ( 10, 15 ] 6529 0.382% 96.948% ( 15, 22 ] 799 0.047% 96.995% ( 22, 34 ] 65 0.004% 96.999% ( 34, 51 ] 149 0.009% 97.007% ( 51, 76 ] 161 0.009% 97.017% ( 76, 110 ] 4314 0.252% 97.269% ( 110, 170 ] 18514 1.083% 98.352% ( 170, 250 ] 7422 0.434% 98.786% ( 250, 380 ] 4083 0.239% 99.025% ( 380, 580 ] 4842 0.283% 99.309% ( 580, 870 ] 4439 0.260% 99.568% ( 870, 1300 ] 3491 0.204% 99.772% ( 1300, 1900 ] 2032 0.119% 99.891% ( 1900, 2900 ] 1580 0.092% 99.984% ( 2900, 4400 ] 1598 0.093% 100.077% ( 4400, 6600 ] 427 0.025% 100.102% ( 6600, 9900 ] 80 0.005% 100.107% ( 9900, 14000 ] 9 0.001% 100.107% ( 14000, 22000 ] 9 0.001% 100.108% ( 22000, 33000 ] 2 0.000% 100.108% ** Level 5 read latency histogram (micros): Count: 247891 Average: 421.6402 StdDev: 733.42 Min: 76 Median: 166.8926 Max: 35826 Percentiles: P50: 166.89 P75: 382.80 P99: 4027.91 P99.9: 6529.11 P99.99: 13086.16 ------------------------------------------------------ ( 51, 76 ] 1 0.000% 0.000% ( 76, 110 ] 25726 10.378% 10.378% ## ( 110, 170 ] 103583 41.786% 52.164% ######## ( 170, 250 ] 38043 15.347% 67.511% ### ( 250, 380 ] 18288 7.377% 74.888% # ( 380, 580 ] 19778 7.979% 82.867% ## ( 580, 870 ] 15768 6.361% 89.228% # ( 870, 1300 ] 11174 4.508% 93.735% # ( 1300, 1900 ] 5772 2.328% 96.064% ( 1900, 2900 ] 4239 1.710% 97.774% ( 2900, 4400 ] 4043 1.631% 99.405% ( 4400, 6600 ] 1269 0.512% 99.916% ( 6600, 9900 ] 169 0.068% 99.985% ( 9900, 14000 ] 17 0.007% 99.992% ( 14000, 22000 ] 16 0.006% 99.998% ( 22000, 33000 ] 7 0.003% 100.001% ( 33000, 50000 ] 1 0.000% 100.001% ** DB Stats ** Uptime(secs): 38.6 total, 10.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 152.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.531 H:M:S, 40.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 91.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.848 H:M:S, 63.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-02:14:18 ... thread 0: (1000000,7000000) ops and (105425.8,146008.9) ops/second in (9.485340,47.942281) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 4.85 GB 181.4 7.4 0.0 7.4 14.1 6.7 0.0 2.1 115.1 218.5 66.22 49.04 121 0.547 7738K 17K 0.0 0.0 L1 7/7 671.32 MB 0.0 2.7 2.2 0.4 2.7 2.2 0.0 1.2 146.9 146.4 18.62 12.71 3 6.206 2777K 10K 0.0 0.0 L3 19/0 992.21 MB 1.0 8.2 3.9 4.3 8.1 3.8 0.2 2.1 122.2 121.3 68.35 38.87 32 2.136 5709K 15K 0.0 0.0 L4 182/0 9.73 GB 1.0 12.2 5.7 6.5 12.0 5.5 0.5 2.1 130.3 128.0 95.89 57.65 73 1.314 7714K 26K 0.0 0.0 L5 1168/0 96.06 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1393/22 112.25 GB 0.0 30.5 11.8 18.7 36.9 18.2 6.6 5.5 125.3 151.6 249.08 158.27 229 1.088 23M 68K 0.0 0.0 Int 0/0 0.00 KB 0.0 30.5 11.8 18.7 36.9 18.2 6.6 5.5 125.3 151.6 249.08 158.27 229 1.088 23M 68K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 30.5 11.8 18.7 30.2 11.5 0.0 0.0 144.6 143.1 215.81 138.60 131 1.647 23M 68K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 206.4 33.26 19.67 98 0.339 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.1 total, 47.9 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 36.87 GB write, 784.46 MB/s write, 30.47 GB read, 648.29 MB/s read, 249.1 seconds Interval compaction: 36.87 GB write, 787.55 MB/s write, 30.47 GB read, 650.85 MB/s read, 249.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 19, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 19, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 68, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2963380 Average: 14.5319 StdDev: 95.13 Min: 0 Median: 1.6146 Max: 19894 Percentiles: P50: 1.61 P75: 2.39 P99: 232.88 P99.9: 788.69 P99.99: 1479.88 ------------------------------------------------------ [ 0, 1 ] 534467 18.036% 18.036% #### ( 1, 2 ] 1541275 52.011% 70.046% ########## ( 2, 3 ] 380528 12.841% 82.887% ### ( 3, 4 ] 161513 5.450% 88.338% # ( 4, 6 ] 145200 4.900% 93.238% # ( 6, 10 ] 28614 0.966% 94.203% ( 10, 15 ] 4975 0.168% 94.371% ( 15, 22 ] 618 0.021% 94.392% ( 22, 34 ] 61 0.002% 94.394% ( 34, 51 ] 56 0.002% 94.396% ( 51, 76 ] 47 0.002% 94.397% ( 76, 110 ] 21641 0.730% 95.128% ( 110, 170 ] 90883 3.067% 98.195% # ( 170, 250 ] 30373 1.025% 99.220% ( 250, 380 ] 9794 0.331% 99.550% ( 380, 580 ] 7949 0.268% 99.818% ( 580, 870 ] 3372 0.114% 99.932% ( 870, 1300 ] 1510 0.051% 99.983% ( 1300, 1900 ] 706 0.024% 100.007% ( 1900, 2900 ] 597 0.020% 100.027% ( 2900, 4400 ] 478 0.016% 100.043% ( 4400, 6600 ] 114 0.004% 100.047% ( 6600, 9900 ] 18 0.001% 100.048% ( 9900, 14000 ] 7 0.000% 100.048% ( 14000, 22000 ] 7 0.000% 100.048% ** Level 1 read latency histogram (micros): Count: 530605 Average: 11.3705 StdDev: 132.48 Min: 1 Median: 1.9555 Max: 26686 Percentiles: P50: 1.96 P75: 2.95 P99: 150.87 P99.9: 1278.58 P99.99: 2453.54 ------------------------------------------------------ [ 0, 1 ] 8533 1.608% 1.608% ( 1, 2 ] 268730 50.646% 52.254% ########## ( 2, 3 ] 127538 24.036% 76.290% ##### ( 3, 4 ] 51849 9.772% 86.062% ## ( 4, 6 ] 50317 9.483% 95.545% ## ( 6, 10 ] 12881 2.428% 97.973% ( 10, 15 ] 1779 0.335% 98.308% ( 15, 22 ] 231 0.044% 98.352% ( 22, 34 ] 21 0.004% 98.355% ( 34, 51 ] 33 0.006% 98.362% ( 51, 76 ] 37 0.007% 98.369% ( 76, 110 ] 912 0.172% 98.541% ( 110, 170 ] 3579 0.675% 99.215% ( 170, 250 ] 1247 0.235% 99.450% ( 250, 380 ] 519 0.098% 99.548% ( 380, 580 ] 700 0.132% 99.680% ( 580, 870 ] 661 0.125% 99.804% ( 870, 1300 ] 534 0.101% 99.905% ( 1300, 1900 ] 312 0.059% 99.964% ( 1900, 2900 ] 251 0.047% 100.011% ( 2900, 4400 ] 202 0.038% 100.049% ( 4400, 6600 ] 37 0.007% 100.056% ( 6600, 9900 ] 6 0.001% 100.057% ( 9900, 14000 ] 1 0.000% 100.057% ( 14000, 22000 ] 4 0.001% 100.058% ( 22000, 33000 ] 1 0.000% 100.058% ** Level 2 read latency histogram (micros): Count: 493436 Average: 13.9186 StdDev: 171.37 Min: 1 Median: 2.0211 Max: 22161 Percentiles: P50: 2.02 P75: 3.12 P99: 12.56 P99.9: 1678.87 P99.99: 2460.92 ------------------------------------------------------ [ 0, 1 ] 11773 2.386% 2.386% ( 1, 2 ] 232435 47.105% 49.491% ######### ( 2, 3 ] 119156 24.148% 73.640% ##### ( 3, 4 ] 53869 10.917% 84.557% ## ( 4, 6 ] 54326 11.010% 95.566% ## ( 6, 10 ] 15454 3.132% 98.698% # ( 10, 15 ] 2909 0.590% 99.288% ( 15, 22 ] 493 0.100% 99.388% ( 22, 34 ] 72 0.015% 99.402% ( 34, 51 ] 34 0.007% 99.409% ( 51, 76 ] 45 0.009% 99.418% ( 76, 110 ] 13 0.003% 99.421% ( 110, 170 ] 49 0.010% 99.431% ( 170, 250 ] 99 0.020% 99.451% ( 250, 380 ] 240 0.049% 99.500% ( 380, 580 ] 446 0.090% 99.590% ( 580, 870 ] 559 0.113% 99.703% ( 870, 1300 ] 646 0.131% 99.834% ( 1300, 1900 ] 514 0.104% 99.938% ( 1900, 2900 ] 454 0.092% 100.030% ( 2900, 4400 ] 376 0.076% 100.107% ( 4400, 6600 ] 115 0.023% 100.130% ( 6600, 9900 ] 18 0.004% 100.134% ( 9900, 14000 ] 3 0.001% 100.134% ( 22000, 33000 ] 1 0.000% 100.134% ** Level 3 read latency histogram (micros): Count: 2450838 Average: 10.8619 StdDev: 148.74 Min: 1 Median: 1.9663 Max: 33318 Percentiles: P50: 1.97 P75: 2.96 P99: 11.03 P99.9: 932.33 P99.99: 1439.55 ------------------------------------------------------ [ 0, 1 ] 39107 1.596% 1.596% ( 1, 2 ] 1227652 50.091% 51.687% ########## ( 2, 3 ] 592594 24.179% 75.866% ##### ( 3, 4 ] 257750 10.517% 86.383% ## ( 4, 6 ] 249515 10.181% 96.564% ## ( 6, 10 ] 57751 2.356% 98.920% ( 10, 15 ] 9488 0.387% 99.307% ( 15, 22 ] 1146 0.047% 99.354% ( 22, 34 ] 108 0.004% 99.358% ( 34, 51 ] 210 0.009% 99.367% ( 51, 76 ] 208 0.008% 99.375% ( 76, 110 ] 1090 0.044% 99.420% ( 110, 170 ] 4131 0.169% 99.588% ( 170, 250 ] 1661 0.068% 99.656% ( 250, 380 ] 1293 0.053% 99.709% ( 380, 580 ] 1946 0.079% 99.788% ( 580, 870 ] 2420 0.099% 99.887% ( 870, 1300 ] 2188 0.089% 99.976% ( 1300, 1900 ] 1440 0.059% 100.035% ( 1900, 2900 ] 1407 0.057% 100.092% ( 2900, 4400 ] 1330 0.054% 100.147% ( 4400, 6600 ] 370 0.015% 100.162% ( 6600, 9900 ] 61 0.002% 100.164% ( 9900, 14000 ] 11 0.000% 100.165% ( 14000, 22000 ] 8 0.000% 100.165% ( 22000, 33000 ] 4 0.000% 100.165% ( 33000, 50000 ] 1 0.000% 100.165% ** Level 4 read latency histogram (micros): Count: 1733433 Average: 22.7385 StdDev: 192.92 Min: 1 Median: 1.9764 Max: 32648 Percentiles: P50: 1.98 P75: 3.11 P99: 394.18 P99.9: 1982.38 P99.99: 2999.18 ------------------------------------------------------ [ 0, 1 ] 30169 1.740% 1.740% ( 1, 2 ] 856745 49.425% 51.165% ########## ( 2, 3 ] 395513 22.817% 73.982% ##### ( 3, 4 ] 166163 9.586% 83.568% ## ( 4, 6 ] 159800 9.219% 92.786% ## ( 6, 10 ] 42713 2.464% 95.250% ( 10, 15 ] 6537 0.377% 95.628% ( 15, 22 ] 800 0.046% 95.674% ( 22, 34 ] 65 0.004% 95.677% ( 34, 51 ] 149 0.009% 95.686% ( 51, 76 ] 161 0.009% 95.695% ( 76, 110 ] 7880 0.455% 96.150% ( 110, 170 ] 32355 1.867% 98.016% ( 170, 250 ] 11466 0.661% 98.678% ( 250, 380 ] 5180 0.299% 98.977% ( 380, 580 ] 5681 0.328% 99.305% ( 580, 870 ] 4640 0.268% 99.572% ( 870, 1300 ] 3517 0.203% 99.775% ( 1300, 1900 ] 2035 0.117% 99.892% ( 1900, 2900 ] 1585 0.091% 99.984% ( 2900, 4400 ] 1598 0.092% 100.076% ( 4400, 6600 ] 427 0.025% 100.101% ( 6600, 9900 ] 80 0.005% 100.105% ( 9900, 14000 ] 9 0.001% 100.106% ( 14000, 22000 ] 9 0.001% 100.106% ( 22000, 33000 ] 2 0.000% 100.106% ** Level 5 read latency histogram (micros): Count: 374480 Average: 336.4020 StdDev: 611.42 Min: 75 Median: 158.0773 Max: 35826 Percentiles: P50: 158.08 P75: 248.43 P99: 3556.65 P99.9: 6299.25 P99.99: 9793.62 ------------------------------------------------------ ( 51, 76 ] 2 0.001% 0.001% ( 76, 110 ] 44962 12.007% 12.007% ## ( 110, 170 ] 177559 47.415% 59.422% ######### ( 170, 250 ] 59506 15.890% 75.312% ### ( 250, 380 ] 24119 6.441% 81.753% # ( 380, 580 ] 24575 6.562% 88.315% # ( 580, 870 ] 16902 4.513% 92.829% # ( 870, 1300 ] 11275 3.011% 95.840% # ( 1300, 1900 ] 5800 1.549% 97.388% ( 1900, 2900 ] 4264 1.139% 98.527% ( 2900, 4400 ] 4046 1.080% 99.607% ( 4400, 6600 ] 1269 0.339% 99.946% ( 6600, 9900 ] 169 0.045% 99.991% ( 9900, 14000 ] 17 0.005% 99.996% ( 14000, 22000 ] 16 0.004% 100.000% ( 22000, 33000 ] 7 0.002% 100.002% ( 33000, 50000 ] 1 0.000% 100.002% ** DB Stats ** Uptime(secs): 48.1 total, 9.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 143.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.271 H:M:S, 44.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 103.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.740 H:M:S, 60.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 338.645 micros/op 11804 ops/sec 60.146 seconds 709996 operations; 11.4 MB/s (177999 of 177999 found) Microseconds per read: Count: 709996 Average: 338.6481 StdDev: 908.62 Min: 3 Median: 205.7882 Max: 60246 Percentiles: P50: 205.79 P75: 287.98 P99: 2788.01 P99.9: 14996.23 P99.99: 32266.69 ------------------------------------------------------ ( 2, 3 ] 5 0.001% 0.001% ( 3, 4 ] 4 0.001% 0.001% ( 4, 6 ] 37 0.005% 0.006% ( 6, 10 ] 195 0.027% 0.034% ( 10, 15 ] 151 0.021% 0.055% ( 15, 22 ] 640 0.090% 0.145% ( 22, 34 ] 8813 1.241% 1.387% ( 34, 51 ] 4299 0.605% 1.992% ( 51, 76 ] 585 0.082% 2.075% ( 76, 110 ] 359 0.051% 2.125% ( 110, 170 ] 218833 30.822% 32.947% ###### ( 170, 250 ] 270652 38.120% 71.067% ######## ( 250, 380 ] 95586 13.463% 84.530% ### ( 380, 580 ] 49678 6.997% 91.527% # ( 580, 870 ] 26913 3.791% 95.317% # ( 870, 1300 ] 14977 2.109% 97.427% ( 1300, 1900 ] 7038 0.991% 98.418% ( 1900, 2900 ] 4652 0.655% 99.073% ( 2900, 4400 ] 3906 0.550% 99.624% ( 4400, 6600 ] 1136 0.160% 99.784% ( 6600, 9900 ] 317 0.045% 99.828% ( 9900, 14000 ] 445 0.063% 99.891% ( 14000, 22000 ] 522 0.074% 99.964% ( 22000, 33000 ] 195 0.027% 99.992% ( 33000, 50000 ] 50 0.007% 99.999% ( 50000, 75000 ] 8 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 12554097 rocksdb.bloom.filter.full.positive COUNT : 832378 rocksdb.bloom.filter.full.true.positive COUNT : 709595 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 401 rocksdb.memtable.miss COUNT : 709595 rocksdb.l0.hit COUNT : 28852 rocksdb.l1.hit COUNT : 4446 rocksdb.l2andup.hit COUNT : 676297 rocksdb.compaction.key.drop.new COUNT : 329347 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 7070045 rocksdb.number.keys.read COUNT : 709996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 7296286440 rocksdb.bytes.read COUNT : 709996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1833 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32658945 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 34842077013 rocksdb.compact.write.bytes COUNT : 34497367310 rocksdb.flush.write.bytes COUNT : 7266396689 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 22 rocksdb.number.superversion_acquires COUNT : 1485 rocksdb.number.superversion_releases COUNT : 1439 rocksdb.number.superversion_cleanups COUNT : 369 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 362 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 7207757824 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2757632 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 37876678084 rocksdb.non.last.level.read.count COUNT : 9010212 rocksdb.block.checksum.compute.count COUNT : 9279776 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 204.667258 P95 : 844.893844 P99 : 2787.726393 P100 : 60243.000000 COUNT : 709996 SUM : 239612858 rocksdb.db.write.micros P50 : 1.570076 P95 : 4.539424 P99 : 8.959516 P100 : 1008702.000000 COUNT : 7070045 SUM : 50817116 rocksdb.compaction.times.micros P50 : 1261764.705882 P95 : 4160000.000000 P99 : 6727913.000000 P100 : 6727913.000000 COUNT : 132 SUM : 220381215 rocksdb.compaction.times.cpu_micros P50 : 893170.731707 P95 : 2671428.571429 P99 : 5774000.000000 P100 : 5781096.000000 COUNT : 132 SUM : 143129698 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 990.937500 P95 : 98916.666667 P99 : 251300.000000 P100 : 256333.000000 COUNT : 99 SUM : 1355337 rocksdb.compaction.outfile.sync.micros P50 : 16285.714286 P95 : 192769.230769 P99 : 462650.000000 P100 : 922979.000000 COUNT : 426 SUM : 20760966 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 319.333333 P95 : 4075.000000 P99 : 6165.500000 P100 : 7970.000000 COUNT : 258 SUM : 256949 rocksdb.table.open.io.micros P50 : 8485.163551 P95 : 19924.110672 P99 : 25835.000000 P100 : 53964.000000 COUNT : 1833 SUM : 15827326 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.932941 P95 : 9.598920 P99 : 166.152026 P100 : 33323.000000 COUNT : 8436606 SUM : 114681622 rocksdb.read.block.get.micros P50 : 149.061806 P95 : 740.966944 P99 : 2535.424390 P100 : 35831.000000 COUNT : 841345 SUM : 205475195 rocksdb.write.raw.block.micros P50 : 0.530200 P95 : 1.193071 P99 : 3.798272 P100 : 37610.000000 COUNT : 10115416 SUM : 30643667 rocksdb.numfiles.in.singlecompaction P50 : 2.672414 P95 : 5.950000 P99 : 11.750000 P100 : 17.000000 COUNT : 165 SUM : 562 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.568289 P95 : 1195.884273 P99 : 2544.735246 P100 : 1008540.000000 COUNT : 154502 SUM : 32677728 rocksdb.sst.read.micros P50 : 1.922926 P95 : 153.580600 P99 : 528.757958 P100 : 35826.000000 COUNT : 9010257 SUM : 296726563 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 709996 SUM : 709996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 7070045 SUM : 7296286440 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 227391.304348 P95 : 1008142.857143 P99 : 1207000.000000 P100 : 1273466.000000 COUNT : 99 SUM : 33503268 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 443 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0