[2024-11-20 22:42:20.793955] Starting SPDK v25.01-pre git sha1 557f022f6 / DPDK 23.11.0 initialization... [2024-11-20 22:42:20.794101] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid368557 ] Set seed to 1732138940790497 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-20 22:42:20.898739] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-20 22:42:20.919999] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-20 22:42:20.920041] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 368557' to capture a snapshot of events at runtime. [2024-11-20 22:42:20.920052] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-20 22:42:20.920062] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-20 22:42:20.920070] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid368557 for offline analysis/debug. [2024-11-20 22:42:20.920624] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 20 22:42:25 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/20-22:42:28 ... thread 0: (1000000,1000000) ops and (335167.3,335167.3) ops/second in (2.983585,2.983585) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/4 503.94 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 343.0 2.57 2.33 12 0.214 0 0 0.0 0.0 L1 2/0 186.97 MB 18.7 0.2 0.2 0.0 0.2 0.2 0.2 1.0 259.0 258.9 0.73 0.71 1 0.730 191K 113 0.0 0.0 L2 3/2 190.77 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 251.6 251.5 0.77 0.74 2 0.383 195K 78 0.0 0.0 L3 12/0 993.08 MB 1.0 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 112/0 9.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1176/6 97.00 GB 0.0 0.4 0.3 0.1 1.2 1.2 0.4 1.4 93.9 310.7 4.07 3.78 15 0.271 387K 191 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.2 0.4 1.4 93.9 310.7 4.07 3.78 15 0.271 387K 191 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 255.3 255.1 1.50 1.45 3 0.499 387K 191 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 343.0 2.57 2.33 12 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.23 GB write, 399.38 MB/s write, 0.37 GB read, 120.67 MB/s read, 4.1 seconds Interval compaction: 1.23 GB write, 423.21 MB/s write, 0.37 GB read, 127.87 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 140671 Average: 1.8715 StdDev: 14.15 Min: 1 Median: 1.2388 Max: 3168 Percentiles: P50: 1.24 P75: 1.67 P99: 4.28 P99.9: 9.37 P99.99: 270.21 ------------------------------------------------------ [ 0, 1 ] 50933 36.207% 36.207% ####### ( 1, 2 ] 81255 57.762% 93.970% ############ ( 2, 3 ] 4908 3.489% 97.459% # ( 3, 4 ] 2014 1.432% 98.890% ( 4, 6 ] 1095 0.778% 99.669% ( 6, 10 ] 386 0.274% 99.943% ( 10, 15 ] 46 0.033% 99.976% ( 15, 22 ] 6 0.004% 99.980% ( 22, 34 ] 3 0.002% 99.982% ( 51, 76 ] 1 0.001% 99.983% ( 110, 170 ] 7 0.005% 99.988% ( 170, 250 ] 2 0.001% 99.989% ( 250, 380 ] 6 0.004% 99.994% ( 580, 870 ] 1 0.001% 99.994% ( 870, 1300 ] 5 0.004% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 1 read latency histogram (micros): Count: 503 Average: 15.2485 StdDev: 108.97 Min: 1 Median: 2.5974 Max: 1513 Percentiles: P50: 2.60 P75: 3.59 P99: 376.10 P99.9: 1513.00 P99.99: 1513.00 ------------------------------------------------------ [ 0, 1 ] 7 1.392% 1.392% ( 1, 2 ] 131 26.044% 27.435% ##### ( 2, 3 ] 190 37.773% 65.209% ######## ( 3, 4 ] 83 16.501% 81.710% ### ( 4, 6 ] 62 12.326% 94.036% ## ( 6, 10 ] 15 2.982% 97.018% # ( 10, 15 ] 5 0.994% 98.012% ( 22, 34 ] 1 0.199% 98.211% ( 110, 170 ] 2 0.398% 98.608% ( 170, 250 ] 1 0.199% 98.807% ( 250, 380 ] 1 0.199% 99.006% ( 380, 580 ] 1 0.199% 99.205% ( 870, 1300 ] 3 0.596% 99.801% ( 1300, 1900 ] 1 0.199% 100.000% ** Level 2 read latency histogram (micros): Count: 40587 Average: 2.2875 StdDev: 17.49 Min: 0 Median: 1.4788 Max: 1955 Percentiles: P50: 1.48 P75: 1.84 P99: 5.66 P99.9: 10.77 P99.99: 574.13 ------------------------------------------------------ [ 0, 1 ] 6980 17.198% 17.198% ### ( 1, 2 ] 27808 68.515% 85.712% ############## ( 2, 3 ] 3520 8.673% 94.385% ## ( 3, 4 ] 1214 2.991% 97.376% # ( 4, 6 ] 795 1.959% 99.335% ( 6, 10 ] 224 0.552% 99.887% ( 10, 15 ] 35 0.086% 99.973% ( 15, 22 ] 2 0.005% 99.978% ( 110, 170 ] 1 0.002% 99.980% ( 170, 250 ] 1 0.002% 99.983% ( 250, 380 ] 1 0.002% 99.985% ( 380, 580 ] 2 0.005% 99.990% ( 870, 1300 ] 1 0.002% 99.993% ( 1300, 1900 ] 2 0.005% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 50 Average: 1560.0400 StdDev: 1216.10 Min: 214 Median: 1238.5714 Max: 4781 Percentiles: P50: 1238.57 P75: 2257.14 P99: 4781.00 P99.9: 4781.00 P99.99: 4781.00 ------------------------------------------------------ ( 170, 250 ] 2 4.000% 4.000% # ( 250, 380 ] 3 6.000% 10.000% # ( 380, 580 ] 8 16.000% 26.000% ### ( 580, 870 ] 6 12.000% 38.000% ## ( 870, 1300 ] 7 14.000% 52.000% ### ( 1300, 1900 ] 9 18.000% 70.000% #### ( 1900, 2900 ] 7 14.000% 84.000% ### ( 2900, 4400 ] 5 10.000% 94.000% ## ( 4400, 6600 ] 3 6.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 20 Average: 1292.1500 StdDev: 1124.91 Min: 76 Median: 870.0000 Max: 3459 Percentiles: P50: 870.00 P75: 2233.33 P99: 3459.00 P99.9: 3459.00 P99.99: 3459.00 ------------------------------------------------------ ( 51, 76 ] 1 5.000% 5.000% # ( 76, 110 ] 1 5.000% 10.000% # ( 170, 250 ] 1 5.000% 15.000% # ( 250, 380 ] 1 5.000% 20.000% # ( 380, 580 ] 3 15.000% 35.000% ### ( 580, 870 ] 3 15.000% 50.000% ### ( 870, 1300 ] 3 15.000% 65.000% ### ( 1300, 1900 ] 1 5.000% 70.000% # ( 1900, 2900 ] 3 15.000% 85.000% ### ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 311.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.421 H:M:S, 13.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.421 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-22:42:31 ... thread 0: (1000000,2000000) ops and (332749.2,333953.9) ops/second in (3.005266,5.988851) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 1.48 GB 50.4 0.6 0.0 0.6 2.4 1.8 0.0 1.3 75.7 328.0 7.49 6.91 28 0.267 575K 645 0.0 0.0 L1 2/2 186.97 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 259.0 258.9 0.73 0.71 1 0.730 191K 113 0.0 0.0 L2 1/0 3.79 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 251.6 251.5 0.77 0.74 2 0.383 195K 78 0.0 0.0 L3 15/0 633.52 MB 0.6 0.2 0.2 0.0 0.2 0.2 0.1 1.0 223.2 223.2 0.84 0.77 1 0.838 189K 0 0.0 0.0 L4 170/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 139.5 139.5 1.21 0.84 1 1.209 171K 0 0.0 0.0 L5 1044/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/14 97.98 GB 0.0 1.3 0.7 0.6 3.1 2.5 1.1 1.7 118.2 289.5 11.03 9.97 33 0.334 1324K 836 0.0 0.0 Int 0/0 0.00 KB 0.0 1.3 0.7 0.6 3.1 2.5 1.1 1.7 118.2 289.5 11.03 9.97 33 0.334 1324K 836 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.3 0.7 0.6 1.3 0.7 0.0 0.0 231.2 231.1 5.64 5.12 7 0.806 1324K 836 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 350.6 5.39 4.85 26 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.12 GB write, 517.66 MB/s write, 1.27 GB read, 211.43 MB/s read, 11.0 seconds Interval compaction: 3.12 GB write, 533.05 MB/s write, 1.27 GB read, 217.72 MB/s read, 11.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 386779 Average: 2.0480 StdDev: 10.78 Min: 0 Median: 1.4060 Max: 3168 Percentiles: P50: 1.41 P75: 1.80 P99: 5.23 P99.9: 9.53 P99.99: 14.85 ------------------------------------------------------ [ 0, 1 ] 92616 23.945% 23.945% ##### ( 1, 2 ] 248222 64.177% 88.122% ############# ( 2, 3 ] 28634 7.403% 95.525% # ( 3, 4 ] 9838 2.544% 98.069% # ( 4, 6 ] 5867 1.517% 99.586% ( 6, 10 ] 1377 0.356% 99.942% ( 10, 15 ] 192 0.050% 99.991% ( 15, 22 ] 15 0.004% 99.995% ( 22, 34 ] 9 0.002% 99.998% ( 34, 51 ] 1 0.000% 99.998% ( 51, 76 ] 4 0.001% 99.999% ( 110, 170 ] 15 0.004% 100.003% ( 170, 250 ] 7 0.002% 100.005% ( 250, 380 ] 14 0.004% 100.008% ( 380, 580 ] 2 0.001% 100.009% ( 580, 870 ] 5 0.001% 100.010% ( 870, 1300 ] 7 0.002% 100.012% ( 1300, 1900 ] 3 0.001% 100.013% ( 1900, 2900 ] 2 0.001% 100.013% ( 2900, 4400 ] 1 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 27758 Average: 2.3028 StdDev: 14.80 Min: 1 Median: 1.4869 Max: 1513 Percentiles: P50: 1.49 P75: 1.86 P99: 5.56 P99.9: 12.72 P99.99: 1045.47 ------------------------------------------------------ [ 0, 1 ] 4853 17.483% 17.483% ### ( 1, 2 ] 18536 66.777% 84.260% ############# ( 2, 3 ] 2807 10.112% 94.373% ## ( 3, 4 ] 867 3.123% 97.496% # ( 4, 6 ] 536 1.931% 99.427% ( 6, 10 ] 116 0.418% 99.845% ( 10, 15 ] 28 0.101% 99.946% ( 15, 22 ] 4 0.014% 99.960% ( 22, 34 ] 2 0.007% 99.968% ( 110, 170 ] 2 0.007% 99.975% ( 170, 250 ] 1 0.004% 99.978% ( 250, 380 ] 1 0.004% 99.982% ( 380, 580 ] 1 0.004% 99.986% ( 870, 1300 ] 3 0.011% 99.996% ( 1300, 1900 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 47968 Average: 2.2727 StdDev: 16.09 Min: 0 Median: 1.4919 Max: 1955 Percentiles: P50: 1.49 P75: 1.86 P99: 5.65 P99.9: 10.70 P99.99: 500.32 ------------------------------------------------------ [ 0, 1 ] 7810 16.282% 16.282% ### ( 1, 2 ] 32883 68.552% 84.834% ############## ( 2, 3 ] 4602 9.594% 94.428% ## ( 3, 4 ] 1407 2.933% 97.361% # ( 4, 6 ] 956 1.993% 99.354% ( 6, 10 ] 256 0.534% 99.887% ( 10, 15 ] 43 0.090% 99.977% ( 15, 22 ] 2 0.004% 99.981% ( 110, 170 ] 1 0.002% 99.983% ( 170, 250 ] 1 0.002% 99.985% ( 250, 380 ] 1 0.002% 99.987% ( 380, 580 ] 2 0.004% 99.992% ( 870, 1300 ] 1 0.002% 99.994% ( 1300, 1900 ] 2 0.004% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42889 Average: 3.9421 StdDev: 67.76 Min: 1 Median: 1.4864 Max: 4781 Percentiles: P50: 1.49 P75: 1.85 P99: 5.77 P99.9: 471.36 P99.99: 4013.33 ------------------------------------------------------ [ 0, 1 ] 7214 16.820% 16.820% ### ( 1, 2 ] 29258 68.218% 85.038% ############## ( 2, 3 ] 4397 10.252% 95.290% ## ( 3, 4 ] 910 2.122% 97.412% ( 4, 6 ] 770 1.795% 99.207% ( 6, 10 ] 250 0.583% 99.790% ( 10, 15 ] 32 0.075% 99.865% ( 15, 22 ] 3 0.007% 99.872% ( 51, 76 ] 1 0.002% 99.874% ( 110, 170 ] 1 0.002% 99.876% ( 170, 250 ] 3 0.007% 99.883% ( 250, 380 ] 3 0.007% 99.890% ( 380, 580 ] 9 0.021% 99.911% ( 580, 870 ] 6 0.014% 99.925% ( 870, 1300 ] 8 0.019% 99.944% ( 1300, 1900 ] 9 0.021% 99.965% ( 1900, 2900 ] 7 0.016% 99.981% ( 2900, 4400 ] 5 0.012% 99.993% ( 4400, 6600 ] 3 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 88.7774 StdDev: 426.54 Min: 0 Median: 1.5081 Max: 3459 Percentiles: P50: 1.51 P75: 5.17 P99: 2866.67 P99.9: 3459.00 P99.99: 3459.00 ------------------------------------------------------ [ 0, 1 ] 92 29.677% 29.677% ###### ( 1, 2 ] 124 40.000% 69.677% ######## ( 2, 3 ] 9 2.903% 72.581% # ( 3, 4 ] 4 1.290% 73.871% ( 4, 6 ] 6 1.935% 75.806% ( 6, 10 ] 38 12.258% 88.065% ## ( 10, 15 ] 12 3.871% 91.935% # ( 51, 76 ] 1 0.323% 92.258% ( 76, 110 ] 2 0.645% 92.903% ( 110, 170 ] 2 0.645% 93.548% ( 170, 250 ] 3 0.968% 94.516% ( 250, 380 ] 1 0.323% 94.839% ( 380, 580 ] 3 0.968% 95.806% ( 580, 870 ] 3 0.968% 96.774% ( 870, 1300 ] 3 0.968% 97.742% ( 1300, 1900 ] 1 0.323% 98.065% ( 1900, 2900 ] 3 0.968% 99.032% ( 2900, 4400 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 846.5500 StdDev: 1058.07 Min: 86 Median: 250.0000 Max: 3946 Percentiles: P50: 250.00 P75: 1500.00 P99: 3946.00 P99.9: 3946.00 P99.99: 3946.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 5 25.000% 40.000% ##### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 1 5.000% 65.000% # ( 580, 870 ] 1 5.000% 70.000% # ( 1300, 1900 ] 3 15.000% 85.000% ### ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 319.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.820 H:M:S, 13.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.400 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/20-22:42:33 ... thread 0: (1000000,3000000) ops and (359422.4,342032.6) ops/second in (2.782242,8.771093) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.60 GB 138.5 1.4 0.0 1.4 4.1 2.7 0.0 1.5 106.7 319.9 12.99 12.12 44 0.295 1407K 1523 0.0 0.0 L1 8/0 938.71 MB 93.9 1.1 0.9 0.2 1.1 0.9 0.2 1.2 236.9 236.0 4.78 4.67 2 2.389 1149K 3912 0.0 0.0 L2 1/0 3.79 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 251.6 251.5 0.77 0.74 2 0.383 195K 78 0.0 0.0 L3 15/0 633.52 MB 0.6 0.2 0.2 0.0 0.2 0.2 0.1 1.0 223.2 223.2 0.84 0.77 1 0.838 189K 0 0.0 0.0 L4 170/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 139.5 139.5 1.21 0.84 1 1.209 171K 0 0.0 0.0 L5 1044/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/4 98.84 GB 0.0 3.0 1.4 1.6 5.7 4.1 1.1 2.1 149.0 283.4 20.58 19.14 50 0.412 3112K 5513 0.0 0.0 Int 0/0 0.00 KB 0.0 3.0 1.4 1.6 5.7 4.1 1.1 2.1 149.0 283.4 20.58 19.14 50 0.412 3112K 5513 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.0 1.4 1.6 3.0 1.4 0.0 0.0 240.2 239.7 12.76 12.10 11 1.160 3112K 5513 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 354.6 7.82 7.04 39 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.70 GB write, 651.54 MB/s write, 2.99 GB read, 342.52 MB/s read, 20.6 seconds Interval compaction: 5.70 GB write, 664.77 MB/s write, 2.99 GB read, 349.47 MB/s read, 20.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 675017 Average: 2.0427 StdDev: 9.47 Min: 0 Median: 1.4172 Max: 3168 Percentiles: P50: 1.42 P75: 1.80 P99: 5.14 P99.9: 9.45 P99.99: 14.61 ------------------------------------------------------ [ 0, 1 ] 153496 22.740% 22.740% ##### ( 1, 2 ] 441081 65.344% 88.083% ############# ( 2, 3 ] 51293 7.599% 95.682% ## ( 3, 4 ] 16965 2.513% 98.195% # ( 4, 6 ] 9563 1.417% 99.612% ( 6, 10 ] 2253 0.334% 99.946% ( 10, 15 ] 326 0.048% 99.994% ( 15, 22 ] 26 0.004% 99.998% ( 22, 34 ] 10 0.001% 99.999% ( 34, 51 ] 3 0.000% 100.000% ( 51, 76 ] 5 0.001% 100.001% ( 110, 170 ] 18 0.003% 100.003% ( 170, 250 ] 17 0.003% 100.006% ( 250, 380 ] 20 0.003% 100.009% ( 380, 580 ] 5 0.001% 100.009% ( 580, 870 ] 11 0.002% 100.011% ( 870, 1300 ] 9 0.001% 100.012% ( 1300, 1900 ] 3 0.000% 100.013% ( 1900, 2900 ] 4 0.001% 100.013% ( 2900, 4400 ] 1 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 48008 Average: 2.3936 StdDev: 16.96 Min: 1 Median: 1.4834 Max: 1513 Percentiles: P50: 1.48 P75: 1.85 P99: 5.40 P99.9: 12.70 P99.99: 1095.71 ------------------------------------------------------ [ 0, 1 ] 8282 17.251% 17.251% ### ( 1, 2 ] 32525 67.749% 85.000% ############## ( 2, 3 ] 4744 9.882% 94.882% ## ( 3, 4 ] 1410 2.937% 97.819% # ( 4, 6 ] 811 1.689% 99.508% ( 6, 10 ] 168 0.350% 99.858% ( 10, 15 ] 37 0.077% 99.935% ( 15, 22 ] 4 0.008% 99.944% ( 22, 34 ] 2 0.004% 99.948% ( 110, 170 ] 3 0.006% 99.954% ( 170, 250 ] 2 0.004% 99.958% ( 250, 380 ] 6 0.012% 99.971% ( 380, 580 ] 4 0.008% 99.979% ( 580, 870 ] 1 0.002% 99.981% ( 870, 1300 ] 8 0.017% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 47968 Average: 2.2727 StdDev: 16.09 Min: 0 Median: 1.4919 Max: 1955 Percentiles: P50: 1.49 P75: 1.86 P99: 5.65 P99.9: 10.70 P99.99: 500.32 ------------------------------------------------------ [ 0, 1 ] 7810 16.282% 16.282% ### ( 1, 2 ] 32883 68.552% 84.834% ############## ( 2, 3 ] 4602 9.594% 94.428% ## ( 3, 4 ] 1407 2.933% 97.361% # ( 4, 6 ] 956 1.993% 99.354% ( 6, 10 ] 256 0.534% 99.887% ( 10, 15 ] 43 0.090% 99.977% ( 15, 22 ] 2 0.004% 99.981% ( 110, 170 ] 1 0.002% 99.983% ( 170, 250 ] 1 0.002% 99.985% ( 250, 380 ] 1 0.002% 99.987% ( 380, 580 ] 2 0.004% 99.992% ( 870, 1300 ] 1 0.002% 99.994% ( 1300, 1900 ] 2 0.004% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42889 Average: 3.9421 StdDev: 67.76 Min: 1 Median: 1.4864 Max: 4781 Percentiles: P50: 1.49 P75: 1.85 P99: 5.77 P99.9: 471.36 P99.99: 4013.33 ------------------------------------------------------ [ 0, 1 ] 7214 16.820% 16.820% ### ( 1, 2 ] 29258 68.218% 85.038% ############## ( 2, 3 ] 4397 10.252% 95.290% ## ( 3, 4 ] 910 2.122% 97.412% ( 4, 6 ] 770 1.795% 99.207% ( 6, 10 ] 250 0.583% 99.790% ( 10, 15 ] 32 0.075% 99.865% ( 15, 22 ] 3 0.007% 99.872% ( 51, 76 ] 1 0.002% 99.874% ( 110, 170 ] 1 0.002% 99.876% ( 170, 250 ] 3 0.007% 99.883% ( 250, 380 ] 3 0.007% 99.890% ( 380, 580 ] 9 0.021% 99.911% ( 580, 870 ] 6 0.014% 99.925% ( 870, 1300 ] 8 0.019% 99.944% ( 1300, 1900 ] 9 0.021% 99.965% ( 1900, 2900 ] 7 0.016% 99.981% ( 2900, 4400 ] 5 0.012% 99.993% ( 4400, 6600 ] 3 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 88.7774 StdDev: 426.54 Min: 0 Median: 1.5081 Max: 3459 Percentiles: P50: 1.51 P75: 5.17 P99: 2866.67 P99.9: 3459.00 P99.99: 3459.00 ------------------------------------------------------ [ 0, 1 ] 92 29.677% 29.677% ###### ( 1, 2 ] 124 40.000% 69.677% ######## ( 2, 3 ] 9 2.903% 72.581% # ( 3, 4 ] 4 1.290% 73.871% ( 4, 6 ] 6 1.935% 75.806% ( 6, 10 ] 38 12.258% 88.065% ## ( 10, 15 ] 12 3.871% 91.935% # ( 51, 76 ] 1 0.323% 92.258% ( 76, 110 ] 2 0.645% 92.903% ( 110, 170 ] 2 0.645% 93.548% ( 170, 250 ] 3 0.968% 94.516% ( 250, 380 ] 1 0.323% 94.839% ( 380, 580 ] 3 0.968% 95.806% ( 580, 870 ] 3 0.968% 96.774% ( 870, 1300 ] 3 0.968% 97.742% ( 1300, 1900 ] 1 0.323% 98.065% ( 1900, 2900 ] 3 0.968% 99.032% ( 2900, 4400 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 846.5500 StdDev: 1058.07 Min: 86 Median: 250.0000 Max: 3946 Percentiles: P50: 250.00 P75: 1500.00 P99: 3946.00 P99.9: 3946.00 P99.99: 3946.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 5 25.000% 40.000% ##### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 1 5.000% 65.000% # ( 580, 870 ] 1 5.000% 70.000% # ( 1300, 1900 ] 3 15.000% 85.000% ### ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 329.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.018 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 353.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.198 H:M:S, 7.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-22:42:37 ... thread 0: (1000000,4000000) ops and (310170.8,333468.9) ops/second in (3.224030,11.995123) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 2.64 GB 37.8 1.8 0.0 1.8 5.6 3.8 0.0 1.5 105.8 320.8 17.86 16.64 60 0.298 1918K 2002 0.0 0.0 L1 8/8 938.71 MB 0.0 1.1 0.9 0.2 1.1 0.9 0.2 1.2 236.9 236.0 4.78 4.67 2 2.389 1149K 3912 0.0 0.0 L2 1/0 3.79 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 251.6 251.5 0.77 0.74 2 0.383 195K 78 0.0 0.0 L3 15/0 633.52 MB 0.6 0.2 0.2 0.0 0.2 0.2 0.1 1.0 223.2 223.2 0.84 0.77 1 0.838 189K 0 0.0 0.0 L4 170/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 139.5 139.5 1.21 0.84 1 1.209 171K 0 0.0 0.0 L5 1044/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/25 99.88 GB 0.0 3.5 1.4 2.1 7.2 5.1 1.1 1.9 140.3 291.0 25.45 23.66 66 0.386 3624K 5992 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 1.4 2.1 7.2 5.1 1.1 1.9 140.3 291.0 25.45 23.66 66 0.386 3624K 5992 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 1.4 2.1 3.5 1.4 0.0 0.0 244.3 243.9 14.61 13.91 13 1.124 3624K 5992 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 354.5 10.84 9.75 53 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.23 GB write, 608.32 MB/s write, 3.49 GB read, 293.22 MB/s read, 25.5 seconds Interval compaction: 7.23 GB write, 617.36 MB/s write, 3.49 GB read, 297.57 MB/s read, 25.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 953919 Average: 2.0516 StdDev: 9.05 Min: 0 Median: 1.4239 Max: 3168 Percentiles: P50: 1.42 P75: 1.80 P99: 5.13 P99.9: 9.52 P99.99: 14.90 ------------------------------------------------------ [ 0, 1 ] 210916 22.110% 22.110% #### ( 1, 2 ] 627592 65.791% 87.901% ############# ( 2, 3 ] 74543 7.814% 95.716% ## ( 3, 4 ] 23799 2.495% 98.211% ( 4, 6 ] 13333 1.398% 99.608% ( 6, 10 ] 3165 0.332% 99.940% ( 10, 15 ] 487 0.051% 99.991% ( 15, 22 ] 38 0.004% 99.995% ( 22, 34 ] 13 0.001% 99.997% ( 34, 51 ] 4 0.000% 99.997% ( 51, 76 ] 7 0.001% 99.998% ( 76, 110 ] 15 0.002% 99.999% ( 110, 170 ] 26 0.003% 100.002% ( 170, 250 ] 24 0.003% 100.005% ( 250, 380 ] 33 0.003% 100.008% ( 380, 580 ] 10 0.001% 100.009% ( 580, 870 ] 17 0.002% 100.011% ( 870, 1300 ] 12 0.001% 100.012% ( 1300, 1900 ] 4 0.000% 100.012% ( 1900, 2900 ] 5 0.001% 100.013% ( 2900, 4400 ] 1 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 106004 Average: 2.4056 StdDev: 14.14 Min: 1 Median: 1.4761 Max: 1513 Percentiles: P50: 1.48 P75: 1.85 P99: 5.86 P99.9: 109.99 P99.99: 924.71 ------------------------------------------------------ [ 0, 1 ] 18859 17.791% 17.791% #### ( 1, 2 ] 71709 67.647% 85.438% ############## ( 2, 3 ] 9980 9.415% 94.853% ## ( 3, 4 ] 2794 2.636% 97.489% # ( 4, 6 ] 1718 1.621% 99.109% ( 6, 10 ] 726 0.685% 99.794% ( 10, 15 ] 84 0.079% 99.874% ( 15, 22 ] 8 0.008% 99.881% ( 22, 34 ] 2 0.002% 99.883% ( 34, 51 ] 1 0.001% 99.884% ( 51, 76 ] 1 0.001% 99.885% ( 76, 110 ] 16 0.015% 99.900% ( 110, 170 ] 55 0.052% 99.952% ( 170, 250 ] 15 0.014% 99.966% ( 250, 380 ] 10 0.009% 99.975% ( 380, 580 ] 10 0.009% 99.985% ( 580, 870 ] 4 0.004% 99.989% ( 870, 1300 ] 11 0.010% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 47968 Average: 2.2727 StdDev: 16.09 Min: 0 Median: 1.4919 Max: 1955 Percentiles: P50: 1.49 P75: 1.86 P99: 5.65 P99.9: 10.70 P99.99: 500.32 ------------------------------------------------------ [ 0, 1 ] 7810 16.282% 16.282% ### ( 1, 2 ] 32883 68.552% 84.834% ############## ( 2, 3 ] 4602 9.594% 94.428% ## ( 3, 4 ] 1407 2.933% 97.361% # ( 4, 6 ] 956 1.993% 99.354% ( 6, 10 ] 256 0.534% 99.887% ( 10, 15 ] 43 0.090% 99.977% ( 15, 22 ] 2 0.004% 99.981% ( 110, 170 ] 1 0.002% 99.983% ( 170, 250 ] 1 0.002% 99.985% ( 250, 380 ] 1 0.002% 99.987% ( 380, 580 ] 2 0.004% 99.992% ( 870, 1300 ] 1 0.002% 99.994% ( 1300, 1900 ] 2 0.004% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42889 Average: 3.9421 StdDev: 67.76 Min: 1 Median: 1.4864 Max: 4781 Percentiles: P50: 1.49 P75: 1.85 P99: 5.77 P99.9: 471.36 P99.99: 4013.33 ------------------------------------------------------ [ 0, 1 ] 7214 16.820% 16.820% ### ( 1, 2 ] 29258 68.218% 85.038% ############## ( 2, 3 ] 4397 10.252% 95.290% ## ( 3, 4 ] 910 2.122% 97.412% ( 4, 6 ] 770 1.795% 99.207% ( 6, 10 ] 250 0.583% 99.790% ( 10, 15 ] 32 0.075% 99.865% ( 15, 22 ] 3 0.007% 99.872% ( 51, 76 ] 1 0.002% 99.874% ( 110, 170 ] 1 0.002% 99.876% ( 170, 250 ] 3 0.007% 99.883% ( 250, 380 ] 3 0.007% 99.890% ( 380, 580 ] 9 0.021% 99.911% ( 580, 870 ] 6 0.014% 99.925% ( 870, 1300 ] 8 0.019% 99.944% ( 1300, 1900 ] 9 0.021% 99.965% ( 1900, 2900 ] 7 0.016% 99.981% ( 2900, 4400 ] 5 0.012% 99.993% ( 4400, 6600 ] 3 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 88.7774 StdDev: 426.54 Min: 0 Median: 1.5081 Max: 3459 Percentiles: P50: 1.51 P75: 5.17 P99: 2866.67 P99.9: 3459.00 P99.99: 3459.00 ------------------------------------------------------ [ 0, 1 ] 92 29.677% 29.677% ###### ( 1, 2 ] 124 40.000% 69.677% ######## ( 2, 3 ] 9 2.903% 72.581% # ( 3, 4 ] 4 1.290% 73.871% ( 4, 6 ] 6 1.935% 75.806% ( 6, 10 ] 38 12.258% 88.065% ## ( 10, 15 ] 12 3.871% 91.935% # ( 51, 76 ] 1 0.323% 92.258% ( 76, 110 ] 2 0.645% 92.903% ( 110, 170 ] 2 0.645% 93.548% ( 170, 250 ] 3 0.968% 94.516% ( 250, 380 ] 1 0.323% 94.839% ( 380, 580 ] 3 0.968% 95.806% ( 580, 870 ] 3 0.968% 96.774% ( 870, 1300 ] 3 0.968% 97.742% ( 1300, 1900 ] 1 0.323% 98.065% ( 1900, 2900 ] 3 0.968% 99.032% ( 2900, 4400 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 846.5500 StdDev: 1058.07 Min: 86 Median: 250.0000 Max: 3946 Percentiles: P50: 250.00 P75: 1500.00 P99: 3946.00 P99.9: 3946.00 P99.99: 3946.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 5 25.000% 40.000% ##### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 1 5.000% 65.000% # ( 580, 870 ] 1 5.000% 70.000% # ( 1300, 1900 ] 3 15.000% 85.000% ### ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 323.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.611 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 305.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.593 H:M:S, 18.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/20-22:42:41 ... thread 0: (1000000,5000000) ops and (229963.5,305929.4) ops/second in (4.348516,16.343639) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/9 3.56 GB 195.1 3.2 0.0 3.2 7.9 4.7 0.0 1.7 127.4 313.6 25.70 24.10 80 0.321 3326K 3547 0.0 0.0 L1 8/8 938.71 MB 0.0 1.1 0.9 0.2 1.1 0.9 0.2 1.2 236.9 236.0 4.78 4.67 2 2.389 1149K 3912 0.0 0.0 L2 1/0 3.79 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 1.5 251.6 251.5 0.77 0.74 2 0.383 195K 78 0.0 0.0 L3 15/0 633.52 MB 0.6 0.2 0.2 0.0 0.2 0.2 0.1 1.0 223.2 223.2 0.84 0.77 1 0.838 189K 0 0.0 0.0 L4 170/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.4 1.0 139.5 139.5 1.21 0.84 1 1.209 171K 0 0.0 0.0 L5 1044/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/17 100.80 GB 0.0 4.8 1.4 3.4 9.5 6.1 1.1 2.0 148.8 292.4 33.29 31.12 86 0.387 5031K 7537 0.0 0.0 Int 0/0 0.00 KB 0.0 4.8 1.4 3.4 9.5 6.1 1.1 2.0 148.8 292.4 33.29 31.12 86 0.387 5031K 7537 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.8 1.4 3.4 4.8 1.4 0.0 0.0 250.6 250.2 19.78 18.98 18 1.099 5031K 7537 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 354.2 13.52 12.14 68 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.5 total, 16.3 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.51 GB write, 589.20 MB/s write, 4.84 GB read, 299.93 MB/s read, 33.3 seconds Interval compaction: 9.51 GB write, 595.62 MB/s write, 4.84 GB read, 303.19 MB/s read, 33.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 7, total-stops: 15, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1384725 Average: 2.1061 StdDev: 9.49 Min: 0 Median: 1.4424 Max: 3168 Percentiles: P50: 1.44 P75: 1.82 P99: 5.28 P99.9: 9.69 P99.99: 81.51 ------------------------------------------------------ [ 0, 1 ] 284770 20.565% 20.565% #### ( 1, 2 ] 921426 66.542% 87.107% ############# ( 2, 3 ] 114464 8.266% 95.373% ## ( 3, 4 ] 36837 2.660% 98.034% # ( 4, 6 ] 20924 1.511% 99.545% ( 6, 10 ] 5335 0.385% 99.930% ( 10, 15 ] 726 0.052% 99.982% ( 15, 22 ] 63 0.005% 99.987% ( 22, 34 ] 19 0.001% 99.988% ( 34, 51 ] 4 0.000% 99.989% ( 51, 76 ] 9 0.001% 99.989% ( 76, 110 ] 65 0.005% 99.994% ( 110, 170 ] 99 0.007% 100.001% ( 170, 250 ] 67 0.005% 100.006% ( 250, 380 ] 55 0.004% 100.010% ( 380, 580 ] 35 0.003% 100.012% ( 580, 870 ] 32 0.002% 100.015% ( 870, 1300 ] 17 0.001% 100.016% ( 1300, 1900 ] 5 0.000% 100.016% ( 1900, 2900 ] 7 0.001% 100.017% ( 2900, 4400 ] 2 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 195239 Average: 2.4500 StdDev: 12.32 Min: 1 Median: 1.4870 Max: 1513 Percentiles: P50: 1.49 P75: 1.86 P99: 6.97 P99.9: 125.24 P99.99: 599.72 ------------------------------------------------------ [ 0, 1 ] 33391 17.103% 17.103% ### ( 1, 2 ] 131875 67.545% 84.648% ############## ( 2, 3 ] 18729 9.593% 94.241% ## ( 3, 4 ] 5310 2.720% 96.961% # ( 4, 6 ] 3521 1.803% 98.764% ( 6, 10 ] 1898 0.972% 99.736% ( 10, 15 ] 180 0.092% 99.828% ( 15, 22 ] 16 0.008% 99.837% ( 22, 34 ] 3 0.002% 99.838% ( 34, 51 ] 1 0.001% 99.839% ( 51, 76 ] 3 0.002% 99.840% ( 76, 110 ] 84 0.043% 99.883% ( 110, 170 ] 129 0.066% 99.949% ( 170, 250 ] 30 0.015% 99.965% ( 250, 380 ] 28 0.014% 99.979% ( 380, 580 ] 21 0.011% 99.990% ( 580, 870 ] 7 0.004% 99.993% ( 870, 1300 ] 12 0.006% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 47968 Average: 2.2727 StdDev: 16.09 Min: 0 Median: 1.4919 Max: 1955 Percentiles: P50: 1.49 P75: 1.86 P99: 5.65 P99.9: 10.70 P99.99: 500.32 ------------------------------------------------------ [ 0, 1 ] 7810 16.282% 16.282% ### ( 1, 2 ] 32883 68.552% 84.834% ############## ( 2, 3 ] 4602 9.594% 94.428% ## ( 3, 4 ] 1407 2.933% 97.361% # ( 4, 6 ] 956 1.993% 99.354% ( 6, 10 ] 256 0.534% 99.887% ( 10, 15 ] 43 0.090% 99.977% ( 15, 22 ] 2 0.004% 99.981% ( 110, 170 ] 1 0.002% 99.983% ( 170, 250 ] 1 0.002% 99.985% ( 250, 380 ] 1 0.002% 99.987% ( 380, 580 ] 2 0.004% 99.992% ( 870, 1300 ] 1 0.002% 99.994% ( 1300, 1900 ] 2 0.004% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 42889 Average: 3.9421 StdDev: 67.76 Min: 1 Median: 1.4864 Max: 4781 Percentiles: P50: 1.49 P75: 1.85 P99: 5.77 P99.9: 471.36 P99.99: 4013.33 ------------------------------------------------------ [ 0, 1 ] 7214 16.820% 16.820% ### ( 1, 2 ] 29258 68.218% 85.038% ############## ( 2, 3 ] 4397 10.252% 95.290% ## ( 3, 4 ] 910 2.122% 97.412% ( 4, 6 ] 770 1.795% 99.207% ( 6, 10 ] 250 0.583% 99.790% ( 10, 15 ] 32 0.075% 99.865% ( 15, 22 ] 3 0.007% 99.872% ( 51, 76 ] 1 0.002% 99.874% ( 110, 170 ] 1 0.002% 99.876% ( 170, 250 ] 3 0.007% 99.883% ( 250, 380 ] 3 0.007% 99.890% ( 380, 580 ] 9 0.021% 99.911% ( 580, 870 ] 6 0.014% 99.925% ( 870, 1300 ] 8 0.019% 99.944% ( 1300, 1900 ] 9 0.021% 99.965% ( 1900, 2900 ] 7 0.016% 99.981% ( 2900, 4400 ] 5 0.012% 99.993% ( 4400, 6600 ] 3 0.007% 100.000% ** Level 4 read latency histogram (micros): Count: 310 Average: 88.7774 StdDev: 426.54 Min: 0 Median: 1.5081 Max: 3459 Percentiles: P50: 1.51 P75: 5.17 P99: 2866.67 P99.9: 3459.00 P99.99: 3459.00 ------------------------------------------------------ [ 0, 1 ] 92 29.677% 29.677% ###### ( 1, 2 ] 124 40.000% 69.677% ######## ( 2, 3 ] 9 2.903% 72.581% # ( 3, 4 ] 4 1.290% 73.871% ( 4, 6 ] 6 1.935% 75.806% ( 6, 10 ] 38 12.258% 88.065% ## ( 10, 15 ] 12 3.871% 91.935% # ( 51, 76 ] 1 0.323% 92.258% ( 76, 110 ] 2 0.645% 92.903% ( 110, 170 ] 2 0.645% 93.548% ( 170, 250 ] 3 0.968% 94.516% ( 250, 380 ] 1 0.323% 94.839% ( 380, 580 ] 3 0.968% 95.806% ( 580, 870 ] 3 0.968% 96.774% ( 870, 1300 ] 3 0.968% 97.742% ( 1300, 1900 ] 1 0.323% 98.065% ( 1900, 2900 ] 3 0.968% 99.032% ( 2900, 4400 ] 3 0.968% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 846.5500 StdDev: 1058.07 Min: 86 Median: 250.0000 Max: 3946 Percentiles: P50: 250.00 P75: 1500.00 P99: 3946.00 P99.9: 3946.00 P99.99: 3946.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 5 25.000% 40.000% ##### ( 170, 250 ] 2 10.000% 50.000% ## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 1 5.000% 65.000% # ( 580, 870 ] 1 5.000% 70.000% # ( 1300, 1900 ] 3 15.000% 85.000% ### ( 1900, 2900 ] 2 10.000% 95.000% ## ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 16.5 total, 4.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 297.81 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.255 H:M:S, 19.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 226.33 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.643 H:M:S, 37.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/20-22:42:49 ... thread 0: (1000000,6000000) ops and (126396.5,247369.1) ops/second in (7.911613,24.255252) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.88 GB 12.6 4.7 0.0 4.7 10.4 5.7 0.0 1.8 134.8 295.7 35.97 32.57 97 0.371 4924K 8563 0.0 0.0 L1 5/5 548.37 MB 0.0 3.7 2.6 1.1 3.6 2.5 0.2 1.4 228.0 226.0 16.53 15.95 3 5.510 3827K 32K 0.0 0.0 L2 1/0 3.79 MB 0.0 0.2 0.1 0.1 0.2 0.1 2.1 1.5 251.6 251.5 0.77 0.74 2 0.383 195K 78 0.0 0.0 L3 14/3 919.85 MB 0.9 0.2 0.2 0.0 0.2 0.2 2.1 1.0 223.2 223.2 0.84 0.77 1 0.838 189K 0 0.0 0.0 L4 174/42 10.69 GB 0.7 1.4 1.3 0.1 1.4 1.3 1.0 1.1 125.1 124.9 11.75 6.89 10 1.175 1427K 755 0.0 0.0 L5 1052/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1260/62 101.75 GB 0.0 10.2 4.2 6.0 15.8 9.8 6.4 2.8 159.0 246.3 65.85 56.92 113 0.583 10M 42K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.2 4.2 6.0 15.8 9.8 6.4 2.8 159.0 246.3 65.85 56.92 113 0.583 10M 42K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.2 4.2 6.0 10.2 4.1 0.0 0.0 215.8 214.9 48.52 42.11 31 1.565 10M 42K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 334.3 17.34 14.81 82 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.4 total, 24.3 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.84 GB write, 663.80 MB/s write, 10.22 GB read, 428.43 MB/s read, 65.9 seconds Interval compaction: 15.84 GB write, 668.68 MB/s write, 10.22 GB read, 431.58 MB/s read, 65.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 26, interval: 37 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2043290 Average: 2.4202 StdDev: 18.73 Min: 0 Median: 1.4770 Max: 5016 Percentiles: P50: 1.48 P75: 1.86 P99: 5.80 P99.9: 14.56 P99.99: 341.85 ------------------------------------------------------ [ 0, 1 ] 378571 18.528% 18.528% #### ( 1, 2 ] 1348226 65.983% 84.511% ############# ( 2, 3 ] 190622 9.329% 93.840% ## ( 3, 4 ] 65635 3.212% 97.052% # ( 4, 6 ] 44162 2.161% 99.213% ( 6, 10 ] 12555 0.614% 99.828% ( 10, 15 ] 1620 0.079% 99.907% ( 15, 22 ] 188 0.009% 99.916% ( 22, 34 ] 27 0.001% 99.918% ( 34, 51 ] 6 0.000% 99.918% ( 51, 76 ] 18 0.001% 99.919% ( 76, 110 ] 542 0.027% 99.945% ( 110, 170 ] 540 0.026% 99.972% ( 170, 250 ] 228 0.011% 99.983% ( 250, 380 ] 209 0.010% 99.993% ( 380, 580 ] 192 0.009% 100.002% ( 580, 870 ] 152 0.007% 100.010% ( 870, 1300 ] 80 0.004% 100.014% ( 1300, 1900 ] 27 0.001% 100.015% ( 1900, 2900 ] 25 0.001% 100.016% ( 2900, 4400 ] 13 0.001% 100.017% ( 4400, 6600 ] 4 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 579112 Average: 3.7440 StdDev: 53.01 Min: 1 Median: 1.6975 Max: 8018 Percentiles: P50: 1.70 P75: 2.41 P99: 8.31 P99.9: 15.37 P99.99: 122.78 ------------------------------------------------------ [ 0, 1 ] 48797 8.426% 8.426% ## ( 1, 2 ] 345165 59.602% 68.029% ############ ( 2, 3 ] 99565 17.193% 85.221% ### ( 3, 4 ] 39579 6.834% 92.056% # ( 4, 6 ] 35109 6.063% 98.118% # ( 6, 10 ] 8849 1.528% 99.646% ( 10, 15 ] 1459 0.252% 99.898% ( 15, 22 ] 185 0.032% 99.930% ( 22, 34 ] 17 0.003% 99.933% ( 34, 51 ] 9 0.002% 99.935% ( 51, 76 ] 19 0.003% 99.938% ( 76, 110 ] 257 0.044% 99.982% ( 110, 170 ] 207 0.036% 100.018% ( 170, 250 ] 107 0.018% 100.037% ( 250, 380 ] 103 0.018% 100.054% ( 380, 580 ] 107 0.018% 100.073% ( 580, 870 ] 83 0.014% 100.087% ( 870, 1300 ] 74 0.013% 100.100% ( 1300, 1900 ] 50 0.009% 100.109% ( 1900, 2900 ] 40 0.007% 100.116% ( 2900, 4400 ] 38 0.007% 100.122% ( 4400, 6600 ] 10 0.002% 100.124% ( 6600, 9900 ] 6 0.001% 100.125% ** Level 2 read latency histogram (micros): Count: 47968 Average: 2.2727 StdDev: 16.09 Min: 0 Median: 1.4919 Max: 1955 Percentiles: P50: 1.49 P75: 1.86 P99: 5.65 P99.9: 10.70 P99.99: 500.32 ------------------------------------------------------ [ 0, 1 ] 7810 16.282% 16.282% ### ( 1, 2 ] 32883 68.552% 84.834% ############## ( 2, 3 ] 4602 9.594% 94.428% ## ( 3, 4 ] 1407 2.933% 97.361% # ( 4, 6 ] 956 1.993% 99.354% ( 6, 10 ] 256 0.534% 99.887% ( 10, 15 ] 43 0.090% 99.977% ( 15, 22 ] 2 0.004% 99.981% ( 110, 170 ] 1 0.002% 99.983% ( 170, 250 ] 1 0.002% 99.985% ( 250, 380 ] 1 0.002% 99.987% ( 380, 580 ] 2 0.004% 99.992% ( 870, 1300 ] 1 0.002% 99.994% ( 1300, 1900 ] 2 0.004% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 44012 Average: 7.9106 StdDev: 109.11 Min: 1 Median: 1.5011 Max: 8592 Percentiles: P50: 1.50 P75: 1.87 P99: 7.82 P99.9: 1610.10 P99.99: 4729.34 ------------------------------------------------------ [ 0, 1 ] 7220 16.405% 16.405% ### ( 1, 2 ] 29507 67.043% 83.448% ############# ( 2, 3 ] 4792 10.888% 94.336% ## ( 3, 4 ] 1044 2.372% 96.708% ( 4, 6 ] 881 2.002% 98.709% ( 6, 10 ] 281 0.638% 99.348% ( 10, 15 ] 36 0.082% 99.430% ( 15, 22 ] 3 0.007% 99.437% ( 51, 76 ] 1 0.002% 99.439% ( 76, 110 ] 3 0.007% 99.446% ( 110, 170 ] 5 0.011% 99.457% ( 170, 250 ] 15 0.034% 99.491% ( 250, 380 ] 27 0.061% 99.552% ( 380, 580 ] 47 0.107% 99.659% ( 580, 870 ] 57 0.130% 99.789% ( 870, 1300 ] 34 0.077% 99.866% ( 1300, 1900 ] 29 0.066% 99.932% ( 1900, 2900 ] 14 0.032% 99.964% ( 2900, 4400 ] 11 0.025% 99.989% ( 4400, 6600 ] 4 0.009% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 36560 Average: 57.5274 StdDev: 305.57 Min: 0 Median: 1.9379 Max: 6880 Percentiles: P50: 1.94 P75: 3.18 P99: 1448.71 P99.9: 4055.96 P99.99: 5868.05 ------------------------------------------------------ [ 0, 1 ] 1246 3.408% 3.408% # ( 1, 2 ] 18161 49.675% 53.083% ########## ( 2, 3 ] 7357 20.123% 73.206% #### ( 3, 4 ] 3746 10.246% 83.452% ## ( 4, 6 ] 2661 7.278% 90.730% # ( 6, 10 ] 849 2.322% 93.053% ( 10, 15 ] 167 0.457% 93.509% ( 15, 22 ] 27 0.074% 93.583% ( 22, 34 ] 3 0.008% 93.591% ( 34, 51 ] 10 0.027% 93.619% ( 51, 76 ] 4 0.011% 93.630% ( 76, 110 ] 48 0.131% 93.761% ( 110, 170 ] 172 0.470% 94.231% ( 170, 250 ] 214 0.585% 94.817% ( 250, 380 ] 319 0.873% 95.689% ( 380, 580 ] 419 1.146% 96.835% ( 580, 870 ] 442 1.209% 98.044% ( 870, 1300 ] 309 0.845% 98.889% ( 1300, 1900 ] 163 0.446% 99.335% ( 1900, 2900 ] 134 0.367% 99.702% ( 2900, 4400 ] 94 0.257% 99.959% ( 4400, 6600 ] 17 0.046% 100.005% ( 6600, 9900 ] 1 0.003% 100.008% ** Level 5 read latency histogram (micros): Count: 60 Average: 1003.3167 StdDev: 1239.45 Min: 79 Median: 420.0000 Max: 5516 Percentiles: P50: 420.00 P75: 1450.00 P99: 5516.00 P99.9: 5516.00 P99.99: 5516.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 8 13.333% 23.333% ### ( 170, 250 ] 5 8.333% 31.667% ## ( 250, 380 ] 10 16.667% 48.333% ### ( 380, 580 ] 5 8.333% 56.667% ## ( 580, 870 ] 7 11.667% 68.333% ## ( 870, 1300 ] 3 5.000% 73.333% # ( 1300, 1900 ] 4 6.667% 80.000% # ( 1900, 2900 ] 7 11.667% 91.667% ## ( 2900, 4400 ] 3 5.000% 96.667% # ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 24.4 total, 7.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 241.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.189 H:M:S, 33.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 124.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.934 H:M:S, 62.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/20-22:42:52 ... thread 0: (1000000,7000000) ops and (311547.2,254869.5) ops/second in (3.209786,27.465038) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.81 GB 107.0 5.5 0.0 5.5 12.1 6.6 0.0 1.8 134.7 294.6 42.09 38.23 113 0.372 5755K 9460 0.0 0.0 L1 5/5 548.37 MB 0.0 3.7 2.6 1.1 3.6 2.5 0.2 1.4 228.0 226.0 16.53 15.95 3 5.510 3827K 32K 0.0 0.0 L2 1/0 3.79 MB 0.0 0.2 0.1 0.1 0.2 0.1 2.1 1.5 251.6 251.5 0.77 0.74 2 0.383 195K 78 0.0 0.0 L3 13/2 916.93 MB 0.9 0.2 0.2 0.0 0.2 0.2 2.1 1.0 223.2 223.2 0.84 0.77 1 0.838 189K 0 0.0 0.0 L4 172/36 10.69 GB 0.8 1.9 1.3 0.6 1.9 1.3 1.0 1.5 134.5 134.3 14.70 9.12 11 1.336 1430K 755 0.0 0.0 L5 1052/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/55 102.67 GB 0.0 11.5 4.2 7.3 18.1 10.7 6.4 2.7 157.4 246.8 74.92 64.81 130 0.576 11M 43K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.5 4.2 7.3 18.1 10.7 6.4 2.7 157.4 246.8 74.92 64.81 130 0.576 11M 43K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.5 4.2 7.3 11.5 4.1 0.0 0.0 215.5 214.7 54.72 47.52 35 1.563 11M 43K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 333.7 20.20 17.28 95 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.6 total, 27.5 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.06 GB write, 668.80 MB/s write, 11.52 GB read, 426.65 MB/s read, 74.9 seconds Interval compaction: 18.06 GB write, 673.14 MB/s write, 11.52 GB read, 429.41 MB/s read, 74.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 31, interval: 42 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2425831 Average: 2.5122 StdDev: 18.42 Min: 0 Median: 1.5212 Max: 5016 Percentiles: P50: 1.52 P75: 1.91 P99: 5.94 P99.9: 14.30 P99.99: 269.44 ------------------------------------------------------ [ 0, 1 ] 393132 16.206% 16.206% ### ( 1, 2 ] 1572952 64.842% 81.048% ############# ( 2, 3 ] 270037 11.132% 92.180% ## ( 3, 4 ] 95964 3.956% 96.136% # ( 4, 6 ] 71470 2.946% 99.082% # ( 6, 10 ] 17905 0.738% 99.820% ( 10, 15 ] 2263 0.093% 99.913% ( 15, 22 ] 286 0.012% 99.925% ( 22, 34 ] 39 0.002% 99.926% ( 34, 51 ] 9 0.000% 99.927% ( 51, 76 ] 21 0.001% 99.928% ( 76, 110 ] 567 0.023% 99.951% ( 110, 170 ] 607 0.025% 99.976% ( 170, 250 ] 297 0.012% 99.988% ( 250, 380 ] 277 0.011% 100.000% ( 380, 580 ] 240 0.010% 100.010% ( 580, 870 ] 185 0.008% 100.017% ( 870, 1300 ] 100 0.004% 100.021% ( 1300, 1900 ] 30 0.001% 100.023% ( 1900, 2900 ] 29 0.001% 100.024% ( 2900, 4400 ] 14 0.001% 100.024% ( 4400, 6600 ] 4 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 579112 Average: 3.7440 StdDev: 53.01 Min: 1 Median: 1.6975 Max: 8018 Percentiles: P50: 1.70 P75: 2.41 P99: 8.31 P99.9: 15.37 P99.99: 122.78 ------------------------------------------------------ [ 0, 1 ] 48797 8.426% 8.426% ## ( 1, 2 ] 345165 59.602% 68.029% ############ ( 2, 3 ] 99565 17.193% 85.221% ### ( 3, 4 ] 39579 6.834% 92.056% # ( 4, 6 ] 35109 6.063% 98.118% # ( 6, 10 ] 8849 1.528% 99.646% ( 10, 15 ] 1459 0.252% 99.898% ( 15, 22 ] 185 0.032% 99.930% ( 22, 34 ] 17 0.003% 99.933% ( 34, 51 ] 9 0.002% 99.935% ( 51, 76 ] 19 0.003% 99.938% ( 76, 110 ] 257 0.044% 99.982% ( 110, 170 ] 207 0.036% 100.018% ( 170, 250 ] 107 0.018% 100.037% ( 250, 380 ] 103 0.018% 100.054% ( 380, 580 ] 107 0.018% 100.073% ( 580, 870 ] 83 0.014% 100.087% ( 870, 1300 ] 74 0.013% 100.100% ( 1300, 1900 ] 50 0.009% 100.109% ( 1900, 2900 ] 40 0.007% 100.116% ( 2900, 4400 ] 38 0.007% 100.122% ( 4400, 6600 ] 10 0.002% 100.124% ( 6600, 9900 ] 6 0.001% 100.125% ** Level 2 read latency histogram (micros): Count: 47968 Average: 2.2727 StdDev: 16.09 Min: 0 Median: 1.4919 Max: 1955 Percentiles: P50: 1.49 P75: 1.86 P99: 5.65 P99.9: 10.70 P99.99: 500.32 ------------------------------------------------------ [ 0, 1 ] 7810 16.282% 16.282% ### ( 1, 2 ] 32883 68.552% 84.834% ############## ( 2, 3 ] 4602 9.594% 94.428% ## ( 3, 4 ] 1407 2.933% 97.361% # ( 4, 6 ] 956 1.993% 99.354% ( 6, 10 ] 256 0.534% 99.887% ( 10, 15 ] 43 0.090% 99.977% ( 15, 22 ] 2 0.004% 99.981% ( 110, 170 ] 1 0.002% 99.983% ( 170, 250 ] 1 0.002% 99.985% ( 250, 380 ] 1 0.002% 99.987% ( 380, 580 ] 2 0.004% 99.992% ( 870, 1300 ] 1 0.002% 99.994% ( 1300, 1900 ] 2 0.004% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 44748 Average: 8.5375 StdDev: 110.12 Min: 1 Median: 1.5109 Max: 8592 Percentiles: P50: 1.51 P75: 1.89 P99: 9.00 P99.9: 1614.55 P99.99: 4688.86 ------------------------------------------------------ [ 0, 1 ] 7220 16.135% 16.135% ### ( 1, 2 ] 29662 66.287% 82.422% ############# ( 2, 3 ] 5130 11.464% 93.886% ## ( 3, 4 ] 1130 2.525% 96.411% # ( 4, 6 ] 936 2.092% 98.503% ( 6, 10 ] 297 0.664% 99.166% ( 10, 15 ] 40 0.089% 99.256% ( 15, 22 ] 3 0.007% 99.263% ( 51, 76 ] 1 0.002% 99.265% ( 76, 110 ] 8 0.018% 99.283% ( 110, 170 ] 20 0.045% 99.327% ( 170, 250 ] 31 0.069% 99.397% ( 250, 380 ] 40 0.089% 99.486% ( 380, 580 ] 64 0.143% 99.629% ( 580, 870 ] 69 0.154% 99.783% ( 870, 1300 ] 36 0.080% 99.864% ( 1300, 1900 ] 31 0.069% 99.933% ( 1900, 2900 ] 14 0.031% 99.964% ( 2900, 4400 ] 11 0.025% 99.989% ( 4400, 6600 ] 4 0.009% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 36580 Average: 57.6689 StdDev: 305.77 Min: 0 Median: 1.9379 Max: 6880 Percentiles: P50: 1.94 P75: 3.18 P99: 1450.73 P99.9: 4055.64 P99.99: 5867.79 ------------------------------------------------------ [ 0, 1 ] 1249 3.414% 3.414% # ( 1, 2 ] 18169 49.669% 53.084% ########## ( 2, 3 ] 7358 20.115% 73.198% #### ( 3, 4 ] 3746 10.241% 83.439% ## ( 4, 6 ] 2661 7.274% 90.714% # ( 6, 10 ] 849 2.321% 93.034% ( 10, 15 ] 167 0.457% 93.491% ( 15, 22 ] 27 0.074% 93.565% ( 22, 34 ] 3 0.008% 93.573% ( 34, 51 ] 10 0.027% 93.600% ( 51, 76 ] 4 0.011% 93.611% ( 76, 110 ] 48 0.131% 93.742% ( 110, 170 ] 172 0.470% 94.213% ( 170, 250 ] 214 0.585% 94.798% ( 250, 380 ] 320 0.875% 95.672% ( 380, 580 ] 422 1.154% 96.826% ( 580, 870 ] 443 1.211% 98.037% ( 870, 1300 ] 311 0.850% 98.887% ( 1300, 1900 ] 164 0.448% 99.336% ( 1900, 2900 ] 134 0.366% 99.702% ( 2900, 4400 ] 94 0.257% 99.959% ( 4400, 6600 ] 17 0.046% 100.005% ( 6600, 9900 ] 1 0.003% 100.008% ** Level 5 read latency histogram (micros): Count: 60 Average: 1003.3167 StdDev: 1239.45 Min: 79 Median: 420.0000 Max: 5516 Percentiles: P50: 420.00 P75: 1450.00 P99: 5516.00 P99.9: 5516.00 P99.99: 5516.00 ------------------------------------------------------ ( 76, 110 ] 6 10.000% 10.000% ## ( 110, 170 ] 8 13.333% 23.333% ### ( 170, 250 ] 5 8.333% 31.667% ## ( 250, 380 ] 10 16.667% 48.333% ### ( 380, 580 ] 5 8.333% 56.667% ## ( 580, 870 ] 7 11.667% 68.333% ## ( 870, 1300 ] 3 5.000% 73.333% # ( 1300, 1900 ] 4 6.667% 80.000% # ( 1900, 2900 ] 7 11.667% 91.667% ## ( 2900, 4400 ] 3 5.000% 96.667% # ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 27.6 total, 3.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 249.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.649 H:M:S, 31.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 306.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.461 H:M:S, 14.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/20-22:43:02 ... thread 0: (1000000,8000000) ops and (98903.0,212902.1) ops/second in (10.110912,37.575950) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/7 2.33 GB 0.0 7.7 0.0 7.7 15.2 7.6 0.0 2.0 146.9 291.2 53.60 48.98 134 0.400 7993K 13K 0.0 0.0 L1 17/17 1.95 GB 0.0 6.7 5.0 1.6 6.6 5.0 0.2 1.3 220.6 218.3 30.97 29.41 4 7.742 6902K 37K 0.0 0.0 L2 7/6 901.45 MB 1.3 0.2 0.1 0.1 0.2 0.1 3.1 1.5 251.6 251.5 0.77 0.74 2 0.383 195K 78 0.0 0.0 L3 13/4 1.02 GB 0.5 0.2 0.2 0.0 0.2 0.2 2.3 1.0 223.2 223.2 0.84 0.77 1 0.838 189K 0 0.0 0.0 L4 173/0 9.59 GB 1.0 5.0 1.3 3.6 4.9 1.3 1.0 3.8 174.5 174.2 29.04 21.37 13 2.234 1436K 755 0.0 0.0 L5 1064/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1281/34 103.61 GB 0.0 19.7 6.6 13.0 27.2 14.1 8.6 3.6 174.9 241.3 115.22 101.27 154 0.748 16M 52K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.7 6.6 13.0 27.2 14.1 8.6 3.6 174.9 241.3 115.22 101.27 154 0.748 16M 52K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.7 6.6 13.0 19.6 6.6 0.0 0.0 218.8 217.8 92.09 81.41 44 2.093 16M 52K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 335.0 23.13 19.86 110 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.8 total, 37.6 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.15 GB write, 736.48 MB/s write, 19.68 GB read, 533.77 MB/s read, 115.2 seconds Interval compaction: 27.15 GB write, 739.97 MB/s write, 19.68 GB read, 536.30 MB/s read, 115.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 32, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3354275 Average: 2.6957 StdDev: 20.80 Min: 0 Median: 1.5236 Max: 5386 Percentiles: P50: 1.52 P75: 1.91 P99: 6.35 P99.9: 100.77 P99.99: 421.95 ------------------------------------------------------ [ 0, 1 ] 534651 15.939% 15.939% ### ( 1, 2 ] 2181963 65.050% 80.990% ############# ( 2, 3 ] 373308 11.129% 92.119% ## ( 3, 4 ] 131434 3.918% 96.037% # ( 4, 6 ] 96915 2.889% 98.927% # ( 6, 10 ] 28065 0.837% 99.763% ( 10, 15 ] 3351 0.100% 99.863% ( 15, 22 ] 494 0.015% 99.878% ( 22, 34 ] 62 0.002% 99.880% ( 34, 51 ] 13 0.000% 99.880% ( 51, 76 ] 31 0.001% 99.881% ( 76, 110 ] 870 0.026% 99.907% ( 110, 170 ] 1189 0.035% 99.942% ( 170, 250 ] 762 0.023% 99.965% ( 250, 380 ] 703 0.021% 99.986% ( 380, 580 ] 613 0.018% 100.004% ( 580, 870 ] 443 0.013% 100.018% ( 870, 1300 ] 204 0.006% 100.024% ( 1300, 1900 ] 66 0.002% 100.026% ( 1900, 2900 ] 45 0.001% 100.027% ( 2900, 4400 ] 16 0.000% 100.028% ( 4400, 6600 ] 5 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 752548 Average: 3.6676 StdDev: 48.51 Min: 1 Median: 1.6588 Max: 8018 Percentiles: P50: 1.66 P75: 2.27 P99: 8.33 P99.9: 88.93 P99.99: 198.37 ------------------------------------------------------ [ 0, 1 ] 74595 9.912% 9.912% ## ( 1, 2 ] 457910 60.848% 70.760% ############ ( 2, 3 ] 119754 15.913% 86.673% ### ( 3, 4 ] 46203 6.140% 92.813% # ( 4, 6 ] 40095 5.328% 98.141% # ( 6, 10 ] 11092 1.474% 99.615% ( 10, 15 ] 1697 0.226% 99.840% ( 15, 22 ] 224 0.030% 99.870% ( 22, 34 ] 22 0.003% 99.873% ( 34, 51 ] 11 0.001% 99.874% ( 51, 76 ] 38 0.005% 99.879% ( 76, 110 ] 414 0.055% 99.934% ( 110, 170 ] 353 0.047% 99.981% ( 170, 250 ] 191 0.025% 100.007% ( 250, 380 ] 189 0.025% 100.032% ( 380, 580 ] 197 0.026% 100.058% ( 580, 870 ] 129 0.017% 100.075% ( 870, 1300 ] 107 0.014% 100.089% ( 1300, 1900 ] 57 0.008% 100.097% ( 1900, 2900 ] 41 0.005% 100.102% ( 2900, 4400 ] 40 0.005% 100.108% ( 4400, 6600 ] 10 0.001% 100.109% ( 6600, 9900 ] 6 0.001% 100.110% ** Level 2 read latency histogram (micros): Count: 47968 Average: 2.2727 StdDev: 16.09 Min: 0 Median: 1.4919 Max: 1955 Percentiles: P50: 1.49 P75: 1.86 P99: 5.65 P99.9: 10.70 P99.99: 500.32 ------------------------------------------------------ [ 0, 1 ] 7810 16.282% 16.282% ### ( 1, 2 ] 32883 68.552% 84.834% ############## ( 2, 3 ] 4602 9.594% 94.428% ## ( 3, 4 ] 1407 2.933% 97.361% # ( 4, 6 ] 956 1.993% 99.354% ( 6, 10 ] 256 0.534% 99.887% ( 10, 15 ] 43 0.090% 99.977% ( 15, 22 ] 2 0.004% 99.981% ( 110, 170 ] 1 0.002% 99.983% ( 170, 250 ] 1 0.002% 99.985% ( 250, 380 ] 1 0.002% 99.987% ( 380, 580 ] 2 0.004% 99.992% ( 870, 1300 ] 1 0.002% 99.994% ( 1300, 1900 ] 2 0.004% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 45144 Average: 10.1336 StdDev: 113.93 Min: 1 Median: 1.5164 Max: 8592 Percentiles: P50: 1.52 P75: 1.90 P99: 170.62 P99.9: 1632.75 P99.99: 4667.08 ------------------------------------------------------ [ 0, 1 ] 7220 15.993% 15.993% ### ( 1, 2 ] 29727 65.849% 81.843% ############# ( 2, 3 ] 5232 11.590% 93.432% ## ( 3, 4 ] 1154 2.556% 95.988% # ( 4, 6 ] 948 2.100% 98.088% ( 6, 10 ] 305 0.676% 98.764% ( 10, 15 ] 42 0.093% 98.857% ( 15, 22 ] 3 0.007% 98.864% ( 51, 76 ] 2 0.004% 98.868% ( 76, 110 ] 16 0.035% 98.904% ( 110, 170 ] 43 0.095% 98.999% ( 170, 250 ] 72 0.159% 99.158% ( 250, 380 ] 71 0.157% 99.316% ( 380, 580 ] 103 0.228% 99.544% ( 580, 870 ] 97 0.215% 99.759% ( 870, 1300 ] 45 0.100% 99.858% ( 1300, 1900 ] 34 0.075% 99.934% ( 1900, 2900 ] 14 0.031% 99.965% ( 2900, 4400 ] 11 0.024% 99.989% ( 4400, 6600 ] 4 0.009% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 4 read latency histogram (micros): Count: 36825 Average: 59.3774 StdDev: 307.89 Min: 0 Median: 1.9430 Max: 6880 Percentiles: P50: 1.94 P75: 3.20 P99: 1473.55 P99.9: 4055.39 P99.99: 5864.62 ------------------------------------------------------ [ 0, 1 ] 1250 3.394% 3.394% # ( 1, 2 ] 18200 49.423% 52.817% ########## ( 2, 3 ] 7407 20.114% 72.931% #### ( 3, 4 ] 3764 10.221% 83.153% ## ( 4, 6 ] 2667 7.242% 90.395% # ( 6, 10 ] 849 2.305% 92.701% ( 10, 15 ] 167 0.453% 93.154% ( 15, 22 ] 28 0.076% 93.230% ( 22, 34 ] 3 0.008% 93.238% ( 34, 51 ] 10 0.027% 93.265% ( 51, 76 ] 4 0.011% 93.276% ( 76, 110 ] 55 0.149% 93.426% ( 110, 170 ] 187 0.508% 93.933% ( 170, 250 ] 227 0.616% 94.550% ( 250, 380 ] 349 0.948% 95.498% ( 380, 580 ] 456 1.238% 96.736% ( 580, 870 ] 461 1.252% 97.988% ( 870, 1300 ] 323 0.877% 98.865% ( 1300, 1900 ] 172 0.467% 99.332% ( 1900, 2900 ] 136 0.369% 99.701% ( 2900, 4400 ] 95 0.258% 99.959% ( 4400, 6600 ] 17 0.046% 100.005% ( 6600, 9900 ] 1 0.003% 100.008% ** Level 5 read latency histogram (micros): Count: 105 Average: 952.5714 StdDev: 1147.63 Min: 78 Median: 430.0000 Max: 5516 Percentiles: P50: 430.00 P75: 1291.04 P99: 5516.00 P99.9: 5516.00 P99.99: 5516.00 ------------------------------------------------------ ( 76, 110 ] 15 14.286% 14.286% ### ( 110, 170 ] 10 9.524% 23.810% ## ( 170, 250 ] 11 10.476% 34.286% ## ( 250, 380 ] 15 14.286% 48.571% ### ( 380, 580 ] 6 5.714% 54.286% # ( 580, 870 ] 10 9.524% 63.810% ## ( 870, 1300 ] 12 11.429% 75.238% ## ( 1300, 1900 ] 8 7.619% 82.857% ## ( 1900, 2900 ] 10 9.524% 92.381% ## ( 2900, 4400 ] 5 4.762% 97.143% # ( 4400, 6600 ] 3 2.857% 100.000% # ** DB Stats ** Uptime(secs): 37.8 total, 10.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 208.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.848 H:M:S, 42.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 97.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.199 H:M:S, 71.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/20-22:43:07 ... thread 0: (1000000,9000000) ops and (211217.6,212713.6) ops/second in (4.734454,42.310404) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/15 3.26 GB 37.8 7.9 0.0 7.9 16.4 8.5 0.0 1.9 140.4 290.5 57.86 52.44 148 0.391 8249K 13K 0.0 0.0 L1 17/17 1.95 GB 0.0 6.7 5.0 1.6 6.6 5.0 0.2 1.3 220.6 218.3 30.97 29.41 4 7.742 6902K 37K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.1 1.5 251.6 251.5 0.77 0.74 2 0.383 195K 78 0.0 0.0 L3 19/0 879.86 MB 0.9 1.7 1.1 0.6 1.7 1.1 2.3 1.6 207.0 205.4 8.41 7.66 6 1.402 1768K 13K 0.0 0.0 L4 173/0 9.62 GB 1.0 6.1 2.3 3.8 6.1 2.3 1.0 2.6 170.1 169.8 36.64 26.76 26 1.409 2604K 2847 0.0 0.0 L5 1076/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/32 104.52 GB 0.0 22.6 8.6 14.0 31.0 16.9 9.6 3.6 171.7 235.5 134.64 117.01 186 0.724 19M 67K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.6 8.6 14.0 31.0 16.9 9.6 3.6 171.7 235.5 134.64 117.01 186 0.724 19M 67K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.6 8.6 14.0 22.5 8.4 0.0 0.0 213.5 212.5 108.30 94.68 63 1.719 19M 67K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 330.0 26.34 22.33 123 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.5 total, 42.3 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.96 GB write, 746.15 MB/s write, 22.58 GB read, 544.16 MB/s read, 134.6 seconds Interval compaction: 30.96 GB write, 749.29 MB/s write, 22.58 GB read, 546.45 MB/s read, 134.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 42, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 32, total-stops: 42, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3739367 Average: 2.7202 StdDev: 21.73 Min: 0 Median: 1.5372 Max: 7692 Percentiles: P50: 1.54 P75: 1.92 P99: 6.60 P99.9: 93.40 P99.99: 409.59 ------------------------------------------------------ [ 0, 1 ] 568049 15.191% 15.191% ### ( 1, 2 ] 2423162 64.801% 79.992% ############# ( 2, 3 ] 432555 11.568% 91.560% ## ( 3, 4 ] 155382 4.155% 95.715% # ( 4, 6 ] 117820 3.151% 98.866% # ( 6, 10 ] 33620 0.899% 99.765% ( 10, 15 ] 3917 0.105% 99.870% ( 15, 22 ] 527 0.014% 99.884% ( 22, 34 ] 65 0.002% 99.886% ( 34, 51 ] 16 0.000% 99.886% ( 51, 76 ] 34 0.001% 99.887% ( 76, 110 ] 941 0.025% 99.912% ( 110, 170 ] 1249 0.033% 99.946% ( 170, 250 ] 800 0.021% 99.967% ( 250, 380 ] 760 0.020% 99.987% ( 380, 580 ] 656 0.018% 100.005% ( 580, 870 ] 484 0.013% 100.018% ( 870, 1300 ] 220 0.006% 100.024% ( 1300, 1900 ] 77 0.002% 100.026% ( 1900, 2900 ] 50 0.001% 100.027% ( 2900, 4400 ] 26 0.001% 100.028% ( 4400, 6600 ] 5 0.000% 100.028% ( 6600, 9900 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 1111162 Average: 3.5851 StdDev: 43.76 Min: 1 Median: 1.7039 Max: 8018 Percentiles: P50: 1.70 P75: 2.41 P99: 8.41 P99.9: 18.60 P99.99: 148.28 ------------------------------------------------------ [ 0, 1 ] 84006 7.560% 7.560% ## ( 1, 2 ] 669937 60.292% 67.852% ############ ( 2, 3 ] 192945 17.364% 85.216% ### ( 3, 4 ] 76219 6.859% 92.075% # ( 4, 6 ] 65759 5.918% 97.993% # ( 6, 10 ] 18591 1.673% 99.667% ( 10, 15 ] 2435 0.219% 99.886% ( 15, 22 ] 309 0.028% 99.914% ( 22, 34 ] 26 0.002% 99.916% ( 34, 51 ] 13 0.001% 99.917% ( 51, 76 ] 46 0.004% 99.921% ( 76, 110 ] 465 0.042% 99.963% ( 110, 170 ] 470 0.042% 100.005% ( 170, 250 ] 279 0.025% 100.030% ( 250, 380 ] 281 0.025% 100.056% ( 380, 580 ] 287 0.026% 100.082% ( 580, 870 ] 188 0.017% 100.098% ( 870, 1300 ] 133 0.012% 100.110% ( 1300, 1900 ] 65 0.006% 100.116% ( 1900, 2900 ] 45 0.004% 100.120% ( 2900, 4400 ] 49 0.004% 100.125% ( 4400, 6600 ] 12 0.001% 100.126% ( 6600, 9900 ] 7 0.001% 100.126% ** Level 2 read latency histogram (micros): Count: 47968 Average: 2.2727 StdDev: 16.09 Min: 0 Median: 1.4919 Max: 1955 Percentiles: P50: 1.49 P75: 1.86 P99: 5.65 P99.9: 10.70 P99.99: 500.32 ------------------------------------------------------ [ 0, 1 ] 7810 16.282% 16.282% ### ( 1, 2 ] 32883 68.552% 84.834% ############## ( 2, 3 ] 4602 9.594% 94.428% ## ( 3, 4 ] 1407 2.933% 97.361% # ( 4, 6 ] 956 1.993% 99.354% ( 6, 10 ] 256 0.534% 99.887% ( 10, 15 ] 43 0.090% 99.977% ( 15, 22 ] 2 0.004% 99.981% ( 110, 170 ] 1 0.002% 99.983% ( 170, 250 ] 1 0.002% 99.985% ( 250, 380 ] 1 0.002% 99.987% ( 380, 580 ] 2 0.004% 99.992% ( 870, 1300 ] 1 0.002% 99.994% ( 1300, 1900 ] 2 0.004% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 313102 Average: 4.5284 StdDev: 62.69 Min: 1 Median: 1.9033 Max: 8592 Percentiles: P50: 1.90 P75: 2.87 P99: 7.86 P99.9: 12.59 P99.99: 14.63 ------------------------------------------------------ [ 0, 1 ] 9657 3.084% 3.084% # ( 1, 2 ] 162613 51.936% 55.020% ########## ( 2, 3 ] 71879 22.957% 77.977% ##### ( 3, 4 ] 32635 10.423% 88.401% ## ( 4, 6 ] 31057 9.919% 98.320% ## ( 6, 10 ] 4589 1.466% 99.785% ( 10, 15 ] 692 0.221% 100.006% ( 15, 22 ] 65 0.021% 100.027% ( 22, 34 ] 3 0.001% 100.028% ( 34, 51 ] 3 0.001% 100.029% ( 51, 76 ] 4 0.001% 100.030% ( 76, 110 ] 20 0.006% 100.037% ( 110, 170 ] 49 0.016% 100.052% ( 170, 250 ] 89 0.028% 100.081% ( 250, 380 ] 81 0.026% 100.107% ( 380, 580 ] 114 0.036% 100.143% ( 580, 870 ] 106 0.034% 100.177% ( 870, 1300 ] 56 0.018% 100.195% ( 1300, 1900 ] 40 0.013% 100.208% ( 1900, 2900 ] 15 0.005% 100.212% ( 2900, 4400 ] 36 0.011% 100.224% ( 4400, 6600 ] 6 0.002% 100.226% ( 6600, 9900 ] 4 0.001% 100.227% ** Level 4 read latency histogram (micros): Count: 64982 Average: 46.4767 StdDev: 276.15 Min: 0 Median: 1.8744 Max: 8664 Percentiles: P50: 1.87 P75: 2.94 P99: 1202.37 P99.9: 3907.84 P99.99: 5711.69 ------------------------------------------------------ [ 0, 1 ] 2669 4.107% 4.107% # ( 1, 2 ] 34105 52.484% 56.591% ########## ( 2, 3 ] 12732 19.593% 76.184% #### ( 3, 4 ] 6035 9.287% 85.471% ## ( 4, 6 ] 4124 6.346% 91.818% # ( 6, 10 ] 1422 2.188% 94.006% ( 10, 15 ] 229 0.352% 94.358% ( 15, 22 ] 36 0.055% 94.414% ( 22, 34 ] 9 0.014% 94.428% ( 34, 51 ] 12 0.018% 94.446% ( 51, 76 ] 11 0.017% 94.463% ( 76, 110 ] 132 0.203% 94.666% ( 110, 170 ] 375 0.577% 95.243% ( 170, 250 ] 397 0.611% 95.854% ( 250, 380 ] 506 0.779% 96.633% ( 380, 580 ] 639 0.983% 97.616% ( 580, 870 ] 590 0.908% 98.524% ( 870, 1300 ] 400 0.616% 99.140% ( 1300, 1900 ] 224 0.345% 99.484% ( 1900, 2900 ] 182 0.280% 99.765% ( 2900, 4400 ] 131 0.202% 99.966% ( 4400, 6600 ] 26 0.040% 100.006% ( 6600, 9900 ] 3 0.005% 100.011% ** Level 5 read latency histogram (micros): Count: 150 Average: 1022.4867 StdDev: 1226.68 Min: 78 Median: 460.0000 Max: 5560 Percentiles: P50: 460.00 P75: 1436.36 P99: 5560.00 P99.9: 5560.00 P99.99: 5560.00 ------------------------------------------------------ ( 76, 110 ] 22 14.667% 14.667% ### ( 110, 170 ] 14 9.333% 24.000% ## ( 170, 250 ] 15 10.000% 34.000% ## ( 250, 380 ] 20 13.333% 47.333% ### ( 380, 580 ] 10 6.667% 54.000% # ( 580, 870 ] 14 9.333% 63.333% ## ( 870, 1300 ] 15 10.000% 73.333% ## ( 1300, 1900 ] 11 7.333% 80.667% # ( 1900, 2900 ] 16 10.667% 91.333% ## ( 2900, 4400 ] 8 5.333% 96.667% # ( 4400, 6600 ] 5 3.333% 100.000% # ** DB Stats ** Uptime(secs): 42.5 total, 4.7 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 208.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.667 H:M:S, 41.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 207.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.819 H:M:S, 38.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.138 micros/op 162906 ops/sec 60.096 seconds 9789999 operations; 157.8 MB/s Microseconds per write: Count: 9789999 Average: 6.1382 StdDev: 352.71 Min: 0 Median: 1.7368 Max: 721165 Percentiles: P50: 1.74 P75: 2.78 P99: 9.97 P99.9: 1164.46 P99.99: 2649.55 ------------------------------------------------------ [ 0, 1 ] 1369934 13.993% 13.993% ### ( 1, 2 ] 4784380 48.870% 62.863% ########## ( 2, 3 ] 1532241 15.651% 78.514% ### ( 3, 4 ] 1321909 13.503% 92.017% ### ( 4, 6 ] 542701 5.543% 97.560% # ( 6, 10 ] 142174 1.452% 99.013% ( 10, 15 ] 50299 0.514% 99.526% ( 15, 22 ] 10940 0.112% 99.638% ( 22, 34 ] 1868 0.019% 99.657% ( 34, 51 ] 284 0.003% 99.660% ( 51, 76 ] 34 0.000% 99.661% ( 76, 110 ] 6298 0.064% 99.725% ( 110, 170 ] 3088 0.032% 99.756% ( 170, 250 ] 326 0.003% 99.760% ( 250, 380 ] 205 0.002% 99.762% ( 380, 580 ] 32 0.000% 99.762% ( 580, 870 ] 22 0.000% 99.762% ( 870, 1300 ] 19676 0.201% 99.963% ( 1300, 1900 ] 89 0.001% 99.964% ( 1900, 2900 ] 3362 0.034% 99.999% ( 2900, 4400 ] 82 0.001% 99.999% ( 4400, 6600 ] 24 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 225274 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9789999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10103278968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 604 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32729598 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 33881000620 rocksdb.compact.write.bytes COUNT : 33619254273 rocksdb.flush.write.bytes COUNT : 10040692461 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 80 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 327 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9959672832 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3807232 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 30203582806 rocksdb.non.last.level.read.count COUNT : 7291692 rocksdb.block.checksum.compute.count COUNT : 8202638 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.391479 P95 : 3.983502 P99 : 8.791672 P100 : 721161.000000 COUNT : 9789999 SUM : 55521752 rocksdb.compaction.times.micros P50 : 1091818.181818 P95 : 8067500.000000 P99 : 18760000.000000 P100 : 19690679.000000 COUNT : 81 SUM : 150285603 rocksdb.compaction.times.cpu_micros P50 : 942258.064516 P95 : 5345000.000000 P99 : 15520000.000000 P100 : 18085305.000000 COUNT : 81 SUM : 128890624 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 705.666667 P95 : 1750.000000 P99 : 29150.000000 P100 : 73437.000000 COUNT : 135 SUM : 213160 rocksdb.compaction.outfile.sync.micros P50 : 985.257732 P95 : 112142.857143 P99 : 203600.000000 P100 : 329939.000000 COUNT : 390 SUM : 6780239 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 101.500000 P95 : 571.250000 P99 : 1829.500000 P100 : 2518.000000 COUNT : 247 SUM : 46985 rocksdb.table.open.io.micros P50 : 1555.652174 P95 : 6428.292683 P99 : 9366.720000 P100 : 13552.000000 COUNT : 604 SUM : 1254915 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.692109 P95 : 7.920382 P99 : 11.127347 P100 : 12133.000000 COUNT : 8201073 SUM : 49381174 rocksdb.read.block.get.micros P50 : 520.571429 P95 : 3130.357143 P99 : 4555.692308 P100 : 5938.000000 COUNT : 1208 SUM : 1040066 rocksdb.write.raw.block.micros P50 : 0.512831 P95 : 0.974379 P99 : 2.880995 P100 : 19462.000000 COUNT : 10577611 SUM : 19993009 rocksdb.numfiles.in.singlecompaction P50 : 3.228814 P95 : 9.100000 P99 : 26.000000 P100 : 26.000000 COUNT : 129 SUM : 534 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562059 P95 : 1146.271614 P99 : 2300.605697 P100 : 720968.000000 COUNT : 210998 SUM : 32751473 rocksdb.sst.read.micros P50 : 1.596044 P95 : 4.665633 P99 : 8.377324 P100 : 9161.000000 COUNT : 7292232 SUM : 28342018 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9789999 SUM : 10103278968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213298.969072 P95 : 350595.238095 P99 : 503500.000000 P100 : 893886.000000 COUNT : 135 SUM : 28821477 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 364 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0