[2024-07-27 02:11:52.287718] Starting SPDK v24.09-pre git sha1 cac68eec0 / DPDK 24.07.0-rc3 initialization... [2024-07-27 02:11:52.287978] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3536715 ] Set seed to 1722039112281296 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-27 02:11:52.357714] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.07.0-rc3 is used. There is no support for it in SPDK. Enabled only for validation. [2024-07-27 02:11:52.393456] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-27 02:11:52.430988] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-27 02:11:52.431034] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3536715' to capture a snapshot of events at runtime. [2024-07-27 02:11:52.431048] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-27 02:11:52.431072] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-27 02:11:52.431083] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3536715 for offline analysis/debug. [2024-07-27 02:11:52.431162] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Jul 27 02:11:56 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/27-02:11:59 ... thread 0: (1000000,1000000) ops and (338051.2,338051.2) ops/second in (2.958132,2.958132) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 567.01 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 352.7 2.50 2.24 12 0.208 0 0 0.0 0.0 L1 3/3 251.73 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 257.4 257.2 0.98 0.94 1 0.979 255K 216 0.0 0.0 L2 1/0 48.71 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 243.4 243.3 0.46 0.44 1 0.457 113K 38 0.0 0.0 L3 16/0 692.49 MB 0.7 0.1 0.1 0.0 0.1 0.1 0.0 1.0 188.0 188.0 0.33 0.26 1 0.333 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 99.7 306.2 4.27 3.88 15 0.285 432K 254 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 99.7 306.2 4.27 3.88 15 0.285 432K 254 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 240.7 240.6 1.77 1.64 3 0.590 432K 254 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 352.7 2.50 2.24 12 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 411.94 MB/s write, 0.42 GB read, 134.15 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 441.81 MB/s write, 0.42 GB read, 143.88 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 105062 Average: 1.8129 StdDev: 20.73 Min: 0 Median: 1.1342 Max: 3805 Percentiles: P50: 1.13 P75: 1.60 P99: 3.34 P99.9: 8.93 P99.99: 314.84 ------------------------------------------------------ [ 0, 1 ] 44905 42.741% 42.741% ######### ( 1, 2 ] 56839 54.100% 96.842% ########### ( 2, 3 ] 2023 1.926% 98.767% ( 3, 4 ] 713 0.679% 99.446% ( 4, 6 ] 351 0.334% 99.780% ( 6, 10 ] 173 0.165% 99.945% ( 10, 15 ] 27 0.026% 99.970% ( 15, 22 ] 3 0.003% 99.973% ( 22, 34 ] 3 0.003% 99.976% ( 34, 51 ] 1 0.001% 99.977% ( 51, 76 ] 1 0.001% 99.978% ( 110, 170 ] 9 0.009% 99.987% ( 170, 250 ] 2 0.002% 99.989% ( 250, 380 ] 5 0.005% 99.993% ( 380, 580 ] 1 0.001% 99.994% ( 580, 870 ] 1 0.001% 99.995% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 2900, 4400 ] 3 0.003% 100.001% ** Level 1 read latency histogram (micros): Count: 32238 Average: 2.1204 StdDev: 19.70 Min: 1 Median: 1.1659 Max: 2773 Percentiles: P50: 1.17 P75: 1.63 P99: 5.08 P99.9: 86.31 P99.99: 751.70 ------------------------------------------------------ [ 0, 1 ] 13248 41.094% 41.094% ######## ( 1, 2 ] 17307 53.685% 94.779% ########### ( 2, 3 ] 1005 3.117% 97.897% # ( 3, 4 ] 248 0.769% 98.666% ( 4, 6 ] 200 0.620% 99.287% ( 6, 10 ] 131 0.406% 99.693% ( 10, 15 ] 15 0.047% 99.739% ( 15, 22 ] 11 0.034% 99.774% ( 51, 76 ] 35 0.109% 99.882% ( 76, 110 ] 19 0.059% 99.941% ( 110, 170 ] 4 0.012% 99.953% ( 170, 250 ] 3 0.009% 99.963% ( 250, 380 ] 5 0.016% 99.978% ( 380, 580 ] 2 0.006% 99.984% ( 580, 870 ] 3 0.009% 99.994% ( 870, 1300 ] 1 0.003% 99.997% ( 1900, 2900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 15888 Average: 1.7953 StdDev: 3.46 Min: 1 Median: 1.1991 Max: 262 Percentiles: P50: 1.20 P75: 1.66 P99: 5.06 P99.9: 11.97 P99.99: 226.45 ------------------------------------------------------ [ 0, 1 ] 6238 39.262% 39.262% ######## ( 1, 2 ] 8567 53.921% 93.184% ########### ( 2, 3 ] 612 3.852% 97.035% # ( 3, 4 ] 228 1.435% 98.471% ( 4, 6 ] 158 0.994% 99.465% ( 6, 10 ] 64 0.403% 99.868% ( 10, 15 ] 13 0.082% 99.950% ( 15, 22 ] 2 0.013% 99.962% ( 22, 34 ] 2 0.013% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 665.8625 StdDev: 1044.46 Min: 1 Median: 170.0000 Max: 3929 Percentiles: P50: 170.00 P75: 1013.33 P99: 3929.00 P99.9: 3929.00 P99.99: 3929.00 ------------------------------------------------------ [ 0, 1 ] 24 30.000% 30.000% ###### ( 1, 2 ] 11 13.750% 43.750% ### ( 4, 6 ] 2 2.500% 46.250% # ( 51, 76 ] 1 1.250% 47.500% ( 76, 110 ] 1 1.250% 48.750% ( 110, 170 ] 1 1.250% 50.000% ( 170, 250 ] 6 7.500% 57.500% ## ( 250, 380 ] 8 10.000% 67.500% ## ( 380, 580 ] 5 6.250% 73.750% # ( 870, 1300 ] 3 3.750% 77.500% # ( 1300, 1900 ] 7 8.750% 86.250% ## ( 1900, 2900 ] 5 6.250% 92.500% # ( 2900, 4400 ] 6 7.500% 100.000% ## ** Level 4 read latency histogram (micros): Count: 35 Average: 1537.2857 StdDev: 991.43 Min: 168 Median: 1278.5000 Max: 4145 Percentiles: P50: 1278.50 P75: 1850.00 P99: 4145.00 P99.9: 4145.00 P99.99: 4145.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 1 2.857% 5.714% # ( 250, 380 ] 1 2.857% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 4 11.429% 22.857% ## ( 870, 1300 ] 10 28.571% 51.429% ###### ( 1300, 1900 ] 9 25.714% 77.143% ##### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 310.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.404 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 332.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.404 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/27-02:12:02 ... thread 0: (1000000,2000000) ops and (327794.5,332843.8) ops/second in (3.050692,6.008824) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/4 1.23 GB 100.7 0.9 0.0 0.9 2.7 1.8 0.0 1.5 101.4 318.7 8.69 8.03 29 0.300 895K 1006 0.0 0.0 L1 2/0 50.37 MB 5.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.7 246.3 3.32 3.22 2 1.659 831K 1468 0.0 0.0 L2 5/4 563.77 MB 1.3 0.1 0.1 0.0 0.1 0.1 0.6 1.8 243.4 243.3 0.46 0.44 1 0.457 113K 38 0.0 0.0 L3 16/9 692.49 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 188.0 188.0 0.33 0.26 1 0.333 63K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1191/17 97.98 GB 0.0 1.8 0.6 1.2 3.7 2.5 0.7 2.0 146.4 293.8 12.80 11.95 33 0.388 1903K 2512 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.6 1.2 3.7 2.5 0.6 2.0 146.4 293.8 12.80 11.95 33 0.388 1903K 2512 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.6 1.2 1.8 0.6 0.0 0.0 252.2 251.8 7.43 7.17 7 1.062 1903K 2512 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 352.0 5.37 4.78 26 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.67 GB write, 604.33 MB/s write, 1.83 GB read, 301.14 MB/s read, 12.8 seconds Interval compaction: 3.67 GB write, 625.90 MB/s write, 1.83 GB read, 311.89 MB/s read, 12.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 410275 Average: 2.1317 StdDev: 12.49 Min: 0 Median: 1.4473 Max: 3805 Percentiles: P50: 1.45 P75: 1.84 P99: 5.48 P99.9: 9.54 P99.99: 13.77 ------------------------------------------------------ [ 0, 1 ] 89301 21.766% 21.766% #### ( 1, 2 ] 258985 63.125% 84.891% ############# ( 2, 3 ] 37186 9.064% 93.955% ## ( 3, 4 ] 14299 3.485% 97.440% # ( 4, 6 ] 8651 2.109% 99.548% ( 6, 10 ] 1631 0.398% 99.946% ( 10, 15 ] 240 0.058% 100.004% ( 15, 22 ] 32 0.008% 100.012% ( 22, 34 ] 8 0.002% 100.014% ( 34, 51 ] 3 0.001% 100.015% ( 51, 76 ] 2 0.000% 100.015% ( 110, 170 ] 18 0.004% 100.020% ( 170, 250 ] 5 0.001% 100.021% ( 250, 380 ] 11 0.003% 100.024% ( 380, 580 ] 5 0.001% 100.025% ( 580, 870 ] 8 0.002% 100.027% ( 870, 1300 ] 4 0.001% 100.028% ( 1300, 1900 ] 2 0.000% 100.028% ( 1900, 2900 ] 2 0.000% 100.029% ( 2900, 4400 ] 3 0.001% 100.029% ** Level 1 read latency histogram (micros): Count: 130357 Average: 2.3384 StdDev: 11.66 Min: 1 Median: 1.5304 Max: 2773 Percentiles: P50: 1.53 P75: 1.93 P99: 5.83 P99.9: 14.02 P99.99: 418.57 ------------------------------------------------------ [ 0, 1 ] 21743 16.680% 16.680% ### ( 1, 2 ] 81899 62.827% 79.506% ############# ( 2, 3 ] 16555 12.700% 92.206% ### ( 3, 4 ] 5137 3.941% 96.147% # ( 4, 6 ] 4069 3.121% 99.268% # ( 6, 10 ] 721 0.553% 99.821% ( 10, 15 ] 129 0.099% 99.920% ( 15, 22 ] 21 0.016% 99.936% ( 22, 34 ] 1 0.001% 99.937% ( 51, 76 ] 35 0.027% 99.964% ( 76, 110 ] 19 0.015% 99.979% ( 110, 170 ] 5 0.004% 99.982% ( 170, 250 ] 3 0.002% 99.985% ( 250, 380 ] 7 0.005% 99.990% ( 380, 580 ] 5 0.004% 99.994% ( 580, 870 ] 4 0.003% 99.997% ( 870, 1300 ] 4 0.003% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 15935 Average: 1.8012 StdDev: 3.48 Min: 1 Median: 1.2014 Max: 262 Percentiles: P50: 1.20 P75: 1.67 P99: 5.08 P99.9: 12.33 P99.99: 226.26 ------------------------------------------------------ [ 0, 1 ] 6238 39.147% 39.147% ######## ( 1, 2 ] 8589 53.900% 93.047% ########### ( 2, 3 ] 628 3.941% 96.988% # ( 3, 4 ] 234 1.468% 98.456% ( 4, 6 ] 160 1.004% 99.460% ( 6, 10 ] 64 0.402% 99.862% ( 10, 15 ] 13 0.082% 99.944% ( 15, 22 ] 2 0.013% 99.956% ( 22, 34 ] 2 0.013% 99.969% ( 51, 76 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 76856 Average: 4.1272 StdDev: 43.67 Min: 1 Median: 1.7290 Max: 3929 Percentiles: P50: 1.73 P75: 2.47 P99: 9.70 P99.9: 347.89 P99.99: 1848.58 ------------------------------------------------------ [ 0, 1 ] 5374 6.992% 6.992% # ( 1, 2 ] 45343 58.997% 65.990% ############ ( 2, 3 ] 14689 19.112% 85.102% #### ( 3, 4 ] 4900 6.376% 91.478% # ( 4, 6 ] 4338 5.644% 97.122% # ( 6, 10 ] 1562 2.032% 99.154% ( 10, 15 ] 269 0.350% 99.504% ( 15, 22 ] 52 0.068% 99.572% ( 22, 34 ] 13 0.017% 99.589% ( 34, 51 ] 2 0.003% 99.591% ( 51, 76 ] 1 0.001% 99.593% ( 76, 110 ] 34 0.044% 99.637% ( 110, 170 ] 112 0.146% 99.783% ( 170, 250 ] 54 0.070% 99.853% ( 250, 380 ] 48 0.062% 99.915% ( 380, 580 ] 33 0.043% 99.958% ( 580, 870 ] 12 0.016% 99.974% ( 870, 1300 ] 5 0.007% 99.980% ( 1300, 1900 ] 8 0.010% 99.991% ( 1900, 2900 ] 5 0.007% 99.997% ( 2900, 4400 ] 6 0.008% 100.005% ** Level 4 read latency histogram (micros): Count: 35 Average: 1537.2857 StdDev: 991.43 Min: 168 Median: 1278.5000 Max: 4145 Percentiles: P50: 1278.50 P75: 1850.00 P99: 4145.00 P99.9: 4145.00 P99.99: 4145.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 1 2.857% 5.714% # ( 250, 380 ] 1 2.857% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 4 11.429% 22.857% ## ( 870, 1300 ] 10 28.571% 51.429% ###### ( 1300, 1900 ] 9 25.714% 77.143% ##### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 316.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.820 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.416 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/27-02:12:05 ... thread 0: (1000000,3000000) ops and (354612.8,339797.0) ops/second in (2.819977,8.828801) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.09 GB 44.1 1.4 0.0 1.4 4.1 2.7 0.0 1.5 105.6 316.7 13.12 12.11 44 0.298 1407K 1481 0.0 0.0 L1 2/2 50.37 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.7 246.3 3.32 3.22 2 1.659 831K 1468 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 243.4 243.3 0.46 0.44 1 0.457 113K 38 0.0 0.0 L3 35/0 983.40 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 211.4 211.2 6.28 5.55 4 1.571 1335K 673 0.0 0.0 L4 140/0 9.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1240/14 98.84 GB 0.0 3.6 1.2 2.4 6.3 3.9 1.2 2.3 157.2 276.6 23.18 21.32 51 0.455 3686K 3660 0.0 0.0 Int 0/0 0.00 KB 0.0 3.6 1.2 2.4 6.3 3.9 1.2 2.3 157.2 276.6 23.18 21.32 51 0.455 3686K 3660 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.6 1.2 2.4 3.6 1.2 0.0 0.0 237.7 237.4 15.33 14.35 12 1.278 3686K 3660 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 353.1 7.85 6.97 39 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.26 GB write, 708.90 MB/s write, 3.56 GB read, 402.87 MB/s read, 23.2 seconds Interval compaction: 6.26 GB write, 726.12 MB/s write, 3.56 GB read, 412.66 MB/s read, 23.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 667290 Average: 2.2158 StdDev: 11.14 Min: 0 Median: 1.4932 Max: 3805 Percentiles: P50: 1.49 P75: 1.88 P99: 5.62 P99.9: 9.99 P99.99: 14.91 ------------------------------------------------------ [ 0, 1 ] 121842 18.259% 18.259% #### ( 1, 2 ] 429418 64.353% 82.612% ############# ( 2, 3 ] 70590 10.579% 93.190% ## ( 3, 4 ] 25684 3.849% 97.039% # ( 4, 6 ] 16176 2.424% 99.464% ( 6, 10 ] 2922 0.438% 99.901% ( 10, 15 ] 605 0.091% 99.992% ( 15, 22 ] 49 0.007% 99.999% ( 22, 34 ] 8 0.001% 100.001% ( 34, 51 ] 8 0.001% 100.002% ( 51, 76 ] 4 0.001% 100.002% ( 76, 110 ] 24 0.004% 100.006% ( 110, 170 ] 57 0.009% 100.015% ( 170, 250 ] 20 0.003% 100.018% ( 250, 380 ] 22 0.003% 100.021% ( 380, 580 ] 14 0.002% 100.023% ( 580, 870 ] 12 0.002% 100.025% ( 870, 1300 ] 11 0.002% 100.026% ( 1300, 1900 ] 4 0.001% 100.027% ( 1900, 2900 ] 2 0.000% 100.027% ( 2900, 4400 ] 3 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 206993 Average: 2.3897 StdDev: 9.28 Min: 1 Median: 1.5926 Max: 2773 Percentiles: P50: 1.59 P75: 1.98 P99: 5.90 P99.9: 13.19 P99.99: 255.58 ------------------------------------------------------ [ 0, 1 ] 25181 12.165% 12.165% ## ( 1, 2 ] 132158 63.847% 76.012% ############# ( 2, 3 ] 30519 14.744% 90.756% ### ( 3, 4 ] 9625 4.650% 95.406% # ( 4, 6 ] 7824 3.780% 99.185% # ( 6, 10 ] 1310 0.633% 99.818% ( 10, 15 ] 265 0.128% 99.946% ( 15, 22 ] 24 0.012% 99.958% ( 22, 34 ] 1 0.000% 99.958% ( 34, 51 ] 1 0.000% 99.959% ( 51, 76 ] 37 0.018% 99.977% ( 76, 110 ] 19 0.009% 99.986% ( 110, 170 ] 5 0.002% 99.988% ( 170, 250 ] 3 0.001% 99.990% ( 250, 380 ] 7 0.003% 99.993% ( 380, 580 ] 5 0.002% 99.996% ( 580, 870 ] 4 0.002% 99.998% ( 870, 1300 ] 4 0.002% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.1306 StdDev: 3.80 Min: 1 Median: 1.4345 Max: 339 Percentiles: P50: 1.43 P75: 1.86 P99: 5.78 P99.9: 12.28 P99.99: 257.55 ------------------------------------------------------ [ 0, 1 ] 6964 24.644% 24.644% ##### ( 1, 2 ] 16490 58.355% 83.000% ############ ( 2, 3 ] 2477 8.766% 91.765% ## ( 3, 4 ] 1217 4.307% 96.072% # ( 4, 6 ] 929 3.288% 99.359% # ( 6, 10 ] 140 0.495% 99.855% ( 10, 15 ] 28 0.099% 99.954% ( 15, 22 ] 3 0.011% 99.965% ( 22, 34 ] 2 0.007% 99.972% ( 51, 76 ] 1 0.004% 99.975% ( 110, 170 ] 2 0.007% 99.982% ( 170, 250 ] 2 0.007% 99.989% ( 250, 380 ] 3 0.011% 100.000% ** Level 3 read latency histogram (micros): Count: 178556 Average: 3.5960 StdDev: 32.13 Min: 1 Median: 1.6679 Max: 3929 Percentiles: P50: 1.67 P75: 2.27 P99: 9.36 P99.9: 267.92 P99.99: 988.81 ------------------------------------------------------ [ 0, 1 ] 15385 8.616% 8.616% ## ( 1, 2 ] 110642 61.965% 70.581% ############ ( 2, 3 ] 29640 16.600% 87.181% ### ( 3, 4 ] 10021 5.612% 92.793% # ( 4, 6 ] 8336 4.669% 97.462% # ( 6, 10 ] 3267 1.830% 99.292% ( 10, 15 ] 485 0.272% 99.563% ( 15, 22 ] 87 0.049% 99.612% ( 22, 34 ] 17 0.010% 99.621% ( 34, 51 ] 11 0.006% 99.628% ( 51, 76 ] 45 0.025% 99.653% ( 76, 110 ] 111 0.062% 99.715% ( 110, 170 ] 205 0.115% 99.830% ( 170, 250 ] 114 0.064% 99.894% ( 250, 380 ] 83 0.046% 99.940% ( 380, 580 ] 59 0.033% 99.973% ( 580, 870 ] 26 0.015% 99.988% ( 870, 1300 ] 15 0.008% 99.996% ( 1300, 1900 ] 9 0.005% 100.001% ( 1900, 2900 ] 6 0.003% 100.004% ( 2900, 4400 ] 6 0.003% 100.008% ** Level 4 read latency histogram (micros): Count: 35 Average: 1537.2857 StdDev: 991.43 Min: 168 Median: 1278.5000 Max: 4145 Percentiles: P50: 1278.50 P75: 1850.00 P99: 4145.00 P99.9: 4145.00 P99.99: 4145.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 1 2.857% 5.714% # ( 250, 380 ] 1 2.857% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 4 11.429% 22.857% ## ( 870, 1300 ] 10 28.571% 51.429% ###### ( 1300, 1900 ] 9 25.714% 77.143% ##### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 631.8500 StdDev: 771.22 Min: 124 Median: 170.0000 Max: 2886 Percentiles: P50: 170.00 P75: 870.00 P99: 2833.33 P99.9: 2886.00 P99.99: 2886.00 ------------------------------------------------------ ( 110, 170 ] 10 50.000% 50.000% ########## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.0 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.028 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 349.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.208 H:M:S, 7.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/27-02:12:09 ... thread 0: (1000000,4000000) ops and (274570.5,320747.9) ops/second in (3.642052,12.470853) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/12 3.20 GB 157.3 2.5 0.0 2.5 6.3 3.8 0.0 1.6 122.6 312.4 20.56 19.12 64 0.321 2558K 2683 0.0 0.0 L1 2/2 50.37 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 246.7 246.3 3.32 3.22 2 1.659 831K 1468 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 243.4 243.3 0.46 0.44 1 0.457 113K 38 0.0 0.0 L3 35/0 983.40 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 211.4 211.2 6.28 5.55 4 1.571 1335K 673 0.0 0.0 L4 140/0 9.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/14 99.95 GB 0.0 4.7 1.2 3.5 8.5 5.0 1.2 2.2 156.1 283.5 30.62 28.33 71 0.431 4838K 4862 0.0 0.0 Int 0/0 0.00 KB 0.0 4.7 1.2 3.5 8.5 5.0 1.2 2.2 156.1 283.5 30.62 28.33 71 0.431 4838K 4862 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.7 1.2 3.5 4.7 1.2 0.0 0.0 244.2 243.9 19.57 18.50 16 1.223 4838K 4862 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 353.5 11.05 9.84 55 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.7 total, 12.5 interval Flush(GB): cumulative 3.814, interval 3.814 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.48 GB write, 684.05 MB/s write, 4.67 GB read, 376.60 MB/s read, 30.6 seconds Interval compaction: 8.48 GB write, 695.82 MB/s write, 4.67 GB read, 383.08 MB/s read, 30.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 15, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1170794 Average: 2.2676 StdDev: 10.89 Min: 0 Median: 1.5068 Max: 3805 Percentiles: P50: 1.51 P75: 1.88 P99: 5.69 P99.9: 10.50 P99.99: 19.19 ------------------------------------------------------ [ 0, 1 ] 193100 16.493% 16.493% ### ( 1, 2 ] 774117 66.119% 82.612% ############# ( 2, 3 ] 126018 10.763% 93.376% ## ( 3, 4 ] 43769 3.738% 97.114% # ( 4, 6 ] 26068 2.227% 99.340% ( 6, 10 ] 6441 0.550% 99.891% ( 10, 15 ] 1114 0.095% 99.986% ( 15, 22 ] 85 0.007% 99.993% ( 22, 34 ] 12 0.001% 99.994% ( 34, 51 ] 9 0.001% 99.995% ( 51, 76 ] 8 0.001% 99.995% ( 76, 110 ] 100 0.009% 100.004% ( 110, 170 ] 163 0.014% 100.018% ( 170, 250 ] 62 0.005% 100.023% ( 250, 380 ] 60 0.005% 100.028% ( 380, 580 ] 45 0.004% 100.032% ( 580, 870 ] 42 0.004% 100.036% ( 870, 1300 ] 16 0.001% 100.037% ( 1300, 1900 ] 8 0.001% 100.038% ( 1900, 2900 ] 2 0.000% 100.038% ( 2900, 4400 ] 4 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 209106 Average: 2.4624 StdDev: 10.70 Min: 1 Median: 1.5926 Max: 2773 Percentiles: P50: 1.59 P75: 1.98 P99: 5.92 P99.9: 14.35 P99.99: 466.99 ------------------------------------------------------ [ 0, 1 ] 25436 12.164% 12.164% ## ( 1, 2 ] 133509 63.848% 76.012% ############# ( 2, 3 ] 30812 14.735% 90.747% ### ( 3, 4 ] 9702 4.640% 95.387% # ( 4, 6 ] 7870 3.764% 99.150% # ( 6, 10 ] 1335 0.638% 99.789% ( 10, 15 ] 268 0.128% 99.917% ( 15, 22 ] 24 0.011% 99.928% ( 22, 34 ] 1 0.000% 99.929% ( 34, 51 ] 1 0.000% 99.929% ( 51, 76 ] 37 0.018% 99.947% ( 76, 110 ] 31 0.015% 99.962% ( 110, 170 ] 25 0.012% 99.974% ( 170, 250 ] 15 0.007% 99.981% ( 250, 380 ] 13 0.006% 99.987% ( 380, 580 ] 14 0.007% 99.994% ( 580, 870 ] 7 0.003% 99.997% ( 870, 1300 ] 5 0.002% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.1306 StdDev: 3.80 Min: 1 Median: 1.4345 Max: 339 Percentiles: P50: 1.43 P75: 1.86 P99: 5.78 P99.9: 12.28 P99.99: 257.55 ------------------------------------------------------ [ 0, 1 ] 6964 24.644% 24.644% ##### ( 1, 2 ] 16490 58.355% 83.000% ############ ( 2, 3 ] 2477 8.766% 91.765% ## ( 3, 4 ] 1217 4.307% 96.072% # ( 4, 6 ] 929 3.288% 99.359% # ( 6, 10 ] 140 0.495% 99.855% ( 10, 15 ] 28 0.099% 99.954% ( 15, 22 ] 3 0.011% 99.965% ( 22, 34 ] 2 0.007% 99.972% ( 51, 76 ] 1 0.004% 99.975% ( 110, 170 ] 2 0.007% 99.982% ( 170, 250 ] 2 0.007% 99.989% ( 250, 380 ] 3 0.011% 100.000% ** Level 3 read latency histogram (micros): Count: 178556 Average: 3.5960 StdDev: 32.13 Min: 1 Median: 1.6679 Max: 3929 Percentiles: P50: 1.67 P75: 2.27 P99: 9.36 P99.9: 267.92 P99.99: 988.81 ------------------------------------------------------ [ 0, 1 ] 15385 8.616% 8.616% ## ( 1, 2 ] 110642 61.965% 70.581% ############ ( 2, 3 ] 29640 16.600% 87.181% ### ( 3, 4 ] 10021 5.612% 92.793% # ( 4, 6 ] 8336 4.669% 97.462% # ( 6, 10 ] 3267 1.830% 99.292% ( 10, 15 ] 485 0.272% 99.563% ( 15, 22 ] 87 0.049% 99.612% ( 22, 34 ] 17 0.010% 99.621% ( 34, 51 ] 11 0.006% 99.628% ( 51, 76 ] 45 0.025% 99.653% ( 76, 110 ] 111 0.062% 99.715% ( 110, 170 ] 205 0.115% 99.830% ( 170, 250 ] 114 0.064% 99.894% ( 250, 380 ] 83 0.046% 99.940% ( 380, 580 ] 59 0.033% 99.973% ( 580, 870 ] 26 0.015% 99.988% ( 870, 1300 ] 15 0.008% 99.996% ( 1300, 1900 ] 9 0.005% 100.001% ( 1900, 2900 ] 6 0.003% 100.004% ( 2900, 4400 ] 6 0.003% 100.008% ** Level 4 read latency histogram (micros): Count: 35 Average: 1537.2857 StdDev: 991.43 Min: 168 Median: 1278.5000 Max: 4145 Percentiles: P50: 1278.50 P75: 1850.00 P99: 4145.00 P99.9: 4145.00 P99.99: 4145.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 1 2.857% 5.714% # ( 250, 380 ] 1 2.857% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 4 11.429% 22.857% ## ( 870, 1300 ] 10 28.571% 51.429% ###### ( 1300, 1900 ] 9 25.714% 77.143% ##### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 631.8500 StdDev: 771.22 Min: 124 Median: 170.0000 Max: 2886 Percentiles: P50: 170.00 P75: 870.00 P99: 2833.33 P99.9: 2886.00 P99.99: 2886.00 ------------------------------------------------------ ( 110, 170 ] 10 50.000% 50.000% ########## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 12.7 total, 3.6 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 310.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.032 H:M:S, 16.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 270.23 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.004 H:M:S, 27.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/07/27-02:12:12 ... thread 0: (1000000,5000000) ops and (338734.6,324190.8) ops/second in (2.952164,15.423017) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 2.64 GB 50.4 3.0 0.0 3.0 7.6 4.7 0.0 1.6 121.4 313.6 24.90 23.15 79 0.315 3070K 3205 0.0 0.0 L1 15/15 1.45 GB 0.0 2.3 1.9 0.4 2.3 1.9 0.1 1.2 234.8 233.6 9.87 9.50 3 3.289 2352K 11K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 243.4 243.3 0.46 0.44 1 0.457 113K 38 0.0 0.0 L3 35/0 983.40 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 211.4 211.2 6.28 5.55 4 1.571 1335K 673 0.0 0.0 L4 140/0 9.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/29 100.80 GB 0.0 6.6 2.6 4.0 11.3 7.2 1.2 2.4 163.3 278.3 41.51 38.64 87 0.477 6870K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.6 2.6 4.0 11.3 7.2 1.2 2.4 163.3 278.3 41.51 38.64 87 0.477 6870K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.6 2.6 4.0 6.6 2.6 0.0 0.0 242.4 241.9 27.96 26.59 19 1.472 6870K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.5 13.54 12.05 68 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.28 GB write, 738.67 MB/s write, 6.62 GB read, 433.52 MB/s read, 41.5 seconds Interval compaction: 11.28 GB write, 748.94 MB/s write, 6.62 GB read, 439.55 MB/s read, 41.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 17, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1397870 Average: 2.2630 StdDev: 11.25 Min: 0 Median: 1.4974 Max: 3805 Percentiles: P50: 1.50 P75: 1.87 P99: 5.65 P99.9: 10.87 P99.99: 84.17 ------------------------------------------------------ [ 0, 1 ] 236479 16.917% 16.917% ### ( 1, 2 ] 929775 66.514% 83.431% ############# ( 2, 3 ] 144454 10.334% 93.765% ## ( 3, 4 ] 49472 3.539% 97.304% # ( 4, 6 ] 28657 2.050% 99.354% ( 6, 10 ] 7408 0.530% 99.884% ( 10, 15 ] 1318 0.094% 99.978% ( 15, 22 ] 101 0.007% 99.985% ( 22, 34 ] 12 0.001% 99.986% ( 34, 51 ] 15 0.001% 99.987% ( 51, 76 ] 9 0.001% 99.988% ( 76, 110 ] 134 0.010% 99.997% ( 110, 170 ] 206 0.015% 100.012% ( 170, 250 ] 86 0.006% 100.018% ( 250, 380 ] 78 0.006% 100.024% ( 380, 580 ] 62 0.004% 100.028% ( 580, 870 ] 51 0.004% 100.032% ( 870, 1300 ] 21 0.002% 100.033% ( 1300, 1900 ] 14 0.001% 100.034% ( 1900, 2900 ] 3 0.000% 100.035% ( 2900, 4400 ] 4 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 275973 Average: 2.5013 StdDev: 12.72 Min: 0 Median: 1.5517 Max: 2773 Percentiles: P50: 1.55 P75: 1.94 P99: 6.24 P99.9: 78.90 P99.99: 588.34 ------------------------------------------------------ [ 0, 1 ] 40140 14.545% 14.545% ### ( 1, 2 ] 177356 64.266% 78.811% ############# ( 2, 3 ] 35608 12.903% 91.713% ### ( 3, 4 ] 11182 4.052% 95.765% # ( 4, 6 ] 8792 3.186% 98.951% # ( 6, 10 ] 2231 0.808% 99.759% ( 10, 15 ] 304 0.110% 99.870% ( 15, 22 ] 32 0.012% 99.881% ( 22, 34 ] 3 0.001% 99.882% ( 34, 51 ] 2 0.001% 99.883% ( 51, 76 ] 39 0.014% 99.897% ( 76, 110 ] 94 0.034% 99.931% ( 110, 170 ] 80 0.029% 99.960% ( 170, 250 ] 28 0.010% 99.970% ( 250, 380 ] 30 0.011% 99.981% ( 380, 580 ] 24 0.009% 99.990% ( 580, 870 ] 14 0.005% 99.995% ( 870, 1300 ] 10 0.004% 99.999% ( 1300, 1900 ] 3 0.001% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.1306 StdDev: 3.80 Min: 1 Median: 1.4345 Max: 339 Percentiles: P50: 1.43 P75: 1.86 P99: 5.78 P99.9: 12.28 P99.99: 257.55 ------------------------------------------------------ [ 0, 1 ] 6964 24.644% 24.644% ##### ( 1, 2 ] 16490 58.355% 83.000% ############ ( 2, 3 ] 2477 8.766% 91.765% ## ( 3, 4 ] 1217 4.307% 96.072% # ( 4, 6 ] 929 3.288% 99.359% # ( 6, 10 ] 140 0.495% 99.855% ( 10, 15 ] 28 0.099% 99.954% ( 15, 22 ] 3 0.011% 99.965% ( 22, 34 ] 2 0.007% 99.972% ( 51, 76 ] 1 0.004% 99.975% ( 110, 170 ] 2 0.007% 99.982% ( 170, 250 ] 2 0.007% 99.989% ( 250, 380 ] 3 0.011% 100.000% ** Level 3 read latency histogram (micros): Count: 178556 Average: 3.5960 StdDev: 32.13 Min: 1 Median: 1.6679 Max: 3929 Percentiles: P50: 1.67 P75: 2.27 P99: 9.36 P99.9: 267.92 P99.99: 988.81 ------------------------------------------------------ [ 0, 1 ] 15385 8.616% 8.616% ## ( 1, 2 ] 110642 61.965% 70.581% ############ ( 2, 3 ] 29640 16.600% 87.181% ### ( 3, 4 ] 10021 5.612% 92.793% # ( 4, 6 ] 8336 4.669% 97.462% # ( 6, 10 ] 3267 1.830% 99.292% ( 10, 15 ] 485 0.272% 99.563% ( 15, 22 ] 87 0.049% 99.612% ( 22, 34 ] 17 0.010% 99.621% ( 34, 51 ] 11 0.006% 99.628% ( 51, 76 ] 45 0.025% 99.653% ( 76, 110 ] 111 0.062% 99.715% ( 110, 170 ] 205 0.115% 99.830% ( 170, 250 ] 114 0.064% 99.894% ( 250, 380 ] 83 0.046% 99.940% ( 380, 580 ] 59 0.033% 99.973% ( 580, 870 ] 26 0.015% 99.988% ( 870, 1300 ] 15 0.008% 99.996% ( 1300, 1900 ] 9 0.005% 100.001% ( 1900, 2900 ] 6 0.003% 100.004% ( 2900, 4400 ] 6 0.003% 100.008% ** Level 4 read latency histogram (micros): Count: 35 Average: 1537.2857 StdDev: 991.43 Min: 168 Median: 1278.5000 Max: 4145 Percentiles: P50: 1278.50 P75: 1850.00 P99: 4145.00 P99.9: 4145.00 P99.99: 4145.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 1 2.857% 5.714% # ( 250, 380 ] 1 2.857% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 4 11.429% 22.857% ## ( 870, 1300 ] 10 28.571% 51.429% ###### ( 1300, 1900 ] 9 25.714% 77.143% ##### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 631.8500 StdDev: 771.22 Min: 124 Median: 170.0000 Max: 2886 Percentiles: P50: 170.00 P75: 870.00 P99: 2833.33 P99.9: 2886.00 P99.99: 2886.00 ------------------------------------------------------ ( 110, 170 ] 10 50.000% 50.000% ########## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 15.6 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 314.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.414 H:M:S, 15.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 333.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.382 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/27-02:12:17 ... thread 0: (1000000,6000000) ops and (194859.6,291901.0) ops/second in (5.131899,20.554916) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.63 GB 94.4 4.2 0.0 4.2 9.9 5.7 0.0 1.7 133.1 310.4 32.66 30.55 99 0.330 4413K 4560 0.0 0.0 L1 15/15 1.45 GB 0.0 2.3 1.9 0.4 2.3 1.9 0.1 1.2 234.8 233.6 9.87 9.50 3 3.289 2352K 11K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 243.4 243.3 0.46 0.44 1 0.457 113K 38 0.0 0.0 L3 35/0 983.40 MB 1.0 1.3 0.6 0.7 1.3 0.6 0.0 2.1 211.4 211.2 6.28 5.55 4 1.571 1335K 673 0.0 0.0 L4 140/0 9.55 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/29 101.78 GB 0.0 7.9 2.6 5.3 13.6 8.2 1.2 2.4 164.4 281.7 49.27 46.04 107 0.460 8214K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.9 2.6 5.3 13.6 8.2 1.2 2.4 164.4 281.7 49.27 46.04 107 0.460 8214K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.9 2.6 5.3 7.9 2.6 0.0 0.0 246.5 246.0 32.87 31.42 24 1.370 8214K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 353.4 16.40 14.61 83 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.8 total, 20.6 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.56 GB write, 668.31 MB/s write, 7.91 GB read, 390.10 MB/s read, 49.3 seconds Interval compaction: 13.56 GB write, 675.29 MB/s write, 7.91 GB read, 394.18 MB/s read, 49.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 18, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1893161 Average: 2.2590 StdDev: 11.25 Min: 0 Median: 1.4931 Max: 3805 Percentiles: P50: 1.49 P75: 1.87 P99: 5.62 P99.9: 10.64 P99.99: 95.98 ------------------------------------------------------ [ 0, 1 ] 320013 16.904% 16.904% ### ( 1, 2 ] 1270736 67.122% 84.026% ############# ( 2, 3 ] 188724 9.969% 93.995% ## ( 3, 4 ] 65262 3.447% 97.442% # ( 4, 6 ] 36499 1.928% 99.370% ( 6, 10 ] 9830 0.519% 99.889% ( 10, 15 ] 1596 0.084% 99.974% ( 15, 22 ] 124 0.007% 99.980% ( 22, 34 ] 17 0.001% 99.981% ( 34, 51 ] 19 0.001% 99.982% ( 51, 76 ] 14 0.001% 99.983% ( 76, 110 ] 236 0.012% 99.995% ( 110, 170 ] 296 0.016% 100.011% ( 170, 250 ] 131 0.007% 100.018% ( 250, 380 ] 102 0.005% 100.023% ( 380, 580 ] 94 0.005% 100.028% ( 580, 870 ] 72 0.004% 100.032% ( 870, 1300 ] 28 0.001% 100.033% ( 1300, 1900 ] 18 0.001% 100.034% ( 1900, 2900 ] 5 0.000% 100.035% ( 2900, 4400 ] 5 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 403184 Average: 2.4919 StdDev: 11.58 Min: 0 Median: 1.5317 Max: 2773 Percentiles: P50: 1.53 P75: 1.91 P99: 6.88 P99.9: 103.54 P99.99: 520.43 ------------------------------------------------------ [ 0, 1 ] 60964 15.121% 15.121% ### ( 1, 2 ] 264490 65.600% 80.721% ############# ( 2, 3 ] 46879 11.627% 92.348% ## ( 3, 4 ] 14876 3.690% 96.038% # ( 4, 6 ] 11097 2.752% 98.790% # ( 6, 10 ] 3852 0.955% 99.746% ( 10, 15 ] 338 0.084% 99.829% ( 15, 22 ] 40 0.010% 99.839% ( 22, 34 ] 3 0.001% 99.840% ( 34, 51 ] 2 0.000% 99.841% ( 51, 76 ] 60 0.015% 99.855% ( 76, 110 ] 222 0.055% 99.910% ( 110, 170 ] 188 0.047% 99.957% ( 170, 250 ] 59 0.015% 99.972% ( 250, 380 ] 47 0.012% 99.983% ( 380, 580 ] 38 0.009% 99.993% ( 580, 870 ] 15 0.004% 99.997% ( 870, 1300 ] 10 0.002% 99.999% ( 1300, 1900 ] 3 0.001% 100.000% ( 1900, 2900 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.1306 StdDev: 3.80 Min: 1 Median: 1.4345 Max: 339 Percentiles: P50: 1.43 P75: 1.86 P99: 5.78 P99.9: 12.28 P99.99: 257.55 ------------------------------------------------------ [ 0, 1 ] 6964 24.644% 24.644% ##### ( 1, 2 ] 16490 58.355% 83.000% ############ ( 2, 3 ] 2477 8.766% 91.765% ## ( 3, 4 ] 1217 4.307% 96.072% # ( 4, 6 ] 929 3.288% 99.359% # ( 6, 10 ] 140 0.495% 99.855% ( 10, 15 ] 28 0.099% 99.954% ( 15, 22 ] 3 0.011% 99.965% ( 22, 34 ] 2 0.007% 99.972% ( 51, 76 ] 1 0.004% 99.975% ( 110, 170 ] 2 0.007% 99.982% ( 170, 250 ] 2 0.007% 99.989% ( 250, 380 ] 3 0.011% 100.000% ** Level 3 read latency histogram (micros): Count: 178556 Average: 3.5960 StdDev: 32.13 Min: 1 Median: 1.6679 Max: 3929 Percentiles: P50: 1.67 P75: 2.27 P99: 9.36 P99.9: 267.92 P99.99: 988.81 ------------------------------------------------------ [ 0, 1 ] 15385 8.616% 8.616% ## ( 1, 2 ] 110642 61.965% 70.581% ############ ( 2, 3 ] 29640 16.600% 87.181% ### ( 3, 4 ] 10021 5.612% 92.793% # ( 4, 6 ] 8336 4.669% 97.462% # ( 6, 10 ] 3267 1.830% 99.292% ( 10, 15 ] 485 0.272% 99.563% ( 15, 22 ] 87 0.049% 99.612% ( 22, 34 ] 17 0.010% 99.621% ( 34, 51 ] 11 0.006% 99.628% ( 51, 76 ] 45 0.025% 99.653% ( 76, 110 ] 111 0.062% 99.715% ( 110, 170 ] 205 0.115% 99.830% ( 170, 250 ] 114 0.064% 99.894% ( 250, 380 ] 83 0.046% 99.940% ( 380, 580 ] 59 0.033% 99.973% ( 580, 870 ] 26 0.015% 99.988% ( 870, 1300 ] 15 0.008% 99.996% ( 1300, 1900 ] 9 0.005% 100.001% ( 1900, 2900 ] 6 0.003% 100.004% ( 2900, 4400 ] 6 0.003% 100.008% ** Level 4 read latency histogram (micros): Count: 35 Average: 1537.2857 StdDev: 991.43 Min: 168 Median: 1278.5000 Max: 4145 Percentiles: P50: 1278.50 P75: 1850.00 P99: 4145.00 P99.9: 4145.00 P99.99: 4145.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 1 2.857% 5.714% # ( 250, 380 ] 1 2.857% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 4 11.429% 22.857% ## ( 870, 1300 ] 10 28.571% 51.429% ###### ( 1300, 1900 ] 9 25.714% 77.143% ##### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 631.8500 StdDev: 771.22 Min: 124 Median: 170.0000 Max: 2886 Percentiles: P50: 170.00 P75: 870.00 P99: 2833.33 P99.9: 2886.00 P99.99: 2886.00 ------------------------------------------------------ ( 110, 170 ] 10 50.000% 50.000% ########## ( 250, 380 ] 2 10.000% 60.000% ## ( 380, 580 ] 2 10.000% 70.000% ## ( 580, 870 ] 1 5.000% 75.000% # ( 870, 1300 ] 2 10.000% 85.000% ## ( 1900, 2900 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 20.8 total, 5.1 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 284.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.827 H:M:S, 23.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 191.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.414 H:M:S, 47.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/27-02:12:26 ... thread 0: (1000000,7000000) ops and (113745.9,238529.8) ops/second in (8.791525,29.346441) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 2.64 GB 188.6 5.8 0.0 5.8 12.4 6.6 0.0 1.9 143.8 307.3 41.18 38.67 118 0.349 6012K 7828 0.0 0.0 L1 24/0 1.65 GB 168.5 5.6 3.8 1.8 5.6 3.8 0.1 1.5 228.8 226.5 25.15 23.95 4 6.288 5844K 57K 0.0 0.0 L2 1/0 51.17 MB 0.5 0.1 0.1 0.0 0.1 0.1 2.2 1.8 243.4 243.3 0.46 0.44 1 0.457 113K 38 0.0 0.0 L3 23/9 1.65 GB 0.9 1.6 0.8 0.7 1.6 0.8 1.4 1.9 195.8 195.5 8.21 6.85 8 1.026 1578K 673 0.0 0.0 L4 158/13 9.81 GB 1.0 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1056/0 86.86 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/26 102.65 GB 0.0 13.1 4.7 8.4 19.6 11.2 5.9 3.0 178.6 267.6 74.99 69.91 131 0.572 13M 66K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.1 4.7 8.4 19.6 11.2 5.9 3.0 178.6 267.6 74.99 69.91 131 0.572 13M 66K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.1 4.7 8.4 13.0 4.7 0.0 0.0 239.6 238.4 55.91 52.89 33 1.694 13M 66K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 353.2 19.09 17.02 98 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.6 total, 29.3 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.60 GB write, 678.81 MB/s write, 13.08 GB read, 453.10 MB/s read, 75.0 seconds Interval compaction: 19.60 GB write, 683.77 MB/s write, 13.08 GB read, 456.42 MB/s read, 75.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 22, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 22, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 33, total-stops: 18, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2611641 Average: 2.3519 StdDev: 13.64 Min: 0 Median: 1.4853 Max: 8014 Percentiles: P50: 1.49 P75: 1.86 P99: 5.74 P99.9: 14.55 P99.99: 173.34 ------------------------------------------------------ [ 0, 1 ] 456466 17.478% 17.478% ### ( 1, 2 ] 1750306 67.019% 84.498% ############# ( 2, 3 ] 247879 9.491% 93.989% ## ( 3, 4 ] 87384 3.346% 97.335% # ( 4, 6 ] 49977 1.914% 99.248% ( 6, 10 ] 15076 0.577% 99.826% ( 10, 15 ] 2134 0.082% 99.907% ( 15, 22 ] 190 0.007% 99.915% ( 22, 34 ] 20 0.001% 99.915% ( 34, 51 ] 22 0.001% 99.916% ( 51, 76 ] 41 0.002% 99.918% ( 76, 110 ] 814 0.031% 99.949% ( 110, 170 ] 1055 0.040% 99.989% ( 170, 250 ] 403 0.015% 100.005% ( 250, 380 ] 235 0.009% 100.014% ( 380, 580 ] 200 0.008% 100.021% ( 580, 870 ] 122 0.005% 100.026% ( 870, 1300 ] 45 0.002% 100.028% ( 1300, 1900 ] 18 0.001% 100.029% ( 1900, 2900 ] 6 0.000% 100.029% ( 2900, 4400 ] 10 0.000% 100.029% ( 6600, 9900 ] 1 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 748687 Average: 2.9881 StdDev: 35.18 Min: 0 Median: 1.5883 Max: 10692 Percentiles: P50: 1.59 P75: 1.99 P99: 7.73 P99.9: 86.35 P99.99: 163.24 ------------------------------------------------------ [ 0, 1 ] 99355 13.271% 13.271% ### ( 1, 2 ] 467457 62.437% 75.707% ############ ( 2, 3 ] 98942 13.215% 88.923% ### ( 3, 4 ] 38029 5.079% 94.002% # ( 4, 6 ] 33308 4.449% 98.451% # ( 6, 10 ] 9482 1.266% 99.718% ( 10, 15 ] 1014 0.135% 99.853% ( 15, 22 ] 134 0.018% 99.871% ( 22, 34 ] 11 0.001% 99.872% ( 34, 51 ] 8 0.001% 99.874% ( 51, 76 ] 73 0.010% 99.883% ( 76, 110 ] 415 0.055% 99.939% ( 110, 170 ] 434 0.058% 99.997% ( 170, 250 ] 136 0.018% 100.015% ( 250, 380 ] 113 0.015% 100.030% ( 380, 580 ] 106 0.014% 100.044% ( 580, 870 ] 73 0.010% 100.054% ( 870, 1300 ] 45 0.006% 100.060% ( 1300, 1900 ] 24 0.003% 100.063% ( 1900, 2900 ] 13 0.002% 100.065% ( 2900, 4400 ] 18 0.002% 100.067% ( 4400, 6600 ] 1 0.000% 100.067% ( 6600, 9900 ] 4 0.001% 100.068% ( 9900, 14000 ] 1 0.000% 100.068% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.1306 StdDev: 3.80 Min: 1 Median: 1.4345 Max: 339 Percentiles: P50: 1.43 P75: 1.86 P99: 5.78 P99.9: 12.28 P99.99: 257.55 ------------------------------------------------------ [ 0, 1 ] 6964 24.644% 24.644% ##### ( 1, 2 ] 16490 58.355% 83.000% ############ ( 2, 3 ] 2477 8.766% 91.765% ## ( 3, 4 ] 1217 4.307% 96.072% # ( 4, 6 ] 929 3.288% 99.359% # ( 6, 10 ] 140 0.495% 99.855% ( 10, 15 ] 28 0.099% 99.954% ( 15, 22 ] 3 0.011% 99.965% ( 22, 34 ] 2 0.007% 99.972% ( 51, 76 ] 1 0.004% 99.975% ( 110, 170 ] 2 0.007% 99.982% ( 170, 250 ] 2 0.007% 99.989% ( 250, 380 ] 3 0.011% 100.000% ** Level 3 read latency histogram (micros): Count: 234118 Average: 7.7320 StdDev: 95.84 Min: 1 Median: 1.7286 Max: 8024 Percentiles: P50: 1.73 P75: 2.50 P99: 12.82 P99.9: 892.25 P99.99: 2056.15 ------------------------------------------------------ [ 0, 1 ] 16654 7.114% 7.114% # ( 1, 2 ] 137815 58.866% 65.979% ############ ( 2, 3 ] 41939 17.914% 83.893% #### ( 3, 4 ] 16722 7.143% 91.035% # ( 4, 6 ] 13486 5.760% 96.796% # ( 6, 10 ] 4753 2.030% 98.826% ( 10, 15 ] 725 0.310% 99.135% ( 15, 22 ] 128 0.055% 99.190% ( 22, 34 ] 22 0.009% 99.200% ( 34, 51 ] 17 0.007% 99.207% ( 51, 76 ] 47 0.020% 99.227% ( 76, 110 ] 121 0.052% 99.279% ( 110, 170 ] 285 0.122% 99.400% ( 170, 250 ] 285 0.122% 99.522% ( 250, 380 ] 279 0.119% 99.641% ( 380, 580 ] 328 0.140% 99.781% ( 580, 870 ] 272 0.116% 99.897% ( 870, 1300 ] 133 0.057% 99.954% ( 1300, 1900 ] 76 0.032% 99.987% ( 1900, 2900 ] 55 0.023% 100.010% ( 2900, 4400 ] 43 0.018% 100.029% ( 4400, 6600 ] 18 0.008% 100.036% ( 6600, 9900 ] 3 0.001% 100.038% ** Level 4 read latency histogram (micros): Count: 35 Average: 1537.2857 StdDev: 991.43 Min: 168 Median: 1278.5000 Max: 4145 Percentiles: P50: 1278.50 P75: 1850.00 P99: 4145.00 P99.9: 4145.00 P99.99: 4145.00 ------------------------------------------------------ ( 110, 170 ] 1 2.857% 2.857% # ( 170, 250 ] 1 2.857% 5.714% # ( 250, 380 ] 1 2.857% 8.571% # ( 380, 580 ] 1 2.857% 11.429% # ( 580, 870 ] 4 11.429% 22.857% ## ( 870, 1300 ] 10 28.571% 51.429% ###### ( 1300, 1900 ] 9 25.714% 77.143% ##### ( 1900, 2900 ] 3 8.571% 85.714% ## ( 2900, 4400 ] 5 14.286% 100.000% ### ** Level 5 read latency histogram (micros): Count: 60 Average: 1074.8000 StdDev: 1167.96 Min: 86 Median: 612.2222 Max: 4348 Percentiles: P50: 612.22 P75: 1500.00 P99: 4271.43 P99.9: 4348.00 P99.99: 4348.00 ------------------------------------------------------ ( 76, 110 ] 1 1.667% 1.667% ( 110, 170 ] 10 16.667% 18.333% ### ( 170, 250 ] 6 10.000% 28.333% ## ( 250, 380 ] 7 11.667% 40.000% ## ( 380, 580 ] 5 8.333% 48.333% ## ( 580, 870 ] 9 15.000% 63.333% ### ( 870, 1300 ] 6 10.000% 73.333% ## ( 1300, 1900 ] 3 5.000% 78.333% # ( 1900, 2900 ] 6 10.000% 88.333% ## ( 2900, 4400 ] 7 11.667% 100.000% ## ** DB Stats ** Uptime(secs): 29.6 total, 8.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 233.04 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.750 H:M:S, 36.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 111.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.922 H:M:S, 67.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 7 num-running-flushes: 1 2024/07/27-02:12:36 ... thread 0: (1000000,8000000) ops and (99530.7,203078.7) ops/second in (10.047155,39.393596) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 3.74 GB 44.1 7.4 0.0 7.4 15.1 7.7 0.0 2.0 148.5 301.7 51.32 47.95 137 0.375 7738K 11K 0.0 0.0 L1 24/24 1.65 GB 0.0 5.6 3.8 1.8 5.6 3.8 0.1 1.5 228.8 226.5 25.15 23.95 4 6.288 5844K 57K 0.0 0.0 L2 1/0 51.17 MB 0.5 0.1 0.1 0.0 0.1 0.1 2.2 1.8 243.4 243.3 0.46 0.44 1 0.457 113K 38 0.0 0.0 L3 14/0 921.07 MB 0.9 1.6 0.8 0.7 1.6 0.8 1.4 1.9 195.8 195.5 8.21 6.85 8 1.026 1578K 673 0.0 0.0 L4 168/0 9.57 GB 1.0 0.9 0.7 0.1 0.9 0.7 1.2 1.2 138.1 137.5 6.47 4.13 6 1.078 878K 3715 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/35 103.75 GB 0.0 15.6 5.5 10.1 23.2 13.1 6.9 3.0 174.5 259.7 91.60 83.32 156 0.587 16M 73K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.6 5.5 10.1 23.2 13.1 6.8 3.0 174.5 259.7 91.60 83.32 156 0.587 16M 73K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.6 5.5 10.1 15.5 5.4 0.0 0.0 231.7 230.6 68.99 63.38 43 1.604 16M 73K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.7 7.7 0.0 0.0 0.0 348.3 22.61 19.94 113 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.6 total, 39.4 interval Flush(GB): cumulative 7.690, interval 7.690 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.23 GB write, 600.54 MB/s write, 15.61 GB read, 403.64 MB/s read, 91.6 seconds Interval compaction: 23.23 GB write, 603.82 MB/s write, 15.61 GB read, 405.84 MB/s read, 91.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 22, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 22, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 16, pending-compaction-bytes-stops: 0, total-delays: 38, total-stops: 31, interval: 69 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3408477 Average: 2.2874 StdDev: 13.29 Min: 0 Median: 1.4582 Max: 8014 Percentiles: P50: 1.46 P75: 1.84 P99: 5.71 P99.9: 14.12 P99.99: 166.40 ------------------------------------------------------ [ 0, 1 ] 677975 19.891% 19.891% #### ( 1, 2 ] 2239748 65.711% 85.602% ############# ( 2, 3 ] 295635 8.674% 94.275% ## ( 3, 4 ] 106301 3.119% 97.394% # ( 4, 6 ] 63861 1.874% 99.268% ( 6, 10 ] 19181 0.563% 99.831% ( 10, 15 ] 2872 0.084% 99.915% ( 15, 22 ] 334 0.010% 99.925% ( 22, 34 ] 26 0.001% 99.925% ( 34, 51 ] 26 0.001% 99.926% ( 51, 76 ] 46 0.001% 99.927% ( 76, 110 ] 942 0.028% 99.955% ( 110, 170 ] 1265 0.037% 99.992% ( 170, 250 ] 439 0.013% 100.005% ( 250, 380 ] 268 0.008% 100.013% ( 380, 580 ] 227 0.007% 100.020% ( 580, 870 ] 133 0.004% 100.024% ( 870, 1300 ] 54 0.002% 100.025% ( 1300, 1900 ] 20 0.001% 100.026% ( 1900, 2900 ] 10 0.000% 100.026% ( 2900, 4400 ] 15 0.000% 100.026% ( 6600, 9900 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 801194 Average: 3.1236 StdDev: 39.64 Min: 0 Median: 1.5966 Max: 10692 Percentiles: P50: 1.60 P75: 2.00 P99: 7.86 P99.9: 89.49 P99.99: 168.09 ------------------------------------------------------ [ 0, 1 ] 105105 13.119% 13.119% ### ( 1, 2 ] 495323 61.823% 74.942% ############ ( 2, 3 ] 108215 13.507% 88.448% ### ( 3, 4 ] 42417 5.294% 93.743% # ( 4, 6 ] 37215 4.645% 98.388% # ( 6, 10 ] 10544 1.316% 99.704% ( 10, 15 ] 1154 0.144% 99.848% ( 15, 22 ] 154 0.019% 99.867% ( 22, 34 ] 13 0.002% 99.868% ( 34, 51 ] 8 0.001% 99.869% ( 51, 76 ] 73 0.009% 99.879% ( 76, 110 ] 433 0.054% 99.933% ( 110, 170 ] 475 0.059% 99.992% ( 170, 250 ] 147 0.018% 100.010% ( 250, 380 ] 123 0.015% 100.026% ( 380, 580 ] 122 0.015% 100.041% ( 580, 870 ] 87 0.011% 100.052% ( 870, 1300 ] 55 0.007% 100.059% ( 1300, 1900 ] 31 0.004% 100.062% ( 1900, 2900 ] 22 0.003% 100.065% ( 2900, 4400 ] 26 0.003% 100.068% ( 4400, 6600 ] 6 0.001% 100.069% ( 6600, 9900 ] 4 0.000% 100.070% ( 9900, 14000 ] 1 0.000% 100.070% ** Level 2 read latency histogram (micros): Count: 28258 Average: 2.1306 StdDev: 3.80 Min: 1 Median: 1.4345 Max: 339 Percentiles: P50: 1.43 P75: 1.86 P99: 5.78 P99.9: 12.28 P99.99: 257.55 ------------------------------------------------------ [ 0, 1 ] 6964 24.644% 24.644% ##### ( 1, 2 ] 16490 58.355% 83.000% ############ ( 2, 3 ] 2477 8.766% 91.765% ## ( 3, 4 ] 1217 4.307% 96.072% # ( 4, 6 ] 929 3.288% 99.359% # ( 6, 10 ] 140 0.495% 99.855% ( 10, 15 ] 28 0.099% 99.954% ( 15, 22 ] 3 0.011% 99.965% ( 22, 34 ] 2 0.007% 99.972% ( 51, 76 ] 1 0.004% 99.975% ( 110, 170 ] 2 0.007% 99.982% ( 170, 250 ] 2 0.007% 99.989% ( 250, 380 ] 3 0.011% 100.000% ** Level 3 read latency histogram (micros): Count: 284162 Average: 7.3484 StdDev: 91.78 Min: 1 Median: 1.7428 Max: 8024 Percentiles: P50: 1.74 P75: 2.53 P99: 10.94 P99.9: 833.60 P99.99: 1714.03 ------------------------------------------------------ [ 0, 1 ] 17980 6.327% 6.327% # ( 1, 2 ] 167062 58.791% 65.118% ############ ( 2, 3 ] 52502 18.476% 83.595% #### ( 3, 4 ] 21068 7.414% 91.009% # ( 4, 6 ] 16922 5.955% 96.964% # ( 6, 10 ] 5631 1.982% 98.945% ( 10, 15 ] 828 0.291% 99.237% ( 15, 22 ] 143 0.050% 99.287% ( 22, 34 ] 24 0.008% 99.295% ( 34, 51 ] 18 0.006% 99.302% ( 51, 76 ] 47 0.017% 99.318% ( 76, 110 ] 123 0.043% 99.362% ( 110, 170 ] 297 0.105% 99.466% ( 170, 250 ] 293 0.103% 99.569% ( 250, 380 ] 295 0.104% 99.673% ( 380, 580 ] 365 0.128% 99.802% ( 580, 870 ] 320 0.113% 99.914% ( 870, 1300 ] 159 0.056% 99.970% ( 1300, 1900 ] 82 0.029% 99.999% ( 1900, 2900 ] 62 0.022% 100.021% ( 2900, 4400 ] 50 0.018% 100.038% ( 4400, 6600 ] 19 0.007% 100.045% ( 6600, 9900 ] 3 0.001% 100.046% ** Level 4 read latency histogram (micros): Count: 210 Average: 372.9714 StdDev: 834.79 Min: 0 Median: 2.1429 Max: 4577 Percentiles: P50: 2.14 P75: 217.27 P99: 4164.29 P99.9: 4577.00 P99.99: 4577.00 ------------------------------------------------------ [ 0, 1 ] 57 27.143% 27.143% ##### ( 1, 2 ] 47 22.381% 49.524% #### ( 2, 3 ] 7 3.333% 52.857% # ( 3, 4 ] 3 1.429% 54.286% ( 4, 6 ] 6 2.857% 57.143% # ( 6, 10 ] 7 3.333% 60.476% # ( 10, 15 ] 2 0.952% 61.429% ( 15, 22 ] 2 0.952% 62.381% ( 22, 34 ] 12 5.714% 68.095% # ( 110, 170 ] 8 3.810% 71.905% # ( 170, 250 ] 11 5.238% 77.143% # ( 250, 380 ] 5 2.381% 79.524% ( 380, 580 ] 4 1.905% 81.429% ( 580, 870 ] 5 2.381% 83.810% ( 870, 1300 ] 10 4.762% 88.571% # ( 1300, 1900 ] 13 6.190% 94.762% # ( 1900, 2900 ] 3 1.429% 96.190% ( 2900, 4400 ] 7 3.333% 99.524% # ( 4400, 6600 ] 1 0.476% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 1088.7417 StdDev: 1232.58 Min: 79 Median: 535.5556 Max: 5485 Percentiles: P50: 535.56 P75: 1600.00 P99: 5280.00 P99.9: 5485.00 P99.99: 5485.00 ------------------------------------------------------ ( 76, 110 ] 4 3.333% 3.333% # ( 110, 170 ] 21 17.500% 20.833% #### ( 170, 250 ] 13 10.833% 31.667% ## ( 250, 380 ] 15 12.500% 44.167% ### ( 380, 580 ] 9 7.500% 51.667% ## ( 580, 870 ] 13 10.833% 62.500% ## ( 870, 1300 ] 11 9.167% 71.667% ## ( 1300, 1900 ] 8 6.667% 78.333% # ( 1900, 2900 ] 13 10.833% 89.167% ## ( 2900, 4400 ] 11 9.167% 98.333% ## ( 4400, 6600 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 39.6 total, 10.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 198.78 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:18.047 H:M:S, 45.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 97.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.297 H:M:S, 72.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.879 micros/op 145365 ops/sec 60.001 seconds 8721999 operations; 140.8 MB/s Microseconds per write: Count: 8721999 Average: 6.8792 StdDev: 522.04 Min: 1 Median: 1.7372 Max: 893358 Percentiles: P50: 1.74 P75: 2.69 P99: 9.18 P99.9: 1259.45 P99.99: 2788.57 ------------------------------------------------------ [ 0, 1 ] 1181346 13.544% 13.544% ### ( 1, 2 ] 4313004 49.450% 62.994% ########## ( 2, 3 ] 1517760 17.402% 80.396% ### ( 3, 4 ] 1139526 13.065% 93.461% ### ( 4, 6 ] 403721 4.629% 98.089% # ( 6, 10 ] 99902 1.145% 99.235% ( 10, 15 ] 27167 0.311% 99.546% ( 15, 22 ] 6873 0.079% 99.625% ( 22, 34 ] 1504 0.017% 99.642% ( 34, 51 ] 153 0.002% 99.644% ( 51, 76 ] 23 0.000% 99.644% ( 76, 110 ] 6481 0.074% 99.719% ( 110, 170 ] 2037 0.023% 99.742% ( 170, 250 ] 242 0.003% 99.745% ( 250, 380 ] 103 0.001% 99.746% ( 380, 580 ] 21 0.000% 99.746% ( 580, 870 ] 17 0.000% 99.746% ( 870, 1300 ] 14792 0.170% 99.916% ( 1300, 1900 ] 34 0.000% 99.916% ( 1900, 2900 ] 7226 0.083% 99.999% ( 2900, 4400 ] 30 0.000% 100.000% ( 4400, 6600 ] 6 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 9900, 14000 ] 4 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 10 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 219089 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 8721999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9001102968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 488 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 36303715 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28098640615 rocksdb.compact.write.bytes COUNT : 27865401778 rocksdb.flush.write.bytes COUNT : 8917749879 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 35 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 241 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 8845800448 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3389440 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28177141731 rocksdb.non.last.level.read.count COUNT : 6808981 rocksdb.block.checksum.compute.count COUNT : 6808040 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.384566 P95 : 3.841029 P99 : 7.800881 P100 : 893356.000000 COUNT : 8721999 SUM : 55948776 rocksdb.compaction.times.micros P50 : 1094482.758621 P95 : 4206666.666667 P99 : 23320567.000000 P100 : 23320567.000000 COUNT : 68 SUM : 128900314 rocksdb.compaction.times.cpu_micros P50 : 914400.000000 P95 : 4020000.000000 P99 : 19280000.000000 P100 : 20917175.000000 COUNT : 68 SUM : 104991626 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 683.880597 P95 : 3650.000000 P99 : 30800.000000 P100 : 189114.000000 COUNT : 120 SUM : 339840 rocksdb.compaction.outfile.sync.micros P50 : 979.385965 P95 : 161214.285714 P99 : 335670.000000 P100 : 372684.000000 COUNT : 341 SUM : 9289174 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 107.746988 P95 : 1918.750000 P99 : 3522.500000 P100 : 5096.000000 COUNT : 217 SUM : 86237 rocksdb.table.open.io.micros P50 : 1396.226415 P95 : 6548.235294 P99 : 9468.000000 P100 : 14365.000000 COUNT : 488 SUM : 906926 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.616444 P95 : 7.686844 P99 : 11.621593 P100 : 14494.000000 COUNT : 6806888 SUM : 43673363 rocksdb.read.block.get.micros P50 : 397.777778 P95 : 2881.395349 P99 : 4370.769231 P100 : 8664.000000 COUNT : 976 SUM : 749366 rocksdb.write.raw.block.micros P50 : 0.513495 P95 : 0.975641 P99 : 2.840146 P100 : 29095.000000 COUNT : 8913958 SUM : 18717340 rocksdb.numfiles.in.singlecompaction P50 : 3.197183 P95 : 6.600000 P99 : 30.640000 P100 : 35.000000 COUNT : 128 SUM : 506 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563603 P95 : 1225.881005 P99 : 2633.558146 P100 : 893160.000000 COUNT : 196498 SUM : 36319458 rocksdb.sst.read.micros P50 : 1.557473 P95 : 4.526779 P99 : 8.715458 P100 : 14489.000000 COUNT : 6809511 SUM : 29546672 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 8721999 SUM : 9001102968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211904.761905 P95 : 494000.000000 P99 : 996000.000000 P100 : 1045050.000000 COUNT : 120 SUM : 27156004 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 307 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0