[2024-07-14 02:00:03.422144] Starting SPDK v24.09-pre git sha1 719d03c6a / DPDK 23.11.0 initialization... [2024-07-14 02:00:03.422242] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2212013 ] Set seed to 1720915203419823 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-14 02:00:03.517213] app.c: 908:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-14 02:00:03.555653] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-14 02:00:03.555697] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2212013' to capture a snapshot of events at runtime. [2024-07-14 02:00:03.555707] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-14 02:00:03.555721] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-14 02:00:03.555728] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2212013 for offline analysis/debug. [2024-07-14 02:00:03.555812] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Jul 14 02:00:07 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/14-02:00:10 ... thread 0: (1000000,1000000) ops and (364866.3,364866.3) ops/second in (2.740730,2.740730) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 504.02 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 357.6 2.29 2.07 12 0.191 0 0 0.0 0.0 L1 3/3 251.75 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 255.3 255.1 0.99 0.95 1 0.987 255K 197 0.0 0.0 L2 1/0 48.88 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 26 0.0 0.0 L3 16/0 755.45 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 215.4 215.4 0.29 0.24 1 0.290 63K 0 0.0 0.0 L4 112/0 9.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1180/8 96.94 GB 0.0 0.4 0.3 0.1 1.2 1.1 0.2 1.5 105.7 309.0 4.03 3.70 15 0.269 432K 223 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.1 0.1 1.5 105.7 309.0 4.03 3.70 15 0.269 432K 223 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 245.0 244.9 1.74 1.63 3 0.579 432K 223 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 357.6 2.29 2.07 12 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.9 total, 2.7 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.22 GB write, 427.28 MB/s write, 0.42 GB read, 146.22 MB/s read, 4.0 seconds Interval compaction: 1.22 GB write, 453.95 MB/s write, 0.42 GB read, 155.35 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 97462 Average: 1.7791 StdDev: 15.07 Min: 1 Median: 1.1330 Max: 3180 Percentiles: P50: 1.13 P75: 1.60 P99: 3.41 P99.9: 9.33 P99.99: 355.75 ------------------------------------------------------ [ 0, 1 ] 41731 42.818% 42.818% ######### ( 1, 2 ] 52654 54.025% 96.843% ########### ( 2, 3 ] 1806 1.853% 98.696% ( 3, 4 ] 717 0.736% 99.432% ( 4, 6 ] 295 0.303% 99.734% ( 6, 10 ] 195 0.200% 99.934% ( 10, 15 ] 27 0.028% 99.962% ( 15, 22 ] 7 0.007% 99.969% ( 22, 34 ] 3 0.003% 99.972% ( 34, 51 ] 2 0.002% 99.974% ( 51, 76 ] 3 0.003% 99.977% ( 110, 170 ] 10 0.010% 99.988% ( 250, 380 ] 4 0.004% 99.992% ( 380, 580 ] 2 0.002% 99.994% ( 580, 870 ] 2 0.002% 99.996% ( 870, 1300 ] 3 0.003% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ( 1900, 2900 ] 1 0.001% 100.001% ( 2900, 4400 ] 1 0.001% 100.002% ** Level 1 read latency histogram (micros): Count: 26233 Average: 2.3007 StdDev: 24.88 Min: 1 Median: 1.1964 Max: 2723 Percentiles: P50: 1.20 P75: 1.65 P99: 5.74 P99.9: 94.01 P99.99: 1031.98 ------------------------------------------------------ [ 0, 1 ] 10306 39.286% 39.286% ######## ( 1, 2 ] 14316 54.572% 93.859% ########### ( 2, 3 ] 911 3.473% 97.332% # ( 3, 4 ] 282 1.075% 98.407% ( 4, 6 ] 180 0.686% 99.093% ( 6, 10 ] 132 0.503% 99.596% ( 10, 15 ] 23 0.088% 99.684% ( 15, 22 ] 6 0.023% 99.706% ( 22, 34 ] 2 0.008% 99.714% ( 34, 51 ] 9 0.034% 99.748% ( 51, 76 ] 36 0.137% 99.886% ( 76, 110 ] 9 0.034% 99.920% ( 110, 170 ] 2 0.008% 99.928% ( 170, 250 ] 9 0.034% 99.962% ( 250, 380 ] 5 0.019% 99.981% ( 380, 580 ] 1 0.004% 99.985% ( 580, 870 ] 2 0.008% 99.992% ( 870, 1300 ] 1 0.004% 99.996% ( 1900, 2900 ] 2 0.008% 100.004% ** Level 2 read latency histogram (micros): Count: 15886 Average: 1.7042 StdDev: 3.77 Min: 0 Median: 1.0918 Max: 322 Percentiles: P50: 1.09 P75: 1.59 P99: 4.57 P99.9: 9.93 P99.99: 226.46 ------------------------------------------------------ [ 0, 1 ] 7217 45.430% 45.430% ######### ( 1, 2 ] 7906 49.767% 95.197% ########## ( 2, 3 ] 347 2.184% 97.381% ( 3, 4 ] 221 1.391% 98.773% ( 4, 6 ] 127 0.799% 99.572% ( 6, 10 ] 53 0.334% 99.906% ( 10, 15 ] 9 0.057% 99.962% ( 15, 22 ] 2 0.013% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 583.1250 StdDev: 794.60 Min: 0 Median: 110.0000 Max: 2659 Percentiles: P50: 110.00 P75: 1115.71 P99: 2659.00 P99.9: 2659.00 P99.99: 2659.00 ------------------------------------------------------ [ 0, 1 ] 30 37.500% 37.500% ######## ( 1, 2 ] 4 5.000% 42.500% # ( 2, 3 ] 1 1.250% 43.750% ( 3, 4 ] 1 1.250% 45.000% ( 34, 51 ] 1 1.250% 46.250% ( 51, 76 ] 1 1.250% 47.500% ( 76, 110 ] 2 2.500% 50.000% # ( 110, 170 ] 4 5.000% 55.000% # ( 170, 250 ] 2 2.500% 57.500% # ( 250, 380 ] 3 3.750% 61.250% # ( 380, 580 ] 5 6.250% 67.500% # ( 580, 870 ] 2 2.500% 70.000% # ( 870, 1300 ] 7 8.750% 78.750% ## ( 1300, 1900 ] 10 12.500% 91.250% ### ( 1900, 2900 ] 7 8.750% 100.000% ## ** Level 4 read latency histogram (micros): Count: 35 Average: 1426.3429 StdDev: 1111.44 Min: 85 Median: 1269.2857 Max: 4582 Percentiles: P50: 1269.29 P75: 1962.50 P99: 4582.00 P99.9: 4582.00 P99.99: 4582.00 ------------------------------------------------------ ( 76, 110 ] 2 5.714% 5.714% # ( 110, 170 ] 1 2.857% 8.571% # ( 170, 250 ] 2 5.714% 14.286% # ( 250, 380 ] 3 8.571% 22.857% ## ( 380, 580 ] 2 5.714% 28.571% # ( 580, 870 ] 1 2.857% 31.429% # ( 870, 1300 ] 7 20.000% 51.429% #### ( 1300, 1900 ] 8 22.857% 74.286% ##### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 2.9 total, 2.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 337.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.185 H:M:S, 6.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 358.80 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.185 H:M:S, 6.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-02:00:13 ... thread 0: (1000000,2000000) ops and (329778.0,346435.9) ops/second in (3.032343,5.773073) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.17 GB 12.6 0.8 0.0 0.8 2.6 1.8 0.0 1.4 101.2 326.8 8.09 7.51 29 0.279 831K 887 0.0 0.0 L1 2/2 50.39 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 243.8 243.4 3.36 3.26 2 1.679 831K 1420 0.0 0.0 L2 5/4 563.94 MB 1.3 0.1 0.1 0.0 0.1 0.1 0.6 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 26 0.0 0.0 L3 16/9 755.45 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 215.4 215.4 0.29 0.24 1 0.290 63K 0 0.0 0.0 L4 112/0 9.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1183/21 97.92 GB 0.0 1.8 0.6 1.2 3.6 2.4 0.7 2.0 148.5 298.0 12.20 11.45 33 0.370 1839K 2333 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.6 1.2 3.6 2.4 0.6 2.0 148.5 298.0 12.20 11.45 33 0.370 1839K 2333 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.6 1.2 1.8 0.6 0.0 0.0 253.7 253.4 7.14 6.91 7 1.020 1839K 2333 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 360.8 5.06 4.53 26 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.55 GB write, 611.59 MB/s write, 1.77 GB read, 304.72 MB/s read, 12.2 seconds Interval compaction: 3.55 GB write, 629.72 MB/s write, 1.77 GB read, 313.75 MB/s read, 12.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 385926 Average: 2.1259 StdDev: 11.16 Min: 1 Median: 1.4456 Max: 3259 Percentiles: P50: 1.45 P75: 1.83 P99: 5.52 P99.9: 9.91 P99.99: 14.72 ------------------------------------------------------ [ 0, 1 ] 82283 21.321% 21.321% #### ( 1, 2 ] 248384 64.361% 85.681% ############# ( 2, 3 ] 33360 8.644% 94.326% ## ( 3, 4 ] 12256 3.176% 97.501% # ( 4, 6 ] 7625 1.976% 99.477% ( 6, 10 ] 1671 0.433% 99.910% ( 10, 15 ] 327 0.085% 99.995% ( 15, 22 ] 33 0.009% 100.003% ( 22, 34 ] 7 0.002% 100.005% ( 34, 51 ] 6 0.002% 100.007% ( 51, 76 ] 10 0.003% 100.009% ( 110, 170 ] 16 0.004% 100.013% ( 170, 250 ] 7 0.002% 100.015% ( 250, 380 ] 10 0.003% 100.018% ( 380, 580 ] 3 0.001% 100.019% ( 580, 870 ] 9 0.002% 100.021% ( 870, 1300 ] 7 0.002% 100.023% ( 1300, 1900 ] 2 0.001% 100.023% ( 1900, 2900 ] 2 0.001% 100.024% ( 2900, 4400 ] 2 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 125657 Average: 2.3223 StdDev: 13.80 Min: 1 Median: 1.5136 Max: 2723 Percentiles: P50: 1.51 P75: 1.90 P99: 5.76 P99.9: 13.83 P99.99: 357.38 ------------------------------------------------------ [ 0, 1 ] 21178 16.854% 16.854% ### ( 1, 2 ] 81099 64.540% 81.394% ############# ( 2, 3 ] 14568 11.593% 92.987% ## ( 3, 4 ] 4754 3.783% 96.771% # ( 4, 6 ] 3187 2.536% 99.307% # ( 6, 10 ] 668 0.532% 99.838% ( 10, 15 ] 101 0.080% 99.919% ( 15, 22 ] 13 0.010% 99.929% ( 22, 34 ] 2 0.002% 99.931% ( 34, 51 ] 10 0.008% 99.939% ( 51, 76 ] 36 0.029% 99.967% ( 76, 110 ] 9 0.007% 99.975% ( 110, 170 ] 3 0.002% 99.977% ( 170, 250 ] 9 0.007% 99.984% ( 250, 380 ] 9 0.007% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 3 0.002% 99.994% ( 870, 1300 ] 4 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 15929 Average: 1.7078 StdDev: 3.77 Min: 0 Median: 1.0944 Max: 322 Percentiles: P50: 1.09 P75: 1.60 P99: 4.61 P99.9: 10.04 P99.99: 226.28 ------------------------------------------------------ [ 0, 1 ] 7217 45.307% 45.307% ######### ( 1, 2 ] 7921 49.727% 95.034% ########## ( 2, 3 ] 371 2.329% 97.363% ( 3, 4 ] 221 1.387% 98.751% ( 4, 6 ] 130 0.816% 99.567% ( 6, 10 ] 53 0.333% 99.900% ( 10, 15 ] 10 0.063% 99.962% ( 15, 22 ] 2 0.013% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 2 0.013% 99.994% ( 250, 380 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 74517 Average: 3.8396 StdDev: 36.73 Min: 0 Median: 1.6133 Max: 2659 Percentiles: P50: 1.61 P75: 2.00 P99: 9.26 P99.9: 346.30 P99.99: 1512.90 ------------------------------------------------------ [ 0, 1 ] 7666 10.288% 10.288% ## ( 1, 2 ] 48252 64.753% 75.041% ############# ( 2, 3 ] 10751 14.428% 89.468% ### ( 3, 4 ] 3565 4.784% 94.252% # ( 4, 6 ] 2532 3.398% 97.650% # ( 6, 10 ] 1235 1.657% 99.308% ( 10, 15 ] 140 0.188% 99.495% ( 15, 22 ] 29 0.039% 99.534% ( 22, 34 ] 6 0.008% 99.542% ( 34, 51 ] 2 0.003% 99.545% ( 51, 76 ] 14 0.019% 99.564% ( 76, 110 ] 87 0.117% 99.681% ( 110, 170 ] 95 0.127% 99.808% ( 170, 250 ] 47 0.063% 99.871% ( 250, 380 ] 29 0.039% 99.910% ( 380, 580 ] 32 0.043% 99.953% ( 580, 870 ] 11 0.015% 99.968% ( 870, 1300 ] 13 0.017% 99.985% ( 1300, 1900 ] 10 0.013% 99.999% ( 1900, 2900 ] 7 0.009% 100.008% ** Level 4 read latency histogram (micros): Count: 35 Average: 1426.3429 StdDev: 1111.44 Min: 85 Median: 1269.2857 Max: 4582 Percentiles: P50: 1269.29 P75: 1962.50 P99: 4582.00 P99.9: 4582.00 P99.99: 4582.00 ------------------------------------------------------ ( 76, 110 ] 2 5.714% 5.714% # ( 110, 170 ] 1 2.857% 8.571% # ( 170, 250 ] 2 5.714% 14.286% # ( 250, 380 ] 3 8.571% 22.857% ## ( 380, 580 ] 2 5.714% 28.571% # ( 580, 870 ] 1 2.857% 31.429% # ( 870, 1300 ] 7 20.000% 51.429% #### ( 1300, 1900 ] 8 22.857% 74.286% ##### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 5.9 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 331.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.584 H:M:S, 9.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.399 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/14-02:00:16 ... thread 0: (1000000,3000000) ops and (325654.4,339220.2) ops/second in (3.070740,8.843813) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/6 2.15 GB 113.3 1.6 0.0 1.6 4.4 2.8 0.0 1.6 116.4 317.7 14.07 13.09 46 0.306 1663K 1738 0.0 0.0 L1 2/2 50.39 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 243.8 243.4 3.36 3.26 2 1.679 831K 1420 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 26 0.0 0.0 L3 27/0 962.69 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 214.0 213.9 6.52 5.73 4 1.629 1399K 708 0.0 0.0 L4 148/0 9.76 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1230/8 98.90 GB 0.0 3.9 1.2 2.7 6.6 3.9 1.0 2.4 162.3 278.3 24.41 22.53 53 0.461 4006K 3892 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 1.2 2.7 6.6 3.9 1.0 2.4 162.3 278.3 24.41 22.53 53 0.461 4006K 3892 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 1.2 2.7 3.9 1.2 0.0 0.0 240.5 240.3 16.48 15.46 13 1.267 4006K 3892 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 357.2 7.94 7.07 40 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.63 GB write, 753.48 MB/s write, 3.87 GB read, 439.52 MB/s read, 24.4 seconds Interval compaction: 6.63 GB write, 768.06 MB/s write, 3.87 GB read, 448.02 MB/s read, 24.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 772810 Average: 2.3193 StdDev: 11.36 Min: 1 Median: 1.5414 Max: 3441 Percentiles: P50: 1.54 P75: 1.93 P99: 5.75 P99.9: 9.96 P99.99: 14.52 ------------------------------------------------------ [ 0, 1 ] 113806 14.726% 14.726% ### ( 1, 2 ] 503466 65.147% 79.874% ############# ( 2, 3 ] 91270 11.810% 91.684% ## ( 3, 4 ] 34979 4.526% 96.210% # ( 4, 6 ] 24594 3.182% 99.392% # ( 6, 10 ] 3960 0.512% 99.905% ( 10, 15 ] 728 0.094% 99.999% ( 15, 22 ] 76 0.010% 100.009% ( 22, 34 ] 12 0.002% 100.010% ( 34, 51 ] 7 0.001% 100.011% ( 51, 76 ] 11 0.001% 100.013% ( 76, 110 ] 33 0.004% 100.017% ( 110, 170 ] 61 0.008% 100.025% ( 170, 250 ] 42 0.005% 100.030% ( 250, 380 ] 27 0.003% 100.034% ( 380, 580 ] 20 0.003% 100.036% ( 580, 870 ] 22 0.003% 100.039% ( 870, 1300 ] 8 0.001% 100.040% ( 1300, 1900 ] 6 0.001% 100.041% ( 1900, 2900 ] 3 0.000% 100.042% ( 2900, 4400 ] 4 0.001% 100.042% ** Level 1 read latency histogram (micros): Count: 207035 Average: 2.4231 StdDev: 10.78 Min: 1 Median: 1.6035 Max: 2723 Percentiles: P50: 1.60 P75: 2.00 P99: 5.91 P99.9: 13.03 P99.99: 243.75 ------------------------------------------------------ [ 0, 1 ] 23833 11.512% 11.512% ## ( 1, 2 ] 132043 63.778% 75.290% ############# ( 2, 3 ] 30596 14.778% 90.068% ### ( 3, 4 ] 10501 5.072% 95.140% # ( 4, 6 ] 8370 4.043% 99.183% # ( 6, 10 ] 1337 0.646% 99.829% ( 10, 15 ] 244 0.118% 99.946% ( 15, 22 ] 20 0.010% 99.956% ( 22, 34 ] 4 0.002% 99.958% ( 34, 51 ] 10 0.005% 99.963% ( 51, 76 ] 36 0.017% 99.980% ( 76, 110 ] 9 0.004% 99.985% ( 110, 170 ] 3 0.001% 99.986% ( 170, 250 ] 9 0.004% 99.990% ( 250, 380 ] 9 0.004% 99.995% ( 380, 580 ] 1 0.000% 99.995% ( 580, 870 ] 3 0.001% 99.997% ( 870, 1300 ] 4 0.002% 99.999% ( 1300, 1900 ] 1 0.000% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28299 Average: 2.0341 StdDev: 2.94 Min: 0 Median: 1.3850 Max: 322 Percentiles: P50: 1.38 P75: 1.82 P99: 5.68 P99.9: 9.99 P99.99: 176.80 ------------------------------------------------------ [ 0, 1 ] 7943 28.068% 28.068% ###### ( 1, 2 ] 16121 56.967% 85.035% ########### ( 2, 3 ] 2133 7.537% 92.572% ## ( 3, 4 ] 1130 3.993% 96.565% # ( 4, 6 ] 819 2.894% 99.459% # ( 6, 10 ] 125 0.442% 99.901% ( 10, 15 ] 19 0.067% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 195464 Average: 3.5717 StdDev: 27.57 Min: 0 Median: 1.6526 Max: 2659 Percentiles: P50: 1.65 P75: 2.20 P99: 9.18 P99.9: 249.71 P99.99: 807.47 ------------------------------------------------------ [ 0, 1 ] 16677 8.532% 8.532% ## ( 1, 2 ] 124197 63.540% 72.072% ############# ( 2, 3 ] 28550 14.606% 86.678% ### ( 3, 4 ] 12308 6.297% 92.975% # ( 4, 6 ] 8921 4.564% 97.539% # ( 6, 10 ] 3593 1.838% 99.377% ( 10, 15 ] 370 0.189% 99.566% ( 15, 22 ] 91 0.047% 99.613% ( 22, 34 ] 16 0.008% 99.621% ( 34, 51 ] 10 0.005% 99.626% ( 51, 76 ] 30 0.015% 99.641% ( 76, 110 ] 152 0.078% 99.719% ( 110, 170 ] 228 0.117% 99.836% ( 170, 250 ] 126 0.064% 99.900% ( 250, 380 ] 75 0.038% 99.939% ( 380, 580 ] 73 0.037% 99.976% ( 580, 870 ] 35 0.018% 99.994% ( 870, 1300 ] 25 0.013% 100.007% ( 1300, 1900 ] 11 0.006% 100.012% ( 1900, 2900 ] 7 0.004% 100.016% ** Level 4 read latency histogram (micros): Count: 35 Average: 1426.3429 StdDev: 1111.44 Min: 85 Median: 1269.2857 Max: 4582 Percentiles: P50: 1269.29 P75: 1962.50 P99: 4582.00 P99.9: 4582.00 P99.99: 4582.00 ------------------------------------------------------ ( 76, 110 ] 2 5.714% 5.714% # ( 110, 170 ] 1 2.857% 8.571% # ( 170, 250 ] 2 5.714% 14.286% # ( 250, 380 ] 3 8.571% 22.857% ## ( 380, 580 ] 2 5.714% 28.571% # ( 580, 870 ] 1 2.857% 31.429% # ( 870, 1300 ] 7 20.000% 51.429% #### ( 1300, 1900 ] 8 22.857% 74.286% ##### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 327.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.973 H:M:S, 10.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 320.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.390 H:M:S, 12.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-02:00:19 ... thread 0: (1000000,4000000) ops and (330626.2,337030.1) ops/second in (3.024564,11.868377) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/8 2.03 GB 151.0 2.2 0.0 2.2 5.8 3.7 0.0 1.6 116.9 317.2 18.86 17.55 61 0.309 2238K 2331 0.0 0.0 L1 10/0 1.09 GB 111.5 1.9 1.5 0.4 1.9 1.5 0.1 1.2 234.6 233.8 8.27 7.97 3 2.755 1968K 6562 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 26 0.0 0.0 L3 27/0 962.69 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 214.0 213.9 6.52 5.73 4 1.629 1399K 708 0.0 0.0 L4 148/0 9.76 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1239/8 99.82 GB 0.0 5.5 2.2 3.3 9.2 5.9 1.0 2.5 165.7 276.2 34.10 31.69 69 0.494 5720K 9627 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 2.2 3.3 9.2 5.9 1.0 2.5 165.7 276.2 34.10 31.69 69 0.494 5720K 9627 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 2.2 3.3 5.5 2.2 0.0 0.0 240.4 240.0 23.50 22.25 16 1.469 5720K 9627 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 356.5 10.60 9.43 53 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.20 GB write, 782.33 MB/s write, 5.52 GB read, 469.25 MB/s read, 34.1 seconds Interval compaction: 9.20 GB write, 793.61 MB/s write, 5.52 GB read, 476.02 MB/s read, 34.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1062825 Average: 2.2578 StdDev: 11.16 Min: 0 Median: 1.5039 Max: 3441 Percentiles: P50: 1.50 P75: 1.89 P99: 5.71 P99.9: 9.99 P99.99: 16.46 ------------------------------------------------------ [ 0, 1 ] 183052 17.223% 17.223% ### ( 1, 2 ] 691311 65.045% 82.268% ############# ( 2, 3 ] 111973 10.535% 92.803% ## ( 3, 4 ] 41862 3.939% 96.742% # ( 4, 6 ] 28134 2.647% 99.389% # ( 6, 10 ] 5446 0.512% 99.901% ( 10, 15 ] 919 0.086% 99.988% ( 15, 22 ] 114 0.011% 99.999% ( 22, 34 ] 14 0.001% 100.000% ( 34, 51 ] 8 0.001% 100.001% ( 51, 76 ] 14 0.001% 100.002% ( 76, 110 ] 72 0.007% 100.009% ( 110, 170 ] 87 0.008% 100.017% ( 170, 250 ] 57 0.005% 100.022% ( 250, 380 ] 42 0.004% 100.026% ( 380, 580 ] 35 0.003% 100.030% ( 580, 870 ] 29 0.003% 100.032% ( 870, 1300 ] 13 0.001% 100.034% ( 1300, 1900 ] 8 0.001% 100.034% ( 1900, 2900 ] 3 0.000% 100.035% ( 2900, 4400 ] 5 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 219878 Average: 2.5675 StdDev: 13.46 Min: 0 Median: 1.5995 Max: 2723 Percentiles: P50: 1.60 P75: 1.99 P99: 5.96 P99.9: 53.11 P99.99: 647.20 ------------------------------------------------------ [ 0, 1 ] 25633 11.658% 11.658% ## ( 1, 2 ] 140621 63.954% 75.612% ############# ( 2, 3 ] 31978 14.544% 90.155% ### ( 3, 4 ] 10976 4.992% 95.147% # ( 4, 6 ] 8630 3.925% 99.072% # ( 6, 10 ] 1526 0.694% 99.766% ( 10, 15 ] 253 0.115% 99.881% ( 15, 22 ] 23 0.010% 99.892% ( 22, 34 ] 5 0.002% 99.894% ( 34, 51 ] 10 0.005% 99.899% ( 51, 76 ] 37 0.017% 99.915% ( 76, 110 ] 62 0.028% 99.944% ( 110, 170 ] 40 0.018% 99.962% ( 170, 250 ] 24 0.011% 99.973% ( 250, 380 ] 22 0.010% 99.983% ( 380, 580 ] 13 0.006% 99.989% ( 580, 870 ] 13 0.006% 99.995% ( 870, 1300 ] 9 0.004% 99.999% ( 1300, 1900 ] 1 0.000% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28299 Average: 2.0341 StdDev: 2.94 Min: 0 Median: 1.3850 Max: 322 Percentiles: P50: 1.38 P75: 1.82 P99: 5.68 P99.9: 9.99 P99.99: 176.80 ------------------------------------------------------ [ 0, 1 ] 7943 28.068% 28.068% ###### ( 1, 2 ] 16121 56.967% 85.035% ########### ( 2, 3 ] 2133 7.537% 92.572% ## ( 3, 4 ] 1130 3.993% 96.565% # ( 4, 6 ] 819 2.894% 99.459% # ( 6, 10 ] 125 0.442% 99.901% ( 10, 15 ] 19 0.067% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 195464 Average: 3.5717 StdDev: 27.57 Min: 0 Median: 1.6526 Max: 2659 Percentiles: P50: 1.65 P75: 2.20 P99: 9.18 P99.9: 249.71 P99.99: 807.47 ------------------------------------------------------ [ 0, 1 ] 16677 8.532% 8.532% ## ( 1, 2 ] 124197 63.540% 72.072% ############# ( 2, 3 ] 28550 14.606% 86.678% ### ( 3, 4 ] 12308 6.297% 92.975% # ( 4, 6 ] 8921 4.564% 97.539% # ( 6, 10 ] 3593 1.838% 99.377% ( 10, 15 ] 370 0.189% 99.566% ( 15, 22 ] 91 0.047% 99.613% ( 22, 34 ] 16 0.008% 99.621% ( 34, 51 ] 10 0.005% 99.626% ( 51, 76 ] 30 0.015% 99.641% ( 76, 110 ] 152 0.078% 99.719% ( 110, 170 ] 228 0.117% 99.836% ( 170, 250 ] 126 0.064% 99.900% ( 250, 380 ] 75 0.038% 99.939% ( 380, 580 ] 73 0.037% 99.976% ( 580, 870 ] 35 0.018% 99.994% ( 870, 1300 ] 25 0.013% 100.007% ( 1300, 1900 ] 11 0.006% 100.012% ( 1900, 2900 ] 7 0.004% 100.016% ** Level 4 read latency histogram (micros): Count: 35 Average: 1426.3429 StdDev: 1111.44 Min: 85 Median: 1269.2857 Max: 4582 Percentiles: P50: 1269.29 P75: 1962.50 P99: 4582.00 P99.9: 4582.00 P99.99: 4582.00 ------------------------------------------------------ ( 76, 110 ] 2 5.714% 5.714% # ( 110, 170 ] 1 2.857% 8.571% # ( 170, 250 ] 2 5.714% 14.286% # ( 250, 380 ] 3 8.571% 22.857% ## ( 380, 580 ] 2 5.714% 28.571% # ( 580, 870 ] 1 2.857% 31.429% # ( 870, 1300 ] 7 20.000% 51.429% #### ( 1300, 1900 ] 8 22.857% 74.286% ##### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 326.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.408 H:M:S, 11.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.434 H:M:S, 14.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-02:00:22 ... thread 0: (1000000,5000000) ops and (340109.8,337641.5) ops/second in (2.940227,14.808604) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/4 3.01 GB 276.9 3.3 0.0 3.3 7.9 4.7 0.0 1.7 129.8 315.9 25.72 24.07 79 0.326 3390K 3600 0.0 0.0 L1 10/0 1.09 GB 111.5 1.9 1.5 0.4 1.9 1.5 0.1 1.2 234.6 233.8 8.27 7.97 3 2.755 1968K 6562 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 26 0.0 0.0 L3 27/0 962.69 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 214.0 213.9 6.52 5.73 4 1.629 1399K 708 0.0 0.0 L4 148/0 9.76 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/4 100.80 GB 0.0 6.6 2.2 4.4 11.3 6.9 1.0 2.4 165.6 282.2 40.96 38.21 87 0.471 6871K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.6 2.2 4.4 11.3 6.9 1.0 2.4 165.6 282.2 40.96 38.21 87 0.471 6871K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.6 2.2 4.4 6.6 2.2 0.0 0.0 245.2 244.8 27.67 26.35 20 1.383 6871K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 360.2 13.29 11.86 67 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.0 total, 14.8 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.29 GB write, 771.67 MB/s write, 6.63 GB read, 452.85 MB/s read, 41.0 seconds Interval compaction: 11.29 GB write, 780.59 MB/s write, 6.63 GB read, 458.08 MB/s read, 41.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 16, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1311619 Average: 2.1890 StdDev: 11.21 Min: 0 Median: 1.4674 Max: 3541 Percentiles: P50: 1.47 P75: 1.86 P99: 5.59 P99.9: 9.92 P99.99: 18.04 ------------------------------------------------------ [ 0, 1 ] 260790 19.883% 19.883% #### ( 1, 2 ] 845091 64.431% 84.314% ############# ( 2, 3 ] 123093 9.385% 93.699% ## ( 3, 4 ] 45759 3.489% 97.188% # ( 4, 6 ] 29817 2.273% 99.461% ( 6, 10 ] 5873 0.448% 99.909% ( 10, 15 ] 1005 0.077% 99.985% ( 15, 22 ] 140 0.011% 99.996% ( 22, 34 ] 20 0.002% 99.998% ( 34, 51 ] 11 0.001% 99.998% ( 51, 76 ] 18 0.001% 100.000% ( 76, 110 ] 72 0.005% 100.005% ( 110, 170 ] 95 0.007% 100.013% ( 170, 250 ] 62 0.005% 100.017% ( 250, 380 ] 48 0.004% 100.021% ( 380, 580 ] 37 0.003% 100.024% ( 580, 870 ] 37 0.003% 100.027% ( 870, 1300 ] 15 0.001% 100.028% ( 1300, 1900 ] 10 0.001% 100.029% ( 1900, 2900 ] 5 0.000% 100.029% ( 2900, 4400 ] 6 0.000% 100.029% ** Level 1 read latency histogram (micros): Count: 219878 Average: 2.5675 StdDev: 13.46 Min: 0 Median: 1.5995 Max: 2723 Percentiles: P50: 1.60 P75: 1.99 P99: 5.96 P99.9: 53.11 P99.99: 647.20 ------------------------------------------------------ [ 0, 1 ] 25633 11.658% 11.658% ## ( 1, 2 ] 140621 63.954% 75.612% ############# ( 2, 3 ] 31978 14.544% 90.155% ### ( 3, 4 ] 10976 4.992% 95.147% # ( 4, 6 ] 8630 3.925% 99.072% # ( 6, 10 ] 1526 0.694% 99.766% ( 10, 15 ] 253 0.115% 99.881% ( 15, 22 ] 23 0.010% 99.892% ( 22, 34 ] 5 0.002% 99.894% ( 34, 51 ] 10 0.005% 99.899% ( 51, 76 ] 37 0.017% 99.915% ( 76, 110 ] 62 0.028% 99.944% ( 110, 170 ] 40 0.018% 99.962% ( 170, 250 ] 24 0.011% 99.973% ( 250, 380 ] 22 0.010% 99.983% ( 380, 580 ] 13 0.006% 99.989% ( 580, 870 ] 13 0.006% 99.995% ( 870, 1300 ] 9 0.004% 99.999% ( 1300, 1900 ] 1 0.000% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28299 Average: 2.0341 StdDev: 2.94 Min: 0 Median: 1.3850 Max: 322 Percentiles: P50: 1.38 P75: 1.82 P99: 5.68 P99.9: 9.99 P99.99: 176.80 ------------------------------------------------------ [ 0, 1 ] 7943 28.068% 28.068% ###### ( 1, 2 ] 16121 56.967% 85.035% ########### ( 2, 3 ] 2133 7.537% 92.572% ## ( 3, 4 ] 1130 3.993% 96.565% # ( 4, 6 ] 819 2.894% 99.459% # ( 6, 10 ] 125 0.442% 99.901% ( 10, 15 ] 19 0.067% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 195464 Average: 3.5717 StdDev: 27.57 Min: 0 Median: 1.6526 Max: 2659 Percentiles: P50: 1.65 P75: 2.20 P99: 9.18 P99.9: 249.71 P99.99: 807.47 ------------------------------------------------------ [ 0, 1 ] 16677 8.532% 8.532% ## ( 1, 2 ] 124197 63.540% 72.072% ############# ( 2, 3 ] 28550 14.606% 86.678% ### ( 3, 4 ] 12308 6.297% 92.975% # ( 4, 6 ] 8921 4.564% 97.539% # ( 6, 10 ] 3593 1.838% 99.377% ( 10, 15 ] 370 0.189% 99.566% ( 15, 22 ] 91 0.047% 99.613% ( 22, 34 ] 16 0.008% 99.621% ( 34, 51 ] 10 0.005% 99.626% ( 51, 76 ] 30 0.015% 99.641% ( 76, 110 ] 152 0.078% 99.719% ( 110, 170 ] 228 0.117% 99.836% ( 170, 250 ] 126 0.064% 99.900% ( 250, 380 ] 75 0.038% 99.939% ( 380, 580 ] 73 0.037% 99.976% ( 580, 870 ] 35 0.018% 99.994% ( 870, 1300 ] 25 0.013% 100.007% ( 1300, 1900 ] 11 0.006% 100.012% ( 1900, 2900 ] 7 0.004% 100.016% ** Level 4 read latency histogram (micros): Count: 35 Average: 1426.3429 StdDev: 1111.44 Min: 85 Median: 1269.2857 Max: 4582 Percentiles: P50: 1269.29 P75: 1962.50 P99: 4582.00 P99.9: 4582.00 P99.99: 4582.00 ------------------------------------------------------ ( 76, 110 ] 2 5.714% 5.714% # ( 110, 170 ] 1 2.857% 8.571% # ( 170, 250 ] 2 5.714% 14.286% # ( 250, 380 ] 3 8.571% 22.857% ## ( 380, 580 ] 2 5.714% 28.571% # ( 580, 870 ] 1 2.857% 31.429% # ( 870, 1300 ] 7 20.000% 51.429% #### ( 1300, 1900 ] 8 22.857% 74.286% ##### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 15.0 total, 2.9 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 328.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.773 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 334.74 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.365 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-02:00:26 ... thread 0: (1000000,6000000) ops and (239548.7,316070.3) ops/second in (4.174517,18.983121) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 3.99 GB 37.8 4.4 0.0 4.4 10.0 5.7 0.0 1.8 136.6 313.4 32.75 30.72 97 0.338 4541K 4805 0.0 0.0 L1 10/10 1.09 GB 0.0 1.9 1.5 0.4 1.9 1.5 0.1 1.2 234.6 233.8 8.27 7.97 3 2.755 1968K 6562 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.6 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 26 0.0 0.0 L3 27/0 962.69 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 214.0 213.9 6.52 5.73 4 1.629 1399K 708 0.0 0.0 L4 148/0 9.76 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1243/26 101.78 GB 0.0 7.7 2.2 5.5 13.4 7.9 1.0 2.4 165.0 285.5 47.99 44.86 105 0.457 8022K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.7 2.2 5.5 13.4 7.9 1.0 2.4 165.0 285.5 47.99 44.86 105 0.457 8022K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.7 2.2 5.5 7.7 2.2 0.0 0.0 248.4 248.0 31.87 30.47 24 1.328 8022K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 359.6 16.12 14.39 81 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.2 total, 19.0 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.38 GB write, 715.25 MB/s write, 7.73 GB read, 413.35 MB/s read, 48.0 seconds Interval compaction: 13.38 GB write, 721.70 MB/s write, 7.73 GB read, 417.08 MB/s read, 48.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 19, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1665180 Average: 2.1675 StdDev: 11.43 Min: 0 Median: 1.4480 Max: 3701 Percentiles: P50: 1.45 P75: 1.83 P99: 5.51 P99.9: 10.29 P99.99: 91.97 ------------------------------------------------------ [ 0, 1 ] 349563 20.993% 20.993% #### ( 1, 2 ] 1078166 64.748% 85.740% ############# ( 2, 3 ] 142619 8.565% 94.305% ## ( 3, 4 ] 53655 3.222% 97.527% # ( 4, 6 ] 32546 1.955% 99.482% ( 6, 10 ] 6892 0.414% 99.896% ( 10, 15 ] 1263 0.076% 99.971% ( 15, 22 ] 169 0.010% 99.982% ( 22, 34 ] 21 0.001% 99.983% ( 34, 51 ] 12 0.001% 99.984% ( 51, 76 ] 22 0.001% 99.985% ( 76, 110 ] 182 0.011% 99.996% ( 110, 170 ] 202 0.012% 100.008% ( 170, 250 ] 95 0.006% 100.014% ( 250, 380 ] 67 0.004% 100.018% ( 380, 580 ] 53 0.003% 100.021% ( 580, 870 ] 49 0.003% 100.024% ( 870, 1300 ] 16 0.001% 100.025% ( 1300, 1900 ] 12 0.001% 100.025% ( 1900, 2900 ] 6 0.000% 100.026% ( 2900, 4400 ] 8 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 248193 Average: 2.5439 StdDev: 13.89 Min: 0 Median: 1.5761 Max: 2723 Percentiles: P50: 1.58 P75: 1.97 P99: 5.99 P99.9: 76.62 P99.99: 625.17 ------------------------------------------------------ [ 0, 1 ] 32431 13.067% 13.067% ### ( 1, 2 ] 159115 64.109% 77.176% ############# ( 2, 3 ] 33433 13.471% 90.647% ### ( 3, 4 ] 11769 4.742% 95.389% # ( 4, 6 ] 9025 3.636% 99.025% # ( 6, 10 ] 1819 0.733% 99.758% ( 10, 15 ] 274 0.110% 99.868% ( 15, 22 ] 25 0.010% 99.878% ( 22, 34 ] 5 0.002% 99.880% ( 34, 51 ] 10 0.004% 99.884% ( 51, 76 ] 37 0.015% 99.899% ( 76, 110 ] 99 0.040% 99.939% ( 110, 170 ] 58 0.023% 99.963% ( 170, 250 ] 28 0.011% 99.974% ( 250, 380 ] 24 0.010% 99.983% ( 380, 580 ] 14 0.006% 99.989% ( 580, 870 ] 14 0.006% 99.995% ( 870, 1300 ] 9 0.004% 99.998% ( 1300, 1900 ] 1 0.000% 99.999% ( 1900, 2900 ] 3 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28299 Average: 2.0341 StdDev: 2.94 Min: 0 Median: 1.3850 Max: 322 Percentiles: P50: 1.38 P75: 1.82 P99: 5.68 P99.9: 9.99 P99.99: 176.80 ------------------------------------------------------ [ 0, 1 ] 7943 28.068% 28.068% ###### ( 1, 2 ] 16121 56.967% 85.035% ########### ( 2, 3 ] 2133 7.537% 92.572% ## ( 3, 4 ] 1130 3.993% 96.565% # ( 4, 6 ] 819 2.894% 99.459% # ( 6, 10 ] 125 0.442% 99.901% ( 10, 15 ] 19 0.067% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 195464 Average: 3.5717 StdDev: 27.57 Min: 0 Median: 1.6526 Max: 2659 Percentiles: P50: 1.65 P75: 2.20 P99: 9.18 P99.9: 249.71 P99.99: 807.47 ------------------------------------------------------ [ 0, 1 ] 16677 8.532% 8.532% ## ( 1, 2 ] 124197 63.540% 72.072% ############# ( 2, 3 ] 28550 14.606% 86.678% ### ( 3, 4 ] 12308 6.297% 92.975% # ( 4, 6 ] 8921 4.564% 97.539% # ( 6, 10 ] 3593 1.838% 99.377% ( 10, 15 ] 370 0.189% 99.566% ( 15, 22 ] 91 0.047% 99.613% ( 22, 34 ] 16 0.008% 99.621% ( 34, 51 ] 10 0.005% 99.626% ( 51, 76 ] 30 0.015% 99.641% ( 76, 110 ] 152 0.078% 99.719% ( 110, 170 ] 228 0.117% 99.836% ( 170, 250 ] 126 0.064% 99.900% ( 250, 380 ] 75 0.038% 99.939% ( 380, 580 ] 73 0.037% 99.976% ( 580, 870 ] 35 0.018% 99.994% ( 870, 1300 ] 25 0.013% 100.007% ( 1300, 1900 ] 11 0.006% 100.012% ( 1900, 2900 ] 7 0.004% 100.016% ** Level 4 read latency histogram (micros): Count: 35 Average: 1426.3429 StdDev: 1111.44 Min: 85 Median: 1269.2857 Max: 4582 Percentiles: P50: 1269.29 P75: 1962.50 P99: 4582.00 P99.9: 4582.00 P99.99: 4582.00 ------------------------------------------------------ ( 76, 110 ] 2 5.714% 5.714% # ( 110, 170 ] 1 2.857% 8.571% # ( 170, 250 ] 2 5.714% 14.286% # ( 250, 380 ] 3 8.571% 22.857% ## ( 380, 580 ] 2 5.714% 28.571% # ( 580, 870 ] 1 2.857% 31.429% # ( 870, 1300 ] 7 20.000% 51.429% #### ( 1300, 1900 ] 8 22.857% 74.286% ##### ( 1900, 2900 ] 4 11.429% 85.714% ## ( 2900, 4400 ] 4 11.429% 97.143% ## ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 19.2 total, 4.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 308.27 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.304 H:M:S, 17.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 235.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.530 H:M:S, 36.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/14-02:00:51 ... thread 0: (1000000,7000000) ops and (40822.6,160996.0) ops/second in (24.496226,43.479347) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/6 1.35 GB 37.8 4.9 0.0 4.9 11.5 6.6 0.0 1.7 126.6 299.5 39.32 35.20 113 0.348 5053K 5246 0.0 0.0 L1 7/7 597.24 MB 0.0 6.6 5.2 1.4 6.5 5.1 0.1 1.3 215.3 211.7 31.43 28.46 4 7.858 6871K 113K 0.0 0.0 L2 8/8 957.65 MB 0.0 0.1 0.1 0.0 0.1 0.1 4.6 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 26 0.0 0.0 L3 20/9 1.66 GB 0.9 1.9 1.1 0.8 1.9 1.1 2.6 1.7 180.6 180.2 10.98 8.46 11 0.998 1624K 708 0.0 0.0 L4 183/69 12.12 GB 0.7 1.3 1.1 0.2 1.3 1.1 1.6 1.2 110.7 110.1 11.74 6.01 9 1.305 1320K 7179 0.0 0.0 L5 1040/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1268/99 102.65 GB 0.0 14.8 7.4 7.4 21.3 13.9 8.9 3.2 161.1 232.2 93.93 78.56 138 0.681 14M 127K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.8 7.4 7.4 21.3 13.9 8.9 3.2 161.1 232.2 93.93 78.56 138 0.681 14M 127K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.8 7.4 7.4 14.7 7.3 0.0 0.0 207.2 205.4 73.07 61.49 43 1.699 14M 127K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 326.1 20.87 17.07 95 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 43.7 total, 43.5 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.30 GB write, 499.64 MB/s write, 14.78 GB read, 346.77 MB/s read, 93.9 seconds Interval compaction: 21.30 GB write, 501.60 MB/s write, 14.78 GB read, 348.13 MB/s read, 93.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 34, interval: 48 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2742325 Average: 3.0213 StdDev: 25.77 Min: 0 Median: 1.4159 Max: 7318 Percentiles: P50: 1.42 P75: 1.81 P99: 7.34 P99.9: 163.91 P99.99: 487.10 ------------------------------------------------------ [ 0, 1 ] 651669 23.763% 23.763% ##### ( 1, 2 ] 1730100 63.089% 86.852% ############# ( 2, 3 ] 194006 7.075% 93.927% # ( 3, 4 ] 80790 2.946% 96.873% # ( 4, 6 ] 54194 1.976% 98.849% ( 6, 10 ] 12413 0.453% 99.302% ( 10, 15 ] 2477 0.090% 99.392% ( 15, 22 ] 457 0.017% 99.409% ( 22, 34 ] 32 0.001% 99.410% ( 34, 51 ] 13 0.000% 99.410% ( 51, 76 ] 126 0.005% 99.415% ( 76, 110 ] 8611 0.314% 99.729% ( 110, 170 ] 5226 0.191% 99.919% ( 170, 250 ] 852 0.031% 99.950% ( 250, 380 ] 765 0.028% 99.978% ( 380, 580 ] 599 0.022% 100.000% ( 580, 870 ] 261 0.010% 100.010% ( 870, 1300 ] 81 0.003% 100.013% ( 1300, 1900 ] 34 0.001% 100.014% ( 1900, 2900 ] 41 0.001% 100.015% ( 2900, 4400 ] 27 0.001% 100.016% ( 4400, 6600 ] 18 0.001% 100.017% ( 6600, 9900 ] 1 0.000% 100.017% ** Level 1 read latency histogram (micros): Count: 1143951 Average: 5.6369 StdDev: 84.94 Min: 0 Median: 1.6938 Max: 8981 Percentiles: P50: 1.69 P75: 2.50 P99: 8.79 P99.9: 98.41 P99.99: 142.14 ------------------------------------------------------ [ 0, 1 ] 133448 11.666% 11.666% ## ( 1, 2 ] 632027 55.249% 66.915% ########### ( 2, 3 ] 186045 16.263% 83.178% ### ( 3, 4 ] 87293 7.631% 90.809% ## ( 4, 6 ] 81211 7.099% 97.908% # ( 6, 10 ] 17893 1.564% 99.473% ( 10, 15 ] 3393 0.297% 99.769% ( 15, 22 ] 494 0.043% 99.812% ( 22, 34 ] 40 0.003% 99.816% ( 34, 51 ] 34 0.003% 99.819% ( 51, 76 ] 105 0.009% 99.828% ( 76, 110 ] 1250 0.109% 99.937% ( 110, 170 ] 1127 0.099% 100.036% ( 170, 250 ] 182 0.016% 100.052% ( 250, 380 ] 279 0.024% 100.076% ( 380, 580 ] 411 0.036% 100.112% ( 580, 870 ] 470 0.041% 100.153% ( 870, 1300 ] 358 0.031% 100.184% ( 1300, 1900 ] 213 0.019% 100.203% ( 1900, 2900 ] 250 0.022% 100.225% ( 2900, 4400 ] 257 0.022% 100.247% ( 4400, 6600 ] 62 0.005% 100.253% ( 6600, 9900 ] 10 0.001% 100.254% ** Level 2 read latency histogram (micros): Count: 28299 Average: 2.0341 StdDev: 2.94 Min: 0 Median: 1.3850 Max: 322 Percentiles: P50: 1.38 P75: 1.82 P99: 5.68 P99.9: 9.99 P99.99: 176.80 ------------------------------------------------------ [ 0, 1 ] 7943 28.068% 28.068% ###### ( 1, 2 ] 16121 56.967% 85.035% ########### ( 2, 3 ] 2133 7.537% 92.572% ## ( 3, 4 ] 1130 3.993% 96.565% # ( 4, 6 ] 819 2.894% 99.459% # ( 6, 10 ] 125 0.442% 99.901% ( 10, 15 ] 19 0.067% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 298812 Average: 11.3593 StdDev: 123.42 Min: 0 Median: 1.7239 Max: 6861 Percentiles: P50: 1.72 P75: 2.51 P99: 125.15 P99.9: 1591.65 P99.99: 3084.38 ------------------------------------------------------ [ 0, 1 ] 19929 6.669% 6.669% # ( 1, 2 ] 178852 59.854% 66.524% ############ ( 2, 3 ] 49670 16.622% 83.146% ### ( 3, 4 ] 23704 7.933% 91.079% ## ( 4, 6 ] 16395 5.487% 96.566% # ( 6, 10 ] 6019 2.014% 98.580% ( 10, 15 ] 758 0.254% 98.834% ( 15, 22 ] 153 0.051% 98.885% ( 22, 34 ] 29 0.010% 98.895% ( 34, 51 ] 15 0.005% 98.900% ( 51, 76 ] 34 0.011% 98.911% ( 76, 110 ] 176 0.059% 98.970% ( 110, 170 ] 356 0.119% 99.089% ( 170, 250 ] 312 0.104% 99.193% ( 250, 380 ] 426 0.143% 99.336% ( 380, 580 ] 636 0.213% 99.549% ( 580, 870 ] 561 0.188% 99.737% ( 870, 1300 ] 390 0.131% 99.867% ( 1300, 1900 ] 202 0.068% 99.935% ( 1900, 2900 ] 150 0.050% 99.985% ( 2900, 4400 ] 123 0.041% 100.026% ( 4400, 6600 ] 27 0.009% 100.035% ( 6600, 9900 ] 2 0.001% 100.036% ** Level 4 read latency histogram (micros): Count: 19292 Average: 7.6250 StdDev: 101.07 Min: 1 Median: 1.8737 Max: 4582 Percentiles: P50: 1.87 P75: 2.84 P99: 8.51 P99.9: 1456.93 P99.99: 2408.85 ------------------------------------------------------ [ 0, 1 ] 308 1.597% 1.597% ( 1, 2 ] 10688 55.401% 56.998% ########### ( 2, 3 ] 4128 21.397% 78.395% #### ( 3, 4 ] 2094 10.854% 89.249% ## ( 4, 6 ] 1740 9.019% 98.269% ## ( 6, 10 ] 225 1.166% 99.435% ( 10, 15 ] 22 0.114% 99.549% ( 15, 22 ] 4 0.021% 99.570% ( 22, 34 ] 5 0.026% 99.596% ( 34, 51 ] 8 0.041% 99.637% ( 51, 76 ] 3 0.016% 99.653% ( 76, 110 ] 3 0.016% 99.668% ( 110, 170 ] 2 0.010% 99.679% ( 170, 250 ] 18 0.093% 99.772% ( 250, 380 ] 3 0.016% 99.787% ( 380, 580 ] 3 0.016% 99.803% ( 580, 870 ] 3 0.016% 99.819% ( 870, 1300 ] 11 0.057% 99.876% ( 1300, 1900 ] 18 0.093% 99.969% ( 1900, 2900 ] 8 0.041% 100.010% ( 2900, 4400 ] 6 0.031% 100.041% ( 4400, 6600 ] 1 0.005% 100.047% ** DB Stats ** Uptime(secs): 43.7 total, 24.5 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 157.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.328 H:M:S, 55.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 40.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:21.025 H:M:S, 85.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/14-02:00:56 ... thread 0: (1000000,8000000) ops and (192447.7,164353.5) ops/second in (5.196216,48.675563) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 2.34 GB 106.9 5.9 0.0 5.9 13.5 7.6 0.0 1.8 124.5 285.1 48.59 42.21 128 0.380 6140K 6586 0.0 0.0 L1 7/7 597.24 MB 0.0 6.6 5.2 1.4 6.5 5.1 0.1 1.3 215.3 211.7 31.43 28.46 4 7.858 6871K 113K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 4.6 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 26 0.0 0.0 L3 14/3 924.35 MB 0.9 3.0 2.1 0.9 3.0 2.0 2.6 1.5 168.3 167.7 18.23 13.38 12 1.519 1754K 708 0.0 0.0 L4 206/54 13.80 GB 0.9 2.2 1.7 0.4 2.1 1.7 2.7 1.3 110.6 110.0 19.91 10.17 14 1.422 2237K 11K 0.0 0.0 L5 1040/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1280/74 103.63 GB 0.0 17.8 9.0 8.8 25.3 16.5 10.0 3.3 153.4 218.0 118.63 94.65 159 0.746 17M 132K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.8 9.0 8.8 25.3 16.5 9.9 3.3 153.4 218.0 118.63 94.65 159 0.746 17M 132K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.8 9.0 8.8 17.6 8.8 0.0 0.0 194.5 193.0 93.56 74.93 52 1.799 17M 132K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 311.5 25.07 19.72 107 0.234 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 48.8 total, 48.7 interval Flush(GB): cumulative 7.628, interval 7.628 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.26 GB write, 529.51 MB/s write, 17.77 GB read, 372.52 MB/s read, 118.6 seconds Interval compaction: 25.26 GB write, 531.38 MB/s write, 17.77 GB read, 373.83 MB/s read, 118.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 42, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 42, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3151236 Average: 3.3355 StdDev: 31.45 Min: 0 Median: 1.4670 Max: 7463 Percentiles: P50: 1.47 P75: 1.87 P99: 8.40 P99.9: 203.28 P99.99: 664.05 ------------------------------------------------------ [ 0, 1 ] 664119 21.075% 21.075% #### ( 1, 2 ] 1951650 61.933% 83.008% ############ ( 2, 3 ] 278874 8.850% 91.857% ## ( 3, 4 ] 119622 3.796% 95.653% # ( 4, 6 ] 91984 2.919% 98.572% # ( 6, 10 ] 22436 0.712% 99.284% ( 10, 15 ] 4034 0.128% 99.412% ( 15, 22 ] 695 0.022% 99.434% ( 22, 34 ] 40 0.001% 99.436% ( 34, 51 ] 17 0.001% 99.436% ( 51, 76 ] 127 0.004% 99.440% ( 76, 110 ] 8656 0.275% 99.715% ( 110, 170 ] 5379 0.171% 99.886% ( 170, 250 ] 1086 0.034% 99.920% ( 250, 380 ] 1080 0.034% 99.954% ( 380, 580 ] 959 0.030% 99.985% ( 580, 870 ] 562 0.018% 100.003% ( 870, 1300 ] 279 0.009% 100.012% ( 1300, 1900 ] 103 0.003% 100.015% ( 1900, 2900 ] 77 0.002% 100.017% ( 2900, 4400 ] 51 0.002% 100.019% ( 4400, 6600 ] 20 0.001% 100.019% ( 6600, 9900 ] 3 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1400202 Average: 5.8784 StdDev: 85.53 Min: 0 Median: 1.7392 Max: 8981 Percentiles: P50: 1.74 P75: 2.62 P99: 9.18 P99.9: 124.59 P99.99: 269.90 ------------------------------------------------------ [ 0, 1 ] 137055 9.788% 9.788% ## ( 1, 2 ] 761724 54.401% 64.189% ########### ( 2, 3 ] 244706 17.476% 81.666% ### ( 3, 4 ] 114327 8.165% 89.831% ## ( 4, 6 ] 107758 7.696% 97.527% ## ( 6, 10 ] 25978 1.855% 99.382% ( 10, 15 ] 4755 0.340% 99.722% ( 15, 22 ] 739 0.053% 99.774% ( 22, 34 ] 54 0.004% 99.778% ( 34, 51 ] 38 0.003% 99.781% ( 51, 76 ] 106 0.008% 99.788% ( 76, 110 ] 1270 0.091% 99.879% ( 110, 170 ] 1200 0.086% 99.965% ( 170, 250 ] 286 0.020% 99.985% ( 250, 380 ] 431 0.031% 100.016% ( 380, 580 ] 625 0.045% 100.061% ( 580, 870 ] 688 0.049% 100.110% ( 870, 1300 ] 484 0.035% 100.144% ( 1300, 1900 ] 277 0.020% 100.164% ( 1900, 2900 ] 315 0.022% 100.187% ( 2900, 4400 ] 318 0.023% 100.209% ( 4400, 6600 ] 74 0.005% 100.215% ( 6600, 9900 ] 11 0.001% 100.215% ** Level 2 read latency histogram (micros): Count: 28299 Average: 2.0341 StdDev: 2.94 Min: 0 Median: 1.3850 Max: 322 Percentiles: P50: 1.38 P75: 1.82 P99: 5.68 P99.9: 9.99 P99.99: 176.80 ------------------------------------------------------ [ 0, 1 ] 7943 28.068% 28.068% ###### ( 1, 2 ] 16121 56.967% 85.035% ########### ( 2, 3 ] 2133 7.537% 92.572% ## ( 3, 4 ] 1130 3.993% 96.565% # ( 4, 6 ] 819 2.894% 99.459% # ( 6, 10 ] 125 0.442% 99.901% ( 10, 15 ] 19 0.067% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 322535 Average: 11.9858 StdDev: 125.99 Min: 0 Median: 1.7412 Max: 6861 Percentiles: P50: 1.74 P75: 2.57 P99: 161.42 P99.9: 1683.86 P99.99: 3174.96 ------------------------------------------------------ [ 0, 1 ] 20305 6.295% 6.295% # ( 1, 2 ] 190174 58.962% 65.258% ############ ( 2, 3 ] 55513 17.211% 82.469% ### ( 3, 4 ] 26134 8.103% 90.572% ## ( 4, 6 ] 18833 5.839% 96.411% # ( 6, 10 ] 6732 2.087% 98.498% ( 10, 15 ] 861 0.267% 98.765% ( 15, 22 ] 169 0.052% 98.817% ( 22, 34 ] 31 0.010% 98.827% ( 34, 51 ] 16 0.005% 98.832% ( 51, 76 ] 35 0.011% 98.843% ( 76, 110 ] 181 0.056% 98.899% ( 110, 170 ] 380 0.118% 99.017% ( 170, 250 ] 349 0.108% 99.125% ( 250, 380 ] 489 0.152% 99.277% ( 380, 580 ] 717 0.222% 99.499% ( 580, 870 ] 675 0.209% 99.708% ( 870, 1300 ] 463 0.144% 99.852% ( 1300, 1900 ] 243 0.075% 99.927% ( 1900, 2900 ] 178 0.055% 99.982% ( 2900, 4400 ] 135 0.042% 100.024% ( 4400, 6600 ] 27 0.008% 100.033% ( 6600, 9900 ] 2 0.001% 100.033% ** Level 4 read latency histogram (micros): Count: 43224 Average: 7.8333 StdDev: 103.61 Min: 1 Median: 1.9405 Max: 5381 Percentiles: P50: 1.94 P75: 2.94 P99: 9.38 P99.9: 1427.05 P99.99: 2659.87 ------------------------------------------------------ [ 0, 1 ] 520 1.203% 1.203% ( 1, 2 ] 22427 51.886% 53.089% ########## ( 2, 3 ] 10129 23.434% 76.522% ##### ( 3, 4 ] 4656 10.772% 87.294% ## ( 4, 6 ] 4472 10.346% 97.640% ## ( 6, 10 ] 695 1.608% 99.248% ( 10, 15 ] 134 0.310% 99.558% ( 15, 22 ] 12 0.028% 99.586% ( 22, 34 ] 6 0.014% 99.600% ( 34, 51 ] 9 0.021% 99.621% ( 51, 76 ] 4 0.009% 99.630% ( 76, 110 ] 4 0.009% 99.639% ( 110, 170 ] 8 0.019% 99.658% ( 170, 250 ] 36 0.083% 99.741% ( 250, 380 ] 8 0.019% 99.759% ( 380, 580 ] 10 0.023% 99.783% ( 580, 870 ] 18 0.042% 99.824% ( 870, 1300 ] 26 0.060% 99.884% ( 1300, 1900 ] 32 0.074% 99.958% ( 1900, 2900 ] 18 0.042% 100.000% ( 2900, 4400 ] 14 0.032% 100.032% ( 4400, 6600 ] 3 0.007% 100.039% ** DB Stats ** Uptime(secs): 48.8 total, 5.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 161.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.739 H:M:S, 54.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 189.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.411 H:M:S, 46.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/07/14-02:01:00 ... thread 0: (1000000,9000000) ops and (240429.1,170342.3) ops/second in (4.159231,52.834794) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.21 GB 18.9 6.5 0.0 6.5 15.0 8.5 0.0 1.8 123.0 283.0 54.28 47.02 143 0.380 6779K 7331 0.0 0.0 L1 17/17 1.34 GB 0.0 8.2 6.1 2.0 8.1 6.0 0.1 1.3 198.9 195.9 42.09 36.00 5 8.419 7894K 113K 0.0 0.0 L2 1/0 55.45 MB 0.6 0.1 0.1 0.0 0.1 0.1 4.8 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 26 0.0 0.0 L3 14/0 980.17 MB 1.0 3.2 2.1 1.1 3.2 2.1 2.7 1.5 169.9 169.3 19.15 14.19 13 1.473 1942K 2057 0.0 0.0 L4 160/0 9.46 GB 1.0 6.8 1.8 5.0 6.8 1.8 2.7 3.7 147.6 147.1 47.30 30.02 18 2.628 3318K 11K 0.0 0.0 L5 1095/0 90.44 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1301/28 104.46 GB 0.0 24.8 10.1 14.7 33.1 18.5 14.7 3.9 155.5 207.7 163.29 127.67 180 0.907 20M 135K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.8 10.1 14.7 33.1 18.5 14.7 3.9 155.5 207.7 163.29 127.67 180 0.907 20M 135K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.8 10.1 14.7 24.6 10.0 0.0 0.0 187.4 186.2 135.51 105.70 60 2.259 20M 135K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 313.0 27.78 21.97 120 0.231 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 53.0 total, 52.8 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.13 GB write, 639.96 MB/s write, 24.80 GB read, 479.12 MB/s read, 163.3 seconds Interval compaction: 33.13 GB write, 642.03 MB/s write, 24.80 GB read, 480.67 MB/s read, 163.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 44, interval: 71 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3462953 Average: 3.5156 StdDev: 33.48 Min: 0 Median: 1.4860 Max: 7463 Percentiles: P50: 1.49 P75: 1.89 P99: 8.65 P99.9: 266.71 P99.99: 771.29 ------------------------------------------------------ [ 0, 1 ] 690205 19.931% 19.931% #### ( 1, 2 ] 2142348 61.865% 81.796% ############ ( 2, 3 ] 328250 9.479% 91.275% ## ( 3, 4 ] 139837 4.038% 95.313% # ( 4, 6 ] 109161 3.152% 98.465% # ( 6, 10 ] 27943 0.807% 99.272% ( 10, 15 ] 4698 0.136% 99.408% ( 15, 22 ] 785 0.023% 99.430% ( 22, 34 ] 51 0.001% 99.432% ( 34, 51 ] 22 0.001% 99.432% ( 51, 76 ] 130 0.004% 99.436% ( 76, 110 ] 8731 0.252% 99.688% ( 110, 170 ] 5682 0.164% 99.852% ( 170, 250 ] 1463 0.042% 99.895% ( 250, 380 ] 1447 0.042% 99.936% ( 380, 580 ] 1328 0.038% 99.975% ( 580, 870 ] 800 0.023% 99.998% ( 870, 1300 ] 415 0.012% 100.010% ( 1300, 1900 ] 164 0.005% 100.015% ( 1900, 2900 ] 94 0.003% 100.017% ( 2900, 4400 ] 58 0.002% 100.019% ( 4400, 6600 ] 22 0.001% 100.020% ( 6600, 9900 ] 3 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1514733 Average: 5.8319 StdDev: 83.36 Min: 0 Median: 1.7456 Max: 8981 Percentiles: P50: 1.75 P75: 2.63 P99: 9.28 P99.9: 143.39 P99.99: 353.55 ------------------------------------------------------ [ 0, 1 ] 142879 9.433% 9.433% ## ( 1, 2 ] 824192 54.412% 63.844% ########### ( 2, 3 ] 267870 17.684% 81.529% #### ( 3, 4 ] 123968 8.184% 89.713% ## ( 4, 6 ] 116644 7.701% 97.413% ## ( 6, 10 ] 29351 1.938% 99.351% ( 10, 15 ] 5280 0.349% 99.700% ( 15, 22 ] 836 0.055% 99.755% ( 22, 34 ] 65 0.004% 99.759% ( 34, 51 ] 38 0.003% 99.762% ( 51, 76 ] 107 0.007% 99.769% ( 76, 110 ] 1287 0.085% 99.854% ( 110, 170 ] 1260 0.083% 99.937% ( 170, 250 ] 376 0.025% 99.962% ( 250, 380 ] 538 0.036% 99.997% ( 380, 580 ] 741 0.049% 100.046% ( 580, 870 ] 765 0.051% 100.097% ( 870, 1300 ] 524 0.035% 100.131% ( 1300, 1900 ] 300 0.020% 100.151% ( 1900, 2900 ] 322 0.021% 100.172% ( 2900, 4400 ] 321 0.021% 100.193% ( 4400, 6600 ] 75 0.005% 100.198% ( 6600, 9900 ] 11 0.001% 100.199% ** Level 2 read latency histogram (micros): Count: 28299 Average: 2.0341 StdDev: 2.94 Min: 0 Median: 1.3850 Max: 322 Percentiles: P50: 1.38 P75: 1.82 P99: 5.68 P99.9: 9.99 P99.99: 176.80 ------------------------------------------------------ [ 0, 1 ] 7943 28.068% 28.068% ###### ( 1, 2 ] 16121 56.967% 85.035% ########### ( 2, 3 ] 2133 7.537% 92.572% ## ( 3, 4 ] 1130 3.993% 96.565% # ( 4, 6 ] 819 2.894% 99.459% # ( 6, 10 ] 125 0.442% 99.901% ( 10, 15 ] 19 0.067% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 348806 Average: 11.8231 StdDev: 122.92 Min: 0 Median: 1.7293 Max: 6861 Percentiles: P50: 1.73 P75: 2.52 P99: 171.99 P99.9: 1636.64 P99.99: 3145.77 ------------------------------------------------------ [ 0, 1 ] 22976 6.587% 6.587% # ( 1, 2 ] 207638 59.528% 66.115% ############ ( 2, 3 ] 59144 16.956% 83.071% ### ( 3, 4 ] 27342 7.839% 90.910% ## ( 4, 6 ] 19542 5.603% 96.513% # ( 6, 10 ] 6871 1.970% 98.483% ( 10, 15 ] 909 0.261% 98.743% ( 15, 22 ] 172 0.049% 98.792% ( 22, 34 ] 32 0.009% 98.802% ( 34, 51 ] 17 0.005% 98.806% ( 51, 76 ] 35 0.010% 98.817% ( 76, 110 ] 201 0.058% 98.874% ( 110, 170 ] 429 0.123% 98.997% ( 170, 250 ] 399 0.114% 99.112% ( 250, 380 ] 559 0.160% 99.272% ( 380, 580 ] 793 0.227% 99.499% ( 580, 870 ] 748 0.214% 99.714% ( 870, 1300 ] 506 0.145% 99.859% ( 1300, 1900 ] 257 0.074% 99.932% ( 1900, 2900 ] 179 0.051% 99.984% ( 2900, 4400 ] 135 0.039% 100.022% ( 4400, 6600 ] 27 0.008% 100.030% ( 6600, 9900 ] 2 0.001% 100.031% ** Level 4 read latency histogram (micros): Count: 43544 Average: 10.7587 StdDev: 119.03 Min: 1 Median: 1.9453 Max: 5381 Percentiles: P50: 1.95 P75: 2.95 P99: 13.57 P99.9: 1655.70 P99.99: 2835.50 ------------------------------------------------------ [ 0, 1 ] 529 1.215% 1.215% ( 1, 2 ] 22473 51.610% 52.825% ########## ( 2, 3 ] 10172 23.360% 76.185% ##### ( 3, 4 ] 4669 10.722% 86.907% ## ( 4, 6 ] 4473 10.272% 97.180% ## ( 6, 10 ] 697 1.601% 98.781% ( 10, 15 ] 134 0.308% 99.088% ( 15, 22 ] 13 0.030% 99.118% ( 22, 34 ] 7 0.016% 99.134% ( 34, 51 ] 9 0.021% 99.155% ( 51, 76 ] 4 0.009% 99.164% ( 76, 110 ] 22 0.051% 99.215% ( 110, 170 ] 28 0.064% 99.279% ( 170, 250 ] 55 0.126% 99.405% ( 250, 380 ] 43 0.099% 99.504% ( 380, 580 ] 38 0.087% 99.591% ( 580, 870 ] 47 0.108% 99.699% ( 870, 1300 ] 59 0.135% 99.835% ( 1300, 1900 ] 48 0.110% 99.945% ( 1900, 2900 ] 21 0.048% 99.993% ( 2900, 4400 ] 17 0.039% 100.032% ( 4400, 6600 ] 3 0.007% 100.039% ** Level 5 read latency histogram (micros): Count: 90 Average: 941.6444 StdDev: 1103.79 Min: 85 Median: 440.0000 Max: 4978 Percentiles: P50: 440.00 P75: 1400.00 P99: 4620.00 P99.9: 4978.00 P99.99: 4978.00 ------------------------------------------------------ ( 76, 110 ] 11 12.222% 12.222% ## ( 110, 170 ] 13 14.444% 26.667% ### ( 170, 250 ] 10 11.111% 37.778% ## ( 250, 380 ] 8 8.889% 46.667% ## ( 380, 580 ] 10 11.111% 57.778% ## ( 580, 870 ] 8 8.889% 66.667% ## ( 870, 1300 ] 6 6.667% 73.333% # ( 1300, 1900 ] 9 10.000% 83.333% ## ( 1900, 2900 ] 6 6.667% 90.000% # ( 2900, 4400 ] 8 8.889% 98.889% ## ( 4400, 6600 ] 1 1.111% 100.000% ** DB Stats ** Uptime(secs): 53.0 total, 4.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 167.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.164 H:M:S, 53.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 236.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.425 H:M:S, 34.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/14-02:01:03 ... thread 0: (1000000,10000000) ops and (304338.5,178187.7) ops/second in (3.285815,56.120609) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 3.20 GB 81.8 7.3 0.0 7.3 16.8 9.5 0.0 1.8 124.4 285.3 60.24 52.61 159 0.379 7611K 8135 0.0 0.0 L1 17/17 1.34 GB 0.0 8.2 6.1 2.0 8.1 6.0 0.1 1.3 198.9 195.9 42.09 36.00 5 8.419 7894K 113K 0.0 0.0 L2 1/0 55.45 MB 0.6 0.1 0.1 0.0 0.1 0.1 4.8 1.8 241.6 241.6 0.46 0.44 1 0.461 113K 26 0.0 0.0 L3 14/0 980.17 MB 1.0 3.2 2.1 1.1 3.2 2.1 2.7 1.5 169.9 169.3 19.15 14.19 13 1.473 1942K 2057 0.0 0.0 L4 160/0 9.46 GB 1.0 6.8 1.8 5.0 6.8 1.8 2.7 3.7 147.6 147.1 47.30 30.02 18 2.628 3318K 11K 0.0 0.0 L5 1095/0 90.44 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1305/32 105.45 GB 0.0 25.6 10.1 15.5 34.9 19.4 14.7 3.7 154.9 211.2 169.25 133.27 196 0.864 20M 136K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.6 10.1 15.5 34.9 19.4 14.7 3.7 154.9 211.2 169.25 133.27 196 0.864 20M 136K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.6 10.1 15.5 25.4 10.0 0.0 0.0 189.2 187.9 138.59 108.73 63 2.200 20M 136K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 316.5 30.65 24.54 133 0.230 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 56.3 total, 56.1 interval Flush(GB): cumulative 9.474, interval 9.474 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.91 GB write, 635.04 MB/s write, 25.60 GB read, 465.70 MB/s read, 169.2 seconds Interval compaction: 34.91 GB write, 636.98 MB/s write, 25.60 GB read, 467.12 MB/s read, 169.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 27, total-stops: 49, interval: 76 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3837564 Average: 3.3907 StdDev: 31.89 Min: 0 Median: 1.4912 Max: 7463 Percentiles: P50: 1.49 P75: 1.89 P99: 8.32 P99.9: 235.67 P99.99: 724.01 ------------------------------------------------------ [ 0, 1 ] 740688 19.301% 19.301% #### ( 1, 2 ] 2398521 62.501% 81.802% ############# ( 2, 3 ] 371908 9.691% 91.493% ## ( 3, 4 ] 153262 3.994% 95.487% # ( 4, 6 ] 117100 3.051% 98.539% # ( 6, 10 ] 30480 0.794% 99.333% ( 10, 15 ] 5099 0.133% 99.466% ( 15, 22 ] 814 0.021% 99.487% ( 22, 34 ] 53 0.001% 99.488% ( 34, 51 ] 22 0.001% 99.489% ( 51, 76 ] 132 0.003% 99.492% ( 76, 110 ] 8748 0.228% 99.720% ( 110, 170 ] 5692 0.148% 99.869% ( 170, 250 ] 1471 0.038% 99.907% ( 250, 380 ] 1459 0.038% 99.945% ( 380, 580 ] 1331 0.035% 99.980% ( 580, 870 ] 806 0.021% 100.001% ( 870, 1300 ] 421 0.011% 100.012% ( 1300, 1900 ] 165 0.004% 100.016% ( 1900, 2900 ] 95 0.002% 100.018% ( 2900, 4400 ] 58 0.002% 100.020% ( 4400, 6600 ] 22 0.001% 100.020% ( 6600, 9900 ] 3 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1577214 Average: 5.7252 StdDev: 81.75 Min: 0 Median: 1.7367 Max: 8981 Percentiles: P50: 1.74 P75: 2.60 P99: 9.26 P99.9: 146.59 P99.99: 359.96 ------------------------------------------------------ [ 0, 1 ] 149640 9.488% 9.488% ## ( 1, 2 ] 867301 54.989% 64.477% ########### ( 2, 3 ] 275514 17.468% 81.945% ### ( 3, 4 ] 126092 7.995% 89.940% ## ( 4, 6 ] 118189 7.494% 97.434% # ( 6, 10 ] 30292 1.921% 99.354% ( 10, 15 ] 5312 0.337% 99.691% ( 15, 22 ] 838 0.053% 99.744% ( 22, 34 ] 67 0.004% 99.748% ( 34, 51 ] 39 0.002% 99.751% ( 51, 76 ] 110 0.007% 99.758% ( 76, 110 ] 1422 0.090% 99.848% ( 110, 170 ] 1346 0.085% 99.933% ( 170, 250 ] 413 0.026% 99.959% ( 250, 380 ] 569 0.036% 99.996% ( 380, 580 ] 761 0.048% 100.044% ( 580, 870 ] 773 0.049% 100.093% ( 870, 1300 ] 524 0.033% 100.126% ( 1300, 1900 ] 300 0.019% 100.145% ( 1900, 2900 ] 322 0.020% 100.165% ( 2900, 4400 ] 321 0.020% 100.186% ( 4400, 6600 ] 75 0.005% 100.191% ( 6600, 9900 ] 11 0.001% 100.191% ** Level 2 read latency histogram (micros): Count: 28299 Average: 2.0341 StdDev: 2.94 Min: 0 Median: 1.3850 Max: 322 Percentiles: P50: 1.38 P75: 1.82 P99: 5.68 P99.9: 9.99 P99.99: 176.80 ------------------------------------------------------ [ 0, 1 ] 7943 28.068% 28.068% ###### ( 1, 2 ] 16121 56.967% 85.035% ########### ( 2, 3 ] 2133 7.537% 92.572% ## ( 3, 4 ] 1130 3.993% 96.565% # ( 4, 6 ] 819 2.894% 99.459% # ( 6, 10 ] 125 0.442% 99.901% ( 10, 15 ] 19 0.067% 99.968% ( 15, 22 ] 5 0.018% 99.986% ( 110, 170 ] 1 0.004% 99.989% ( 170, 250 ] 2 0.007% 99.996% ( 250, 380 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 348806 Average: 11.8231 StdDev: 122.92 Min: 0 Median: 1.7293 Max: 6861 Percentiles: P50: 1.73 P75: 2.52 P99: 171.99 P99.9: 1636.64 P99.99: 3145.77 ------------------------------------------------------ [ 0, 1 ] 22976 6.587% 6.587% # ( 1, 2 ] 207638 59.528% 66.115% ############ ( 2, 3 ] 59144 16.956% 83.071% ### ( 3, 4 ] 27342 7.839% 90.910% ## ( 4, 6 ] 19542 5.603% 96.513% # ( 6, 10 ] 6871 1.970% 98.483% ( 10, 15 ] 909 0.261% 98.743% ( 15, 22 ] 172 0.049% 98.792% ( 22, 34 ] 32 0.009% 98.802% ( 34, 51 ] 17 0.005% 98.806% ( 51, 76 ] 35 0.010% 98.817% ( 76, 110 ] 201 0.058% 98.874% ( 110, 170 ] 429 0.123% 98.997% ( 170, 250 ] 399 0.114% 99.112% ( 250, 380 ] 559 0.160% 99.272% ( 380, 580 ] 793 0.227% 99.499% ( 580, 870 ] 748 0.214% 99.714% ( 870, 1300 ] 506 0.145% 99.859% ( 1300, 1900 ] 257 0.074% 99.932% ( 1900, 2900 ] 179 0.051% 99.984% ( 2900, 4400 ] 135 0.039% 100.022% ( 4400, 6600 ] 27 0.008% 100.030% ( 6600, 9900 ] 2 0.001% 100.031% ** Level 4 read latency histogram (micros): Count: 43544 Average: 10.7587 StdDev: 119.03 Min: 1 Median: 1.9453 Max: 5381 Percentiles: P50: 1.95 P75: 2.95 P99: 13.57 P99.9: 1655.70 P99.99: 2835.50 ------------------------------------------------------ [ 0, 1 ] 529 1.215% 1.215% ( 1, 2 ] 22473 51.610% 52.825% ########## ( 2, 3 ] 10172 23.360% 76.185% ##### ( 3, 4 ] 4669 10.722% 86.907% ## ( 4, 6 ] 4473 10.272% 97.180% ## ( 6, 10 ] 697 1.601% 98.781% ( 10, 15 ] 134 0.308% 99.088% ( 15, 22 ] 13 0.030% 99.118% ( 22, 34 ] 7 0.016% 99.134% ( 34, 51 ] 9 0.021% 99.155% ( 51, 76 ] 4 0.009% 99.164% ( 76, 110 ] 22 0.051% 99.215% ( 110, 170 ] 28 0.064% 99.279% ( 170, 250 ] 55 0.126% 99.405% ( 250, 380 ] 43 0.099% 99.504% ( 380, 580 ] 38 0.087% 99.591% ( 580, 870 ] 47 0.108% 99.699% ( 870, 1300 ] 59 0.135% 99.835% ( 1300, 1900 ] 48 0.110% 99.945% ( 1900, 2900 ] 21 0.048% 99.993% ( 2900, 4400 ] 17 0.039% 100.032% ( 4400, 6600 ] 3 0.007% 100.039% ** Level 5 read latency histogram (micros): Count: 90 Average: 941.6444 StdDev: 1103.79 Min: 85 Median: 440.0000 Max: 4978 Percentiles: P50: 440.00 P75: 1400.00 P99: 4620.00 P99.9: 4978.00 P99.99: 4978.00 ------------------------------------------------------ ( 76, 110 ] 11 12.222% 12.222% ## ( 110, 170 ] 13 14.444% 26.667% ### ( 170, 250 ] 10 11.111% 37.778% ## ( 250, 380 ] 8 8.889% 46.667% ## ( 380, 580 ] 10 11.111% 57.778% ## ( 580, 870 ] 8 8.889% 66.667% ## ( 870, 1300 ] 6 6.667% 73.333% # ( 1300, 1900 ] 9 10.000% 83.333% ## ( 1900, 2900 ] 6 6.667% 90.000% # ( 2900, 4400 ] 8 8.889% 98.889% ## ( 4400, 6600 ] 1 1.111% 100.000% ** DB Stats ** Uptime(secs): 56.3 total, 3.3 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 174.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.772 H:M:S, 51.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 299.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.608 H:M:S, 18.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.618 micros/op 177986 ops/sec 60.072 seconds 10691999 operations; 172.5 MB/s Microseconds per write: Count: 10691999 Average: 5.6184 StdDev: 505.23 Min: 1 Median: 1.7481 Max: 884111 Percentiles: P50: 1.75 P75: 2.71 P99: 8.88 P99.9: 1116.37 P99.99: 2739.99 ------------------------------------------------------ [ 0, 1 ] 1358988 12.710% 12.710% ### ( 1, 2 ] 5329362 49.844% 62.555% ########## ( 2, 3 ] 1863389 17.428% 79.983% ### ( 3, 4 ] 1432269 13.396% 93.378% ### ( 4, 6 ] 518409 4.849% 98.227% # ( 6, 10 ] 114946 1.075% 99.302% ( 10, 15 ] 35419 0.331% 99.633% ( 15, 22 ] 9446 0.088% 99.722% ( 22, 34 ] 2064 0.019% 99.741% ( 34, 51 ] 296 0.003% 99.744% ( 51, 76 ] 50 0.000% 99.744% ( 76, 110 ] 7717 0.072% 99.816% ( 110, 170 ] 2672 0.025% 99.841% ( 170, 250 ] 283 0.003% 99.844% ( 250, 380 ] 153 0.001% 99.845% ( 380, 580 ] 23 0.000% 99.846% ( 580, 870 ] 21 0.000% 99.846% ( 870, 1300 ] 10123 0.095% 99.940% ( 1300, 1900 ] 44 0.000% 99.941% ( 1900, 2900 ] 6257 0.059% 99.999% ( 2900, 4400 ] 29 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 50000, 75000 ] 2 0.000% 100.000% ( 110000, 170000 ] 4 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 191421 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10691999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 11034142968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 576 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 30827916 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30815588426 rocksdb.compact.write.bytes COUNT : 30596142025 rocksdb.flush.write.bytes COUNT : 11031290814 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 83 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 255 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10942537728 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4423680 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 26011000886 rocksdb.non.last.level.read.count COUNT : 6276009 rocksdb.block.checksum.compute.count COUNT : 7459029 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.389851 P95 : 3.837091 P99 : 7.286191 P100 : 884108.000000 COUNT : 10691999 SUM : 54999909 rocksdb.compaction.times.micros P50 : 1164583.333333 P95 : 8686250.000000 P99 : 23166991.000000 P100 : 23166991.000000 COUNT : 67 SUM : 143010354 rocksdb.compaction.times.cpu_micros P50 : 984230.769231 P95 : 6307500.000000 P99 : 16640000.000000 P100 : 20482572.000000 COUNT : 67 SUM : 113028141 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 701.117647 P95 : 2775.000000 P99 : 104750.000000 P100 : 368508.000000 COUNT : 145 SUM : 916771 rocksdb.compaction.outfile.sync.micros P50 : 1048.046875 P95 : 122789.473684 P99 : 168136.842105 P100 : 216913.000000 COUNT : 359 SUM : 6941586 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 100.109091 P95 : 1504.000000 P99 : 4285.000000 P100 : 4867.000000 COUNT : 246 SUM : 81442 rocksdb.table.open.io.micros P50 : 1677.319588 P95 : 7685.806452 P99 : 11736.800000 P100 : 15898.000000 COUNT : 576 SUM : 1376904 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.646135 P95 : 8.114290 P99 : 13.062302 P100 : 21481.000000 COUNT : 7457316 SUM : 51455312 rocksdb.read.block.get.micros P50 : 609.635036 P95 : 3542.187500 P99 : 5558.666667 P100 : 8755.000000 COUNT : 1152 SUM : 1111071 rocksdb.write.raw.block.micros P50 : 0.514986 P95 : 0.978473 P99 : 2.867648 P100 : 61392.000000 COUNT : 10081998 SUM : 20704282 rocksdb.numfiles.in.singlecompaction P50 : 3.369048 P95 : 13.000000 P99 : 26.000000 P100 : 26.000000 COUNT : 128 SUM : 573 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567734 P95 : 1273.946659 P99 : 2686.198559 P100 : 883912.000000 COUNT : 138719 SUM : 30843057 rocksdb.sst.read.micros P50 : 1.561162 P95 : 4.551840 P99 : 9.100876 P100 : 8981.000000 COUNT : 6276107 SUM : 27855154 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10691999 SUM : 11034142968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211395.348837 P95 : 408500.000000 P99 : 953500.000000 P100 : 1031639.000000 COUNT : 145 SUM : 33046048 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 354 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0