[2024-07-26 16:18:46.807842] Starting SPDK v24.09-pre git sha1 704257090 / DPDK 24.03.0 initialization... [2024-07-26 16:18:46.807946] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid292784 ] Set seed to 1722003526805390 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-26 16:18:46.910052] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-26 16:18:47.116834] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-26 16:18:47.116876] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 292784' to capture a snapshot of events at runtime. [2024-07-26 16:18:47.116886] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-26 16:18:47.116895] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-26 16:18:47.116903] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid292784 for offline analysis/debug. [2024-07-26 16:18:47.116990] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 26 16:18:56 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/26-16:18:59 ... thread 0: (1000000,1000000) ops and (363826.3,363826.3) ops/second in (2.748564,2.748564) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 629.99 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 357.9 2.29 2.05 12 0.191 0 0 0.0 0.0 L1 1/1 63.00 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L2 1/0 1.01 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 242.9 242.8 0.52 0.50 1 0.519 127K 56 0.0 0.0 L3 18/0 929.32 MB 0.9 0.1 0.1 0.0 0.1 0.1 0.1 1.0 224.1 224.2 0.56 0.50 1 0.557 126K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/9 96.94 GB 0.0 0.2 0.2 0.1 1.0 1.0 0.4 1.3 74.6 318.0 3.36 3.05 14 0.240 254K 56 0.0 0.0 Int 0/0 0.00 KB 0.0 0.2 0.2 0.1 1.0 1.0 0.2 1.3 74.6 318.0 3.36 3.05 14 0.240 254K 56 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.2 0.2 0.1 0.2 0.2 0.0 0.0 233.2 233.1 1.08 1.00 2 0.538 254K 56 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 357.9 2.29 2.05 12 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.04 GB write, 357.56 MB/s write, 0.25 GB read, 83.86 MB/s read, 3.4 seconds Interval compaction: 1.04 GB write, 388.97 MB/s write, 0.25 GB read, 91.23 MB/s read, 3.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 116592 Average: 2.0548 StdDev: 17.12 Min: 1 Median: 1.3744 Max: 3068 Percentiles: P50: 1.37 P75: 1.75 P99: 4.83 P99.9: 9.56 P99.99: 130.04 ------------------------------------------------------ [ 0, 1 ] 29380 25.199% 25.199% ##### ( 1, 2 ] 77232 66.241% 91.440% ############# ( 2, 3 ] 6428 5.513% 96.953% # ( 3, 4 ] 1892 1.623% 98.576% ( 4, 6 ] 1197 1.027% 99.603% ( 6, 10 ] 392 0.336% 99.939% ( 10, 15 ] 48 0.041% 99.980% ( 15, 22 ] 4 0.003% 99.984% ( 22, 34 ] 4 0.003% 99.987% ( 51, 76 ] 1 0.001% 99.988% ( 76, 110 ] 1 0.001% 99.989% ( 110, 170 ] 10 0.009% 99.997% ( 250, 380 ] 1 0.001% 99.998% ( 380, 580 ] 4 0.003% 100.002% ( 580, 870 ] 1 0.001% 100.003% ( 870, 1300 ] 4 0.003% 100.006% ( 1300, 1900 ] 1 0.001% 100.007% ( 1900, 2900 ] 1 0.001% 100.008% ( 2900, 4400 ] 2 0.002% 100.009% ** Level 2 read latency histogram (micros): Count: 31733 Average: 2.7614 StdDev: 70.43 Min: 0 Median: 1.3048 Max: 7918 Percentiles: P50: 1.30 P75: 1.69 P99: 3.80 P99.9: 9.78 P99.99: 3813.35 ------------------------------------------------------ [ 0, 1 ] 9647 30.401% 30.401% ###### ( 1, 2 ] 20408 64.312% 94.712% ############# ( 2, 3 ] 1087 3.425% 98.138% # ( 3, 4 ] 344 1.084% 99.222% ( 4, 6 ] 150 0.473% 99.694% ( 6, 10 ] 69 0.217% 99.912% ( 10, 15 ] 15 0.047% 99.959% ( 15, 22 ] 1 0.003% 99.962% ( 170, 250 ] 2 0.006% 99.968% ( 250, 380 ] 1 0.003% 99.972% ( 580, 870 ] 2 0.006% 99.978% ( 870, 1300 ] 1 0.003% 99.981% ( 1900, 2900 ] 1 0.003% 99.984% ( 2900, 4400 ] 3 0.009% 99.994% ( 6600, 9900 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 1539.1500 StdDev: 2196.55 Min: 1 Median: 302.0000 Max: 8091 Percentiles: P50: 302.00 P75: 2900.00 P99: 8091.00 P99.9: 8091.00 P99.99: 8091.00 ------------------------------------------------------ [ 0, 1 ] 14 17.500% 17.500% #### ( 1, 2 ] 11 13.750% 31.250% ### ( 2, 3 ] 6 7.500% 38.750% ## ( 3, 4 ] 1 1.250% 40.000% ( 4, 6 ] 1 1.250% 41.250% ( 6, 10 ] 4 5.000% 46.250% # ( 170, 250 ] 1 1.250% 47.500% ( 250, 380 ] 5 6.250% 53.750% # ( 380, 580 ] 2 2.500% 56.250% # ( 580, 870 ] 4 5.000% 61.250% # ( 870, 1300 ] 2 2.500% 63.750% # ( 1300, 1900 ] 3 3.750% 67.500% # ( 1900, 2900 ] 6 7.500% 75.000% ## ( 2900, 4400 ] 11 13.750% 88.750% ### ( 4400, 6600 ] 5 6.250% 95.000% # ( 6600, 9900 ] 4 5.000% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 3945.9333 StdDev: 2345.05 Min: 681 Median: 3592.3077 Max: 9794 Percentiles: P50: 3592.31 P75: 4675.00 P99: 9652.50 P99.9: 9794.00 P99.99: 9794.00 ------------------------------------------------------ ( 580, 870 ] 1 3.333% 3.333% # ( 870, 1300 ] 2 6.667% 10.000% # ( 1300, 1900 ] 3 10.000% 20.000% ## ( 1900, 2900 ] 3 10.000% 30.000% ## ( 2900, 4400 ] 13 43.333% 73.333% ######### ( 4400, 6600 ] 4 13.333% 86.667% ### ( 6600, 9900 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 328.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.192 H:M:S, 6.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 357.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.192 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-16:19:02 ... thread 0: (1000000,2000000) ops and (325102.0,343375.8) ops/second in (3.075958,5.824522) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.29 GB 100.7 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.5 318.2 8.31 7.69 29 0.287 831K 831 0.0 0.0 L1 1/0 3.13 MB 0.3 0.4 0.3 0.1 0.4 0.3 0.2 1.2 244.6 244.2 1.55 1.51 1 1.545 383K 565 0.0 0.0 L2 2/1 117.73 MB 1.2 0.1 0.1 0.1 0.1 0.1 0.4 2.0 242.9 242.8 0.52 0.50 1 0.519 127K 56 0.0 0.0 L3 75/10 1.16 GB 0.4 0.5 0.4 0.1 0.5 0.4 0.1 1.3 180.1 180.0 2.75 2.27 2 1.374 502K 341 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1248/15 97.92 GB 0.0 1.8 0.7 1.0 3.6 2.5 0.7 2.0 138.5 277.6 13.12 11.96 33 0.398 1845K 1793 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 0.7 1.0 3.6 2.5 0.6 2.0 138.5 277.6 13.12 11.96 33 0.398 1845K 1793 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 0.7 1.0 1.8 0.7 0.0 0.0 227.1 226.8 8.01 7.41 7 1.144 1845K 1793 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 356.9 5.12 4.56 26 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.56 GB write, 600.36 MB/s write, 1.78 GB read, 299.60 MB/s read, 13.1 seconds Interval compaction: 3.56 GB write, 625.26 MB/s write, 1.78 GB read, 312.02 MB/s read, 13.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 382824 Average: 2.3507 StdDev: 13.10 Min: 1 Median: 1.5719 Max: 3068 Percentiles: P50: 1.57 P75: 1.96 P99: 5.82 P99.9: 11.13 P99.99: 19.92 ------------------------------------------------------ [ 0, 1 ] 50219 13.118% 13.118% ### ( 1, 2 ] 246872 64.487% 77.605% ############# ( 2, 3 ] 57491 15.018% 92.623% ### ( 3, 4 ] 13897 3.630% 96.253% # ( 4, 6 ] 11570 3.022% 99.275% # ( 6, 10 ] 2302 0.601% 99.876% ( 10, 15 ] 402 0.105% 99.981% ( 15, 22 ] 48 0.013% 99.994% ( 22, 34 ] 13 0.003% 99.997% ( 34, 51 ] 1 0.000% 99.998% ( 51, 76 ] 7 0.002% 99.999% ( 76, 110 ] 2 0.001% 100.000% ( 110, 170 ] 16 0.004% 100.004% ( 170, 250 ] 7 0.002% 100.006% ( 250, 380 ] 3 0.001% 100.007% ( 380, 580 ] 9 0.002% 100.009% ( 580, 870 ] 6 0.002% 100.011% ( 870, 1300 ] 8 0.002% 100.013% ( 1300, 1900 ] 5 0.001% 100.014% ( 1900, 2900 ] 3 0.001% 100.015% ( 2900, 4400 ] 2 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 65400 Average: 2.7447 StdDev: 8.17 Min: 1 Median: 1.8558 Max: 1225 Percentiles: P50: 1.86 P75: 2.60 P99: 6.84 P99.9: 12.51 P99.99: 62.50 ------------------------------------------------------ [ 0, 1 ] 1429 2.185% 2.185% ( 1, 2 ] 36539 55.870% 58.055% ########### ( 2, 3 ] 18402 28.138% 86.193% ###### ( 3, 4 ] 3761 5.751% 91.943% # ( 4, 6 ] 4471 6.836% 98.780% # ( 6, 10 ] 685 1.047% 99.827% ( 10, 15 ] 95 0.145% 99.972% ( 15, 22 ] 11 0.017% 99.989% ( 51, 76 ] 1 0.002% 99.991% ( 250, 380 ] 3 0.005% 99.995% ( 870, 1300 ] 3 0.005% 100.000% ** Level 2 read latency histogram (micros): Count: 31918 Average: 2.7633 StdDev: 70.23 Min: 0 Median: 1.3086 Max: 7918 Percentiles: P50: 1.31 P75: 1.70 P99: 3.85 P99.9: 9.78 P99.99: 3804.10 ------------------------------------------------------ [ 0, 1 ] 9647 30.224% 30.224% ###### ( 1, 2 ] 20456 64.089% 94.314% ############# ( 2, 3 ] 1187 3.719% 98.032% # ( 3, 4 ] 364 1.140% 99.173% ( 4, 6 ] 164 0.514% 99.687% ( 6, 10 ] 72 0.226% 99.912% ( 10, 15 ] 15 0.047% 99.959% ( 15, 22 ] 1 0.003% 99.962% ( 170, 250 ] 2 0.006% 99.969% ( 250, 380 ] 1 0.003% 99.972% ( 580, 870 ] 2 0.006% 99.978% ( 870, 1300 ] 1 0.003% 99.981% ( 1900, 2900 ] 1 0.003% 99.984% ( 2900, 4400 ] 3 0.009% 99.994% ( 6600, 9900 ] 2 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 173993 Average: 4.0814 StdDev: 59.98 Min: 1 Median: 1.7748 Max: 8091 Percentiles: P50: 1.77 P75: 2.50 P99: 9.38 P99.9: 222.53 P99.99: 680.75 ------------------------------------------------------ [ 0, 1 ] 7719 4.436% 4.436% # ( 1, 2 ] 102321 58.808% 63.244% ############ ( 2, 3 ] 40940 23.530% 86.774% ##### ( 3, 4 ] 9199 5.287% 92.061% # ( 4, 6 ] 9270 5.328% 97.388% # ( 6, 10 ] 3321 1.909% 99.297% ( 10, 15 ] 493 0.283% 99.580% ( 15, 22 ] 81 0.047% 99.627% ( 22, 34 ] 52 0.030% 99.657% ( 34, 51 ] 5 0.003% 99.660% ( 51, 76 ] 2 0.001% 99.661% ( 76, 110 ] 148 0.085% 99.746% ( 110, 170 ] 203 0.117% 99.863% ( 170, 250 ] 99 0.057% 99.920% ( 250, 380 ] 56 0.032% 99.952% ( 380, 580 ] 60 0.034% 99.986% ( 580, 870 ] 19 0.011% 99.997% ( 870, 1300 ] 13 0.007% 100.005% ( 1300, 1900 ] 5 0.003% 100.007% ( 1900, 2900 ] 6 0.003% 100.011% ( 2900, 4400 ] 11 0.006% 100.017% ( 4400, 6600 ] 5 0.003% 100.020% ( 6600, 9900 ] 4 0.002% 100.022% ** Level 4 read latency histogram (micros): Count: 30 Average: 3945.9333 StdDev: 2345.05 Min: 681 Median: 3592.3077 Max: 9794 Percentiles: P50: 3592.31 P75: 4675.00 P99: 9652.50 P99.9: 9794.00 P99.99: 9794.00 ------------------------------------------------------ ( 580, 870 ] 1 3.333% 3.333% # ( 870, 1300 ] 2 6.667% 10.000% # ( 1300, 1900 ] 3 10.000% 20.000% ## ( 1900, 2900 ] 3 10.000% 30.000% ## ( 2900, 4400 ] 13 43.333% 73.333% ######### ( 4400, 6600 ] 4 13.333% 86.667% ### ( 6600, 9900 ] 4 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.594 H:M:S, 9.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.402 H:M:S, 13.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-16:19:05 ... thread 0: (1000000,3000000) ops and (330763.5,339066.2) ops/second in (3.023308,8.847830) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 2.27 GB 12.6 1.9 0.0 1.9 4.7 2.8 0.0 1.7 125.6 307.8 15.55 14.50 47 0.331 1982K 2055 0.0 0.0 L1 1/1 3.13 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.2 1.2 244.6 244.2 1.55 1.51 1 1.545 383K 565 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 242.9 242.8 0.52 0.50 1 0.519 127K 56 0.0 0.0 L3 23/0 991.13 MB 1.0 1.5 0.5 1.0 1.5 0.5 0.1 3.1 213.2 213.0 7.17 6.36 4 1.792 1517K 1365 0.0 0.0 L4 152/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1236/11 98.90 GB 0.0 3.9 0.9 3.0 6.7 3.6 1.3 2.4 160.8 275.0 24.78 22.87 53 0.468 4011K 4041 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 0.9 3.0 6.7 3.6 1.2 2.4 160.8 275.0 24.78 22.87 53 0.468 4011K 4041 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 0.9 3.0 3.9 0.9 0.0 0.0 237.0 236.7 16.81 15.79 13 1.293 4011K 4041 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 355.9 7.96 7.08 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.8 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.66 GB write, 749.66 MB/s write, 3.89 GB read, 438.32 MB/s read, 24.8 seconds Interval compaction: 6.66 GB write, 770.12 MB/s write, 3.89 GB read, 450.28 MB/s read, 24.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 635970 Average: 2.4106 StdDev: 14.73 Min: 1 Median: 1.5767 Max: 3926 Percentiles: P50: 1.58 P75: 1.96 P99: 5.84 P99.9: 12.56 P99.99: 117.93 ------------------------------------------------------ [ 0, 1 ] 80192 12.609% 12.609% ### ( 1, 2 ] 412336 64.836% 77.445% ############# ( 2, 3 ] 97773 15.374% 92.819% ### ( 3, 4 ] 22284 3.504% 96.323% # ( 4, 6 ] 18486 2.907% 99.230% # ( 6, 10 ] 3825 0.601% 99.831% ( 10, 15 ] 855 0.134% 99.966% ( 15, 22 ] 85 0.013% 99.979% ( 22, 34 ] 15 0.002% 99.981% ( 34, 51 ] 4 0.001% 99.982% ( 51, 76 ] 11 0.002% 99.984% ( 76, 110 ] 33 0.005% 99.989% ( 110, 170 ] 56 0.009% 99.998% ( 170, 250 ] 31 0.005% 100.003% ( 250, 380 ] 22 0.003% 100.006% ( 380, 580 ] 24 0.004% 100.010% ( 580, 870 ] 26 0.004% 100.014% ( 870, 1300 ] 18 0.003% 100.017% ( 1300, 1900 ] 6 0.001% 100.018% ( 1900, 2900 ] 4 0.001% 100.018% ( 2900, 4400 ] 5 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 95033 Average: 2.6043 StdDev: 6.81 Min: 1 Median: 1.7802 Max: 1225 Percentiles: P50: 1.78 P75: 2.47 P99: 5.99 P99.9: 11.67 P99.99: 21.04 ------------------------------------------------------ [ 0, 1 ] 3578 3.765% 3.765% # ( 1, 2 ] 56314 59.257% 63.022% ############ ( 2, 3 ] 24445 25.723% 88.745% ##### ( 3, 4 ] 4603 4.844% 93.589% # ( 4, 6 ] 5181 5.452% 99.040% # ( 6, 10 ] 779 0.820% 99.860% ( 10, 15 ] 114 0.120% 99.980% ( 15, 22 ] 11 0.012% 99.992% ( 51, 76 ] 1 0.001% 99.993% ( 110, 170 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 60293 Average: 3.1297 StdDev: 53.37 Min: 0 Median: 1.4694 Max: 7918 Percentiles: P50: 1.47 P75: 1.86 P99: 7.34 P99.9: 181.40 P99.99: 1882.42 ------------------------------------------------------ [ 0, 1 ] 12021 19.938% 19.938% #### ( 1, 2 ] 38614 64.044% 83.982% ############# ( 2, 3 ] 6878 11.408% 95.389% ## ( 3, 4 ] 1154 1.914% 97.303% ( 4, 6 ] 831 1.378% 98.681% ( 6, 10 ] 575 0.954% 99.635% ( 10, 15 ] 61 0.101% 99.736% ( 15, 22 ] 7 0.012% 99.748% ( 51, 76 ] 1 0.002% 99.750% ( 76, 110 ] 5 0.008% 99.758% ( 110, 170 ] 83 0.138% 99.896% ( 170, 250 ] 19 0.032% 99.927% ( 250, 380 ] 14 0.023% 99.950% ( 380, 580 ] 11 0.018% 99.968% ( 580, 870 ] 9 0.015% 99.983% ( 870, 1300 ] 3 0.005% 99.988% ( 1300, 1900 ] 1 0.002% 99.990% ( 1900, 2900 ] 1 0.002% 99.992% ( 2900, 4400 ] 3 0.005% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 233110 Average: 3.7505 StdDev: 52.38 Min: 0 Median: 1.7573 Max: 8091 Percentiles: P50: 1.76 P75: 2.45 P99: 9.04 P99.9: 197.29 P99.99: 715.59 ------------------------------------------------------ [ 0, 1 ] 10964 4.703% 4.703% # ( 1, 2 ] 139433 59.814% 64.518% ############ ( 2, 3 ] 53854 23.102% 87.620% ##### ( 3, 4 ] 11823 5.072% 92.692% # ( 4, 6 ] 11616 4.983% 97.675% # ( 6, 10 ] 4069 1.746% 99.420% ( 10, 15 ] 561 0.241% 99.661% ( 15, 22 ] 90 0.039% 99.700% ( 22, 34 ] 55 0.024% 99.723% ( 34, 51 ] 5 0.002% 99.725% ( 51, 76 ] 2 0.001% 99.726% ( 76, 110 ] 160 0.069% 99.795% ( 110, 170 ] 206 0.088% 99.883% ( 170, 250 ] 114 0.049% 99.932% ( 250, 380 ] 58 0.025% 99.957% ( 380, 580 ] 65 0.028% 99.985% ( 580, 870 ] 25 0.011% 99.996% ( 870, 1300 ] 16 0.007% 100.003% ( 1300, 1900 ] 7 0.003% 100.006% ( 1900, 2900 ] 6 0.003% 100.008% ( 2900, 4400 ] 11 0.005% 100.013% ( 4400, 6600 ] 5 0.002% 100.015% ( 6600, 9900 ] 4 0.002% 100.017% ** Level 4 read latency histogram (micros): Count: 30 Average: 3945.9333 StdDev: 2345.05 Min: 681 Median: 3592.3077 Max: 9794 Percentiles: P50: 3592.31 P75: 4675.00 P99: 9652.50 P99.9: 9794.00 P99.99: 9794.00 ------------------------------------------------------ ( 580, 870 ] 1 3.333% 3.333% # ( 870, 1300 ] 2 6.667% 10.000% # ( 1300, 1900 ] 3 10.000% 20.000% ## ( 1900, 2900 ] 3 10.000% 30.000% ## ( 2900, 4400 ] 13 43.333% 73.333% ######### ( 4400, 6600 ] 4 13.333% 86.667% ### ( 6600, 9900 ] 4 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 936.4500 StdDev: 1233.72 Min: 101 Median: 170.0000 Max: 3875 Percentiles: P50: 170.00 P75: 1600.00 P99: 3875.00 P99.9: 3875.00 P99.99: 3875.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 5 25.000% 50.000% ##### ( 170, 250 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.76 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.992 H:M:S, 10.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.54 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.398 H:M:S, 13.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/26-16:19:08 ... thread 0: (1000000,4000000) ops and (305833.8,330098.9) ops/second in (3.269750,12.117580) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.26 GB 88.1 2.4 0.0 2.4 6.1 3.8 0.0 1.6 120.1 307.8 20.46 19.04 62 0.330 2494K 2541 0.0 0.0 L1 1/1 3.13 MB 0.0 0.4 0.3 0.1 0.4 0.3 0.2 1.2 244.6 244.2 1.55 1.51 1 1.545 383K 565 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 242.9 242.8 0.52 0.50 1 0.519 127K 56 0.0 0.0 L3 23/0 991.13 MB 1.0 1.5 0.5 1.0 1.5 0.5 0.1 3.1 213.2 213.0 7.17 6.36 4 1.792 1517K 1365 0.0 0.0 L4 152/0 9.53 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1243/15 99.88 GB 0.0 4.4 0.9 3.5 8.1 4.6 1.3 2.2 151.2 280.5 29.69 27.40 68 0.437 4523K 4527 0.0 0.0 Int 0/0 0.00 KB 0.0 4.4 0.9 3.5 8.1 4.6 1.2 2.2 151.2 280.5 29.69 27.40 68 0.437 4523K 4527 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.4 0.9 3.5 4.4 0.9 0.0 0.0 239.5 239.2 18.74 17.69 15 1.250 4523K 4527 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 351.1 10.94 9.71 53 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.4 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.13 GB write, 673.63 MB/s write, 4.38 GB read, 363.15 MB/s read, 29.7 seconds Interval compaction: 8.13 GB write, 687.05 MB/s write, 4.38 GB read, 370.39 MB/s read, 29.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 988055 Average: 2.3673 StdDev: 13.60 Min: 1 Median: 1.5724 Max: 4356 Percentiles: P50: 1.57 P75: 1.95 P99: 5.80 P99.9: 11.95 P99.99: 86.31 ------------------------------------------------------ [ 0, 1 ] 121228 12.269% 12.269% ## ( 1, 2 ] 651322 65.920% 78.189% ############# ( 2, 3 ] 151316 15.315% 93.503% ### ( 3, 4 ] 31296 3.167% 96.671% # ( 4, 6 ] 25512 2.582% 99.253% # ( 6, 10 ] 5933 0.600% 99.853% ( 10, 15 ] 1181 0.120% 99.973% ( 15, 22 ] 119 0.012% 99.985% ( 22, 34 ] 16 0.002% 99.987% ( 34, 51 ] 4 0.000% 99.987% ( 51, 76 ] 12 0.001% 99.988% ( 76, 110 ] 60 0.006% 99.994% ( 110, 170 ] 82 0.008% 100.003% ( 170, 250 ] 41 0.004% 100.007% ( 250, 380 ] 35 0.004% 100.010% ( 380, 580 ] 29 0.003% 100.013% ( 580, 870 ] 30 0.003% 100.016% ( 870, 1300 ] 24 0.002% 100.019% ( 1300, 1900 ] 7 0.001% 100.019% ( 1900, 2900 ] 4 0.000% 100.020% ( 2900, 4400 ] 7 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 95033 Average: 2.6043 StdDev: 6.81 Min: 1 Median: 1.7802 Max: 1225 Percentiles: P50: 1.78 P75: 2.47 P99: 5.99 P99.9: 11.67 P99.99: 21.04 ------------------------------------------------------ [ 0, 1 ] 3578 3.765% 3.765% # ( 1, 2 ] 56314 59.257% 63.022% ############ ( 2, 3 ] 24445 25.723% 88.745% ##### ( 3, 4 ] 4603 4.844% 93.589% # ( 4, 6 ] 5181 5.452% 99.040% # ( 6, 10 ] 779 0.820% 99.860% ( 10, 15 ] 114 0.120% 99.980% ( 15, 22 ] 11 0.012% 99.992% ( 51, 76 ] 1 0.001% 99.993% ( 110, 170 ] 1 0.001% 99.994% ( 250, 380 ] 3 0.003% 99.997% ( 870, 1300 ] 3 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 60293 Average: 3.1297 StdDev: 53.37 Min: 0 Median: 1.4694 Max: 7918 Percentiles: P50: 1.47 P75: 1.86 P99: 7.34 P99.9: 181.40 P99.99: 1882.42 ------------------------------------------------------ [ 0, 1 ] 12021 19.938% 19.938% #### ( 1, 2 ] 38614 64.044% 83.982% ############# ( 2, 3 ] 6878 11.408% 95.389% ## ( 3, 4 ] 1154 1.914% 97.303% ( 4, 6 ] 831 1.378% 98.681% ( 6, 10 ] 575 0.954% 99.635% ( 10, 15 ] 61 0.101% 99.736% ( 15, 22 ] 7 0.012% 99.748% ( 51, 76 ] 1 0.002% 99.750% ( 76, 110 ] 5 0.008% 99.758% ( 110, 170 ] 83 0.138% 99.896% ( 170, 250 ] 19 0.032% 99.927% ( 250, 380 ] 14 0.023% 99.950% ( 380, 580 ] 11 0.018% 99.968% ( 580, 870 ] 9 0.015% 99.983% ( 870, 1300 ] 3 0.005% 99.988% ( 1300, 1900 ] 1 0.002% 99.990% ( 1900, 2900 ] 1 0.002% 99.992% ( 2900, 4400 ] 3 0.005% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 233110 Average: 3.7505 StdDev: 52.38 Min: 0 Median: 1.7573 Max: 8091 Percentiles: P50: 1.76 P75: 2.45 P99: 9.04 P99.9: 197.29 P99.99: 715.59 ------------------------------------------------------ [ 0, 1 ] 10964 4.703% 4.703% # ( 1, 2 ] 139433 59.814% 64.518% ############ ( 2, 3 ] 53854 23.102% 87.620% ##### ( 3, 4 ] 11823 5.072% 92.692% # ( 4, 6 ] 11616 4.983% 97.675% # ( 6, 10 ] 4069 1.746% 99.420% ( 10, 15 ] 561 0.241% 99.661% ( 15, 22 ] 90 0.039% 99.700% ( 22, 34 ] 55 0.024% 99.723% ( 34, 51 ] 5 0.002% 99.725% ( 51, 76 ] 2 0.001% 99.726% ( 76, 110 ] 160 0.069% 99.795% ( 110, 170 ] 206 0.088% 99.883% ( 170, 250 ] 114 0.049% 99.932% ( 250, 380 ] 58 0.025% 99.957% ( 380, 580 ] 65 0.028% 99.985% ( 580, 870 ] 25 0.011% 99.996% ( 870, 1300 ] 16 0.007% 100.003% ( 1300, 1900 ] 7 0.003% 100.006% ( 1900, 2900 ] 6 0.003% 100.008% ( 2900, 4400 ] 11 0.005% 100.013% ( 4400, 6600 ] 5 0.002% 100.015% ( 6600, 9900 ] 4 0.002% 100.017% ** Level 4 read latency histogram (micros): Count: 30 Average: 3945.9333 StdDev: 2345.05 Min: 681 Median: 3592.3077 Max: 9794 Percentiles: P50: 3592.31 P75: 4675.00 P99: 9652.50 P99.9: 9794.00 P99.99: 9794.00 ------------------------------------------------------ ( 580, 870 ] 1 3.333% 3.333% # ( 870, 1300 ] 2 6.667% 10.000% # ( 1300, 1900 ] 3 10.000% 20.000% ## ( 1900, 2900 ] 3 10.000% 30.000% ## ( 2900, 4400 ] 13 43.333% 73.333% ######### ( 4400, 6600 ] 4 13.333% 86.667% ### ( 6600, 9900 ] 4 13.333% 100.000% ### ** Level 5 read latency histogram (micros): Count: 20 Average: 936.4500 StdDev: 1233.72 Min: 101 Median: 170.0000 Max: 3875 Percentiles: P50: 170.00 P75: 1600.00 P99: 3875.00 P99.9: 3875.00 P99.99: 3875.00 ------------------------------------------------------ ( 76, 110 ] 5 25.000% 25.000% ##### ( 110, 170 ] 5 25.000% 50.000% ##### ( 170, 250 ] 2 10.000% 60.000% ## ( 580, 870 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 2 10.000% 80.000% ## ( 1900, 2900 ] 1 5.000% 85.000% # ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 12.4 total, 3.3 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 318.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.658 H:M:S, 13.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 301.00 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.666 H:M:S, 20.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-16:19:16 ... thread 0: (1000000,5000000) ops and (130891.4,253068.4) ops/second in (7.639921,19.757501) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.03 GB 44.1 3.1 0.0 3.1 7.8 4.7 0.0 1.7 121.5 302.4 26.44 24.27 79 0.335 3262K 3318 0.0 0.0 L1 5/0 247.31 MB 24.7 2.5 2.5 0.1 2.5 2.4 0.2 1.0 231.6 229.6 11.16 10.77 2 5.578 2623K 22K 0.0 0.0 L2 4/3 515.10 MB 1.3 0.1 0.1 0.1 0.1 0.1 2.3 2.0 242.9 242.8 0.52 0.50 1 0.519 127K 56 0.0 0.0 L3 17/1 1.06 GB 1.0 1.6 0.6 1.0 1.6 0.6 1.4 2.8 208.0 207.8 7.75 6.78 5 1.550 1587K 1365 0.0 0.0 L4 152/0 9.53 GB 1.0 0.7 0.6 0.2 0.7 0.6 1.0 1.3 134.3 133.7 5.48 3.47 5 1.096 731K 2768 0.0 0.0 L5 1064/0 87.42 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/15 100.78 GB 0.0 8.1 3.6 4.4 12.7 8.3 6.6 2.7 161.1 253.7 51.35 45.79 92 0.558 8332K 30K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.1 3.6 4.4 12.7 8.3 6.5 2.7 161.1 253.7 51.35 45.79 92 0.558 8332K 30K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.1 3.6 4.4 8.0 3.6 0.0 0.0 222.2 221.3 37.23 33.62 25 1.489 8332K 30K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 339.2 14.12 12.17 67 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.0 total, 19.8 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.72 GB write, 651.33 MB/s write, 8.08 GB read, 413.53 MB/s read, 51.3 seconds Interval compaction: 12.72 GB write, 659.29 MB/s write, 8.08 GB read, 418.59 MB/s read, 51.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 20, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1828182 Average: 2.4244 StdDev: 13.04 Min: 0 Median: 1.5900 Max: 5922 Percentiles: P50: 1.59 P75: 1.97 P99: 6.02 P99.9: 12.89 P99.99: 125.22 ------------------------------------------------------ [ 0, 1 ] 205890 11.262% 11.262% ## ( 1, 2 ] 1200272 65.654% 76.916% ############# ( 2, 3 ] 287301 15.715% 92.631% ### ( 3, 4 ] 61511 3.365% 95.996% # ( 4, 6 ] 54858 3.001% 98.996% # ( 6, 10 ] 15097 0.826% 99.822% ( 10, 15 ] 2464 0.135% 99.957% ( 15, 22 ] 251 0.014% 99.971% ( 22, 34 ] 34 0.002% 99.972% ( 34, 51 ] 15 0.001% 99.973% ( 51, 76 ] 14 0.001% 99.974% ( 76, 110 ] 195 0.011% 99.985% ( 110, 170 ] 387 0.021% 100.006% ( 170, 250 ] 96 0.005% 100.011% ( 250, 380 ] 69 0.004% 100.015% ( 380, 580 ] 61 0.003% 100.018% ( 580, 870 ] 51 0.003% 100.021% ( 870, 1300 ] 30 0.002% 100.023% ( 1300, 1900 ] 10 0.001% 100.023% ( 1900, 2900 ] 6 0.000% 100.024% ( 2900, 4400 ] 10 0.001% 100.024% ( 4400, 6600 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 310267 Average: 3.9005 StdDev: 47.16 Min: 1 Median: 2.0629 Max: 6720 Percentiles: P50: 2.06 P75: 2.89 P99: 8.73 P99.9: 13.72 P99.99: 14.87 ------------------------------------------------------ [ 0, 1 ] 4597 1.482% 1.482% ( 1, 2 ] 144616 46.610% 48.092% ######### ( 2, 3 ] 94184 30.356% 78.448% ###### ( 3, 4 ] 26989 8.699% 87.146% ## ( 4, 6 ] 32715 10.544% 97.690% ## ( 6, 10 ] 5954 1.919% 99.609% ( 10, 15 ] 1213 0.391% 100.000% ( 15, 22 ] 133 0.043% 100.043% ( 22, 34 ] 11 0.004% 100.047% ( 34, 51 ] 3 0.001% 100.048% ( 51, 76 ] 5 0.002% 100.049% ( 76, 110 ] 18 0.006% 100.055% ( 110, 170 ] 43 0.014% 100.069% ( 170, 250 ] 23 0.007% 100.076% ( 250, 380 ] 31 0.010% 100.086% ( 380, 580 ] 37 0.012% 100.098% ( 580, 870 ] 23 0.007% 100.106% ( 870, 1300 ] 30 0.010% 100.115% ( 1300, 1900 ] 15 0.005% 100.120% ( 1900, 2900 ] 31 0.010% 100.130% ( 2900, 4400 ] 24 0.008% 100.138% ( 4400, 6600 ] 2 0.001% 100.139% ( 6600, 9900 ] 1 0.000% 100.139% ** Level 2 read latency histogram (micros): Count: 60293 Average: 3.1297 StdDev: 53.37 Min: 0 Median: 1.4694 Max: 7918 Percentiles: P50: 1.47 P75: 1.86 P99: 7.34 P99.9: 181.40 P99.99: 1882.42 ------------------------------------------------------ [ 0, 1 ] 12021 19.938% 19.938% #### ( 1, 2 ] 38614 64.044% 83.982% ############# ( 2, 3 ] 6878 11.408% 95.389% ## ( 3, 4 ] 1154 1.914% 97.303% ( 4, 6 ] 831 1.378% 98.681% ( 6, 10 ] 575 0.954% 99.635% ( 10, 15 ] 61 0.101% 99.736% ( 15, 22 ] 7 0.012% 99.748% ( 51, 76 ] 1 0.002% 99.750% ( 76, 110 ] 5 0.008% 99.758% ( 110, 170 ] 83 0.138% 99.896% ( 170, 250 ] 19 0.032% 99.927% ( 250, 380 ] 14 0.023% 99.950% ( 380, 580 ] 11 0.018% 99.968% ( 580, 870 ] 9 0.015% 99.983% ( 870, 1300 ] 3 0.005% 99.988% ( 1300, 1900 ] 1 0.002% 99.990% ( 1900, 2900 ] 1 0.002% 99.992% ( 2900, 4400 ] 3 0.005% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 293971 Average: 7.5323 StdDev: 98.03 Min: 0 Median: 1.8147 Max: 8091 Percentiles: P50: 1.81 P75: 2.60 P99: 11.50 P99.9: 865.84 P99.99: 2741.79 ------------------------------------------------------ [ 0, 1 ] 11508 3.915% 3.915% # ( 1, 2 ] 166296 56.569% 60.484% ########### ( 2, 3 ] 71215 24.225% 84.709% ##### ( 3, 4 ] 18664 6.349% 91.058% # ( 4, 6 ] 17306 5.887% 96.945% # ( 6, 10 ] 5765 1.961% 98.906% ( 10, 15 ] 924 0.314% 99.220% ( 15, 22 ] 129 0.044% 99.264% ( 22, 34 ] 58 0.020% 99.284% ( 34, 51 ] 5 0.002% 99.285% ( 51, 76 ] 3 0.001% 99.286% ( 76, 110 ] 177 0.060% 99.347% ( 110, 170 ] 362 0.123% 99.470% ( 170, 250 ] 356 0.121% 99.591% ( 250, 380 ] 301 0.102% 99.693% ( 380, 580 ] 335 0.114% 99.807% ( 580, 870 ] 277 0.094% 99.901% ( 870, 1300 ] 125 0.043% 99.944% ( 1300, 1900 ] 59 0.020% 99.964% ( 1900, 2900 ] 91 0.031% 99.995% ( 2900, 4400 ] 80 0.027% 100.022% ( 4400, 6600 ] 11 0.004% 100.026% ( 6600, 9900 ] 7 0.002% 100.028% ** Level 4 read latency histogram (micros): Count: 145 Average: 927.0552 StdDev: 1893.08 Min: 1 Median: 6.5000 Max: 9794 Percentiles: P50: 6.50 P75: 809.58 P99: 8703.75 P99.9: 9780.38 P99.99: 9794.00 ------------------------------------------------------ [ 0, 1 ] 20 13.793% 13.793% ### ( 1, 2 ] 33 22.759% 36.552% ##### ( 2, 3 ] 12 8.276% 44.828% ## ( 3, 4 ] 3 2.069% 46.897% ( 4, 6 ] 4 2.759% 49.655% # ( 6, 10 ] 4 2.759% 52.414% # ( 10, 15 ] 1 0.690% 53.103% ( 15, 22 ] 1 0.690% 53.793% ( 22, 34 ] 1 0.690% 54.483% ( 51, 76 ] 3 2.069% 56.552% ( 110, 170 ] 14 9.655% 66.207% ## ( 170, 250 ] 1 0.690% 66.897% ( 250, 380 ] 2 1.379% 68.276% ( 380, 580 ] 5 3.448% 71.724% # ( 580, 870 ] 6 4.138% 75.862% # ( 870, 1300 ] 8 5.517% 81.379% # ( 1300, 1900 ] 3 2.069% 83.448% ( 1900, 2900 ] 3 2.069% 85.517% ( 2900, 4400 ] 13 8.966% 94.483% ## ( 4400, 6600 ] 4 2.759% 97.241% # ( 6600, 9900 ] 4 2.759% 100.000% # ** Level 5 read latency histogram (micros): Count: 100 Average: 1273.5500 StdDev: 1656.01 Min: 101 Median: 546.6667 Max: 10632 Percentiles: P50: 546.67 P75: 1750.00 P99: 9900.00 P99.9: 10632.00 P99.99: 10632.00 ------------------------------------------------------ ( 76, 110 ] 7 7.000% 7.000% # ( 110, 170 ] 17 17.000% 24.000% ### ( 170, 250 ] 12 12.000% 36.000% ## ( 250, 380 ] 9 9.000% 45.000% ## ( 380, 580 ] 6 6.000% 51.000% # ( 580, 870 ] 8 8.000% 59.000% ## ( 870, 1300 ] 10 10.000% 69.000% ## ( 1300, 1900 ] 8 8.000% 77.000% ## ( 1900, 2900 ] 7 7.000% 84.000% # ( 2900, 4400 ] 13 13.000% 97.000% ### ( 4400, 6600 ] 1 1.000% 98.000% ( 6600, 9900 ] 1 1.000% 99.000% ( 9900, 14000 ] 1 1.000% 100.000% ** DB Stats ** Uptime(secs): 20.0 total, 7.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 246.03 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.313 H:M:S, 31.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 128.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.655 H:M:S, 60.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/26-16:19:19 ... thread 0: (1000000,6000000) ops and (328982.8,263190.5) ops/second in (3.039673,22.797174) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 3.00 GB 6.3 5.6 0.0 5.6 11.2 5.6 0.0 2.0 145.4 292.0 39.43 36.60 98 0.402 5819K 12K 0.0 0.0 L1 5/5 247.31 MB 0.0 2.5 2.5 0.1 2.5 2.4 0.2 1.0 231.6 229.6 11.16 10.77 2 5.578 2623K 22K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.3 2.0 242.9 242.8 0.52 0.50 1 0.519 127K 56 0.0 0.0 L3 12/0 878.58 MB 0.9 2.1 0.9 1.1 2.1 0.9 1.6 2.2 205.1 204.8 10.30 8.99 6 1.716 2094K 3421 0.0 0.0 L4 164/0 9.56 GB 1.0 0.9 0.7 0.2 0.9 0.7 1.6 1.3 143.0 142.4 6.31 4.22 6 1.051 900K 3444 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1263/14 101.75 GB 0.0 11.2 4.1 7.0 16.8 9.8 7.9 3.0 169.2 254.1 67.71 61.07 113 0.599 11M 42K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.2 4.1 7.0 16.8 9.8 7.8 3.0 169.2 254.1 67.71 61.07 113 0.599 11M 42K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.2 4.1 7.0 11.1 4.1 0.0 0.0 226.0 225.2 50.68 46.35 32 1.584 11M 42K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 340.3 17.03 14.73 81 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.0 total, 22.8 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.80 GB write, 746.82 MB/s write, 11.19 GB read, 497.18 MB/s read, 67.7 seconds Interval compaction: 16.80 GB write, 754.73 MB/s write, 11.19 GB read, 502.45 MB/s read, 67.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 31, interval: 39 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2141234 Average: 2.4405 StdDev: 13.89 Min: 0 Median: 1.5952 Max: 5922 Percentiles: P50: 1.60 P75: 1.98 P99: 6.05 P99.9: 12.80 P99.99: 114.29 ------------------------------------------------------ [ 0, 1 ] 236340 11.038% 11.038% ## ( 1, 2 ] 1401579 65.457% 76.494% ############# ( 2, 3 ] 341098 15.930% 92.424% ### ( 3, 4 ] 73859 3.449% 95.874% # ( 4, 6 ] 66724 3.116% 98.990% # ( 6, 10 ] 17820 0.832% 99.822% ( 10, 15 ] 2984 0.139% 99.961% ( 15, 22 ] 293 0.014% 99.975% ( 22, 34 ] 36 0.002% 99.977% ( 34, 51 ] 19 0.001% 99.977% ( 51, 76 ] 16 0.001% 99.978% ( 76, 110 ] 223 0.010% 99.989% ( 110, 170 ] 404 0.019% 100.008% ( 170, 250 ] 109 0.005% 100.013% ( 250, 380 ] 80 0.004% 100.016% ( 380, 580 ] 71 0.003% 100.020% ( 580, 870 ] 60 0.003% 100.022% ( 870, 1300 ] 37 0.002% 100.024% ( 1300, 1900 ] 13 0.001% 100.025% ( 1900, 2900 ] 11 0.001% 100.025% ( 2900, 4400 ] 14 0.001% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 390361 Average: 3.6791 StdDev: 42.33 Min: 1 Median: 1.9751 Max: 6720 Percentiles: P50: 1.98 P75: 2.81 P99: 8.57 P99.9: 13.84 P99.99: 17.08 ------------------------------------------------------ [ 0, 1 ] 7316 1.874% 1.874% ( 1, 2 ] 192663 49.355% 51.229% ########## ( 2, 3 ] 114163 29.245% 80.475% ###### ( 3, 4 ] 30731 7.872% 88.347% ## ( 4, 6 ] 37073 9.497% 97.844% ## ( 6, 10 ] 7011 1.796% 99.640% ( 10, 15 ] 1320 0.338% 99.978% ( 15, 22 ] 151 0.039% 100.017% ( 22, 34 ] 11 0.003% 100.020% ( 34, 51 ] 4 0.001% 100.021% ( 51, 76 ] 6 0.002% 100.023% ( 76, 110 ] 23 0.006% 100.028% ( 110, 170 ] 69 0.018% 100.046% ( 170, 250 ] 30 0.008% 100.054% ( 250, 380 ] 40 0.010% 100.064% ( 380, 580 ] 45 0.012% 100.076% ( 580, 870 ] 31 0.008% 100.084% ( 870, 1300 ] 32 0.008% 100.092% ( 1300, 1900 ] 15 0.004% 100.096% ( 1900, 2900 ] 31 0.008% 100.103% ( 2900, 4400 ] 24 0.006% 100.110% ( 4400, 6600 ] 2 0.001% 100.110% ( 6600, 9900 ] 1 0.000% 100.110% ** Level 2 read latency histogram (micros): Count: 60293 Average: 3.1297 StdDev: 53.37 Min: 0 Median: 1.4694 Max: 7918 Percentiles: P50: 1.47 P75: 1.86 P99: 7.34 P99.9: 181.40 P99.99: 1882.42 ------------------------------------------------------ [ 0, 1 ] 12021 19.938% 19.938% #### ( 1, 2 ] 38614 64.044% 83.982% ############# ( 2, 3 ] 6878 11.408% 95.389% ## ( 3, 4 ] 1154 1.914% 97.303% ( 4, 6 ] 831 1.378% 98.681% ( 6, 10 ] 575 0.954% 99.635% ( 10, 15 ] 61 0.101% 99.736% ( 15, 22 ] 7 0.012% 99.748% ( 51, 76 ] 1 0.002% 99.750% ( 76, 110 ] 5 0.008% 99.758% ( 110, 170 ] 83 0.138% 99.896% ( 170, 250 ] 19 0.032% 99.927% ( 250, 380 ] 14 0.023% 99.950% ( 380, 580 ] 11 0.018% 99.968% ( 580, 870 ] 9 0.015% 99.983% ( 870, 1300 ] 3 0.005% 99.988% ( 1300, 1900 ] 1 0.002% 99.990% ( 1900, 2900 ] 1 0.002% 99.992% ( 2900, 4400 ] 3 0.005% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 314972 Average: 7.2794 StdDev: 94.90 Min: 0 Median: 1.8065 Max: 8091 Percentiles: P50: 1.81 P75: 2.58 P99: 11.01 P99.9: 845.52 P99.99: 2718.71 ------------------------------------------------------ [ 0, 1 ] 12719 4.038% 4.038% # ( 1, 2 ] 179491 56.986% 61.024% ########### ( 2, 3 ] 75568 23.992% 85.016% ##### ( 3, 4 ] 19641 6.236% 91.252% # ( 4, 6 ] 18122 5.754% 97.006% # ( 6, 10 ] 6088 1.933% 98.939% ( 10, 15 ] 956 0.304% 99.242% ( 15, 22 ] 134 0.043% 99.285% ( 22, 34 ] 60 0.019% 99.304% ( 34, 51 ] 6 0.002% 99.306% ( 51, 76 ] 4 0.001% 99.307% ( 76, 110 ] 178 0.057% 99.363% ( 110, 170 ] 395 0.125% 99.489% ( 170, 250 ] 371 0.118% 99.607% ( 250, 380 ] 306 0.097% 99.704% ( 380, 580 ] 358 0.114% 99.817% ( 580, 870 ] 284 0.090% 99.908% ( 870, 1300 ] 126 0.040% 99.948% ( 1300, 1900 ] 59 0.019% 99.966% ( 1900, 2900 ] 91 0.029% 99.995% ( 2900, 4400 ] 80 0.025% 100.021% ( 4400, 6600 ] 11 0.003% 100.024% ( 6600, 9900 ] 7 0.002% 100.026% ** Level 4 read latency histogram (micros): Count: 170 Average: 806.8059 StdDev: 1773.87 Min: 1 Median: 4.0000 Max: 9794 Percentiles: P50: 4.00 P75: 598.12 P99: 8497.50 P99.9: 9759.75 P99.99: 9794.00 ------------------------------------------------------ [ 0, 1 ] 27 15.882% 15.882% ### ( 1, 2 ] 41 24.118% 40.000% ##### ( 2, 3 ] 13 7.647% 47.647% ## ( 3, 4 ] 4 2.353% 50.000% ( 4, 6 ] 4 2.353% 52.353% ( 6, 10 ] 4 2.353% 54.706% ( 10, 15 ] 1 0.588% 55.294% ( 15, 22 ] 1 0.588% 55.882% ( 22, 34 ] 1 0.588% 56.471% ( 51, 76 ] 3 1.765% 58.235% ( 110, 170 ] 18 10.588% 68.824% ## ( 170, 250 ] 1 0.588% 69.412% ( 250, 380 ] 3 1.765% 71.176% ( 380, 580 ] 6 3.529% 74.706% # ( 580, 870 ] 8 4.706% 79.412% # ( 870, 1300 ] 8 4.706% 84.118% # ( 1300, 1900 ] 3 1.765% 85.882% ( 1900, 2900 ] 3 1.765% 87.647% ( 2900, 4400 ] 13 7.647% 95.294% ## ( 4400, 6600 ] 4 2.353% 97.647% ( 6600, 9900 ] 4 2.353% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1165.0571 StdDev: 1551.35 Min: 82 Median: 465.7143 Max: 10632 Percentiles: P50: 465.71 P75: 1600.00 P99: 8580.00 P99.9: 10632.00 P99.99: 10632.00 ------------------------------------------------------ ( 76, 110 ] 13 9.286% 9.286% ## ( 110, 170 ] 27 19.286% 28.571% #### ( 170, 250 ] 17 12.143% 40.714% ## ( 250, 380 ] 10 7.143% 47.857% # ( 380, 580 ] 7 5.000% 52.857% # ( 580, 870 ] 13 9.286% 62.143% ## ( 870, 1300 ] 12 8.571% 70.714% ## ( 1300, 1900 ] 12 8.571% 79.286% ## ( 1900, 2900 ] 10 7.143% 86.429% # ( 2900, 4400 ] 14 10.000% 96.429% ## ( 4400, 6600 ] 3 2.143% 98.571% ( 6600, 9900 ] 1 0.714% 99.286% ( 9900, 14000 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 23.0 total, 3.0 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 256.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.758 H:M:S, 29.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.445 H:M:S, 14.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/26-16:19:22 ... thread 0: (1000000,7000000) ops and (314504.1,269471.4) ops/second in (3.179609,25.976783) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/13 3.99 GB 81.8 6.2 0.0 6.2 12.8 6.6 0.0 1.9 141.6 294.2 44.49 41.30 113 0.394 6395K 13K 0.0 0.0 L1 5/5 247.31 MB 0.0 2.5 2.5 0.1 2.5 2.4 0.2 1.0 231.6 229.6 11.16 10.77 2 5.578 2623K 22K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.3 2.0 242.9 242.8 0.52 0.50 1 0.519 127K 56 0.0 0.0 L3 12/0 878.58 MB 0.9 2.1 0.9 1.1 2.1 0.9 1.6 2.2 205.1 204.8 10.30 8.99 6 1.716 2094K 3421 0.0 0.0 L4 164/0 9.56 GB 1.0 0.9 0.7 0.2 0.9 0.7 1.6 1.3 143.0 142.4 6.31 4.22 6 1.051 900K 3444 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/18 102.74 GB 0.0 11.7 4.1 7.6 18.3 10.7 7.9 2.8 165.2 258.1 72.76 65.78 128 0.568 12M 43K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.7 4.1 7.6 18.3 10.7 7.8 2.8 165.2 258.1 72.76 65.78 128 0.568 12M 43K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.7 4.1 7.6 11.7 4.1 0.0 0.0 227.4 226.5 52.87 48.50 34 1.555 12M 43K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 342.1 19.89 17.27 94 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.2 total, 26.0 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.34 GB write, 716.29 MB/s write, 11.74 GB read, 458.51 MB/s read, 72.8 seconds Interval compaction: 18.34 GB write, 722.95 MB/s write, 11.74 GB read, 462.78 MB/s read, 72.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 35, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2492182 Average: 2.4449 StdDev: 13.79 Min: 0 Median: 1.5989 Max: 5922 Percentiles: P50: 1.60 P75: 1.98 P99: 6.00 P99.9: 12.64 P99.99: 114.54 ------------------------------------------------------ [ 0, 1 ] 267440 10.731% 10.731% ## ( 1, 2 ] 1634151 65.571% 76.302% ############# ( 2, 3 ] 404141 16.216% 92.519% ### ( 3, 4 ] 84791 3.402% 95.921% # ( 4, 6 ] 76886 3.085% 99.006% # ( 6, 10 ] 20567 0.825% 99.831% ( 10, 15 ] 3244 0.130% 99.961% ( 15, 22 ] 337 0.014% 99.975% ( 22, 34 ] 46 0.002% 99.977% ( 34, 51 ] 23 0.001% 99.978% ( 51, 76 ] 19 0.001% 99.978% ( 76, 110 ] 251 0.010% 99.989% ( 110, 170 ] 513 0.021% 100.009% ( 170, 250 ] 136 0.005% 100.015% ( 250, 380 ] 95 0.004% 100.018% ( 380, 580 ] 78 0.003% 100.022% ( 580, 870 ] 69 0.003% 100.024% ( 870, 1300 ] 42 0.002% 100.026% ( 1300, 1900 ] 15 0.001% 100.027% ( 1900, 2900 ] 13 0.001% 100.027% ( 2900, 4400 ] 17 0.001% 100.028% ( 4400, 6600 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 390361 Average: 3.6791 StdDev: 42.33 Min: 1 Median: 1.9751 Max: 6720 Percentiles: P50: 1.98 P75: 2.81 P99: 8.57 P99.9: 13.84 P99.99: 17.08 ------------------------------------------------------ [ 0, 1 ] 7316 1.874% 1.874% ( 1, 2 ] 192663 49.355% 51.229% ########## ( 2, 3 ] 114163 29.245% 80.475% ###### ( 3, 4 ] 30731 7.872% 88.347% ## ( 4, 6 ] 37073 9.497% 97.844% ## ( 6, 10 ] 7011 1.796% 99.640% ( 10, 15 ] 1320 0.338% 99.978% ( 15, 22 ] 151 0.039% 100.017% ( 22, 34 ] 11 0.003% 100.020% ( 34, 51 ] 4 0.001% 100.021% ( 51, 76 ] 6 0.002% 100.023% ( 76, 110 ] 23 0.006% 100.028% ( 110, 170 ] 69 0.018% 100.046% ( 170, 250 ] 30 0.008% 100.054% ( 250, 380 ] 40 0.010% 100.064% ( 380, 580 ] 45 0.012% 100.076% ( 580, 870 ] 31 0.008% 100.084% ( 870, 1300 ] 32 0.008% 100.092% ( 1300, 1900 ] 15 0.004% 100.096% ( 1900, 2900 ] 31 0.008% 100.103% ( 2900, 4400 ] 24 0.006% 100.110% ( 4400, 6600 ] 2 0.001% 100.110% ( 6600, 9900 ] 1 0.000% 100.110% ** Level 2 read latency histogram (micros): Count: 60293 Average: 3.1297 StdDev: 53.37 Min: 0 Median: 1.4694 Max: 7918 Percentiles: P50: 1.47 P75: 1.86 P99: 7.34 P99.9: 181.40 P99.99: 1882.42 ------------------------------------------------------ [ 0, 1 ] 12021 19.938% 19.938% #### ( 1, 2 ] 38614 64.044% 83.982% ############# ( 2, 3 ] 6878 11.408% 95.389% ## ( 3, 4 ] 1154 1.914% 97.303% ( 4, 6 ] 831 1.378% 98.681% ( 6, 10 ] 575 0.954% 99.635% ( 10, 15 ] 61 0.101% 99.736% ( 15, 22 ] 7 0.012% 99.748% ( 51, 76 ] 1 0.002% 99.750% ( 76, 110 ] 5 0.008% 99.758% ( 110, 170 ] 83 0.138% 99.896% ( 170, 250 ] 19 0.032% 99.927% ( 250, 380 ] 14 0.023% 99.950% ( 380, 580 ] 11 0.018% 99.968% ( 580, 870 ] 9 0.015% 99.983% ( 870, 1300 ] 3 0.005% 99.988% ( 1300, 1900 ] 1 0.002% 99.990% ( 1900, 2900 ] 1 0.002% 99.992% ( 2900, 4400 ] 3 0.005% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 314972 Average: 7.2794 StdDev: 94.90 Min: 0 Median: 1.8065 Max: 8091 Percentiles: P50: 1.81 P75: 2.58 P99: 11.01 P99.9: 845.52 P99.99: 2718.71 ------------------------------------------------------ [ 0, 1 ] 12719 4.038% 4.038% # ( 1, 2 ] 179491 56.986% 61.024% ########### ( 2, 3 ] 75568 23.992% 85.016% ##### ( 3, 4 ] 19641 6.236% 91.252% # ( 4, 6 ] 18122 5.754% 97.006% # ( 6, 10 ] 6088 1.933% 98.939% ( 10, 15 ] 956 0.304% 99.242% ( 15, 22 ] 134 0.043% 99.285% ( 22, 34 ] 60 0.019% 99.304% ( 34, 51 ] 6 0.002% 99.306% ( 51, 76 ] 4 0.001% 99.307% ( 76, 110 ] 178 0.057% 99.363% ( 110, 170 ] 395 0.125% 99.489% ( 170, 250 ] 371 0.118% 99.607% ( 250, 380 ] 306 0.097% 99.704% ( 380, 580 ] 358 0.114% 99.817% ( 580, 870 ] 284 0.090% 99.908% ( 870, 1300 ] 126 0.040% 99.948% ( 1300, 1900 ] 59 0.019% 99.966% ( 1900, 2900 ] 91 0.029% 99.995% ( 2900, 4400 ] 80 0.025% 100.021% ( 4400, 6600 ] 11 0.003% 100.024% ( 6600, 9900 ] 7 0.002% 100.026% ** Level 4 read latency histogram (micros): Count: 170 Average: 806.8059 StdDev: 1773.87 Min: 1 Median: 4.0000 Max: 9794 Percentiles: P50: 4.00 P75: 598.12 P99: 8497.50 P99.9: 9759.75 P99.99: 9794.00 ------------------------------------------------------ [ 0, 1 ] 27 15.882% 15.882% ### ( 1, 2 ] 41 24.118% 40.000% ##### ( 2, 3 ] 13 7.647% 47.647% ## ( 3, 4 ] 4 2.353% 50.000% ( 4, 6 ] 4 2.353% 52.353% ( 6, 10 ] 4 2.353% 54.706% ( 10, 15 ] 1 0.588% 55.294% ( 15, 22 ] 1 0.588% 55.882% ( 22, 34 ] 1 0.588% 56.471% ( 51, 76 ] 3 1.765% 58.235% ( 110, 170 ] 18 10.588% 68.824% ## ( 170, 250 ] 1 0.588% 69.412% ( 250, 380 ] 3 1.765% 71.176% ( 380, 580 ] 6 3.529% 74.706% # ( 580, 870 ] 8 4.706% 79.412% # ( 870, 1300 ] 8 4.706% 84.118% # ( 1300, 1900 ] 3 1.765% 85.882% ( 1900, 2900 ] 3 1.765% 87.647% ( 2900, 4400 ] 13 7.647% 95.294% ## ( 4400, 6600 ] 4 2.353% 97.647% ( 6600, 9900 ] 4 2.353% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1165.0571 StdDev: 1551.35 Min: 82 Median: 465.7143 Max: 10632 Percentiles: P50: 465.71 P75: 1600.00 P99: 8580.00 P99.9: 10632.00 P99.99: 10632.00 ------------------------------------------------------ ( 76, 110 ] 13 9.286% 9.286% ## ( 110, 170 ] 27 19.286% 28.571% #### ( 170, 250 ] 17 12.143% 40.714% ## ( 250, 380 ] 10 7.143% 47.857% # ( 380, 580 ] 7 5.000% 52.857% # ( 580, 870 ] 13 9.286% 62.143% ## ( 870, 1300 ] 12 8.571% 70.714% ## ( 1300, 1900 ] 12 8.571% 79.286% ## ( 1900, 2900 ] 10 7.143% 86.429% # ( 2900, 4400 ] 14 10.000% 96.429% ## ( 4400, 6600 ] 3 2.143% 98.571% ( 6600, 9900 ] 1 0.714% 99.286% ( 9900, 14000 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 26.2 total, 3.2 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 262.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.357 H:M:S, 28.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 309.53 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.600 H:M:S, 18.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-16:19:27 ... thread 0: (1000000,8000000) ops and (194567.8,257099.3) ops/second in (5.139596,31.116379) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/16 4.91 GB 62.9 7.2 0.0 7.2 14.7 7.6 0.0 1.9 143.8 294.6 51.26 47.73 131 0.391 7482K 14K 0.0 0.0 L1 5/5 247.31 MB 0.0 2.5 2.5 0.1 2.5 2.4 0.2 1.0 231.6 229.6 11.16 10.77 2 5.578 2623K 22K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 2.3 2.0 242.9 242.8 0.52 0.50 1 0.519 127K 56 0.0 0.0 L3 12/0 878.58 MB 0.9 2.1 0.9 1.1 2.1 0.9 1.6 2.2 205.1 204.8 10.30 8.99 6 1.716 2094K 3421 0.0 0.0 L4 164/0 9.56 GB 1.0 0.9 0.7 0.2 0.9 0.7 1.6 1.3 143.0 142.4 6.31 4.22 6 1.051 900K 3444 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/21 103.66 GB 0.0 12.8 4.1 8.6 20.3 11.7 7.9 2.7 164.6 261.5 79.54 72.21 146 0.545 13M 44K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.8 4.1 8.6 20.3 11.7 7.8 2.7 164.6 261.5 79.54 72.21 146 0.545 13M 44K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.8 4.1 8.6 12.7 4.1 0.0 0.0 229.8 229.0 56.98 52.55 38 1.500 13M 44K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 343.5 22.56 19.66 108 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.4 total, 31.1 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.31 GB write, 663.15 MB/s write, 12.79 GB read, 417.52 MB/s read, 79.5 seconds Interval compaction: 20.31 GB write, 668.30 MB/s write, 12.79 GB read, 420.76 MB/s read, 79.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 37, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3057646 Average: 2.4437 StdDev: 13.40 Min: 0 Median: 1.5965 Max: 5922 Percentiles: P50: 1.60 P75: 1.97 P99: 6.01 P99.9: 12.84 P99.99: 127.42 ------------------------------------------------------ [ 0, 1 ] 323870 10.592% 10.592% ## ( 1, 2 ] 2020078 66.066% 76.659% ############# ( 2, 3 ] 493863 16.152% 92.810% ### ( 3, 4 ] 99343 3.249% 96.059% # ( 4, 6 ] 89848 2.938% 98.998% # ( 6, 10 ] 25415 0.831% 99.829% ( 10, 15 ] 3821 0.125% 99.954% ( 15, 22 ] 423 0.014% 99.968% ( 22, 34 ] 49 0.002% 99.969% ( 34, 51 ] 26 0.001% 99.970% ( 51, 76 ] 23 0.001% 99.971% ( 76, 110 ] 380 0.012% 99.983% ( 110, 170 ] 700 0.023% 100.006% ( 170, 250 ] 181 0.006% 100.012% ( 250, 380 ] 122 0.004% 100.016% ( 380, 580 ] 118 0.004% 100.020% ( 580, 870 ] 90 0.003% 100.023% ( 870, 1300 ] 47 0.002% 100.025% ( 1300, 1900 ] 17 0.001% 100.025% ( 1900, 2900 ] 15 0.000% 100.026% ( 2900, 4400 ] 20 0.001% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 390361 Average: 3.6791 StdDev: 42.33 Min: 1 Median: 1.9751 Max: 6720 Percentiles: P50: 1.98 P75: 2.81 P99: 8.57 P99.9: 13.84 P99.99: 17.08 ------------------------------------------------------ [ 0, 1 ] 7316 1.874% 1.874% ( 1, 2 ] 192663 49.355% 51.229% ########## ( 2, 3 ] 114163 29.245% 80.475% ###### ( 3, 4 ] 30731 7.872% 88.347% ## ( 4, 6 ] 37073 9.497% 97.844% ## ( 6, 10 ] 7011 1.796% 99.640% ( 10, 15 ] 1320 0.338% 99.978% ( 15, 22 ] 151 0.039% 100.017% ( 22, 34 ] 11 0.003% 100.020% ( 34, 51 ] 4 0.001% 100.021% ( 51, 76 ] 6 0.002% 100.023% ( 76, 110 ] 23 0.006% 100.028% ( 110, 170 ] 69 0.018% 100.046% ( 170, 250 ] 30 0.008% 100.054% ( 250, 380 ] 40 0.010% 100.064% ( 380, 580 ] 45 0.012% 100.076% ( 580, 870 ] 31 0.008% 100.084% ( 870, 1300 ] 32 0.008% 100.092% ( 1300, 1900 ] 15 0.004% 100.096% ( 1900, 2900 ] 31 0.008% 100.103% ( 2900, 4400 ] 24 0.006% 100.110% ( 4400, 6600 ] 2 0.001% 100.110% ( 6600, 9900 ] 1 0.000% 100.110% ** Level 2 read latency histogram (micros): Count: 60293 Average: 3.1297 StdDev: 53.37 Min: 0 Median: 1.4694 Max: 7918 Percentiles: P50: 1.47 P75: 1.86 P99: 7.34 P99.9: 181.40 P99.99: 1882.42 ------------------------------------------------------ [ 0, 1 ] 12021 19.938% 19.938% #### ( 1, 2 ] 38614 64.044% 83.982% ############# ( 2, 3 ] 6878 11.408% 95.389% ## ( 3, 4 ] 1154 1.914% 97.303% ( 4, 6 ] 831 1.378% 98.681% ( 6, 10 ] 575 0.954% 99.635% ( 10, 15 ] 61 0.101% 99.736% ( 15, 22 ] 7 0.012% 99.748% ( 51, 76 ] 1 0.002% 99.750% ( 76, 110 ] 5 0.008% 99.758% ( 110, 170 ] 83 0.138% 99.896% ( 170, 250 ] 19 0.032% 99.927% ( 250, 380 ] 14 0.023% 99.950% ( 380, 580 ] 11 0.018% 99.968% ( 580, 870 ] 9 0.015% 99.983% ( 870, 1300 ] 3 0.005% 99.988% ( 1300, 1900 ] 1 0.002% 99.990% ( 1900, 2900 ] 1 0.002% 99.992% ( 2900, 4400 ] 3 0.005% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 314972 Average: 7.2794 StdDev: 94.90 Min: 0 Median: 1.8065 Max: 8091 Percentiles: P50: 1.81 P75: 2.58 P99: 11.01 P99.9: 845.52 P99.99: 2718.71 ------------------------------------------------------ [ 0, 1 ] 12719 4.038% 4.038% # ( 1, 2 ] 179491 56.986% 61.024% ########### ( 2, 3 ] 75568 23.992% 85.016% ##### ( 3, 4 ] 19641 6.236% 91.252% # ( 4, 6 ] 18122 5.754% 97.006% # ( 6, 10 ] 6088 1.933% 98.939% ( 10, 15 ] 956 0.304% 99.242% ( 15, 22 ] 134 0.043% 99.285% ( 22, 34 ] 60 0.019% 99.304% ( 34, 51 ] 6 0.002% 99.306% ( 51, 76 ] 4 0.001% 99.307% ( 76, 110 ] 178 0.057% 99.363% ( 110, 170 ] 395 0.125% 99.489% ( 170, 250 ] 371 0.118% 99.607% ( 250, 380 ] 306 0.097% 99.704% ( 380, 580 ] 358 0.114% 99.817% ( 580, 870 ] 284 0.090% 99.908% ( 870, 1300 ] 126 0.040% 99.948% ( 1300, 1900 ] 59 0.019% 99.966% ( 1900, 2900 ] 91 0.029% 99.995% ( 2900, 4400 ] 80 0.025% 100.021% ( 4400, 6600 ] 11 0.003% 100.024% ( 6600, 9900 ] 7 0.002% 100.026% ** Level 4 read latency histogram (micros): Count: 170 Average: 806.8059 StdDev: 1773.87 Min: 1 Median: 4.0000 Max: 9794 Percentiles: P50: 4.00 P75: 598.12 P99: 8497.50 P99.9: 9759.75 P99.99: 9794.00 ------------------------------------------------------ [ 0, 1 ] 27 15.882% 15.882% ### ( 1, 2 ] 41 24.118% 40.000% ##### ( 2, 3 ] 13 7.647% 47.647% ## ( 3, 4 ] 4 2.353% 50.000% ( 4, 6 ] 4 2.353% 52.353% ( 6, 10 ] 4 2.353% 54.706% ( 10, 15 ] 1 0.588% 55.294% ( 15, 22 ] 1 0.588% 55.882% ( 22, 34 ] 1 0.588% 56.471% ( 51, 76 ] 3 1.765% 58.235% ( 110, 170 ] 18 10.588% 68.824% ## ( 170, 250 ] 1 0.588% 69.412% ( 250, 380 ] 3 1.765% 71.176% ( 380, 580 ] 6 3.529% 74.706% # ( 580, 870 ] 8 4.706% 79.412% # ( 870, 1300 ] 8 4.706% 84.118% # ( 1300, 1900 ] 3 1.765% 85.882% ( 1900, 2900 ] 3 1.765% 87.647% ( 2900, 4400 ] 13 7.647% 95.294% ## ( 4400, 6600 ] 4 2.353% 97.647% ( 6600, 9900 ] 4 2.353% 100.000% ** Level 5 read latency histogram (micros): Count: 140 Average: 1165.0571 StdDev: 1551.35 Min: 82 Median: 465.7143 Max: 10632 Percentiles: P50: 465.71 P75: 1600.00 P99: 8580.00 P99.9: 10632.00 P99.99: 10632.00 ------------------------------------------------------ ( 76, 110 ] 13 9.286% 9.286% ## ( 110, 170 ] 27 19.286% 28.571% #### ( 170, 250 ] 17 12.143% 40.714% ## ( 250, 380 ] 10 7.143% 47.857% # ( 380, 580 ] 7 5.000% 52.857% # ( 580, 870 ] 13 9.286% 62.143% ## ( 870, 1300 ] 12 8.571% 70.714% ## ( 1300, 1900 ] 12 8.571% 79.286% ## ( 1900, 2900 ] 10 7.143% 86.429% # ( 2900, 4400 ] 14 10.000% 96.429% ## ( 4400, 6600 ] 3 2.143% 98.571% ( 6600, 9900 ] 1 0.714% 99.286% ( 9900, 14000 ] 1 0.714% 100.000% ** DB Stats ** Uptime(secs): 31.4 total, 5.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 251.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.944 H:M:S, 31.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 191.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.587 H:M:S, 50.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-16:19:37 ... thread 0: (1000000,9000000) ops and (97649.0,217616.6) ops/second in (10.240756,41.357135) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/12 2.94 GB 0.0 9.0 0.0 9.0 17.6 8.5 0.0 2.1 147.9 287.4 62.60 57.80 148 0.423 9400K 23K 0.0 0.0 L1 22/22 2.11 GB 0.0 5.7 5.4 0.3 5.6 5.3 0.2 1.0 219.6 217.2 26.61 25.10 3 8.870 5930K 60K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 3.3 2.0 242.9 242.8 0.52 0.50 1 0.519 127K 56 0.0 0.0 L3 16/0 974.19 MB 1.0 3.0 1.4 1.5 2.9 1.4 2.1 2.0 206.4 205.4 14.66 13.07 9 1.629 3023K 14K 0.0 0.0 L4 162/0 9.50 GB 1.0 2.0 1.6 0.4 2.0 1.6 1.6 1.2 142.6 142.0 14.35 9.60 18 0.797 2062K 8390 0.0 0.0 L5 1084/0 89.08 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1296/34 104.58 GB 0.0 19.8 8.5 11.3 28.3 17.0 10.5 3.3 171.0 243.8 118.74 106.06 179 0.663 20M 107K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.8 8.5 11.3 28.3 17.0 10.4 3.3 171.0 243.8 118.74 106.06 179 0.663 20M 107K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.8 8.5 11.3 19.7 8.4 0.0 0.0 218.6 217.4 92.86 83.75 57 1.629 20M 107K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 338.4 25.88 22.31 122 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.6 total, 41.4 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.27 GB write, 695.75 MB/s write, 19.82 GB read, 487.98 MB/s read, 118.7 seconds Interval compaction: 28.27 GB write, 699.82 MB/s write, 19.82 GB read, 490.83 MB/s read, 118.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 44, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 26, total-stops: 44, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3929493 Average: 2.7927 StdDev: 17.21 Min: 0 Median: 1.6123 Max: 5979 Percentiles: P50: 1.61 P75: 2.00 P99: 7.40 P99.9: 136.20 P99.99: 244.50 ------------------------------------------------------ [ 0, 1 ] 394708 10.045% 10.045% ## ( 1, 2 ] 2564173 65.255% 75.299% ############# ( 2, 3 ] 660087 16.798% 92.098% ### ( 3, 4 ] 133552 3.399% 95.496% # ( 4, 6 ] 124368 3.165% 98.661% # ( 6, 10 ] 37976 0.966% 99.628% ( 10, 15 ] 5251 0.134% 99.761% ( 15, 22 ] 632 0.016% 99.777% ( 22, 34 ] 59 0.002% 99.779% ( 34, 51 ] 30 0.001% 99.780% ( 51, 76 ] 26 0.001% 99.780% ( 76, 110 ] 2591 0.066% 99.846% ( 110, 170 ] 4837 0.123% 99.969% ( 170, 250 ] 872 0.022% 99.992% ( 250, 380 ] 515 0.013% 100.005% ( 380, 580 ] 448 0.011% 100.016% ( 580, 870 ] 212 0.005% 100.021% ( 870, 1300 ] 81 0.002% 100.024% ( 1300, 1900 ] 34 0.001% 100.024% ( 1900, 2900 ] 28 0.001% 100.025% ( 2900, 4400 ] 27 0.001% 100.026% ( 4400, 6600 ] 3 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 716982 Average: 3.8343 StdDev: 36.68 Min: 1 Median: 1.9428 Max: 6720 Percentiles: P50: 1.94 P75: 2.79 P99: 9.00 P99.9: 87.79 P99.99: 159.96 ------------------------------------------------------ [ 0, 1 ] 15088 2.104% 2.104% ( 1, 2 ] 364240 50.802% 52.906% ########## ( 2, 3 ] 200714 27.994% 80.900% ###### ( 3, 4 ] 55672 7.765% 88.665% ## ( 4, 6 ] 62904 8.773% 97.439% ## ( 6, 10 ] 14944 2.084% 99.523% ( 10, 15 ] 2278 0.318% 99.841% ( 15, 22 ] 309 0.043% 99.884% ( 22, 34 ] 18 0.003% 99.886% ( 34, 51 ] 4 0.001% 99.887% ( 51, 76 ] 7 0.001% 99.888% ( 76, 110 ] 251 0.035% 99.923% ( 110, 170 ] 578 0.081% 100.003% ( 170, 250 ] 222 0.031% 100.034% ( 250, 380 ] 205 0.029% 100.063% ( 380, 580 ] 182 0.025% 100.088% ( 580, 870 ] 98 0.014% 100.102% ( 870, 1300 ] 75 0.010% 100.113% ( 1300, 1900 ] 29 0.004% 100.117% ( 1900, 2900 ] 41 0.006% 100.122% ( 2900, 4400 ] 27 0.004% 100.126% ( 4400, 6600 ] 2 0.000% 100.126% ( 6600, 9900 ] 1 0.000% 100.127% ** Level 2 read latency histogram (micros): Count: 60293 Average: 3.1297 StdDev: 53.37 Min: 0 Median: 1.4694 Max: 7918 Percentiles: P50: 1.47 P75: 1.86 P99: 7.34 P99.9: 181.40 P99.99: 1882.42 ------------------------------------------------------ [ 0, 1 ] 12021 19.938% 19.938% #### ( 1, 2 ] 38614 64.044% 83.982% ############# ( 2, 3 ] 6878 11.408% 95.389% ## ( 3, 4 ] 1154 1.914% 97.303% ( 4, 6 ] 831 1.378% 98.681% ( 6, 10 ] 575 0.954% 99.635% ( 10, 15 ] 61 0.101% 99.736% ( 15, 22 ] 7 0.012% 99.748% ( 51, 76 ] 1 0.002% 99.750% ( 76, 110 ] 5 0.008% 99.758% ( 110, 170 ] 83 0.138% 99.896% ( 170, 250 ] 19 0.032% 99.927% ( 250, 380 ] 14 0.023% 99.950% ( 380, 580 ] 11 0.018% 99.968% ( 580, 870 ] 9 0.015% 99.983% ( 870, 1300 ] 3 0.005% 99.988% ( 1300, 1900 ] 1 0.002% 99.990% ( 1900, 2900 ] 1 0.002% 99.992% ( 2900, 4400 ] 3 0.005% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 549787 Average: 6.5831 StdDev: 86.19 Min: 0 Median: 1.9363 Max: 8091 Percentiles: P50: 1.94 P75: 2.79 P99: 9.77 P99.9: 464.21 P99.99: 730.96 ------------------------------------------------------ [ 0, 1 ] 13819 2.514% 2.514% # ( 1, 2 ] 278822 50.715% 53.228% ########## ( 2, 3 ] 150706 27.412% 80.640% ##### ( 3, 4 ] 45082 8.200% 88.840% ## ( 4, 6 ] 45804 8.331% 97.171% ## ( 6, 10 ] 10670 1.941% 99.112% ( 10, 15 ] 2009 0.365% 99.477% ( 15, 22 ] 218 0.040% 99.517% ( 22, 34 ] 63 0.011% 99.528% ( 34, 51 ] 7 0.001% 99.529% ( 51, 76 ] 5 0.001% 99.530% ( 76, 110 ] 214 0.039% 99.569% ( 110, 170 ] 541 0.098% 99.668% ( 170, 250 ] 570 0.104% 99.771% ( 250, 380 ] 495 0.090% 99.861% ( 380, 580 ] 504 0.092% 99.953% ( 580, 870 ] 390 0.071% 100.024% ( 870, 1300 ] 173 0.031% 100.055% ( 1300, 1900 ] 83 0.015% 100.071% ( 1900, 2900 ] 104 0.019% 100.089% ( 2900, 4400 ] 127 0.023% 100.113% ( 4400, 6600 ] 17 0.003% 100.116% ( 6600, 9900 ] 9 0.002% 100.117% ** Level 4 read latency histogram (micros): Count: 21977 Average: 32.3741 StdDev: 329.53 Min: 1 Median: 2.4677 Max: 9794 Percentiles: P50: 2.47 P75: 3.67 P99: 566.75 P99.9: 4365.92 P99.99: 6776.51 ------------------------------------------------------ [ 0, 1 ] 93 0.423% 0.423% ( 1, 2 ] 7576 34.472% 34.896% ####### ( 2, 3 ] 7097 32.293% 67.188% ###### ( 3, 4 ] 2565 11.671% 78.860% ## ( 4, 6 ] 3165 14.401% 93.261% ### ( 6, 10 ] 765 3.481% 96.742% # ( 10, 15 ] 196 0.892% 97.634% ( 15, 22 ] 17 0.077% 97.711% ( 22, 34 ] 5 0.023% 97.734% ( 34, 51 ] 1 0.005% 97.739% ( 51, 76 ] 7 0.032% 97.770% ( 76, 110 ] 4 0.018% 97.789% ( 110, 170 ] 52 0.237% 98.025% ( 170, 250 ] 72 0.328% 98.353% ( 250, 380 ] 75 0.341% 98.694% ( 380, 580 ] 72 0.328% 99.022% ( 580, 870 ] 67 0.305% 99.327% ( 870, 1300 ] 39 0.177% 99.504% ( 1300, 1900 ] 18 0.082% 99.586% ( 1900, 2900 ] 27 0.123% 99.709% ( 2900, 4400 ] 43 0.196% 99.904% ( 4400, 6600 ] 18 0.082% 99.986% ( 6600, 9900 ] 15 0.068% 100.055% ** Level 5 read latency histogram (micros): Count: 200 Average: 1078.6500 StdDev: 1451.74 Min: 80 Median: 398.1818 Max: 10632 Percentiles: P50: 398.18 P75: 1476.47 P99: 6600.00 P99.9: 10632.00 P99.99: 10632.00 ------------------------------------------------------ ( 76, 110 ] 20 10.000% 10.000% ## ( 110, 170 ] 41 20.500% 30.500% #### ( 170, 250 ] 21 10.500% 41.000% ## ( 250, 380 ] 17 8.500% 49.500% ## ( 380, 580 ] 11 5.500% 55.000% # ( 580, 870 ] 21 10.500% 65.500% ## ( 870, 1300 ] 14 7.000% 72.500% # ( 1300, 1900 ] 17 8.500% 81.000% ## ( 1900, 2900 ] 15 7.500% 88.500% ## ( 2900, 4400 ] 16 8.000% 96.500% ## ( 4400, 6600 ] 5 2.500% 99.000% # ( 6600, 9900 ] 1 0.500% 99.500% ( 9900, 14000 ] 1 0.500% 100.000% ** DB Stats ** Uptime(secs): 41.6 total, 10.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 212.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.316 H:M:S, 41.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 96.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.372 H:M:S, 72.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.011 micros/op 166349 ops/sec 60.036 seconds 9986999 operations; 161.2 MB/s Microseconds per write: Count: 9986999 Average: 6.0114 StdDev: 303.64 Min: 1 Median: 1.7391 Max: 367716 Percentiles: P50: 1.74 P75: 2.70 P99: 9.33 P99.9: 1181.32 P99.99: 2730.50 ------------------------------------------------------ [ 0, 1 ] 1304682 13.064% 13.064% ### ( 1, 2 ] 4991016 49.975% 63.039% ########## ( 2, 3 ] 1707578 17.098% 80.137% ### ( 3, 4 ] 1325120 13.268% 93.405% ### ( 4, 6 ] 458663 4.593% 97.998% # ( 6, 10 ] 120118 1.203% 99.201% ( 10, 15 ] 38321 0.384% 99.584% ( 15, 22 ] 8085 0.081% 99.665% ( 22, 34 ] 1446 0.014% 99.680% ( 34, 51 ] 184 0.002% 99.682% ( 51, 76 ] 22 0.000% 99.682% ( 76, 110 ] 7453 0.075% 99.757% ( 110, 170 ] 2326 0.023% 99.780% ( 170, 250 ] 219 0.002% 99.782% ( 250, 380 ] 165 0.002% 99.784% ( 380, 580 ] 20 0.000% 99.784% ( 580, 870 ] 18 0.000% 99.784% ( 870, 1300 ] 15989 0.160% 99.944% ( 1300, 1900 ] 25 0.000% 99.944% ( 1900, 2900 ] 5479 0.055% 99.999% ( 2900, 4400 ] 38 0.000% 100.000% ( 4400, 6600 ] 3 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 2 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 15 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 197034 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9986999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10306582968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 460 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32716344 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28495274230 rocksdb.compact.write.bytes COUNT : 28314415624 rocksdb.flush.write.bytes COUNT : 10304877087 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 50 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 222 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10221838336 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4012032 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28585002491 rocksdb.non.last.level.read.count COUNT : 6907889 rocksdb.block.checksum.compute.count COUNT : 6907019 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.395355 P95 : 3.862866 P99 : 7.884100 P100 : 367714.000000 COUNT : 9986999 SUM : 55432069 rocksdb.compaction.times.micros P50 : 1086666.666667 P95 : 5693333.333333 P99 : 15453870.000000 P100 : 15453870.000000 COUNT : 62 SUM : 102499298 rocksdb.compaction.times.cpu_micros P50 : 996000.000000 P95 : 5693333.333333 P99 : 14323522.000000 P100 : 14323522.000000 COUNT : 62 SUM : 93007659 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 693.554217 P95 : 1169.656250 P99 : 1678.000000 P100 : 6260.000000 COUNT : 137 SUM : 99117 rocksdb.compaction.outfile.sync.micros P50 : 860.937500 P95 : 7645.000000 P99 : 38553.333333 P100 : 107053.000000 COUNT : 302 SUM : 688489 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 98.028169 P95 : 362.210526 P99 : 645.733333 P100 : 835.000000 COUNT : 232 SUM : 31477 rocksdb.table.open.io.micros P50 : 1318.181818 P95 : 7500.000000 P99 : 20577.777778 P100 : 23269.000000 COUNT : 460 SUM : 1091476 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.729572 P95 : 7.516153 P99 : 10.996744 P100 : 12298.000000 COUNT : 6905826 SUM : 38058837 rocksdb.read.block.get.micros P50 : 493.559322 P95 : 3866.666667 P99 : 7920.000000 P100 : 10862.000000 COUNT : 920 SUM : 876864 rocksdb.write.raw.block.micros P50 : 0.512245 P95 : 0.973265 P99 : 2.746076 P100 : 15759.000000 COUNT : 9353004 SUM : 17597381 rocksdb.numfiles.in.singlecompaction P50 : 3.378788 P95 : 8.800000 P99 : 27.280000 P100 : 30.000000 COUNT : 112 SUM : 476 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559568 P95 : 1175.440349 P99 : 2534.568918 P100 : 367515.000000 COUNT : 202735 SUM : 32734444 rocksdb.sst.read.micros P50 : 1.644462 P95 : 4.375743 P99 : 8.520161 P100 : 10632.000000 COUNT : 6908173 SUM : 23860468 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9986999 SUM : 10306582968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214313.725490 P95 : 360500.000000 P99 : 504925.000000 P100 : 522962.000000 COUNT : 137 SUM : 29007827 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 297 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0