[2024-11-27 01:33:58.080751] Starting SPDK v25.01-pre git sha1 2f2acf4eb / DPDK 23.11.0 initialization... [2024-11-27 01:33:58.080893] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2653363 ] Set seed to 1732667638077279 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-27 01:33:58.191974] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-27 01:33:58.215369] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-27 01:33:58.215415] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2653363' to capture a snapshot of events at runtime. [2024-11-27 01:33:58.215425] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-27 01:33:58.215435] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-27 01:33:58.215443] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2653363 for offline analysis/debug. [2024-11-27 01:33:58.215979] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 27 01:34:02 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/27-01:34:05 ... thread 0: (1000000,1000000) ops and (333685.5,333685.5) ops/second in (2.996834,2.996834) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 567.00 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 351.3 2.51 2.28 12 0.209 0 0 0.0 0.0 L1 3/3 251.74 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 259.5 259.2 0.97 0.94 1 0.971 255K 199 0.0 0.0 L2 1/0 48.92 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 232.3 232.2 0.48 0.45 1 0.480 113K 23 0.0 0.0 L3 16/0 755.43 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 220.3 220.3 0.28 0.23 1 0.284 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1188/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 100.3 308.0 4.25 3.90 15 0.283 432K 222 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.1 1.5 100.3 308.0 4.25 3.90 15 0.283 432K 222 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 245.5 245.4 1.73 1.62 3 0.578 432K 222 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 351.3 2.51 2.28 12 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 407.05 MB/s write, 0.42 GB read, 132.59 MB/s read, 4.2 seconds Interval compaction: 1.28 GB write, 436.08 MB/s write, 0.42 GB read, 142.04 MB/s read, 4.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 106524 Average: 1.7378 StdDev: 13.79 Min: 0 Median: 1.1230 Max: 3755 Percentiles: P50: 1.12 P75: 1.59 P99: 3.32 P99.9: 9.38 P99.99: 275.02 ------------------------------------------------------ [ 0, 1 ] 46253 43.420% 43.420% ######### ( 1, 2 ] 57003 53.512% 96.932% ########### ( 2, 3 ] 1966 1.846% 98.778% ( 3, 4 ] 750 0.704% 99.482% ( 4, 6 ] 347 0.326% 99.808% ( 6, 10 ] 119 0.112% 99.919% ( 10, 15 ] 55 0.052% 99.971% ( 15, 22 ] 7 0.007% 99.977% ( 22, 34 ] 2 0.002% 99.979% ( 110, 170 ] 4 0.004% 99.983% ( 170, 250 ] 8 0.008% 99.991% ( 250, 380 ] 7 0.007% 99.997% ( 380, 580 ] 1 0.001% 99.998% ( 870, 1300 ] 2 0.002% 100.000% ( 1300, 1900 ] 1 0.001% 100.001% ( 2900, 4400 ] 1 0.001% 100.002% ** Level 1 read latency histogram (micros): Count: 21146 Average: 1.7446 StdDev: 7.95 Min: 1 Median: 1.1558 Max: 764 Percentiles: P50: 1.16 P75: 1.60 P99: 3.29 P99.9: 10.27 P99.99: 372.55 ------------------------------------------------------ [ 0, 1 ] 8729 41.280% 41.280% ######## ( 1, 2 ] 11832 55.954% 97.234% ########### ( 2, 3 ] 328 1.551% 98.785% ( 3, 4 ] 163 0.771% 99.555% ( 4, 6 ] 44 0.208% 99.764% ( 6, 10 ] 29 0.137% 99.901% ( 10, 15 ] 16 0.076% 99.976% ( 15, 22 ] 2 0.009% 99.986% ( 250, 380 ] 2 0.009% 99.995% ( 580, 870 ] 2 0.009% 100.005% ** Level 2 read latency histogram (micros): Count: 28191 Average: 2.4405 StdDev: 30.67 Min: 1 Median: 1.1740 Max: 3742 Percentiles: P50: 1.17 P75: 1.64 P99: 5.65 P99.9: 214.05 P99.99: 947.79 ------------------------------------------------------ [ 0, 1 ] 11452 40.623% 40.623% ######## ( 1, 2 ] 15196 53.904% 94.527% ########### ( 2, 3 ] 864 3.065% 97.591% # ( 3, 4 ] 240 0.851% 98.443% ( 4, 6 ] 190 0.674% 99.117% ( 6, 10 ] 134 0.475% 99.592% ( 10, 15 ] 33 0.117% 99.709% ( 15, 22 ] 8 0.028% 99.738% ( 34, 51 ] 20 0.071% 99.808% ( 51, 76 ] 10 0.035% 99.844% ( 76, 110 ] 4 0.014% 99.858% ( 110, 170 ] 3 0.011% 99.869% ( 170, 250 ] 16 0.057% 99.926% ( 250, 380 ] 11 0.039% 99.965% ( 380, 580 ] 4 0.014% 99.979% ( 580, 870 ] 3 0.011% 99.989% ( 870, 1300 ] 1 0.004% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 80 Average: 774.6500 StdDev: 1148.15 Min: 0 Median: 170.0000 Max: 4545 Percentiles: P50: 170.00 P75: 825.38 P99: 4545.00 P99.9: 4545.00 P99.99: 4545.00 ------------------------------------------------------ [ 0, 1 ] 35 43.750% 43.750% ######### ( 1, 2 ] 3 3.750% 47.500% # ( 76, 110 ] 1 1.250% 48.750% ( 110, 170 ] 1 1.250% 50.000% ( 250, 380 ] 4 5.000% 55.000% # ( 380, 580 ] 5 6.250% 61.250% # ( 580, 870 ] 13 16.250% 77.500% ### ( 870, 1300 ] 1 1.250% 78.750% ( 1300, 1900 ] 2 2.500% 81.250% # ( 1900, 2900 ] 9 11.250% 92.500% ## ( 2900, 4400 ] 5 6.250% 98.750% # ( 4400, 6600 ] 1 1.250% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1663.2571 StdDev: 1208.73 Min: 234 Median: 1192.5000 Max: 5144 Percentiles: P50: 1192.50 P75: 2441.67 P99: 5144.00 P99.9: 5144.00 P99.99: 5144.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 12 34.286% 45.714% ####### ( 870, 1300 ] 2 5.714% 51.429% # ( 1300, 1900 ] 5 14.286% 65.714% ### ( 1900, 2900 ] 6 17.143% 82.857% ### ( 2900, 4400 ] 5 14.286% 97.143% ### ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 306.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.365 H:M:S, 11.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.365 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-01:34:08 ... thread 0: (1000000,2000000) ops and (351410.6,342318.7) ops/second in (2.845674,5.842508) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/8 1.17 GB 62.9 0.6 0.0 0.6 2.3 1.8 0.0 1.3 77.4 326.8 7.32 6.74 28 0.262 575K 600 0.0 0.0 L1 2/0 50.40 MB 5.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 247.5 247.1 3.31 3.22 2 1.654 831K 1422 0.0 0.0 L2 5/4 563.98 MB 1.3 0.1 0.1 0.0 0.1 0.1 0.5 1.8 232.3 232.2 0.48 0.45 1 0.480 113K 23 0.0 0.0 L3 16/9 755.43 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 220.3 220.3 0.28 0.23 1 0.284 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1194/21 97.92 GB 0.0 1.5 0.6 0.9 3.3 2.4 0.6 1.9 136.9 297.0 11.39 10.64 32 0.356 1583K 2045 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.3 2.4 0.6 1.9 136.9 297.0 11.39 10.64 32 0.356 1583K 2045 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 251.4 251.1 6.20 5.99 6 1.034 1583K 2045 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.9 5.19 4.65 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.31 GB write, 558.66 MB/s write, 1.52 GB read, 257.45 MB/s read, 11.4 seconds Interval compaction: 3.31 GB write, 579.10 MB/s write, 1.52 GB read, 266.87 MB/s read, 11.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 387392 Average: 2.1060 StdDev: 9.40 Min: 0 Median: 1.4405 Max: 3755 Percentiles: P50: 1.44 P75: 1.83 P99: 5.50 P99.9: 10.16 P99.99: 14.47 ------------------------------------------------------ [ 0, 1 ] 85486 22.067% 22.067% #### ( 1, 2 ] 245662 63.414% 85.481% ############# ( 2, 3 ] 33951 8.764% 94.245% ## ( 3, 4 ] 12751 3.291% 97.537% # ( 4, 6 ] 7542 1.947% 99.484% ( 6, 10 ] 1602 0.414% 99.897% ( 10, 15 ] 404 0.104% 100.002% ( 15, 22 ] 27 0.007% 100.009% ( 22, 34 ] 11 0.003% 100.011% ( 34, 51 ] 1 0.000% 100.012% ( 51, 76 ] 4 0.001% 100.013% ( 110, 170 ] 7 0.002% 100.014% ( 170, 250 ] 18 0.005% 100.019% ( 250, 380 ] 12 0.003% 100.022% ( 380, 580 ] 2 0.001% 100.023% ( 580, 870 ] 8 0.002% 100.025% ( 870, 1300 ] 4 0.001% 100.026% ( 1300, 1900 ] 4 0.001% 100.027% ( 2900, 4400 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 116223 Average: 2.3207 StdDev: 11.04 Min: 1 Median: 1.5544 Max: 1865 Percentiles: P50: 1.55 P75: 1.94 P99: 5.81 P99.9: 12.40 P99.99: 301.52 ------------------------------------------------------ [ 0, 1 ] 16625 14.304% 14.304% ### ( 1, 2 ] 74837 64.391% 78.695% ############# ( 2, 3 ] 15541 13.372% 92.067% ### ( 3, 4 ] 4831 4.157% 96.224% # ( 4, 6 ] 3566 3.068% 99.292% # ( 6, 10 ] 634 0.546% 99.837% ( 10, 15 ] 154 0.133% 99.970% ( 15, 22 ] 20 0.017% 99.987% ( 22, 34 ] 1 0.001% 99.988% ( 110, 170 ] 1 0.001% 99.989% ( 250, 380 ] 6 0.005% 99.994% ( 380, 580 ] 1 0.001% 99.995% ( 580, 870 ] 2 0.002% 99.997% ( 870, 1300 ] 2 0.002% 99.998% ( 1300, 1900 ] 3 0.003% 100.001% ** Level 2 read latency histogram (micros): Count: 28245 Average: 2.4417 StdDev: 30.65 Min: 1 Median: 1.1755 Max: 3742 Percentiles: P50: 1.18 P75: 1.64 P99: 5.67 P99.9: 213.78 P99.99: 945.46 ------------------------------------------------------ [ 0, 1 ] 11452 40.545% 40.545% ######## ( 1, 2 ] 15217 53.875% 94.420% ########### ( 2, 3 ] 887 3.140% 97.561% # ( 3, 4 ] 246 0.871% 98.432% ( 4, 6 ] 192 0.680% 99.111% ( 6, 10 ] 135 0.478% 99.589% ( 10, 15 ] 34 0.120% 99.710% ( 15, 22 ] 8 0.028% 99.738% ( 34, 51 ] 20 0.071% 99.809% ( 51, 76 ] 10 0.035% 99.844% ( 76, 110 ] 4 0.014% 99.858% ( 110, 170 ] 3 0.011% 99.869% ( 170, 250 ] 16 0.057% 99.926% ( 250, 380 ] 11 0.039% 99.965% ( 380, 580 ] 4 0.014% 99.979% ( 580, 870 ] 3 0.011% 99.989% ( 870, 1300 ] 1 0.004% 99.993% ( 1900, 2900 ] 1 0.004% 99.996% ( 2900, 4400 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 79515 Average: 4.2145 StdDev: 47.98 Min: 0 Median: 1.6998 Max: 4545 Percentiles: P50: 1.70 P75: 2.35 P99: 9.71 P99.9: 372.70 P99.99: 1457.26 ------------------------------------------------------ [ 0, 1 ] 5533 6.958% 6.958% # ( 1, 2 ] 48908 61.508% 68.466% ############ ( 2, 3 ] 14637 18.408% 86.874% #### ( 3, 4 ] 4605 5.791% 92.666% # ( 4, 6 ] 3562 4.480% 97.145% # ( 6, 10 ] 1593 2.003% 99.149% ( 10, 15 ] 245 0.308% 99.457% ( 15, 22 ] 73 0.092% 99.549% ( 22, 34 ] 19 0.024% 99.572% ( 34, 51 ] 5 0.006% 99.579% ( 51, 76 ] 1 0.001% 99.580% ( 76, 110 ] 63 0.079% 99.659% ( 110, 170 ] 121 0.152% 99.811% ( 170, 250 ] 46 0.058% 99.869% ( 250, 380 ] 27 0.034% 99.903% ( 380, 580 ] 35 0.044% 99.947% ( 580, 870 ] 27 0.034% 99.981% ( 870, 1300 ] 7 0.009% 99.990% ( 1300, 1900 ] 4 0.005% 99.995% ( 1900, 2900 ] 9 0.011% 100.006% ( 2900, 4400 ] 5 0.006% 100.013% ( 4400, 6600 ] 1 0.001% 100.014% ** Level 4 read latency histogram (micros): Count: 35 Average: 1663.2571 StdDev: 1208.73 Min: 234 Median: 1192.5000 Max: 5144 Percentiles: P50: 1192.50 P75: 2441.67 P99: 5144.00 P99.9: 5144.00 P99.99: 5144.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 12 34.286% 45.714% ####### ( 870, 1300 ] 2 5.714% 51.429% # ( 1300, 1900 ] 5 14.286% 65.714% ### ( 1900, 2900 ] 6 17.143% 82.857% ### ( 2900, 4400 ] 5 14.286% 97.143% ### ( 4400, 6600 ] 1 2.857% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 2.8 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.541 H:M:S, 8.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 345.86 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.176 H:M:S, 6.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/27-01:34:11 ... thread 0: (1000000,3000000) ops and (322927.5,335601.3) ops/second in (3.096670,8.939178) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.15 GB 188.8 1.7 0.0 1.7 4.4 2.8 0.0 1.6 116.9 311.6 14.55 13.56 46 0.316 1727K 1849 0.0 0.0 L1 2/0 50.40 MB 5.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 247.5 247.1 3.31 3.22 2 1.654 831K 1422 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.5 1.8 232.3 232.2 0.48 0.45 1 0.480 113K 23 0.0 0.0 L3 27/0 966.31 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 214.1 214.0 6.54 5.83 4 1.634 1399K 717 0.0 0.0 L4 148/0 9.57 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1238/4 98.90 GB 0.0 3.9 1.2 2.8 6.7 3.9 1.3 2.4 162.0 275.9 24.87 23.06 53 0.469 4070K 4011 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 1.2 2.8 6.7 3.9 1.3 2.4 162.0 275.9 24.87 23.06 53 0.469 4070K 4011 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 1.2 2.8 3.9 1.2 0.0 0.0 238.9 238.6 16.87 15.93 13 1.298 4070K 4011 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 354.4 8.00 7.13 40 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.70 GB write, 749.46 MB/s write, 3.94 GB read, 440.26 MB/s read, 24.9 seconds Interval compaction: 6.70 GB write, 767.38 MB/s write, 3.94 GB read, 450.79 MB/s read, 24.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 635378 Average: 2.1608 StdDev: 9.71 Min: 0 Median: 1.4643 Max: 3755 Percentiles: P50: 1.46 P75: 1.86 P99: 5.67 P99.9: 11.40 P99.99: 14.84 ------------------------------------------------------ [ 0, 1 ] 132123 20.794% 20.794% #### ( 1, 2 ] 399664 62.902% 83.696% ############# ( 2, 3 ] 61204 9.633% 93.329% ## ( 3, 4 ] 23456 3.692% 97.021% # ( 4, 6 ] 15065 2.371% 99.392% ( 6, 10 ] 2998 0.472% 99.863% ( 10, 15 ] 832 0.131% 99.994% ( 15, 22 ] 63 0.010% 100.004% ( 22, 34 ] 14 0.002% 100.006% ( 34, 51 ] 4 0.001% 100.007% ( 51, 76 ] 5 0.001% 100.008% ( 110, 170 ] 10 0.002% 100.009% ( 170, 250 ] 26 0.004% 100.014% ( 250, 380 ] 20 0.003% 100.017% ( 380, 580 ] 6 0.001% 100.018% ( 580, 870 ] 12 0.002% 100.020% ( 870, 1300 ] 11 0.002% 100.021% ( 1300, 1900 ] 5 0.001% 100.022% ( 2900, 4400 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 194726 Average: 2.4003 StdDev: 8.56 Min: 1 Median: 1.6259 Max: 1865 Percentiles: P50: 1.63 P75: 2.06 P99: 5.86 P99.9: 12.45 P99.99: 21.68 ------------------------------------------------------ [ 0, 1 ] 19185 9.852% 9.852% ## ( 1, 2 ] 124904 64.143% 73.996% ############# ( 2, 3 ] 31854 16.358% 90.354% ### ( 3, 4 ] 9856 5.061% 95.416% # ( 4, 6 ] 7486 3.844% 99.260% # ( 6, 10 ] 1107 0.568% 99.828% ( 10, 15 ] 284 0.146% 99.974% ( 15, 22 ] 32 0.016% 99.991% ( 22, 34 ] 2 0.001% 99.992% ( 34, 51 ] 1 0.001% 99.992% ( 110, 170 ] 1 0.001% 99.993% ( 250, 380 ] 6 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 2 0.001% 99.997% ( 870, 1300 ] 2 0.001% 99.998% ( 1300, 1900 ] 3 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 40614 Average: 2.4711 StdDev: 25.56 Min: 1 Median: 1.3595 Max: 3742 Percentiles: P50: 1.36 P75: 1.80 P99: 5.89 P99.9: 104.78 P99.99: 767.40 ------------------------------------------------------ [ 0, 1 ] 12101 29.795% 29.795% ###### ( 1, 2 ] 22825 56.200% 85.995% ########### ( 2, 3 ] 3156 7.771% 93.766% ## ( 3, 4 ] 1284 3.161% 96.927% # ( 4, 6 ] 889 2.189% 99.116% ( 6, 10 ] 228 0.561% 99.677% ( 10, 15 ] 46 0.113% 99.791% ( 15, 22 ] 11 0.027% 99.818% ( 34, 51 ] 20 0.049% 99.867% ( 51, 76 ] 10 0.025% 99.892% ( 76, 110 ] 4 0.010% 99.902% ( 110, 170 ] 3 0.007% 99.909% ( 170, 250 ] 16 0.039% 99.948% ( 250, 380 ] 11 0.027% 99.975% ( 380, 580 ] 4 0.010% 99.985% ( 580, 870 ] 3 0.007% 99.993% ( 870, 1300 ] 1 0.002% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 196645 Average: 3.6033 StdDev: 33.87 Min: 0 Median: 1.6755 Max: 4545 Percentiles: P50: 1.68 P75: 2.26 P99: 9.27 P99.9: 233.68 P99.99: 736.83 ------------------------------------------------------ [ 0, 1 ] 14207 7.225% 7.225% # ( 1, 2 ] 124521 63.323% 70.547% ############# ( 2, 3 ] 33140 16.853% 87.400% ### ( 3, 4 ] 11543 5.870% 93.270% # ( 4, 6 ] 8240 4.190% 97.460% # ( 6, 10 ] 3704 1.884% 99.344% ( 10, 15 ] 498 0.253% 99.597% ( 15, 22 ] 118 0.060% 99.657% ( 22, 34 ] 23 0.012% 99.669% ( 34, 51 ] 18 0.009% 99.678% ( 51, 76 ] 16 0.008% 99.686% ( 76, 110 ] 114 0.058% 99.744% ( 110, 170 ] 218 0.111% 99.855% ( 170, 250 ] 111 0.056% 99.912% ( 250, 380 ] 69 0.035% 99.947% ( 380, 580 ] 61 0.031% 99.978% ( 580, 870 ] 45 0.023% 100.001% ( 870, 1300 ] 15 0.008% 100.008% ( 1300, 1900 ] 9 0.005% 100.013% ( 1900, 2900 ] 9 0.005% 100.017% ( 2900, 4400 ] 5 0.003% 100.020% ( 4400, 6600 ] 1 0.001% 100.020% ** Level 4 read latency histogram (micros): Count: 35 Average: 1663.2571 StdDev: 1208.73 Min: 234 Median: 1192.5000 Max: 5144 Percentiles: P50: 1192.50 P75: 2441.67 P99: 5144.00 P99.9: 5144.00 P99.99: 5144.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 12 34.286% 45.714% ####### ( 870, 1300 ] 2 5.714% 51.429% # ( 1300, 1900 ] 5 14.286% 65.714% ### ( 1900, 2900 ] 6 17.143% 82.857% ### ( 2900, 4400 ] 5 14.286% 97.143% ### ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 544.7500 StdDev: 615.12 Min: 84 Median: 250.0000 Max: 1855 Percentiles: P50: 250.00 P75: 580.00 P99: 1855.00 P99.9: 1855.00 P99.99: 1855.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 6 30.000% 45.000% ###### ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 3 15.000% 65.000% ### ( 380, 580 ] 2 10.000% 75.000% ## ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 9.2 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.957 H:M:S, 10.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.417 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-01:34:14 ... thread 0: (1000000,4000000) ops and (335977.4,335695.3) ops/second in (2.976391,11.915569) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 3.07 GB 0.0 2.8 0.0 2.8 6.5 3.7 0.0 1.7 132.4 308.9 21.40 20.05 63 0.340 2878K 3133 0.0 0.0 L1 2/2 50.40 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 247.5 247.1 3.31 3.22 2 1.654 831K 1422 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.5 1.8 232.3 232.2 0.48 0.45 1 0.480 113K 23 0.0 0.0 L3 27/0 966.31 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 214.1 214.0 6.54 5.83 4 1.634 1399K 717 0.0 0.0 L4 148/0 9.57 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1239/16 99.82 GB 0.0 5.0 1.2 3.9 8.7 4.9 1.3 2.4 162.8 281.7 31.73 29.55 70 0.453 5222K 5295 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 1.2 3.9 8.7 4.9 1.3 2.4 162.8 281.7 31.73 29.55 70 0.453 5222K 5295 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 1.2 3.9 5.0 1.2 0.0 0.0 244.4 244.2 21.13 20.11 17 1.243 5222K 5295 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 356.7 10.60 9.43 53 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.73 GB write, 736.83 MB/s write, 5.04 GB read, 425.72 MB/s read, 31.7 seconds Interval compaction: 8.73 GB write, 750.05 MB/s write, 5.04 GB read, 433.36 MB/s read, 31.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 18, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 886444 Average: 2.1211 StdDev: 10.51 Min: 0 Median: 1.4224 Max: 3755 Percentiles: P50: 1.42 P75: 1.82 P99: 5.52 P99.9: 11.84 P99.99: 109.18 ------------------------------------------------------ [ 0, 1 ] 209403 23.623% 23.623% ##### ( 1, 2 ] 553528 62.444% 86.066% ############ ( 2, 3 ] 73824 8.328% 94.395% ## ( 3, 4 ] 28017 3.161% 97.555% # ( 4, 6 ] 16869 1.903% 99.458% ( 6, 10 ] 3559 0.401% 99.860% ( 10, 15 ] 972 0.110% 99.969% ( 15, 22 ] 88 0.010% 99.979% ( 22, 34 ] 17 0.002% 99.981% ( 34, 51 ] 4 0.000% 99.982% ( 51, 76 ] 9 0.001% 99.983% ( 76, 110 ] 68 0.008% 99.990% ( 110, 170 ] 92 0.010% 100.001% ( 170, 250 ] 57 0.006% 100.007% ( 250, 380 ] 38 0.004% 100.011% ( 380, 580 ] 12 0.001% 100.013% ( 580, 870 ] 21 0.002% 100.015% ( 870, 1300 ] 17 0.002% 100.017% ( 1300, 1900 ] 5 0.001% 100.018% ( 1900, 2900 ] 1 0.000% 100.018% ( 2900, 4400 ] 3 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 194727 Average: 2.4010 StdDev: 8.56 Min: 1 Median: 1.6259 Max: 1865 Percentiles: P50: 1.63 P75: 2.06 P99: 5.87 P99.9: 12.47 P99.99: 21.90 ------------------------------------------------------ [ 0, 1 ] 19185 9.852% 9.852% ## ( 1, 2 ] 124904 64.143% 73.995% ############# ( 2, 3 ] 31854 16.358% 90.354% ### ( 3, 4 ] 9856 5.061% 95.415% # ( 4, 6 ] 7486 3.844% 99.259% # ( 6, 10 ] 1107 0.568% 99.828% ( 10, 15 ] 284 0.146% 99.974% ( 15, 22 ] 32 0.016% 99.990% ( 22, 34 ] 2 0.001% 99.991% ( 34, 51 ] 1 0.001% 99.992% ( 110, 170 ] 2 0.001% 99.993% ( 250, 380 ] 6 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 2 0.001% 99.997% ( 870, 1300 ] 2 0.001% 99.998% ( 1300, 1900 ] 3 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 40614 Average: 2.4711 StdDev: 25.56 Min: 1 Median: 1.3595 Max: 3742 Percentiles: P50: 1.36 P75: 1.80 P99: 5.89 P99.9: 104.78 P99.99: 767.40 ------------------------------------------------------ [ 0, 1 ] 12101 29.795% 29.795% ###### ( 1, 2 ] 22825 56.200% 85.995% ########### ( 2, 3 ] 3156 7.771% 93.766% ## ( 3, 4 ] 1284 3.161% 96.927% # ( 4, 6 ] 889 2.189% 99.116% ( 6, 10 ] 228 0.561% 99.677% ( 10, 15 ] 46 0.113% 99.791% ( 15, 22 ] 11 0.027% 99.818% ( 34, 51 ] 20 0.049% 99.867% ( 51, 76 ] 10 0.025% 99.892% ( 76, 110 ] 4 0.010% 99.902% ( 110, 170 ] 3 0.007% 99.909% ( 170, 250 ] 16 0.039% 99.948% ( 250, 380 ] 11 0.027% 99.975% ( 380, 580 ] 4 0.010% 99.985% ( 580, 870 ] 3 0.007% 99.993% ( 870, 1300 ] 1 0.002% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 196645 Average: 3.6033 StdDev: 33.87 Min: 0 Median: 1.6755 Max: 4545 Percentiles: P50: 1.68 P75: 2.26 P99: 9.27 P99.9: 233.68 P99.99: 736.83 ------------------------------------------------------ [ 0, 1 ] 14207 7.225% 7.225% # ( 1, 2 ] 124521 63.323% 70.547% ############# ( 2, 3 ] 33140 16.853% 87.400% ### ( 3, 4 ] 11543 5.870% 93.270% # ( 4, 6 ] 8240 4.190% 97.460% # ( 6, 10 ] 3704 1.884% 99.344% ( 10, 15 ] 498 0.253% 99.597% ( 15, 22 ] 118 0.060% 99.657% ( 22, 34 ] 23 0.012% 99.669% ( 34, 51 ] 18 0.009% 99.678% ( 51, 76 ] 16 0.008% 99.686% ( 76, 110 ] 114 0.058% 99.744% ( 110, 170 ] 218 0.111% 99.855% ( 170, 250 ] 111 0.056% 99.912% ( 250, 380 ] 69 0.035% 99.947% ( 380, 580 ] 61 0.031% 99.978% ( 580, 870 ] 45 0.023% 100.001% ( 870, 1300 ] 15 0.008% 100.008% ( 1300, 1900 ] 9 0.005% 100.013% ( 1900, 2900 ] 9 0.005% 100.017% ( 2900, 4400 ] 5 0.003% 100.020% ( 4400, 6600 ] 1 0.001% 100.020% ** Level 4 read latency histogram (micros): Count: 35 Average: 1663.2571 StdDev: 1208.73 Min: 234 Median: 1192.5000 Max: 5144 Percentiles: P50: 1192.50 P75: 2441.67 P99: 5144.00 P99.9: 5144.00 P99.99: 5144.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 12 34.286% 45.714% ####### ( 870, 1300 ] 2 5.714% 51.429% # ( 1300, 1900 ] 5 14.286% 65.714% ### ( 1900, 2900 ] 6 17.143% 82.857% ### ( 2900, 4400 ] 5 14.286% 97.143% ### ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 544.7500 StdDev: 615.12 Min: 84 Median: 250.0000 Max: 1855 Percentiles: P50: 250.00 P75: 580.00 P99: 1855.00 P99.9: 1855.00 P99.99: 1855.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 6 30.000% 45.000% ###### ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 3 15.000% 65.000% ### ( 380, 580 ] 2 10.000% 75.000% ## ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.340 H:M:S, 11.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.382 H:M:S, 12.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-01:34:20 ... thread 0: (1000000,5000000) ops and (156430.3,273101.8) ops/second in (6.392624,18.308193) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/18 4.12 GB 0.0 3.8 0.0 3.8 8.5 4.7 0.0 1.8 137.7 308.5 28.37 26.64 83 0.342 3965K 4263 0.0 0.0 L1 2/2 50.40 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 247.5 247.1 3.31 3.22 2 1.654 831K 1422 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 0.5 1.8 232.3 232.2 0.48 0.45 1 0.480 113K 23 0.0 0.0 L3 27/0 966.31 MB 1.0 1.4 0.6 0.8 1.4 0.6 0.0 2.2 214.1 214.0 6.54 5.83 4 1.634 1399K 717 0.0 0.0 L4 148/0 9.57 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1243/20 100.87 GB 0.0 6.1 1.2 4.9 10.8 5.9 1.3 2.3 161.1 286.3 38.70 36.14 90 0.430 6309K 6425 0.0 0.0 Int 0/0 0.00 KB 0.0 6.1 1.2 4.9 10.8 5.9 1.3 2.3 161.1 286.3 38.70 36.14 90 0.430 6309K 6425 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.1 1.2 4.9 6.1 1.2 0.0 0.0 248.2 248.0 25.12 24.03 21 1.196 6309K 6425 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 357.2 13.58 12.11 69 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.5 total, 18.3 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.82 GB write, 598.12 MB/s write, 6.09 GB read, 336.62 MB/s read, 38.7 seconds Interval compaction: 10.82 GB write, 605.10 MB/s write, 6.09 GB read, 340.55 MB/s read, 38.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 8, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 8, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 8, total-stops: 20, interval: 28 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1548565 Average: 2.0932 StdDev: 10.12 Min: 0 Median: 1.4223 Max: 3755 Percentiles: P50: 1.42 P75: 1.81 P99: 5.38 P99.9: 10.97 P99.99: 91.21 ------------------------------------------------------ [ 0, 1 ] 351474 22.697% 22.697% ##### ( 1, 2 ] 1001242 64.656% 87.353% ############# ( 2, 3 ] 120837 7.803% 95.156% ## ( 3, 4 ] 43558 2.813% 97.969% # ( 4, 6 ] 23101 1.492% 99.461% ( 6, 10 ] 6535 0.422% 99.883% ( 10, 15 ] 1403 0.091% 99.973% ( 15, 22 ] 167 0.011% 99.984% ( 22, 34 ] 22 0.001% 99.985% ( 34, 51 ] 5 0.000% 99.986% ( 51, 76 ] 11 0.001% 99.986% ( 76, 110 ] 130 0.008% 99.995% ( 110, 170 ] 170 0.011% 100.006% ( 170, 250 ] 82 0.005% 100.011% ( 250, 380 ] 51 0.003% 100.014% ( 380, 580 ] 25 0.002% 100.016% ( 580, 870 ] 35 0.002% 100.018% ( 870, 1300 ] 18 0.001% 100.019% ( 1300, 1900 ] 7 0.000% 100.020% ( 1900, 2900 ] 2 0.000% 100.020% ( 2900, 4400 ] 6 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 194727 Average: 2.4010 StdDev: 8.56 Min: 1 Median: 1.6259 Max: 1865 Percentiles: P50: 1.63 P75: 2.06 P99: 5.87 P99.9: 12.47 P99.99: 21.90 ------------------------------------------------------ [ 0, 1 ] 19185 9.852% 9.852% ## ( 1, 2 ] 124904 64.143% 73.995% ############# ( 2, 3 ] 31854 16.358% 90.354% ### ( 3, 4 ] 9856 5.061% 95.415% # ( 4, 6 ] 7486 3.844% 99.259% # ( 6, 10 ] 1107 0.568% 99.828% ( 10, 15 ] 284 0.146% 99.974% ( 15, 22 ] 32 0.016% 99.990% ( 22, 34 ] 2 0.001% 99.991% ( 34, 51 ] 1 0.001% 99.992% ( 110, 170 ] 2 0.001% 99.993% ( 250, 380 ] 6 0.003% 99.996% ( 380, 580 ] 1 0.001% 99.996% ( 580, 870 ] 2 0.001% 99.997% ( 870, 1300 ] 2 0.001% 99.998% ( 1300, 1900 ] 3 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 40614 Average: 2.4711 StdDev: 25.56 Min: 1 Median: 1.3595 Max: 3742 Percentiles: P50: 1.36 P75: 1.80 P99: 5.89 P99.9: 104.78 P99.99: 767.40 ------------------------------------------------------ [ 0, 1 ] 12101 29.795% 29.795% ###### ( 1, 2 ] 22825 56.200% 85.995% ########### ( 2, 3 ] 3156 7.771% 93.766% ## ( 3, 4 ] 1284 3.161% 96.927% # ( 4, 6 ] 889 2.189% 99.116% ( 6, 10 ] 228 0.561% 99.677% ( 10, 15 ] 46 0.113% 99.791% ( 15, 22 ] 11 0.027% 99.818% ( 34, 51 ] 20 0.049% 99.867% ( 51, 76 ] 10 0.025% 99.892% ( 76, 110 ] 4 0.010% 99.902% ( 110, 170 ] 3 0.007% 99.909% ( 170, 250 ] 16 0.039% 99.948% ( 250, 380 ] 11 0.027% 99.975% ( 380, 580 ] 4 0.010% 99.985% ( 580, 870 ] 3 0.007% 99.993% ( 870, 1300 ] 1 0.002% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 196645 Average: 3.6033 StdDev: 33.87 Min: 0 Median: 1.6755 Max: 4545 Percentiles: P50: 1.68 P75: 2.26 P99: 9.27 P99.9: 233.68 P99.99: 736.83 ------------------------------------------------------ [ 0, 1 ] 14207 7.225% 7.225% # ( 1, 2 ] 124521 63.323% 70.547% ############# ( 2, 3 ] 33140 16.853% 87.400% ### ( 3, 4 ] 11543 5.870% 93.270% # ( 4, 6 ] 8240 4.190% 97.460% # ( 6, 10 ] 3704 1.884% 99.344% ( 10, 15 ] 498 0.253% 99.597% ( 15, 22 ] 118 0.060% 99.657% ( 22, 34 ] 23 0.012% 99.669% ( 34, 51 ] 18 0.009% 99.678% ( 51, 76 ] 16 0.008% 99.686% ( 76, 110 ] 114 0.058% 99.744% ( 110, 170 ] 218 0.111% 99.855% ( 170, 250 ] 111 0.056% 99.912% ( 250, 380 ] 69 0.035% 99.947% ( 380, 580 ] 61 0.031% 99.978% ( 580, 870 ] 45 0.023% 100.001% ( 870, 1300 ] 15 0.008% 100.008% ( 1300, 1900 ] 9 0.005% 100.013% ( 1900, 2900 ] 9 0.005% 100.017% ( 2900, 4400 ] 5 0.003% 100.020% ( 4400, 6600 ] 1 0.001% 100.020% ** Level 4 read latency histogram (micros): Count: 35 Average: 1663.2571 StdDev: 1208.73 Min: 234 Median: 1192.5000 Max: 5144 Percentiles: P50: 1192.50 P75: 2441.67 P99: 5144.00 P99.9: 5144.00 P99.99: 5144.00 ------------------------------------------------------ ( 170, 250 ] 1 2.857% 2.857% # ( 380, 580 ] 3 8.571% 11.429% ## ( 580, 870 ] 12 34.286% 45.714% ####### ( 870, 1300 ] 2 5.714% 51.429% # ( 1300, 1900 ] 5 14.286% 65.714% ### ( 1900, 2900 ] 6 17.143% 82.857% ### ( 2900, 4400 ] 5 14.286% 97.143% ### ( 4400, 6600 ] 1 2.857% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 544.7500 StdDev: 615.12 Min: 84 Median: 250.0000 Max: 1855 Percentiles: P50: 250.00 P75: 580.00 P99: 1855.00 P99.9: 1855.00 P99.99: 1855.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 6 30.000% 45.000% ###### ( 170, 250 ] 1 5.000% 50.000% # ( 250, 380 ] 3 15.000% 65.000% ### ( 380, 580 ] 2 10.000% 75.000% ## ( 870, 1300 ] 1 5.000% 80.000% # ( 1300, 1900 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 18.5 total, 6.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 265.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.045 H:M:S, 27.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 153.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.705 H:M:S, 58.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-01:34:29 ... thread 0: (1000000,6000000) ops and (111993.7,220286.4) ops/second in (8.929075,27.237268) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/5 1.96 GB 12.6 5.6 0.0 5.6 11.2 5.7 0.0 2.0 148.4 298.1 38.63 35.85 101 0.382 5819K 9415 0.0 0.0 L1 17/17 1.28 GB 0.0 3.9 3.6 0.4 3.9 3.5 0.1 1.1 231.1 228.2 17.38 16.61 3 5.792 4077K 49K 0.0 0.0 L2 2/0 95.48 MB 1.0 0.1 0.1 0.0 0.1 0.1 2.3 1.8 232.3 232.2 0.48 0.45 1 0.480 113K 23 0.0 0.0 L3 19/4 1.13 GB 1.0 1.4 0.6 0.8 1.4 0.6 1.7 2.2 214.1 214.0 6.54 5.83 4 1.634 1399K 717 0.0 0.0 L4 149/0 9.42 GB 1.0 0.9 0.8 0.2 0.9 0.7 1.1 1.2 146.1 145.3 6.57 4.37 6 1.094 974K 5000 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1261/26 101.73 GB 0.0 11.9 5.0 6.9 17.5 10.6 7.2 3.1 175.6 257.9 69.59 63.11 115 0.605 12M 64K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.9 5.0 6.9 17.5 10.6 7.2 3.1 175.6 257.9 69.59 63.11 115 0.605 12M 64K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.9 5.0 6.9 11.9 4.9 0.0 0.0 231.3 230.1 52.82 48.51 32 1.651 12M 64K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 345.6 16.77 14.60 83 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.5 total, 27.2 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.53 GB write, 653.77 MB/s write, 11.93 GB read, 445.03 MB/s read, 69.6 seconds Interval compaction: 17.53 GB write, 658.90 MB/s write, 11.93 GB read, 448.52 MB/s read, 69.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 25, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 25, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2433327 Average: 2.3198 StdDev: 14.28 Min: 0 Median: 1.4398 Max: 4425 Percentiles: P50: 1.44 P75: 1.82 P99: 5.70 P99.9: 85.36 P99.99: 213.99 ------------------------------------------------------ [ 0, 1 ] 513831 21.116% 21.116% #### ( 1, 2 ] 1597955 65.670% 86.786% ############# ( 2, 3 ] 195442 8.032% 94.818% ## ( 3, 4 ] 69477 2.855% 97.673% # ( 4, 6 ] 37945 1.559% 99.232% ( 6, 10 ] 13594 0.559% 99.791% ( 10, 15 ] 1985 0.082% 99.873% ( 15, 22 ] 221 0.009% 99.882% ( 22, 34 ] 26 0.001% 99.883% ( 34, 51 ] 8 0.000% 99.883% ( 51, 76 ] 97 0.004% 99.887% ( 76, 110 ] 1140 0.047% 99.934% ( 110, 170 ] 1191 0.049% 99.983% ( 170, 250 ] 314 0.013% 99.996% ( 250, 380 ] 253 0.010% 100.006% ( 380, 580 ] 174 0.007% 100.013% ( 580, 870 ] 127 0.005% 100.019% ( 870, 1300 ] 63 0.003% 100.021% ( 1300, 1900 ] 15 0.001% 100.022% ( 1900, 2900 ] 8 0.000% 100.022% ( 2900, 4400 ] 13 0.001% 100.023% ( 4400, 6600 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 402891 Average: 3.2781 StdDev: 38.61 Min: 0 Median: 1.7526 Max: 6013 Percentiles: P50: 1.75 P75: 2.54 P99: 7.49 P99.9: 13.46 P99.99: 20.87 ------------------------------------------------------ [ 0, 1 ] 25009 6.207% 6.207% # ( 1, 2 ] 234448 58.191% 64.399% ############ ( 2, 3 ] 79039 19.618% 84.017% #### ( 3, 4 ] 31103 7.720% 91.737% ## ( 4, 6 ] 27480 6.821% 98.557% # ( 6, 10 ] 4794 1.190% 99.747% ( 10, 15 ] 888 0.220% 99.968% ( 15, 22 ] 107 0.027% 99.994% ( 22, 34 ] 14 0.003% 99.998% ( 34, 51 ] 9 0.002% 100.000% ( 51, 76 ] 2 0.000% 100.000% ( 76, 110 ] 92 0.023% 100.023% ( 110, 170 ] 89 0.022% 100.045% ( 170, 250 ] 34 0.008% 100.054% ( 250, 380 ] 56 0.014% 100.068% ( 380, 580 ] 35 0.009% 100.076% ( 580, 870 ] 29 0.007% 100.084% ( 870, 1300 ] 21 0.005% 100.089% ( 1300, 1900 ] 17 0.004% 100.093% ( 1900, 2900 ] 15 0.004% 100.097% ( 2900, 4400 ] 24 0.006% 100.103% ( 4400, 6600 ] 3 0.001% 100.104% ** Level 2 read latency histogram (micros): Count: 40614 Average: 2.4711 StdDev: 25.56 Min: 1 Median: 1.3595 Max: 3742 Percentiles: P50: 1.36 P75: 1.80 P99: 5.89 P99.9: 104.78 P99.99: 767.40 ------------------------------------------------------ [ 0, 1 ] 12101 29.795% 29.795% ###### ( 1, 2 ] 22825 56.200% 85.995% ########### ( 2, 3 ] 3156 7.771% 93.766% ## ( 3, 4 ] 1284 3.161% 96.927% # ( 4, 6 ] 889 2.189% 99.116% ( 6, 10 ] 228 0.561% 99.677% ( 10, 15 ] 46 0.113% 99.791% ( 15, 22 ] 11 0.027% 99.818% ( 34, 51 ] 20 0.049% 99.867% ( 51, 76 ] 10 0.025% 99.892% ( 76, 110 ] 4 0.010% 99.902% ( 110, 170 ] 3 0.007% 99.909% ( 170, 250 ] 16 0.039% 99.948% ( 250, 380 ] 11 0.027% 99.975% ( 380, 580 ] 4 0.010% 99.985% ( 580, 870 ] 3 0.007% 99.993% ( 870, 1300 ] 1 0.002% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 280998 Average: 7.2855 StdDev: 88.19 Min: 0 Median: 1.7306 Max: 7474 Percentiles: P50: 1.73 P75: 2.48 P99: 12.01 P99.9: 809.79 P99.99: 1699.17 ------------------------------------------------------ [ 0, 1 ] 17267 6.145% 6.145% # ( 1, 2 ] 168666 60.024% 66.169% ############ ( 2, 3 ] 51318 18.263% 84.432% #### ( 3, 4 ] 20575 7.322% 91.754% # ( 4, 6 ] 14292 5.086% 96.840% # ( 6, 10 ] 5725 2.037% 98.877% ( 10, 15 ] 860 0.306% 99.183% ( 15, 22 ] 168 0.060% 99.243% ( 22, 34 ] 30 0.011% 99.254% ( 34, 51 ] 19 0.007% 99.260% ( 51, 76 ] 17 0.006% 99.267% ( 76, 110 ] 150 0.053% 99.320% ( 110, 170 ] 396 0.141% 99.461% ( 170, 250 ] 305 0.109% 99.569% ( 250, 380 ] 347 0.123% 99.693% ( 380, 580 ] 353 0.126% 99.819% ( 580, 870 ] 289 0.103% 99.921% ( 870, 1300 ] 145 0.052% 99.973% ( 1300, 1900 ] 72 0.026% 99.999% ( 1900, 2900 ] 57 0.020% 100.019% ( 2900, 4400 ] 70 0.025% 100.044% ( 4400, 6600 ] 9 0.003% 100.047% ( 6600, 9900 ] 3 0.001% 100.048% ** Level 4 read latency histogram (micros): Count: 155 Average: 542.8065 StdDev: 953.07 Min: 1 Median: 4.3333 Max: 5144 Percentiles: P50: 4.33 P75: 693.28 P99: 4235.00 P99.9: 5144.00 P99.99: 5144.00 ------------------------------------------------------ [ 0, 1 ] 20 12.903% 12.903% ### ( 1, 2 ] 33 21.290% 34.194% #### ( 2, 3 ] 17 10.968% 45.161% ## ( 3, 4 ] 7 4.516% 49.677% # ( 4, 6 ] 3 1.935% 51.613% ( 6, 10 ] 2 1.290% 52.903% ( 15, 22 ] 1 0.645% 53.548% ( 22, 34 ] 1 0.645% 54.194% ( 76, 110 ] 2 1.290% 55.484% ( 110, 170 ] 2 1.290% 56.774% ( 170, 250 ] 12 7.742% 64.516% ## ( 250, 380 ] 6 3.871% 68.387% # ( 380, 580 ] 4 2.581% 70.968% # ( 580, 870 ] 16 10.323% 81.290% ## ( 870, 1300 ] 6 3.871% 85.161% # ( 1300, 1900 ] 7 4.516% 89.677% # ( 1900, 2900 ] 10 6.452% 96.129% # ( 2900, 4400 ] 5 3.226% 99.355% # ( 4400, 6600 ] 1 0.645% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 981.0250 StdDev: 1325.35 Min: 84 Median: 396.6667 Max: 8377 Percentiles: P50: 396.67 P75: 1300.00 P99: 7920.00 P99.9: 8377.00 P99.99: 8377.00 ------------------------------------------------------ ( 76, 110 ] 10 8.333% 8.333% ## ( 110, 170 ] 22 18.333% 26.667% #### ( 170, 250 ] 18 15.000% 41.667% ### ( 250, 380 ] 9 7.500% 49.167% ## ( 380, 580 ] 12 10.000% 59.167% ## ( 580, 870 ] 10 8.333% 67.500% ## ( 870, 1300 ] 9 7.500% 75.000% ## ( 1300, 1900 ] 9 7.500% 82.500% ## ( 1900, 2900 ] 10 8.333% 90.833% ## ( 2900, 4400 ] 9 7.500% 98.333% ## ( 6600, 9900 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 27.5 total, 8.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 215.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.981 H:M:S, 40.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 110.22 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.936 H:M:S, 66.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-01:34:32 ... thread 0: (1000000,7000000) ops and (326170.6,230999.1) ops/second in (3.065880,30.303148) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/9 2.95 GB 88.1 6.2 0.0 6.2 12.8 6.6 0.0 1.9 144.5 300.3 43.60 40.49 117 0.373 6395K 10K 0.0 0.0 L1 17/17 1.28 GB 0.0 3.9 3.6 0.4 3.9 3.5 0.1 1.1 231.1 228.2 17.38 16.61 3 5.792 4077K 49K 0.0 0.0 L2 2/0 95.48 MB 1.0 0.1 0.1 0.0 0.1 0.1 2.3 1.8 232.3 232.2 0.48 0.45 1 0.480 113K 23 0.0 0.0 L3 15/0 994.92 MB 1.0 1.4 0.6 0.8 1.4 0.6 1.7 2.2 214.1 214.0 6.54 5.83 4 1.634 1399K 717 0.0 0.0 L4 166/0 9.58 GB 1.0 1.1 0.9 0.2 1.1 0.9 1.1 1.2 140.5 139.9 7.95 5.15 7 1.136 1104K 5000 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/26 102.72 GB 0.0 12.6 5.1 7.5 19.2 11.7 7.2 2.9 170.4 259.1 75.95 68.53 132 0.575 13M 65K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.6 5.1 7.5 19.2 11.7 7.2 2.9 170.4 259.1 75.95 68.53 132 0.575 13M 65K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.6 5.1 7.5 12.6 5.1 0.0 0.0 229.9 228.8 56.29 51.34 35 1.608 13M 65K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 346.1 19.66 17.19 97 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 30.5 total, 30.3 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.22 GB write, 644.86 MB/s write, 12.64 GB read, 424.08 MB/s read, 75.9 seconds Interval compaction: 19.22 GB write, 649.41 MB/s write, 12.64 GB read, 427.07 MB/s read, 75.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 28, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 28, interval: 44 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2800092 Average: 2.3080 StdDev: 13.63 Min: 0 Median: 1.4514 Max: 4425 Percentiles: P50: 1.45 P75: 1.83 P99: 5.72 P99.9: 53.02 P99.99: 182.40 ------------------------------------------------------ [ 0, 1 ] 566767 20.241% 20.241% #### ( 1, 2 ] 1845977 65.926% 86.167% ############# ( 2, 3 ] 238424 8.515% 94.681% ## ( 3, 4 ] 81890 2.925% 97.606% # ( 4, 6 ] 45479 1.624% 99.230% ( 6, 10 ] 16335 0.583% 99.814% ( 10, 15 ] 2144 0.077% 99.890% ( 15, 22 ] 236 0.008% 99.899% ( 22, 34 ] 26 0.001% 99.900% ( 34, 51 ] 8 0.000% 99.900% ( 51, 76 ] 98 0.003% 99.903% ( 76, 110 ] 1168 0.042% 99.945% ( 110, 170 ] 1211 0.043% 99.988% ( 170, 250 ] 329 0.012% 100.000% ( 250, 380 ] 263 0.009% 100.009% ( 380, 580 ] 182 0.006% 100.016% ( 580, 870 ] 136 0.005% 100.021% ( 870, 1300 ] 65 0.002% 100.023% ( 1300, 1900 ] 16 0.001% 100.024% ( 1900, 2900 ] 8 0.000% 100.024% ( 2900, 4400 ] 14 0.000% 100.024% ( 4400, 6600 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 402891 Average: 3.2781 StdDev: 38.61 Min: 0 Median: 1.7526 Max: 6013 Percentiles: P50: 1.75 P75: 2.54 P99: 7.49 P99.9: 13.46 P99.99: 20.87 ------------------------------------------------------ [ 0, 1 ] 25009 6.207% 6.207% # ( 1, 2 ] 234448 58.191% 64.399% ############ ( 2, 3 ] 79039 19.618% 84.017% #### ( 3, 4 ] 31103 7.720% 91.737% ## ( 4, 6 ] 27480 6.821% 98.557% # ( 6, 10 ] 4794 1.190% 99.747% ( 10, 15 ] 888 0.220% 99.968% ( 15, 22 ] 107 0.027% 99.994% ( 22, 34 ] 14 0.003% 99.998% ( 34, 51 ] 9 0.002% 100.000% ( 51, 76 ] 2 0.000% 100.000% ( 76, 110 ] 92 0.023% 100.023% ( 110, 170 ] 89 0.022% 100.045% ( 170, 250 ] 34 0.008% 100.054% ( 250, 380 ] 56 0.014% 100.068% ( 380, 580 ] 35 0.009% 100.076% ( 580, 870 ] 29 0.007% 100.084% ( 870, 1300 ] 21 0.005% 100.089% ( 1300, 1900 ] 17 0.004% 100.093% ( 1900, 2900 ] 15 0.004% 100.097% ( 2900, 4400 ] 24 0.006% 100.103% ( 4400, 6600 ] 3 0.001% 100.104% ** Level 2 read latency histogram (micros): Count: 40614 Average: 2.4711 StdDev: 25.56 Min: 1 Median: 1.3595 Max: 3742 Percentiles: P50: 1.36 P75: 1.80 P99: 5.89 P99.9: 104.78 P99.99: 767.40 ------------------------------------------------------ [ 0, 1 ] 12101 29.795% 29.795% ###### ( 1, 2 ] 22825 56.200% 85.995% ########### ( 2, 3 ] 3156 7.771% 93.766% ## ( 3, 4 ] 1284 3.161% 96.927% # ( 4, 6 ] 889 2.189% 99.116% ( 6, 10 ] 228 0.561% 99.677% ( 10, 15 ] 46 0.113% 99.791% ( 15, 22 ] 11 0.027% 99.818% ( 34, 51 ] 20 0.049% 99.867% ( 51, 76 ] 10 0.025% 99.892% ( 76, 110 ] 4 0.010% 99.902% ( 110, 170 ] 3 0.007% 99.909% ( 170, 250 ] 16 0.039% 99.948% ( 250, 380 ] 11 0.027% 99.975% ( 380, 580 ] 4 0.010% 99.985% ( 580, 870 ] 3 0.007% 99.993% ( 870, 1300 ] 1 0.002% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 283913 Average: 7.2340 StdDev: 87.74 Min: 0 Median: 1.7287 Max: 7474 Percentiles: P50: 1.73 P75: 2.48 P99: 11.84 P99.9: 806.87 P99.99: 1696.74 ------------------------------------------------------ [ 0, 1 ] 17484 6.158% 6.158% # ( 1, 2 ] 170822 60.167% 66.325% ############ ( 2, 3 ] 51676 18.201% 84.527% #### ( 3, 4 ] 20657 7.276% 91.802% # ( 4, 6 ] 14338 5.050% 96.853% # ( 6, 10 ] 5780 2.036% 98.888% ( 10, 15 ] 861 0.303% 99.192% ( 15, 22 ] 168 0.059% 99.251% ( 22, 34 ] 30 0.011% 99.261% ( 34, 51 ] 19 0.007% 99.268% ( 51, 76 ] 17 0.006% 99.274% ( 76, 110 ] 150 0.053% 99.327% ( 110, 170 ] 396 0.139% 99.466% ( 170, 250 ] 305 0.107% 99.574% ( 250, 380 ] 347 0.122% 99.696% ( 380, 580 ] 353 0.124% 99.820% ( 580, 870 ] 289 0.102% 99.922% ( 870, 1300 ] 145 0.051% 99.973% ( 1300, 1900 ] 72 0.025% 99.999% ( 1900, 2900 ] 57 0.020% 100.019% ( 2900, 4400 ] 70 0.025% 100.043% ( 4400, 6600 ] 9 0.003% 100.046% ( 6600, 9900 ] 3 0.001% 100.048% ** Level 4 read latency histogram (micros): Count: 240 Average: 355.7542 StdDev: 807.00 Min: 0 Median: 2.7895 Max: 5144 Percentiles: P50: 2.79 P75: 227.14 P99: 3980.00 P99.9: 5144.00 P99.99: 5144.00 ------------------------------------------------------ [ 0, 1 ] 57 23.750% 23.750% ##### ( 1, 2 ] 48 20.000% 43.750% #### ( 2, 3 ] 19 7.917% 51.667% ## ( 3, 4 ] 10 4.167% 55.833% # ( 4, 6 ] 9 3.750% 59.583% # ( 6, 10 ] 5 2.083% 61.667% ( 10, 15 ] 3 1.250% 62.917% ( 15, 22 ] 3 1.250% 64.167% ( 22, 34 ] 12 5.000% 69.167% # ( 76, 110 ] 2 0.833% 70.000% ( 110, 170 ] 2 0.833% 70.833% ( 170, 250 ] 14 5.833% 76.667% # ( 250, 380 ] 7 2.917% 79.583% # ( 380, 580 ] 4 1.667% 81.250% ( 580, 870 ] 16 6.667% 87.917% # ( 870, 1300 ] 6 2.500% 90.417% # ( 1300, 1900 ] 7 2.917% 93.333% # ( 1900, 2900 ] 10 4.167% 97.500% # ( 2900, 4400 ] 5 2.083% 99.583% ( 4400, 6600 ] 1 0.417% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 981.0250 StdDev: 1325.35 Min: 84 Median: 396.6667 Max: 8377 Percentiles: P50: 396.67 P75: 1300.00 P99: 7920.00 P99.9: 8377.00 P99.99: 8377.00 ------------------------------------------------------ ( 76, 110 ] 10 8.333% 8.333% ## ( 110, 170 ] 22 18.333% 26.667% #### ( 170, 250 ] 18 15.000% 41.667% ### ( 250, 380 ] 9 7.500% 49.167% ## ( 380, 580 ] 12 10.000% 59.167% ## ( 580, 870 ] 10 8.333% 67.500% ## ( 870, 1300 ] 9 7.500% 75.000% ## ( 1300, 1900 ] 9 7.500% 82.500% ## ( 1900, 2900 ] 10 8.333% 90.833% ## ( 2900, 4400 ] 9 7.500% 98.333% ## ( 6600, 9900 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 30.5 total, 3.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 225.74 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.392 H:M:S, 37.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.411 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-01:34:43 ... thread 0: (1000000,8000000) ops and (90782.3,193617.8) ops/second in (11.015363,41.318511) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/5 3.98 GB 219.4 9.0 0.0 9.0 16.6 7.7 0.0 2.2 157.8 292.6 58.27 54.25 138 0.422 9336K 20K 0.0 0.0 L1 17/17 1.28 GB 0.0 3.9 3.6 0.4 3.9 3.5 0.1 1.1 231.1 228.2 17.38 16.61 3 5.792 4077K 49K 0.0 0.0 L2 2/0 95.48 MB 1.0 0.1 0.1 0.0 0.1 0.1 2.3 1.8 232.3 232.2 0.48 0.45 1 0.480 113K 23 0.0 0.0 L3 15/0 994.92 MB 1.0 1.4 0.6 0.8 1.4 0.6 1.7 2.2 214.1 214.0 6.54 5.83 4 1.634 1399K 717 0.0 0.0 L4 166/0 9.58 GB 1.0 1.1 0.9 0.2 1.1 0.9 1.1 1.2 140.5 139.9 7.95 5.15 7 1.136 1104K 5000 0.0 0.0 L5 1068/0 87.85 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1278/22 103.75 GB 0.0 15.5 5.1 10.3 23.1 12.8 7.2 3.0 174.8 260.9 90.61 82.29 153 0.592 16M 75K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.5 5.1 10.3 23.1 12.8 7.2 3.0 174.8 260.9 90.61 82.29 153 0.592 16M 75K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.5 5.1 10.3 15.4 5.1 0.0 0.0 233.4 232.3 67.86 62.37 41 1.655 16M 75K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.7 7.7 0.0 0.0 0.0 346.2 22.75 19.92 112 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 41.5 total, 41.3 interval Flush(GB): cumulative 7.690, interval 7.690 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.08 GB write, 569.11 MB/s write, 15.47 GB read, 381.34 MB/s read, 90.6 seconds Interval compaction: 23.08 GB write, 572.05 MB/s write, 15.47 GB read, 383.31 MB/s read, 90.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 7, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 32, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3769201 Average: 2.4823 StdDev: 14.72 Min: 0 Median: 1.4669 Max: 4509 Percentiles: P50: 1.47 P75: 1.84 P99: 5.90 P99.9: 121.53 P99.99: 247.65 ------------------------------------------------------ [ 0, 1 ] 719115 19.079% 19.079% #### ( 1, 2 ] 2496415 66.232% 85.311% ############# ( 2, 3 ] 340643 9.038% 94.348% ## ( 3, 4 ] 114747 3.044% 97.393% # ( 4, 6 ] 63824 1.693% 99.086% ( 6, 10 ] 23630 0.627% 99.713% ( 10, 15 ] 2736 0.073% 99.785% ( 15, 22 ] 314 0.008% 99.794% ( 22, 34 ] 32 0.001% 99.795% ( 34, 51 ] 9 0.000% 99.795% ( 51, 76 ] 118 0.003% 99.798% ( 76, 110 ] 3214 0.085% 99.883% ( 110, 170 ] 3303 0.088% 99.971% ( 170, 250 ] 746 0.020% 99.991% ( 250, 380 ] 512 0.014% 100.004% ( 380, 580 ] 380 0.010% 100.014% ( 580, 870 ] 205 0.005% 100.020% ( 870, 1300 ] 88 0.002% 100.022% ( 1300, 1900 ] 20 0.001% 100.023% ( 1900, 2900 ] 14 0.000% 100.023% ( 2900, 4400 ] 17 0.000% 100.023% ( 4400, 6600 ] 2 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 736484 Average: 3.2028 StdDev: 31.10 Min: 0 Median: 1.6467 Max: 6013 Percentiles: P50: 1.65 P75: 2.19 P99: 8.18 P99.9: 124.94 P99.99: 217.31 ------------------------------------------------------ [ 0, 1 ] 72041 9.782% 9.782% ## ( 1, 2 ] 457986 62.185% 71.967% ############ ( 2, 3 ] 116292 15.790% 87.757% ### ( 3, 4 ] 42968 5.834% 93.592% # ( 4, 6 ] 34825 4.729% 98.320% # ( 6, 10 ] 9195 1.248% 99.569% ( 10, 15 ] 1096 0.149% 99.717% ( 15, 22 ] 143 0.019% 99.737% ( 22, 34 ] 16 0.002% 99.739% ( 34, 51 ] 12 0.002% 99.741% ( 51, 76 ] 60 0.008% 99.749% ( 76, 110 ] 931 0.126% 99.875% ( 110, 170 ] 733 0.100% 99.975% ( 170, 250 ] 190 0.026% 100.001% ( 250, 380 ] 155 0.021% 100.022% ( 380, 580 ] 108 0.015% 100.036% ( 580, 870 ] 53 0.007% 100.043% ( 870, 1300 ] 26 0.004% 100.047% ( 1300, 1900 ] 26 0.004% 100.051% ( 1900, 2900 ] 16 0.002% 100.053% ( 2900, 4400 ] 26 0.004% 100.056% ( 4400, 6600 ] 3 0.000% 100.057% ** Level 2 read latency histogram (micros): Count: 40614 Average: 2.4711 StdDev: 25.56 Min: 1 Median: 1.3595 Max: 3742 Percentiles: P50: 1.36 P75: 1.80 P99: 5.89 P99.9: 104.78 P99.99: 767.40 ------------------------------------------------------ [ 0, 1 ] 12101 29.795% 29.795% ###### ( 1, 2 ] 22825 56.200% 85.995% ########### ( 2, 3 ] 3156 7.771% 93.766% ## ( 3, 4 ] 1284 3.161% 96.927% # ( 4, 6 ] 889 2.189% 99.116% ( 6, 10 ] 228 0.561% 99.677% ( 10, 15 ] 46 0.113% 99.791% ( 15, 22 ] 11 0.027% 99.818% ( 34, 51 ] 20 0.049% 99.867% ( 51, 76 ] 10 0.025% 99.892% ( 76, 110 ] 4 0.010% 99.902% ( 110, 170 ] 3 0.007% 99.909% ( 170, 250 ] 16 0.039% 99.948% ( 250, 380 ] 11 0.027% 99.975% ( 380, 580 ] 4 0.010% 99.985% ( 580, 870 ] 3 0.007% 99.993% ( 870, 1300 ] 1 0.002% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 283913 Average: 7.2340 StdDev: 87.74 Min: 0 Median: 1.7287 Max: 7474 Percentiles: P50: 1.73 P75: 2.48 P99: 11.84 P99.9: 806.87 P99.99: 1696.74 ------------------------------------------------------ [ 0, 1 ] 17484 6.158% 6.158% # ( 1, 2 ] 170822 60.167% 66.325% ############ ( 2, 3 ] 51676 18.201% 84.527% #### ( 3, 4 ] 20657 7.276% 91.802% # ( 4, 6 ] 14338 5.050% 96.853% # ( 6, 10 ] 5780 2.036% 98.888% ( 10, 15 ] 861 0.303% 99.192% ( 15, 22 ] 168 0.059% 99.251% ( 22, 34 ] 30 0.011% 99.261% ( 34, 51 ] 19 0.007% 99.268% ( 51, 76 ] 17 0.006% 99.274% ( 76, 110 ] 150 0.053% 99.327% ( 110, 170 ] 396 0.139% 99.466% ( 170, 250 ] 305 0.107% 99.574% ( 250, 380 ] 347 0.122% 99.696% ( 380, 580 ] 353 0.124% 99.820% ( 580, 870 ] 289 0.102% 99.922% ( 870, 1300 ] 145 0.051% 99.973% ( 1300, 1900 ] 72 0.025% 99.999% ( 1900, 2900 ] 57 0.020% 100.019% ( 2900, 4400 ] 70 0.025% 100.043% ( 4400, 6600 ] 9 0.003% 100.046% ( 6600, 9900 ] 3 0.001% 100.048% ** Level 4 read latency histogram (micros): Count: 240 Average: 355.7542 StdDev: 807.00 Min: 0 Median: 2.7895 Max: 5144 Percentiles: P50: 2.79 P75: 227.14 P99: 3980.00 P99.9: 5144.00 P99.99: 5144.00 ------------------------------------------------------ [ 0, 1 ] 57 23.750% 23.750% ##### ( 1, 2 ] 48 20.000% 43.750% #### ( 2, 3 ] 19 7.917% 51.667% ## ( 3, 4 ] 10 4.167% 55.833% # ( 4, 6 ] 9 3.750% 59.583% # ( 6, 10 ] 5 2.083% 61.667% ( 10, 15 ] 3 1.250% 62.917% ( 15, 22 ] 3 1.250% 64.167% ( 22, 34 ] 12 5.000% 69.167% # ( 76, 110 ] 2 0.833% 70.000% ( 110, 170 ] 2 0.833% 70.833% ( 170, 250 ] 14 5.833% 76.667% # ( 250, 380 ] 7 2.917% 79.583% # ( 380, 580 ] 4 1.667% 81.250% ( 580, 870 ] 16 6.667% 87.917% # ( 870, 1300 ] 6 2.500% 90.417% # ( 1300, 1900 ] 7 2.917% 93.333% # ( 1900, 2900 ] 10 4.167% 97.500% # ( 2900, 4400 ] 5 2.083% 99.583% ( 4400, 6600 ] 1 0.417% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 981.0250 StdDev: 1325.35 Min: 84 Median: 396.6667 Max: 8377 Percentiles: P50: 396.67 P75: 1300.00 P99: 7920.00 P99.9: 8377.00 P99.99: 8377.00 ------------------------------------------------------ ( 76, 110 ] 10 8.333% 8.333% ## ( 110, 170 ] 22 18.333% 26.667% #### ( 170, 250 ] 18 15.000% 41.667% ### ( 250, 380 ] 9 7.500% 49.167% ## ( 380, 580 ] 12 10.000% 59.167% ## ( 580, 870 ] 10 8.333% 67.500% ## ( 870, 1300 ] 9 7.500% 75.000% ## ( 1300, 1900 ] 9 7.500% 82.500% ## ( 1900, 2900 ] 10 8.333% 90.833% ## ( 2900, 4400 ] 9 7.500% 98.333% ## ( 6600, 9900 ] 2 1.667% 100.000% ** DB Stats ** Uptime(secs): 41.5 total, 11.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 189.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.483 H:M:S, 46.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 89.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:8.091 H:M:S, 73.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/11/27-01:34:49 ... thread 0: (1000000,9000000) ops and (161745.6,189469.5) ops/second in (6.182548,47.501059) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 3.00 GB 25.2 9.2 0.0 9.2 17.8 8.5 0.0 2.1 150.8 290.3 62.64 57.62 151 0.415 9592K 20K 0.0 0.0 L1 18/18 2.08 GB 0.0 7.0 5.4 1.6 7.0 5.3 0.1 1.3 225.8 223.1 31.94 30.12 4 7.986 6189K 49K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 3.3 1.8 232.3 232.2 0.48 0.45 1 0.480 113K 23 0.0 0.0 L3 22/0 965.56 MB 1.0 3.8 1.6 2.1 3.7 1.6 1.8 2.3 208.3 207.3 18.44 16.57 12 1.537 3880K 18K 0.0 0.0 L4 169/0 9.70 GB 1.0 2.3 2.0 0.3 2.3 2.0 1.1 1.2 146.4 145.7 16.41 11.11 23 0.714 2410K 12K 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1303/31 104.55 GB 0.0 22.5 9.1 13.4 30.9 17.5 9.3 3.6 177.2 243.5 129.91 115.87 191 0.680 22M 100K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.5 9.1 13.4 30.9 17.5 9.3 3.6 177.2 243.5 129.91 115.87 191 0.680 22M 100K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.5 9.1 13.4 22.3 9.0 0.0 0.0 221.6 220.3 103.87 93.58 67 1.550 22M 100K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 336.3 26.04 22.29 124 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.7 total, 47.5 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.89 GB write, 662.97 MB/s write, 22.48 GB read, 482.35 MB/s read, 129.9 seconds Interval compaction: 30.89 GB write, 665.96 MB/s write, 22.48 GB read, 484.52 MB/s read, 129.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 37, pending-compaction-bytes-delays: 21, pending-compaction-bytes-stops: 0, total-delays: 37, total-stops: 37, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4232526 Average: 2.5648 StdDev: 17.14 Min: 0 Median: 1.4949 Max: 4996 Percentiles: P50: 1.49 P75: 1.88 P99: 6.19 P99.9: 119.30 P99.99: 278.30 ------------------------------------------------------ [ 0, 1 ] 745169 17.606% 17.606% #### ( 1, 2 ] 2770356 65.454% 83.060% ############# ( 2, 3 ] 432170 10.211% 93.270% ## ( 3, 4 ] 146466 3.460% 96.731% # ( 4, 6 ] 94508 2.233% 98.964% ( 6, 10 ] 31765 0.750% 99.714% ( 10, 15 ] 3503 0.083% 99.797% ( 15, 22 ] 390 0.009% 99.806% ( 22, 34 ] 38 0.001% 99.807% ( 34, 51 ] 10 0.000% 99.807% ( 51, 76 ] 121 0.003% 99.810% ( 76, 110 ] 3276 0.077% 99.888% ( 110, 170 ] 3384 0.080% 99.968% ( 170, 250 ] 820 0.019% 99.987% ( 250, 380 ] 596 0.014% 100.001% ( 380, 580 ] 454 0.011% 100.012% ( 580, 870 ] 250 0.006% 100.018% ( 870, 1300 ] 131 0.003% 100.021% ( 1300, 1900 ] 46 0.001% 100.022% ( 1900, 2900 ] 24 0.001% 100.022% ( 2900, 4400 ] 30 0.001% 100.023% ( 4400, 6600 ] 3 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1262671 Average: 3.6004 StdDev: 40.09 Min: 0 Median: 1.7170 Max: 11080 Percentiles: P50: 1.72 P75: 2.45 P99: 8.62 P99.9: 127.99 P99.99: 249.95 ------------------------------------------------------ [ 0, 1 ] 84985 6.731% 6.731% # ( 1, 2 ] 762027 60.350% 67.081% ############ ( 2, 3 ] 224597 17.787% 84.868% #### ( 3, 4 ] 90645 7.179% 92.047% # ( 4, 6 ] 74018 5.862% 97.909% # ( 6, 10 ] 21011 1.664% 99.573% ( 10, 15 ] 2359 0.187% 99.760% ( 15, 22 ] 292 0.023% 99.783% ( 22, 34 ] 28 0.002% 99.785% ( 34, 51 ] 12 0.001% 99.786% ( 51, 76 ] 62 0.005% 99.791% ( 76, 110 ] 1062 0.084% 99.875% ( 110, 170 ] 1035 0.082% 99.957% ( 170, 250 ] 412 0.033% 99.990% ( 250, 380 ] 381 0.030% 100.020% ( 380, 580 ] 317 0.025% 100.045% ( 580, 870 ] 227 0.018% 100.063% ( 870, 1300 ] 127 0.010% 100.073% ( 1300, 1900 ] 51 0.004% 100.077% ( 1900, 2900 ] 38 0.003% 100.080% ( 2900, 4400 ] 44 0.003% 100.084% ( 4400, 6600 ] 11 0.001% 100.085% ( 6600, 9900 ] 5 0.000% 100.085% ( 9900, 14000 ] 1 0.000% 100.085% ** Level 2 read latency histogram (micros): Count: 40614 Average: 2.4711 StdDev: 25.56 Min: 1 Median: 1.3595 Max: 3742 Percentiles: P50: 1.36 P75: 1.80 P99: 5.89 P99.9: 104.78 P99.99: 767.40 ------------------------------------------------------ [ 0, 1 ] 12101 29.795% 29.795% ###### ( 1, 2 ] 22825 56.200% 85.995% ########### ( 2, 3 ] 3156 7.771% 93.766% ## ( 3, 4 ] 1284 3.161% 96.927% # ( 4, 6 ] 889 2.189% 99.116% ( 6, 10 ] 228 0.561% 99.677% ( 10, 15 ] 46 0.113% 99.791% ( 15, 22 ] 11 0.027% 99.818% ( 34, 51 ] 20 0.049% 99.867% ( 51, 76 ] 10 0.025% 99.892% ( 76, 110 ] 4 0.010% 99.902% ( 110, 170 ] 3 0.007% 99.909% ( 170, 250 ] 16 0.039% 99.948% ( 250, 380 ] 11 0.027% 99.975% ( 380, 580 ] 4 0.010% 99.985% ( 580, 870 ] 3 0.007% 99.993% ( 870, 1300 ] 1 0.002% 99.995% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 708765 Average: 5.9188 StdDev: 74.81 Min: 0 Median: 1.8313 Max: 8501 Percentiles: P50: 1.83 P75: 2.74 P99: 9.15 P99.9: 372.09 P99.99: 596.09 ------------------------------------------------------ [ 0, 1 ] 24691 3.484% 3.484% # ( 1, 2 ] 396608 55.958% 59.441% ########### ( 2, 3 ] 148813 20.996% 80.437% #### ( 3, 4 ] 67087 9.465% 89.903% ## ( 4, 6 ] 55025 7.764% 97.666% ## ( 6, 10 ] 12013 1.695% 99.361% ( 10, 15 ] 1823 0.257% 99.618% ( 15, 22 ] 245 0.035% 99.653% ( 22, 34 ] 41 0.006% 99.659% ( 34, 51 ] 23 0.003% 99.662% ( 51, 76 ] 27 0.004% 99.666% ( 76, 110 ] 192 0.027% 99.693% ( 110, 170 ] 520 0.073% 99.766% ( 170, 250 ] 458 0.065% 99.831% ( 250, 380 ] 522 0.074% 99.904% ( 380, 580 ] 578 0.082% 99.986% ( 580, 870 ] 507 0.072% 100.058% ( 870, 1300 ] 253 0.036% 100.093% ( 1300, 1900 ] 131 0.018% 100.112% ( 1900, 2900 ] 107 0.015% 100.127% ( 2900, 4400 ] 123 0.017% 100.144% ( 4400, 6600 ] 15 0.002% 100.146% ( 6600, 9900 ] 6 0.001% 100.147% ** Level 4 read latency histogram (micros): Count: 1118 Average: 168.4383 StdDev: 487.22 Min: 0 Median: 2.7152 Max: 5375 Percentiles: P50: 2.72 P75: 118.46 P99: 2610.91 P99.9: 5370.20 P99.99: 5375.00 ------------------------------------------------------ [ 0, 1 ] 107 9.571% 9.571% ## ( 1, 2 ] 334 29.875% 39.445% ###### ( 2, 3 ] 165 14.758% 54.204% ### ( 3, 4 ] 65 5.814% 60.018% # ( 4, 6 ] 67 5.993% 66.011% # ( 6, 10 ] 40 3.578% 69.589% # ( 10, 15 ] 7 0.626% 70.215% ( 15, 22 ] 4 0.358% 70.572% ( 22, 34 ] 16 1.431% 72.004% ( 51, 76 ] 9 0.805% 72.809% ( 76, 110 ] 19 1.699% 74.508% ( 110, 170 ] 39 3.488% 77.996% # ( 170, 250 ] 70 6.261% 84.258% # ( 250, 380 ] 45 4.025% 88.283% # ( 380, 580 ] 39 3.488% 91.771% # ( 580, 870 ] 37 3.309% 95.081% # ( 870, 1300 ] 20 1.789% 96.869% ( 1300, 1900 ] 16 1.431% 98.301% ( 1900, 2900 ] 11 0.984% 99.284% ( 2900, 4400 ] 6 0.537% 99.821% ( 4400, 6600 ] 2 0.179% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 1146.8278 StdDev: 1411.99 Min: 84 Median: 513.3333 Max: 8377 Percentiles: P50: 513.33 P75: 1660.00 P99: 6930.00 P99.9: 8377.00 P99.99: 8377.00 ------------------------------------------------------ ( 76, 110 ] 13 7.222% 7.222% # ( 110, 170 ] 29 16.111% 23.333% ### ( 170, 250 ] 21 11.667% 35.000% ## ( 250, 380 ] 17 9.444% 44.444% ## ( 380, 580 ] 15 8.333% 52.778% ## ( 580, 870 ] 18 10.000% 62.778% ## ( 870, 1300 ] 13 7.222% 70.000% # ( 1300, 1900 ] 15 8.333% 78.333% ## ( 1900, 2900 ] 17 9.444% 87.778% ## ( 2900, 4400 ] 16 8.889% 96.667% ## ( 4400, 6600 ] 4 2.222% 98.889% ( 6600, 9900 ] 2 1.111% 100.000% ** DB Stats ** Uptime(secs): 47.7 total, 6.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 185.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:22.783 H:M:S, 47.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 159.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.300 H:M:S, 53.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.105 micros/op 163786 ops/sec 60.023 seconds 9830999 operations; 158.7 MB/s Microseconds per write: Count: 9830999 Average: 6.1055 StdDev: 314.83 Min: 1 Median: 1.7575 Max: 542474 Percentiles: P50: 1.76 P75: 2.79 P99: 9.74 P99.9: 1170.30 P99.99: 2662.15 ------------------------------------------------------ [ 0, 1 ] 1187832 12.083% 12.083% ## ( 1, 2 ] 4921046 50.056% 62.139% ########## ( 2, 3 ] 1606338 16.340% 78.478% ### ( 3, 4 ] 1358935 13.823% 92.301% ### ( 4, 6 ] 537146 5.464% 97.765% # ( 6, 10 ] 129920 1.322% 99.087% ( 10, 15 ] 44334 0.451% 99.538% ( 15, 22 ] 10049 0.102% 99.640% ( 22, 34 ] 1833 0.019% 99.659% ( 34, 51 ] 220 0.002% 99.661% ( 51, 76 ] 23 0.000% 99.661% ( 76, 110 ] 6783 0.069% 99.730% ( 110, 170 ] 2676 0.027% 99.757% ( 170, 250 ] 306 0.003% 99.760% ( 250, 380 ] 189 0.002% 99.762% ( 380, 580 ] 22 0.000% 99.763% ( 580, 870 ] 13 0.000% 99.763% ( 870, 1300 ] 19335 0.197% 99.959% ( 1300, 1900 ] 42 0.000% 99.960% ( 1900, 2900 ] 3902 0.040% 99.999% ( 2900, 4400 ] 23 0.000% 100.000% ( 4400, 6600 ] 8 0.000% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 203899 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9830999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10145590968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 484 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 32622214 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31390049611 rocksdb.compact.write.bytes COUNT : 31199232400 rocksdb.flush.write.bytes COUNT : 10106813007 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 47 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 218 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10025281536 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3859456 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 31477179382 rocksdb.non.last.level.read.count COUNT : 7608623 rocksdb.block.checksum.compute.count COUNT : 7607702 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.396771 P95 : 3.946553 P99 : 8.403103 P100 : 542472.000000 COUNT : 9830999 SUM : 55217315 rocksdb.compaction.times.micros P50 : 1035000.000000 P95 : 4685000.000000 P99 : 14565909.000000 P100 : 14565909.000000 COUNT : 73 SUM : 115322772 rocksdb.compaction.times.cpu_micros P50 : 965000.000000 P95 : 4685000.000000 P99 : 12467000.000000 P100 : 13504919.000000 COUNT : 73 SUM : 104411715 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 682.848837 P95 : 1247.785714 P99 : 43710.000000 P100 : 77696.000000 COUNT : 137 SUM : 246825 rocksdb.compaction.outfile.sync.micros P50 : 901.084337 P95 : 31625.000000 P99 : 55833.333333 P100 : 76645.000000 COUNT : 330 SUM : 1633924 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 95.500000 P95 : 556.000000 P99 : 2740.000000 P100 : 3510.000000 COUNT : 232 SUM : 45244 rocksdb.table.open.io.micros P50 : 1154.805195 P95 : 7145.217391 P99 : 10228.000000 P100 : 19493.000000 COUNT : 484 SUM : 902064 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.593637 P95 : 6.869475 P99 : 9.926436 P100 : 13077.000000 COUNT : 7606256 SUM : 39728322 rocksdb.read.block.get.micros P50 : 369.843750 P95 : 3000.000000 P99 : 4910.400000 P100 : 11705.000000 COUNT : 968 SUM : 720881 rocksdb.write.raw.block.micros P50 : 0.511779 P95 : 0.972381 P99 : 2.800316 P100 : 14067.000000 COUNT : 10003869 SUM : 18405455 rocksdb.numfiles.in.singlecompaction P50 : 3.354167 P95 : 6.900000 P99 : 21.743333 P100 : 23.000000 COUNT : 111 SUM : 462 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559988 P95 : 1145.071798 P99 : 2350.829055 P100 : 542254.000000 COUNT : 218757 SUM : 32643136 rocksdb.sst.read.micros P50 : 1.558329 P95 : 3.961185 P99 : 7.895245 P100 : 11080.000000 COUNT : 7608744 SUM : 24287216 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9830999 SUM : 10145590968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210425.531915 P95 : 353657.894737 P99 : 534850.000000 P100 : 694762.000000 COUNT : 137 SUM : 28541140 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 319 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0