[2024-11-28 19:03:28.483687] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-11-28 19:03:28.483836] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3504296 ] Set seed to 1732817008480214 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-28 19:03:28.592732] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-28 19:03:28.813586] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-28 19:03:28.813636] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3504296' to capture a snapshot of events at runtime. [2024-11-28 19:03:28.813647] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3504296 for offline analysis/debug. [2024-11-28 19:03:28.813671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Nov 28 19:03:37 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/28-19:03:40 ... thread 0: (1000000,1000000) ops and (362539.4,362539.4) ops/second in (2.758321,2.758321) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 504.03 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 356.0 2.30 2.06 12 0.192 0 0 0.0 0.0 L1 3/3 251.75 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 256.0 255.8 0.98 0.96 1 0.984 255K 190 0.0 0.0 L2 1/0 48.89 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 238.0 237.9 0.47 0.44 1 0.468 113K 38 0.0 0.0 L3 19/1 1007.26 MB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 199.6 199.6 0.31 0.25 1 0.312 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 85.63 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1187/9 96.94 GB 0.0 0.4 0.3 0.1 1.2 1.1 0.1 1.5 104.7 306.2 4.06 3.70 15 0.271 432K 228 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.2 1.1 0.1 1.5 104.7 306.2 4.06 3.70 15 0.271 432K 228 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 241.3 241.1 1.76 1.65 3 0.588 432K 228 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 356.0 2.30 2.06 12 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.22 GB write, 417.23 MB/s write, 0.42 GB read, 142.70 MB/s read, 4.1 seconds Interval compaction: 1.22 GB write, 450.74 MB/s write, 0.42 GB read, 154.17 MB/s read, 4.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 97226 Average: 1.9356 StdDev: 22.75 Min: 1 Median: 1.2447 Max: 4269 Percentiles: P50: 1.24 P75: 1.65 P99: 3.70 P99.9: 9.19 P99.99: 348.69 ------------------------------------------------------ [ 0, 1 ] 34077 35.049% 35.049% ####### ( 1, 2 ] 59395 61.090% 96.139% ############ ( 2, 3 ] 2062 2.121% 98.260% ( 3, 4 ] 1027 1.056% 99.316% ( 4, 6 ] 399 0.410% 99.726% ( 6, 10 ] 213 0.219% 99.945% ( 10, 15 ] 18 0.019% 99.964% ( 15, 22 ] 6 0.006% 99.970% ( 22, 34 ] 5 0.005% 99.975% ( 51, 76 ] 2 0.002% 99.977% ( 110, 170 ] 10 0.010% 99.988% ( 170, 250 ] 1 0.001% 99.989% ( 250, 380 ] 3 0.003% 99.992% ( 380, 580 ] 2 0.002% 99.994% ( 580, 870 ] 2 0.002% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ( 2900, 4400 ] 2 0.002% 100.002% ** Level 1 read latency histogram (micros): Count: 13814 Average: 1.9731 StdDev: 13.67 Min: 0 Median: 1.2872 Max: 1217 Percentiles: P50: 1.29 P75: 1.68 P99: 3.79 P99.9: 9.62 P99.99: 1003.00 ------------------------------------------------------ [ 0, 1 ] 4411 31.931% 31.931% ###### ( 1, 2 ] 8692 62.922% 94.853% ############# ( 2, 3 ] 433 3.135% 97.988% # ( 3, 4 ] 178 1.289% 99.276% ( 4, 6 ] 69 0.499% 99.776% ( 6, 10 ] 19 0.138% 99.913% ( 10, 15 ] 7 0.051% 99.964% ( 22, 34 ] 1 0.007% 99.971% ( 250, 380 ] 2 0.014% 99.986% ( 870, 1300 ] 2 0.014% 100.000% ** Level 2 read latency histogram (micros): Count: 28106 Average: 2.6843 StdDev: 40.76 Min: 0 Median: 1.2420 Max: 5427 Percentiles: P50: 1.24 P75: 1.67 P99: 6.80 P99.9: 238.77 P99.99: 1994.70 ------------------------------------------------------ [ 0, 1 ] 10035 35.704% 35.704% ####### ( 1, 2 ] 16600 59.062% 94.766% ############ ( 2, 3 ] 819 2.914% 97.680% # ( 3, 4 ] 221 0.786% 98.467% ( 4, 6 ] 114 0.406% 98.872% ( 6, 10 ] 180 0.640% 99.513% ( 10, 15 ] 54 0.192% 99.705% ( 15, 22 ] 4 0.014% 99.719% ( 22, 34 ] 1 0.004% 99.722% ( 34, 51 ] 2 0.007% 99.730% ( 51, 76 ] 26 0.093% 99.822% ( 76, 110 ] 7 0.025% 99.847% ( 110, 170 ] 2 0.007% 99.854% ( 170, 250 ] 15 0.053% 99.907% ( 250, 380 ] 15 0.053% 99.961% ( 380, 580 ] 5 0.018% 99.979% ( 870, 1300 ] 2 0.007% 99.986% ( 1300, 1900 ] 1 0.004% 99.989% ( 1900, 2900 ] 2 0.007% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 1717 Average: 109.2650 StdDev: 735.66 Min: 1 Median: 3.0083 Max: 9095 Percentiles: P50: 3.01 P75: 4.12 P99: 4709.69 P99.9: 8955.65 P99.99: 9095.00 ------------------------------------------------------ [ 0, 1 ] 17 0.990% 0.990% ( 1, 2 ] 138 8.037% 9.027% ## ( 2, 3 ] 700 40.769% 49.796% ######## ( 3, 4 ] 420 24.461% 74.257% ##### ( 4, 6 ] 213 12.405% 86.663% ## ( 6, 10 ] 133 7.746% 94.409% ## ( 10, 15 ] 30 1.747% 96.156% ( 15, 22 ] 8 0.466% 96.622% ( 22, 34 ] 1 0.058% 96.680% ( 170, 250 ] 1 0.058% 96.738% ( 250, 380 ] 4 0.233% 96.971% ( 380, 580 ] 5 0.291% 97.263% ( 580, 870 ] 7 0.408% 97.670% ( 870, 1300 ] 5 0.291% 97.962% ( 1300, 1900 ] 3 0.175% 98.136% ( 1900, 2900 ] 5 0.291% 98.427% ( 2900, 4400 ] 8 0.466% 98.893% ( 4400, 6600 ] 13 0.757% 99.651% ( 6600, 9900 ] 6 0.349% 100.000% ** Level 4 read latency histogram (micros): Count: 20 Average: 3299.8000 StdDev: 2478.18 Min: 317 Median: 2900.0000 Max: 7535 Percentiles: P50: 2900.00 P75: 5866.67 P99: 7535.00 P99.9: 7535.00 P99.99: 7535.00 ------------------------------------------------------ ( 250, 380 ] 1 5.000% 5.000% # ( 380, 580 ] 2 10.000% 15.000% ## ( 580, 870 ] 3 15.000% 30.000% ### ( 870, 1300 ] 1 5.000% 35.000% # ( 1300, 1900 ] 1 5.000% 40.000% # ( 1900, 2900 ] 2 10.000% 50.000% ## ( 2900, 4400 ] 3 15.000% 65.000% ### ( 4400, 6600 ] 3 15.000% 80.000% ### ( 6600, 9900 ] 4 20.000% 100.000% #### ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 329.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.167 H:M:S, 5.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 356.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.167 H:M:S, 6.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-19:03:43 ... thread 0: (1000000,2000000) ops and (324092.7,342239.7) ops/second in (3.085537,5.843858) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/6 1.17 GB 12.6 0.8 0.0 0.8 2.6 1.8 0.0 1.4 100.3 323.8 8.17 7.55 29 0.282 831K 902 0.0 0.0 L1 2/2 50.42 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 239.8 239.4 3.41 3.32 2 1.707 831K 1393 0.0 0.0 L2 1/0 48.89 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.5 1.8 238.0 237.9 0.47 0.44 1 0.468 113K 38 0.0 0.0 L3 15/0 773.32 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.4 1.0 227.0 227.0 0.85 0.77 2 0.425 196K 10 0.0 0.0 L4 173/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.7 1.0 62.0 62.1 0.90 0.57 1 0.904 56K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1247/8 97.92 GB 0.0 2.0 0.8 1.2 3.7 2.6 2.4 2.1 144.8 276.9 13.80 12.64 35 0.394 2028K 2343 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.8 1.2 3.7 2.6 2.4 2.1 144.8 276.9 13.80 12.64 35 0.394 2028K 2343 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.8 1.2 1.9 0.8 0.0 0.0 229.3 229.0 8.71 8.11 9 0.968 2028K 2343 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 358.9 5.09 4.53 26 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.73 GB write, 629.97 MB/s write, 1.95 GB read, 329.30 MB/s read, 13.8 seconds Interval compaction: 3.73 GB write, 653.87 MB/s write, 1.95 GB read, 341.79 MB/s read, 13.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 389073 Average: 2.1653 StdDev: 14.80 Min: 1 Median: 1.4569 Max: 4269 Percentiles: P50: 1.46 P75: 1.84 P99: 5.58 P99.9: 9.81 P99.99: 14.82 ------------------------------------------------------ [ 0, 1 ] 77774 19.990% 19.990% #### ( 1, 2 ] 255562 65.685% 85.674% ############# ( 2, 3 ] 33448 8.597% 94.271% ## ( 3, 4 ] 11605 2.983% 97.254% # ( 4, 6 ] 8577 2.204% 99.458% ( 6, 10 ] 1806 0.464% 99.923% ( 10, 15 ] 273 0.070% 99.993% ( 15, 22 ] 35 0.009% 100.002% ( 22, 34 ] 12 0.003% 100.005% ( 34, 51 ] 3 0.001% 100.006% ( 51, 76 ] 6 0.002% 100.007% ( 110, 170 ] 14 0.004% 100.011% ( 170, 250 ] 8 0.002% 100.013% ( 250, 380 ] 8 0.002% 100.015% ( 380, 580 ] 6 0.002% 100.016% ( 580, 870 ] 8 0.002% 100.019% ( 870, 1300 ] 6 0.002% 100.020% ( 1300, 1900 ] 2 0.001% 100.021% ( 1900, 2900 ] 2 0.001% 100.021% ( 2900, 4400 ] 4 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 96651 Average: 2.2245 StdDev: 9.26 Min: 0 Median: 1.5089 Max: 1288 Percentiles: P50: 1.51 P75: 1.88 P99: 5.60 P99.9: 9.63 P99.99: 396.74 ------------------------------------------------------ [ 0, 1 ] 14943 15.461% 15.461% ### ( 1, 2 ] 65591 67.864% 83.325% ############## ( 2, 3 ] 10041 10.389% 93.713% ## ( 3, 4 ] 3103 3.211% 96.924% # ( 4, 6 ] 2508 2.595% 99.519% # ( 6, 10 ] 406 0.420% 99.939% ( 10, 15 ] 37 0.038% 99.977% ( 15, 22 ] 6 0.006% 99.983% ( 22, 34 ] 1 0.001% 99.984% ( 34, 51 ] 1 0.001% 99.986% ( 110, 170 ] 1 0.001% 99.987% ( 250, 380 ] 3 0.003% 99.990% ( 380, 580 ] 4 0.004% 99.994% ( 870, 1300 ] 6 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 28106 Average: 2.6843 StdDev: 40.76 Min: 0 Median: 1.2420 Max: 5427 Percentiles: P50: 1.24 P75: 1.67 P99: 6.80 P99.9: 238.77 P99.99: 1994.70 ------------------------------------------------------ [ 0, 1 ] 10035 35.704% 35.704% ####### ( 1, 2 ] 16600 59.062% 94.766% ############ ( 2, 3 ] 819 2.914% 97.680% # ( 3, 4 ] 221 0.786% 98.467% ( 4, 6 ] 114 0.406% 98.872% ( 6, 10 ] 180 0.640% 99.513% ( 10, 15 ] 54 0.192% 99.705% ( 15, 22 ] 4 0.014% 99.719% ( 22, 34 ] 1 0.004% 99.722% ( 34, 51 ] 2 0.007% 99.730% ( 51, 76 ] 26 0.093% 99.822% ( 76, 110 ] 7 0.025% 99.847% ( 110, 170 ] 2 0.007% 99.854% ( 170, 250 ] 15 0.053% 99.907% ( 250, 380 ] 15 0.053% 99.961% ( 380, 580 ] 5 0.018% 99.979% ( 870, 1300 ] 2 0.007% 99.986% ( 1300, 1900 ] 1 0.004% 99.989% ( 1900, 2900 ] 2 0.007% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 14852 Average: 15.9738 StdDev: 252.47 Min: 1 Median: 2.8085 Max: 9095 Percentiles: P50: 2.81 P75: 3.76 P99: 13.13 P99.9: 5101.97 P99.99: 9083.14 ------------------------------------------------------ [ 0, 1 ] 166 1.118% 1.118% ( 1, 2 ] 2408 16.213% 17.331% ### ( 2, 3 ] 6001 40.405% 57.736% ######## ( 3, 4 ] 3373 22.711% 80.447% ##### ( 4, 6 ] 1861 12.530% 92.977% ### ( 6, 10 ] 803 5.407% 98.384% # ( 10, 15 ] 146 0.983% 99.367% ( 15, 22 ] 31 0.209% 99.576% ( 22, 34 ] 2 0.013% 99.589% ( 110, 170 ] 1 0.007% 99.596% ( 170, 250 ] 2 0.013% 99.609% ( 250, 380 ] 4 0.027% 99.636% ( 380, 580 ] 7 0.047% 99.684% ( 580, 870 ] 7 0.047% 99.731% ( 870, 1300 ] 5 0.034% 99.764% ( 1300, 1900 ] 3 0.020% 99.785% ( 1900, 2900 ] 5 0.034% 99.818% ( 2900, 4400 ] 8 0.054% 99.872% ( 4400, 6600 ] 13 0.088% 99.960% ( 6600, 9900 ] 6 0.040% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 221.8656 StdDev: 1033.49 Min: 0 Median: 1.5930 Max: 7535 Percentiles: P50: 1.59 P75: 2.49 P99: 7383.75 P99.9: 7535.00 P99.99: 7535.00 ------------------------------------------------------ [ 0, 1 ] 76 24.918% 24.918% ##### ( 1, 2 ] 129 42.295% 67.213% ######## ( 2, 3 ] 48 15.738% 82.951% ### ( 3, 4 ] 16 5.246% 88.197% # ( 4, 6 ] 5 1.639% 89.836% ( 6, 10 ] 2 0.656% 90.492% ( 10, 15 ] 1 0.328% 90.820% ( 34, 51 ] 2 0.656% 91.475% ( 51, 76 ] 1 0.328% 91.803% ( 110, 170 ] 2 0.656% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 250, 380 ] 1 0.328% 93.770% ( 380, 580 ] 2 0.656% 94.426% ( 580, 870 ] 3 0.984% 95.410% ( 870, 1300 ] 1 0.328% 95.738% ( 1300, 1900 ] 1 0.328% 96.066% ( 1900, 2900 ] 2 0.656% 96.721% ( 2900, 4400 ] 3 0.984% 97.705% ( 4400, 6600 ] 3 0.984% 98.689% ( 6600, 9900 ] 4 1.311% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 950.0000 StdDev: 1201.71 Min: 110 Median: 420.0000 Max: 4813 Percentiles: P50: 420.00 P75: 1300.00 P99: 4813.00 P99.9: 4813.00 P99.99: 4813.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 11 27.500% 30.000% ###### ( 170, 250 ] 4 10.000% 40.000% ## ( 250, 380 ] 3 7.500% 47.500% ## ( 380, 580 ] 5 12.500% 60.000% ### ( 580, 870 ] 5 12.500% 72.500% ### ( 870, 1300 ] 1 2.500% 75.000% # ( 1300, 1900 ] 3 7.500% 82.500% ## ( 1900, 2900 ] 4 10.000% 92.500% ## ( 2900, 4400 ] 1 2.500% 95.000% # ( 4400, 6600 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 324.38 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.580 H:M:S, 9.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 318.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.413 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-19:03:46 ... thread 0: (1000000,3000000) ops and (344637.1,343035.1) ops/second in (2.901603,8.745461) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/14 2.09 GB 56.6 1.4 0.0 1.4 4.1 2.7 0.0 1.5 107.0 321.0 12.95 12.00 45 0.288 1407K 1508 0.0 0.0 L1 2/2 50.42 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 239.8 239.4 3.41 3.32 2 1.707 831K 1393 0.0 0.0 L2 1/0 48.89 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.5 1.8 238.0 237.9 0.47 0.44 1 0.468 113K 38 0.0 0.0 L3 15/0 773.32 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.4 1.0 227.0 227.0 0.85 0.77 2 0.425 196K 10 0.0 0.0 L4 173/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.7 1.0 62.0 62.1 0.90 0.57 1 0.904 56K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/16 98.84 GB 0.0 2.5 0.8 1.7 5.2 3.5 2.4 1.9 138.0 287.0 18.58 17.10 51 0.364 2604K 2949 0.0 0.0 Int 0/0 0.00 KB 0.0 2.5 0.8 1.7 5.2 3.5 2.4 1.9 138.0 287.0 18.58 17.10 51 0.364 2604K 2949 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.5 0.8 1.7 2.5 0.8 0.0 0.0 236.8 236.6 10.83 10.19 11 0.985 2604K 2949 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 357.5 7.75 6.91 40 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.7 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.21 GB write, 594.67 MB/s write, 2.51 GB read, 285.98 MB/s read, 18.6 seconds Interval compaction: 5.21 GB write, 609.75 MB/s write, 2.51 GB read, 293.23 MB/s read, 18.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 778986 Average: 2.1867 StdDev: 11.55 Min: 1 Median: 1.4976 Max: 4269 Percentiles: P50: 1.50 P75: 1.87 P99: 5.55 P99.9: 9.57 P99.99: 13.43 ------------------------------------------------------ [ 0, 1 ] 128138 16.449% 16.449% ### ( 1, 2 ] 525207 67.422% 83.871% ############# ( 2, 3 ] 78131 10.030% 93.901% ## ( 3, 4 ] 25486 3.272% 97.173% # ( 4, 6 ] 18329 2.353% 99.526% ( 6, 10 ] 3266 0.419% 99.945% ( 10, 15 ] 514 0.066% 100.011% ( 15, 22 ] 55 0.007% 100.018% ( 22, 34 ] 21 0.003% 100.021% ( 34, 51 ] 8 0.001% 100.022% ( 51, 76 ] 10 0.001% 100.023% ( 110, 170 ] 18 0.002% 100.025% ( 170, 250 ] 17 0.002% 100.027% ( 250, 380 ] 12 0.002% 100.029% ( 380, 580 ] 10 0.001% 100.030% ( 580, 870 ] 12 0.002% 100.032% ( 870, 1300 ] 12 0.002% 100.033% ( 1300, 1900 ] 2 0.000% 100.034% ( 1900, 2900 ] 2 0.000% 100.034% ( 2900, 4400 ] 5 0.001% 100.035% ** Level 1 read latency histogram (micros): Count: 96651 Average: 2.2245 StdDev: 9.26 Min: 0 Median: 1.5089 Max: 1288 Percentiles: P50: 1.51 P75: 1.88 P99: 5.60 P99.9: 9.63 P99.99: 396.74 ------------------------------------------------------ [ 0, 1 ] 14943 15.461% 15.461% ### ( 1, 2 ] 65591 67.864% 83.325% ############## ( 2, 3 ] 10041 10.389% 93.713% ## ( 3, 4 ] 3103 3.211% 96.924% # ( 4, 6 ] 2508 2.595% 99.519% # ( 6, 10 ] 406 0.420% 99.939% ( 10, 15 ] 37 0.038% 99.977% ( 15, 22 ] 6 0.006% 99.983% ( 22, 34 ] 1 0.001% 99.984% ( 34, 51 ] 1 0.001% 99.986% ( 110, 170 ] 1 0.001% 99.987% ( 250, 380 ] 3 0.003% 99.990% ( 380, 580 ] 4 0.004% 99.994% ( 870, 1300 ] 6 0.006% 100.000% ** Level 2 read latency histogram (micros): Count: 28106 Average: 2.6843 StdDev: 40.76 Min: 0 Median: 1.2420 Max: 5427 Percentiles: P50: 1.24 P75: 1.67 P99: 6.80 P99.9: 238.77 P99.99: 1994.70 ------------------------------------------------------ [ 0, 1 ] 10035 35.704% 35.704% ####### ( 1, 2 ] 16600 59.062% 94.766% ############ ( 2, 3 ] 819 2.914% 97.680% # ( 3, 4 ] 221 0.786% 98.467% ( 4, 6 ] 114 0.406% 98.872% ( 6, 10 ] 180 0.640% 99.513% ( 10, 15 ] 54 0.192% 99.705% ( 15, 22 ] 4 0.014% 99.719% ( 22, 34 ] 1 0.004% 99.722% ( 34, 51 ] 2 0.007% 99.730% ( 51, 76 ] 26 0.093% 99.822% ( 76, 110 ] 7 0.025% 99.847% ( 110, 170 ] 2 0.007% 99.854% ( 170, 250 ] 15 0.053% 99.907% ( 250, 380 ] 15 0.053% 99.961% ( 380, 580 ] 5 0.018% 99.979% ( 870, 1300 ] 2 0.007% 99.986% ( 1300, 1900 ] 1 0.004% 99.989% ( 1900, 2900 ] 2 0.007% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 14852 Average: 15.9738 StdDev: 252.47 Min: 1 Median: 2.8085 Max: 9095 Percentiles: P50: 2.81 P75: 3.76 P99: 13.13 P99.9: 5101.97 P99.99: 9083.14 ------------------------------------------------------ [ 0, 1 ] 166 1.118% 1.118% ( 1, 2 ] 2408 16.213% 17.331% ### ( 2, 3 ] 6001 40.405% 57.736% ######## ( 3, 4 ] 3373 22.711% 80.447% ##### ( 4, 6 ] 1861 12.530% 92.977% ### ( 6, 10 ] 803 5.407% 98.384% # ( 10, 15 ] 146 0.983% 99.367% ( 15, 22 ] 31 0.209% 99.576% ( 22, 34 ] 2 0.013% 99.589% ( 110, 170 ] 1 0.007% 99.596% ( 170, 250 ] 2 0.013% 99.609% ( 250, 380 ] 4 0.027% 99.636% ( 380, 580 ] 7 0.047% 99.684% ( 580, 870 ] 7 0.047% 99.731% ( 870, 1300 ] 5 0.034% 99.764% ( 1300, 1900 ] 3 0.020% 99.785% ( 1900, 2900 ] 5 0.034% 99.818% ( 2900, 4400 ] 8 0.054% 99.872% ( 4400, 6600 ] 13 0.088% 99.960% ( 6600, 9900 ] 6 0.040% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 221.8656 StdDev: 1033.49 Min: 0 Median: 1.5930 Max: 7535 Percentiles: P50: 1.59 P75: 2.49 P99: 7383.75 P99.9: 7535.00 P99.99: 7535.00 ------------------------------------------------------ [ 0, 1 ] 76 24.918% 24.918% ##### ( 1, 2 ] 129 42.295% 67.213% ######## ( 2, 3 ] 48 15.738% 82.951% ### ( 3, 4 ] 16 5.246% 88.197% # ( 4, 6 ] 5 1.639% 89.836% ( 6, 10 ] 2 0.656% 90.492% ( 10, 15 ] 1 0.328% 90.820% ( 34, 51 ] 2 0.656% 91.475% ( 51, 76 ] 1 0.328% 91.803% ( 110, 170 ] 2 0.656% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 250, 380 ] 1 0.328% 93.770% ( 380, 580 ] 2 0.656% 94.426% ( 580, 870 ] 3 0.984% 95.410% ( 870, 1300 ] 1 0.328% 95.738% ( 1300, 1900 ] 1 0.328% 96.066% ( 1900, 2900 ] 2 0.656% 96.721% ( 2900, 4400 ] 3 0.984% 97.705% ( 4400, 6600 ] 3 0.984% 98.689% ( 6600, 9900 ] 4 1.311% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 950.0000 StdDev: 1201.71 Min: 110 Median: 420.0000 Max: 4813 Percentiles: P50: 420.00 P75: 1300.00 P99: 4813.00 P99.9: 4813.00 P99.99: 4813.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 11 27.500% 30.000% ###### ( 170, 250 ] 4 10.000% 40.000% ## ( 250, 380 ] 3 7.500% 47.500% ## ( 380, 580 ] 5 12.500% 60.000% ### ( 580, 870 ] 5 12.500% 72.500% ### ( 870, 1300 ] 1 2.500% 75.000% # ( 1300, 1900 ] 3 7.500% 82.500% ## ( 1900, 2900 ] 4 10.000% 92.500% ## ( 2900, 4400 ] 1 2.500% 95.000% # ( 4400, 6600 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 329.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.808 H:M:S, 9.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 339.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.229 H:M:S, 7.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/28-19:03:49 ... thread 0: (1000000,4000000) ops and (329335.5,339504.4) ops/second in (3.036417,11.781878) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/8 2.03 GB 151.1 2.1 0.0 2.1 5.8 3.7 0.0 1.6 115.1 318.1 18.61 17.30 62 0.300 2174K 2198 0.0 0.0 L1 10/0 1.09 GB 111.5 1.9 1.5 0.4 1.9 1.5 0.1 1.2 238.8 237.9 8.12 7.90 3 2.707 1968K 6675 0.0 0.0 L2 1/0 48.89 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.5 1.8 238.0 237.9 0.47 0.44 1 0.468 113K 38 0.0 0.0 L3 15/0 773.32 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.4 1.0 227.0 227.0 0.85 0.77 2 0.425 196K 10 0.0 0.0 L4 173/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.7 1.0 62.0 62.1 0.90 0.57 1 0.904 56K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/8 99.82 GB 0.0 4.3 1.8 2.5 8.0 5.5 2.4 2.2 153.4 283.6 28.96 26.98 69 0.420 4509K 8921 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 1.8 2.5 8.0 5.5 2.4 2.2 153.4 283.6 28.96 26.98 69 0.420 4509K 8921 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 1.8 2.5 4.3 1.8 0.0 0.0 241.4 240.9 18.40 17.58 15 1.227 4509K 8921 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 358.1 10.56 9.40 54 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.8 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.02 GB write, 684.00 MB/s write, 4.34 GB read, 369.94 MB/s read, 29.0 seconds Interval compaction: 8.02 GB write, 696.87 MB/s write, 4.34 GB read, 376.90 MB/s read, 29.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1067209 Average: 2.1538 StdDev: 10.59 Min: 1 Median: 1.4832 Max: 4269 Percentiles: P50: 1.48 P75: 1.85 P99: 5.47 P99.9: 9.58 P99.99: 13.79 ------------------------------------------------------ [ 0, 1 ] 184738 17.310% 17.310% ### ( 1, 2 ] 722031 67.656% 84.966% ############## ( 2, 3 ] 100788 9.444% 94.410% ## ( 3, 4 ] 32398 3.036% 97.446% # ( 4, 6 ] 22532 2.111% 99.558% ( 6, 10 ] 4088 0.383% 99.941% ( 10, 15 ] 698 0.065% 100.006% ( 15, 22 ] 80 0.007% 100.013% ( 22, 34 ] 28 0.003% 100.016% ( 34, 51 ] 13 0.001% 100.017% ( 51, 76 ] 11 0.001% 100.018% ( 110, 170 ] 24 0.002% 100.021% ( 170, 250 ] 22 0.002% 100.023% ( 250, 380 ] 17 0.002% 100.024% ( 380, 580 ] 15 0.001% 100.026% ( 580, 870 ] 19 0.002% 100.027% ( 870, 1300 ] 16 0.001% 100.029% ( 1300, 1900 ] 4 0.000% 100.029% ( 1900, 2900 ] 2 0.000% 100.030% ( 2900, 4400 ] 5 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 109501 Average: 2.3494 StdDev: 17.04 Min: 0 Median: 1.5005 Max: 2198 Percentiles: P50: 1.50 P75: 1.87 P99: 5.57 P99.9: 9.76 P99.99: 1033.93 ------------------------------------------------------ [ 0, 1 ] 17552 16.029% 16.029% ### ( 1, 2 ] 74328 67.879% 83.908% ############## ( 2, 3 ] 11015 10.059% 93.967% ## ( 3, 4 ] 3403 3.108% 97.075% # ( 4, 6 ] 2685 2.452% 99.527% ( 6, 10 ] 435 0.397% 99.924% ( 10, 15 ] 42 0.038% 99.963% ( 15, 22 ] 6 0.005% 99.968% ( 22, 34 ] 2 0.002% 99.970% ( 34, 51 ] 1 0.001% 99.971% ( 110, 170 ] 1 0.001% 99.972% ( 250, 380 ] 9 0.008% 99.980% ( 380, 580 ] 8 0.007% 99.987% ( 870, 1300 ] 8 0.007% 99.995% ( 1300, 1900 ] 4 0.004% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 28106 Average: 2.6843 StdDev: 40.76 Min: 0 Median: 1.2420 Max: 5427 Percentiles: P50: 1.24 P75: 1.67 P99: 6.80 P99.9: 238.77 P99.99: 1994.70 ------------------------------------------------------ [ 0, 1 ] 10035 35.704% 35.704% ####### ( 1, 2 ] 16600 59.062% 94.766% ############ ( 2, 3 ] 819 2.914% 97.680% # ( 3, 4 ] 221 0.786% 98.467% ( 4, 6 ] 114 0.406% 98.872% ( 6, 10 ] 180 0.640% 99.513% ( 10, 15 ] 54 0.192% 99.705% ( 15, 22 ] 4 0.014% 99.719% ( 22, 34 ] 1 0.004% 99.722% ( 34, 51 ] 2 0.007% 99.730% ( 51, 76 ] 26 0.093% 99.822% ( 76, 110 ] 7 0.025% 99.847% ( 110, 170 ] 2 0.007% 99.854% ( 170, 250 ] 15 0.053% 99.907% ( 250, 380 ] 15 0.053% 99.961% ( 380, 580 ] 5 0.018% 99.979% ( 870, 1300 ] 2 0.007% 99.986% ( 1300, 1900 ] 1 0.004% 99.989% ( 1900, 2900 ] 2 0.007% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 14852 Average: 15.9738 StdDev: 252.47 Min: 1 Median: 2.8085 Max: 9095 Percentiles: P50: 2.81 P75: 3.76 P99: 13.13 P99.9: 5101.97 P99.99: 9083.14 ------------------------------------------------------ [ 0, 1 ] 166 1.118% 1.118% ( 1, 2 ] 2408 16.213% 17.331% ### ( 2, 3 ] 6001 40.405% 57.736% ######## ( 3, 4 ] 3373 22.711% 80.447% ##### ( 4, 6 ] 1861 12.530% 92.977% ### ( 6, 10 ] 803 5.407% 98.384% # ( 10, 15 ] 146 0.983% 99.367% ( 15, 22 ] 31 0.209% 99.576% ( 22, 34 ] 2 0.013% 99.589% ( 110, 170 ] 1 0.007% 99.596% ( 170, 250 ] 2 0.013% 99.609% ( 250, 380 ] 4 0.027% 99.636% ( 380, 580 ] 7 0.047% 99.684% ( 580, 870 ] 7 0.047% 99.731% ( 870, 1300 ] 5 0.034% 99.764% ( 1300, 1900 ] 3 0.020% 99.785% ( 1900, 2900 ] 5 0.034% 99.818% ( 2900, 4400 ] 8 0.054% 99.872% ( 4400, 6600 ] 13 0.088% 99.960% ( 6600, 9900 ] 6 0.040% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 221.8656 StdDev: 1033.49 Min: 0 Median: 1.5930 Max: 7535 Percentiles: P50: 1.59 P75: 2.49 P99: 7383.75 P99.9: 7535.00 P99.99: 7535.00 ------------------------------------------------------ [ 0, 1 ] 76 24.918% 24.918% ##### ( 1, 2 ] 129 42.295% 67.213% ######## ( 2, 3 ] 48 15.738% 82.951% ### ( 3, 4 ] 16 5.246% 88.197% # ( 4, 6 ] 5 1.639% 89.836% ( 6, 10 ] 2 0.656% 90.492% ( 10, 15 ] 1 0.328% 90.820% ( 34, 51 ] 2 0.656% 91.475% ( 51, 76 ] 1 0.328% 91.803% ( 110, 170 ] 2 0.656% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 250, 380 ] 1 0.328% 93.770% ( 380, 580 ] 2 0.656% 94.426% ( 580, 870 ] 3 0.984% 95.410% ( 870, 1300 ] 1 0.328% 95.738% ( 1300, 1900 ] 1 0.328% 96.066% ( 1900, 2900 ] 2 0.656% 96.721% ( 2900, 4400 ] 3 0.984% 97.705% ( 4400, 6600 ] 3 0.984% 98.689% ( 6600, 9900 ] 4 1.311% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 950.0000 StdDev: 1201.71 Min: 110 Median: 420.0000 Max: 4813 Percentiles: P50: 420.00 P75: 1300.00 P99: 4813.00 P99.9: 4813.00 P99.99: 4813.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 11 27.500% 30.000% ###### ( 170, 250 ] 4 10.000% 40.000% ## ( 250, 380 ] 3 7.500% 47.500% ## ( 380, 580 ] 5 12.500% 60.000% ### ( 580, 870 ] 5 12.500% 72.500% ### ( 870, 1300 ] 1 2.500% 75.000% # ( 1300, 1900 ] 3 7.500% 82.500% ## ( 1900, 2900 ] 4 10.000% 92.500% ## ( 2900, 4400 ] 1 2.500% 95.000% # ( 4400, 6600 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 327.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.191 H:M:S, 9.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.383 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-19:03:52 ... thread 0: (1000000,5000000) ops and (276520.1,324712.2) ops/second in (3.616373,15.398251) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/17 3.07 GB 31.5 3.2 0.0 3.2 7.9 4.7 0.0 1.7 126.6 313.8 25.88 24.18 81 0.320 3326K 3440 0.0 0.0 L1 10/10 1.09 GB 0.0 1.9 1.5 0.4 1.9 1.5 0.1 1.2 238.8 237.9 8.12 7.90 3 2.707 1968K 6675 0.0 0.0 L2 1/0 48.89 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.5 1.8 238.0 237.9 0.47 0.44 1 0.468 113K 38 0.0 0.0 L3 15/0 773.32 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.4 1.0 227.0 227.0 0.85 0.77 2 0.425 196K 10 0.0 0.0 L4 173/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.7 1.0 62.0 62.1 0.90 0.57 1 0.904 56K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/27 100.86 GB 0.0 5.4 1.8 3.6 10.2 6.6 2.4 2.1 153.9 287.5 36.23 33.86 88 0.412 5661K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 1.8 3.6 10.2 6.6 2.4 2.1 153.9 287.5 36.23 33.86 88 0.412 5661K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 1.8 3.6 5.4 1.8 0.0 0.0 245.6 245.1 22.70 21.81 19 1.195 5661K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 358.7 13.52 12.05 69 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.17 GB write, 666.71 MB/s write, 5.44 GB read, 356.89 MB/s read, 36.2 seconds Interval compaction: 10.17 GB write, 676.31 MB/s write, 5.44 GB read, 362.03 MB/s read, 36.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 20, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1389652 Average: 2.1679 StdDev: 11.59 Min: 0 Median: 1.4800 Max: 4269 Percentiles: P50: 1.48 P75: 1.85 P99: 5.48 P99.9: 9.70 P99.99: 14.25 ------------------------------------------------------ [ 0, 1 ] 243184 17.500% 17.500% ### ( 1, 2 ] 940827 67.702% 85.202% ############## ( 2, 3 ] 128667 9.259% 94.461% ## ( 3, 4 ] 41579 2.992% 97.453% # ( 4, 6 ] 28957 2.084% 99.537% ( 6, 10 ] 5460 0.393% 99.930% ( 10, 15 ] 989 0.071% 100.001% ( 15, 22 ] 116 0.008% 100.009% ( 22, 34 ] 32 0.002% 100.011% ( 34, 51 ] 16 0.001% 100.013% ( 51, 76 ] 13 0.001% 100.014% ( 76, 110 ] 2 0.000% 100.014% ( 110, 170 ] 70 0.005% 100.019% ( 170, 250 ] 41 0.003% 100.022% ( 250, 380 ] 24 0.002% 100.023% ( 380, 580 ] 29 0.002% 100.025% ( 580, 870 ] 31 0.002% 100.028% ( 870, 1300 ] 18 0.001% 100.029% ( 1300, 1900 ] 9 0.001% 100.030% ( 1900, 2900 ] 2 0.000% 100.030% ( 2900, 4400 ] 8 0.001% 100.030% ** Level 1 read latency histogram (micros): Count: 147213 Average: 2.4617 StdDev: 16.11 Min: 0 Median: 1.4988 Max: 2198 Percentiles: P50: 1.50 P75: 1.87 P99: 5.92 P99.9: 87.44 P99.99: 883.32 ------------------------------------------------------ [ 0, 1 ] 23866 16.212% 16.212% ### ( 1, 2 ] 99711 67.732% 83.944% ############## ( 2, 3 ] 14375 9.765% 93.709% ## ( 3, 4 ] 4486 3.047% 96.756% # ( 4, 6 ] 3434 2.333% 99.089% ( 6, 10 ] 1012 0.687% 99.777% ( 10, 15 ] 148 0.101% 99.877% ( 15, 22 ] 16 0.011% 99.888% ( 22, 34 ] 2 0.001% 99.889% ( 34, 51 ] 2 0.001% 99.891% ( 51, 76 ] 1 0.001% 99.891% ( 76, 110 ] 38 0.026% 99.917% ( 110, 170 ] 52 0.035% 99.952% ( 170, 250 ] 21 0.014% 99.967% ( 250, 380 ] 17 0.012% 99.978% ( 380, 580 ] 14 0.010% 99.988% ( 580, 870 ] 3 0.002% 99.990% ( 870, 1300 ] 9 0.006% 99.996% ( 1300, 1900 ] 4 0.003% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28106 Average: 2.6843 StdDev: 40.76 Min: 0 Median: 1.2420 Max: 5427 Percentiles: P50: 1.24 P75: 1.67 P99: 6.80 P99.9: 238.77 P99.99: 1994.70 ------------------------------------------------------ [ 0, 1 ] 10035 35.704% 35.704% ####### ( 1, 2 ] 16600 59.062% 94.766% ############ ( 2, 3 ] 819 2.914% 97.680% # ( 3, 4 ] 221 0.786% 98.467% ( 4, 6 ] 114 0.406% 98.872% ( 6, 10 ] 180 0.640% 99.513% ( 10, 15 ] 54 0.192% 99.705% ( 15, 22 ] 4 0.014% 99.719% ( 22, 34 ] 1 0.004% 99.722% ( 34, 51 ] 2 0.007% 99.730% ( 51, 76 ] 26 0.093% 99.822% ( 76, 110 ] 7 0.025% 99.847% ( 110, 170 ] 2 0.007% 99.854% ( 170, 250 ] 15 0.053% 99.907% ( 250, 380 ] 15 0.053% 99.961% ( 380, 580 ] 5 0.018% 99.979% ( 870, 1300 ] 2 0.007% 99.986% ( 1300, 1900 ] 1 0.004% 99.989% ( 1900, 2900 ] 2 0.007% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 14852 Average: 15.9738 StdDev: 252.47 Min: 1 Median: 2.8085 Max: 9095 Percentiles: P50: 2.81 P75: 3.76 P99: 13.13 P99.9: 5101.97 P99.99: 9083.14 ------------------------------------------------------ [ 0, 1 ] 166 1.118% 1.118% ( 1, 2 ] 2408 16.213% 17.331% ### ( 2, 3 ] 6001 40.405% 57.736% ######## ( 3, 4 ] 3373 22.711% 80.447% ##### ( 4, 6 ] 1861 12.530% 92.977% ### ( 6, 10 ] 803 5.407% 98.384% # ( 10, 15 ] 146 0.983% 99.367% ( 15, 22 ] 31 0.209% 99.576% ( 22, 34 ] 2 0.013% 99.589% ( 110, 170 ] 1 0.007% 99.596% ( 170, 250 ] 2 0.013% 99.609% ( 250, 380 ] 4 0.027% 99.636% ( 380, 580 ] 7 0.047% 99.684% ( 580, 870 ] 7 0.047% 99.731% ( 870, 1300 ] 5 0.034% 99.764% ( 1300, 1900 ] 3 0.020% 99.785% ( 1900, 2900 ] 5 0.034% 99.818% ( 2900, 4400 ] 8 0.054% 99.872% ( 4400, 6600 ] 13 0.088% 99.960% ( 6600, 9900 ] 6 0.040% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 221.8656 StdDev: 1033.49 Min: 0 Median: 1.5930 Max: 7535 Percentiles: P50: 1.59 P75: 2.49 P99: 7383.75 P99.9: 7535.00 P99.99: 7535.00 ------------------------------------------------------ [ 0, 1 ] 76 24.918% 24.918% ##### ( 1, 2 ] 129 42.295% 67.213% ######## ( 2, 3 ] 48 15.738% 82.951% ### ( 3, 4 ] 16 5.246% 88.197% # ( 4, 6 ] 5 1.639% 89.836% ( 6, 10 ] 2 0.656% 90.492% ( 10, 15 ] 1 0.328% 90.820% ( 34, 51 ] 2 0.656% 91.475% ( 51, 76 ] 1 0.328% 91.803% ( 110, 170 ] 2 0.656% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 250, 380 ] 1 0.328% 93.770% ( 380, 580 ] 2 0.656% 94.426% ( 580, 870 ] 3 0.984% 95.410% ( 870, 1300 ] 1 0.328% 95.738% ( 1300, 1900 ] 1 0.328% 96.066% ( 1900, 2900 ] 2 0.656% 96.721% ( 2900, 4400 ] 3 0.984% 97.705% ( 4400, 6600 ] 3 0.984% 98.689% ( 6600, 9900 ] 4 1.311% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 950.0000 StdDev: 1201.71 Min: 110 Median: 420.0000 Max: 4813 Percentiles: P50: 420.00 P75: 1300.00 P99: 4813.00 P99.9: 4813.00 P99.99: 4813.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 11 27.500% 30.000% ###### ( 170, 250 ] 4 10.000% 40.000% ## ( 250, 380 ] 3 7.500% 47.500% ## ( 380, 580 ] 5 12.500% 60.000% ### ( 580, 870 ] 5 12.500% 72.500% ### ( 870, 1300 ] 1 2.500% 75.000% # ( 1300, 1900 ] 3 7.500% 82.500% ## ( 1900, 2900 ] 4 10.000% 92.500% ## ( 2900, 4400 ] 1 2.500% 95.000% # ( 4400, 6600 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.6 total, 3.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 314.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.117 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 272.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.926 H:M:S, 25.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/28-19:04:00 ... thread 0: (1000000,6000000) ops and (132868.9,261729.1) ops/second in (7.526217,22.924468) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.99 GB 150.8 5.0 0.0 5.0 10.6 5.7 0.0 1.9 144.7 308.9 35.26 33.16 101 0.349 5180K 6916 0.0 0.0 L1 10/10 1.09 GB 0.0 1.9 1.5 0.4 1.9 1.5 0.1 1.2 238.8 237.9 8.12 7.90 3 2.707 1968K 6675 0.0 0.0 L2 1/0 48.89 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.5 1.8 238.0 237.9 0.47 0.44 1 0.468 113K 38 0.0 0.0 L3 15/0 773.32 MB 0.8 0.2 0.2 0.0 0.2 0.2 0.4 1.0 227.0 227.0 0.85 0.77 2 0.425 196K 10 0.0 0.0 L4 173/0 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.7 1.0 62.0 62.1 0.90 0.57 1 0.904 56K 0 0.0 0.0 L5 1048/0 86.31 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1265/23 101.78 GB 0.0 7.2 1.8 5.4 12.9 7.5 2.4 2.3 162.3 289.1 45.60 42.83 108 0.422 7515K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.2 1.8 5.4 12.9 7.5 2.4 2.3 162.3 289.1 45.60 42.83 108 0.422 7515K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.2 1.8 5.4 7.2 1.8 0.0 0.0 251.7 251.2 29.41 28.41 24 1.225 7515K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 357.9 16.19 14.42 84 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.1 total, 22.9 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.87 GB write, 569.51 MB/s write, 7.23 GB read, 319.75 MB/s read, 45.6 seconds Interval compaction: 12.87 GB write, 575.02 MB/s write, 7.23 GB read, 322.84 MB/s read, 45.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 20, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2122211 Average: 2.2163 StdDev: 11.48 Min: 0 Median: 1.4852 Max: 4350 Percentiles: P50: 1.49 P75: 1.85 P99: 5.56 P99.9: 9.96 P99.99: 111.86 ------------------------------------------------------ [ 0, 1 ] 354916 16.724% 16.724% ### ( 1, 2 ] 1455513 68.585% 85.309% ############## ( 2, 3 ] 196397 9.254% 94.563% ## ( 3, 4 ] 61495 2.898% 97.461% # ( 4, 6 ] 41851 1.972% 99.433% ( 6, 10 ] 10010 0.472% 99.904% ( 10, 15 ] 1433 0.068% 99.972% ( 15, 22 ] 178 0.008% 99.980% ( 22, 34 ] 40 0.002% 99.982% ( 34, 51 ] 17 0.001% 99.983% ( 51, 76 ] 16 0.001% 99.984% ( 76, 110 ] 123 0.006% 99.990% ( 110, 170 ] 347 0.016% 100.006% ( 170, 250 ] 138 0.007% 100.012% ( 250, 380 ] 72 0.003% 100.016% ( 380, 580 ] 89 0.004% 100.020% ( 580, 870 ] 62 0.003% 100.023% ( 870, 1300 ] 26 0.001% 100.024% ( 1300, 1900 ] 10 0.000% 100.025% ( 1900, 2900 ] 5 0.000% 100.025% ( 2900, 4400 ] 9 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 273264 Average: 2.4650 StdDev: 13.00 Min: 0 Median: 1.5032 Max: 2198 Percentiles: P50: 1.50 P75: 1.87 P99: 7.36 P99.9: 104.55 P99.99: 525.73 ------------------------------------------------------ [ 0, 1 ] 42188 15.439% 15.439% ### ( 1, 2 ] 187684 68.682% 84.121% ############## ( 2, 3 ] 25840 9.456% 93.577% ## ( 3, 4 ] 7794 2.852% 96.429% # ( 4, 6 ] 6011 2.200% 98.629% ( 6, 10 ] 2979 1.090% 99.719% ( 10, 15 ] 317 0.116% 99.835% ( 15, 22 ] 29 0.011% 99.846% ( 22, 34 ] 3 0.001% 99.847% ( 34, 51 ] 2 0.001% 99.847% ( 51, 76 ] 1 0.000% 99.848% ( 76, 110 ] 170 0.062% 99.910% ( 110, 170 ] 133 0.049% 99.959% ( 170, 250 ] 37 0.014% 99.972% ( 250, 380 ] 29 0.011% 99.983% ( 380, 580 ] 27 0.010% 99.993% ( 580, 870 ] 5 0.002% 99.995% ( 870, 1300 ] 9 0.003% 99.998% ( 1300, 1900 ] 4 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 28106 Average: 2.6843 StdDev: 40.76 Min: 0 Median: 1.2420 Max: 5427 Percentiles: P50: 1.24 P75: 1.67 P99: 6.80 P99.9: 238.77 P99.99: 1994.70 ------------------------------------------------------ [ 0, 1 ] 10035 35.704% 35.704% ####### ( 1, 2 ] 16600 59.062% 94.766% ############ ( 2, 3 ] 819 2.914% 97.680% # ( 3, 4 ] 221 0.786% 98.467% ( 4, 6 ] 114 0.406% 98.872% ( 6, 10 ] 180 0.640% 99.513% ( 10, 15 ] 54 0.192% 99.705% ( 15, 22 ] 4 0.014% 99.719% ( 22, 34 ] 1 0.004% 99.722% ( 34, 51 ] 2 0.007% 99.730% ( 51, 76 ] 26 0.093% 99.822% ( 76, 110 ] 7 0.025% 99.847% ( 110, 170 ] 2 0.007% 99.854% ( 170, 250 ] 15 0.053% 99.907% ( 250, 380 ] 15 0.053% 99.961% ( 380, 580 ] 5 0.018% 99.979% ( 870, 1300 ] 2 0.007% 99.986% ( 1300, 1900 ] 1 0.004% 99.989% ( 1900, 2900 ] 2 0.007% 99.996% ( 4400, 6600 ] 1 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 14852 Average: 15.9738 StdDev: 252.47 Min: 1 Median: 2.8085 Max: 9095 Percentiles: P50: 2.81 P75: 3.76 P99: 13.13 P99.9: 5101.97 P99.99: 9083.14 ------------------------------------------------------ [ 0, 1 ] 166 1.118% 1.118% ( 1, 2 ] 2408 16.213% 17.331% ### ( 2, 3 ] 6001 40.405% 57.736% ######## ( 3, 4 ] 3373 22.711% 80.447% ##### ( 4, 6 ] 1861 12.530% 92.977% ### ( 6, 10 ] 803 5.407% 98.384% # ( 10, 15 ] 146 0.983% 99.367% ( 15, 22 ] 31 0.209% 99.576% ( 22, 34 ] 2 0.013% 99.589% ( 110, 170 ] 1 0.007% 99.596% ( 170, 250 ] 2 0.013% 99.609% ( 250, 380 ] 4 0.027% 99.636% ( 380, 580 ] 7 0.047% 99.684% ( 580, 870 ] 7 0.047% 99.731% ( 870, 1300 ] 5 0.034% 99.764% ( 1300, 1900 ] 3 0.020% 99.785% ( 1900, 2900 ] 5 0.034% 99.818% ( 2900, 4400 ] 8 0.054% 99.872% ( 4400, 6600 ] 13 0.088% 99.960% ( 6600, 9900 ] 6 0.040% 100.000% ** Level 4 read latency histogram (micros): Count: 305 Average: 221.8656 StdDev: 1033.49 Min: 0 Median: 1.5930 Max: 7535 Percentiles: P50: 1.59 P75: 2.49 P99: 7383.75 P99.9: 7535.00 P99.99: 7535.00 ------------------------------------------------------ [ 0, 1 ] 76 24.918% 24.918% ##### ( 1, 2 ] 129 42.295% 67.213% ######## ( 2, 3 ] 48 15.738% 82.951% ### ( 3, 4 ] 16 5.246% 88.197% # ( 4, 6 ] 5 1.639% 89.836% ( 6, 10 ] 2 0.656% 90.492% ( 10, 15 ] 1 0.328% 90.820% ( 34, 51 ] 2 0.656% 91.475% ( 51, 76 ] 1 0.328% 91.803% ( 110, 170 ] 2 0.656% 92.459% ( 170, 250 ] 3 0.984% 93.443% ( 250, 380 ] 1 0.328% 93.770% ( 380, 580 ] 2 0.656% 94.426% ( 580, 870 ] 3 0.984% 95.410% ( 870, 1300 ] 1 0.328% 95.738% ( 1300, 1900 ] 1 0.328% 96.066% ( 1900, 2900 ] 2 0.656% 96.721% ( 2900, 4400 ] 3 0.984% 97.705% ( 4400, 6600 ] 3 0.984% 98.689% ( 6600, 9900 ] 4 1.311% 100.000% ** Level 5 read latency histogram (micros): Count: 40 Average: 950.0000 StdDev: 1201.71 Min: 110 Median: 420.0000 Max: 4813 Percentiles: P50: 420.00 P75: 1300.00 P99: 4813.00 P99.9: 4813.00 P99.99: 4813.00 ------------------------------------------------------ ( 76, 110 ] 1 2.500% 2.500% # ( 110, 170 ] 11 27.500% 30.000% ###### ( 170, 250 ] 4 10.000% 40.000% ## ( 250, 380 ] 3 7.500% 47.500% ## ( 380, 580 ] 5 12.500% 60.000% ### ( 580, 870 ] 5 12.500% 72.500% ### ( 870, 1300 ] 1 2.500% 75.000% # ( 1300, 1900 ] 3 7.500% 82.500% ## ( 1900, 2900 ] 4 10.000% 92.500% ## ( 2900, 4400 ] 1 2.500% 95.000% # ( 4400, 6600 ] 2 5.000% 100.000% # ** DB Stats ** Uptime(secs): 23.1 total, 7.5 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 255.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.753 H:M:S, 29.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 130.77 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.636 H:M:S, 61.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/28-19:04:12 ... thread 0: (1000000,7000000) ops and (82791.7,199983.0) ops/second in (12.078503,35.002971) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/5 2.39 GB 56.7 5.8 0.0 5.8 12.4 6.6 0.0 1.9 140.5 300.3 42.13 38.83 117 0.360 6012K 7787 0.0 0.0 L1 13/13 1.54 GB 0.0 5.5 4.1 1.4 5.4 4.0 0.1 1.3 225.6 222.9 24.98 23.69 4 6.245 5721K 66K 0.0 0.0 L2 4/3 515.12 MB 1.3 0.1 0.1 0.0 0.1 0.1 2.5 1.8 238.0 237.9 0.47 0.44 1 0.468 113K 38 0.0 0.0 L3 27/6 1.25 GB 1.0 2.4 1.7 0.6 2.4 1.7 0.4 1.4 200.5 199.8 12.09 10.59 6 2.016 2463K 9202 0.0 0.0 L4 177/2 9.66 GB 1.0 1.0 0.9 0.0 1.0 0.9 0.8 1.0 127.0 126.9 7.71 4.89 15 0.514 986K 245 0.0 0.0 L5 1060/0 87.29 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1290/29 102.64 GB 0.0 14.7 6.8 7.9 21.2 13.3 5.5 3.2 172.5 248.6 87.38 78.43 143 0.611 15M 83K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.7 6.8 7.9 21.2 13.3 5.5 3.2 172.5 248.6 87.38 78.43 143 0.611 15M 83K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.7 6.8 7.9 14.6 6.7 0.0 0.0 223.7 222.4 67.39 61.36 46 1.465 15M 83K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 337.1 20.00 17.08 97 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.2 total, 35.0 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.22 GB write, 616.79 MB/s write, 14.72 GB read, 427.84 MB/s read, 87.4 seconds Interval compaction: 21.22 GB write, 620.70 MB/s write, 14.72 GB read, 430.55 MB/s read, 87.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 24, interval: 45 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2830761 Average: 2.5487 StdDev: 17.44 Min: 0 Median: 1.5108 Max: 5392 Percentiles: P50: 1.51 P75: 1.88 P99: 6.00 P99.9: 109.72 P99.99: 268.37 ------------------------------------------------------ [ 0, 1 ] 447482 15.808% 15.808% ### ( 1, 2 ] 1894771 66.935% 82.743% ############# ( 2, 3 ] 284609 10.054% 92.797% ## ( 3, 4 ] 97702 3.451% 96.248% # ( 4, 6 ] 78028 2.756% 99.005% # ( 6, 10 ] 20474 0.723% 99.728% ( 10, 15 ] 3098 0.109% 99.838% ( 15, 22 ] 373 0.013% 99.851% ( 22, 34 ] 62 0.002% 99.853% ( 34, 51 ] 23 0.001% 99.854% ( 51, 76 ] 16 0.001% 99.854% ( 76, 110 ] 1304 0.046% 99.900% ( 110, 170 ] 2097 0.074% 99.974% ( 170, 250 ] 393 0.014% 99.988% ( 250, 380 ] 332 0.012% 100.000% ( 380, 580 ] 286 0.010% 100.010% ( 580, 870 ] 201 0.007% 100.017% ( 870, 1300 ] 72 0.003% 100.020% ( 1300, 1900 ] 30 0.001% 100.021% ( 1900, 2900 ] 13 0.000% 100.021% ( 2900, 4400 ] 23 0.001% 100.022% ( 4400, 6600 ] 2 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 962236 Average: 3.7240 StdDev: 48.41 Min: 0 Median: 1.6938 Max: 13608 Percentiles: P50: 1.69 P75: 2.41 P99: 8.98 P99.9: 148.77 P99.99: 386.67 ------------------------------------------------------ [ 0, 1 ] 85957 8.933% 8.933% ## ( 1, 2 ] 569590 59.194% 68.127% ############ ( 2, 3 ] 161142 16.747% 84.874% ### ( 3, 4 ] 61099 6.350% 91.224% # ( 4, 6 ] 62093 6.453% 97.677% # ( 6, 10 ] 17069 1.774% 99.451% ( 10, 15 ] 3037 0.316% 99.766% ( 15, 22 ] 286 0.030% 99.796% ( 22, 34 ] 27 0.003% 99.799% ( 34, 51 ] 6 0.001% 99.799% ( 51, 76 ] 1 0.000% 99.800% ( 76, 110 ] 457 0.047% 99.847% ( 110, 170 ] 792 0.082% 99.929% ( 170, 250 ] 302 0.031% 99.961% ( 250, 380 ] 275 0.029% 99.989% ( 380, 580 ] 263 0.027% 100.017% ( 580, 870 ] 169 0.018% 100.034% ( 870, 1300 ] 115 0.012% 100.046% ( 1300, 1900 ] 60 0.006% 100.052% ( 1900, 2900 ] 29 0.003% 100.055% ( 2900, 4400 ] 40 0.004% 100.060% ( 4400, 6600 ] 12 0.001% 100.061% ( 6600, 9900 ] 12 0.001% 100.062% ( 9900, 14000 ] 1 0.000% 100.062% ** Level 2 read latency histogram (micros): Count: 40521 Average: 3.6199 StdDev: 41.17 Min: 0 Median: 1.4331 Max: 5427 Percentiles: P50: 1.43 P75: 1.87 P99: 9.32 P99.9: 392.33 P99.99: 1742.18 ------------------------------------------------------ [ 0, 1 ] 10251 25.298% 25.298% ##### ( 1, 2 ] 23112 57.037% 82.335% ########### ( 2, 3 ] 3815 9.415% 91.750% ## ( 3, 4 ] 1249 3.082% 94.832% # ( 4, 6 ] 1315 3.245% 98.078% # ( 6, 10 ] 451 1.113% 99.191% ( 10, 15 ] 142 0.350% 99.541% ( 15, 22 ] 15 0.037% 99.578% ( 22, 34 ] 3 0.007% 99.585% ( 34, 51 ] 2 0.005% 99.590% ( 51, 76 ] 26 0.064% 99.655% ( 76, 110 ] 8 0.020% 99.674% ( 110, 170 ] 13 0.032% 99.706% ( 170, 250 ] 39 0.096% 99.803% ( 250, 380 ] 38 0.094% 99.896% ( 380, 580 ] 24 0.059% 99.956% ( 580, 870 ] 6 0.015% 99.970% ( 870, 1300 ] 5 0.012% 99.983% ( 1300, 1900 ] 4 0.010% 99.993% ( 1900, 2900 ] 2 0.005% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 363926 Average: 4.9383 StdDev: 72.49 Min: 0 Median: 2.1221 Max: 9095 Percentiles: P50: 2.12 P75: 3.17 P99: 8.83 P99.9: 13.75 P99.99: 14.90 ------------------------------------------------------ [ 0, 1 ] 4481 1.231% 1.231% ( 1, 2 ] 165809 45.561% 46.792% ######### ( 2, 3 ] 95590 26.266% 73.059% ##### ( 3, 4 ] 41955 11.528% 84.587% ## ( 4, 6 ] 47123 12.949% 97.536% ### ( 6, 10 ] 7530 2.069% 99.605% ( 10, 15 ] 1433 0.394% 99.999% ( 15, 22 ] 144 0.040% 100.038% ( 22, 34 ] 8 0.002% 100.040% ( 34, 51 ] 3 0.001% 100.041% ( 51, 76 ] 8 0.002% 100.043% ( 76, 110 ] 27 0.007% 100.051% ( 110, 170 ] 52 0.014% 100.065% ( 170, 250 ] 105 0.029% 100.094% ( 250, 380 ] 104 0.029% 100.123% ( 380, 580 ] 121 0.033% 100.156% ( 580, 870 ] 82 0.023% 100.178% ( 870, 1300 ] 67 0.018% 100.197% ( 1300, 1900 ] 34 0.009% 100.206% ( 1900, 2900 ] 36 0.010% 100.216% ( 2900, 4400 ] 44 0.012% 100.228% ( 4400, 6600 ] 15 0.004% 100.232% ( 6600, 9900 ] 6 0.002% 100.234% ** Level 4 read latency histogram (micros): Count: 4378 Average: 276.6699 StdDev: 675.33 Min: 0 Median: 2.7498 Max: 7535 Percentiles: P50: 2.75 P75: 13.99 P99: 3291.40 P99.9: 7010.52 P99.99: 7535.00 ------------------------------------------------------ [ 0, 1 ] 119 2.718% 2.718% # ( 1, 2 ] 1258 28.735% 31.453% ###### ( 2, 3 ] 1083 24.737% 56.190% ##### ( 3, 4 ] 391 8.931% 65.121% ## ( 4, 6 ] 334 7.629% 72.750% ## ( 6, 10 ] 65 1.485% 74.235% ( 10, 15 ] 42 0.959% 75.194% ( 15, 22 ] 2 0.046% 75.240% ( 22, 34 ] 2 0.046% 75.286% ( 34, 51 ] 3 0.069% 75.354% ( 51, 76 ] 1 0.023% 75.377% ( 76, 110 ] 4 0.091% 75.468% ( 110, 170 ] 35 0.799% 76.268% ( 170, 250 ] 72 1.645% 77.912% ( 250, 380 ] 88 2.010% 79.922% ( 380, 580 ] 149 3.403% 83.326% # ( 580, 870 ] 215 4.911% 88.237% # ( 870, 1300 ] 213 4.865% 93.102% # ( 1300, 1900 ] 135 3.084% 96.185% # ( 1900, 2900 ] 112 2.558% 98.744% # ( 2900, 4400 ] 43 0.982% 99.726% ( 4400, 6600 ] 7 0.160% 99.886% ( 6600, 9900 ] 5 0.114% 100.000% ** Level 5 read latency histogram (micros): Count: 100 Average: 1069.2200 StdDev: 1231.05 Min: 77 Median: 546.6667 Max: 5399 Percentiles: P50: 546.67 P75: 1525.00 P99: 5399.00 P99.9: 5399.00 P99.99: 5399.00 ------------------------------------------------------ ( 76, 110 ] 8 8.000% 8.000% ## ( 110, 170 ] 16 16.000% 24.000% ### ( 170, 250 ] 9 9.000% 33.000% ## ( 250, 380 ] 7 7.000% 40.000% # ( 380, 580 ] 12 12.000% 52.000% ## ( 580, 870 ] 13 13.000% 65.000% ### ( 870, 1300 ] 7 7.000% 72.000% # ( 1300, 1900 ] 8 8.000% 80.000% ## ( 1900, 2900 ] 11 11.000% 91.000% ## ( 2900, 4400 ] 5 5.000% 96.000% # ( 4400, 6600 ] 4 4.000% 100.000% # ** DB Stats ** Uptime(secs): 35.2 total, 12.1 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 195.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.883 H:M:S, 45.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 81.48 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:9.130 H:M:S, 75.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/28-19:04:15 ... thread 0: (1000000,8000000) ops and (273383.4,206927.7) ops/second in (3.657866,38.660837) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/13 3.44 GB 107.0 6.4 0.0 6.4 14.0 7.6 0.0 1.8 136.2 298.3 48.11 44.06 133 0.362 6651K 8509 0.0 0.0 L1 13/13 1.54 GB 0.0 5.5 4.1 1.4 5.4 4.0 0.1 1.3 225.6 222.9 24.98 23.69 4 6.245 5721K 66K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.5 1.8 238.0 237.9 0.47 0.44 1 0.468 113K 38 0.0 0.0 L3 21/0 953.37 MB 1.0 3.2 2.2 0.9 3.2 2.2 0.4 1.4 192.7 192.0 16.88 14.26 9 1.876 3304K 12K 0.0 0.0 L4 178/0 9.49 GB 1.0 1.8 1.8 0.0 1.8 1.8 0.8 1.0 139.4 139.3 13.11 8.82 28 0.468 1842K 537 0.0 0.0 L5 1072/0 88.28 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1301/26 103.68 GB 0.0 17.0 8.1 8.8 24.5 15.7 6.5 3.2 167.8 242.4 103.56 91.27 175 0.592 17M 87K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.0 8.1 8.8 24.5 15.7 6.5 3.2 167.8 242.4 103.56 91.27 175 0.592 17M 87K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.0 8.1 8.8 16.9 8.0 0.0 0.0 216.9 215.8 80.10 71.42 64 1.252 17M 87K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 333.0 23.46 19.85 111 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.9 total, 38.7 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.51 GB write, 645.50 MB/s write, 16.97 GB read, 446.90 MB/s read, 103.6 seconds Interval compaction: 24.51 GB write, 649.21 MB/s write, 16.97 GB read, 449.46 MB/s read, 103.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 38, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 38, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3183170 Average: 2.5684 StdDev: 17.23 Min: 0 Median: 1.5291 Max: 5392 Percentiles: P50: 1.53 P75: 1.91 P99: 6.18 P99.9: 102.63 P99.99: 242.03 ------------------------------------------------------ [ 0, 1 ] 473597 14.878% 14.878% ### ( 1, 2 ] 2112807 66.374% 81.252% ############# ( 2, 3 ] 344355 10.818% 92.070% ## ( 3, 4 ] 118874 3.734% 95.805% # ( 4, 6 ] 100599 3.160% 98.965% # ( 6, 10 ] 24422 0.767% 99.732% ( 10, 15 ] 3754 0.118% 99.850% ( 15, 22 ] 432 0.014% 99.864% ( 22, 34 ] 71 0.002% 99.866% ( 34, 51 ] 24 0.001% 99.867% ( 51, 76 ] 17 0.001% 99.867% ( 76, 110 ] 1325 0.042% 99.909% ( 110, 170 ] 2186 0.069% 99.978% ( 170, 250 ] 435 0.014% 99.991% ( 250, 380 ] 342 0.011% 100.002% ( 380, 580 ] 316 0.010% 100.012% ( 580, 870 ] 211 0.007% 100.019% ( 870, 1300 ] 81 0.003% 100.021% ( 1300, 1900 ] 36 0.001% 100.022% ( 1900, 2900 ] 13 0.000% 100.023% ( 2900, 4400 ] 25 0.001% 100.024% ( 4400, 6600 ] 3 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1121838 Average: 3.7753 StdDev: 48.91 Min: 0 Median: 1.7018 Max: 13608 Percentiles: P50: 1.70 P75: 2.42 P99: 9.03 P99.9: 152.83 P99.99: 462.82 ------------------------------------------------------ [ 0, 1 ] 92810 8.273% 8.273% ## ( 1, 2 ] 667001 59.456% 67.729% ############ ( 2, 3 ] 192157 17.129% 84.858% ### ( 3, 4 ] 70708 6.303% 91.161% # ( 4, 6 ] 72575 6.469% 97.630% # ( 6, 10 ] 20321 1.811% 99.441% ( 10, 15 ] 3620 0.323% 99.764% ( 15, 22 ] 324 0.029% 99.793% ( 22, 34 ] 30 0.003% 99.796% ( 34, 51 ] 7 0.001% 99.796% ( 51, 76 ] 4 0.000% 99.797% ( 76, 110 ] 542 0.048% 99.845% ( 110, 170 ] 866 0.077% 99.922% ( 170, 250 ] 327 0.029% 99.951% ( 250, 380 ] 311 0.028% 99.979% ( 380, 580 ] 299 0.027% 100.006% ( 580, 870 ] 207 0.018% 100.024% ( 870, 1300 ] 138 0.012% 100.036% ( 1300, 1900 ] 74 0.007% 100.043% ( 1900, 2900 ] 47 0.004% 100.047% ( 2900, 4400 ] 54 0.005% 100.052% ( 4400, 6600 ] 14 0.001% 100.053% ( 6600, 9900 ] 12 0.001% 100.054% ( 9900, 14000 ] 1 0.000% 100.054% ** Level 2 read latency histogram (micros): Count: 40521 Average: 3.6199 StdDev: 41.17 Min: 0 Median: 1.4331 Max: 5427 Percentiles: P50: 1.43 P75: 1.87 P99: 9.32 P99.9: 392.33 P99.99: 1742.18 ------------------------------------------------------ [ 0, 1 ] 10251 25.298% 25.298% ##### ( 1, 2 ] 23112 57.037% 82.335% ########### ( 2, 3 ] 3815 9.415% 91.750% ## ( 3, 4 ] 1249 3.082% 94.832% # ( 4, 6 ] 1315 3.245% 98.078% # ( 6, 10 ] 451 1.113% 99.191% ( 10, 15 ] 142 0.350% 99.541% ( 15, 22 ] 15 0.037% 99.578% ( 22, 34 ] 3 0.007% 99.585% ( 34, 51 ] 2 0.005% 99.590% ( 51, 76 ] 26 0.064% 99.655% ( 76, 110 ] 8 0.020% 99.674% ( 110, 170 ] 13 0.032% 99.706% ( 170, 250 ] 39 0.096% 99.803% ( 250, 380 ] 38 0.094% 99.896% ( 380, 580 ] 24 0.059% 99.956% ( 580, 870 ] 6 0.015% 99.970% ( 870, 1300 ] 5 0.012% 99.983% ( 1300, 1900 ] 4 0.010% 99.993% ( 1900, 2900 ] 2 0.005% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 598212 Average: 4.6434 StdDev: 65.62 Min: 0 Median: 2.1016 Max: 9095 Percentiles: P50: 2.10 P75: 3.12 P99: 8.89 P99.9: 14.10 P99.99: 17.69 ------------------------------------------------------ [ 0, 1 ] 6810 1.138% 1.138% ( 1, 2 ] 276298 46.187% 47.326% ######### ( 2, 3 ] 157525 26.333% 73.658% ##### ( 3, 4 ] 66633 11.139% 84.797% ## ( 4, 6 ] 76079 12.718% 97.515% ### ( 6, 10 ] 12284 2.053% 99.568% ( 10, 15 ] 2419 0.404% 99.973% ( 15, 22 ] 271 0.045% 100.018% ( 22, 34 ] 16 0.003% 100.021% ( 34, 51 ] 5 0.001% 100.021% ( 51, 76 ] 10 0.002% 100.023% ( 76, 110 ] 41 0.007% 100.030% ( 110, 170 ] 99 0.017% 100.046% ( 170, 250 ] 154 0.026% 100.072% ( 250, 380 ] 141 0.024% 100.096% ( 380, 580 ] 157 0.026% 100.122% ( 580, 870 ] 121 0.020% 100.142% ( 870, 1300 ] 82 0.014% 100.156% ( 1300, 1900 ] 46 0.008% 100.164% ( 1900, 2900 ] 64 0.011% 100.174% ( 2900, 4400 ] 63 0.011% 100.185% ( 4400, 6600 ] 17 0.003% 100.188% ( 6600, 9900 ] 8 0.001% 100.189% ** Level 4 read latency histogram (micros): Count: 7233 Average: 249.3114 StdDev: 612.29 Min: 0 Median: 2.7573 Max: 7535 Percentiles: P50: 2.76 P75: 69.75 P99: 2891.47 P99.9: 5985.93 P99.99: 7535.00 ------------------------------------------------------ [ 0, 1 ] 146 2.019% 2.019% ( 1, 2 ] 2096 28.978% 30.997% ###### ( 2, 3 ] 1815 25.093% 56.090% ##### ( 3, 4 ] 634 8.765% 64.856% ## ( 4, 6 ] 537 7.424% 72.280% # ( 6, 10 ] 115 1.590% 73.870% ( 10, 15 ] 69 0.954% 74.824% ( 15, 22 ] 6 0.083% 74.907% ( 22, 34 ] 3 0.041% 74.948% ( 34, 51 ] 3 0.041% 74.990% ( 51, 76 ] 1 0.014% 75.003% ( 76, 110 ] 11 0.152% 75.156% ( 110, 170 ] 72 0.995% 76.151% ( 170, 250 ] 163 2.254% 78.405% ( 250, 380 ] 183 2.530% 80.935% # ( 380, 580 ] 280 3.871% 84.806% # ( 580, 870 ] 358 4.950% 89.755% # ( 870, 1300 ] 313 4.327% 94.083% # ( 1300, 1900 ] 201 2.779% 96.862% # ( 1900, 2900 ] 156 2.157% 99.018% ( 2900, 4400 ] 58 0.802% 99.820% ( 4400, 6600 ] 8 0.111% 99.931% ( 6600, 9900 ] 5 0.069% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1021.1875 StdDev: 1167.56 Min: 77 Median: 497.6471 Max: 5399 Percentiles: P50: 497.65 P75: 1562.50 P99: 5399.00 P99.9: 5399.00 P99.99: 5399.00 ------------------------------------------------------ ( 76, 110 ] 16 10.000% 10.000% ## ( 110, 170 ] 25 15.625% 25.625% ### ( 170, 250 ] 14 8.750% 34.375% ## ( 250, 380 ] 15 9.375% 43.750% ## ( 380, 580 ] 17 10.625% 54.375% ## ( 580, 870 ] 17 10.625% 65.000% ## ( 870, 1300 ] 9 5.625% 70.625% # ( 1300, 1900 ] 16 10.000% 80.625% ## ( 1900, 2900 ] 18 11.250% 91.875% ## ( 2900, 4400 ] 9 5.625% 97.500% # ( 4400, 6600 ] 4 2.500% 100.000% # ** DB Stats ** Uptime(secs): 38.9 total, 3.7 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 202.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.715 H:M:S, 43.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 269.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.832 H:M:S, 22.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/28-19:04:19 ... thread 0: (1000000,9000000) ops and (302468.3,214454.4) ops/second in (3.306132,41.966969) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 4.36 GB 226.5 7.5 0.0 7.5 16.0 8.5 0.0 1.9 139.2 297.6 55.21 50.76 150 0.368 7803K 9792 0.0 0.0 L1 13/13 1.54 GB 0.0 5.5 4.1 1.4 5.4 4.0 0.1 1.3 225.6 222.9 24.98 23.69 4 6.245 5721K 66K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.5 1.8 238.0 237.9 0.47 0.44 1 0.468 113K 38 0.0 0.0 L3 21/0 953.37 MB 1.0 3.2 2.2 0.9 3.2 2.2 0.4 1.4 192.7 192.0 16.88 14.26 9 1.876 3304K 12K 0.0 0.0 L4 178/0 9.49 GB 1.0 1.8 1.8 0.0 1.8 1.8 0.8 1.0 139.4 139.3 13.11 8.82 28 0.468 1842K 537 0.0 0.0 L5 1072/0 88.28 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1302/22 104.60 GB 0.0 18.1 8.1 10.0 26.5 16.6 6.5 3.1 167.3 245.6 110.66 97.97 192 0.576 18M 89K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.1 8.1 10.0 26.5 16.6 6.5 3.1 167.3 245.6 110.66 97.97 192 0.576 18M 89K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.1 8.1 10.0 18.0 8.0 0.0 0.0 219.3 218.2 84.41 75.64 68 1.241 18M 89K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 333.6 26.25 22.32 124 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.2 total, 42.0 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.54 GB write, 644.17 MB/s write, 18.08 GB read, 438.76 MB/s read, 110.7 seconds Interval compaction: 26.54 GB write, 647.57 MB/s write, 18.08 GB read, 441.08 MB/s read, 110.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 42, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 42, interval: 64 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3461980 Average: 2.5465 StdDev: 16.97 Min: 0 Median: 1.5298 Max: 5392 Percentiles: P50: 1.53 P75: 1.90 P99: 6.08 P99.9: 95.34 P99.99: 231.36 ------------------------------------------------------ [ 0, 1 ] 508816 14.697% 14.697% ### ( 1, 2 ] 2306860 66.634% 81.331% ############# ( 2, 3 ] 376446 10.874% 92.205% ## ( 3, 4 ] 127556 3.684% 95.890% # ( 4, 6 ] 107156 3.095% 98.985% # ( 6, 10 ] 26309 0.760% 99.745% ( 10, 15 ] 4047 0.117% 99.862% ( 15, 22 ] 445 0.013% 99.874% ( 22, 34 ] 79 0.002% 99.877% ( 34, 51 ] 25 0.001% 99.877% ( 51, 76 ] 18 0.001% 99.878% ( 76, 110 ] 1338 0.039% 99.917% ( 110, 170 ] 2199 0.064% 99.980% ( 170, 250 ] 443 0.013% 99.993% ( 250, 380 ] 351 0.010% 100.003% ( 380, 580 ] 323 0.009% 100.012% ( 580, 870 ] 216 0.006% 100.019% ( 870, 1300 ] 85 0.002% 100.021% ( 1300, 1900 ] 38 0.001% 100.022% ( 1900, 2900 ] 14 0.000% 100.023% ( 2900, 4400 ] 28 0.001% 100.023% ( 4400, 6600 ] 3 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1246978 Average: 3.6628 StdDev: 46.52 Min: 0 Median: 1.6866 Max: 13608 Percentiles: P50: 1.69 P75: 2.36 P99: 8.98 P99.9: 151.07 P99.99: 465.08 ------------------------------------------------------ [ 0, 1 ] 105621 8.470% 8.470% ## ( 1, 2 ] 754264 60.487% 68.958% ############ ( 2, 3 ] 207929 16.675% 85.632% ### ( 3, 4 ] 74286 5.957% 91.589% # ( 4, 6 ] 75708 6.071% 97.661% # ( 6, 10 ] 22412 1.797% 99.458% ( 10, 15 ] 3839 0.308% 99.766% ( 15, 22 ] 337 0.027% 99.793% ( 22, 34 ] 31 0.002% 99.795% ( 34, 51 ] 7 0.001% 99.796% ( 51, 76 ] 8 0.001% 99.797% ( 76, 110 ] 623 0.050% 99.847% ( 110, 170 ] 973 0.078% 99.925% ( 170, 250 ] 356 0.029% 99.953% ( 250, 380 ] 327 0.026% 99.979% ( 380, 580 ] 311 0.025% 100.004% ( 580, 870 ] 213 0.017% 100.021% ( 870, 1300 ] 141 0.011% 100.033% ( 1300, 1900 ] 74 0.006% 100.039% ( 1900, 2900 ] 47 0.004% 100.042% ( 2900, 4400 ] 54 0.004% 100.047% ( 4400, 6600 ] 14 0.001% 100.048% ( 6600, 9900 ] 12 0.001% 100.049% ( 9900, 14000 ] 1 0.000% 100.049% ** Level 2 read latency histogram (micros): Count: 40521 Average: 3.6199 StdDev: 41.17 Min: 0 Median: 1.4331 Max: 5427 Percentiles: P50: 1.43 P75: 1.87 P99: 9.32 P99.9: 392.33 P99.99: 1742.18 ------------------------------------------------------ [ 0, 1 ] 10251 25.298% 25.298% ##### ( 1, 2 ] 23112 57.037% 82.335% ########### ( 2, 3 ] 3815 9.415% 91.750% ## ( 3, 4 ] 1249 3.082% 94.832% # ( 4, 6 ] 1315 3.245% 98.078% # ( 6, 10 ] 451 1.113% 99.191% ( 10, 15 ] 142 0.350% 99.541% ( 15, 22 ] 15 0.037% 99.578% ( 22, 34 ] 3 0.007% 99.585% ( 34, 51 ] 2 0.005% 99.590% ( 51, 76 ] 26 0.064% 99.655% ( 76, 110 ] 8 0.020% 99.674% ( 110, 170 ] 13 0.032% 99.706% ( 170, 250 ] 39 0.096% 99.803% ( 250, 380 ] 38 0.094% 99.896% ( 380, 580 ] 24 0.059% 99.956% ( 580, 870 ] 6 0.015% 99.970% ( 870, 1300 ] 5 0.012% 99.983% ( 1300, 1900 ] 4 0.010% 99.993% ( 1900, 2900 ] 2 0.005% 99.998% ( 4400, 6600 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 598212 Average: 4.6434 StdDev: 65.62 Min: 0 Median: 2.1016 Max: 9095 Percentiles: P50: 2.10 P75: 3.12 P99: 8.89 P99.9: 14.10 P99.99: 17.69 ------------------------------------------------------ [ 0, 1 ] 6810 1.138% 1.138% ( 1, 2 ] 276298 46.187% 47.326% ######### ( 2, 3 ] 157525 26.333% 73.658% ##### ( 3, 4 ] 66633 11.139% 84.797% ## ( 4, 6 ] 76079 12.718% 97.515% ### ( 6, 10 ] 12284 2.053% 99.568% ( 10, 15 ] 2419 0.404% 99.973% ( 15, 22 ] 271 0.045% 100.018% ( 22, 34 ] 16 0.003% 100.021% ( 34, 51 ] 5 0.001% 100.021% ( 51, 76 ] 10 0.002% 100.023% ( 76, 110 ] 41 0.007% 100.030% ( 110, 170 ] 99 0.017% 100.046% ( 170, 250 ] 154 0.026% 100.072% ( 250, 380 ] 141 0.024% 100.096% ( 380, 580 ] 157 0.026% 100.122% ( 580, 870 ] 121 0.020% 100.142% ( 870, 1300 ] 82 0.014% 100.156% ( 1300, 1900 ] 46 0.008% 100.164% ( 1900, 2900 ] 64 0.011% 100.174% ( 2900, 4400 ] 63 0.011% 100.185% ( 4400, 6600 ] 17 0.003% 100.188% ( 6600, 9900 ] 8 0.001% 100.189% ** Level 4 read latency histogram (micros): Count: 7233 Average: 249.3114 StdDev: 612.29 Min: 0 Median: 2.7573 Max: 7535 Percentiles: P50: 2.76 P75: 69.75 P99: 2891.47 P99.9: 5985.93 P99.99: 7535.00 ------------------------------------------------------ [ 0, 1 ] 146 2.019% 2.019% ( 1, 2 ] 2096 28.978% 30.997% ###### ( 2, 3 ] 1815 25.093% 56.090% ##### ( 3, 4 ] 634 8.765% 64.856% ## ( 4, 6 ] 537 7.424% 72.280% # ( 6, 10 ] 115 1.590% 73.870% ( 10, 15 ] 69 0.954% 74.824% ( 15, 22 ] 6 0.083% 74.907% ( 22, 34 ] 3 0.041% 74.948% ( 34, 51 ] 3 0.041% 74.990% ( 51, 76 ] 1 0.014% 75.003% ( 76, 110 ] 11 0.152% 75.156% ( 110, 170 ] 72 0.995% 76.151% ( 170, 250 ] 163 2.254% 78.405% ( 250, 380 ] 183 2.530% 80.935% # ( 380, 580 ] 280 3.871% 84.806% # ( 580, 870 ] 358 4.950% 89.755% # ( 870, 1300 ] 313 4.327% 94.083% # ( 1300, 1900 ] 201 2.779% 96.862% # ( 1900, 2900 ] 156 2.157% 99.018% ( 2900, 4400 ] 58 0.802% 99.820% ( 4400, 6600 ] 8 0.111% 99.931% ( 6600, 9900 ] 5 0.069% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1021.1875 StdDev: 1167.56 Min: 77 Median: 497.6471 Max: 5399 Percentiles: P50: 497.65 P75: 1562.50 P99: 5399.00 P99.9: 5399.00 P99.99: 5399.00 ------------------------------------------------------ ( 76, 110 ] 16 10.000% 10.000% ## ( 110, 170 ] 25 15.625% 25.625% ### ( 170, 250 ] 14 8.750% 34.375% ## ( 250, 380 ] 15 9.375% 43.750% ## ( 380, 580 ] 17 10.625% 54.375% ## ( 580, 870 ] 17 10.625% 65.000% ## ( 870, 1300 ] 9 5.625% 70.625% # ( 1300, 1900 ] 16 10.000% 80.625% ## ( 1900, 2900 ] 18 11.250% 91.875% ## ( 2900, 4400 ] 9 5.625% 97.500% # ( 4400, 6600 ] 4 2.500% 100.000% # ** DB Stats ** Uptime(secs): 42.2 total, 3.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 209.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.330 H:M:S, 41.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 297.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.615 H:M:S, 18.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.549 micros/op 152698 ops/sec 60.040 seconds 9167999 operations; 148.0 MB/s Microseconds per write: Count: 9167999 Average: 6.5489 StdDev: 367.42 Min: 1 Median: 1.7720 Max: 600648 Percentiles: P50: 1.77 P75: 2.81 P99: 9.11 P99.9: 1194.97 P99.99: 2681.27 ------------------------------------------------------ [ 0, 1 ] 1049419 11.447% 11.447% ## ( 1, 2 ] 4578498 49.940% 61.387% ########## ( 2, 3 ] 1536808 16.763% 78.149% ### ( 3, 4 ] 1304214 14.226% 92.375% ### ( 4, 6 ] 525086 5.727% 98.102% # ( 6, 10 ] 105765 1.154% 99.256% ( 10, 15 ] 26088 0.285% 99.541% ( 15, 22 ] 6427 0.070% 99.611% ( 22, 34 ] 1257 0.014% 99.624% ( 34, 51 ] 150 0.002% 99.626% ( 51, 76 ] 19 0.000% 99.626% ( 76, 110 ] 6749 0.074% 99.700% ( 110, 170 ] 2157 0.024% 99.723% ( 170, 250 ] 261 0.003% 99.726% ( 250, 380 ] 102 0.001% 99.727% ( 380, 580 ] 27 0.000% 99.728% ( 580, 870 ] 19 0.000% 99.728% ( 870, 1300 ] 20887 0.228% 99.956% ( 1300, 1900 ] 46 0.001% 99.956% ( 1900, 2900 ] 3972 0.043% 99.999% ( 2900, 4400 ] 20 0.000% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 9 0.000% 100.000% ( 250000, 380000 ] 2 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 199458 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9167999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9461374968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 513 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34503709 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28728146020 rocksdb.compact.write.bytes COUNT : 28537336947 rocksdb.flush.write.bytes COUNT : 9446212100 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 48 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 260 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9370073088 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3670016 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28812934014 rocksdb.non.last.level.read.count COUNT : 6963090 rocksdb.block.checksum.compute.count COUNT : 6962113 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.409902 P95 : 3.918445 P99 : 7.658924 P100 : 600646.000000 COUNT : 9167999 SUM : 55511893 rocksdb.compaction.times.micros P50 : 860000.000000 P95 : 3693333.333333 P99 : 16858663.000000 P100 : 16858663.000000 COUNT : 86 SUM : 111270427 rocksdb.compaction.times.cpu_micros P50 : 744000.000000 P95 : 3390000.000000 P99 : 15785413.000000 P100 : 15785413.000000 COUNT : 86 SUM : 100106754 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 690.987654 P95 : 1278.500000 P99 : 39120.000000 P100 : 49110.000000 COUNT : 128 SUM : 190761 rocksdb.compaction.outfile.sync.micros P50 : 867.835821 P95 : 12906.666667 P99 : 34870.000000 P100 : 43541.000000 COUNT : 356 SUM : 971789 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 102.860000 P95 : 355.950000 P99 : 1011.900000 P100 : 1423.000000 COUNT : 234 SUM : 36181 rocksdb.table.open.io.micros P50 : 1270.681818 P95 : 6545.000000 P99 : 17870.000000 P100 : 22534.000000 COUNT : 513 SUM : 1068670 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.617173 P95 : 7.596346 P99 : 10.865477 P100 : 13613.000000 COUNT : 6960756 SUM : 37306610 rocksdb.read.block.get.micros P50 : 438.156028 P95 : 3512.500000 P99 : 6571.400000 P100 : 9190.000000 COUNT : 1026 SUM : 858280 rocksdb.write.raw.block.micros P50 : 0.512770 P95 : 0.974263 P99 : 3.004108 P100 : 11579.000000 COUNT : 9199650 SUM : 17712591 rocksdb.numfiles.in.singlecompaction P50 : 3.084906 P95 : 7.250000 P99 : 32.200000 P100 : 35.000000 COUNT : 115 SUM : 437 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558555 P95 : 1137.462760 P99 : 2304.764914 P100 : 600466.000000 COUNT : 238075 SUM : 34521429 rocksdb.sst.read.micros P50 : 1.585129 P95 : 4.577272 P99 : 8.239654 P100 : 13608.000000 COUNT : 6963450 SUM : 23401470 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9167999 SUM : 9461374968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 209090.909091 P95 : 359200.000000 P99 : 674400.000000 P100 : 733205.000000 COUNT : 128 SUM : 27005081 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 320 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0