[2024-11-19 12:43:21.948658] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 22.11.4 initialization... [2024-11-19 12:43:21.948758] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid3504692 ] Set seed to 1732016601946197 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-19 12:43:22.034764] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-19 12:43:22.074099] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-19 12:43:22.074145] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 3504692' to capture a snapshot of events at runtime. [2024-11-19 12:43:22.074155] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-19 12:43:22.074166] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-19 12:43:22.074174] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid3504692 for offline analysis/debug. [2024-11-19 12:43:22.074255] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 19 12:43:26 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/19-12:43:29 ... thread 0: (1000000,1000000) ops and (348417.9,348417.9) ops/second in (2.870117,2.870117) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.02 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 345.1 2.37 2.14 12 0.198 0 0 0.0 0.0 L2 3/2 251.78 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 249.4 249.2 1.52 1.47 2 0.758 383K 194 0.0 0.0 L3 8/0 678.28 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 112/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1172/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 1.2 1.5 97.2 307.7 3.89 3.60 14 0.278 383K 194 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.7 1.5 97.2 307.7 3.89 3.60 14 0.278 383K 194 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 249.4 249.2 1.52 1.47 2 0.758 383K 194 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 345.1 2.37 2.14 12 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 389.03 MB/s write, 0.37 GB read, 122.87 MB/s read, 3.9 seconds Interval compaction: 1.17 GB write, 416.77 MB/s write, 0.37 GB read, 131.63 MB/s read, 3.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 103907 Average: 1.9366 StdDev: 22.85 Min: 1 Median: 1.2013 Max: 3243 Percentiles: P50: 1.20 P75: 1.65 P99: 3.94 P99.9: 9.91 P99.99: 289.60 ------------------------------------------------------ [ 0, 1 ] 40262 38.748% 38.748% ######## ( 1, 2 ] 58097 55.912% 94.661% ########### ( 2, 3 ] 3318 3.193% 97.854% # ( 3, 4 ] 1266 1.218% 99.072% ( 4, 6 ] 637 0.613% 99.685% ( 6, 10 ] 230 0.221% 99.907% ( 10, 15 ] 57 0.055% 99.962% ( 15, 22 ] 15 0.014% 99.976% ( 22, 34 ] 2 0.002% 99.978% ( 51, 76 ] 1 0.001% 99.979% ( 110, 170 ] 10 0.010% 99.988% ( 170, 250 ] 3 0.003% 99.991% ( 250, 380 ] 2 0.002% 99.993% ( 380, 580 ] 1 0.001% 99.994% ( 1300, 1900 ] 2 0.002% 99.996% ( 1900, 2900 ] 3 0.003% 99.999% ( 2900, 4400 ] 3 0.003% 100.002% ** Level 2 read latency histogram (micros): Count: 51801 Average: 2.1024 StdDev: 24.87 Min: 1 Median: 1.2570 Max: 3056 Percentiles: P50: 1.26 P75: 1.69 P99: 4.85 P99.9: 10.21 P99.99: 1046.28 ------------------------------------------------------ [ 0, 1 ] 18140 35.019% 35.019% ####### ( 1, 2 ] 30192 58.285% 93.303% ############ ( 2, 3 ] 1978 3.818% 97.122% # ( 3, 4 ] 749 1.446% 98.568% ( 4, 6 ] 530 1.023% 99.591% ( 6, 10 ] 160 0.309% 99.900% ( 10, 15 ] 29 0.056% 99.956% ( 15, 22 ] 6 0.012% 99.967% ( 22, 34 ] 1 0.002% 99.969% ( 34, 51 ] 1 0.002% 99.971% ( 76, 110 ] 1 0.002% 99.973% ( 170, 250 ] 1 0.002% 99.975% ( 250, 380 ] 3 0.006% 99.981% ( 380, 580 ] 1 0.002% 99.983% ( 580, 870 ] 4 0.008% 99.990% ( 870, 1300 ] 2 0.004% 99.994% ( 1300, 1900 ] 1 0.002% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 50 Average: 1451.2000 StdDev: 936.61 Min: 307 Median: 1300.0000 Max: 3455 Percentiles: P50: 1300.00 P75: 2191.67 P99: 3455.00 P99.9: 3455.00 P99.99: 3455.00 ------------------------------------------------------ ( 250, 380 ] 3 6.000% 6.000% # ( 380, 580 ] 9 18.000% 24.000% #### ( 580, 870 ] 11 22.000% 46.000% #### ( 870, 1300 ] 2 4.000% 50.000% # ( 1300, 1900 ] 9 18.000% 68.000% #### ( 1900, 2900 ] 12 24.000% 92.000% ##### ( 2900, 4400 ] 4 8.000% 100.000% ## ** Level 4 read latency histogram (micros): Count: 20 Average: 1445.4000 StdDev: 986.57 Min: 92 Median: 1471.4286 Max: 3647 Percentiles: P50: 1471.43 P75: 1900.00 P99: 3647.00 P99.9: 3647.00 P99.99: 3647.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 170, 250 ] 1 5.000% 15.000% # ( 580, 870 ] 5 25.000% 40.000% ##### ( 1300, 1900 ] 7 35.000% 75.000% ####### ( 1900, 2900 ] 3 15.000% 90.000% ### ( 2900, 4400 ] 2 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 40 Average: 484.9750 StdDev: 629.15 Min: 44 Median: 143.3333 Max: 2282 Percentiles: P50: 143.33 P75: 676.67 P99: 2282.00 P99.9: 2282.00 P99.99: 2282.00 ------------------------------------------------------ ( 34, 51 ] 3 7.500% 7.500% ## ( 51, 76 ] 4 10.000% 17.500% ## ( 76, 110 ] 8 20.000% 37.500% #### ( 110, 170 ] 9 22.500% 60.000% ##### ( 170, 250 ] 1 2.500% 62.500% # ( 380, 580 ] 4 10.000% 72.500% ## ( 580, 870 ] 3 7.500% 80.000% ## ( 870, 1300 ] 3 7.500% 87.500% ## ( 1300, 1900 ] 2 5.000% 92.500% # ( 1900, 2900 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 319.90 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.227 H:M:S, 7.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 342.62 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.227 H:M:S, 7.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-12:43:32 ... thread 0: (1000000,2000000) ops and (321223.7,334268.6) ops/second in (3.113095,5.983212) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 1.17 GB 12.6 0.2 0.0 0.2 2.0 1.8 0.0 1.1 40.4 333.4 6.23 5.67 27 0.231 255K 250 0.0 0.0 L1 1/1 2.68 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 237.8 237.3 1.59 1.54 1 1.590 383K 614 0.0 0.0 L2 2/0 54.31 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 249.4 249.2 1.52 1.47 2 0.758 383K 194 0.0 0.0 L3 45/0 974.22 MB 1.0 0.8 0.6 0.2 0.8 0.6 0.2 1.4 207.1 206.9 3.85 3.42 3 1.283 809K 790 0.0 0.0 L4 140/0 9.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/13 97.92 GB 0.0 1.8 1.1 0.7 3.5 2.9 2.1 2.0 136.9 275.2 13.19 12.10 33 0.400 1833K 1848 0.0 0.0 Int 0/0 0.00 KB 0.0 1.8 1.1 0.7 3.5 2.9 1.6 2.0 136.9 275.2 13.19 12.10 33 0.400 1833K 1848 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.8 1.1 0.7 1.8 1.1 0.0 0.0 227.7 227.4 7.93 7.39 7 1.133 1833K 1848 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 347.3 5.26 4.71 26 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.55 GB write, 586.55 MB/s write, 1.76 GB read, 291.69 MB/s read, 13.2 seconds Interval compaction: 3.55 GB write, 606.61 MB/s write, 1.76 GB read, 301.67 MB/s read, 13.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 349823 Average: 2.1442 StdDev: 15.14 Min: 0 Median: 1.4394 Max: 3243 Percentiles: P50: 1.44 P75: 1.83 P99: 5.44 P99.9: 9.94 P99.99: 17.63 ------------------------------------------------------ [ 0, 1 ] 75821 21.674% 21.674% #### ( 1, 2 ] 225492 64.459% 86.133% ############# ( 2, 3 ] 30066 8.595% 94.728% ## ( 3, 4 ] 10507 3.004% 97.731% # ( 4, 6 ] 6161 1.761% 99.492% ( 6, 10 ] 1449 0.414% 99.907% ( 10, 15 ] 279 0.080% 99.986% ( 15, 22 ] 40 0.011% 99.998% ( 22, 34 ] 9 0.003% 100.000% ( 34, 51 ] 1 0.000% 100.001% ( 51, 76 ] 2 0.001% 100.001% ( 76, 110 ] 1 0.000% 100.001% ( 110, 170 ] 15 0.004% 100.006% ( 170, 250 ] 10 0.003% 100.009% ( 250, 380 ] 8 0.002% 100.011% ( 380, 580 ] 2 0.001% 100.011% ( 580, 870 ] 5 0.001% 100.013% ( 870, 1300 ] 1 0.000% 100.013% ( 1300, 1900 ] 6 0.002% 100.015% ( 1900, 2900 ] 5 0.001% 100.016% ( 2900, 4400 ] 3 0.001% 100.017% ** Level 1 read latency histogram (micros): Count: 81762 Average: 2.2549 StdDev: 5.42 Min: 1 Median: 1.5524 Max: 1046 Percentiles: P50: 1.55 P75: 1.92 P99: 5.81 P99.9: 12.29 P99.99: 18.14 ------------------------------------------------------ [ 0, 1 ] 10291 12.587% 12.587% ### ( 1, 2 ] 55379 67.732% 80.318% ############## ( 2, 3 ] 10312 12.612% 92.931% ### ( 3, 4 ] 3142 3.843% 96.774% # ( 4, 6 ] 2015 2.464% 99.238% ( 6, 10 ] 484 0.592% 99.830% ( 10, 15 ] 125 0.153% 99.983% ( 15, 22 ] 13 0.016% 99.999% ( 22, 34 ] 2 0.002% 100.001% ( 51, 76 ] 1 0.001% 100.002% ( 110, 170 ] 1 0.001% 100.004% ( 170, 250 ] 1 0.001% 100.005% ( 250, 380 ] 2 0.002% 100.007% ( 380, 580 ] 1 0.001% 100.009% ( 580, 870 ] 2 0.002% 100.011% ( 870, 1300 ] 1 0.001% 100.012% ** Level 2 read latency histogram (micros): Count: 95505 Average: 2.1855 StdDev: 18.33 Min: 1 Median: 1.4215 Max: 3056 Percentiles: P50: 1.42 P75: 1.82 P99: 5.56 P99.9: 10.32 P99.99: 612.59 ------------------------------------------------------ [ 0, 1 ] 22429 23.485% 23.485% ##### ( 1, 2 ] 60081 62.909% 86.393% ############# ( 2, 3 ] 7562 7.918% 94.311% ## ( 3, 4 ] 2916 3.053% 97.365% # ( 4, 6 ] 2006 2.100% 99.465% ( 6, 10 ] 411 0.430% 99.895% ( 10, 15 ] 70 0.073% 99.969% ( 15, 22 ] 9 0.009% 99.978% ( 22, 34 ] 2 0.002% 99.980% ( 34, 51 ] 1 0.001% 99.981% ( 51, 76 ] 2 0.002% 99.983% ( 76, 110 ] 1 0.001% 99.984% ( 170, 250 ] 1 0.001% 99.985% ( 250, 380 ] 3 0.003% 99.988% ( 380, 580 ] 1 0.001% 99.990% ( 580, 870 ] 4 0.004% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 57561 Average: 3.5644 StdDev: 51.14 Min: 0 Median: 1.5503 Max: 3455 Percentiles: P50: 1.55 P75: 1.92 P99: 5.97 P99.9: 198.78 P99.99: 2503.66 ------------------------------------------------------ [ 0, 1 ] 7447 12.938% 12.938% ### ( 1, 2 ] 38766 67.348% 80.285% ############# ( 2, 3 ] 7272 12.634% 92.919% ### ( 3, 4 ] 2160 3.753% 96.671% # ( 4, 6 ] 1361 2.364% 99.036% ( 6, 10 ] 356 0.618% 99.654% ( 10, 15 ] 73 0.127% 99.781% ( 15, 22 ] 11 0.019% 99.800% ( 22, 34 ] 32 0.056% 99.856% ( 34, 51 ] 21 0.036% 99.892% ( 51, 76 ] 1 0.002% 99.894% ( 110, 170 ] 2 0.003% 99.898% ( 170, 250 ] 4 0.007% 99.904% ( 250, 380 ] 8 0.014% 99.918% ( 380, 580 ] 11 0.019% 99.937% ( 580, 870 ] 12 0.021% 99.958% ( 870, 1300 ] 2 0.003% 99.962% ( 1300, 1900 ] 9 0.016% 99.977% ( 1900, 2900 ] 12 0.021% 99.998% ( 2900, 4400 ] 4 0.007% 100.005% ** Level 4 read latency histogram (micros): Count: 20 Average: 1445.4000 StdDev: 986.57 Min: 92 Median: 1471.4286 Max: 3647 Percentiles: P50: 1471.43 P75: 1900.00 P99: 3647.00 P99.9: 3647.00 P99.99: 3647.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 170, 250 ] 1 5.000% 15.000% # ( 580, 870 ] 5 25.000% 40.000% ##### ( 1300, 1900 ] 7 35.000% 75.000% ####### ( 1900, 2900 ] 3 15.000% 90.000% ### ( 2900, 4400 ] 2 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 40 Average: 484.9750 StdDev: 629.15 Min: 44 Median: 143.3333 Max: 2282 Percentiles: P50: 143.33 P75: 676.67 P99: 2282.00 P99.9: 2282.00 P99.99: 2282.00 ------------------------------------------------------ ( 34, 51 ] 3 7.500% 7.500% ## ( 51, 76 ] 4 10.000% 17.500% ## ( 76, 110 ] 8 20.000% 37.500% #### ( 110, 170 ] 9 22.500% 60.000% ##### ( 170, 250 ] 1 2.500% 62.500% # ( 380, 580 ] 4 10.000% 72.500% ## ( 580, 870 ] 3 7.500% 80.000% ## ( 870, 1300 ] 3 7.500% 87.500% ## ( 1300, 1900 ] 2 5.000% 92.500% # ( 1900, 2900 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 6.2 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 318.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.592 H:M:S, 9.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 316.14 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.365 H:M:S, 11.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-12:43:35 ... thread 0: (1000000,3000000) ops and (311087.2,326166.9) ops/second in (3.214533,9.197745) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 1.41 GB 6.3 1.4 0.0 1.4 4.1 2.8 0.0 1.5 102.9 313.2 13.47 12.40 45 0.299 1407K 1519 0.0 0.0 L1 3/3 242.75 MB 0.0 1.1 1.1 0.0 1.1 1.1 0.2 1.0 234.9 234.2 4.84 4.71 2 2.419 1153K 3089 0.0 0.0 L2 2/2 130.47 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 249.4 249.2 1.52 1.47 2 0.758 383K 194 0.0 0.0 L3 40/20 1.38 GB 0.5 1.0 0.7 0.3 1.0 0.7 0.4 1.4 205.4 205.1 5.20 4.67 5 1.041 1018K 790 0.0 0.0 L4 140/0 9.74 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1040/0 86.00 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1233/32 98.90 GB 0.0 3.9 2.0 1.8 6.6 4.8 2.8 2.4 158.6 271.6 25.03 23.24 54 0.463 3963K 5592 0.0 0.0 Int 0/0 0.00 KB 0.0 3.9 2.0 1.8 6.6 4.8 2.3 2.4 158.6 271.6 25.03 23.24 54 0.463 3963K 5592 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.9 2.0 1.8 3.9 2.0 0.0 0.0 235.8 235.4 16.84 16.02 14 1.203 3963K 5592 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 346.0 8.19 7.23 40 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.4 total, 9.2 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.64 GB write, 722.84 MB/s write, 3.88 GB read, 422.06 MB/s read, 25.0 seconds Interval compaction: 6.64 GB write, 738.92 MB/s write, 3.88 GB read, 431.46 MB/s read, 25.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 718369 Average: 2.2257 StdDev: 12.70 Min: 0 Median: 1.5063 Max: 3265 Percentiles: P50: 1.51 P75: 1.89 P99: 5.60 P99.9: 9.90 P99.99: 14.34 ------------------------------------------------------ [ 0, 1 ] 119861 16.685% 16.685% ### ( 1, 2 ] 472667 65.797% 82.482% ############# ( 2, 3 ] 77241 10.752% 93.235% ## ( 3, 4 ] 27802 3.870% 97.105% # ( 4, 6 ] 17046 2.373% 99.478% ( 6, 10 ] 3112 0.433% 99.911% ( 10, 15 ] 655 0.091% 100.002% ( 15, 22 ] 61 0.008% 100.011% ( 22, 34 ] 13 0.002% 100.012% ( 34, 51 ] 2 0.000% 100.013% ( 51, 76 ] 4 0.001% 100.013% ( 76, 110 ] 2 0.000% 100.014% ( 110, 170 ] 19 0.003% 100.016% ( 170, 250 ] 16 0.002% 100.018% ( 250, 380 ] 16 0.002% 100.021% ( 380, 580 ] 4 0.001% 100.021% ( 580, 870 ] 12 0.002% 100.023% ( 870, 1300 ] 4 0.001% 100.023% ( 1300, 1900 ] 9 0.001% 100.025% ( 1900, 2900 ] 7 0.001% 100.026% ( 2900, 4400 ] 4 0.001% 100.026% ** Level 1 read latency histogram (micros): Count: 133016 Average: 2.4835 StdDev: 8.21 Min: 0 Median: 1.6441 Max: 1586 Percentiles: P50: 1.64 P75: 2.14 P99: 6.00 P99.9: 13.06 P99.99: 19.92 ------------------------------------------------------ [ 0, 1 ] 11944 8.979% 8.979% ## ( 1, 2 ] 84717 63.689% 72.669% ############# ( 2, 3 ] 21710 16.321% 88.990% ### ( 3, 4 ] 7285 5.477% 94.467% # ( 4, 6 ] 6029 4.533% 98.999% # ( 6, 10 ] 1040 0.782% 99.781% ( 10, 15 ] 258 0.194% 99.975% ( 15, 22 ] 28 0.021% 99.996% ( 22, 34 ] 3 0.002% 99.998% ( 51, 76 ] 2 0.002% 100.000% ( 110, 170 ] 1 0.001% 100.001% ( 170, 250 ] 1 0.001% 100.002% ( 250, 380 ] 7 0.005% 100.007% ( 380, 580 ] 3 0.002% 100.009% ( 580, 870 ] 5 0.004% 100.013% ( 870, 1300 ] 2 0.002% 100.014% ( 1300, 1900 ] 1 0.001% 100.015% ** Level 2 read latency histogram (micros): Count: 95704 Average: 2.1866 StdDev: 18.31 Min: 1 Median: 1.4224 Max: 3056 Percentiles: P50: 1.42 P75: 1.82 P99: 5.56 P99.9: 10.31 P99.99: 611.15 ------------------------------------------------------ [ 0, 1 ] 22430 23.437% 23.437% ##### ( 1, 2 ] 60180 62.881% 86.318% ############# ( 2, 3 ] 7635 7.978% 94.296% ## ( 3, 4 ] 2933 3.065% 97.361% # ( 4, 6 ] 2013 2.103% 99.464% ( 6, 10 ] 413 0.432% 99.896% ( 10, 15 ] 70 0.073% 99.969% ( 15, 22 ] 9 0.009% 99.978% ( 22, 34 ] 2 0.002% 99.980% ( 34, 51 ] 1 0.001% 99.981% ( 51, 76 ] 2 0.002% 99.983% ( 76, 110 ] 1 0.001% 99.984% ( 170, 250 ] 1 0.001% 99.985% ( 250, 380 ] 3 0.003% 99.989% ( 380, 580 ] 1 0.001% 99.990% ( 580, 870 ] 4 0.004% 99.994% ( 870, 1300 ] 2 0.002% 99.996% ( 1300, 1900 ] 1 0.001% 99.997% ( 1900, 2900 ] 1 0.001% 99.998% ( 2900, 4400 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 193613 Average: 3.5339 StdDev: 33.88 Min: 0 Median: 1.6445 Max: 3455 Percentiles: P50: 1.64 P75: 2.13 P99: 8.32 P99.9: 244.37 P99.99: 688.10 ------------------------------------------------------ [ 0, 1 ] 16108 8.320% 8.320% ## ( 1, 2 ] 125217 64.674% 72.994% ############# ( 2, 3 ] 29895 15.441% 88.434% ### ( 3, 4 ] 11526 5.953% 94.387% # ( 4, 6 ] 7615 3.933% 98.320% # ( 6, 10 ] 2272 1.173% 99.494% ( 10, 15 ] 371 0.192% 99.685% ( 15, 22 ] 54 0.028% 99.713% ( 22, 34 ] 40 0.021% 99.734% ( 34, 51 ] 22 0.011% 99.745% ( 51, 76 ] 6 0.003% 99.748% ( 76, 110 ] 70 0.036% 99.785% ( 110, 170 ] 136 0.070% 99.855% ( 170, 250 ] 94 0.049% 99.903% ( 250, 380 ] 73 0.038% 99.941% ( 380, 580 ] 76 0.039% 99.980% ( 580, 870 ] 50 0.026% 100.006% ( 870, 1300 ] 13 0.007% 100.013% ( 1300, 1900 ] 13 0.007% 100.020% ( 1900, 2900 ] 13 0.007% 100.026% ( 2900, 4400 ] 4 0.002% 100.028% ** Level 4 read latency histogram (micros): Count: 20 Average: 1445.4000 StdDev: 986.57 Min: 92 Median: 1471.4286 Max: 3647 Percentiles: P50: 1471.43 P75: 1900.00 P99: 3647.00 P99.9: 3647.00 P99.99: 3647.00 ------------------------------------------------------ ( 76, 110 ] 2 10.000% 10.000% ## ( 170, 250 ] 1 5.000% 15.000% # ( 580, 870 ] 5 25.000% 40.000% ##### ( 1300, 1900 ] 7 35.000% 75.000% ####### ( 1900, 2900 ] 3 15.000% 90.000% ### ( 2900, 4400 ] 2 10.000% 100.000% ## ** Level 5 read latency histogram (micros): Count: 40 Average: 484.9750 StdDev: 629.15 Min: 44 Median: 143.3333 Max: 2282 Percentiles: P50: 143.33 P75: 676.67 P99: 2282.00 P99.9: 2282.00 P99.99: 2282.00 ------------------------------------------------------ ( 34, 51 ] 3 7.500% 7.500% ## ( 51, 76 ] 4 10.000% 17.500% ## ( 76, 110 ] 8 20.000% 37.500% #### ( 110, 170 ] 9 22.500% 60.000% ##### ( 170, 250 ] 1 2.500% 62.500% # ( 380, 580 ] 4 10.000% 72.500% ## ( 580, 870 ] 3 7.500% 80.000% ## ( 870, 1300 ] 3 7.500% 87.500% ## ( 1300, 1900 ] 2 5.000% 92.500% # ( 1900, 2900 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 9.4 total, 3.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 313.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.056 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 306.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.464 H:M:S, 14.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/19-12:43:38 ... thread 0: (1000000,4000000) ops and (322782.0,325314.0) ops/second in (3.098066,12.295811) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.40 GB 81.8 1.9 0.0 1.9 5.7 3.8 0.0 1.5 105.2 312.0 18.57 17.14 61 0.304 1982K 2162 0.0 0.0 L1 3/3 242.75 MB 0.0 1.1 1.1 0.0 1.1 1.1 0.2 1.0 234.9 234.2 4.84 4.71 2 2.419 1153K 3089 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 249.4 249.2 1.52 1.47 2 0.758 383K 194 0.0 0.0 L3 18/0 963.51 MB 1.0 2.0 0.9 1.2 2.0 0.9 0.4 2.4 213.6 213.3 9.82 8.84 7 1.403 2064K 3315 0.0 0.0 L4 157/0 9.63 GB 1.0 0.2 0.2 0.0 0.2 0.2 1.0 1.0 202.5 202.5 1.18 1.05 1 1.181 242K 0 0.0 0.0 L5 1048/0 86.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1242/14 99.88 GB 0.0 5.7 2.4 3.3 9.4 6.1 3.9 2.5 161.6 268.3 35.92 33.21 73 0.492 5828K 8760 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 2.4 3.3 9.4 6.1 3.3 2.5 161.6 268.3 35.92 33.21 73 0.492 5828K 8760 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 2.4 3.3 5.7 2.4 0.0 0.0 233.8 233.4 24.83 23.39 19 1.307 5828K 8760 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 346.2 11.10 9.81 54 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.5 total, 12.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.41 GB write, 770.95 MB/s write, 5.67 GB read, 464.34 MB/s read, 35.9 seconds Interval compaction: 9.41 GB write, 783.78 MB/s write, 5.67 GB read, 472.07 MB/s read, 35.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1091108 Average: 2.3331 StdDev: 12.36 Min: 0 Median: 1.5563 Max: 3322 Percentiles: P50: 1.56 P75: 1.94 P99: 5.76 P99.9: 10.86 P99.99: 14.69 ------------------------------------------------------ [ 0, 1 ] 148025 13.566% 13.566% ### ( 1, 2 ] 714618 65.495% 79.061% ############# ( 2, 3 ] 139231 12.761% 91.822% ### ( 3, 4 ] 48619 4.456% 96.278% # ( 4, 6 ] 33686 3.087% 99.365% # ( 6, 10 ] 5617 0.515% 99.880% ( 10, 15 ] 1284 0.118% 99.997% ( 15, 22 ] 117 0.011% 100.008% ( 22, 34 ] 13 0.001% 100.009% ( 34, 51 ] 4 0.000% 100.010% ( 51, 76 ] 9 0.001% 100.011% ( 76, 110 ] 43 0.004% 100.014% ( 110, 170 ] 65 0.006% 100.020% ( 170, 250 ] 47 0.004% 100.025% ( 250, 380 ] 33 0.003% 100.028% ( 380, 580 ] 13 0.001% 100.029% ( 580, 870 ] 22 0.002% 100.031% ( 870, 1300 ] 10 0.001% 100.032% ( 1300, 1900 ] 9 0.001% 100.033% ( 1900, 2900 ] 9 0.001% 100.034% ( 2900, 4400 ] 6 0.001% 100.034% ** Level 1 read latency histogram (micros): Count: 161032 Average: 2.4914 StdDev: 7.47 Min: 0 Median: 1.6606 Max: 1586 Percentiles: P50: 1.66 P75: 2.20 P99: 5.99 P99.9: 12.80 P99.99: 19.56 ------------------------------------------------------ [ 0, 1 ] 13112 8.142% 8.142% ## ( 1, 2 ] 102038 63.365% 71.508% ############# ( 2, 3 ] 27609 17.145% 88.653% ### ( 3, 4 ] 9181 5.701% 94.354% # ( 4, 6 ] 7535 4.679% 99.033% # ( 6, 10 ] 1235 0.767% 99.800% ( 10, 15 ] 287 0.178% 99.978% ( 15, 22 ] 29 0.018% 99.996% ( 22, 34 ] 3 0.002% 99.998% ( 34, 51 ] 1 0.001% 99.999% ( 51, 76 ] 2 0.001% 100.000% ( 110, 170 ] 1 0.001% 100.001% ( 170, 250 ] 1 0.001% 100.001% ( 250, 380 ] 7 0.004% 100.006% ( 380, 580 ] 3 0.002% 100.007% ( 580, 870 ] 5 0.003% 100.011% ( 870, 1300 ] 2 0.001% 100.012% ( 1300, 1900 ] 1 0.001% 100.012% ** Level 2 read latency histogram (micros): Count: 140208 Average: 2.5948 StdDev: 18.71 Min: 1 Median: 1.4933 Max: 3056 Percentiles: P50: 1.49 P75: 1.89 P99: 6.53 P99.9: 147.08 P99.99: 684.91 ------------------------------------------------------ [ 0, 1 ] 26260 18.729% 18.729% #### ( 1, 2 ] 88875 63.388% 82.117% ############# ( 2, 3 ] 14105 10.060% 92.177% ## ( 3, 4 ] 5595 3.990% 96.168% # ( 4, 6 ] 3808 2.716% 98.884% # ( 6, 10 ] 1236 0.882% 99.765% ( 10, 15 ] 109 0.078% 99.843% ( 15, 22 ] 10 0.007% 99.850% ( 22, 34 ] 2 0.001% 99.852% ( 34, 51 ] 1 0.001% 99.852% ( 51, 76 ] 5 0.004% 99.856% ( 76, 110 ] 21 0.015% 99.871% ( 110, 170 ] 66 0.047% 99.918% ( 170, 250 ] 34 0.024% 99.942% ( 250, 380 ] 32 0.023% 99.965% ( 380, 580 ] 31 0.022% 99.987% ( 580, 870 ] 11 0.008% 99.995% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 325395 Average: 3.6915 StdDev: 30.90 Min: 0 Median: 1.6651 Max: 3455 Percentiles: P50: 1.67 P75: 2.21 P99: 8.65 P99.9: 319.54 P99.99: 724.88 ------------------------------------------------------ [ 0, 1 ] 23690 7.280% 7.280% # ( 1, 2 ] 208990 64.227% 71.507% ############# ( 2, 3 ] 53400 16.411% 87.918% ### ( 3, 4 ] 19429 5.971% 93.889% # ( 4, 6 ] 14006 4.304% 98.193% # ( 6, 10 ] 3957 1.216% 99.409% ( 10, 15 ] 568 0.175% 99.584% ( 15, 22 ] 87 0.027% 99.610% ( 22, 34 ] 42 0.013% 99.623% ( 34, 51 ] 24 0.007% 99.631% ( 51, 76 ] 13 0.004% 99.635% ( 76, 110 ] 201 0.062% 99.696% ( 110, 170 ] 345 0.106% 99.802% ( 170, 250 ] 224 0.069% 99.871% ( 250, 380 ] 175 0.054% 99.925% ( 380, 580 ] 165 0.051% 99.976% ( 580, 870 ] 93 0.029% 100.004% ( 870, 1300 ] 20 0.006% 100.010% ( 1300, 1900 ] 18 0.006% 100.016% ( 1900, 2900 ] 15 0.005% 100.021% ( 2900, 4400 ] 4 0.001% 100.022% ** Level 4 read latency histogram (micros): Count: 85 Average: 356.7882 StdDev: 771.45 Min: 1 Median: 5.5000 Max: 3647 Percentiles: P50: 5.50 P75: 88.75 P99: 3647.00 P99.9: 3647.00 P99.99: 3647.00 ------------------------------------------------------ [ 0, 1 ] 11 12.941% 12.941% ### ( 1, 2 ] 22 25.882% 38.824% ##### ( 2, 3 ] 8 9.412% 48.235% ## ( 4, 6 ] 2 2.353% 50.588% ( 6, 10 ] 4 4.706% 55.294% # ( 10, 15 ] 2 2.353% 57.647% ( 15, 22 ] 3 3.529% 61.176% # ( 34, 51 ] 1 1.176% 62.353% ( 51, 76 ] 10 11.765% 74.118% ## ( 76, 110 ] 2 2.353% 76.471% ( 170, 250 ] 3 3.529% 80.000% # ( 580, 870 ] 5 5.882% 85.882% # ( 1300, 1900 ] 7 8.235% 94.118% ## ( 1900, 2900 ] 3 3.529% 97.647% # ( 2900, 4400 ] 2 2.353% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 737.6375 StdDev: 1079.56 Min: 44 Median: 220.0000 Max: 5009 Percentiles: P50: 220.00 P75: 870.00 P99: 5009.00 P99.9: 5009.00 P99.99: 5009.00 ------------------------------------------------------ ( 34, 51 ] 3 3.750% 3.750% # ( 51, 76 ] 4 5.000% 8.750% # ( 76, 110 ] 11 13.750% 22.500% ### ( 110, 170 ] 17 21.250% 43.750% #### ( 170, 250 ] 8 10.000% 53.750% ## ( 250, 380 ] 3 3.750% 57.500% # ( 380, 580 ] 7 8.750% 66.250% ## ( 580, 870 ] 7 8.750% 75.000% ## ( 870, 1300 ] 5 6.250% 81.250% # ( 1300, 1900 ] 6 7.500% 88.750% ## ( 1900, 2900 ] 4 5.000% 93.750% # ( 2900, 4400 ] 3 3.750% 97.500% # ( 4400, 6600 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 12.5 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 314.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.441 H:M:S, 11.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.385 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-12:43:42 ... thread 0: (1000000,5000000) ops and (273413.0,313415.1) ops/second in (3.657471,15.953282) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.38 GB 182.5 3.0 0.0 3.0 7.7 4.7 0.0 1.6 120.1 308.8 25.69 23.90 79 0.325 3134K 3357 0.0 0.0 L1 3/3 242.75 MB 0.0 1.1 1.1 0.0 1.1 1.1 0.2 1.0 234.9 234.2 4.84 4.71 2 2.419 1153K 3089 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 249.4 249.2 1.52 1.47 2 0.758 383K 194 0.0 0.0 L3 18/0 963.51 MB 1.0 2.0 0.9 1.2 2.0 0.9 0.4 2.4 213.6 213.3 9.82 8.84 7 1.403 2064K 3315 0.0 0.0 L4 157/0 9.63 GB 1.0 0.2 0.2 0.0 0.2 0.2 1.0 1.0 202.5 202.5 1.18 1.05 1 1.181 242K 0 0.0 0.0 L5 1048/0 86.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/14 100.86 GB 0.0 6.8 2.4 4.4 11.5 7.1 3.9 2.4 161.2 273.6 43.05 39.97 91 0.473 6979K 9955 0.0 0.0 Int 0/0 0.00 KB 0.0 6.8 2.4 4.4 11.5 7.1 3.3 2.4 161.2 273.6 43.05 39.97 91 0.473 6979K 9955 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.8 2.4 4.4 6.8 2.4 0.0 0.0 238.6 238.2 29.09 27.57 23 1.265 6979K 9955 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 347.3 13.97 12.40 68 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.2 total, 16.0 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.50 GB write, 728.92 MB/s write, 6.78 GB read, 429.41 MB/s read, 43.1 seconds Interval compaction: 11.50 GB write, 738.27 MB/s write, 6.78 GB read, 434.92 MB/s read, 43.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 16, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1499925 Average: 2.3124 StdDev: 11.53 Min: 0 Median: 1.5422 Max: 3322 Percentiles: P50: 1.54 P75: 1.92 P99: 5.75 P99.9: 10.42 P99.99: 14.94 ------------------------------------------------------ [ 0, 1 ] 212781 14.186% 14.186% ### ( 1, 2 ] 990740 66.053% 80.239% ############# ( 2, 3 ] 182854 12.191% 92.430% ## ( 3, 4 ] 61913 4.128% 96.557% # ( 4, 6 ] 41794 2.786% 99.344% # ( 6, 10 ] 8219 0.548% 99.892% ( 10, 15 ] 1492 0.099% 99.991% ( 15, 22 ] 132 0.009% 100.000% ( 22, 34 ] 16 0.001% 100.001% ( 34, 51 ] 7 0.000% 100.002% ( 51, 76 ] 12 0.001% 100.002% ( 76, 110 ] 105 0.007% 100.009% ( 110, 170 ] 113 0.008% 100.017% ( 170, 250 ] 83 0.006% 100.022% ( 250, 380 ] 56 0.004% 100.026% ( 380, 580 ] 33 0.002% 100.028% ( 580, 870 ] 34 0.002% 100.031% ( 870, 1300 ] 17 0.001% 100.032% ( 1300, 1900 ] 12 0.001% 100.033% ( 1900, 2900 ] 9 0.001% 100.033% ( 2900, 4400 ] 6 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 217539 Average: 2.5441 StdDev: 8.91 Min: 0 Median: 1.6338 Max: 1586 Percentiles: P50: 1.63 P75: 2.08 P99: 6.68 P99.9: 14.18 P99.99: 272.21 ------------------------------------------------------ [ 0, 1 ] 19615 9.017% 9.017% ## ( 1, 2 ] 140658 64.659% 73.676% ############# ( 2, 3 ] 34728 15.964% 89.640% ### ( 3, 4 ] 11027 5.069% 94.709% # ( 4, 6 ] 8993 4.134% 98.843% # ( 6, 10 ] 2033 0.935% 99.777% ( 10, 15 ] 321 0.148% 99.925% ( 15, 22 ] 32 0.015% 99.939% ( 22, 34 ] 3 0.001% 99.941% ( 34, 51 ] 1 0.000% 99.941% ( 51, 76 ] 5 0.002% 99.943% ( 76, 110 ] 43 0.020% 99.963% ( 110, 170 ] 34 0.016% 99.979% ( 170, 250 ] 22 0.010% 99.989% ( 250, 380 ] 19 0.009% 99.998% ( 380, 580 ] 14 0.006% 100.004% ( 580, 870 ] 7 0.003% 100.007% ( 870, 1300 ] 4 0.002% 100.009% ( 1300, 1900 ] 1 0.000% 100.010% ** Level 2 read latency histogram (micros): Count: 140208 Average: 2.5948 StdDev: 18.71 Min: 1 Median: 1.4933 Max: 3056 Percentiles: P50: 1.49 P75: 1.89 P99: 6.53 P99.9: 147.08 P99.99: 684.91 ------------------------------------------------------ [ 0, 1 ] 26260 18.729% 18.729% #### ( 1, 2 ] 88875 63.388% 82.117% ############# ( 2, 3 ] 14105 10.060% 92.177% ## ( 3, 4 ] 5595 3.990% 96.168% # ( 4, 6 ] 3808 2.716% 98.884% # ( 6, 10 ] 1236 0.882% 99.765% ( 10, 15 ] 109 0.078% 99.843% ( 15, 22 ] 10 0.007% 99.850% ( 22, 34 ] 2 0.001% 99.852% ( 34, 51 ] 1 0.001% 99.852% ( 51, 76 ] 5 0.004% 99.856% ( 76, 110 ] 21 0.015% 99.871% ( 110, 170 ] 66 0.047% 99.918% ( 170, 250 ] 34 0.024% 99.942% ( 250, 380 ] 32 0.023% 99.965% ( 380, 580 ] 31 0.022% 99.987% ( 580, 870 ] 11 0.008% 99.995% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 325395 Average: 3.6915 StdDev: 30.90 Min: 0 Median: 1.6651 Max: 3455 Percentiles: P50: 1.67 P75: 2.21 P99: 8.65 P99.9: 319.54 P99.99: 724.88 ------------------------------------------------------ [ 0, 1 ] 23690 7.280% 7.280% # ( 1, 2 ] 208990 64.227% 71.507% ############# ( 2, 3 ] 53400 16.411% 87.918% ### ( 3, 4 ] 19429 5.971% 93.889% # ( 4, 6 ] 14006 4.304% 98.193% # ( 6, 10 ] 3957 1.216% 99.409% ( 10, 15 ] 568 0.175% 99.584% ( 15, 22 ] 87 0.027% 99.610% ( 22, 34 ] 42 0.013% 99.623% ( 34, 51 ] 24 0.007% 99.631% ( 51, 76 ] 13 0.004% 99.635% ( 76, 110 ] 201 0.062% 99.696% ( 110, 170 ] 345 0.106% 99.802% ( 170, 250 ] 224 0.069% 99.871% ( 250, 380 ] 175 0.054% 99.925% ( 380, 580 ] 165 0.051% 99.976% ( 580, 870 ] 93 0.029% 100.004% ( 870, 1300 ] 20 0.006% 100.010% ( 1300, 1900 ] 18 0.006% 100.016% ( 1900, 2900 ] 15 0.005% 100.021% ( 2900, 4400 ] 4 0.001% 100.022% ** Level 4 read latency histogram (micros): Count: 85 Average: 356.7882 StdDev: 771.45 Min: 1 Median: 5.5000 Max: 3647 Percentiles: P50: 5.50 P75: 88.75 P99: 3647.00 P99.9: 3647.00 P99.99: 3647.00 ------------------------------------------------------ [ 0, 1 ] 11 12.941% 12.941% ### ( 1, 2 ] 22 25.882% 38.824% ##### ( 2, 3 ] 8 9.412% 48.235% ## ( 4, 6 ] 2 2.353% 50.588% ( 6, 10 ] 4 4.706% 55.294% # ( 10, 15 ] 2 2.353% 57.647% ( 15, 22 ] 3 3.529% 61.176% # ( 34, 51 ] 1 1.176% 62.353% ( 51, 76 ] 10 11.765% 74.118% ## ( 76, 110 ] 2 2.353% 76.471% ( 170, 250 ] 3 3.529% 80.000% # ( 580, 870 ] 5 5.882% 85.882% # ( 1300, 1900 ] 7 8.235% 94.118% ## ( 1900, 2900 ] 3 3.529% 97.647% # ( 2900, 4400 ] 2 2.353% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 737.6375 StdDev: 1079.56 Min: 44 Median: 220.0000 Max: 5009 Percentiles: P50: 220.00 P75: 870.00 P99: 5009.00 P99.9: 5009.00 P99.99: 5009.00 ------------------------------------------------------ ( 34, 51 ] 3 3.750% 3.750% # ( 51, 76 ] 4 5.000% 8.750% # ( 76, 110 ] 11 13.750% 22.500% ### ( 110, 170 ] 17 21.250% 43.750% #### ( 170, 250 ] 8 10.000% 53.750% ## ( 250, 380 ] 3 3.750% 57.500% # ( 380, 580 ] 7 8.750% 66.250% ## ( 580, 870 ] 7 8.750% 75.000% ## ( 870, 1300 ] 5 6.250% 81.250% # ( 1300, 1900 ] 6 7.500% 88.750% ## ( 1900, 2900 ] 4 5.000% 93.750% # ( 2900, 4400 ] 3 3.750% 97.500% # ( 4400, 6600 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 16.2 total, 3.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 304.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.438 H:M:S, 15.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 269.09 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.997 H:M:S, 27.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-12:43:45 ... thread 0: (1000000,6000000) ops and (354168.9,319543.4) ops/second in (2.823512,18.776794) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/15 2.89 GB 44.1 3.5 0.0 3.5 9.1 5.6 0.0 1.6 119.7 310.6 30.01 27.93 94 0.319 3645K 3815 0.0 0.0 L1 14/14 1.58 GB 0.0 2.7 2.5 0.2 2.7 2.4 0.2 1.1 228.4 227.2 12.10 11.69 3 4.033 2806K 14K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 249.4 249.2 1.52 1.47 2 0.758 383K 194 0.0 0.0 L3 18/0 963.51 MB 1.0 2.0 0.9 1.2 2.0 0.9 0.4 2.4 213.6 213.3 9.82 8.84 7 1.403 2064K 3315 0.0 0.0 L4 157/0 9.63 GB 1.0 0.2 0.2 0.0 0.2 0.2 1.0 1.0 202.5 202.5 1.18 1.05 1 1.181 242K 0 0.0 0.0 L5 1048/0 86.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1255/29 101.71 GB 0.0 8.9 3.7 5.1 14.4 9.3 3.9 2.6 166.0 270.6 54.63 50.99 107 0.511 9143K 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.9 3.7 5.1 14.4 9.3 3.3 2.6 166.0 270.6 54.63 50.99 107 0.511 9143K 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.9 3.7 5.1 8.8 3.7 0.0 0.0 237.2 236.6 38.23 36.42 26 1.471 9143K 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 349.7 16.39 14.57 81 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.0 total, 18.8 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.43 GB write, 778.59 MB/s write, 8.86 GB read, 477.82 MB/s read, 54.6 seconds Interval compaction: 14.43 GB write, 787.08 MB/s write, 8.86 GB read, 483.03 MB/s read, 54.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 17, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1716412 Average: 2.3053 StdDev: 11.77 Min: 0 Median: 1.5280 Max: 3322 Percentiles: P50: 1.53 P75: 1.91 P99: 5.72 P99.9: 10.85 P99.99: 80.77 ------------------------------------------------------ [ 0, 1 ] 259277 15.106% 15.106% ### ( 1, 2 ] 1134429 66.093% 81.199% ############# ( 2, 3 ] 200257 11.667% 92.866% ## ( 3, 4 ] 67290 3.920% 96.786% # ( 4, 6 ] 44063 2.567% 99.354% # ( 6, 10 ] 9106 0.531% 99.884% ( 10, 15 ] 1612 0.094% 99.978% ( 15, 22 ] 146 0.009% 99.986% ( 22, 34 ] 16 0.001% 99.987% ( 34, 51 ] 8 0.000% 99.988% ( 51, 76 ] 16 0.001% 99.989% ( 76, 110 ] 145 0.008% 99.997% ( 110, 170 ] 220 0.013% 100.010% ( 170, 250 ] 117 0.007% 100.017% ( 250, 380 ] 84 0.005% 100.022% ( 380, 580 ] 44 0.003% 100.024% ( 580, 870 ] 46 0.003% 100.027% ( 870, 1300 ] 22 0.001% 100.028% ( 1300, 1900 ] 14 0.001% 100.029% ( 1900, 2900 ] 10 0.001% 100.030% ( 2900, 4400 ] 7 0.000% 100.030% ** Level 1 read latency histogram (micros): Count: 269587 Average: 2.7012 StdDev: 16.46 Min: 0 Median: 1.5986 Max: 4309 Percentiles: P50: 1.60 P75: 1.98 P99: 7.12 P99.9: 105.52 P99.99: 520.21 ------------------------------------------------------ [ 0, 1 ] 30165 11.189% 11.189% ## ( 1, 2 ] 174776 64.831% 76.020% ############# ( 2, 3 ] 39159 14.526% 90.546% ### ( 3, 4 ] 12258 4.547% 95.093% # ( 4, 6 ] 9782 3.629% 98.721% # ( 6, 10 ] 2675 0.992% 99.714% ( 10, 15 ] 377 0.140% 99.853% ( 15, 22 ] 37 0.014% 99.867% ( 22, 34 ] 3 0.001% 99.868% ( 34, 51 ] 3 0.001% 99.869% ( 51, 76 ] 6 0.002% 99.872% ( 76, 110 ] 88 0.033% 99.904% ( 110, 170 ] 99 0.037% 99.941% ( 170, 250 ] 56 0.021% 99.962% ( 250, 380 ] 48 0.018% 99.980% ( 380, 580 ] 40 0.015% 99.994% ( 580, 870 ] 19 0.007% 100.001% ( 870, 1300 ] 9 0.003% 100.005% ( 1300, 1900 ] 5 0.002% 100.007% ( 1900, 2900 ] 1 0.000% 100.007% ( 2900, 4400 ] 1 0.000% 100.007% ** Level 2 read latency histogram (micros): Count: 140208 Average: 2.5948 StdDev: 18.71 Min: 1 Median: 1.4933 Max: 3056 Percentiles: P50: 1.49 P75: 1.89 P99: 6.53 P99.9: 147.08 P99.99: 684.91 ------------------------------------------------------ [ 0, 1 ] 26260 18.729% 18.729% #### ( 1, 2 ] 88875 63.388% 82.117% ############# ( 2, 3 ] 14105 10.060% 92.177% ## ( 3, 4 ] 5595 3.990% 96.168% # ( 4, 6 ] 3808 2.716% 98.884% # ( 6, 10 ] 1236 0.882% 99.765% ( 10, 15 ] 109 0.078% 99.843% ( 15, 22 ] 10 0.007% 99.850% ( 22, 34 ] 2 0.001% 99.852% ( 34, 51 ] 1 0.001% 99.852% ( 51, 76 ] 5 0.004% 99.856% ( 76, 110 ] 21 0.015% 99.871% ( 110, 170 ] 66 0.047% 99.918% ( 170, 250 ] 34 0.024% 99.942% ( 250, 380 ] 32 0.023% 99.965% ( 380, 580 ] 31 0.022% 99.987% ( 580, 870 ] 11 0.008% 99.995% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 325395 Average: 3.6915 StdDev: 30.90 Min: 0 Median: 1.6651 Max: 3455 Percentiles: P50: 1.67 P75: 2.21 P99: 8.65 P99.9: 319.54 P99.99: 724.88 ------------------------------------------------------ [ 0, 1 ] 23690 7.280% 7.280% # ( 1, 2 ] 208990 64.227% 71.507% ############# ( 2, 3 ] 53400 16.411% 87.918% ### ( 3, 4 ] 19429 5.971% 93.889% # ( 4, 6 ] 14006 4.304% 98.193% # ( 6, 10 ] 3957 1.216% 99.409% ( 10, 15 ] 568 0.175% 99.584% ( 15, 22 ] 87 0.027% 99.610% ( 22, 34 ] 42 0.013% 99.623% ( 34, 51 ] 24 0.007% 99.631% ( 51, 76 ] 13 0.004% 99.635% ( 76, 110 ] 201 0.062% 99.696% ( 110, 170 ] 345 0.106% 99.802% ( 170, 250 ] 224 0.069% 99.871% ( 250, 380 ] 175 0.054% 99.925% ( 380, 580 ] 165 0.051% 99.976% ( 580, 870 ] 93 0.029% 100.004% ( 870, 1300 ] 20 0.006% 100.010% ( 1300, 1900 ] 18 0.006% 100.016% ( 1900, 2900 ] 15 0.005% 100.021% ( 2900, 4400 ] 4 0.001% 100.022% ** Level 4 read latency histogram (micros): Count: 85 Average: 356.7882 StdDev: 771.45 Min: 1 Median: 5.5000 Max: 3647 Percentiles: P50: 5.50 P75: 88.75 P99: 3647.00 P99.9: 3647.00 P99.99: 3647.00 ------------------------------------------------------ [ 0, 1 ] 11 12.941% 12.941% ### ( 1, 2 ] 22 25.882% 38.824% ##### ( 2, 3 ] 8 9.412% 48.235% ## ( 4, 6 ] 2 2.353% 50.588% ( 6, 10 ] 4 4.706% 55.294% # ( 10, 15 ] 2 2.353% 57.647% ( 15, 22 ] 3 3.529% 61.176% # ( 34, 51 ] 1 1.176% 62.353% ( 51, 76 ] 10 11.765% 74.118% ## ( 76, 110 ] 2 2.353% 76.471% ( 170, 250 ] 3 3.529% 80.000% # ( 580, 870 ] 5 5.882% 85.882% # ( 1300, 1900 ] 7 8.235% 94.118% ## ( 1900, 2900 ] 3 3.529% 97.647% # ( 2900, 4400 ] 2 2.353% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 737.6375 StdDev: 1079.56 Min: 44 Median: 220.0000 Max: 5009 Percentiles: P50: 220.00 P75: 870.00 P99: 5009.00 P99.9: 5009.00 P99.99: 5009.00 ------------------------------------------------------ ( 34, 51 ] 3 3.750% 3.750% # ( 51, 76 ] 4 5.000% 8.750% # ( 76, 110 ] 11 13.750% 22.500% ### ( 110, 170 ] 17 21.250% 43.750% #### ( 170, 250 ] 8 10.000% 53.750% ## ( 250, 380 ] 3 3.750% 57.500% # ( 380, 580 ] 7 8.750% 66.250% ## ( 580, 870 ] 7 8.750% 75.000% ## ( 870, 1300 ] 5 6.250% 81.250% # ( 1300, 1900 ] 6 7.500% 88.750% ## ( 1900, 2900 ] 4 5.000% 93.750% # ( 2900, 4400 ] 3 3.750% 97.500% # ( 4400, 6600 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 19.0 total, 2.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 311.07 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.637 H:M:S, 13.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 348.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.199 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-12:43:51 ... thread 0: (1000000,7000000) ops and (156889.4,278322.2) ops/second in (6.373916,25.150710) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/17 3.93 GB 31.5 4.8 0.0 4.8 11.4 6.6 0.0 1.7 129.2 308.0 38.02 35.54 115 0.331 4989K 5177 0.0 0.0 L1 14/14 1.58 GB 0.0 2.7 2.5 0.2 2.7 2.4 0.2 1.1 228.4 227.2 12.10 11.69 3 4.033 2806K 14K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 249.4 249.2 1.52 1.47 2 0.758 383K 194 0.0 0.0 L3 18/0 963.51 MB 1.0 2.0 0.9 1.2 2.0 0.9 0.4 2.4 213.6 213.3 9.82 8.84 7 1.403 2064K 3315 0.0 0.0 L4 157/0 9.63 GB 1.0 0.2 0.2 0.0 0.2 0.2 1.0 1.0 202.5 202.5 1.18 1.05 1 1.181 242K 0 0.0 0.0 L5 1048/0 86.68 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/31 102.76 GB 0.0 10.1 3.7 6.4 16.8 10.4 3.9 2.5 165.9 274.1 62.64 58.59 128 0.489 10M 23K 0.0 0.0 Int 0/0 0.00 KB 0.0 10.1 3.7 6.4 16.8 10.4 3.3 2.5 165.9 274.1 62.64 58.59 128 0.489 10M 23K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 10.1 3.7 6.4 10.1 3.7 0.0 0.0 240.7 240.2 43.18 41.28 31 1.393 10M 23K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 349.5 19.47 17.31 97 0.201 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.4 total, 25.2 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.77 GB write, 677.24 MB/s write, 10.15 GB read, 409.88 MB/s read, 62.6 seconds Interval compaction: 16.77 GB write, 682.75 MB/s write, 10.15 GB read, 413.22 MB/s read, 62.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 13, total-stops: 18, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2276649 Average: 2.2860 StdDev: 11.70 Min: 0 Median: 1.5104 Max: 3838 Percentiles: P50: 1.51 P75: 1.89 P99: 5.69 P99.9: 11.37 P99.99: 118.60 ------------------------------------------------------ [ 0, 1 ] 364365 16.004% 16.004% ### ( 1, 2 ] 1516437 66.608% 82.613% ############# ( 2, 3 ] 246750 10.838% 93.451% ## ( 3, 4 ] 82783 3.636% 97.087% # ( 4, 6 ] 51506 2.262% 99.350% ( 6, 10 ] 11980 0.526% 99.876% ( 10, 15 ] 2015 0.089% 99.964% ( 15, 22 ] 190 0.008% 99.973% ( 22, 34 ] 23 0.001% 99.974% ( 34, 51 ] 9 0.000% 99.974% ( 51, 76 ] 21 0.001% 99.975% ( 76, 110 ] 292 0.013% 99.988% ( 110, 170 ] 358 0.016% 100.004% ( 170, 250 ] 171 0.008% 100.011% ( 250, 380 ] 132 0.006% 100.017% ( 380, 580 ] 76 0.003% 100.020% ( 580, 870 ] 72 0.003% 100.023% ( 870, 1300 ] 29 0.001% 100.025% ( 1300, 1900 ] 17 0.001% 100.025% ( 1900, 2900 ] 11 0.000% 100.026% ( 2900, 4400 ] 9 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 408691 Average: 2.6231 StdDev: 14.68 Min: 0 Median: 1.5540 Max: 4309 Percentiles: P50: 1.55 P75: 1.93 P99: 7.29 P99.9: 126.85 P99.99: 520.52 ------------------------------------------------------ [ 0, 1 ] 55280 13.526% 13.526% ### ( 1, 2 ] 269093 65.843% 79.369% ############# ( 2, 3 ] 50869 12.447% 91.816% ## ( 3, 4 ] 15810 3.868% 95.684% # ( 4, 6 ] 12195 2.984% 98.668% # ( 6, 10 ] 4219 1.032% 99.700% ( 10, 15 ] 497 0.122% 99.822% ( 15, 22 ] 50 0.012% 99.834% ( 22, 34 ] 3 0.001% 99.835% ( 34, 51 ] 3 0.001% 99.836% ( 51, 76 ] 13 0.003% 99.839% ( 76, 110 ] 186 0.046% 99.884% ( 110, 170 ] 229 0.056% 99.940% ( 170, 250 ] 97 0.024% 99.964% ( 250, 380 ] 71 0.017% 99.981% ( 380, 580 ] 50 0.012% 99.994% ( 580, 870 ] 29 0.007% 100.001% ( 870, 1300 ] 10 0.002% 100.003% ( 1300, 1900 ] 5 0.001% 100.004% ( 1900, 2900 ] 1 0.000% 100.005% ( 2900, 4400 ] 1 0.000% 100.005% ** Level 2 read latency histogram (micros): Count: 140208 Average: 2.5948 StdDev: 18.71 Min: 1 Median: 1.4933 Max: 3056 Percentiles: P50: 1.49 P75: 1.89 P99: 6.53 P99.9: 147.08 P99.99: 684.91 ------------------------------------------------------ [ 0, 1 ] 26260 18.729% 18.729% #### ( 1, 2 ] 88875 63.388% 82.117% ############# ( 2, 3 ] 14105 10.060% 92.177% ## ( 3, 4 ] 5595 3.990% 96.168% # ( 4, 6 ] 3808 2.716% 98.884% # ( 6, 10 ] 1236 0.882% 99.765% ( 10, 15 ] 109 0.078% 99.843% ( 15, 22 ] 10 0.007% 99.850% ( 22, 34 ] 2 0.001% 99.852% ( 34, 51 ] 1 0.001% 99.852% ( 51, 76 ] 5 0.004% 99.856% ( 76, 110 ] 21 0.015% 99.871% ( 110, 170 ] 66 0.047% 99.918% ( 170, 250 ] 34 0.024% 99.942% ( 250, 380 ] 32 0.023% 99.965% ( 380, 580 ] 31 0.022% 99.987% ( 580, 870 ] 11 0.008% 99.995% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 325395 Average: 3.6915 StdDev: 30.90 Min: 0 Median: 1.6651 Max: 3455 Percentiles: P50: 1.67 P75: 2.21 P99: 8.65 P99.9: 319.54 P99.99: 724.88 ------------------------------------------------------ [ 0, 1 ] 23690 7.280% 7.280% # ( 1, 2 ] 208990 64.227% 71.507% ############# ( 2, 3 ] 53400 16.411% 87.918% ### ( 3, 4 ] 19429 5.971% 93.889% # ( 4, 6 ] 14006 4.304% 98.193% # ( 6, 10 ] 3957 1.216% 99.409% ( 10, 15 ] 568 0.175% 99.584% ( 15, 22 ] 87 0.027% 99.610% ( 22, 34 ] 42 0.013% 99.623% ( 34, 51 ] 24 0.007% 99.631% ( 51, 76 ] 13 0.004% 99.635% ( 76, 110 ] 201 0.062% 99.696% ( 110, 170 ] 345 0.106% 99.802% ( 170, 250 ] 224 0.069% 99.871% ( 250, 380 ] 175 0.054% 99.925% ( 380, 580 ] 165 0.051% 99.976% ( 580, 870 ] 93 0.029% 100.004% ( 870, 1300 ] 20 0.006% 100.010% ( 1300, 1900 ] 18 0.006% 100.016% ( 1900, 2900 ] 15 0.005% 100.021% ( 2900, 4400 ] 4 0.001% 100.022% ** Level 4 read latency histogram (micros): Count: 85 Average: 356.7882 StdDev: 771.45 Min: 1 Median: 5.5000 Max: 3647 Percentiles: P50: 5.50 P75: 88.75 P99: 3647.00 P99.9: 3647.00 P99.99: 3647.00 ------------------------------------------------------ [ 0, 1 ] 11 12.941% 12.941% ### ( 1, 2 ] 22 25.882% 38.824% ##### ( 2, 3 ] 8 9.412% 48.235% ## ( 4, 6 ] 2 2.353% 50.588% ( 6, 10 ] 4 4.706% 55.294% # ( 10, 15 ] 2 2.353% 57.647% ( 15, 22 ] 3 3.529% 61.176% # ( 34, 51 ] 1 1.176% 62.353% ( 51, 76 ] 10 11.765% 74.118% ## ( 76, 110 ] 2 2.353% 76.471% ( 170, 250 ] 3 3.529% 80.000% # ( 580, 870 ] 5 5.882% 85.882% # ( 1300, 1900 ] 7 8.235% 94.118% ## ( 1900, 2900 ] 3 3.529% 97.647% # ( 2900, 4400 ] 2 2.353% 100.000% ** Level 5 read latency histogram (micros): Count: 80 Average: 737.6375 StdDev: 1079.56 Min: 44 Median: 220.0000 Max: 5009 Percentiles: P50: 220.00 P75: 870.00 P99: 5009.00 P99.9: 5009.00 P99.99: 5009.00 ------------------------------------------------------ ( 34, 51 ] 3 3.750% 3.750% # ( 51, 76 ] 4 5.000% 8.750% # ( 76, 110 ] 11 13.750% 22.500% ### ( 110, 170 ] 17 21.250% 43.750% #### ( 170, 250 ] 8 10.000% 53.750% ## ( 250, 380 ] 3 3.750% 57.500% # ( 380, 580 ] 7 8.750% 66.250% ## ( 580, 870 ] 7 8.750% 75.000% ## ( 870, 1300 ] 5 6.250% 81.250% # ( 1300, 1900 ] 6 7.500% 88.750% ## ( 1900, 2900 ] 4 5.000% 93.750% # ( 2900, 4400 ] 3 3.750% 97.500% # ( 4400, 6600 ] 2 2.500% 100.000% # ** DB Stats ** Uptime(secs): 25.4 total, 6.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 271.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.325 H:M:S, 24.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 154.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.688 H:M:S, 57.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-12:44:06 ... thread 0: (1000000,8000000) ops and (68755.0,201536.2) ops/second in (14.544387,39.695097) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 2.63 GB 12.6 6.7 0.0 6.7 14.3 7.6 0.0 1.9 140.9 299.6 48.73 45.20 132 0.369 6970K 14K 0.0 0.0 L1 18/18 1.78 GB 0.0 6.5 4.7 1.8 6.4 4.6 0.2 1.4 224.7 222.1 29.57 28.09 4 7.394 6747K 75K 0.0 0.0 L2 1/0 96.76 MB 1.0 0.4 0.2 0.2 0.4 0.2 2.9 2.0 249.4 249.2 1.52 1.47 2 0.758 383K 194 0.0 0.0 L3 22/0 996.81 MB 1.0 4.6 2.7 1.9 4.6 2.7 0.4 1.7 211.8 211.0 22.33 20.42 13 1.718 4737K 18K 0.0 0.0 L4 167/0 9.70 GB 1.0 1.8 1.6 0.1 1.8 1.6 1.4 1.1 153.7 153.2 11.80 8.29 18 0.655 1821K 5761 0.0 0.0 L5 1068/0 88.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1287/27 103.59 GB 0.0 20.0 9.2 10.8 27.4 16.7 7.9 3.6 179.3 246.3 113.95 103.46 169 0.674 20M 114K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.0 9.2 10.8 27.4 16.7 7.4 3.6 179.3 246.3 113.95 103.46 169 0.674 20M 114K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.0 9.2 10.8 19.8 9.1 0.0 0.0 223.4 222.1 91.46 83.71 58 1.577 20M 114K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 344.5 22.49 19.74 111 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.9 total, 39.7 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.41 GB write, 703.36 MB/s write, 19.95 GB read, 512.08 MB/s read, 114.0 seconds Interval compaction: 27.41 GB write, 706.99 MB/s write, 19.95 GB read, 514.72 MB/s read, 114.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 17, pending-compaction-bytes-stops: 0, total-delays: 34, total-stops: 23, interval: 57 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3329229 Average: 2.6378 StdDev: 22.18 Min: 0 Median: 1.5212 Max: 9367 Percentiles: P50: 1.52 P75: 1.90 P99: 6.23 P99.9: 121.54 P99.99: 293.97 ------------------------------------------------------ [ 0, 1 ] 522562 15.696% 15.696% ### ( 1, 2 ] 2191037 65.812% 81.508% ############# ( 2, 3 ] 367585 11.041% 92.549% ## ( 3, 4 ] 126303 3.794% 96.343% # ( 4, 6 ] 87068 2.615% 98.958% # ( 6, 10 ] 24308 0.730% 99.689% ( 10, 15 ] 3313 0.100% 99.788% ( 15, 22 ] 548 0.016% 99.805% ( 22, 34 ] 36 0.001% 99.806% ( 34, 51 ] 14 0.000% 99.806% ( 51, 76 ] 62 0.002% 99.808% ( 76, 110 ] 2556 0.077% 99.885% ( 110, 170 ] 2650 0.080% 99.964% ( 170, 250 ] 689 0.021% 99.985% ( 250, 380 ] 494 0.015% 100.000% ( 380, 580 ] 370 0.011% 100.011% ( 580, 870 ] 198 0.006% 100.017% ( 870, 1300 ] 57 0.002% 100.019% ( 1300, 1900 ] 33 0.001% 100.020% ( 1900, 2900 ] 31 0.001% 100.021% ( 2900, 4400 ] 26 0.001% 100.021% ( 4400, 6600 ] 8 0.000% 100.022% ( 6600, 9900 ] 8 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 1177876 Average: 3.1246 StdDev: 24.84 Min: 0 Median: 1.6668 Max: 9724 Percentiles: P50: 1.67 P75: 2.29 P99: 8.43 P99.9: 103.77 P99.99: 218.83 ------------------------------------------------------ [ 0, 1 ] 108002 9.169% 9.169% ## ( 1, 2 ] 721285 61.236% 70.405% ############ ( 2, 3 ] 186694 15.850% 86.255% ### ( 3, 4 ] 73949 6.278% 92.534% # ( 4, 6 ] 64622 5.486% 98.020% # ( 6, 10 ] 18974 1.611% 99.631% ( 10, 15 ] 2064 0.175% 99.806% ( 15, 22 ] 372 0.032% 99.838% ( 22, 34 ] 15 0.001% 99.839% ( 34, 51 ] 3 0.000% 99.839% ( 51, 76 ] 77 0.007% 99.846% ( 76, 110 ] 785 0.067% 99.912% ( 110, 170 ] 680 0.058% 99.970% ( 170, 250 ] 387 0.033% 100.003% ( 250, 380 ] 346 0.029% 100.032% ( 380, 580 ] 251 0.021% 100.053% ( 580, 870 ] 138 0.012% 100.065% ( 870, 1300 ] 64 0.005% 100.071% ( 1300, 1900 ] 19 0.002% 100.072% ( 1900, 2900 ] 9 0.001% 100.073% ( 2900, 4400 ] 10 0.001% 100.074% ( 4400, 6600 ] 1 0.000% 100.074% ( 6600, 9900 ] 3 0.000% 100.074% ** Level 2 read latency histogram (micros): Count: 140208 Average: 2.5948 StdDev: 18.71 Min: 1 Median: 1.4933 Max: 3056 Percentiles: P50: 1.49 P75: 1.89 P99: 6.53 P99.9: 147.08 P99.99: 684.91 ------------------------------------------------------ [ 0, 1 ] 26260 18.729% 18.729% #### ( 1, 2 ] 88875 63.388% 82.117% ############# ( 2, 3 ] 14105 10.060% 92.177% ## ( 3, 4 ] 5595 3.990% 96.168% # ( 4, 6 ] 3808 2.716% 98.884% # ( 6, 10 ] 1236 0.882% 99.765% ( 10, 15 ] 109 0.078% 99.843% ( 15, 22 ] 10 0.007% 99.850% ( 22, 34 ] 2 0.001% 99.852% ( 34, 51 ] 1 0.001% 99.852% ( 51, 76 ] 5 0.004% 99.856% ( 76, 110 ] 21 0.015% 99.871% ( 110, 170 ] 66 0.047% 99.918% ( 170, 250 ] 34 0.024% 99.942% ( 250, 380 ] 32 0.023% 99.965% ( 380, 580 ] 31 0.022% 99.987% ( 580, 870 ] 11 0.008% 99.995% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 843727 Average: 4.2978 StdDev: 54.05 Min: 0 Median: 1.8316 Max: 11312 Percentiles: P50: 1.83 P75: 2.73 P99: 8.37 P99.9: 100.68 P99.99: 207.89 ------------------------------------------------------ [ 0, 1 ] 30031 3.559% 3.559% # ( 1, 2 ] 471174 55.844% 59.404% ########### ( 2, 3 ] 179071 21.224% 80.628% #### ( 3, 4 ] 78569 9.312% 89.940% ## ( 4, 6 ] 69496 8.237% 98.176% ## ( 6, 10 ] 11741 1.392% 99.568% ( 10, 15 ] 2249 0.267% 99.835% ( 15, 22 ] 268 0.032% 99.866% ( 22, 34 ] 52 0.006% 99.872% ( 34, 51 ] 24 0.003% 99.875% ( 51, 76 ] 29 0.003% 99.879% ( 76, 110 ] 247 0.029% 99.908% ( 110, 170 ] 487 0.058% 99.966% ( 170, 250 ] 432 0.051% 100.017% ( 250, 380 ] 403 0.048% 100.065% ( 380, 580 ] 422 0.050% 100.115% ( 580, 870 ] 246 0.029% 100.144% ( 870, 1300 ] 111 0.013% 100.157% ( 1300, 1900 ] 43 0.005% 100.162% ( 1900, 2900 ] 36 0.004% 100.166% ( 2900, 4400 ] 76 0.009% 100.175% ( 4400, 6600 ] 8 0.001% 100.176% ( 6600, 9900 ] 6 0.001% 100.177% ( 9900, 14000 ] 1 0.000% 100.177% ** Level 4 read latency histogram (micros): Count: 275 Average: 258.5164 StdDev: 697.61 Min: 1 Median: 2.6613 Max: 5041 Percentiles: P50: 2.66 P75: 176.92 P99: 4118.75 P99.9: 5041.00 P99.99: 5041.00 ------------------------------------------------------ [ 0, 1 ] 44 16.000% 16.000% ### ( 1, 2 ] 73 26.545% 42.545% ##### ( 2, 3 ] 31 11.273% 53.818% ## ( 3, 4 ] 4 1.455% 55.273% ( 4, 6 ] 8 2.909% 58.182% # ( 6, 10 ] 6 2.182% 60.364% ( 10, 15 ] 4 1.455% 61.818% ( 15, 22 ] 6 2.182% 64.000% ( 22, 34 ] 10 3.636% 67.636% # ( 34, 51 ] 3 1.091% 68.727% ( 51, 76 ] 12 4.364% 73.091% # ( 76, 110 ] 2 0.727% 73.818% ( 110, 170 ] 1 0.364% 74.182% ( 170, 250 ] 26 9.455% 83.636% ## ( 250, 380 ] 3 1.091% 84.727% ( 380, 580 ] 7 2.545% 87.273% # ( 580, 870 ] 11 4.000% 91.273% # ( 870, 1300 ] 5 1.818% 93.091% ( 1300, 1900 ] 9 3.273% 96.364% # ( 1900, 2900 ] 4 1.455% 97.818% ( 2900, 4400 ] 4 1.455% 99.273% ( 4400, 6600 ] 2 0.727% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 890.2278 StdDev: 1086.61 Min: 44 Median: 380.0000 Max: 5009 Percentiles: P50: 380.00 P75: 1300.00 P99: 4620.00 P99.9: 5009.00 P99.99: 5009.00 ------------------------------------------------------ ( 34, 51 ] 3 1.667% 1.667% ( 51, 76 ] 4 2.222% 3.889% ( 76, 110 ] 17 9.444% 13.333% ## ( 110, 170 ] 32 17.778% 31.111% #### ( 170, 250 ] 17 9.444% 40.556% ## ( 250, 380 ] 17 9.444% 50.000% ## ( 380, 580 ] 20 11.111% 61.111% ## ( 580, 870 ] 13 7.222% 68.333% # ( 870, 1300 ] 12 6.667% 75.000% # ( 1300, 1900 ] 13 7.222% 82.222% # ( 1900, 2900 ] 16 8.889% 91.111% ## ( 2900, 4400 ] 14 7.778% 98.889% ## ( 4400, 6600 ] 2 1.111% 100.000% ** DB Stats ** Uptime(secs): 39.9 total, 14.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 197.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:17.834 H:M:S, 44.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 67.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.510 H:M:S, 79.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/19-12:44:21 ... thread 0: (1000000,9000000) ops and (65686.7,163878.1) ops/second in (15.223787,54.918884) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 1.41 GB 18.9 7.8 0.0 7.8 16.3 8.5 0.0 1.9 139.5 291.8 57.36 52.21 149 0.385 8122K 15K 0.0 0.0 L1 1/0 60.55 MB 6.1 10.5 6.9 3.6 10.3 6.7 0.2 1.5 222.3 219.5 48.27 45.29 5 9.655 9563K 75K 0.0 0.0 L2 17/12 1.65 GB 4.8 0.4 0.2 0.2 0.4 0.2 6.7 2.0 249.4 249.2 1.52 1.47 2 0.758 383K 194 0.0 0.0 L3 44/16 3.29 GB 2.5 5.4 3.2 2.2 5.4 3.2 2.2 1.7 187.3 186.5 29.58 24.22 19 1.557 5559K 23K 0.0 0.0 L4 167/1 9.70 GB 1.0 1.8 1.6 0.1 1.8 1.6 1.4 1.1 153.7 153.2 11.80 8.29 18 0.655 1821K 5761 0.0 0.0 L5 1068/0 88.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1304/34 104.51 GB 0.0 25.8 11.9 13.9 34.2 20.3 13.6 4.0 178.2 235.9 148.52 131.47 193 0.770 25M 120K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.8 11.9 13.9 34.2 20.3 13.1 4.0 178.2 235.9 148.52 131.47 193 0.770 25M 120K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.8 11.9 13.9 25.7 11.8 0.0 0.0 216.7 215.2 122.11 109.07 69 1.770 25M 120K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 331.6 26.41 22.39 124 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.1 total, 54.9 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.22 GB write, 635.60 MB/s write, 25.84 GB read, 480.00 MB/s read, 148.5 seconds Interval compaction: 34.22 GB write, 637.97 MB/s write, 25.84 GB read, 481.79 MB/s read, 148.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 34, pending-compaction-bytes-delays: 25, pending-compaction-bytes-stops: 0, total-delays: 42, total-stops: 34, interval: 76 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4086680 Average: 2.7780 StdDev: 22.40 Min: 0 Median: 1.5209 Max: 9367 Percentiles: P50: 1.52 P75: 1.90 P99: 6.99 P99.9: 145.07 P99.99: 347.68 ------------------------------------------------------ [ 0, 1 ] 652622 15.969% 15.969% ### ( 1, 2 ] 2669713 65.327% 81.297% ############# ( 2, 3 ] 446593 10.928% 92.225% ## ( 3, 4 ] 157769 3.861% 96.085% # ( 4, 6 ] 111255 2.722% 98.808% # ( 6, 10 ] 31821 0.779% 99.586% ( 10, 15 ] 4206 0.103% 99.689% ( 15, 22 ] 756 0.018% 99.708% ( 22, 34 ] 46 0.001% 99.709% ( 34, 51 ] 81 0.002% 99.711% ( 51, 76 ] 267 0.007% 99.717% ( 76, 110 ] 4849 0.119% 99.836% ( 110, 170 ] 4476 0.110% 99.946% ( 170, 250 ] 1224 0.030% 99.975% ( 250, 380 ] 791 0.019% 99.995% ( 380, 580 ] 583 0.014% 100.009% ( 580, 870 ] 286 0.007% 100.016% ( 870, 1300 ] 85 0.002% 100.018% ( 1300, 1900 ] 40 0.001% 100.019% ( 1900, 2900 ] 36 0.001% 100.020% ( 2900, 4400 ] 34 0.001% 100.021% ( 4400, 6600 ] 10 0.000% 100.021% ( 6600, 9900 ] 8 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1950479 Average: 3.7980 StdDev: 54.28 Min: 0 Median: 1.6333 Max: 10388 Percentiles: P50: 1.63 P75: 2.25 P99: 8.54 P99.9: 118.52 P99.99: 277.14 ------------------------------------------------------ [ 0, 1 ] 258139 13.235% 13.235% ### ( 1, 2 ] 1132338 58.054% 71.289% ############ ( 2, 3 ] 290657 14.902% 86.191% ### ( 3, 4 ] 120058 6.155% 92.346% # ( 4, 6 ] 111085 5.695% 98.041% # ( 6, 10 ] 29401 1.507% 99.549% ( 10, 15 ] 3879 0.199% 99.748% ( 15, 22 ] 685 0.035% 99.783% ( 22, 34 ] 34 0.002% 99.785% ( 34, 51 ] 12 0.001% 99.785% ( 51, 76 ] 281 0.014% 99.800% ( 76, 110 ] 1776 0.091% 99.891% ( 110, 170 ] 1292 0.066% 99.957% ( 170, 250 ] 539 0.028% 99.984% ( 250, 380 ] 517 0.027% 100.011% ( 380, 580 ] 461 0.024% 100.035% ( 580, 870 ] 312 0.016% 100.051% ( 870, 1300 ] 228 0.012% 100.062% ( 1300, 1900 ] 112 0.006% 100.068% ( 1900, 2900 ] 117 0.006% 100.074% ( 2900, 4400 ] 161 0.008% 100.082% ( 4400, 6600 ] 49 0.003% 100.085% ( 6600, 9900 ] 12 0.001% 100.085% ( 9900, 14000 ] 1 0.000% 100.085% ** Level 2 read latency histogram (micros): Count: 140208 Average: 2.5948 StdDev: 18.71 Min: 1 Median: 1.4933 Max: 3056 Percentiles: P50: 1.49 P75: 1.89 P99: 6.53 P99.9: 147.08 P99.99: 684.91 ------------------------------------------------------ [ 0, 1 ] 26260 18.729% 18.729% #### ( 1, 2 ] 88875 63.388% 82.117% ############# ( 2, 3 ] 14105 10.060% 92.177% ## ( 3, 4 ] 5595 3.990% 96.168% # ( 4, 6 ] 3808 2.716% 98.884% # ( 6, 10 ] 1236 0.882% 99.765% ( 10, 15 ] 109 0.078% 99.843% ( 15, 22 ] 10 0.007% 99.850% ( 22, 34 ] 2 0.001% 99.852% ( 34, 51 ] 1 0.001% 99.852% ( 51, 76 ] 5 0.004% 99.856% ( 76, 110 ] 21 0.015% 99.871% ( 110, 170 ] 66 0.047% 99.918% ( 170, 250 ] 34 0.024% 99.942% ( 250, 380 ] 32 0.023% 99.965% ( 380, 580 ] 31 0.022% 99.987% ( 580, 870 ] 11 0.008% 99.995% ( 870, 1300 ] 3 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 2 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1003653 Average: 5.8477 StdDev: 84.52 Min: 0 Median: 1.8649 Max: 11312 Percentiles: P50: 1.86 P75: 2.81 P99: 8.99 P99.9: 230.35 P99.99: 447.87 ------------------------------------------------------ [ 0, 1 ] 31764 3.165% 3.165% # ( 1, 2 ] 543499 54.152% 57.317% ########### ( 2, 3 ] 219050 21.825% 79.142% #### ( 3, 4 ] 97595 9.724% 88.866% ## ( 4, 6 ] 89259 8.893% 97.760% ## ( 6, 10 ] 16665 1.660% 99.420% ( 10, 15 ] 3106 0.309% 99.729% ( 15, 22 ] 385 0.038% 99.768% ( 22, 34 ] 61 0.006% 99.774% ( 34, 51 ] 32 0.003% 99.777% ( 51, 76 ] 32 0.003% 99.780% ( 76, 110 ] 261 0.026% 99.806% ( 110, 170 ] 539 0.054% 99.860% ( 170, 250 ] 532 0.053% 99.913% ( 250, 380 ] 548 0.055% 99.968% ( 380, 580 ] 662 0.066% 100.034% ( 580, 870 ] 486 0.048% 100.082% ( 870, 1300 ] 276 0.027% 100.109% ( 1300, 1900 ] 139 0.014% 100.123% ( 1900, 2900 ] 135 0.013% 100.137% ( 2900, 4400 ] 234 0.023% 100.160% ( 4400, 6600 ] 49 0.005% 100.165% ( 6600, 9900 ] 12 0.001% 100.166% ( 9900, 14000 ] 2 0.000% 100.166% ** Level 4 read latency histogram (micros): Count: 275 Average: 258.5164 StdDev: 697.61 Min: 1 Median: 2.6613 Max: 5041 Percentiles: P50: 2.66 P75: 176.92 P99: 4118.75 P99.9: 5041.00 P99.99: 5041.00 ------------------------------------------------------ [ 0, 1 ] 44 16.000% 16.000% ### ( 1, 2 ] 73 26.545% 42.545% ##### ( 2, 3 ] 31 11.273% 53.818% ## ( 3, 4 ] 4 1.455% 55.273% ( 4, 6 ] 8 2.909% 58.182% # ( 6, 10 ] 6 2.182% 60.364% ( 10, 15 ] 4 1.455% 61.818% ( 15, 22 ] 6 2.182% 64.000% ( 22, 34 ] 10 3.636% 67.636% # ( 34, 51 ] 3 1.091% 68.727% ( 51, 76 ] 12 4.364% 73.091% # ( 76, 110 ] 2 0.727% 73.818% ( 110, 170 ] 1 0.364% 74.182% ( 170, 250 ] 26 9.455% 83.636% ## ( 250, 380 ] 3 1.091% 84.727% ( 380, 580 ] 7 2.545% 87.273% # ( 580, 870 ] 11 4.000% 91.273% # ( 870, 1300 ] 5 1.818% 93.091% ( 1300, 1900 ] 9 3.273% 96.364% # ( 1900, 2900 ] 4 1.455% 97.818% ( 2900, 4400 ] 4 1.455% 99.273% ( 4400, 6600 ] 2 0.727% 100.000% ** Level 5 read latency histogram (micros): Count: 180 Average: 890.2278 StdDev: 1086.61 Min: 44 Median: 380.0000 Max: 5009 Percentiles: P50: 380.00 P75: 1300.00 P99: 4620.00 P99.9: 5009.00 P99.99: 5009.00 ------------------------------------------------------ ( 34, 51 ] 3 1.667% 1.667% ( 51, 76 ] 4 2.222% 3.889% ( 76, 110 ] 17 9.444% 13.333% ## ( 110, 170 ] 32 17.778% 31.111% #### ( 170, 250 ] 17 9.444% 40.556% ## ( 250, 380 ] 17 9.444% 50.000% ## ( 380, 580 ] 20 11.111% 61.111% ## ( 580, 870 ] 13 7.222% 68.333% # ( 870, 1300 ] 12 6.667% 75.000% # ( 1300, 1900 ] 13 7.222% 82.222% # ( 1900, 2900 ] 16 8.889% 91.111% ## ( 2900, 4400 ] 14 7.778% 98.889% ## ( 4400, 6600 ] 2 1.111% 100.000% ** DB Stats ** Uptime(secs): 55.1 total, 15.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 160.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.032 H:M:S, 54.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 64.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:12.198 H:M:S, 80.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.205 micros/op 161156 ops/sec 60.357 seconds 9726999 operations; 156.2 MB/s Microseconds per write: Count: 9726999 Average: 6.2051 StdDev: 577.23 Min: 1 Median: 1.7832 Max: 801418 Percentiles: P50: 1.78 P75: 2.82 P99: 7.56 P99.9: 1160.74 P99.99: 2703.93 ------------------------------------------------------ [ 0, 1 ] 1052368 10.819% 10.819% ## ( 1, 2 ] 4866078 50.027% 60.846% ########## ( 2, 3 ] 1673413 17.204% 78.049% ### ( 3, 4 ] 1419137 14.590% 92.639% ### ( 4, 6 ] 588873 6.054% 98.693% # ( 6, 10 ] 76532 0.787% 99.480% ( 10, 15 ] 12751 0.131% 99.611% ( 15, 22 ] 5467 0.056% 99.667% ( 22, 34 ] 1682 0.017% 99.684% ( 34, 51 ] 185 0.002% 99.686% ( 51, 76 ] 37 0.000% 99.687% ( 76, 110 ] 6483 0.067% 99.753% ( 110, 170 ] 3078 0.032% 99.785% ( 170, 250 ] 265 0.003% 99.788% ( 250, 380 ] 57 0.001% 99.788% ( 380, 580 ] 23 0.000% 99.789% ( 580, 870 ] 18 0.000% 99.789% ( 870, 1300 ] 16010 0.165% 99.953% ( 1300, 1900 ] 32 0.000% 99.954% ( 1900, 2900 ] 4400 0.045% 99.999% ( 2900, 4400 ] 62 0.001% 100.000% ( 4400, 6600 ] 12 0.000% 100.000% ( 6600, 9900 ] 7 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 3 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 14 0.000% 100.000% ( 570000, 860000 ] 5 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 229209 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9726999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10038262968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 593 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33295479 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 36414987809 rocksdb.compact.write.bytes COUNT : 36175529996 rocksdb.flush.write.bytes COUNT : 9974550920 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 44 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 345 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9894223872 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3927040 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 36506963391 rocksdb.non.last.level.read.count COUNT : 8823566 rocksdb.block.checksum.compute.count COUNT : 8822424 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.453308 P95 : 3.887212 P99 : 5.969438 P100 : 801416.000000 COUNT : 9726999 SUM : 55853709 rocksdb.compaction.times.micros P50 : 1107272.727273 P95 : 5180000.000000 P99 : 17840000.000000 P100 : 18698349.000000 COUNT : 104 SUM : 174226571 rocksdb.compaction.times.cpu_micros P50 : 879428.571429 P95 : 4160000.000000 P99 : 17198080.000000 P100 : 17198080.000000 COUNT : 104 SUM : 139945362 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 727.301587 P95 : 12360.000000 P99 : 150800.000000 P100 : 279921.000000 COUNT : 132 SUM : 751872 rocksdb.compaction.outfile.sync.micros P50 : 1123.287671 P95 : 129333.333333 P99 : 233466.666667 P100 : 1424960.000000 COUNT : 424 SUM : 10073896 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 105.600000 P95 : 2014.285714 P99 : 3990.000000 P100 : 4964.000000 COUNT : 264 SUM : 101976 rocksdb.table.open.io.micros P50 : 1496.774194 P95 : 6142.812500 P99 : 9160.500000 P100 : 10023.000000 COUNT : 593 SUM : 1167297 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.740453 P95 : 8.166551 P99 : 11.760498 P100 : 15185.000000 COUNT : 8820849 SUM : 60837936 rocksdb.read.block.get.micros P50 : 461.081081 P95 : 3181.578947 P99 : 4609.000000 P100 : 7994.000000 COUNT : 1186 SUM : 998657 rocksdb.write.raw.block.micros P50 : 0.513830 P95 : 0.976276 P99 : 2.909931 P100 : 41195.000000 COUNT : 11180481 SUM : 24250737 rocksdb.numfiles.in.singlecompaction P50 : 3.089041 P95 : 5.722222 P99 : 24.100000 P100 : 25.000000 COUNT : 165 SUM : 612 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558118 P95 : 1155.372187 P99 : 2463.127854 P100 : 801233.000000 COUNT : 196750 SUM : 33306663 rocksdb.sst.read.micros P50 : 1.656526 P95 : 4.938465 P99 : 8.837078 P100 : 12549.000000 COUNT : 8823961 SUM : 42169760 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9726999 SUM : 10038262968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213294.117647 P95 : 599000.000000 P99 : 953256.000000 P100 : 953256.000000 COUNT : 132 SUM : 31653675 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 411 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0