[2024-07-26 11:20:43.821988] Starting SPDK v24.09-pre git sha1 704257090 / DPDK 23.11.0 initialization... [2024-07-26 11:20:43.822084] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2578236 ] Set seed to 1721985643819726 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-26 11:20:43.916299] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-26 11:20:43.957836] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-26 11:20:43.957882] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2578236' to capture a snapshot of events at runtime. [2024-07-26 11:20:43.957891] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-26 11:20:43.957905] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-26 11:20:43.957912] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2578236 for offline analysis/debug. [2024-07-26 11:20:43.958001] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 26 11:20:48 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/26-11:20:51 ... thread 0: (1000000,1000000) ops and (356509.0,356509.0) ops/second in (2.804978,2.804978) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 567.03 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 351.3 2.33 2.08 12 0.194 0 0 0.0 0.0 L2 3/2 251.69 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.1 2.0 252.9 252.7 1.49 1.44 2 0.747 383K 241 0.0 0.0 L3 11/0 867.18 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1183/8 96.94 GB 0.0 0.4 0.2 0.2 1.2 1.0 0.2 1.5 98.8 312.8 3.83 3.52 14 0.273 383K 241 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.2 0.2 1.2 1.0 0.1 1.5 98.8 312.8 3.83 3.52 14 0.273 383K 241 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 0.0 252.9 252.7 1.49 1.44 2 0.747 383K 241 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 351.3 2.33 2.08 12 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 400.82 MB/s write, 0.37 GB read, 126.58 MB/s read, 3.8 seconds Interval compaction: 1.17 GB write, 426.38 MB/s write, 0.37 GB read, 134.65 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 104129 Average: 1.8650 StdDev: 18.15 Min: 0 Median: 1.1990 Max: 3908 Percentiles: P50: 1.20 P75: 1.65 P99: 3.87 P99.9: 9.49 P99.99: 318.77 ------------------------------------------------------ [ 0, 1 ] 40501 38.895% 38.895% ######## ( 1, 2 ] 58116 55.812% 94.707% ########### ( 2, 3 ] 3499 3.360% 98.067% # ( 3, 4 ] 1118 1.074% 99.140% ( 4, 6 ] 627 0.602% 99.743% ( 6, 10 ] 189 0.182% 99.924% ( 10, 15 ] 51 0.049% 99.973% ( 15, 22 ] 3 0.003% 99.976% ( 22, 34 ] 1 0.001% 99.977% ( 34, 51 ] 1 0.001% 99.978% ( 110, 170 ] 8 0.008% 99.986% ( 170, 250 ] 4 0.004% 99.989% ( 250, 380 ] 3 0.003% 99.992% ( 380, 580 ] 2 0.002% 99.994% ( 580, 870 ] 1 0.001% 99.995% ( 870, 1300 ] 3 0.003% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 2900, 4400 ] 2 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 51390 Average: 2.0733 StdDev: 18.91 Min: 1 Median: 1.2682 Max: 2404 Percentiles: P50: 1.27 P75: 1.70 P99: 5.17 P99.9: 9.93 P99.99: 859.92 ------------------------------------------------------ [ 0, 1 ] 17757 34.553% 34.553% ####### ( 1, 2 ] 29603 57.605% 92.158% ############ ( 2, 3 ] 2204 4.289% 96.447% # ( 3, 4 ] 936 1.821% 98.268% ( 4, 6 ] 647 1.259% 99.527% ( 6, 10 ] 196 0.381% 99.909% ( 10, 15 ] 24 0.047% 99.955% ( 15, 22 ] 2 0.004% 99.959% ( 22, 34 ] 3 0.006% 99.965% ( 51, 76 ] 3 0.006% 99.971% ( 170, 250 ] 1 0.002% 99.973% ( 250, 380 ] 2 0.004% 99.977% ( 380, 580 ] 4 0.008% 99.984% ( 580, 870 ] 4 0.008% 99.992% ( 870, 1300 ] 2 0.004% 99.996% ( 1300, 1900 ] 1 0.002% 99.998% ( 1900, 2900 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 45 Average: 1778.2667 StdDev: 1633.44 Min: 449 Median: 1111.8750 Max: 7321 Percentiles: P50: 1111.88 P75: 2292.86 P99: 7321.00 P99.9: 7321.00 P99.99: 7321.00 ------------------------------------------------------ ( 380, 580 ] 6 13.333% 13.333% ### ( 580, 870 ] 12 26.667% 40.000% ##### ( 870, 1300 ] 8 17.778% 57.778% #### ( 1300, 1900 ] 5 11.111% 68.889% ## ( 1900, 2900 ] 7 15.556% 84.444% ### ( 2900, 4400 ] 4 8.889% 93.333% ## ( 4400, 6600 ] 1 2.222% 95.556% ( 6600, 9900 ] 2 4.444% 100.000% # ** Level 4 read latency histogram (micros): Count: 25 Average: 1679.4000 StdDev: 1470.46 Min: 151 Median: 999.0000 Max: 5421 Percentiles: P50: 999.00 P75: 2650.00 P99: 5421.00 P99.9: 5421.00 P99.99: 5421.00 ------------------------------------------------------ ( 110, 170 ] 1 4.000% 4.000% # ( 250, 380 ] 1 4.000% 8.000% # ( 380, 580 ] 2 8.000% 16.000% ## ( 580, 870 ] 7 28.000% 44.000% ###### ( 870, 1300 ] 5 20.000% 64.000% #### ( 1300, 1900 ] 2 8.000% 72.000% ## ( 1900, 2900 ] 1 4.000% 76.000% # ( 2900, 4400 ] 4 16.000% 92.000% ### ( 4400, 6600 ] 2 8.000% 100.000% ## ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 329.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.217 H:M:S, 7.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 350.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.217 H:M:S, 7.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-11:20:54 ... thread 0: (1000000,2000000) ops and (327828.0,341567.5) ops/second in (3.050380,5.855358) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 1.17 GB 0.0 0.2 0.0 0.2 2.0 1.8 0.0 1.1 41.2 339.6 6.12 5.52 27 0.227 255K 223 0.0 0.0 L1 1/1 3.32 MB 0.0 0.4 0.4 0.0 0.4 0.4 0.2 1.0 242.1 241.7 1.56 1.51 1 1.561 383K 600 0.0 0.0 L2 2/1 54.16 MB 0.5 0.4 0.2 0.2 0.4 0.2 0.4 2.0 252.9 252.7 1.49 1.44 2 0.747 383K 241 0.0 0.0 L3 21/11 1.19 GB 0.3 0.2 0.2 0.0 0.2 0.2 0.4 1.0 228.7 228.8 1.09 1.01 1 1.091 253K 0 0.0 0.0 L4 174/0 9.75 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 151.8 151.8 1.48 1.09 1 1.478 227K 0 0.0 0.0 L5 1044/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/27 97.92 GB 0.0 1.4 1.0 0.4 3.2 2.8 1.1 1.8 126.2 281.6 11.75 10.58 32 0.367 1504K 1064 0.0 0.0 Int 0/0 0.00 KB 0.0 1.4 1.0 0.4 3.2 2.8 1.0 1.8 126.2 281.6 11.75 10.58 32 0.367 1504K 1064 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.4 1.0 0.4 1.4 1.0 0.0 0.0 224.8 224.7 6.59 6.00 6 1.098 1504K 1064 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.4 5.16 4.58 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.23 GB write, 548.00 MB/s write, 1.45 GB read, 245.50 MB/s read, 11.7 seconds Interval compaction: 3.23 GB write, 564.74 MB/s write, 1.45 GB read, 253.01 MB/s read, 11.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 397019 Average: 2.2414 StdDev: 11.10 Min: 0 Median: 1.5175 Max: 3908 Percentiles: P50: 1.52 P75: 1.91 P99: 5.71 P99.9: 10.80 P99.99: 14.38 ------------------------------------------------------ [ 0, 1 ] 68123 17.159% 17.159% ### ( 1, 2 ] 251969 63.465% 80.624% ############# ( 2, 3 ] 46512 11.715% 92.339% ## ( 3, 4 ] 16513 4.159% 96.498% # ( 4, 6 ] 11590 2.919% 99.418% # ( 6, 10 ] 1837 0.463% 99.880% ( 10, 15 ] 499 0.126% 100.006% ( 15, 22 ] 17 0.004% 100.010% ( 22, 34 ] 4 0.001% 100.011% ( 34, 51 ] 4 0.001% 100.012% ( 51, 76 ] 2 0.001% 100.013% ( 76, 110 ] 1 0.000% 100.013% ( 110, 170 ] 12 0.003% 100.016% ( 170, 250 ] 12 0.003% 100.019% ( 250, 380 ] 9 0.002% 100.021% ( 380, 580 ] 4 0.001% 100.022% ( 580, 870 ] 5 0.001% 100.024% ( 870, 1300 ] 7 0.002% 100.025% ( 1300, 1900 ] 2 0.001% 100.026% ( 1900, 2900 ] 1 0.000% 100.026% ( 2900, 4400 ] 2 0.001% 100.027% ** Level 1 read latency histogram (micros): Count: 26 Average: 184.9615 StdDev: 358.20 Min: 1 Median: 1.5714 Max: 1485 Percentiles: P50: 1.57 P75: 210.00 P99: 1485.00 P99.9: 1485.00 P99.99: 1485.00 ------------------------------------------------------ [ 0, 1 ] 9 34.615% 34.615% ####### ( 1, 2 ] 7 26.923% 61.538% ##### ( 4, 6 ] 2 7.692% 69.231% ## ( 110, 170 ] 1 3.846% 73.077% # ( 170, 250 ] 1 3.846% 76.923% # ( 250, 380 ] 2 7.692% 84.615% ## ( 380, 580 ] 1 3.846% 88.462% # ( 580, 870 ] 2 7.692% 96.154% ## ( 1300, 1900 ] 1 3.846% 100.000% # ** Level 2 read latency histogram (micros): Count: 95655 Average: 2.1794 StdDev: 13.88 Min: 1 Median: 1.4320 Max: 2404 Percentiles: P50: 1.43 P75: 1.84 P99: 5.67 P99.9: 10.78 P99.99: 551.72 ------------------------------------------------------ [ 0, 1 ] 22265 23.276% 23.276% ##### ( 1, 2 ] 59174 61.862% 85.138% ############ ( 2, 3 ] 8252 8.627% 93.765% ## ( 3, 4 ] 3090 3.230% 96.995% # ( 4, 6 ] 2295 2.399% 99.395% ( 6, 10 ] 471 0.492% 99.887% ( 10, 15 ] 79 0.083% 99.970% ( 15, 22 ] 5 0.005% 99.975% ( 22, 34 ] 5 0.005% 99.980% ( 51, 76 ] 3 0.003% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 250, 380 ] 2 0.002% 99.986% ( 380, 580 ] 4 0.004% 99.991% ( 580, 870 ] 4 0.004% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 178765 Average: 3.4121 StdDev: 41.05 Min: 0 Median: 1.6590 Max: 7321 Percentiles: P50: 1.66 P75: 2.22 P99: 8.75 P99.9: 158.71 P99.99: 430.77 ------------------------------------------------------ [ 0, 1 ] 16061 8.984% 8.984% ## ( 1, 2 ] 111258 62.237% 71.221% ############ ( 2, 3 ] 30963 17.321% 88.542% ### ( 3, 4 ] 9345 5.228% 93.769% # ( 4, 6 ] 7447 4.166% 97.935% # ( 6, 10 ] 2768 1.548% 99.484% ( 10, 15 ] 407 0.228% 99.711% ( 15, 22 ] 85 0.048% 99.759% ( 22, 34 ] 19 0.011% 99.770% ( 34, 51 ] 5 0.003% 99.772% ( 51, 76 ] 18 0.010% 99.782% ( 76, 110 ] 57 0.032% 99.814% ( 110, 170 ] 190 0.106% 99.921% ( 170, 250 ] 70 0.039% 99.960% ( 250, 380 ] 47 0.026% 99.986% ( 380, 580 ] 32 0.018% 100.004% ( 580, 870 ] 29 0.016% 100.020% ( 870, 1300 ] 13 0.007% 100.027% ( 1300, 1900 ] 5 0.003% 100.030% ( 1900, 2900 ] 7 0.004% 100.034% ( 2900, 4400 ] 5 0.003% 100.037% ( 4400, 6600 ] 1 0.001% 100.037% ( 6600, 9900 ] 2 0.001% 100.039% ** Level 4 read latency histogram (micros): Count: 315 Average: 140.8952 StdDev: 613.72 Min: 0 Median: 2.2719 Max: 5421 Percentiles: P50: 2.27 P75: 5.92 P99: 3968.75 P99.9: 5421.00 P99.99: 5421.00 ------------------------------------------------------ [ 0, 1 ] 42 13.333% 13.333% ### ( 1, 2 ] 100 31.746% 45.079% ###### ( 2, 3 ] 57 18.095% 63.175% #### ( 3, 4 ] 19 6.032% 69.206% # ( 4, 6 ] 19 6.032% 75.238% # ( 6, 10 ] 13 4.127% 79.365% # ( 10, 15 ] 15 4.762% 84.127% # ( 15, 22 ] 15 4.762% 88.889% # ( 22, 34 ] 6 1.905% 90.794% ( 110, 170 ] 1 0.317% 91.111% ( 170, 250 ] 3 0.952% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 7 2.222% 95.556% ( 870, 1300 ] 5 1.587% 97.143% ( 1300, 1900 ] 2 0.635% 97.778% ( 1900, 2900 ] 1 0.317% 98.095% ( 2900, 4400 ] 4 1.270% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** DB Stats ** Uptime(secs): 6.0 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 326.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.596 H:M:S, 9.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.379 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/26-11:20:57 ... thread 0: (1000000,3000000) ops and (314358.2,331989.0) ops/second in (3.181085,9.036443) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 1.54 GB 18.9 1.0 0.0 1.0 3.8 2.8 0.0 1.4 87.4 318.7 12.25 11.15 44 0.278 1087K 1061 0.0 0.0 L1 3/3 181.79 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 233.0 232.4 4.34 4.20 2 2.170 1026K 2158 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 252.9 252.7 1.49 1.44 2 0.747 383K 241 0.0 0.0 L3 23/0 941.35 MB 0.9 1.9 0.7 1.2 1.9 0.7 0.4 2.6 221.5 221.0 8.89 8.14 6 1.481 1998K 4144 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 151.8 151.8 1.48 1.09 1 1.478 227K 0 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1269/13 98.90 GB 0.0 4.5 2.1 2.4 7.3 4.9 3.3 2.6 163.5 262.9 28.45 26.02 55 0.517 4724K 7604 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 2.1 2.4 7.3 4.9 3.2 2.6 163.5 262.9 28.45 26.02 55 0.517 4724K 7604 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 2.1 2.4 4.5 2.1 0.0 0.0 228.6 228.2 20.35 18.92 15 1.357 4724K 7604 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 350.0 8.10 7.10 40 0.203 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.30 GB write, 811.46 MB/s write, 4.54 GB read, 504.73 MB/s read, 28.4 seconds Interval compaction: 7.30 GB write, 827.52 MB/s write, 4.54 GB read, 514.72 MB/s read, 28.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 13, interval: 13 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 723321 Average: 2.3243 StdDev: 9.67 Min: 0 Median: 1.5666 Max: 3908 Percentiles: P50: 1.57 P75: 1.96 P99: 5.82 P99.9: 10.97 P99.99: 14.19 ------------------------------------------------------ [ 0, 1 ] 99234 13.719% 13.719% ### ( 1, 2 ] 463183 64.036% 77.755% ############# ( 2, 3 ] 94006 12.996% 90.751% ### ( 3, 4 ] 35594 4.921% 95.672% # ( 4, 6 ] 26443 3.656% 99.328% # ( 6, 10 ] 3945 0.545% 99.873% ( 10, 15 ] 1008 0.139% 100.013% ( 15, 22 ] 51 0.007% 100.020% ( 22, 34 ] 6 0.001% 100.021% ( 34, 51 ] 5 0.001% 100.021% ( 51, 76 ] 4 0.001% 100.022% ( 76, 110 ] 1 0.000% 100.022% ( 110, 170 ] 18 0.002% 100.024% ( 170, 250 ] 20 0.003% 100.027% ( 250, 380 ] 12 0.002% 100.029% ( 380, 580 ] 8 0.001% 100.030% ( 580, 870 ] 10 0.001% 100.031% ( 870, 1300 ] 12 0.002% 100.033% ( 1300, 1900 ] 4 0.001% 100.034% ( 1900, 2900 ] 2 0.000% 100.034% ( 2900, 4400 ] 2 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 209363 Average: 2.8575 StdDev: 10.48 Min: 1 Median: 1.7815 Max: 1495 Percentiles: P50: 1.78 P75: 2.64 P99: 7.98 P99.9: 12.40 P99.99: 13.86 ------------------------------------------------------ [ 0, 1 ] 10052 4.801% 4.801% # ( 1, 2 ] 121093 57.839% 62.640% ############ ( 2, 3 ] 40330 19.263% 81.903% #### ( 3, 4 ] 18063 8.628% 90.531% ## ( 4, 6 ] 16187 7.732% 98.262% ## ( 6, 10 ] 3119 1.490% 99.752% ( 10, 15 ] 645 0.308% 100.060% ( 15, 22 ] 68 0.032% 100.093% ( 22, 34 ] 4 0.002% 100.095% ( 51, 76 ] 1 0.000% 100.095% ( 76, 110 ] 7 0.003% 100.098% ( 110, 170 ] 28 0.013% 100.112% ( 170, 250 ] 18 0.009% 100.120% ( 250, 380 ] 21 0.010% 100.130% ( 380, 580 ] 9 0.004% 100.135% ( 580, 870 ] 7 0.003% 100.138% ( 870, 1300 ] 7 0.003% 100.141% ( 1300, 1900 ] 3 0.001% 100.143% ** Level 2 read latency histogram (micros): Count: 124160 Average: 3.0035 StdDev: 38.44 Min: 1 Median: 1.5207 Max: 6789 Percentiles: P50: 1.52 P75: 1.94 P99: 7.17 P99.9: 112.52 P99.99: 2287.29 ------------------------------------------------------ [ 0, 1 ] 23223 18.704% 18.704% #### ( 1, 2 ] 74621 60.101% 78.805% ############ ( 2, 3 ] 14123 11.375% 90.180% ## ( 3, 4 ] 5855 4.716% 94.895% # ( 4, 6 ] 4739 3.817% 98.712% # ( 6, 10 ] 1221 0.983% 99.696% ( 10, 15 ] 201 0.162% 99.857% ( 15, 22 ] 13 0.010% 99.868% ( 22, 34 ] 5 0.004% 99.872% ( 51, 76 ] 3 0.002% 99.874% ( 76, 110 ] 31 0.025% 99.899% ( 110, 170 ] 20 0.016% 99.915% ( 170, 250 ] 20 0.016% 99.932% ( 250, 380 ] 23 0.019% 99.950% ( 380, 580 ] 18 0.014% 99.965% ( 580, 870 ] 19 0.015% 99.980% ( 870, 1300 ] 4 0.003% 99.983% ( 1300, 1900 ] 2 0.002% 99.985% ( 1900, 2900 ] 17 0.014% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255439 Average: 3.4678 StdDev: 36.79 Min: 0 Median: 1.6754 Max: 7321 Percentiles: P50: 1.68 P75: 2.29 P99: 8.91 P99.9: 193.62 P99.99: 554.50 ------------------------------------------------------ [ 0, 1 ] 21012 8.226% 8.226% ## ( 1, 2 ] 157998 61.854% 70.079% ############ ( 2, 3 ] 43697 17.107% 87.186% ### ( 3, 4 ] 15309 5.993% 93.179% # ( 4, 6 ] 11739 4.596% 97.775% # ( 6, 10 ] 4303 1.685% 99.459% ( 10, 15 ] 573 0.224% 99.684% ( 15, 22 ] 103 0.040% 99.724% ( 22, 34 ] 24 0.009% 99.733% ( 34, 51 ] 5 0.002% 99.735% ( 51, 76 ] 22 0.009% 99.744% ( 76, 110 ] 76 0.030% 99.774% ( 110, 170 ] 283 0.111% 99.885% ( 170, 250 ] 134 0.052% 99.937% ( 250, 380 ] 77 0.030% 99.967% ( 380, 580 ] 67 0.026% 99.993% ( 580, 870 ] 39 0.015% 100.009% ( 870, 1300 ] 22 0.009% 100.017% ( 1300, 1900 ] 9 0.004% 100.021% ( 1900, 2900 ] 8 0.003% 100.024% ( 2900, 4400 ] 5 0.002% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ( 6600, 9900 ] 2 0.001% 100.027% ** Level 4 read latency histogram (micros): Count: 315 Average: 140.8952 StdDev: 613.72 Min: 0 Median: 2.2719 Max: 5421 Percentiles: P50: 2.27 P75: 5.92 P99: 3968.75 P99.9: 5421.00 P99.99: 5421.00 ------------------------------------------------------ [ 0, 1 ] 42 13.333% 13.333% ### ( 1, 2 ] 100 31.746% 45.079% ###### ( 2, 3 ] 57 18.095% 63.175% #### ( 3, 4 ] 19 6.032% 69.206% # ( 4, 6 ] 19 6.032% 75.238% # ( 6, 10 ] 13 4.127% 79.365% # ( 10, 15 ] 15 4.762% 84.127% # ( 15, 22 ] 15 4.762% 88.889% # ( 22, 34 ] 6 1.905% 90.794% ( 110, 170 ] 1 0.317% 91.111% ( 170, 250 ] 3 0.952% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 7 2.222% 95.556% ( 870, 1300 ] 5 1.587% 97.143% ( 1300, 1900 ] 2 0.635% 97.778% ( 1900, 2900 ] 1 0.317% 98.095% ( 2900, 4400 ] 4 1.270% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 809.6000 StdDev: 1028.53 Min: 77 Median: 315.0000 Max: 4426 Percentiles: P50: 315.00 P75: 1385.71 P99: 4426.00 P99.9: 4426.00 P99.99: 4426.00 ------------------------------------------------------ ( 76, 110 ] 15 25.000% 25.000% ##### ( 110, 170 ] 6 10.000% 35.000% ## ( 170, 250 ] 5 8.333% 43.333% ## ( 250, 380 ] 8 13.333% 56.667% ### ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 2 3.333% 73.333% # ( 1300, 1900 ] 7 11.667% 85.000% ## ( 1900, 2900 ] 5 8.333% 93.333% ## ( 2900, 4400 ] 3 5.000% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 9.2 total, 3.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 320.33 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.037 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 309.39 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.440 H:M:S, 13.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-11:21:00 ... thread 0: (1000000,4000000) ops and (322761.3,329633.0) ops/second in (3.098265,12.134708) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/14 2.46 GB 88.1 1.9 0.0 1.9 5.6 3.7 0.0 1.5 106.5 312.4 18.34 16.84 60 0.306 1982K 2061 0.0 0.0 L1 3/3 181.79 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 233.0 232.4 4.34 4.20 2 2.170 1026K 2158 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 252.9 252.7 1.49 1.44 2 0.747 383K 241 0.0 0.0 L3 23/0 941.35 MB 0.9 1.9 0.7 1.2 1.9 0.7 0.4 2.6 221.5 221.0 8.89 8.14 6 1.481 1998K 4144 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 151.8 151.8 1.48 1.09 1 1.478 227K 0 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1273/17 99.82 GB 0.0 5.4 2.1 3.3 9.1 5.8 3.3 2.5 160.2 269.4 34.54 31.71 71 0.486 5619K 8604 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 2.1 3.3 9.1 5.8 3.2 2.5 160.2 269.4 34.54 31.71 71 0.486 5619K 8604 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 2.1 3.3 5.4 2.1 0.0 0.0 233.7 233.4 23.68 22.18 18 1.315 5619K 8604 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 347.9 10.86 9.53 53 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.1 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.09 GB write, 755.57 MB/s write, 5.40 GB read, 449.36 MB/s read, 34.5 seconds Interval compaction: 9.09 GB write, 766.71 MB/s write, 5.40 GB read, 455.99 MB/s read, 34.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1130204 Average: 2.3141 StdDev: 10.01 Min: 0 Median: 1.5503 Max: 4258 Percentiles: P50: 1.55 P75: 1.93 P99: 5.78 P99.9: 10.77 P99.99: 14.45 ------------------------------------------------------ [ 0, 1 ] 156239 13.824% 13.824% ### ( 1, 2 ] 742918 65.733% 79.557% ############# ( 2, 3 ] 138936 12.293% 91.850% ## ( 3, 4 ] 50329 4.453% 96.303% # ( 4, 6 ] 34249 3.030% 99.333% # ( 6, 10 ] 6192 0.548% 99.881% ( 10, 15 ] 1382 0.122% 100.004% ( 15, 22 ] 79 0.007% 100.011% ( 22, 34 ] 9 0.001% 100.011% ( 34, 51 ] 7 0.001% 100.012% ( 51, 76 ] 7 0.001% 100.013% ( 76, 110 ] 26 0.002% 100.015% ( 110, 170 ] 81 0.007% 100.022% ( 170, 250 ] 61 0.005% 100.028% ( 250, 380 ] 36 0.003% 100.031% ( 380, 580 ] 33 0.003% 100.034% ( 580, 870 ] 23 0.002% 100.036% ( 870, 1300 ] 22 0.002% 100.038% ( 1300, 1900 ] 4 0.000% 100.038% ( 1900, 2900 ] 2 0.000% 100.038% ( 2900, 4400 ] 3 0.000% 100.038% ** Level 1 read latency histogram (micros): Count: 237923 Average: 2.8873 StdDev: 12.60 Min: 1 Median: 1.7512 Max: 3032 Percentiles: P50: 1.75 P75: 2.56 P99: 8.07 P99.9: 13.23 P99.99: 14.86 ------------------------------------------------------ [ 0, 1 ] 13090 5.502% 5.502% # ( 1, 2 ] 140935 59.236% 64.737% ############ ( 2, 3 ] 43748 18.387% 83.125% #### ( 3, 4 ] 19108 8.031% 91.156% ## ( 4, 6 ] 16820 7.070% 98.225% # ( 6, 10 ] 3559 1.496% 99.721% ( 10, 15 ] 659 0.277% 99.998% ( 15, 22 ] 70 0.029% 100.028% ( 22, 34 ] 5 0.002% 100.030% ( 34, 51 ] 1 0.000% 100.030% ( 51, 76 ] 10 0.004% 100.034% ( 76, 110 ] 55 0.023% 100.058% ( 110, 170 ] 63 0.026% 100.084% ( 170, 250 ] 30 0.013% 100.097% ( 250, 380 ] 30 0.013% 100.109% ( 380, 580 ] 20 0.008% 100.118% ( 580, 870 ] 9 0.004% 100.121% ( 870, 1300 ] 7 0.003% 100.124% ( 1300, 1900 ] 3 0.001% 100.126% ( 2900, 4400 ] 1 0.000% 100.126% ** Level 2 read latency histogram (micros): Count: 124160 Average: 3.0035 StdDev: 38.44 Min: 1 Median: 1.5207 Max: 6789 Percentiles: P50: 1.52 P75: 1.94 P99: 7.17 P99.9: 112.52 P99.99: 2287.29 ------------------------------------------------------ [ 0, 1 ] 23223 18.704% 18.704% #### ( 1, 2 ] 74621 60.101% 78.805% ############ ( 2, 3 ] 14123 11.375% 90.180% ## ( 3, 4 ] 5855 4.716% 94.895% # ( 4, 6 ] 4739 3.817% 98.712% # ( 6, 10 ] 1221 0.983% 99.696% ( 10, 15 ] 201 0.162% 99.857% ( 15, 22 ] 13 0.010% 99.868% ( 22, 34 ] 5 0.004% 99.872% ( 51, 76 ] 3 0.002% 99.874% ( 76, 110 ] 31 0.025% 99.899% ( 110, 170 ] 20 0.016% 99.915% ( 170, 250 ] 20 0.016% 99.932% ( 250, 380 ] 23 0.019% 99.950% ( 380, 580 ] 18 0.014% 99.965% ( 580, 870 ] 19 0.015% 99.980% ( 870, 1300 ] 4 0.003% 99.983% ( 1300, 1900 ] 2 0.002% 99.985% ( 1900, 2900 ] 17 0.014% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255439 Average: 3.4678 StdDev: 36.79 Min: 0 Median: 1.6754 Max: 7321 Percentiles: P50: 1.68 P75: 2.29 P99: 8.91 P99.9: 193.62 P99.99: 554.50 ------------------------------------------------------ [ 0, 1 ] 21012 8.226% 8.226% ## ( 1, 2 ] 157998 61.854% 70.079% ############ ( 2, 3 ] 43697 17.107% 87.186% ### ( 3, 4 ] 15309 5.993% 93.179% # ( 4, 6 ] 11739 4.596% 97.775% # ( 6, 10 ] 4303 1.685% 99.459% ( 10, 15 ] 573 0.224% 99.684% ( 15, 22 ] 103 0.040% 99.724% ( 22, 34 ] 24 0.009% 99.733% ( 34, 51 ] 5 0.002% 99.735% ( 51, 76 ] 22 0.009% 99.744% ( 76, 110 ] 76 0.030% 99.774% ( 110, 170 ] 283 0.111% 99.885% ( 170, 250 ] 134 0.052% 99.937% ( 250, 380 ] 77 0.030% 99.967% ( 380, 580 ] 67 0.026% 99.993% ( 580, 870 ] 39 0.015% 100.009% ( 870, 1300 ] 22 0.009% 100.017% ( 1300, 1900 ] 9 0.004% 100.021% ( 1900, 2900 ] 8 0.003% 100.024% ( 2900, 4400 ] 5 0.002% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ( 6600, 9900 ] 2 0.001% 100.027% ** Level 4 read latency histogram (micros): Count: 315 Average: 140.8952 StdDev: 613.72 Min: 0 Median: 2.2719 Max: 5421 Percentiles: P50: 2.27 P75: 5.92 P99: 3968.75 P99.9: 5421.00 P99.99: 5421.00 ------------------------------------------------------ [ 0, 1 ] 42 13.333% 13.333% ### ( 1, 2 ] 100 31.746% 45.079% ###### ( 2, 3 ] 57 18.095% 63.175% #### ( 3, 4 ] 19 6.032% 69.206% # ( 4, 6 ] 19 6.032% 75.238% # ( 6, 10 ] 13 4.127% 79.365% # ( 10, 15 ] 15 4.762% 84.127% # ( 15, 22 ] 15 4.762% 88.889% # ( 22, 34 ] 6 1.905% 90.794% ( 110, 170 ] 1 0.317% 91.111% ( 170, 250 ] 3 0.952% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 7 2.222% 95.556% ( 870, 1300 ] 5 1.587% 97.143% ( 1300, 1900 ] 2 0.635% 97.778% ( 1900, 2900 ] 1 0.317% 98.095% ( 2900, 4400 ] 4 1.270% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 809.6000 StdDev: 1028.53 Min: 77 Median: 315.0000 Max: 4426 Percentiles: P50: 315.00 P75: 1385.71 P99: 4426.00 P99.9: 4426.00 P99.99: 4426.00 ------------------------------------------------------ ( 76, 110 ] 15 25.000% 25.000% ##### ( 110, 170 ] 6 10.000% 35.000% ## ( 170, 250 ] 5 8.333% 43.333% ## ( 250, 380 ] 8 13.333% 56.667% ### ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 2 3.333% 73.333% # ( 1300, 1900 ] 7 11.667% 85.000% ## ( 1900, 2900 ] 5 8.333% 93.333% ## ( 2900, 4400 ] 3 5.000% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 12.3 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 319.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.456 H:M:S, 11.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 317.66 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.419 H:M:S, 13.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/26-11:21:03 ... thread 0: (1000000,5000000) ops and (329123.3,329530.9) ops/second in (3.038375,15.173083) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 2.40 GB 50.4 2.7 0.0 2.7 7.4 4.7 0.0 1.6 114.5 312.2 24.21 22.36 77 0.314 2814K 2923 0.0 0.0 L1 12/12 1.22 GB 0.0 2.2 2.0 0.2 2.2 2.0 0.2 1.1 231.8 230.8 9.76 9.40 3 3.254 2297K 8813 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 252.9 252.7 1.49 1.44 2 0.747 383K 241 0.0 0.0 L3 23/0 941.35 MB 0.9 1.9 0.7 1.2 1.9 0.7 0.4 2.6 221.5 221.0 8.89 8.14 6 1.481 1998K 4144 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 151.8 151.8 1.48 1.09 1 1.478 227K 0 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1281/24 100.80 GB 0.0 7.4 3.2 4.3 12.1 7.8 3.3 2.6 165.9 270.1 45.83 42.43 89 0.515 7722K 16K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.4 3.2 4.3 12.1 7.8 3.2 2.6 165.9 270.1 45.83 42.43 89 0.515 7722K 16K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.4 3.2 4.3 7.4 3.2 0.0 0.0 236.7 236.2 32.12 30.35 22 1.460 7722K 16K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 349.4 13.70 12.08 67 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.4 total, 15.2 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.09 GB write, 806.06 MB/s write, 7.43 GB read, 495.31 MB/s read, 45.8 seconds Interval compaction: 12.09 GB write, 815.56 MB/s write, 7.43 GB read, 501.15 MB/s read, 45.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 20, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1403079 Average: 2.2864 StdDev: 9.73 Min: 0 Median: 1.5342 Max: 4258 Percentiles: P50: 1.53 P75: 1.91 P99: 5.72 P99.9: 10.60 P99.99: 14.72 ------------------------------------------------------ [ 0, 1 ] 205241 14.628% 14.628% ### ( 1, 2 ] 928984 66.210% 80.838% ############# ( 2, 3 ] 163665 11.665% 92.503% ## ( 3, 4 ] 58461 4.167% 96.670% # ( 4, 6 ] 37985 2.707% 99.377% # ( 6, 10 ] 7157 0.510% 99.887% ( 10, 15 ] 1532 0.109% 99.996% ( 15, 22 ] 92 0.007% 100.003% ( 22, 34 ] 11 0.001% 100.003% ( 34, 51 ] 7 0.000% 100.004% ( 51, 76 ] 9 0.001% 100.005% ( 76, 110 ] 54 0.004% 100.008% ( 110, 170 ] 127 0.009% 100.018% ( 170, 250 ] 79 0.006% 100.023% ( 250, 380 ] 50 0.004% 100.027% ( 380, 580 ] 48 0.003% 100.030% ( 580, 870 ] 31 0.002% 100.032% ( 870, 1300 ] 26 0.002% 100.034% ( 1300, 1900 ] 4 0.000% 100.034% ( 1900, 2900 ] 3 0.000% 100.035% ( 2900, 4400 ] 3 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 306056 Average: 2.8445 StdDev: 13.81 Min: 0 Median: 1.6819 Max: 3032 Percentiles: P50: 1.68 P75: 2.35 P99: 8.07 P99.9: 14.36 P99.99: 98.34 ------------------------------------------------------ [ 0, 1 ] 25906 8.464% 8.464% ## ( 1, 2 ] 186426 60.912% 69.377% ############ ( 2, 3 ] 49668 16.228% 85.605% ### ( 3, 4 ] 20860 6.816% 92.421% # ( 4, 6 ] 17849 5.832% 98.253% # ( 6, 10 ] 4425 1.446% 99.699% ( 10, 15 ] 707 0.231% 99.930% ( 15, 22 ] 74 0.024% 99.954% ( 22, 34 ] 6 0.002% 99.956% ( 34, 51 ] 1 0.000% 99.956% ( 51, 76 ] 17 0.006% 99.962% ( 76, 110 ] 133 0.043% 100.005% ( 110, 170 ] 134 0.044% 100.049% ( 170, 250 ] 44 0.014% 100.063% ( 250, 380 ] 40 0.013% 100.076% ( 380, 580 ] 31 0.010% 100.087% ( 580, 870 ] 17 0.006% 100.092% ( 870, 1300 ] 11 0.004% 100.096% ( 1300, 1900 ] 6 0.002% 100.098% ( 2900, 4400 ] 1 0.000% 100.098% ** Level 2 read latency histogram (micros): Count: 124160 Average: 3.0035 StdDev: 38.44 Min: 1 Median: 1.5207 Max: 6789 Percentiles: P50: 1.52 P75: 1.94 P99: 7.17 P99.9: 112.52 P99.99: 2287.29 ------------------------------------------------------ [ 0, 1 ] 23223 18.704% 18.704% #### ( 1, 2 ] 74621 60.101% 78.805% ############ ( 2, 3 ] 14123 11.375% 90.180% ## ( 3, 4 ] 5855 4.716% 94.895% # ( 4, 6 ] 4739 3.817% 98.712% # ( 6, 10 ] 1221 0.983% 99.696% ( 10, 15 ] 201 0.162% 99.857% ( 15, 22 ] 13 0.010% 99.868% ( 22, 34 ] 5 0.004% 99.872% ( 51, 76 ] 3 0.002% 99.874% ( 76, 110 ] 31 0.025% 99.899% ( 110, 170 ] 20 0.016% 99.915% ( 170, 250 ] 20 0.016% 99.932% ( 250, 380 ] 23 0.019% 99.950% ( 380, 580 ] 18 0.014% 99.965% ( 580, 870 ] 19 0.015% 99.980% ( 870, 1300 ] 4 0.003% 99.983% ( 1300, 1900 ] 2 0.002% 99.985% ( 1900, 2900 ] 17 0.014% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255439 Average: 3.4678 StdDev: 36.79 Min: 0 Median: 1.6754 Max: 7321 Percentiles: P50: 1.68 P75: 2.29 P99: 8.91 P99.9: 193.62 P99.99: 554.50 ------------------------------------------------------ [ 0, 1 ] 21012 8.226% 8.226% ## ( 1, 2 ] 157998 61.854% 70.079% ############ ( 2, 3 ] 43697 17.107% 87.186% ### ( 3, 4 ] 15309 5.993% 93.179% # ( 4, 6 ] 11739 4.596% 97.775% # ( 6, 10 ] 4303 1.685% 99.459% ( 10, 15 ] 573 0.224% 99.684% ( 15, 22 ] 103 0.040% 99.724% ( 22, 34 ] 24 0.009% 99.733% ( 34, 51 ] 5 0.002% 99.735% ( 51, 76 ] 22 0.009% 99.744% ( 76, 110 ] 76 0.030% 99.774% ( 110, 170 ] 283 0.111% 99.885% ( 170, 250 ] 134 0.052% 99.937% ( 250, 380 ] 77 0.030% 99.967% ( 380, 580 ] 67 0.026% 99.993% ( 580, 870 ] 39 0.015% 100.009% ( 870, 1300 ] 22 0.009% 100.017% ( 1300, 1900 ] 9 0.004% 100.021% ( 1900, 2900 ] 8 0.003% 100.024% ( 2900, 4400 ] 5 0.002% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ( 6600, 9900 ] 2 0.001% 100.027% ** Level 4 read latency histogram (micros): Count: 315 Average: 140.8952 StdDev: 613.72 Min: 0 Median: 2.2719 Max: 5421 Percentiles: P50: 2.27 P75: 5.92 P99: 3968.75 P99.9: 5421.00 P99.99: 5421.00 ------------------------------------------------------ [ 0, 1 ] 42 13.333% 13.333% ### ( 1, 2 ] 100 31.746% 45.079% ###### ( 2, 3 ] 57 18.095% 63.175% #### ( 3, 4 ] 19 6.032% 69.206% # ( 4, 6 ] 19 6.032% 75.238% # ( 6, 10 ] 13 4.127% 79.365% # ( 10, 15 ] 15 4.762% 84.127% # ( 15, 22 ] 15 4.762% 88.889% # ( 22, 34 ] 6 1.905% 90.794% ( 110, 170 ] 1 0.317% 91.111% ( 170, 250 ] 3 0.952% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 7 2.222% 95.556% ( 870, 1300 ] 5 1.587% 97.143% ( 1300, 1900 ] 2 0.635% 97.778% ( 1900, 2900 ] 1 0.317% 98.095% ( 2900, 4400 ] 4 1.270% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 809.6000 StdDev: 1028.53 Min: 77 Median: 315.0000 Max: 4426 Percentiles: P50: 315.00 P75: 1385.71 P99: 4426.00 P99.9: 4426.00 P99.99: 4426.00 ------------------------------------------------------ ( 76, 110 ] 15 25.000% 25.000% ##### ( 110, 170 ] 6 10.000% 35.000% ## ( 170, 250 ] 5 8.333% 43.333% ## ( 250, 380 ] 8 13.333% 56.667% ### ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 2 3.333% 73.333% # ( 1300, 1900 ] 7 11.667% 85.000% ## ( 1900, 2900 ] 5 8.333% 93.333% ## ( 2900, 4400 ] 3 5.000% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 15.4 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 320.50 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.864 H:M:S, 12.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.92 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.408 H:M:S, 13.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-11:21:06 ... thread 0: (1000000,6000000) ops and (277709.9,319591.6) ops/second in (3.600880,18.773963) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/8 3.44 GB 182.5 3.8 0.0 3.8 9.5 5.7 0.0 1.7 123.2 311.0 31.18 28.94 95 0.328 3901K 4012 0.0 0.0 L1 12/12 1.22 GB 0.0 2.2 2.0 0.2 2.2 2.0 0.2 1.1 231.8 230.8 9.76 9.40 3 3.254 2297K 8813 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 0.9 2.0 252.9 252.7 1.49 1.44 2 0.747 383K 241 0.0 0.0 L3 23/0 941.35 MB 0.9 1.9 0.7 1.2 1.9 0.7 0.4 2.6 221.5 221.0 8.89 8.14 6 1.481 1998K 4144 0.0 0.0 L4 174/0 9.52 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 151.8 151.8 1.48 1.09 1 1.478 227K 0 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1283/20 101.84 GB 0.0 8.5 3.2 5.3 14.2 8.9 3.3 2.5 164.3 274.9 52.80 49.01 107 0.494 8809K 17K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.5 3.2 5.3 14.2 8.9 3.2 2.5 164.3 274.9 52.80 49.01 107 0.494 8809K 17K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.5 3.2 5.3 8.5 3.2 0.0 0.0 240.5 240.0 36.08 34.23 26 1.388 8809K 17K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 350.3 16.73 14.79 81 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.0 total, 18.8 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.18 GB write, 765.87 MB/s write, 8.47 GB read, 457.72 MB/s read, 52.8 seconds Interval compaction: 14.18 GB write, 773.17 MB/s write, 8.47 GB read, 462.08 MB/s read, 52.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 23, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1773280 Average: 2.2742 StdDev: 9.75 Min: 0 Median: 1.5244 Max: 4258 Percentiles: P50: 1.52 P75: 1.90 P99: 5.70 P99.9: 10.82 P99.99: 14.97 ------------------------------------------------------ [ 0, 1 ] 266475 15.027% 15.027% ### ( 1, 2 ] 1182639 66.692% 81.719% ############# ( 2, 3 ] 199297 11.239% 92.958% ## ( 3, 4 ] 69887 3.941% 96.899% # ( 4, 6 ] 43722 2.466% 99.365% ( 6, 10 ] 9171 0.517% 99.882% ( 10, 15 ] 1925 0.109% 99.991% ( 15, 22 ] 119 0.007% 99.997% ( 22, 34 ] 15 0.001% 99.998% ( 34, 51 ] 8 0.000% 99.999% ( 51, 76 ] 14 0.001% 100.000% ( 76, 110 ] 80 0.005% 100.004% ( 110, 170 ] 188 0.011% 100.015% ( 170, 250 ] 110 0.006% 100.021% ( 250, 380 ] 66 0.004% 100.025% ( 380, 580 ] 68 0.004% 100.028% ( 580, 870 ] 40 0.002% 100.031% ( 870, 1300 ] 34 0.002% 100.033% ( 1300, 1900 ] 6 0.000% 100.033% ( 1900, 2900 ] 5 0.000% 100.033% ( 2900, 4400 ] 3 0.000% 100.033% ** Level 1 read latency histogram (micros): Count: 385509 Average: 2.8080 StdDev: 13.61 Min: 0 Median: 1.6462 Max: 3032 Percentiles: P50: 1.65 P75: 2.19 P99: 8.09 P99.9: 17.77 P99.99: 135.47 ------------------------------------------------------ [ 0, 1 ] 37359 9.691% 9.691% ## ( 1, 2 ] 240486 62.381% 72.072% ############ ( 2, 3 ] 58217 15.101% 87.174% ### ( 3, 4 ] 23269 6.036% 93.209% # ( 4, 6 ] 19428 5.040% 98.249% # ( 6, 10 ] 5532 1.435% 99.684% ( 10, 15 ] 800 0.208% 99.892% ( 15, 22 ] 82 0.021% 99.913% ( 22, 34 ] 6 0.002% 99.914% ( 34, 51 ] 1 0.000% 99.915% ( 51, 76 ] 20 0.005% 99.920% ( 76, 110 ] 183 0.047% 99.967% ( 110, 170 ] 206 0.053% 100.021% ( 170, 250 ] 65 0.017% 100.038% ( 250, 380 ] 62 0.016% 100.054% ( 380, 580 ] 54 0.014% 100.068% ( 580, 870 ] 18 0.005% 100.072% ( 870, 1300 ] 12 0.003% 100.075% ( 1300, 1900 ] 7 0.002% 100.077% ( 2900, 4400 ] 1 0.000% 100.078% ** Level 2 read latency histogram (micros): Count: 124160 Average: 3.0035 StdDev: 38.44 Min: 1 Median: 1.5207 Max: 6789 Percentiles: P50: 1.52 P75: 1.94 P99: 7.17 P99.9: 112.52 P99.99: 2287.29 ------------------------------------------------------ [ 0, 1 ] 23223 18.704% 18.704% #### ( 1, 2 ] 74621 60.101% 78.805% ############ ( 2, 3 ] 14123 11.375% 90.180% ## ( 3, 4 ] 5855 4.716% 94.895% # ( 4, 6 ] 4739 3.817% 98.712% # ( 6, 10 ] 1221 0.983% 99.696% ( 10, 15 ] 201 0.162% 99.857% ( 15, 22 ] 13 0.010% 99.868% ( 22, 34 ] 5 0.004% 99.872% ( 51, 76 ] 3 0.002% 99.874% ( 76, 110 ] 31 0.025% 99.899% ( 110, 170 ] 20 0.016% 99.915% ( 170, 250 ] 20 0.016% 99.932% ( 250, 380 ] 23 0.019% 99.950% ( 380, 580 ] 18 0.014% 99.965% ( 580, 870 ] 19 0.015% 99.980% ( 870, 1300 ] 4 0.003% 99.983% ( 1300, 1900 ] 2 0.002% 99.985% ( 1900, 2900 ] 17 0.014% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 255439 Average: 3.4678 StdDev: 36.79 Min: 0 Median: 1.6754 Max: 7321 Percentiles: P50: 1.68 P75: 2.29 P99: 8.91 P99.9: 193.62 P99.99: 554.50 ------------------------------------------------------ [ 0, 1 ] 21012 8.226% 8.226% ## ( 1, 2 ] 157998 61.854% 70.079% ############ ( 2, 3 ] 43697 17.107% 87.186% ### ( 3, 4 ] 15309 5.993% 93.179% # ( 4, 6 ] 11739 4.596% 97.775% # ( 6, 10 ] 4303 1.685% 99.459% ( 10, 15 ] 573 0.224% 99.684% ( 15, 22 ] 103 0.040% 99.724% ( 22, 34 ] 24 0.009% 99.733% ( 34, 51 ] 5 0.002% 99.735% ( 51, 76 ] 22 0.009% 99.744% ( 76, 110 ] 76 0.030% 99.774% ( 110, 170 ] 283 0.111% 99.885% ( 170, 250 ] 134 0.052% 99.937% ( 250, 380 ] 77 0.030% 99.967% ( 380, 580 ] 67 0.026% 99.993% ( 580, 870 ] 39 0.015% 100.009% ( 870, 1300 ] 22 0.009% 100.017% ( 1300, 1900 ] 9 0.004% 100.021% ( 1900, 2900 ] 8 0.003% 100.024% ( 2900, 4400 ] 5 0.002% 100.026% ( 4400, 6600 ] 1 0.000% 100.026% ( 6600, 9900 ] 2 0.001% 100.027% ** Level 4 read latency histogram (micros): Count: 315 Average: 140.8952 StdDev: 613.72 Min: 0 Median: 2.2719 Max: 5421 Percentiles: P50: 2.27 P75: 5.92 P99: 3968.75 P99.9: 5421.00 P99.99: 5421.00 ------------------------------------------------------ [ 0, 1 ] 42 13.333% 13.333% ### ( 1, 2 ] 100 31.746% 45.079% ###### ( 2, 3 ] 57 18.095% 63.175% #### ( 3, 4 ] 19 6.032% 69.206% # ( 4, 6 ] 19 6.032% 75.238% # ( 6, 10 ] 13 4.127% 79.365% # ( 10, 15 ] 15 4.762% 84.127% # ( 15, 22 ] 15 4.762% 88.889% # ( 22, 34 ] 6 1.905% 90.794% ( 110, 170 ] 1 0.317% 91.111% ( 170, 250 ] 3 0.952% 92.063% ( 250, 380 ] 1 0.317% 92.381% ( 380, 580 ] 3 0.952% 93.333% ( 580, 870 ] 7 2.222% 95.556% ( 870, 1300 ] 5 1.587% 97.143% ( 1300, 1900 ] 2 0.635% 97.778% ( 1900, 2900 ] 1 0.317% 98.095% ( 2900, 4400 ] 4 1.270% 99.365% ( 4400, 6600 ] 2 0.635% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 809.6000 StdDev: 1028.53 Min: 77 Median: 315.0000 Max: 4426 Percentiles: P50: 315.00 P75: 1385.71 P99: 4426.00 P99.9: 4426.00 P99.99: 4426.00 ------------------------------------------------------ ( 76, 110 ] 15 25.000% 25.000% ##### ( 110, 170 ] 6 10.000% 35.000% ## ( 170, 250 ] 5 8.333% 43.333% ## ( 250, 380 ] 8 13.333% 56.667% ### ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 2 3.333% 73.333% # ( 1300, 1900 ] 7 11.667% 85.000% ## ( 1900, 2900 ] 5 8.333% 93.333% ## ( 2900, 4400 ] 3 5.000% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 19.0 total, 3.6 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 311.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.803 H:M:S, 14.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 273.32 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.939 H:M:S, 26.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/07/26-11:21:17 ... thread 0: (1000000,7000000) ops and (92100.3,236233.5) ops/second in (10.857731,29.631694) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 2.70 GB 31.5 5.5 0.0 5.5 12.2 6.6 0.0 1.8 132.3 290.8 42.85 38.11 111 0.386 5755K 11K 0.0 0.0 L1 12/12 743.88 MB 0.0 5.1 3.7 1.4 5.0 3.6 0.2 1.4 224.6 222.7 23.19 21.75 4 5.797 5287K 43K 0.0 0.0 L2 6/6 605.15 MB 0.0 0.4 0.2 0.2 0.4 0.2 3.0 2.0 252.9 252.7 1.49 1.44 2 0.747 383K 241 0.0 0.0 L3 40/11 1.78 GB 1.2 4.0 2.3 1.7 4.0 2.2 0.4 1.8 151.5 150.7 27.09 18.20 16 1.693 4167K 20K 0.0 0.0 L4 186/6 10.17 GB 1.0 0.8 0.8 0.0 0.8 0.8 0.8 1.0 127.7 127.5 6.52 3.91 11 0.593 837K 1170 0.0 0.0 L5 1056/0 86.74 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1312/44 102.71 GB 0.0 15.8 6.9 8.9 22.4 13.5 5.5 3.4 160.1 226.6 101.14 83.42 144 0.702 16M 75K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.8 6.9 8.9 22.4 13.5 5.4 3.4 160.1 226.6 101.14 83.42 144 0.702 16M 75K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.8 6.9 8.9 15.7 6.8 0.0 0.0 202.4 201.5 79.97 66.14 50 1.599 16M 75K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 321.4 21.17 17.28 94 0.225 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.8 total, 29.6 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.38 GB write, 768.69 MB/s write, 15.81 GB read, 543.04 MB/s read, 101.1 seconds Interval compaction: 22.38 GB write, 773.33 MB/s write, 15.81 GB read, 546.32 MB/s read, 101.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 42, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 42, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2531361 Average: 2.9028 StdDev: 36.14 Min: 0 Median: 1.5192 Max: 25844 Percentiles: P50: 1.52 P75: 1.90 P99: 6.44 P99.9: 141.47 P99.99: 398.25 ------------------------------------------------------ [ 0, 1 ] 395605 15.628% 15.628% ### ( 1, 2 ] 1675901 66.206% 81.834% ############# ( 2, 3 ] 274231 10.833% 92.667% ## ( 3, 4 ] 95550 3.775% 96.442% # ( 4, 6 ] 62837 2.482% 98.924% ( 6, 10 ] 17442 0.689% 99.613% ( 10, 15 ] 2864 0.113% 99.726% ( 15, 22 ] 267 0.011% 99.737% ( 22, 34 ] 34 0.001% 99.738% ( 34, 51 ] 19 0.001% 99.739% ( 51, 76 ] 73 0.003% 99.742% ( 76, 110 ] 2777 0.110% 99.851% ( 110, 170 ] 2346 0.093% 99.944% ( 170, 250 ] 689 0.027% 99.971% ( 250, 380 ] 436 0.017% 99.989% ( 380, 580 ] 415 0.016% 100.005% ( 580, 870 ] 237 0.009% 100.014% ( 870, 1300 ] 157 0.006% 100.021% ( 1300, 1900 ] 48 0.002% 100.022% ( 1900, 2900 ] 37 0.001% 100.024% ( 2900, 4400 ] 57 0.002% 100.026% ( 4400, 6600 ] 19 0.001% 100.027% ( 6600, 9900 ] 1 0.000% 100.027% ( 14000, 22000 ] 1 0.000% 100.027% ( 22000, 33000 ] 1 0.000% 100.027% ** Level 1 read latency histogram (micros): Count: 1060369 Average: 7.2149 StdDev: 133.59 Min: 0 Median: 1.7526 Max: 29857 Percentiles: P50: 1.75 P75: 2.59 P99: 9.20 P99.9: 198.51 P99.99: 582.32 ------------------------------------------------------ [ 0, 1 ] 73134 6.897% 6.897% # ( 1, 2 ] 607293 57.272% 64.169% ########### ( 2, 3 ] 193673 18.265% 82.434% #### ( 3, 4 ] 81533 7.689% 90.123% ## ( 4, 6 ] 77018 7.263% 97.386% # ( 6, 10 ] 21372 2.016% 99.402% ( 10, 15 ] 3330 0.314% 99.716% ( 15, 22 ] 421 0.040% 99.755% ( 22, 34 ] 36 0.003% 99.759% ( 34, 51 ] 12 0.001% 99.760% ( 51, 76 ] 41 0.004% 99.764% ( 76, 110 ] 722 0.068% 99.832% ( 110, 170 ] 621 0.059% 99.890% ( 170, 250 ] 288 0.027% 99.917% ( 250, 380 ] 352 0.033% 99.951% ( 380, 580 ] 414 0.039% 99.990% ( 580, 870 ] 371 0.035% 100.025% ( 870, 1300 ] 282 0.027% 100.051% ( 1300, 1900 ] 139 0.013% 100.064% ( 1900, 2900 ] 223 0.021% 100.085% ( 2900, 4400 ] 464 0.044% 100.129% ( 4400, 6600 ] 167 0.016% 100.145% ( 6600, 9900 ] 46 0.004% 100.149% ( 9900, 14000 ] 1 0.000% 100.149% ( 14000, 22000 ] 1 0.000% 100.149% ( 22000, 33000 ] 4 0.000% 100.150% ** Level 2 read latency histogram (micros): Count: 124160 Average: 3.0035 StdDev: 38.44 Min: 1 Median: 1.5207 Max: 6789 Percentiles: P50: 1.52 P75: 1.94 P99: 7.17 P99.9: 112.52 P99.99: 2287.29 ------------------------------------------------------ [ 0, 1 ] 23223 18.704% 18.704% #### ( 1, 2 ] 74621 60.101% 78.805% ############ ( 2, 3 ] 14123 11.375% 90.180% ## ( 3, 4 ] 5855 4.716% 94.895% # ( 4, 6 ] 4739 3.817% 98.712% # ( 6, 10 ] 1221 0.983% 99.696% ( 10, 15 ] 201 0.162% 99.857% ( 15, 22 ] 13 0.010% 99.868% ( 22, 34 ] 5 0.004% 99.872% ( 51, 76 ] 3 0.002% 99.874% ( 76, 110 ] 31 0.025% 99.899% ( 110, 170 ] 20 0.016% 99.915% ( 170, 250 ] 20 0.016% 99.932% ( 250, 380 ] 23 0.019% 99.950% ( 380, 580 ] 18 0.014% 99.965% ( 580, 870 ] 19 0.015% 99.980% ( 870, 1300 ] 4 0.003% 99.983% ( 1300, 1900 ] 2 0.002% 99.985% ( 1900, 2900 ] 17 0.014% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 592368 Average: 4.7079 StdDev: 90.22 Min: 0 Median: 1.8483 Max: 24145 Percentiles: P50: 1.85 P75: 2.79 P99: 9.12 P99.9: 133.86 P99.99: 246.18 ------------------------------------------------------ [ 0, 1 ] 25868 4.367% 4.367% # ( 1, 2 ] 318659 53.794% 58.161% ########### ( 2, 3 ] 125582 21.200% 79.361% #### ( 3, 4 ] 54664 9.228% 88.589% ## ( 4, 6 ] 52183 8.809% 97.398% ## ( 6, 10 ] 12155 2.052% 99.450% ( 10, 15 ] 2080 0.351% 99.801% ( 15, 22 ] 262 0.044% 99.846% ( 22, 34 ] 37 0.006% 99.852% ( 34, 51 ] 11 0.002% 99.854% ( 51, 76 ] 22 0.004% 99.857% ( 76, 110 ] 89 0.015% 99.872% ( 110, 170 ] 414 0.070% 99.942% ( 170, 250 ] 298 0.050% 99.993% ( 250, 380 ] 223 0.038% 100.030% ( 380, 580 ] 229 0.039% 100.069% ( 580, 870 ] 160 0.027% 100.096% ( 870, 1300 ] 112 0.019% 100.115% ( 1300, 1900 ] 47 0.008% 100.123% ( 1900, 2900 ] 39 0.007% 100.129% ( 2900, 4400 ] 50 0.008% 100.138% ( 4400, 6600 ] 13 0.002% 100.140% ( 6600, 9900 ] 5 0.001% 100.141% ( 9900, 14000 ] 2 0.000% 100.141% ( 14000, 22000 ] 4 0.001% 100.142% ( 22000, 33000 ] 2 0.000% 100.142% ** Level 4 read latency histogram (micros): Count: 10610 Average: 101.6529 StdDev: 433.12 Min: 0 Median: 2.1094 Max: 6995 Percentiles: P50: 2.11 P75: 3.50 P99: 2361.19 P99.9: 4471.50 P99.99: 6222.15 ------------------------------------------------------ [ 0, 1 ] 246 2.319% 2.319% ( 1, 2 ] 4809 45.325% 47.644% ######### ( 2, 3 ] 2286 21.546% 69.189% #### ( 3, 4 ] 1238 11.668% 80.858% ## ( 4, 6 ] 756 7.125% 87.983% # ( 6, 10 ] 241 2.271% 90.254% ( 10, 15 ] 60 0.566% 90.820% ( 15, 22 ] 23 0.217% 91.037% ( 22, 34 ] 7 0.066% 91.103% ( 76, 110 ] 7 0.066% 91.169% ( 110, 170 ] 15 0.141% 91.310% ( 170, 250 ] 43 0.405% 91.715% ( 250, 380 ] 90 0.848% 92.564% ( 380, 580 ] 148 1.395% 93.959% ( 580, 870 ] 236 2.224% 96.183% ( 870, 1300 ] 172 1.621% 97.804% ( 1300, 1900 ] 96 0.905% 98.709% ( 1900, 2900 ] 67 0.631% 99.340% ( 2900, 4400 ] 59 0.556% 99.896% ( 4400, 6600 ] 12 0.113% 100.009% ( 6600, 9900 ] 2 0.019% 100.028% ** Level 5 read latency histogram (micros): Count: 60 Average: 809.6000 StdDev: 1028.53 Min: 77 Median: 315.0000 Max: 4426 Percentiles: P50: 315.00 P75: 1385.71 P99: 4426.00 P99.9: 4426.00 P99.99: 4426.00 ------------------------------------------------------ ( 76, 110 ] 15 25.000% 25.000% ##### ( 110, 170 ] 6 10.000% 35.000% ## ( 170, 250 ] 5 8.333% 43.333% ## ( 250, 380 ] 8 13.333% 56.667% ### ( 380, 580 ] 6 10.000% 66.667% ## ( 580, 870 ] 2 3.333% 70.000% # ( 870, 1300 ] 2 3.333% 73.333% # ( 1300, 1900 ] 7 11.667% 85.000% ## ( 1900, 2900 ] 5 8.333% 93.333% ## ( 2900, 4400 ] 3 5.000% 98.333% # ( 4400, 6600 ] 1 1.667% 100.000% ** DB Stats ** Uptime(secs): 29.8 total, 10.9 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 231.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.548 H:M:S, 35.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 90.64 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.745 H:M:S, 71.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/07/26-11:21:21 ... thread 0: (1000000,8000000) ops and (242812.5,237036.3) ops/second in (4.118404,33.750098) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/13 3.68 GB 100.7 6.5 0.0 6.5 14.1 7.6 0.0 1.9 131.7 285.5 50.71 44.52 127 0.399 6779K 12K 0.0 0.0 L1 12/12 743.88 MB 0.0 5.1 3.7 1.4 5.0 3.6 0.2 1.4 224.6 222.7 23.19 21.75 4 5.797 5287K 43K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.0 2.0 252.9 252.7 1.49 1.44 2 0.747 383K 241 0.0 0.0 L3 25/0 981.20 MB 1.0 4.8 2.9 2.0 4.8 2.8 0.4 1.7 147.1 146.4 33.68 22.11 19 1.773 5031K 24K 0.0 0.0 L4 187/0 9.61 GB 1.0 2.3 2.2 0.1 2.3 2.2 0.8 1.1 129.8 129.5 18.27 10.99 36 0.507 2337K 2579 0.0 0.0 L5 1080/0 88.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1320/25 103.68 GB 0.0 19.1 8.9 10.2 26.7 16.5 7.4 3.5 153.8 214.5 127.34 100.82 188 0.677 19M 83K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.1 8.9 10.2 26.7 16.5 7.3 3.5 153.8 214.5 127.34 100.82 188 0.677 19M 83K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.1 8.9 10.2 19.0 8.8 0.0 0.0 191.3 190.4 102.40 80.96 81 1.264 19M 83K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 313.2 24.94 19.86 107 0.233 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 33.9 total, 33.8 interval Flush(GB): cumulative 7.628, interval 7.628 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.67 GB write, 804.93 MB/s write, 19.13 GB read, 577.25 MB/s read, 127.3 seconds Interval compaction: 26.67 GB write, 809.19 MB/s write, 19.13 GB read, 580.31 MB/s read, 127.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 65, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 65, interval: 75 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2987647 Average: 3.0269 StdDev: 40.34 Min: 0 Median: 1.5402 Max: 25844 Percentiles: P50: 1.54 P75: 1.92 P99: 6.76 P99.9: 133.20 P99.99: 401.24 ------------------------------------------------------ [ 0, 1 ] 435448 14.575% 14.575% ### ( 1, 2 ] 1959289 65.580% 80.155% ############# ( 2, 3 ] 348323 11.659% 91.813% ## ( 3, 4 ] 122940 4.115% 95.928% # ( 4, 6 ] 87259 2.921% 98.849% # ( 6, 10 ] 23612 0.790% 99.639% ( 10, 15 ] 3616 0.121% 99.760% ( 15, 22 ] 332 0.011% 99.771% ( 22, 34 ] 42 0.001% 99.773% ( 34, 51 ] 22 0.001% 99.774% ( 51, 76 ] 79 0.003% 99.776% ( 76, 110 ] 2783 0.093% 99.869% ( 110, 170 ] 2367 0.079% 99.949% ( 170, 250 ] 708 0.024% 99.972% ( 250, 380 ] 479 0.016% 99.988% ( 380, 580 ] 473 0.016% 100.004% ( 580, 870 ] 304 0.010% 100.014% ( 870, 1300 ] 207 0.007% 100.021% ( 1300, 1900 ] 98 0.003% 100.025% ( 1900, 2900 ] 82 0.003% 100.027% ( 2900, 4400 ] 102 0.003% 100.031% ( 4400, 6600 ] 29 0.001% 100.032% ( 6600, 9900 ] 4 0.000% 100.032% ( 14000, 22000 ] 1 0.000% 100.032% ( 22000, 33000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 1119105 Average: 7.4428 StdDev: 136.95 Min: 0 Median: 1.7634 Max: 29857 Percentiles: P50: 1.76 P75: 2.62 P99: 9.23 P99.9: 236.29 P99.99: 670.92 ------------------------------------------------------ [ 0, 1 ] 73884 6.602% 6.602% # ( 1, 2 ] 636170 56.846% 63.448% ########### ( 2, 3 ] 207052 18.502% 81.950% #### ( 3, 4 ] 88493 7.907% 89.857% ## ( 4, 6 ] 83849 7.493% 97.350% # ( 6, 10 ] 22876 2.044% 99.394% ( 10, 15 ] 3512 0.314% 99.708% ( 15, 22 ] 444 0.040% 99.748% ( 22, 34 ] 40 0.004% 99.751% ( 34, 51 ] 14 0.001% 99.752% ( 51, 76 ] 43 0.004% 99.756% ( 76, 110 ] 724 0.065% 99.821% ( 110, 170 ] 633 0.057% 99.877% ( 170, 250 ] 304 0.027% 99.905% ( 250, 380 ] 378 0.034% 99.938% ( 380, 580 ] 452 0.040% 99.979% ( 580, 870 ] 399 0.036% 100.014% ( 870, 1300 ] 299 0.027% 100.041% ( 1300, 1900 ] 153 0.014% 100.055% ( 1900, 2900 ] 253 0.023% 100.077% ( 2900, 4400 ] 509 0.045% 100.123% ( 4400, 6600 ] 182 0.016% 100.139% ( 6600, 9900 ] 57 0.005% 100.144% ( 9900, 14000 ] 2 0.000% 100.144% ( 14000, 22000 ] 1 0.000% 100.145% ( 22000, 33000 ] 4 0.000% 100.145% ** Level 2 read latency histogram (micros): Count: 124160 Average: 3.0035 StdDev: 38.44 Min: 1 Median: 1.5207 Max: 6789 Percentiles: P50: 1.52 P75: 1.94 P99: 7.17 P99.9: 112.52 P99.99: 2287.29 ------------------------------------------------------ [ 0, 1 ] 23223 18.704% 18.704% #### ( 1, 2 ] 74621 60.101% 78.805% ############ ( 2, 3 ] 14123 11.375% 90.180% ## ( 3, 4 ] 5855 4.716% 94.895% # ( 4, 6 ] 4739 3.817% 98.712% # ( 6, 10 ] 1221 0.983% 99.696% ( 10, 15 ] 201 0.162% 99.857% ( 15, 22 ] 13 0.010% 99.868% ( 22, 34 ] 5 0.004% 99.872% ( 51, 76 ] 3 0.002% 99.874% ( 76, 110 ] 31 0.025% 99.899% ( 110, 170 ] 20 0.016% 99.915% ( 170, 250 ] 20 0.016% 99.932% ( 250, 380 ] 23 0.019% 99.950% ( 380, 580 ] 18 0.014% 99.965% ( 580, 870 ] 19 0.015% 99.980% ( 870, 1300 ] 4 0.003% 99.983% ( 1300, 1900 ] 2 0.002% 99.985% ( 1900, 2900 ] 17 0.014% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 970867 Average: 5.0134 StdDev: 85.57 Min: 0 Median: 1.8948 Max: 24145 Percentiles: P50: 1.89 P75: 2.88 P99: 8.76 P99.9: 14.99 P99.99: 156.19 ------------------------------------------------------ [ 0, 1 ] 30056 3.096% 3.096% # ( 1, 2 ] 508902 52.417% 55.513% ########## ( 2, 3 ] 215348 22.181% 77.694% #### ( 3, 4 ] 99901 10.290% 87.984% ## ( 4, 6 ] 94211 9.704% 97.688% ## ( 6, 10 ] 18460 1.901% 99.589% ( 10, 15 ] 3026 0.312% 99.901% ( 15, 22 ] 340 0.035% 99.936% ( 22, 34 ] 54 0.006% 99.941% ( 34, 51 ] 19 0.002% 99.943% ( 51, 76 ] 23 0.002% 99.946% ( 76, 110 ] 95 0.010% 99.956% ( 110, 170 ] 435 0.045% 100.000% ( 170, 250 ] 338 0.035% 100.035% ( 250, 380 ] 274 0.028% 100.063% ( 380, 580 ] 323 0.033% 100.097% ( 580, 870 ] 294 0.030% 100.127% ( 870, 1300 ] 241 0.025% 100.152% ( 1300, 1900 ] 133 0.014% 100.165% ( 1900, 2900 ] 119 0.012% 100.178% ( 2900, 4400 ] 122 0.013% 100.190% ( 4400, 6600 ] 28 0.003% 100.193% ( 6600, 9900 ] 7 0.001% 100.194% ( 9900, 14000 ] 2 0.000% 100.194% ( 14000, 22000 ] 4 0.000% 100.194% ( 22000, 33000 ] 2 0.000% 100.195% ** Level 4 read latency histogram (micros): Count: 35101 Average: 86.6000 StdDev: 428.94 Min: 0 Median: 1.9689 Max: 7385 Percentiles: P50: 1.97 P75: 3.21 P99: 2407.72 P99.9: 5024.04 P99.99: 6442.40 ------------------------------------------------------ [ 0, 1 ] 936 2.667% 2.667% # ( 1, 2 ] 17148 48.853% 51.520% ########## ( 2, 3 ] 7384 21.036% 72.556% #### ( 3, 4 ] 4099 11.678% 84.234% ## ( 4, 6 ] 2260 6.439% 90.673% # ( 6, 10 ] 768 2.188% 92.861% ( 10, 15 ] 121 0.345% 93.205% ( 15, 22 ] 32 0.091% 93.296% ( 22, 34 ] 8 0.023% 93.319% ( 76, 110 ] 14 0.040% 93.359% ( 110, 170 ] 36 0.103% 93.462% ( 170, 250 ] 112 0.319% 93.781% ( 250, 380 ] 199 0.567% 94.348% ( 380, 580 ] 358 1.020% 95.368% ( 580, 870 ] 497 1.416% 96.784% ( 870, 1300 ] 414 1.179% 97.963% ( 1300, 1900 ] 266 0.758% 98.721% ( 1900, 2900 ] 193 0.550% 99.271% ( 2900, 4400 ] 207 0.590% 99.860% ( 4400, 6600 ] 49 0.140% 100.000% ( 6600, 9900 ] 5 0.014% 100.014% ** Level 5 read latency histogram (micros): Count: 180 Average: 1368.1111 StdDev: 1387.20 Min: 77 Median: 682.3529 Max: 5992 Percentiles: P50: 682.35 P75: 2291.30 P99: 5992.00 P99.9: 5992.00 P99.99: 5992.00 ------------------------------------------------------ ( 76, 110 ] 16 8.889% 8.889% ## ( 110, 170 ] 6 3.333% 12.222% # ( 170, 250 ] 15 8.333% 20.556% ## ( 250, 380 ] 20 11.111% 31.667% ## ( 380, 580 ] 27 15.000% 46.667% ### ( 580, 870 ] 17 9.444% 56.111% ## ( 870, 1300 ] 8 4.444% 60.556% # ( 1300, 1900 ] 17 9.444% 70.000% ## ( 1900, 2900 ] 23 12.778% 82.778% ### ( 2900, 4400 ] 24 13.333% 96.111% ### ( 4400, 6600 ] 7 3.889% 100.000% # ** DB Stats ** Uptime(secs): 33.9 total, 4.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 232.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:11.752 H:M:S, 34.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 238.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.204 H:M:S, 29.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-11:21:26 ... thread 0: (1000000,9000000) ops and (230045.8,236238.7) ops/second in (4.346960,38.097058) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/9 4.60 GB 226.5 7.6 0.0 7.6 16.1 8.5 0.0 1.9 135.1 287.5 57.35 50.77 146 0.393 7866K 13K 0.0 0.0 L1 12/12 743.88 MB 0.0 5.1 3.7 1.4 5.0 3.6 0.2 1.4 224.6 222.7 23.19 21.75 4 5.797 5287K 43K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.0 2.0 252.9 252.7 1.49 1.44 2 0.747 383K 241 0.0 0.0 L3 25/0 981.20 MB 1.0 4.8 2.9 2.0 4.8 2.8 0.4 1.7 147.1 146.4 33.68 22.11 19 1.773 5031K 24K 0.0 0.0 L4 187/0 9.61 GB 1.0 2.3 2.2 0.1 2.3 2.2 0.8 1.1 129.8 129.5 18.27 10.99 36 0.507 2337K 2579 0.0 0.0 L5 1080/0 88.71 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1323/21 104.60 GB 0.0 20.2 8.9 11.3 28.6 17.4 7.4 3.3 154.2 218.9 133.98 107.07 207 0.647 20M 84K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.2 8.9 11.3 28.6 17.4 7.3 3.3 154.2 218.9 133.98 107.07 207 0.647 20M 84K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.2 8.9 11.3 20.1 8.8 0.0 0.0 194.2 193.4 106.36 84.85 85 1.251 20M 84K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 317.0 27.63 22.22 122 0.226 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 38.3 total, 38.1 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.64 GB write, 766.15 MB/s write, 20.17 GB read, 539.67 MB/s read, 134.0 seconds Interval compaction: 28.64 GB write, 769.75 MB/s write, 20.17 GB read, 542.21 MB/s read, 134.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 65, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 65, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3488645 Average: 2.9165 StdDev: 37.52 Min: 0 Median: 1.5354 Max: 25844 Percentiles: P50: 1.54 P75: 1.91 P99: 6.51 P99.9: 120.91 P99.99: 348.30 ------------------------------------------------------ [ 0, 1 ] 510750 14.640% 14.640% ### ( 1, 2 ] 2303862 66.039% 80.679% ############# ( 2, 3 ] 400885 11.491% 92.170% ## ( 3, 4 ] 139008 3.985% 96.155% # ( 4, 6 ] 95816 2.747% 98.901% # ( 6, 10 ] 27105 0.777% 99.678% ( 10, 15 ] 3901 0.112% 99.790% ( 15, 22 ] 364 0.010% 99.801% ( 22, 34 ] 47 0.001% 99.802% ( 34, 51 ] 24 0.001% 99.803% ( 51, 76 ] 83 0.002% 99.805% ( 76, 110 ] 2865 0.082% 99.887% ( 110, 170 ] 2454 0.070% 99.958% ( 170, 250 ] 745 0.021% 99.979% ( 250, 380 ] 512 0.015% 99.994% ( 380, 580 ] 492 0.014% 100.008% ( 580, 870 ] 315 0.009% 100.017% ( 870, 1300 ] 210 0.006% 100.023% ( 1300, 1900 ] 101 0.003% 100.026% ( 1900, 2900 ] 86 0.002% 100.028% ( 2900, 4400 ] 102 0.003% 100.031% ( 4400, 6600 ] 29 0.001% 100.032% ( 6600, 9900 ] 4 0.000% 100.032% ( 14000, 22000 ] 1 0.000% 100.032% ( 22000, 33000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 1143202 Average: 7.3324 StdDev: 135.51 Min: 0 Median: 1.7539 Max: 29857 Percentiles: P50: 1.75 P75: 2.60 P99: 9.21 P99.9: 230.79 P99.99: 669.67 ------------------------------------------------------ [ 0, 1 ] 80498 7.041% 7.041% # ( 1, 2 ] 651414 56.982% 64.023% ########### ( 2, 3 ] 208226 18.214% 82.237% #### ( 3, 4 ] 88935 7.779% 90.017% ## ( 4, 6 ] 84188 7.364% 97.381% # ( 6, 10 ] 23080 2.019% 99.400% ( 10, 15 ] 3524 0.308% 99.708% ( 15, 22 ] 449 0.039% 99.747% ( 22, 34 ] 40 0.003% 99.751% ( 34, 51 ] 14 0.001% 99.752% ( 51, 76 ] 71 0.006% 99.758% ( 76, 110 ] 744 0.065% 99.823% ( 110, 170 ] 641 0.056% 99.879% ( 170, 250 ] 309 0.027% 99.906% ( 250, 380 ] 378 0.033% 99.940% ( 380, 580 ] 453 0.040% 99.979% ( 580, 870 ] 400 0.035% 100.014% ( 870, 1300 ] 299 0.026% 100.040% ( 1300, 1900 ] 153 0.013% 100.054% ( 1900, 2900 ] 253 0.022% 100.076% ( 2900, 4400 ] 509 0.045% 100.120% ( 4400, 6600 ] 182 0.016% 100.136% ( 6600, 9900 ] 57 0.005% 100.141% ( 9900, 14000 ] 2 0.000% 100.141% ( 14000, 22000 ] 1 0.000% 100.142% ( 22000, 33000 ] 4 0.000% 100.142% ** Level 2 read latency histogram (micros): Count: 124160 Average: 3.0035 StdDev: 38.44 Min: 1 Median: 1.5207 Max: 6789 Percentiles: P50: 1.52 P75: 1.94 P99: 7.17 P99.9: 112.52 P99.99: 2287.29 ------------------------------------------------------ [ 0, 1 ] 23223 18.704% 18.704% #### ( 1, 2 ] 74621 60.101% 78.805% ############ ( 2, 3 ] 14123 11.375% 90.180% ## ( 3, 4 ] 5855 4.716% 94.895% # ( 4, 6 ] 4739 3.817% 98.712% # ( 6, 10 ] 1221 0.983% 99.696% ( 10, 15 ] 201 0.162% 99.857% ( 15, 22 ] 13 0.010% 99.868% ( 22, 34 ] 5 0.004% 99.872% ( 51, 76 ] 3 0.002% 99.874% ( 76, 110 ] 31 0.025% 99.899% ( 110, 170 ] 20 0.016% 99.915% ( 170, 250 ] 20 0.016% 99.932% ( 250, 380 ] 23 0.019% 99.950% ( 380, 580 ] 18 0.014% 99.965% ( 580, 870 ] 19 0.015% 99.980% ( 870, 1300 ] 4 0.003% 99.983% ( 1300, 1900 ] 2 0.002% 99.985% ( 1900, 2900 ] 17 0.014% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 970867 Average: 5.0134 StdDev: 85.57 Min: 0 Median: 1.8948 Max: 24145 Percentiles: P50: 1.89 P75: 2.88 P99: 8.76 P99.9: 14.99 P99.99: 156.19 ------------------------------------------------------ [ 0, 1 ] 30056 3.096% 3.096% # ( 1, 2 ] 508902 52.417% 55.513% ########## ( 2, 3 ] 215348 22.181% 77.694% #### ( 3, 4 ] 99901 10.290% 87.984% ## ( 4, 6 ] 94211 9.704% 97.688% ## ( 6, 10 ] 18460 1.901% 99.589% ( 10, 15 ] 3026 0.312% 99.901% ( 15, 22 ] 340 0.035% 99.936% ( 22, 34 ] 54 0.006% 99.941% ( 34, 51 ] 19 0.002% 99.943% ( 51, 76 ] 23 0.002% 99.946% ( 76, 110 ] 95 0.010% 99.956% ( 110, 170 ] 435 0.045% 100.000% ( 170, 250 ] 338 0.035% 100.035% ( 250, 380 ] 274 0.028% 100.063% ( 380, 580 ] 323 0.033% 100.097% ( 580, 870 ] 294 0.030% 100.127% ( 870, 1300 ] 241 0.025% 100.152% ( 1300, 1900 ] 133 0.014% 100.165% ( 1900, 2900 ] 119 0.012% 100.178% ( 2900, 4400 ] 122 0.013% 100.190% ( 4400, 6600 ] 28 0.003% 100.193% ( 6600, 9900 ] 7 0.001% 100.194% ( 9900, 14000 ] 2 0.000% 100.194% ( 14000, 22000 ] 4 0.000% 100.194% ( 22000, 33000 ] 2 0.000% 100.195% ** Level 4 read latency histogram (micros): Count: 35101 Average: 86.6000 StdDev: 428.94 Min: 0 Median: 1.9689 Max: 7385 Percentiles: P50: 1.97 P75: 3.21 P99: 2407.72 P99.9: 5024.04 P99.99: 6442.40 ------------------------------------------------------ [ 0, 1 ] 936 2.667% 2.667% # ( 1, 2 ] 17148 48.853% 51.520% ########## ( 2, 3 ] 7384 21.036% 72.556% #### ( 3, 4 ] 4099 11.678% 84.234% ## ( 4, 6 ] 2260 6.439% 90.673% # ( 6, 10 ] 768 2.188% 92.861% ( 10, 15 ] 121 0.345% 93.205% ( 15, 22 ] 32 0.091% 93.296% ( 22, 34 ] 8 0.023% 93.319% ( 76, 110 ] 14 0.040% 93.359% ( 110, 170 ] 36 0.103% 93.462% ( 170, 250 ] 112 0.319% 93.781% ( 250, 380 ] 199 0.567% 94.348% ( 380, 580 ] 358 1.020% 95.368% ( 580, 870 ] 497 1.416% 96.784% ( 870, 1300 ] 414 1.179% 97.963% ( 1300, 1900 ] 266 0.758% 98.721% ( 1900, 2900 ] 193 0.550% 99.271% ( 2900, 4400 ] 207 0.590% 99.860% ( 4400, 6600 ] 49 0.140% 100.000% ( 6600, 9900 ] 5 0.014% 100.014% ** Level 5 read latency histogram (micros): Count: 180 Average: 1368.1111 StdDev: 1387.20 Min: 77 Median: 682.3529 Max: 5992 Percentiles: P50: 682.35 P75: 2291.30 P99: 5992.00 P99.9: 5992.00 P99.99: 5992.00 ------------------------------------------------------ ( 76, 110 ] 16 8.889% 8.889% ## ( 110, 170 ] 6 3.333% 12.222% # ( 170, 250 ] 15 8.333% 20.556% ## ( 250, 380 ] 20 11.111% 31.667% ## ( 380, 580 ] 27 15.000% 46.667% ### ( 580, 870 ] 17 9.444% 56.111% ## ( 870, 1300 ] 8 4.444% 60.556% # ( 1300, 1900 ] 17 9.444% 70.000% ## ( 1900, 2900 ] 23 12.778% 82.778% ### ( 2900, 4400 ] 24 13.333% 96.111% ### ( 4400, 6600 ] 7 3.889% 100.000% # ** DB Stats ** Uptime(secs): 38.3 total, 4.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 231.41 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.349 H:M:S, 34.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 226.41 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.597 H:M:S, 36.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/26-11:21:34 ... thread 0: (1000000,10000000) ops and (116028.0,214060.9) ops/second in (8.618612,46.715670) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/16 3.19 GB 12.6 8.9 0.0 8.9 18.4 9.5 0.0 1.9 138.5 287.3 65.50 58.17 162 0.404 9208K 18K 0.0 0.0 L1 22/22 2.35 GB 0.0 8.2 6.1 2.1 8.1 6.0 0.2 1.3 214.9 212.8 39.08 35.39 5 7.816 7773K 43K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.4 0.2 0.2 0.4 0.2 3.7 2.0 252.9 252.7 1.49 1.44 2 0.747 383K 241 0.0 0.0 L3 21/0 992.57 MB 1.0 5.4 3.2 2.2 5.3 3.2 0.8 1.7 150.6 149.8 36.52 24.53 22 1.660 5585K 29K 0.0 0.0 L4 188/0 9.64 GB 1.0 3.1 2.9 0.2 3.1 2.9 0.9 1.1 128.4 128.1 24.54 14.68 48 0.511 3085K 2829 0.0 0.0 L5 1088/0 89.38 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1336/38 105.54 GB 0.0 25.9 12.4 13.5 35.3 21.8 9.2 3.7 158.5 216.1 167.14 134.21 239 0.699 26M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.9 12.4 13.5 35.3 21.8 9.1 3.7 158.5 216.1 167.14 134.21 239 0.699 26M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.9 12.4 13.5 25.7 12.2 0.0 0.0 194.3 193.3 136.38 109.40 103 1.324 26M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 317.4 30.76 24.80 136 0.226 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 46.9 total, 46.7 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.28 GB write, 770.27 MB/s write, 25.88 GB read, 565.01 MB/s read, 167.1 seconds Interval compaction: 35.28 GB write, 773.22 MB/s write, 25.88 GB read, 567.17 MB/s read, 167.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 13, pending-compaction-bytes-stops: 0, total-delays: 34, total-stops: 73, interval: 107 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4222473 Average: 2.9801 StdDev: 36.71 Min: 0 Median: 1.5349 Max: 25844 Percentiles: P50: 1.53 P75: 1.91 P99: 6.73 P99.9: 137.17 P99.99: 416.59 ------------------------------------------------------ [ 0, 1 ] 619196 14.664% 14.664% ### ( 1, 2 ] 2789409 66.061% 80.725% ############# ( 2, 3 ] 486248 11.516% 92.241% ## ( 3, 4 ] 166118 3.934% 96.175% # ( 4, 6 ] 113169 2.680% 98.855% # ( 6, 10 ] 33402 0.791% 99.646% ( 10, 15 ] 4683 0.111% 99.757% ( 15, 22 ] 427 0.010% 99.767% ( 22, 34 ] 54 0.001% 99.769% ( 34, 51 ] 29 0.001% 99.769% ( 51, 76 ] 107 0.003% 99.772% ( 76, 110 ] 3833 0.091% 99.863% ( 110, 170 ] 3484 0.083% 99.945% ( 170, 250 ] 1025 0.024% 99.969% ( 250, 380 ] 735 0.017% 99.987% ( 380, 580 ] 731 0.017% 100.004% ( 580, 870 ] 464 0.011% 100.015% ( 870, 1300 ] 272 0.006% 100.022% ( 1300, 1900 ] 133 0.003% 100.025% ( 1900, 2900 ] 98 0.002% 100.027% ( 2900, 4400 ] 125 0.003% 100.030% ( 4400, 6600 ] 32 0.001% 100.031% ( 6600, 9900 ] 4 0.000% 100.031% ( 14000, 22000 ] 1 0.000% 100.031% ( 22000, 33000 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 1402372 Average: 6.6731 StdDev: 122.97 Min: 0 Median: 1.7260 Max: 29857 Percentiles: P50: 1.73 P75: 2.51 P99: 9.20 P99.9: 246.30 P99.99: 674.83 ------------------------------------------------------ [ 0, 1 ] 104316 7.439% 7.439% # ( 1, 2 ] 822145 58.625% 66.064% ############ ( 2, 3 ] 243505 17.364% 83.428% ### ( 3, 4 ] 102315 7.296% 90.724% # ( 4, 6 ] 94007 6.703% 97.427% # ( 6, 10 ] 27541 1.964% 99.391% ( 10, 15 ] 3835 0.273% 99.664% ( 15, 22 ] 489 0.035% 99.699% ( 22, 34 ] 48 0.003% 99.703% ( 34, 51 ] 15 0.001% 99.704% ( 51, 76 ] 97 0.007% 99.711% ( 76, 110 ] 1168 0.083% 99.794% ( 110, 170 ] 1068 0.076% 99.870% ( 170, 250 ] 441 0.031% 99.901% ( 250, 380 ] 507 0.036% 99.938% ( 380, 580 ] 585 0.042% 99.979% ( 580, 870 ] 458 0.033% 100.012% ( 870, 1300 ] 347 0.025% 100.037% ( 1300, 1900 ] 175 0.012% 100.049% ( 1900, 2900 ] 258 0.018% 100.068% ( 2900, 4400 ] 509 0.036% 100.104% ( 4400, 6600 ] 182 0.013% 100.117% ( 6600, 9900 ] 57 0.004% 100.121% ( 9900, 14000 ] 2 0.000% 100.121% ( 14000, 22000 ] 1 0.000% 100.121% ( 22000, 33000 ] 4 0.000% 100.121% ** Level 2 read latency histogram (micros): Count: 124160 Average: 3.0035 StdDev: 38.44 Min: 1 Median: 1.5207 Max: 6789 Percentiles: P50: 1.52 P75: 1.94 P99: 7.17 P99.9: 112.52 P99.99: 2287.29 ------------------------------------------------------ [ 0, 1 ] 23223 18.704% 18.704% #### ( 1, 2 ] 74621 60.101% 78.805% ############ ( 2, 3 ] 14123 11.375% 90.180% ## ( 3, 4 ] 5855 4.716% 94.895% # ( 4, 6 ] 4739 3.817% 98.712% # ( 6, 10 ] 1221 0.983% 99.696% ( 10, 15 ] 201 0.162% 99.857% ( 15, 22 ] 13 0.010% 99.868% ( 22, 34 ] 5 0.004% 99.872% ( 51, 76 ] 3 0.002% 99.874% ( 76, 110 ] 31 0.025% 99.899% ( 110, 170 ] 20 0.016% 99.915% ( 170, 250 ] 20 0.016% 99.932% ( 250, 380 ] 23 0.019% 99.950% ( 380, 580 ] 18 0.014% 99.965% ( 580, 870 ] 19 0.015% 99.980% ( 870, 1300 ] 4 0.003% 99.983% ( 1300, 1900 ] 2 0.002% 99.985% ( 1900, 2900 ] 17 0.014% 99.998% ( 2900, 4400 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 1197032 Average: 5.6420 StdDev: 90.70 Min: 0 Median: 1.9067 Max: 24145 Percentiles: P50: 1.91 P75: 2.90 P99: 8.99 P99.9: 94.54 P99.99: 241.44 ------------------------------------------------------ [ 0, 1 ] 33269 2.779% 2.779% # ( 1, 2 ] 623404 52.079% 54.858% ########## ( 2, 3 ] 268298 22.414% 77.272% #### ( 3, 4 ] 124566 10.406% 87.678% ## ( 4, 6 ] 117191 9.790% 97.468% ## ( 6, 10 ] 24544 2.050% 99.519% ( 10, 15 ] 3886 0.325% 99.843% ( 15, 22 ] 472 0.039% 99.883% ( 22, 34 ] 65 0.005% 99.888% ( 34, 51 ] 23 0.002% 99.890% ( 51, 76 ] 33 0.003% 99.893% ( 76, 110 ] 154 0.013% 99.906% ( 110, 170 ] 584 0.049% 99.955% ( 170, 250 ] 474 0.040% 99.994% ( 250, 380 ] 471 0.039% 100.034% ( 380, 580 ] 583 0.049% 100.082% ( 580, 870 ] 506 0.042% 100.125% ( 870, 1300 ] 373 0.031% 100.156% ( 1300, 1900 ] 193 0.016% 100.172% ( 1900, 2900 ] 187 0.016% 100.187% ( 2900, 4400 ] 206 0.017% 100.205% ( 4400, 6600 ] 52 0.004% 100.209% ( 6600, 9900 ] 10 0.001% 100.210% ( 9900, 14000 ] 2 0.000% 100.210% ( 14000, 22000 ] 4 0.000% 100.210% ( 22000, 33000 ] 2 0.000% 100.211% ** Level 4 read latency histogram (micros): Count: 49775 Average: 76.2319 StdDev: 392.41 Min: 0 Median: 1.9771 Max: 7385 Percentiles: P50: 1.98 P75: 3.20 P99: 2000.23 P99.9: 4448.13 P99.99: 6208.03 ------------------------------------------------------ [ 0, 1 ] 1306 2.624% 2.624% # ( 1, 2 ] 24135 48.488% 51.112% ########## ( 2, 3 ] 10762 21.621% 72.733% #### ( 3, 4 ] 5687 11.425% 84.159% ## ( 4, 6 ] 3199 6.427% 90.586% # ( 6, 10 ] 1079 2.168% 92.753% ( 10, 15 ] 162 0.325% 93.079% ( 15, 22 ] 41 0.082% 93.161% ( 22, 34 ] 8 0.016% 93.177% ( 76, 110 ] 70 0.141% 93.318% ( 110, 170 ] 171 0.344% 93.661% ( 170, 250 ] 273 0.548% 94.210% ( 250, 380 ] 365 0.733% 94.943% ( 380, 580 ] 519 1.043% 95.986% ( 580, 870 ] 654 1.314% 97.300% ( 870, 1300 ] 518 1.041% 98.341% ( 1300, 1900 ] 306 0.615% 98.955% ( 1900, 2900 ] 222 0.446% 99.401% ( 2900, 4400 ] 247 0.496% 99.898% ( 4400, 6600 ] 56 0.113% 100.010% ( 6600, 9900 ] 5 0.010% 100.020% ** Level 5 read latency histogram (micros): Count: 220 Average: 1359.2409 StdDev: 1410.57 Min: 77 Median: 672.2727 Max: 5992 Percentiles: P50: 672.27 P75: 2246.15 P99: 5992.00 P99.9: 5992.00 P99.99: 5992.00 ------------------------------------------------------ ( 76, 110 ] 19 8.636% 8.636% ## ( 110, 170 ] 13 5.909% 14.545% # ( 170, 250 ] 18 8.182% 22.727% ## ( 250, 380 ] 21 9.545% 32.273% ## ( 380, 580 ] 32 14.545% 46.818% ### ( 580, 870 ] 22 10.000% 56.818% ## ( 870, 1300 ] 11 5.000% 61.818% # ( 1300, 1900 ] 20 9.091% 70.909% ## ( 1900, 2900 ] 26 11.818% 82.727% ## ( 2900, 4400 ] 29 13.182% 95.909% ### ( 4400, 6600 ] 9 4.091% 100.000% # ** DB Stats ** Uptime(secs): 46.9 total, 8.6 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 209.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.013 H:M:S, 40.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 114.19 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.664 H:M:S, 65.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.807 micros/op 172220 ops/sec 60.179 seconds 10363999 operations; 166.9 MB/s Microseconds per write: Count: 10363999 Average: 5.8065 StdDev: 462.61 Min: 1 Median: 1.7743 Max: 759744 Percentiles: P50: 1.77 P75: 2.74 P99: 8.67 P99.9: 1162.15 P99.99: 2766.11 ------------------------------------------------------ [ 0, 1 ] 1146551 11.063% 11.063% ## ( 1, 2 ] 5211649 50.286% 61.349% ########## ( 2, 3 ] 1910495 18.434% 79.783% #### ( 3, 4 ] 1409537 13.600% 93.383% ### ( 4, 6 ] 511502 4.935% 98.319% # ( 6, 10 ] 105907 1.022% 99.340% ( 10, 15 ] 30920 0.298% 99.639% ( 15, 22 ] 7676 0.074% 99.713% ( 22, 34 ] 1645 0.016% 99.729% ( 34, 51 ] 186 0.002% 99.730% ( 51, 76 ] 35 0.000% 99.731% ( 76, 110 ] 7710 0.074% 99.805% ( 110, 170 ] 2424 0.023% 99.829% ( 170, 250 ] 249 0.002% 99.831% ( 250, 380 ] 142 0.001% 99.832% ( 380, 580 ] 34 0.000% 99.833% ( 580, 870 ] 28 0.000% 99.833% ( 870, 1300 ] 10222 0.099% 99.932% ( 1300, 1900 ] 32 0.000% 99.932% ( 1900, 2900 ] 6949 0.067% 99.999% ( 2900, 4400 ] 62 0.001% 100.000% ( 4400, 6600 ] 11 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 4 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 17 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 202972 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10363999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10695646968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 584 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31453751 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 32610124885 rocksdb.compact.write.bytes COUNT : 32418778357 rocksdb.flush.write.bytes COUNT : 10635221792 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 53 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 316 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10549485568 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4108288 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 32704816181 rocksdb.non.last.level.read.count COUNT : 7904316 rocksdb.block.checksum.compute.count COUNT : 7903201 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.419128 P95 : 3.829392 P99 : 6.884936 P100 : 759743.000000 COUNT : 10363999 SUM : 55114269 rocksdb.compaction.times.micros P50 : 894000.000000 P95 : 3390000.000000 P99 : 13748000.000000 P100 : 15892751.000000 COUNT : 106 SUM : 139486007 rocksdb.compaction.times.cpu_micros P50 : 744000.000000 P95 : 3390000.000000 P99 : 11774000.000000 P100 : 13636243.000000 COUNT : 106 SUM : 112432353 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 728.452381 P95 : 2800.000000 P99 : 13426.000000 P100 : 31017.000000 COUNT : 142 SUM : 175546 rocksdb.compaction.outfile.sync.micros P50 : 1166.473684 P95 : 66838.235294 P99 : 106762.500000 P100 : 142742.000000 COUNT : 411 SUM : 4401164 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 109.792683 P95 : 2320.833333 P99 : 3952.500000 P100 : 5668.000000 COUNT : 279 SUM : 123617 rocksdb.table.open.io.micros P50 : 1330.508475 P95 : 7810.000000 P99 : 12289.714286 P100 : 13761.000000 COUNT : 584 SUM : 1138464 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.652384 P95 : 7.649294 P99 : 10.969298 P100 : 29863.000000 COUNT : 7901406 SUM : 52138631 rocksdb.read.block.get.micros P50 : 359.473684 P95 : 3159.090909 P99 : 5594.947368 P100 : 7868.000000 COUNT : 1168 SUM : 925262 rocksdb.write.raw.block.micros P50 : 0.513117 P95 : 0.974923 P99 : 2.825256 P100 : 29880.000000 COUNT : 10427503 SUM : 21667771 rocksdb.numfiles.in.singlecompaction P50 : 2.526316 P95 : 5.950000 P99 : 20.530000 P100 : 30.000000 COUNT : 142 SUM : 505 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.559445 P95 : 1251.409242 P99 : 2671.975737 P100 : 759557.000000 COUNT : 162784 SUM : 31466337 rocksdb.sst.read.micros P50 : 1.591351 P95 : 4.522175 P99 : 8.532046 P100 : 29857.000000 COUNT : 7904334 SUM : 35672996 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10363999 SUM : 10695646968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213265.306122 P95 : 414200.000000 P99 : 933471.000000 P100 : 933471.000000 COUNT : 142 SUM : 31836131 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 377 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0