[2024-07-15 11:37:54.419099] Starting SPDK v24.09-pre git sha1 e7cce062d / DPDK 24.03.0 initialization... [2024-07-15 11:37:54.419371] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid254291 ] Set seed to 1721036274412673 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-15 11:37:54.534198] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-15 11:37:54.751111] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-15 11:37:54.751157] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 254291' to capture a snapshot of events at runtime. [2024-07-15 11:37:54.751167] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-15 11:37:54.751178] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-15 11:37:54.751185] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid254291 for offline analysis/debug. [2024-07-15 11:37:54.751299] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Jul 15 11:38:00 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/15-11:38:03 ... thread 0: (1000000,1000000) ops and (358938.6,358938.6) ops/second in (2.785992,2.785992) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 566.27 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 347.3 2.35 2.11 12 0.196 0 0 0.0 0.0 L1 3/3 188.13 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 256.1 255.5 0.74 0.71 1 0.736 191K 389 0.0 0.0 L2 2/2 160.54 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.1 2.6 242.8 242.3 0.66 0.63 1 0.663 163K 324 0.0 0.0 L3 9/9 755.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 247/22 20.03 GB 0.0 0.3 0.2 0.1 1.1 1.0 0.2 1.4 93.1 310.7 3.75 3.45 14 0.268 354K 713 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.1 1.0 0.1 1.4 93.1 310.7 3.75 3.45 14 0.268 354K 713 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 249.8 249.2 1.40 1.34 2 0.699 354K 713 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 347.3 2.35 2.11 12 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.9 total, 2.8 interval Flush(GB): cumulative 0.799, interval 0.799 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.14 GB write, 405.28 MB/s write, 0.34 GB read, 121.40 MB/s read, 3.8 seconds Interval compaction: 1.14 GB write, 418.49 MB/s write, 0.34 GB read, 125.36 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 112991 Average: 2.1210 StdDev: 13.61 Min: 1 Median: 1.4019 Max: 2867 Percentiles: P50: 1.40 P75: 1.80 P99: 5.70 P99.9: 11.67 P99.99: 99.83 ------------------------------------------------------ [ 0, 1 ] 28114 24.882% 24.882% ##### ( 1, 2 ] 70616 62.497% 87.379% ############ ( 2, 3 ] 7971 7.055% 94.433% # ( 3, 4 ] 3044 2.694% 97.127% # ( 4, 6 ] 2493 2.206% 99.334% ( 6, 10 ] 601 0.532% 99.865% ( 10, 15 ] 120 0.106% 99.972% ( 15, 22 ] 14 0.012% 99.984% ( 22, 34 ] 5 0.004% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 51, 76 ] 1 0.001% 99.990% ( 76, 110 ] 1 0.001% 99.991% ( 110, 170 ] 8 0.007% 99.998% ( 170, 250 ] 3 0.003% 100.001% ( 250, 380 ] 2 0.002% 100.003% ( 380, 580 ] 4 0.004% 100.006% ( 580, 870 ] 2 0.002% 100.008% ( 870, 1300 ] 2 0.002% 100.010% ( 1300, 1900 ] 1 0.001% 100.011% ( 1900, 2900 ] 2 0.002% 100.012% ** Level 1 read latency histogram (micros): Count: 47929 Average: 2.3664 StdDev: 21.60 Min: 1 Median: 1.3562 Max: 3317 Percentiles: P50: 1.36 P75: 1.76 P99: 5.97 P99.9: 73.71 P99.99: 793.34 ------------------------------------------------------ [ 0, 1 ] 13313 27.777% 27.777% ###### ( 1, 2 ] 29904 62.392% 90.169% ############ ( 2, 3 ] 2490 5.195% 95.364% # ( 3, 4 ] 889 1.855% 97.219% ( 4, 6 ] 866 1.807% 99.026% ( 6, 10 ] 315 0.657% 99.683% ( 10, 15 ] 61 0.127% 99.810% ( 15, 22 ] 8 0.017% 99.827% ( 22, 34 ] 1 0.002% 99.829% ( 34, 51 ] 6 0.013% 99.841% ( 51, 76 ] 32 0.067% 99.908% ( 76, 110 ] 3 0.006% 99.914% ( 110, 170 ] 9 0.019% 99.933% ( 170, 250 ] 12 0.025% 99.958% ( 250, 380 ] 7 0.015% 99.973% ( 380, 580 ] 7 0.015% 99.987% ( 580, 870 ] 3 0.006% 99.994% ( 870, 1300 ] 2 0.004% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ( 2900, 4400 ] 1 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 13565 Average: 3.0978 StdDev: 17.58 Min: 0 Median: 1.8790 Max: 1965 Percentiles: P50: 1.88 P75: 2.82 P99: 9.23 P99.9: 15.38 P99.99: 333.65 ------------------------------------------------------ [ 0, 1 ] 336 2.477% 2.477% ( 1, 2 ] 7334 54.066% 56.543% ########### ( 2, 3 ] 3051 22.492% 79.034% #### ( 3, 4 ] 1165 8.588% 87.623% ## ( 4, 6 ] 1270 9.362% 96.985% ## ( 6, 10 ] 338 2.492% 99.477% ( 10, 15 ] 57 0.420% 99.897% ( 15, 22 ] 8 0.059% 99.956% ( 22, 34 ] 1 0.007% 99.963% ( 34, 51 ] 1 0.007% 99.971% ( 51, 76 ] 1 0.007% 99.978% ( 170, 250 ] 1 0.007% 99.985% ( 250, 380 ] 1 0.007% 99.993% ( 380, 580 ] 1 0.007% 100.000% ( 1900, 2900 ] 1 0.007% 100.007% ** Level 3 read latency histogram (micros): Count: 19097 Average: 9.4235 StdDev: 151.98 Min: 1 Median: 1.7550 Max: 6347 Percentiles: P50: 1.76 P75: 2.58 P99: 12.34 P99.9: 3119.46 P99.99: 6074.80 ------------------------------------------------------ [ 0, 1 ] 797 4.173% 4.173% # ( 1, 2 ] 11591 60.695% 64.869% ############ ( 2, 3 ] 3335 17.463% 82.332% ### ( 3, 4 ] 1228 6.430% 88.763% # ( 4, 6 ] 1452 7.603% 96.366% ## ( 6, 10 ] 444 2.325% 98.691% ( 10, 15 ] 128 0.670% 99.361% ( 15, 22 ] 12 0.063% 99.424% ( 34, 51 ] 1 0.005% 99.429% ( 76, 110 ] 43 0.225% 99.654% ( 110, 170 ] 13 0.068% 99.722% ( 170, 250 ] 9 0.047% 99.770% ( 250, 380 ] 3 0.016% 99.785% ( 380, 580 ] 1 0.005% 99.791% ( 580, 870 ] 4 0.021% 99.811% ( 870, 1300 ] 3 0.016% 99.827% ( 1300, 1900 ] 4 0.021% 99.848% ( 1900, 2900 ] 9 0.047% 99.895% ( 2900, 4400 ] 13 0.068% 99.963% ( 4400, 6600 ] 8 0.042% 100.005% ** Level 4 read latency histogram (micros): Count: 30 Average: 3193.9000 StdDev: 1819.06 Min: 106 Median: 3172.7273 Max: 6958 Percentiles: P50: 3172.73 P75: 4195.45 P99: 6958.00 P99.9: 6958.00 P99.99: 6958.00 ------------------------------------------------------ ( 76, 110 ] 2 6.667% 6.667% # ( 110, 170 ] 1 3.333% 10.000% # ( 380, 580 ] 1 3.333% 13.333% # ( 870, 1300 ] 1 3.333% 16.667% # ( 1300, 1900 ] 1 3.333% 20.000% # ( 1900, 2900 ] 7 23.333% 43.333% ##### ( 2900, 4400 ] 11 36.667% 80.000% ####### ( 4400, 6600 ] 5 16.667% 96.667% ### ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 2.9 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 341.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.214 H:M:S, 7.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 352.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.214 H:M:S, 7.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/07/15-11:38:06 ... thread 0: (1000000,2000000) ops and (302201.4,328135.4) ops/second in (3.309052,6.095044) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 1.35 GB 18.9 0.8 0.0 0.8 2.6 1.8 0.0 1.4 93.8 309.6 8.72 8.07 29 0.301 830K 4342 0.0 0.0 L1 1/1 49.79 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 239.1 237.6 2.63 2.55 2 1.314 638K 4065 0.0 0.0 L2 1/1 100.44 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.5 2.6 242.8 242.3 0.66 0.63 1 0.663 163K 324 0.0 0.0 L3 18/9 1.17 GB 0.4 0.5 0.4 0.1 0.5 0.4 0.0 1.2 199.4 198.9 2.77 2.52 4 0.693 561K 1221 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 254/19 21.06 GB 0.0 2.1 0.9 1.2 3.9 2.8 0.5 2.1 146.1 273.0 14.78 13.77 36 0.411 2193K 9952 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 0.9 1.2 3.9 2.8 0.4 2.1 146.1 273.0 14.78 13.77 36 0.411 2193K 9952 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 0.9 1.2 2.1 0.9 0.0 0.0 232.0 230.9 9.31 8.89 10 0.931 2193K 9952 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 344.8 5.47 4.88 26 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.1 interval Flush(GB): cumulative 1.842, interval 1.842 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.94 GB write, 652.42 MB/s write, 2.11 GB read, 349.11 MB/s read, 14.8 seconds Interval compaction: 3.94 GB write, 662.14 MB/s write, 2.11 GB read, 354.31 MB/s read, 14.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 366021 Average: 2.7097 StdDev: 16.84 Min: 1 Median: 1.6389 Max: 3352 Percentiles: P50: 1.64 P75: 2.18 P99: 6.64 P99.9: 17.41 P99.99: 260.79 ------------------------------------------------------ [ 0, 1 ] 40468 11.056% 11.056% ## ( 1, 2 ] 223098 60.952% 72.008% ############ ( 2, 3 ] 62571 17.095% 89.103% ### ( 3, 4 ] 18564 5.072% 94.175% # ( 4, 6 ] 17161 4.689% 98.864% # ( 6, 10 ] 3125 0.854% 99.718% ( 10, 15 ] 639 0.175% 99.892% ( 15, 22 ] 87 0.024% 99.916% ( 22, 34 ] 15 0.004% 99.920% ( 34, 51 ] 3 0.001% 99.921% ( 51, 76 ] 3 0.001% 99.922% ( 76, 110 ] 42 0.011% 99.933% ( 110, 170 ] 127 0.035% 99.968% ( 170, 250 ] 78 0.021% 99.989% ( 250, 380 ] 53 0.014% 100.004% ( 380, 580 ] 41 0.011% 100.015% ( 580, 870 ] 17 0.005% 100.019% ( 870, 1300 ] 10 0.003% 100.022% ( 1300, 1900 ] 3 0.001% 100.023% ( 1900, 2900 ] 4 0.001% 100.024% ( 2900, 4400 ] 3 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 170711 Average: 2.9781 StdDev: 16.26 Min: 1 Median: 1.7242 Max: 3317 Percentiles: P50: 1.72 P75: 2.47 P99: 9.00 P99.9: 108.38 P99.99: 349.64 ------------------------------------------------------ [ 0, 1 ] 16338 9.571% 9.571% ## ( 1, 2 ] 95304 55.828% 65.398% ########### ( 2, 3 ] 34965 20.482% 85.880% #### ( 3, 4 ] 9600 5.624% 91.504% # ( 4, 6 ] 10666 6.248% 97.752% # ( 6, 10 ] 2837 1.662% 99.414% ( 10, 15 ] 665 0.390% 99.803% ( 15, 22 ] 85 0.050% 99.853% ( 22, 34 ] 8 0.005% 99.858% ( 34, 51 ] 6 0.004% 99.861% ( 51, 76 ] 32 0.019% 99.880% ( 76, 110 ] 36 0.021% 99.901% ( 110, 170 ] 80 0.047% 99.948% ( 170, 250 ] 52 0.030% 99.978% ( 250, 380 ] 26 0.015% 99.994% ( 380, 580 ] 27 0.016% 100.009% ( 580, 870 ] 10 0.006% 100.015% ( 870, 1300 ] 6 0.004% 100.019% ( 1300, 1900 ] 1 0.001% 100.019% ( 1900, 2900 ] 2 0.001% 100.021% ( 2900, 4400 ] 1 0.001% 100.021% ** Level 2 read latency histogram (micros): Count: 40775 Average: 3.3104 StdDev: 18.79 Min: 0 Median: 1.7072 Max: 1965 Percentiles: P50: 1.71 P75: 2.38 P99: 9.09 P99.9: 257.58 P99.99: 721.25 ------------------------------------------------------ [ 0, 1 ] 2744 6.730% 6.730% # ( 1, 2 ] 24948 61.185% 67.914% ############ ( 2, 3 ] 7658 18.781% 86.695% #### ( 3, 4 ] 2095 5.138% 91.833% # ( 4, 6 ] 2271 5.570% 97.403% # ( 6, 10 ] 844 2.070% 99.473% ( 10, 15 ] 85 0.208% 99.681% ( 15, 22 ] 12 0.029% 99.711% ( 22, 34 ] 1 0.002% 99.713% ( 34, 51 ] 1 0.002% 99.716% ( 51, 76 ] 2 0.005% 99.720% ( 76, 110 ] 7 0.017% 99.738% ( 110, 170 ] 42 0.103% 99.841% ( 170, 250 ] 23 0.056% 99.897% ( 250, 380 ] 21 0.052% 99.948% ( 380, 580 ] 14 0.034% 99.983% ( 580, 870 ] 6 0.015% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ( 1900, 2900 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 219156 Average: 4.2025 StdDev: 50.26 Min: 1 Median: 1.7278 Max: 6347 Percentiles: P50: 1.73 P75: 2.42 P99: 9.36 P99.9: 346.53 P99.99: 1270.58 ------------------------------------------------------ [ 0, 1 ] 10844 4.948% 4.948% # ( 1, 2 ] 135656 61.899% 66.847% ############ ( 2, 3 ] 42774 19.518% 86.365% #### ( 3, 4 ] 11751 5.362% 91.727% # ( 4, 6 ] 12247 5.588% 97.315% # ( 6, 10 ] 4402 2.009% 99.324% ( 10, 15 ] 517 0.236% 99.560% ( 15, 22 ] 53 0.024% 99.584% ( 22, 34 ] 6 0.003% 99.587% ( 34, 51 ] 3 0.001% 99.588% ( 51, 76 ] 1 0.000% 99.588% ( 76, 110 ] 103 0.047% 99.635% ( 110, 170 ] 303 0.138% 99.774% ( 170, 250 ] 187 0.085% 99.859% ( 250, 380 ] 121 0.055% 99.914% ( 380, 580 ] 86 0.039% 99.953% ( 580, 870 ] 54 0.025% 99.978% ( 870, 1300 ] 28 0.013% 99.991% ( 1300, 1900 ] 9 0.004% 99.995% ( 1900, 2900 ] 10 0.005% 100.000% ( 2900, 4400 ] 13 0.006% 100.005% ( 4400, 6600 ] 8 0.004% 100.009% ** Level 4 read latency histogram (micros): Count: 30 Average: 3193.9000 StdDev: 1819.06 Min: 106 Median: 3172.7273 Max: 6958 Percentiles: P50: 3172.73 P75: 4195.45 P99: 6958.00 P99.9: 6958.00 P99.99: 6958.00 ------------------------------------------------------ ( 76, 110 ] 2 6.667% 6.667% # ( 110, 170 ] 1 3.333% 10.000% # ( 380, 580 ] 1 3.333% 13.333% # ( 870, 1300 ] 1 3.333% 16.667% # ( 1300, 1900 ] 1 3.333% 20.000% # ( 1900, 2900 ] 7 23.333% 43.333% ##### ( 2900, 4400 ] 11 36.667% 80.000% ####### ( 4400, 6600 ] 5 16.667% 96.667% ### ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.3 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 318.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.843 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 297.43 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.628 H:M:S, 19.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-11:38:10 ... thread 0: (1000000,3000000) ops and (328212.1,328161.0) ops/second in (3.046810,9.141854) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/12 2.26 GB 87.7 1.4 0.0 1.4 4.1 2.8 0.0 1.5 101.4 308.3 13.64 12.63 44 0.310 1405K 7509 0.0 0.0 L1 1/1 49.79 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 239.1 237.6 2.63 2.55 2 1.314 638K 4065 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.5 2.6 242.8 242.3 0.66 0.63 1 0.663 163K 324 0.0 0.0 L3 17/0 811.94 MB 0.8 1.4 0.5 0.8 1.4 0.5 0.0 2.6 221.4 220.8 6.36 5.78 5 1.273 1431K 3762 0.0 0.0 L4 122/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 211.0 211.0 1.09 1.02 1 1.088 233K 0 0.0 0.0 L5 112/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 269/13 21.98 GB 0.0 3.7 1.2 2.5 6.5 4.0 1.2 2.3 156.3 271.7 24.38 22.61 53 0.460 3871K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 1.2 2.5 6.5 4.0 1.1 2.3 156.3 271.7 24.38 22.61 53 0.460 3871K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 1.2 2.5 3.7 1.2 0.0 0.0 235.5 234.5 16.19 15.32 14 1.156 3871K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 345.3 8.19 7.29 39 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.1 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.47 GB write, 717.58 MB/s write, 3.72 GB read, 412.81 MB/s read, 24.4 seconds Interval compaction: 6.47 GB write, 724.71 MB/s write, 3.72 GB read, 416.91 MB/s read, 24.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 728376 Average: 2.6750 StdDev: 16.16 Min: 0 Median: 1.6422 Max: 4322 Percentiles: P50: 1.64 P75: 2.14 P99: 6.84 P99.9: 14.81 P99.99: 220.10 ------------------------------------------------------ [ 0, 1 ] 69837 9.588% 9.588% ## ( 1, 2 ] 458338 62.926% 72.514% ############# ( 2, 3 ] 130091 17.860% 90.374% #### ( 3, 4 ] 31808 4.367% 94.741% # ( 4, 6 ] 29587 4.062% 98.804% # ( 6, 10 ] 6782 0.931% 99.735% ( 10, 15 ] 1252 0.172% 99.907% ( 15, 22 ] 138 0.019% 99.925% ( 22, 34 ] 21 0.003% 99.928% ( 34, 51 ] 5 0.001% 99.929% ( 51, 76 ] 4 0.001% 99.930% ( 76, 110 ] 96 0.013% 99.943% ( 110, 170 ] 260 0.036% 99.978% ( 170, 250 ] 136 0.019% 99.997% ( 250, 380 ] 92 0.013% 100.010% ( 380, 580 ] 69 0.009% 100.019% ( 580, 870 ] 36 0.005% 100.024% ( 870, 1300 ] 19 0.003% 100.027% ( 1300, 1900 ] 7 0.001% 100.028% ( 1900, 2900 ] 4 0.001% 100.028% ( 2900, 4400 ] 6 0.001% 100.029% ** Level 1 read latency histogram (micros): Count: 170711 Average: 2.9781 StdDev: 16.26 Min: 1 Median: 1.7242 Max: 3317 Percentiles: P50: 1.72 P75: 2.47 P99: 9.00 P99.9: 108.38 P99.99: 349.64 ------------------------------------------------------ [ 0, 1 ] 16338 9.571% 9.571% ## ( 1, 2 ] 95304 55.828% 65.398% ########### ( 2, 3 ] 34965 20.482% 85.880% #### ( 3, 4 ] 9600 5.624% 91.504% # ( 4, 6 ] 10666 6.248% 97.752% # ( 6, 10 ] 2837 1.662% 99.414% ( 10, 15 ] 665 0.390% 99.803% ( 15, 22 ] 85 0.050% 99.853% ( 22, 34 ] 8 0.005% 99.858% ( 34, 51 ] 6 0.004% 99.861% ( 51, 76 ] 32 0.019% 99.880% ( 76, 110 ] 36 0.021% 99.901% ( 110, 170 ] 80 0.047% 99.948% ( 170, 250 ] 52 0.030% 99.978% ( 250, 380 ] 26 0.015% 99.994% ( 380, 580 ] 27 0.016% 100.009% ( 580, 870 ] 10 0.006% 100.015% ( 870, 1300 ] 6 0.004% 100.019% ( 1300, 1900 ] 1 0.001% 100.019% ( 1900, 2900 ] 2 0.001% 100.021% ( 2900, 4400 ] 1 0.001% 100.021% ** Level 2 read latency histogram (micros): Count: 40775 Average: 3.3104 StdDev: 18.79 Min: 0 Median: 1.7072 Max: 1965 Percentiles: P50: 1.71 P75: 2.38 P99: 9.09 P99.9: 257.58 P99.99: 721.25 ------------------------------------------------------ [ 0, 1 ] 2744 6.730% 6.730% # ( 1, 2 ] 24948 61.185% 67.914% ############ ( 2, 3 ] 7658 18.781% 86.695% #### ( 3, 4 ] 2095 5.138% 91.833% # ( 4, 6 ] 2271 5.570% 97.403% # ( 6, 10 ] 844 2.070% 99.473% ( 10, 15 ] 85 0.208% 99.681% ( 15, 22 ] 12 0.029% 99.711% ( 22, 34 ] 1 0.002% 99.713% ( 34, 51 ] 1 0.002% 99.716% ( 51, 76 ] 2 0.005% 99.720% ( 76, 110 ] 7 0.017% 99.738% ( 110, 170 ] 42 0.103% 99.841% ( 170, 250 ] 23 0.056% 99.897% ( 250, 380 ] 21 0.052% 99.948% ( 380, 580 ] 14 0.034% 99.983% ( 580, 870 ] 6 0.015% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ( 1900, 2900 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 277446 Average: 3.9664 StdDev: 45.64 Min: 1 Median: 1.7249 Max: 6347 Percentiles: P50: 1.72 P75: 2.40 P99: 9.24 P99.9: 329.33 P99.99: 1229.42 ------------------------------------------------------ [ 0, 1 ] 13718 4.944% 4.944% # ( 1, 2 ] 172440 62.153% 67.097% ############ ( 2, 3 ] 55236 19.909% 87.006% #### ( 3, 4 ] 14356 5.174% 92.180% # ( 4, 6 ] 14716 5.304% 97.484% # ( 6, 10 ] 5199 1.874% 99.358% ( 10, 15 ] 731 0.263% 99.622% ( 15, 22 ] 68 0.025% 99.646% ( 22, 34 ] 9 0.003% 99.649% ( 34, 51 ] 4 0.001% 99.651% ( 51, 76 ] 1 0.000% 99.651% ( 76, 110 ] 103 0.037% 99.688% ( 110, 170 ] 305 0.110% 99.798% ( 170, 250 ] 202 0.073% 99.871% ( 250, 380 ] 132 0.048% 99.919% ( 380, 580 ] 106 0.038% 99.957% ( 580, 870 ] 63 0.023% 99.979% ( 870, 1300 ] 35 0.013% 99.992% ( 1300, 1900 ] 10 0.004% 99.996% ( 1900, 2900 ] 11 0.004% 100.000% ( 2900, 4400 ] 13 0.005% 100.004% ( 4400, 6600 ] 8 0.003% 100.007% ** Level 4 read latency histogram (micros): Count: 60 Average: 1656.9833 StdDev: 2010.09 Min: 1 Median: 446.6667 Max: 6958 Percentiles: P50: 446.67 P75: 3172.73 P99: 6958.00 P99.9: 6958.00 P99.99: 6958.00 ------------------------------------------------------ [ 0, 1 ] 13 21.667% 21.667% #### ( 1, 2 ] 4 6.667% 28.333% # ( 2, 3 ] 1 1.667% 30.000% ( 22, 34 ] 1 1.667% 31.667% ( 76, 110 ] 2 3.333% 35.000% # ( 110, 170 ] 7 11.667% 46.667% ## ( 250, 380 ] 1 1.667% 48.333% ( 380, 580 ] 3 5.000% 53.333% # ( 580, 870 ] 1 1.667% 55.000% ( 870, 1300 ] 2 3.333% 58.333% # ( 1300, 1900 ] 1 1.667% 60.000% ( 1900, 2900 ] 7 11.667% 71.667% ## ( 2900, 4400 ] 11 18.333% 90.000% #### ( 4400, 6600 ] 5 8.333% 98.333% ## ( 6600, 9900 ] 1 1.667% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1200.0000 StdDev: 1265.49 Min: 167 Median: 480.0000 Max: 4016 Percentiles: P50: 480.00 P75: 1900.00 P99: 4016.00 P99.9: 4016.00 P99.99: 4016.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 4 20.000% 25.000% #### ( 250, 380 ] 4 20.000% 45.000% #### ( 380, 580 ] 2 10.000% 55.000% ## ( 870, 1300 ] 3 15.000% 70.000% ### ( 1300, 1900 ] 1 5.000% 75.000% # ( 1900, 2900 ] 2 10.000% 85.000% ## ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 319.75 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.256 H:M:S, 13.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.413 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/15-11:38:13 ... thread 0: (1000000,4000000) ops and (326292.4,327691.8) ops/second in (3.064736,12.206590) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/4 2.02 GB 181.6 2.1 0.0 2.1 5.8 3.7 0.0 1.6 112.9 305.7 19.50 18.12 61 0.320 2235K 11K 0.0 0.0 L1 11/0 1.18 GB 120.8 1.8 1.6 0.2 1.8 1.6 0.1 1.1 223.3 219.0 8.37 7.93 3 2.789 1897K 36K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.5 2.6 242.8 242.3 0.66 0.63 1 0.663 163K 324 0.0 0.0 L3 17/0 811.94 MB 0.8 1.4 0.5 0.8 1.4 0.5 0.0 2.6 221.4 220.8 6.36 5.78 5 1.273 1431K 3762 0.0 0.0 L4 122/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 211.0 211.0 1.09 1.02 1 1.088 233K 0 0.0 0.0 L5 112/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 276/4 22.86 GB 0.0 5.7 2.4 3.3 9.4 6.0 1.2 2.5 163.1 266.5 35.99 33.48 71 0.507 5961K 52K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 2.4 3.3 9.4 6.0 1.1 2.5 163.1 266.5 35.99 33.48 71 0.507 5961K 52K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 2.4 3.3 5.7 2.4 0.0 0.0 234.1 232.1 25.07 23.77 18 1.393 5961K 52K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 345.6 10.92 9.71 53 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.3 total, 12.2 interval Flush(GB): cumulative 3.685, interval 3.685 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.37 GB write, 779.84 MB/s write, 5.73 GB read, 477.28 MB/s read, 36.0 seconds Interval compaction: 9.37 GB write, 785.64 MB/s write, 5.73 GB read, 480.82 MB/s read, 36.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 14, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1033394 Average: 2.5947 StdDev: 14.97 Min: 0 Median: 1.6079 Max: 4322 Percentiles: P50: 1.61 P75: 2.00 P99: 6.48 P99.9: 14.81 P99.99: 227.24 ------------------------------------------------------ [ 0, 1 ] 113687 11.001% 11.001% ## ( 1, 2 ] 662976 64.155% 75.157% ############# ( 2, 3 ] 170271 16.477% 91.633% ### ( 3, 4 ] 39503 3.823% 95.456% # ( 4, 6 ] 35576 3.443% 98.899% # ( 6, 10 ] 8809 0.852% 99.751% ( 10, 15 ] 1600 0.155% 99.906% ( 15, 22 ] 159 0.015% 99.921% ( 22, 34 ] 23 0.002% 99.924% ( 34, 51 ] 6 0.001% 99.924% ( 51, 76 ] 4 0.000% 99.925% ( 76, 110 ] 168 0.016% 99.941% ( 110, 170 ] 378 0.037% 99.977% ( 170, 250 ] 184 0.018% 99.995% ( 250, 380 ] 120 0.012% 100.007% ( 380, 580 ] 98 0.009% 100.016% ( 580, 870 ] 48 0.005% 100.021% ( 870, 1300 ] 24 0.002% 100.023% ( 1300, 1900 ] 11 0.001% 100.024% ( 1900, 2900 ] 5 0.000% 100.025% ( 2900, 4400 ] 6 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 183407 Average: 3.1391 StdDev: 21.68 Min: 1 Median: 1.7190 Max: 3317 Percentiles: P50: 1.72 P75: 2.45 P99: 9.05 P99.9: 144.72 P99.99: 480.91 ------------------------------------------------------ [ 0, 1 ] 17326 9.447% 9.447% ## ( 1, 2 ] 103452 56.406% 65.852% ########### ( 2, 3 ] 37510 20.452% 86.304% #### ( 3, 4 ] 9945 5.422% 91.727% # ( 4, 6 ] 11039 6.019% 97.745% # ( 6, 10 ] 3020 1.647% 99.392% ( 10, 15 ] 682 0.372% 99.764% ( 15, 22 ] 87 0.047% 99.811% ( 22, 34 ] 8 0.004% 99.816% ( 34, 51 ] 7 0.004% 99.820% ( 51, 76 ] 32 0.017% 99.837% ( 76, 110 ] 45 0.025% 99.862% ( 110, 170 ] 122 0.067% 99.928% ( 170, 250 ] 62 0.034% 99.962% ( 250, 380 ] 34 0.019% 99.980% ( 380, 580 ] 35 0.019% 99.999% ( 580, 870 ] 16 0.009% 100.008% ( 870, 1300 ] 11 0.006% 100.014% ( 1300, 1900 ] 3 0.002% 100.016% ( 1900, 2900 ] 5 0.003% 100.019% ( 2900, 4400 ] 2 0.001% 100.020% ** Level 2 read latency histogram (micros): Count: 40775 Average: 3.3104 StdDev: 18.79 Min: 0 Median: 1.7072 Max: 1965 Percentiles: P50: 1.71 P75: 2.38 P99: 9.09 P99.9: 257.58 P99.99: 721.25 ------------------------------------------------------ [ 0, 1 ] 2744 6.730% 6.730% # ( 1, 2 ] 24948 61.185% 67.914% ############ ( 2, 3 ] 7658 18.781% 86.695% #### ( 3, 4 ] 2095 5.138% 91.833% # ( 4, 6 ] 2271 5.570% 97.403% # ( 6, 10 ] 844 2.070% 99.473% ( 10, 15 ] 85 0.208% 99.681% ( 15, 22 ] 12 0.029% 99.711% ( 22, 34 ] 1 0.002% 99.713% ( 34, 51 ] 1 0.002% 99.716% ( 51, 76 ] 2 0.005% 99.720% ( 76, 110 ] 7 0.017% 99.738% ( 110, 170 ] 42 0.103% 99.841% ( 170, 250 ] 23 0.056% 99.897% ( 250, 380 ] 21 0.052% 99.948% ( 380, 580 ] 14 0.034% 99.983% ( 580, 870 ] 6 0.015% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ( 1900, 2900 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 277446 Average: 3.9664 StdDev: 45.64 Min: 1 Median: 1.7249 Max: 6347 Percentiles: P50: 1.72 P75: 2.40 P99: 9.24 P99.9: 329.33 P99.99: 1229.42 ------------------------------------------------------ [ 0, 1 ] 13718 4.944% 4.944% # ( 1, 2 ] 172440 62.153% 67.097% ############ ( 2, 3 ] 55236 19.909% 87.006% #### ( 3, 4 ] 14356 5.174% 92.180% # ( 4, 6 ] 14716 5.304% 97.484% # ( 6, 10 ] 5199 1.874% 99.358% ( 10, 15 ] 731 0.263% 99.622% ( 15, 22 ] 68 0.025% 99.646% ( 22, 34 ] 9 0.003% 99.649% ( 34, 51 ] 4 0.001% 99.651% ( 51, 76 ] 1 0.000% 99.651% ( 76, 110 ] 103 0.037% 99.688% ( 110, 170 ] 305 0.110% 99.798% ( 170, 250 ] 202 0.073% 99.871% ( 250, 380 ] 132 0.048% 99.919% ( 380, 580 ] 106 0.038% 99.957% ( 580, 870 ] 63 0.023% 99.979% ( 870, 1300 ] 35 0.013% 99.992% ( 1300, 1900 ] 10 0.004% 99.996% ( 1900, 2900 ] 11 0.004% 100.000% ( 2900, 4400 ] 13 0.005% 100.004% ( 4400, 6600 ] 8 0.003% 100.007% ** Level 4 read latency histogram (micros): Count: 60 Average: 1656.9833 StdDev: 2010.09 Min: 1 Median: 446.6667 Max: 6958 Percentiles: P50: 446.67 P75: 3172.73 P99: 6958.00 P99.9: 6958.00 P99.99: 6958.00 ------------------------------------------------------ [ 0, 1 ] 13 21.667% 21.667% #### ( 1, 2 ] 4 6.667% 28.333% # ( 2, 3 ] 1 1.667% 30.000% ( 22, 34 ] 1 1.667% 31.667% ( 76, 110 ] 2 3.333% 35.000% # ( 110, 170 ] 7 11.667% 46.667% ## ( 250, 380 ] 1 1.667% 48.333% ( 380, 580 ] 3 5.000% 53.333% # ( 580, 870 ] 1 1.667% 55.000% ( 870, 1300 ] 2 3.333% 58.333% # ( 1300, 1900 ] 1 1.667% 60.000% ( 1900, 2900 ] 7 11.667% 71.667% ## ( 2900, 4400 ] 11 18.333% 90.000% #### ( 4400, 6600 ] 5 8.333% 98.333% ## ( 6600, 9900 ] 1 1.667% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1200.0000 StdDev: 1265.49 Min: 167 Median: 480.0000 Max: 4016 Percentiles: P50: 480.00 P75: 1900.00 P99: 4016.00 P99.9: 4016.00 P99.99: 4016.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 4 20.000% 25.000% #### ( 250, 380 ] 4 20.000% 45.000% #### ( 380, 580 ] 2 10.000% 55.000% ## ( 870, 1300 ] 3 15.000% 70.000% ### ( 1300, 1900 ] 1 5.000% 75.000% # ( 1900, 2900 ] 2 10.000% 85.000% ## ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 12.3 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 320.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.697 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.441 H:M:S, 14.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/15-11:38:16 ... thread 0: (1000000,5000000) ops and (273941.2,315318.0) ops/second in (3.650419,15.857009) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/15 3.00 GB 75.2 2.9 0.0 2.9 7.6 4.7 0.0 1.6 118.6 305.6 25.46 23.70 78 0.326 3065K 15K 0.0 0.0 L1 11/11 1.18 GB 0.0 1.8 1.6 0.2 1.8 1.6 0.1 1.1 223.3 219.0 8.37 7.93 3 2.789 1897K 36K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.5 2.6 242.8 242.3 0.66 0.63 1 0.663 163K 324 0.0 0.0 L3 17/0 811.94 MB 0.8 1.4 0.5 0.8 1.4 0.5 0.0 2.6 221.4 220.8 6.36 5.78 5 1.273 1431K 3762 0.0 0.0 L4 122/0 9.64 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 211.0 211.0 1.09 1.02 1 1.088 233K 0 0.0 0.0 L5 112/0 9.23 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 281/26 23.84 GB 0.0 6.5 2.4 4.1 11.1 7.0 1.2 2.4 159.4 272.0 41.95 39.06 88 0.477 6791K 56K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 2.4 4.1 11.1 7.0 1.1 2.4 159.4 272.0 41.95 39.06 88 0.477 6791K 56K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 2.4 4.1 6.5 2.4 0.0 0.0 237.7 235.7 28.14 26.78 21 1.340 6791K 56K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 346.1 13.81 12.27 67 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.9 total, 15.9 interval Flush(GB): cumulative 4.668, interval 4.668 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.14 GB write, 715.44 MB/s write, 6.53 GB read, 419.31 MB/s read, 41.9 seconds Interval compaction: 11.14 GB write, 719.53 MB/s write, 6.53 GB read, 421.71 MB/s read, 41.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 18, interval: 22 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1368958 Average: 2.6010 StdDev: 15.70 Min: 0 Median: 1.5972 Max: 4322 Percentiles: P50: 1.60 P75: 1.98 P99: 6.16 P99.9: 21.16 P99.99: 235.28 ------------------------------------------------------ [ 0, 1 ] 153368 11.203% 11.203% ## ( 1, 2 ] 889393 64.969% 76.172% ############# ( 2, 3 ] 218830 15.985% 92.157% ### ( 3, 4 ] 49680 3.629% 95.786% # ( 4, 6 ] 43575 3.183% 98.969% # ( 6, 10 ] 10802 0.789% 99.758% ( 10, 15 ] 1780 0.130% 99.888% ( 15, 22 ] 184 0.013% 99.902% ( 22, 34 ] 24 0.002% 99.903% ( 34, 51 ] 10 0.001% 99.904% ( 51, 76 ] 7 0.001% 99.905% ( 76, 110 ] 377 0.028% 99.932% ( 110, 170 ] 593 0.043% 99.976% ( 170, 250 ] 244 0.018% 99.993% ( 250, 380 ] 175 0.013% 100.006% ( 380, 580 ] 139 0.010% 100.016% ( 580, 870 ] 68 0.005% 100.021% ( 870, 1300 ] 29 0.002% 100.023% ( 1300, 1900 ] 13 0.001% 100.024% ( 1900, 2900 ] 7 0.001% 100.025% ( 2900, 4400 ] 11 0.001% 100.026% ** Level 1 read latency histogram (micros): Count: 251383 Average: 3.0704 StdDev: 20.91 Min: 1 Median: 1.6777 Max: 3317 Percentiles: P50: 1.68 P75: 2.31 P99: 8.89 P99.9: 148.89 P99.99: 507.07 ------------------------------------------------------ [ 0, 1 ] 24836 9.880% 9.880% ## ( 1, 2 ] 148822 59.201% 69.081% ############ ( 2, 3 ] 47830 19.027% 88.108% #### ( 3, 4 ] 11652 4.635% 92.743% # ( 4, 6 ] 12833 5.105% 97.848% # ( 6, 10 ] 4006 1.594% 99.441% ( 10, 15 ] 730 0.290% 99.732% ( 15, 22 ] 97 0.039% 99.770% ( 22, 34 ] 10 0.004% 99.774% ( 34, 51 ] 8 0.003% 99.778% ( 51, 76 ] 33 0.013% 99.791% ( 76, 110 ] 145 0.058% 99.848% ( 110, 170 ] 200 0.080% 99.928% ( 170, 250 ] 82 0.033% 99.961% ( 250, 380 ] 44 0.018% 99.978% ( 380, 580 ] 47 0.019% 99.997% ( 580, 870 ] 20 0.008% 100.005% ( 870, 1300 ] 11 0.004% 100.009% ( 1300, 1900 ] 4 0.002% 100.011% ( 1900, 2900 ] 7 0.003% 100.014% ( 2900, 4400 ] 2 0.001% 100.014% ** Level 2 read latency histogram (micros): Count: 40775 Average: 3.3104 StdDev: 18.79 Min: 0 Median: 1.7072 Max: 1965 Percentiles: P50: 1.71 P75: 2.38 P99: 9.09 P99.9: 257.58 P99.99: 721.25 ------------------------------------------------------ [ 0, 1 ] 2744 6.730% 6.730% # ( 1, 2 ] 24948 61.185% 67.914% ############ ( 2, 3 ] 7658 18.781% 86.695% #### ( 3, 4 ] 2095 5.138% 91.833% # ( 4, 6 ] 2271 5.570% 97.403% # ( 6, 10 ] 844 2.070% 99.473% ( 10, 15 ] 85 0.208% 99.681% ( 15, 22 ] 12 0.029% 99.711% ( 22, 34 ] 1 0.002% 99.713% ( 34, 51 ] 1 0.002% 99.716% ( 51, 76 ] 2 0.005% 99.720% ( 76, 110 ] 7 0.017% 99.738% ( 110, 170 ] 42 0.103% 99.841% ( 170, 250 ] 23 0.056% 99.897% ( 250, 380 ] 21 0.052% 99.948% ( 380, 580 ] 14 0.034% 99.983% ( 580, 870 ] 6 0.015% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ( 1900, 2900 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 277446 Average: 3.9664 StdDev: 45.64 Min: 1 Median: 1.7249 Max: 6347 Percentiles: P50: 1.72 P75: 2.40 P99: 9.24 P99.9: 329.33 P99.99: 1229.42 ------------------------------------------------------ [ 0, 1 ] 13718 4.944% 4.944% # ( 1, 2 ] 172440 62.153% 67.097% ############ ( 2, 3 ] 55236 19.909% 87.006% #### ( 3, 4 ] 14356 5.174% 92.180% # ( 4, 6 ] 14716 5.304% 97.484% # ( 6, 10 ] 5199 1.874% 99.358% ( 10, 15 ] 731 0.263% 99.622% ( 15, 22 ] 68 0.025% 99.646% ( 22, 34 ] 9 0.003% 99.649% ( 34, 51 ] 4 0.001% 99.651% ( 51, 76 ] 1 0.000% 99.651% ( 76, 110 ] 103 0.037% 99.688% ( 110, 170 ] 305 0.110% 99.798% ( 170, 250 ] 202 0.073% 99.871% ( 250, 380 ] 132 0.048% 99.919% ( 380, 580 ] 106 0.038% 99.957% ( 580, 870 ] 63 0.023% 99.979% ( 870, 1300 ] 35 0.013% 99.992% ( 1300, 1900 ] 10 0.004% 99.996% ( 1900, 2900 ] 11 0.004% 100.000% ( 2900, 4400 ] 13 0.005% 100.004% ( 4400, 6600 ] 8 0.003% 100.007% ** Level 4 read latency histogram (micros): Count: 60 Average: 1656.9833 StdDev: 2010.09 Min: 1 Median: 446.6667 Max: 6958 Percentiles: P50: 446.67 P75: 3172.73 P99: 6958.00 P99.9: 6958.00 P99.99: 6958.00 ------------------------------------------------------ [ 0, 1 ] 13 21.667% 21.667% #### ( 1, 2 ] 4 6.667% 28.333% # ( 2, 3 ] 1 1.667% 30.000% ( 22, 34 ] 1 1.667% 31.667% ( 76, 110 ] 2 3.333% 35.000% # ( 110, 170 ] 7 11.667% 46.667% ## ( 250, 380 ] 1 1.667% 48.333% ( 380, 580 ] 3 5.000% 53.333% # ( 580, 870 ] 1 1.667% 55.000% ( 870, 1300 ] 2 3.333% 58.333% # ( 1300, 1900 ] 1 1.667% 60.000% ( 1900, 2900 ] 7 11.667% 71.667% ## ( 2900, 4400 ] 11 18.333% 90.000% #### ( 4400, 6600 ] 5 8.333% 98.333% ## ( 6600, 9900 ] 1 1.667% 100.000% ** Level 5 read latency histogram (micros): Count: 20 Average: 1200.0000 StdDev: 1265.49 Min: 167 Median: 480.0000 Max: 4016 Percentiles: P50: 480.00 P75: 1900.00 P99: 4016.00 P99.9: 4016.00 P99.99: 4016.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 4 20.000% 25.000% #### ( 250, 380 ] 4 20.000% 45.000% #### ( 380, 580 ] 2 10.000% 55.000% ## ( 870, 1300 ] 3 15.000% 70.000% ### ( 1300, 1900 ] 1 5.000% 75.000% # ( 1900, 2900 ] 2 10.000% 85.000% ## ( 2900, 4400 ] 3 15.000% 100.000% ### ** DB Stats ** Uptime(secs): 15.9 total, 3.7 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 308.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.687 H:M:S, 16.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 269.61 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.991 H:M:S, 27.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.582 micros/op 279188 ops/sec 20.029 seconds 5591999 operations; 270.5 MB/s Microseconds per write: Count: 5591999 Average: 3.5818 StdDev: 258.15 Min: 1 Median: 1.7239 Max: 233846 Percentiles: P50: 1.72 P75: 2.66 P99: 7.34 P99.9: 97.98 P99.99: 1284.46 ------------------------------------------------------ [ 0, 1 ] 744308 13.310% 13.310% ### ( 1, 2 ] 2834409 50.687% 63.997% ########## ( 2, 3 ] 932928 16.683% 80.680% ### ( 3, 4 ] 754811 13.498% 94.178% ### ( 4, 6 ] 254379 4.549% 98.727% # ( 6, 10 ] 45468 0.813% 99.540% ( 10, 15 ] 12851 0.230% 99.770% ( 15, 22 ] 3670 0.066% 99.836% ( 22, 34 ] 739 0.013% 99.849% ( 34, 51 ] 100 0.002% 99.851% ( 51, 76 ] 8 0.000% 99.851% ( 76, 110 ] 4233 0.076% 99.927% ( 110, 170 ] 1257 0.022% 99.949% ( 170, 250 ] 148 0.003% 99.952% ( 250, 380 ] 33 0.001% 99.952% ( 380, 580 ] 7 0.000% 99.953% ( 580, 870 ] 5 0.000% 99.953% ( 870, 1300 ] 2164 0.039% 99.991% ( 1300, 1900 ] 3 0.000% 99.991% ( 1900, 2900 ] 462 0.008% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 170000, 250000 ] 9 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 175679 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5591999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5770942968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 169 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 5182549 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9888358941 rocksdb.compact.write.bytes COUNT : 9714447386 rocksdb.flush.write.bytes COUNT : 5737486618 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 14 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 80 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5700709376 rocksdb.memtable.garbage.bytes.at.flush COUNT : 10923008 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 9934454371 rocksdb.non.last.level.read.count COUNT : 2398512 rocksdb.block.checksum.compute.count COUNT : 2398188 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.350925 P95 : 3.754714 P99 : 5.874417 P100 : 233841.000000 COUNT : 5591999 SUM : 17395159 rocksdb.compaction.times.micros P50 : 1043076.923077 P95 : 4020000.000000 P99 : 5739914.000000 P100 : 5739914.000000 COUNT : 24 SUM : 31036764 rocksdb.compaction.times.cpu_micros P50 : 1016923.076923 P95 : 4020000.000000 P99 : 5376061.000000 P100 : 5376061.000000 COUNT : 24 SUM : 29637340 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 652.500000 P95 : 1432.000000 P99 : 1801.000000 P100 : 1801.000000 COUNT : 78 SUM : 60612 rocksdb.compaction.outfile.sync.micros P50 : 776.785714 P95 : 1577.500000 P99 : 3107.000000 P100 : 3107.000000 COUNT : 83 SUM : 69205 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 80.000000 P95 : 245.428571 P99 : 351.920000 P100 : 354.000000 COUNT : 108 SUM : 11094 rocksdb.table.open.io.micros P50 : 1454.545455 P95 : 14488.888889 P99 : 20497.777778 P100 : 20881.000000 COUNT : 169 SUM : 491003 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.631034 P95 : 6.801070 P99 : 9.906395 P100 : 11268.000000 COUNT : 2397699 SUM : 11560658 rocksdb.read.block.get.micros P50 : 528.148148 P95 : 4232.692308 P99 : 6347.000000 P100 : 7226.000000 COUNT : 338 SUM : 364434 rocksdb.write.raw.block.micros P50 : 0.510120 P95 : 0.969228 P99 : 2.631668 P100 : 4229.000000 COUNT : 3743550 SUM : 6842303 rocksdb.numfiles.in.singlecompaction P50 : 3.382353 P95 : 9.266667 P99 : 19.830000 P100 : 22.000000 COUNT : 31 SUM : 139 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560668 P95 : 1149.470235 P99 : 2397.575758 P100 : 233600.000000 COUNT : 24712 SUM : 5185408 rocksdb.sst.read.micros P50 : 1.612208 P95 : 3.978697 P99 : 7.679891 P100 : 6958.000000 COUNT : 2398563 SUM : 7004059 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5591999 SUM : 5770942968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 210677.966102 P95 : 338111.111111 P99 : 386633.000000 P100 : 386633.000000 COUNT : 78 SUM : 15761158 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 105 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0