[2024-10-14 17:32:33.437541] Starting SPDK v25.01-pre git sha1 4c93d5931 / DPDK 24.03.0 initialization... [2024-10-14 17:32:33.437663] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid4179458 ] Set seed to 1728919953434929 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-10-14 17:32:33.594103] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-10-14 17:32:33.746522] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-10-14 17:32:33.746585] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 4179458' to capture a snapshot of events at runtime. [2024-10-14 17:32:33.746604] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-10-14 17:32:33.746623] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-10-14 17:32:33.746638] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid4179458 for offline analysis/debug. [2024-10-14 17:32:33.748546] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Mon Oct 14 17:32:40 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/10/14-17:32:44 ... thread 0: (1000000,1000000) ops and (258271.5,258271.5) ops/second in (3.871894,3.871894) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 7/5 440.39 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 319.7 2.76 2.43 14 0.197 0 0 0.0 0.0 L1 4/0 374.49 MB 37.4 0.6 0.4 0.2 0.5 0.4 0.1 1.5 246.5 245.2 2.29 2.22 2 1.147 574K 3004 0.0 0.0 L2 1/1 100.68 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.0 2.6 239.1 238.7 0.67 0.64 1 0.672 163K 297 0.0 0.0 L3 19/12 941.69 MB 0.1 0.1 0.1 0.0 0.1 0.1 0.0 1.0 186.4 186.4 0.32 0.27 1 0.321 60K 0 0.0 0.0 L4 136/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 116/0 8.67 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 283/18 20.08 GB 0.0 0.8 0.5 0.3 1.6 1.3 0.1 1.9 130.1 275.3 6.04 5.56 18 0.336 798K 3301 0.0 0.0 Int 0/0 0.00 KB 0.0 0.8 0.5 0.3 1.6 1.3 0.1 1.9 130.1 275.3 6.04 5.56 18 0.336 798K 3301 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.8 0.5 0.3 0.8 0.5 0.0 0.0 239.1 238.1 3.29 3.13 4 0.822 798K 3301 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 319.7 2.76 2.43 14 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.0 total, 3.9 interval Flush(GB): cumulative 0.860, interval 0.860 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.62 GB write, 417.99 MB/s write, 0.77 GB read, 197.53 MB/s read, 6.0 seconds Interval compaction: 1.62 GB write, 429.25 MB/s write, 0.77 GB read, 202.85 MB/s read, 6.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 148412 Average: 2.2612 StdDev: 12.46 Min: 1 Median: 1.5074 Max: 3122 Percentiles: P50: 1.51 P75: 1.95 P99: 5.92 P99.9: 12.90 P99.99: 182.34 ------------------------------------------------------ [ 0, 1 ] 31491 21.219% 21.219% #### ( 1, 2 ] 84178 56.719% 77.938% ########### ( 2, 3 ] 23256 15.670% 93.608% ### ( 3, 4 ] 4292 2.892% 96.500% # ( 4, 6 ] 3865 2.604% 99.104% # ( 6, 10 ] 1054 0.710% 99.814% ( 10, 15 ] 225 0.152% 99.966% ( 15, 22 ] 27 0.018% 99.984% ( 22, 34 ] 5 0.003% 99.987% ( 34, 51 ] 2 0.001% 99.989% ( 51, 76 ] 1 0.001% 99.989% ( 76, 110 ] 2 0.001% 99.991% ( 170, 250 ] 14 0.009% 100.000% ( 380, 580 ] 8 0.005% 100.005% ( 580, 870 ] 2 0.001% 100.007% ( 870, 1300 ] 1 0.001% 100.007% ( 1300, 1900 ] 1 0.001% 100.008% ( 1900, 2900 ] 1 0.001% 100.009% ( 2900, 4400 ] 1 0.001% 100.009% ** Level 1 read latency histogram (micros): Count: 47804 Average: 2.1172 StdDev: 10.92 Min: 1 Median: 1.4185 Max: 1303 Percentiles: P50: 1.42 P75: 1.81 P99: 5.22 P99.9: 9.55 P99.99: 508.78 ------------------------------------------------------ [ 0, 1 ] 11030 23.073% 23.073% ##### ( 1, 2 ] 30757 64.340% 87.413% ############# ( 2, 3 ] 3729 7.801% 95.214% ## ( 3, 4 ] 1369 2.864% 98.078% # ( 4, 6 ] 722 1.510% 99.588% ( 6, 10 ] 168 0.351% 99.939% ( 10, 15 ] 13 0.027% 99.967% ( 15, 22 ] 4 0.008% 99.975% ( 22, 34 ] 1 0.002% 99.977% ( 170, 250 ] 2 0.004% 99.981% ( 250, 380 ] 1 0.002% 99.983% ( 380, 580 ] 5 0.010% 99.994% ( 870, 1300 ] 2 0.004% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 40166 Average: 2.7928 StdDev: 43.51 Min: 1 Median: 1.4767 Max: 7141 Percentiles: P50: 1.48 P75: 1.89 P99: 8.52 P99.9: 86.27 P99.99: 868.40 ------------------------------------------------------ [ 0, 1 ] 8495 21.150% 21.150% #### ( 1, 2 ] 24310 60.524% 81.674% ############ ( 2, 3 ] 3801 9.463% 91.137% ## ( 3, 4 ] 1469 3.657% 94.794% # ( 4, 6 ] 1371 3.413% 98.207% # ( 6, 10 ] 505 1.257% 99.465% ( 10, 15 ] 119 0.296% 99.761% ( 15, 22 ] 12 0.030% 99.791% ( 22, 34 ] 2 0.005% 99.796% ( 51, 76 ] 37 0.092% 99.888% ( 76, 110 ] 16 0.040% 99.928% ( 110, 170 ] 8 0.020% 99.948% ( 170, 250 ] 10 0.025% 99.973% ( 250, 380 ] 2 0.005% 99.978% ( 380, 580 ] 2 0.005% 99.983% ( 580, 870 ] 3 0.007% 99.990% ( 870, 1300 ] 2 0.005% 99.995% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 38572 Average: 11.0104 StdDev: 227.18 Min: 1 Median: 1.9518 Max: 12237 Percentiles: P50: 1.95 P75: 2.70 P99: 13.66 P99.9: 2169.78 P99.99: 10046.37 ------------------------------------------------------ [ 0, 1 ] 717 1.859% 1.859% ( 1, 2 ] 19509 50.578% 52.437% ########## ( 2, 3 ] 12348 32.013% 84.450% ###### ( 3, 4 ] 2276 5.901% 90.351% # ( 4, 6 ] 2318 6.010% 96.360% # ( 6, 10 ] 842 2.183% 98.543% ( 10, 15 ] 241 0.625% 99.168% ( 15, 22 ] 47 0.122% 99.290% ( 22, 34 ] 12 0.031% 99.321% ( 34, 51 ] 3 0.008% 99.329% ( 76, 110 ] 47 0.122% 99.450% ( 110, 170 ] 72 0.187% 99.637% ( 170, 250 ] 37 0.096% 99.733% ( 250, 380 ] 25 0.065% 99.798% ( 380, 580 ] 13 0.034% 99.831% ( 580, 870 ] 7 0.018% 99.850% ( 870, 1300 ] 11 0.029% 99.878% ( 1300, 1900 ] 6 0.016% 99.894% ( 1900, 2900 ] 9 0.023% 99.917% ( 2900, 4400 ] 7 0.018% 99.935% ( 4400, 6600 ] 5 0.013% 99.948% ( 6600, 9900 ] 16 0.041% 99.990% ( 9900, 14000 ] 4 0.010% 100.000% ** Level 4 read latency histogram (micros): Count: 15 Average: 5546.6667 StdDev: 3518.74 Min: 1215 Median: 4150.0000 Max: 11567 Percentiles: P50: 4150.00 P75: 8456.25 P99: 11567.00 P99.9: 11567.00 P99.99: 11567.00 ------------------------------------------------------ ( 870, 1300 ] 1 6.667% 6.667% # ( 1900, 2900 ] 4 26.667% 33.333% ##### ( 2900, 4400 ] 3 20.000% 53.333% #### ( 4400, 6600 ] 1 6.667% 60.000% # ( 6600, 9900 ] 4 26.667% 86.667% ##### ( 9900, 14000 ] 2 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 4.0 total, 3.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 247.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 253.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/14-17:32:48 ... thread 0: (1000000,2000000) ops and (249128.7,253617.7) ops/second in (4.013990,7.885884) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 1.41 GB 25.0 0.8 0.0 0.8 2.6 1.8 0.0 1.4 85.1 281.0 9.61 8.73 33 0.291 830K 4483 0.0 0.0 L1 1/1 18.66 MB 0.0 0.6 0.4 0.2 0.5 0.4 0.1 1.5 246.5 245.2 2.29 2.22 2 1.147 574K 3004 0.0 0.0 L2 1/1 100.68 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.3 2.6 239.1 238.7 0.67 0.64 1 0.672 163K 297 0.0 0.0 L3 22/12 1.27 GB 0.4 0.5 0.4 0.1 0.5 0.4 0.0 1.2 211.4 210.9 2.43 2.27 4 0.607 521K 1189 0.0 0.0 L4 136/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 116/0 8.67 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 289/26 21.06 GB 0.0 2.0 0.8 1.2 3.8 2.7 0.4 2.1 137.1 262.3 15.00 13.85 40 0.375 2089K 8973 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.8 1.2 3.8 2.7 0.4 2.1 137.1 262.3 15.00 13.85 40 0.375 2089K 8973 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.8 1.2 2.0 0.8 0.0 0.0 227.2 226.2 9.05 8.67 10 0.905 2089K 8973 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 317.2 5.95 5.18 30 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.0 total, 7.9 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.84 GB write, 492.34 MB/s write, 2.01 GB read, 257.39 MB/s read, 15.0 seconds Interval compaction: 3.84 GB write, 498.86 MB/s write, 2.01 GB read, 260.79 MB/s read, 15.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 434075 Average: 2.9572 StdDev: 17.28 Min: 1 Median: 1.7208 Max: 3464 Percentiles: P50: 1.72 P75: 2.41 P99: 7.79 P99.9: 126.34 P99.99: 303.70 ------------------------------------------------------ [ 0, 1 ] 43930 10.120% 10.120% ## ( 1, 2 ] 240168 55.329% 65.449% ########### ( 2, 3 ] 101463 23.375% 88.824% ##### ( 3, 4 ] 21306 4.908% 93.732% # ( 4, 6 ] 20693 4.767% 98.499% # ( 6, 10 ] 4862 1.120% 99.619% ( 10, 15 ] 891 0.205% 99.824% ( 15, 22 ] 95 0.022% 99.846% ( 22, 34 ] 14 0.003% 99.850% ( 34, 51 ] 4 0.001% 99.850% ( 51, 76 ] 40 0.009% 99.860% ( 76, 110 ] 120 0.028% 99.887% ( 110, 170 ] 209 0.048% 99.935% ( 170, 250 ] 201 0.046% 99.982% ( 250, 380 ] 91 0.021% 100.003% ( 380, 580 ] 81 0.019% 100.021% ( 580, 870 ] 24 0.006% 100.027% ( 870, 1300 ] 16 0.004% 100.031% ( 1300, 1900 ] 6 0.001% 100.032% ( 1900, 2900 ] 3 0.001% 100.033% ( 2900, 4400 ] 3 0.001% 100.033% ** Level 1 read latency histogram (micros): Count: 138083 Average: 2.5210 StdDev: 6.86 Min: 1 Median: 1.6914 Max: 1303 Percentiles: P50: 1.69 P75: 2.35 P99: 6.67 P99.9: 12.25 P99.99: 17.39 ------------------------------------------------------ [ 0, 1 ] 13561 9.821% 9.821% ## ( 1, 2 ] 80241 58.111% 67.932% ############ ( 2, 3 ] 27708 20.066% 87.998% #### ( 3, 4 ] 8038 5.821% 93.819% # ( 4, 6 ] 6925 5.015% 98.834% # ( 6, 10 ] 1377 0.997% 99.831% ( 10, 15 ] 211 0.153% 99.984% ( 15, 22 ] 24 0.017% 100.001% ( 22, 34 ] 5 0.004% 100.005% ( 51, 76 ] 1 0.001% 100.006% ( 110, 170 ] 3 0.002% 100.008% ( 170, 250 ] 5 0.004% 100.012% ( 250, 380 ] 1 0.001% 100.012% ( 380, 580 ] 5 0.004% 100.016% ( 580, 870 ] 1 0.001% 100.017% ( 870, 1300 ] 2 0.001% 100.018% ( 1300, 1900 ] 1 0.001% 100.019% ** Level 2 read latency histogram (micros): Count: 44491 Average: 3.1960 StdDev: 42.98 Min: 1 Median: 1.5401 Max: 7141 Percentiles: P50: 1.54 P75: 1.98 P99: 9.12 P99.9: 203.63 P99.99: 948.95 ------------------------------------------------------ [ 0, 1 ] 8496 19.096% 19.096% #### ( 1, 2 ] 25458 57.221% 76.317% ########### ( 2, 3 ] 6062 13.625% 89.942% ### ( 3, 4 ] 1850 4.158% 94.100% # ( 4, 6 ] 1705 3.832% 97.932% # ( 6, 10 ] 610 1.371% 99.303% ( 10, 15 ] 149 0.335% 99.638% ( 15, 22 ] 15 0.034% 99.672% ( 22, 34 ] 2 0.004% 99.676% ( 51, 76 ] 37 0.083% 99.760% ( 76, 110 ] 16 0.036% 99.795% ( 110, 170 ] 37 0.083% 99.879% ( 170, 250 ] 25 0.056% 99.935% ( 250, 380 ] 8 0.018% 99.953% ( 380, 580 ] 11 0.025% 99.978% ( 580, 870 ] 6 0.013% 99.991% ( 870, 1300 ] 3 0.007% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ( 6600, 9900 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 248854 Average: 4.8275 StdDev: 90.83 Min: 1 Median: 2.2159 Max: 12237 Percentiles: P50: 2.22 P75: 2.81 P99: 9.93 P99.9: 233.40 P99.99: 1031.01 ------------------------------------------------------ [ 0, 1 ] 1959 0.787% 0.787% ( 1, 2 ] 99674 40.053% 40.840% ######## ( 2, 3 ] 105583 42.428% 83.268% ######## ( 3, 4 ] 16458 6.614% 89.882% # ( 4, 6 ] 17426 7.002% 96.884% # ( 6, 10 ] 5365 2.156% 99.040% ( 10, 15 ] 1318 0.530% 99.570% ( 15, 22 ] 187 0.075% 99.645% ( 22, 34 ] 28 0.011% 99.656% ( 34, 51 ] 4 0.002% 99.658% ( 51, 76 ] 1 0.000% 99.658% ( 76, 110 ] 119 0.048% 99.706% ( 110, 170 ] 350 0.141% 99.846% ( 170, 250 ] 168 0.068% 99.914% ( 250, 380 ] 102 0.041% 99.955% ( 380, 580 ] 59 0.024% 99.979% ( 580, 870 ] 21 0.008% 99.987% ( 870, 1300 ] 19 0.008% 99.995% ( 1300, 1900 ] 6 0.002% 99.997% ( 1900, 2900 ] 10 0.004% 100.001% ( 2900, 4400 ] 8 0.003% 100.004% ( 4400, 6600 ] 5 0.002% 100.006% ( 6600, 9900 ] 16 0.006% 100.013% ( 9900, 14000 ] 4 0.002% 100.014% ** Level 4 read latency histogram (micros): Count: 15 Average: 5546.6667 StdDev: 3518.74 Min: 1215 Median: 4150.0000 Max: 11567 Percentiles: P50: 4150.00 P75: 8456.25 P99: 11567.00 P99.9: 11567.00 P99.99: 11567.00 ------------------------------------------------------ ( 870, 1300 ] 1 6.667% 6.667% # ( 1900, 2900 ] 4 26.667% 33.333% ##### ( 2900, 4400 ] 3 20.000% 53.333% #### ( 4400, 6600 ] 1 6.667% 60.000% # ( 6600, 9900 ] 4 26.667% 86.667% ##### ( 9900, 14000 ] 2 13.333% 100.000% ### ** DB Stats ** Uptime(secs): 8.0 total, 4.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 246.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 245.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/14-17:32:52 ... thread 0: (1000000,3000000) ops and (250905.6,252707.2) ops/second in (3.985562,11.871446) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.47 GB 100.2 1.5 0.0 1.5 4.4 2.8 0.0 1.5 95.6 271.1 16.45 14.93 52 0.316 1597K 8200 0.0 0.0 L1 4/0 425.20 MB 42.5 1.5 1.3 0.2 1.5 1.3 0.1 1.1 223.3 220.1 6.83 6.47 3 2.276 1548K 21K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 2.6 239.1 238.7 0.67 0.64 1 0.672 163K 297 0.0 0.0 L3 17/0 937.31 MB 0.9 1.7 0.6 1.0 1.6 0.6 0.4 2.6 197.3 196.5 8.57 7.96 6 1.429 1718K 6351 0.0 0.0 L4 142/0 9.74 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 199.2 199.2 0.99 0.87 1 0.989 200K 0 0.0 0.0 L5 128/0 9.47 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 303/8 22.02 GB 0.0 5.0 2.2 2.9 7.8 5.0 2.8 2.8 153.6 238.8 33.51 30.86 63 0.532 5226K 36K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.0 2.2 2.9 7.8 5.0 2.8 2.8 153.6 238.8 33.51 30.86 63 0.532 5226K 36K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.0 2.2 2.9 5.0 2.1 0.0 0.0 210.9 209.4 24.41 23.00 17 1.436 5226K 36K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 317.8 9.11 7.86 46 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.0 total, 11.9 interval Flush(GB): cumulative 2.826, interval 2.826 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.82 GB write, 668.12 MB/s write, 5.03 GB read, 429.61 MB/s read, 33.5 seconds Interval compaction: 7.82 GB write, 674.00 MB/s write, 5.03 GB read, 433.39 MB/s read, 33.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 815240 Average: 2.9192 StdDev: 15.39 Min: 1 Median: 1.7665 Max: 3464 Percentiles: P50: 1.77 P75: 2.47 P99: 7.86 P99.9: 24.70 P99.99: 210.13 ------------------------------------------------------ [ 0, 1 ] 65750 8.065% 8.065% ## ( 1, 2 ] 445989 54.706% 62.772% ########### ( 2, 3 ] 213305 26.165% 88.936% ##### ( 3, 4 ] 40110 4.920% 93.856% # ( 4, 6 ] 37357 4.582% 98.439% # ( 6, 10 ] 9833 1.206% 99.645% ( 10, 15 ] 1808 0.222% 99.867% ( 15, 22 ] 266 0.033% 99.899% ( 22, 34 ] 30 0.004% 99.903% ( 34, 51 ] 5 0.001% 99.903% ( 51, 76 ] 45 0.006% 99.909% ( 76, 110 ] 171 0.021% 99.930% ( 110, 170 ] 346 0.042% 99.972% ( 170, 250 ] 286 0.035% 100.007% ( 250, 380 ] 135 0.017% 100.024% ( 380, 580 ] 128 0.016% 100.040% ( 580, 870 ] 44 0.005% 100.045% ( 870, 1300 ] 27 0.003% 100.048% ( 1300, 1900 ] 9 0.001% 100.050% ( 1900, 2900 ] 4 0.000% 100.050% ( 2900, 4400 ] 4 0.000% 100.051% ** Level 1 read latency histogram (micros): Count: 175564 Average: 2.6971 StdDev: 15.06 Min: 1 Median: 1.6922 Max: 3152 Percentiles: P50: 1.69 P75: 2.33 P99: 6.58 P99.9: 14.12 P99.99: 272.69 ------------------------------------------------------ [ 0, 1 ] 15897 9.055% 9.055% ## ( 1, 2 ] 103843 59.148% 68.203% ############ ( 2, 3 ] 36213 20.627% 88.830% #### ( 3, 4 ] 9584 5.459% 94.289% # ( 4, 6 ] 8034 4.576% 98.865% # ( 6, 10 ] 1631 0.929% 99.794% ( 10, 15 ] 226 0.129% 99.923% ( 15, 22 ] 26 0.015% 99.937% ( 22, 34 ] 5 0.003% 99.940% ( 51, 76 ] 1 0.001% 99.941% ( 76, 110 ] 2 0.001% 99.942% ( 110, 170 ] 65 0.037% 99.979% ( 170, 250 ] 17 0.010% 99.989% ( 250, 380 ] 14 0.008% 99.997% ( 380, 580 ] 15 0.009% 100.005% ( 580, 870 ] 5 0.003% 100.008% ( 870, 1300 ] 7 0.004% 100.012% ( 1300, 1900 ] 3 0.002% 100.014% ( 1900, 2900 ] 1 0.001% 100.014% ( 2900, 4400 ] 1 0.001% 100.015% ** Level 2 read latency histogram (micros): Count: 65614 Average: 3.2855 StdDev: 35.92 Min: 1 Median: 1.7657 Max: 7141 Percentiles: P50: 1.77 P75: 2.53 P99: 9.33 P99.9: 184.60 P99.99: 842.87 ------------------------------------------------------ [ 0, 1 ] 8501 12.956% 12.956% ### ( 1, 2 ] 31742 48.377% 61.333% ########## ( 2, 3 ] 17015 25.932% 87.265% ##### ( 3, 4 ] 3406 5.191% 92.456% # ( 4, 6 ] 3374 5.142% 97.598% # ( 6, 10 ] 1105 1.684% 99.282% ( 10, 15 ] 270 0.411% 99.694% ( 15, 22 ] 25 0.038% 99.732% ( 22, 34 ] 2 0.003% 99.735% ( 51, 76 ] 37 0.056% 99.791% ( 76, 110 ] 17 0.026% 99.817% ( 110, 170 ] 48 0.073% 99.890% ( 170, 250 ] 35 0.053% 99.944% ( 250, 380 ] 11 0.017% 99.960% ( 380, 580 ] 14 0.021% 99.982% ( 580, 870 ] 6 0.009% 99.991% ( 870, 1300 ] 4 0.006% 99.997% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 315934 Average: 4.7097 StdDev: 82.14 Min: 1 Median: 2.1220 Max: 12237 Percentiles: P50: 2.12 P75: 2.77 P99: 9.78 P99.9: 285.43 P99.99: 1194.67 ------------------------------------------------------ [ 0, 1 ] 4126 1.306% 1.306% ( 1, 2 ] 138857 43.951% 45.257% ######### ( 2, 3 ] 122800 38.869% 84.126% ######## ( 3, 4 ] 20163 6.382% 90.508% # ( 4, 6 ] 20436 6.468% 96.977% # ( 6, 10 ] 6764 2.141% 99.118% ( 10, 15 ] 1413 0.447% 99.565% ( 15, 22 ] 189 0.060% 99.625% ( 22, 34 ] 29 0.009% 99.634% ( 34, 51 ] 4 0.001% 99.635% ( 51, 76 ] 1 0.000% 99.635% ( 76, 110 ] 148 0.047% 99.682% ( 110, 170 ] 438 0.139% 99.821% ( 170, 250 ] 213 0.067% 99.888% ( 250, 380 ] 136 0.043% 99.931% ( 380, 580 ] 111 0.035% 99.966% ( 580, 870 ] 51 0.016% 99.983% ( 870, 1300 ] 31 0.010% 99.992% ( 1300, 1900 ] 15 0.005% 99.997% ( 1900, 2900 ] 12 0.004% 100.001% ( 2900, 4400 ] 8 0.003% 100.003% ( 4400, 6600 ] 5 0.002% 100.005% ( 6600, 9900 ] 16 0.005% 100.010% ( 9900, 14000 ] 4 0.001% 100.011% ** Level 4 read latency histogram (micros): Count: 45 Average: 1911.2889 StdDev: 3280.96 Min: 1 Median: 125.0000 Max: 11567 Percentiles: P50: 125.00 P75: 2587.50 P99: 11567.00 P99.9: 11567.00 P99.99: 11567.00 ------------------------------------------------------ [ 0, 1 ] 6 13.333% 13.333% ### ( 1, 2 ] 5 11.111% 24.444% ## ( 2, 3 ] 2 4.444% 28.889% # ( 3, 4 ] 4 8.889% 37.778% ## ( 4, 6 ] 1 2.222% 40.000% ( 22, 34 ] 1 2.222% 42.222% ( 34, 51 ] 2 4.444% 46.667% # ( 110, 170 ] 6 13.333% 60.000% ### ( 250, 380 ] 2 4.444% 64.444% # ( 870, 1300 ] 2 4.444% 68.889% # ( 1900, 2900 ] 4 8.889% 77.778% ## ( 2900, 4400 ] 3 6.667% 84.444% # ( 4400, 6600 ] 1 2.222% 86.667% ( 6600, 9900 ] 4 8.889% 95.556% ## ( 9900, 14000 ] 2 4.444% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 1224.7000 StdDev: 1278.24 Min: 94 Median: 667.0000 Max: 4806 Percentiles: P50: 667.00 P75: 1600.00 P99: 4806.00 P99.9: 4806.00 P99.99: 4806.00 ------------------------------------------------------ ( 76, 110 ] 2 3.333% 3.333% # ( 110, 170 ] 3 5.000% 8.333% # ( 170, 250 ] 6 10.000% 18.333% ## ( 250, 380 ] 8 13.333% 31.667% ### ( 380, 580 ] 8 13.333% 45.000% ### ( 580, 870 ] 10 16.667% 61.667% ### ( 870, 1300 ] 7 11.667% 73.333% ## ( 1300, 1900 ] 2 3.333% 76.667% # ( 1900, 2900 ] 4 6.667% 83.333% # ( 2900, 4400 ] 8 13.333% 96.667% ### ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 12.0 total, 4.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 246.45 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 246.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/10/14-17:32:56 ... thread 0: (1000000,4000000) ops and (257773.5,253955.0) ops/second in (3.879375,15.750821) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/13 2.39 GB 50.1 2.5 0.0 2.5 6.3 3.7 0.0 1.7 110.2 273.6 23.40 21.45 71 0.330 2619K 13K 0.0 0.0 L1 4/4 425.20 MB 0.0 1.5 1.3 0.2 1.5 1.3 0.1 1.1 223.3 220.1 6.83 6.47 3 2.276 1548K 21K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 2.6 239.1 238.7 0.67 0.64 1 0.672 163K 297 0.0 0.0 L3 17/0 937.31 MB 0.9 1.7 0.6 1.0 1.6 0.6 0.4 2.6 197.3 196.5 8.57 7.96 6 1.429 1718K 6351 0.0 0.0 L4 142/0 9.74 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.8 1.0 199.2 199.2 0.99 0.87 1 0.989 200K 0 0.0 0.0 L5 128/0 9.47 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 306/17 22.93 GB 0.0 6.0 2.2 3.8 9.7 5.9 2.8 2.6 152.0 245.8 40.47 37.38 82 0.494 6249K 41K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.0 2.2 3.8 9.7 5.9 2.8 2.6 152.0 245.8 40.47 37.38 82 0.494 6249K 41K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.0 2.2 3.8 6.0 2.1 0.0 0.0 215.4 213.9 28.57 27.08 21 1.360 6249K 41K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 322.5 11.90 10.30 61 0.195 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.9 total, 15.8 interval Flush(GB): cumulative 3.748, interval 3.748 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.72 GB write, 627.34 MB/s write, 6.01 GB read, 387.99 MB/s read, 40.5 seconds Interval compaction: 9.72 GB write, 631.50 MB/s write, 6.01 GB read, 390.56 MB/s read, 40.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1145415 Average: 2.8622 StdDev: 14.75 Min: 1 Median: 1.7728 Max: 3464 Percentiles: P50: 1.77 P75: 2.46 P99: 7.56 P99.9: 17.77 P99.99: 188.51 ------------------------------------------------------ [ 0, 1 ] 91819 8.016% 8.016% ## ( 1, 2 ] 622234 54.324% 62.340% ########### ( 2, 3 ] 315166 27.515% 89.856% ###### ( 3, 4 ] 51538 4.500% 94.355% # ( 4, 6 ] 48275 4.215% 98.570% # ( 6, 10 ] 12652 1.105% 99.674% ( 10, 15 ] 2461 0.215% 99.889% ( 15, 22 ] 320 0.028% 99.917% ( 22, 34 ] 37 0.003% 99.920% ( 34, 51 ] 6 0.001% 99.921% ( 51, 76 ] 48 0.004% 99.925% ( 76, 110 ] 180 0.016% 99.941% ( 110, 170 ] 482 0.042% 99.983% ( 170, 250 ] 365 0.032% 100.015% ( 250, 380 ] 145 0.013% 100.027% ( 380, 580 ] 149 0.013% 100.040% ( 580, 870 ] 51 0.004% 100.045% ( 870, 1300 ] 41 0.004% 100.048% ( 1300, 1900 ] 10 0.001% 100.049% ( 1900, 2900 ] 6 0.001% 100.050% ( 2900, 4400 ] 5 0.000% 100.050% ** Level 1 read latency histogram (micros): Count: 175565 Average: 2.6991 StdDev: 15.08 Min: 1 Median: 1.6923 Max: 3152 Percentiles: P50: 1.69 P75: 2.33 P99: 6.58 P99.9: 14.15 P99.99: 279.84 ------------------------------------------------------ [ 0, 1 ] 15897 9.055% 9.055% ## ( 1, 2 ] 103843 59.148% 68.203% ############ ( 2, 3 ] 36213 20.627% 88.829% #### ( 3, 4 ] 9584 5.459% 94.288% # ( 4, 6 ] 8034 4.576% 98.864% # ( 6, 10 ] 1631 0.929% 99.793% ( 10, 15 ] 226 0.129% 99.922% ( 15, 22 ] 26 0.015% 99.937% ( 22, 34 ] 5 0.003% 99.940% ( 51, 76 ] 1 0.001% 99.940% ( 76, 110 ] 2 0.001% 99.941% ( 110, 170 ] 65 0.037% 99.978% ( 170, 250 ] 17 0.010% 99.988% ( 250, 380 ] 15 0.009% 99.997% ( 380, 580 ] 15 0.009% 100.005% ( 580, 870 ] 5 0.003% 100.008% ( 870, 1300 ] 7 0.004% 100.012% ( 1300, 1900 ] 3 0.002% 100.014% ( 1900, 2900 ] 1 0.001% 100.014% ( 2900, 4400 ] 1 0.001% 100.015% ** Level 2 read latency histogram (micros): Count: 65614 Average: 3.2855 StdDev: 35.92 Min: 1 Median: 1.7657 Max: 7141 Percentiles: P50: 1.77 P75: 2.53 P99: 9.33 P99.9: 184.60 P99.99: 842.87 ------------------------------------------------------ [ 0, 1 ] 8501 12.956% 12.956% ### ( 1, 2 ] 31742 48.377% 61.333% ########## ( 2, 3 ] 17015 25.932% 87.265% ##### ( 3, 4 ] 3406 5.191% 92.456% # ( 4, 6 ] 3374 5.142% 97.598% # ( 6, 10 ] 1105 1.684% 99.282% ( 10, 15 ] 270 0.411% 99.694% ( 15, 22 ] 25 0.038% 99.732% ( 22, 34 ] 2 0.003% 99.735% ( 51, 76 ] 37 0.056% 99.791% ( 76, 110 ] 17 0.026% 99.817% ( 110, 170 ] 48 0.073% 99.890% ( 170, 250 ] 35 0.053% 99.944% ( 250, 380 ] 11 0.017% 99.960% ( 380, 580 ] 14 0.021% 99.982% ( 580, 870 ] 6 0.009% 99.991% ( 870, 1300 ] 4 0.006% 99.997% ( 2900, 4400 ] 1 0.002% 99.998% ( 6600, 9900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 315934 Average: 4.7097 StdDev: 82.14 Min: 1 Median: 2.1220 Max: 12237 Percentiles: P50: 2.12 P75: 2.77 P99: 9.78 P99.9: 285.43 P99.99: 1194.67 ------------------------------------------------------ [ 0, 1 ] 4126 1.306% 1.306% ( 1, 2 ] 138857 43.951% 45.257% ######### ( 2, 3 ] 122800 38.869% 84.126% ######## ( 3, 4 ] 20163 6.382% 90.508% # ( 4, 6 ] 20436 6.468% 96.977% # ( 6, 10 ] 6764 2.141% 99.118% ( 10, 15 ] 1413 0.447% 99.565% ( 15, 22 ] 189 0.060% 99.625% ( 22, 34 ] 29 0.009% 99.634% ( 34, 51 ] 4 0.001% 99.635% ( 51, 76 ] 1 0.000% 99.635% ( 76, 110 ] 148 0.047% 99.682% ( 110, 170 ] 438 0.139% 99.821% ( 170, 250 ] 213 0.067% 99.888% ( 250, 380 ] 136 0.043% 99.931% ( 380, 580 ] 111 0.035% 99.966% ( 580, 870 ] 51 0.016% 99.983% ( 870, 1300 ] 31 0.010% 99.992% ( 1300, 1900 ] 15 0.005% 99.997% ( 1900, 2900 ] 12 0.004% 100.001% ( 2900, 4400 ] 8 0.003% 100.003% ( 4400, 6600 ] 5 0.002% 100.005% ( 6600, 9900 ] 16 0.005% 100.010% ( 9900, 14000 ] 4 0.001% 100.011% ** Level 4 read latency histogram (micros): Count: 45 Average: 1911.2889 StdDev: 3280.96 Min: 1 Median: 125.0000 Max: 11567 Percentiles: P50: 125.00 P75: 2587.50 P99: 11567.00 P99.9: 11567.00 P99.99: 11567.00 ------------------------------------------------------ [ 0, 1 ] 6 13.333% 13.333% ### ( 1, 2 ] 5 11.111% 24.444% ## ( 2, 3 ] 2 4.444% 28.889% # ( 3, 4 ] 4 8.889% 37.778% ## ( 4, 6 ] 1 2.222% 40.000% ( 22, 34 ] 1 2.222% 42.222% ( 34, 51 ] 2 4.444% 46.667% # ( 110, 170 ] 6 13.333% 60.000% ### ( 250, 380 ] 2 4.444% 64.444% # ( 870, 1300 ] 2 4.444% 68.889% # ( 1900, 2900 ] 4 8.889% 77.778% ## ( 2900, 4400 ] 3 6.667% 84.444% # ( 4400, 6600 ] 1 2.222% 86.667% ( 6600, 9900 ] 4 8.889% 95.556% ## ( 9900, 14000 ] 2 4.444% 100.000% # ** Level 5 read latency histogram (micros): Count: 60 Average: 1224.7000 StdDev: 1278.24 Min: 94 Median: 667.0000 Max: 4806 Percentiles: P50: 667.00 P75: 1600.00 P99: 4806.00 P99.9: 4806.00 P99.99: 4806.00 ------------------------------------------------------ ( 76, 110 ] 2 3.333% 3.333% # ( 110, 170 ] 3 5.000% 8.333% # ( 170, 250 ] 6 10.000% 18.333% ## ( 250, 380 ] 8 13.333% 31.667% ### ( 380, 580 ] 8 13.333% 45.000% ### ( 580, 870 ] 10 16.667% 61.667% ### ( 870, 1300 ] 7 11.667% 73.333% ## ( 1300, 1900 ] 2 3.333% 76.667% # ( 1900, 2900 ] 4 6.667% 83.333% # ( 2900, 4400 ] 8 13.333% 96.667% ### ( 4400, 6600 ] 2 3.333% 100.000% # ** DB Stats ** Uptime(secs): 15.9 total, 3.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 248.22 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 253.69 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.068 micros/op 245830 ops/sec 20.002 seconds 4916999 operations; 238.2 MB/s Microseconds per write: Count: 4916999 Average: 4.0679 StdDev: 18.44 Min: 1 Median: 2.6449 Max: 26214 Percentiles: P50: 2.64 P75: 4.27 P99: 9.88 P99.9: 133.37 P99.99: 973.02 ------------------------------------------------------ [ 0, 1 ] 21023 0.428% 0.428% ( 1, 2 ] 1244529 25.311% 25.738% ##### ( 2, 3 ] 1849939 37.623% 63.362% ######## ( 3, 4 ] 441204 8.973% 72.335% ## ( 4, 6 ] 957896 19.481% 91.816% #### ( 6, 10 ] 364012 7.403% 99.219% # ( 10, 15 ] 25825 0.525% 99.744% ( 15, 22 ] 4783 0.097% 99.842% ( 22, 34 ] 1722 0.035% 99.877% ( 34, 51 ] 383 0.008% 99.884% ( 51, 76 ] 39 0.001% 99.885% ( 76, 110 ] 2 0.000% 99.885% ( 110, 170 ] 1861 0.038% 99.923% ( 170, 250 ] 2954 0.060% 99.983% ( 250, 380 ] 168 0.003% 99.987% ( 380, 580 ] 15 0.000% 99.987% ( 580, 870 ] 4 0.000% 99.987% ( 870, 1300 ] 619 0.013% 100.000% ( 1300, 1900 ] 1 0.000% 100.000% ( 1900, 2900 ] 19 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 97639 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 4916999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5074342968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 179 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 698425 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 8819310031 rocksdb.compact.write.bytes COUNT : 8724566292 rocksdb.flush.write.bytes COUNT : 4947548848 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 19 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 85 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 4914330624 rocksdb.memtable.garbage.bytes.at.flush COUNT : 8014848 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 8862366470 rocksdb.non.last.level.read.count COUNT : 2138450 rocksdb.block.checksum.compute.count COUNT : 2138111 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.903785 P95 : 6.089842 P99 : 9.629512 P100 : 2132.000000 COUNT : 4916999 SUM : 16818229 rocksdb.compaction.times.micros P50 : 1060909.090909 P95 : 5125000.000000 P99 : 5165882.000000 P100 : 5165882.000000 COUNT : 25 SUM : 32855507 rocksdb.compaction.times.cpu_micros P50 : 1060909.090909 P95 : 3950000.000000 P99 : 4776078.000000 P100 : 4776078.000000 COUNT : 25 SUM : 31274448 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 899.318182 P95 : 1796.875000 P99 : 2150.000000 P100 : 2178.000000 COUNT : 75 SUM : 75162 rocksdb.compaction.outfile.sync.micros P50 : 909.605263 P95 : 1610.000000 P99 : 1769.000000 P100 : 1769.000000 COUNT : 87 SUM : 81678 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 114.285714 P95 : 346.416667 P99 : 524.500000 P100 : 578.000000 COUNT : 111 SUM : 16221 rocksdb.table.open.io.micros P50 : 1360.000000 P95 : 23155.000000 P99 : 29609.000000 P100 : 29609.000000 COUNT : 179 SUM : 686394 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.322959 P95 : 8.243873 P99 : 12.634383 P100 : 12267.000000 COUNT : 2137600 SUM : 11383505 rocksdb.read.block.get.micros P50 : 553.584906 P95 : 7590.000000 P99 : 11553.666667 P100 : 12396.000000 COUNT : 358 SUM : 517052 rocksdb.write.raw.block.micros P50 : 0.518881 P95 : 0.985873 P99 : 3.233186 P100 : 3171.000000 COUNT : 3324172 SUM : 7083945 rocksdb.numfiles.in.singlecompaction P50 : 3.428571 P95 : 10.500000 P99 : 13.000000 P100 : 13.000000 COUNT : 36 SUM : 156 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.558866 P95 : 1099.855178 P99 : 1270.547087 P100 : 2121.000000 COUNT : 6133 SUM : 699095 rocksdb.sst.read.micros P50 : 1.827089 P95 : 4.550147 P99 : 8.303107 P100 : 12237.000000 COUNT : 2138527 SUM : 6914524 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 4916999 SUM : 5074342968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 211095.890411 P95 : 248082.191781 P99 : 331250.000000 P100 : 350848.000000 COUNT : 75 SUM : 14620196 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 108 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0