[2024-07-24 18:08:17.054408] Starting SPDK v24.09-pre git sha1 a2a5ee875 / DPDK 24.03.0 initialization... [2024-07-24 18:08:17.054567] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2886050 ] Set seed to 1721837297050866 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-24 18:08:17.200780] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-24 18:08:17.432903] app.c: 603:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-24 18:08:17.432954] app.c: 604:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2886050' to capture a snapshot of events at runtime. [2024-07-24 18:08:17.432966] app.c: 609:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-24 18:08:17.432996] app.c: 610:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-24 18:08:17.433007] app.c: 611:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2886050 for offline analysis/debug. [2024-07-24 18:08:17.433108] reactor.c: 941:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Jul 24 18:08:23 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/07/24-18:08:26 ... thread 0: (1000000,1000000) ops and (331411.7,331411.7) ops/second in (3.017395,3.017395) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 377.45 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 323.7 2.53 2.27 12 0.210 0 0 0.0 0.0 L1 4/0 250.45 MB 25.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 237.8 236.7 1.06 1.02 1 1.058 255K 1203 0.0 0.0 L2 3/2 222.59 MB 0.4 0.3 0.2 0.1 0.3 0.2 0.0 1.7 247.7 247.1 1.30 1.24 2 0.648 326K 791 0.0 0.0 L3 10/0 881.89 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 247/6 20.02 GB 0.0 0.6 0.4 0.1 1.4 1.2 0.2 1.7 117.4 284.5 4.88 4.53 15 0.325 581K 1994 0.0 0.0 Int 0/0 0.00 KB 0.0 0.6 0.4 0.1 1.4 1.2 0.2 1.7 117.4 284.5 4.88 4.53 15 0.325 581K 1994 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.6 0.4 0.1 0.6 0.4 0.0 0.0 243.3 242.4 2.35 2.25 3 0.785 581K 1994 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 323.7 2.53 2.27 12 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 3.0 interval Flush(GB): cumulative 0.798, interval 0.798 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.36 GB write, 447.34 MB/s write, 0.56 GB read, 184.54 MB/s read, 4.9 seconds Interval compaction: 1.36 GB write, 459.86 MB/s write, 0.56 GB read, 189.71 MB/s read, 4.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 143177 Average: 2.2228 StdDev: 16.48 Min: 0 Median: 1.4710 Max: 3278 Percentiles: P50: 1.47 P75: 1.86 P99: 5.84 P99.9: 13.24 P99.99: 24.73 ------------------------------------------------------ [ 0, 1 ] 28356 19.805% 19.805% #### ( 1, 2 ] 91796 64.114% 83.919% ############# ( 2, 3 ] 14796 10.334% 94.253% ## ( 3, 4 ] 4126 2.882% 97.134% # ( 4, 6 ] 2900 2.025% 99.160% ( 6, 10 ] 867 0.606% 99.765% ( 10, 15 ] 302 0.211% 99.976% ( 15, 22 ] 22 0.015% 99.992% ( 22, 34 ] 3 0.002% 99.994% ( 34, 51 ] 4 0.003% 99.997% ( 51, 76 ] 2 0.001% 99.998% ( 170, 250 ] 11 0.008% 100.006% ( 380, 580 ] 6 0.004% 100.010% ( 580, 870 ] 3 0.002% 100.012% ( 1900, 2900 ] 1 0.001% 100.013% ( 2900, 4400 ] 3 0.002% 100.015% ** Level 1 read latency histogram (micros): Count: 20 Average: 194.1500 StdDev: 384.71 Min: 1 Median: 1.8571 Max: 1619 Percentiles: P50: 1.86 P75: 293.33 P99: 1619.00 P99.9: 1619.00 P99.99: 1619.00 ------------------------------------------------------ [ 0, 1 ] 4 20.000% 20.000% #### ( 1, 2 ] 7 35.000% 55.000% ####### ( 2, 3 ] 1 5.000% 60.000% # ( 15, 22 ] 1 5.000% 65.000% # ( 110, 170 ] 1 5.000% 70.000% # ( 250, 380 ] 3 15.000% 85.000% ### ( 380, 580 ] 1 5.000% 90.000% # ( 580, 870 ] 1 5.000% 95.000% # ( 1300, 1900 ] 1 5.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 63100 Average: 2.4623 StdDev: 28.01 Min: 1 Median: 1.4864 Max: 6312 Percentiles: P50: 1.49 P75: 1.88 P99: 7.57 P99.9: 58.95 P99.99: 569.66 ------------------------------------------------------ [ 0, 1 ] 11854 18.786% 18.786% #### ( 1, 2 ] 40497 64.179% 82.965% ############# ( 2, 3 ] 6491 10.287% 93.252% ## ( 3, 4 ] 1925 3.051% 96.303% # ( 4, 6 ] 1491 2.363% 98.666% ( 6, 10 ] 539 0.854% 99.520% ( 10, 15 ] 206 0.326% 99.846% ( 15, 22 ] 15 0.024% 99.870% ( 22, 34 ] 3 0.005% 99.875% ( 34, 51 ] 1 0.002% 99.876% ( 51, 76 ] 50 0.079% 99.956% ( 76, 110 ] 6 0.010% 99.965% ( 110, 170 ] 3 0.005% 99.970% ( 170, 250 ] 5 0.008% 99.978% ( 250, 380 ] 3 0.005% 99.983% ( 380, 580 ] 6 0.010% 99.992% ( 580, 870 ] 3 0.005% 99.997% ( 870, 1300 ] 1 0.002% 99.998% ( 1900, 2900 ] 1 0.002% 100.000% ( 4400, 6600 ] 1 0.002% 100.002% ** Level 3 read latency histogram (micros): Count: 50 Average: 3014.2600 StdDev: 3220.48 Min: 75 Median: 1471.4286 Max: 11124 Percentiles: P50: 1471.43 P75: 5500.00 P99: 11124.00 P99.9: 11124.00 P99.99: 11124.00 ------------------------------------------------------ ( 51, 76 ] 1 2.000% 2.000% ( 110, 170 ] 2 4.000% 6.000% # ( 250, 380 ] 2 4.000% 10.000% # ( 380, 580 ] 4 8.000% 18.000% ## ( 580, 870 ] 5 10.000% 28.000% ## ( 870, 1300 ] 9 18.000% 46.000% #### ( 1300, 1900 ] 7 14.000% 60.000% ### ( 1900, 2900 ] 3 6.000% 66.000% # ( 2900, 4400 ] 2 4.000% 70.000% # ( 4400, 6600 ] 5 10.000% 80.000% ## ( 6600, 9900 ] 7 14.000% 94.000% ### ( 9900, 14000 ] 2 4.000% 98.000% # ** Level 4 read latency histogram (micros): Count: 25 Average: 3419.3200 StdDev: 2875.86 Min: 73 Median: 2400.0000 Max: 9566 Percentiles: P50: 2400.00 P75: 5610.00 P99: 9566.00 P99.9: 9566.00 P99.99: 9566.00 ------------------------------------------------------ ( 51, 76 ] 1 4.000% 4.000% # ( 76, 110 ] 1 4.000% 8.000% # ( 250, 380 ] 1 4.000% 12.000% # ( 380, 580 ] 1 4.000% 16.000% # ( 580, 870 ] 2 8.000% 24.000% ## ( 870, 1300 ] 3 12.000% 36.000% ## ( 1300, 1900 ] 2 8.000% 44.000% ## ( 1900, 2900 ] 3 12.000% 56.000% ## ( 2900, 4400 ] 2 8.000% 64.000% ## ( 4400, 6600 ] 5 20.000% 84.000% #### ( 6600, 9900 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.1 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 317.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.236 H:M:S, 7.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.236 H:M:S, 7.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-18:08:30 ... thread 0: (1000000,2000000) ops and (282984.6,305289.6) ops/second in (3.533761,6.551156) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 1.35 GB 18.9 0.8 0.0 0.8 2.6 1.8 0.0 1.4 90.8 292.8 9.01 8.30 28 0.322 830K 4271 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 237.8 236.7 1.06 1.02 1 1.058 255K 1203 0.0 0.0 L2 2/1 96.67 MB 0.4 0.4 0.2 0.2 0.4 0.2 0.2 1.9 246.3 245.4 1.53 1.46 3 0.509 382K 1382 0.0 0.0 L3 20/10 1.14 GB 0.3 0.4 0.4 0.1 0.4 0.4 0.0 1.2 210.1 209.7 2.16 2.01 3 0.719 460K 776 0.0 0.0 L4 122/0 9.56 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 187.9 187.9 0.46 0.41 1 0.461 88K 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 262/19 21.00 GB 0.0 1.9 0.9 1.0 3.7 2.7 0.4 2.1 139.7 267.5 14.21 13.20 36 0.395 2016K 7632 0.0 0.0 Int 0/0 0.00 KB 0.0 1.9 0.9 1.0 3.7 2.7 0.4 2.1 139.7 267.5 14.21 13.20 36 0.395 2016K 7632 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.9 0.9 1.0 1.9 0.9 0.0 0.0 232.8 231.9 8.53 8.14 11 0.775 2016K 7632 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 320.9 5.68 5.06 25 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.6 total, 6.6 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.71 GB write, 572.75 MB/s write, 1.94 GB read, 299.15 MB/s read, 14.2 seconds Interval compaction: 3.71 GB write, 580.13 MB/s write, 1.94 GB read, 303.01 MB/s read, 14.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 361817 Average: 2.5451 StdDev: 13.30 Min: 0 Median: 1.6308 Max: 3278 Percentiles: P50: 1.63 P75: 2.12 P99: 7.28 P99.9: 14.76 P99.99: 219.31 ------------------------------------------------------ [ 0, 1 ] 39507 10.919% 10.919% ## ( 1, 2 ] 224169 61.956% 72.876% ############ ( 2, 3 ] 65112 17.996% 90.871% #### ( 3, 4 ] 15638 4.322% 95.193% # ( 4, 6 ] 12687 3.506% 98.700% # ( 6, 10 ] 3386 0.936% 99.636% ( 10, 15 ] 1004 0.277% 99.913% ( 15, 22 ] 113 0.031% 99.944% ( 22, 34 ] 16 0.004% 99.949% ( 34, 51 ] 8 0.002% 99.951% ( 51, 76 ] 15 0.004% 99.955% ( 76, 110 ] 5 0.001% 99.957% ( 110, 170 ] 90 0.025% 99.981% ( 170, 250 ] 50 0.014% 99.995% ( 250, 380 ] 10 0.003% 99.998% ( 380, 580 ] 25 0.007% 100.005% ( 580, 870 ] 7 0.002% 100.007% ( 870, 1300 ] 8 0.002% 100.009% ( 1300, 1900 ] 2 0.001% 100.010% ( 1900, 2900 ] 1 0.000% 100.010% ( 2900, 4400 ] 3 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 52926 Average: 3.0490 StdDev: 11.55 Min: 1 Median: 1.9011 Max: 1619 Percentiles: P50: 1.90 P75: 2.68 P99: 9.13 P99.9: 95.33 P99.99: 493.83 ------------------------------------------------------ [ 0, 1 ] 916 1.731% 1.731% ( 1, 2 ] 28351 53.567% 55.298% ########### ( 2, 3 ] 15257 28.827% 84.125% ###### ( 3, 4 ] 3808 7.195% 91.320% # ( 4, 6 ] 3485 6.585% 97.905% # ( 6, 10 ] 740 1.398% 99.303% ( 10, 15 ] 265 0.501% 99.803% ( 15, 22 ] 35 0.066% 99.870% ( 22, 34 ] 2 0.004% 99.873% ( 34, 51 ] 1 0.002% 99.875% ( 76, 110 ] 23 0.043% 99.919% ( 110, 170 ] 21 0.040% 99.958% ( 170, 250 ] 5 0.009% 99.968% ( 250, 380 ] 10 0.019% 99.987% ( 380, 580 ] 3 0.006% 99.992% ( 580, 870 ] 2 0.004% 99.996% ( 870, 1300 ] 1 0.002% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 94018 Average: 2.5470 StdDev: 23.39 Min: 1 Median: 1.5680 Max: 6312 Percentiles: P50: 1.57 P75: 1.96 P99: 7.84 P99.9: 52.49 P99.99: 419.95 ------------------------------------------------------ [ 0, 1 ] 13045 13.875% 13.875% ### ( 1, 2 ] 59791 63.595% 77.470% ############# ( 2, 3 ] 13512 14.372% 91.842% ### ( 3, 4 ] 3489 3.711% 95.553% # ( 4, 6 ] 2836 3.016% 98.569% # ( 6, 10 ] 882 0.938% 99.508% ( 10, 15 ] 332 0.353% 99.861% ( 15, 22 ] 29 0.031% 99.892% ( 22, 34 ] 3 0.003% 99.895% ( 34, 51 ] 2 0.002% 99.897% ( 51, 76 ] 50 0.053% 99.950% ( 76, 110 ] 8 0.009% 99.959% ( 110, 170 ] 15 0.016% 99.974% ( 170, 250 ] 8 0.009% 99.983% ( 250, 380 ] 5 0.005% 99.988% ( 380, 580 ] 8 0.009% 99.997% ( 580, 870 ] 5 0.005% 100.002% ( 870, 1300 ] 1 0.001% 100.003% ( 1900, 2900 ] 1 0.001% 100.004% ( 4400, 6600 ] 1 0.001% 100.005% ** Level 3 read latency histogram (micros): Count: 213522 Average: 3.8262 StdDev: 68.72 Min: 1 Median: 1.7427 Max: 11124 Percentiles: P50: 1.74 P75: 2.43 P99: 9.59 P99.9: 155.00 P99.99: 330.23 ------------------------------------------------------ [ 0, 1 ] 12318 5.769% 5.769% # ( 1, 2 ] 127163 59.555% 65.324% ############ ( 2, 3 ] 47781 22.378% 87.702% #### ( 3, 4 ] 11570 5.419% 93.120% # ( 4, 6 ] 8868 4.153% 97.273% # ( 6, 10 ] 4106 1.923% 99.196% ( 10, 15 ] 1048 0.491% 99.687% ( 15, 22 ] 115 0.054% 99.741% ( 22, 34 ] 19 0.009% 99.750% ( 34, 51 ] 3 0.001% 99.751% ( 51, 76 ] 5 0.002% 99.754% ( 76, 110 ] 80 0.037% 99.791% ( 110, 170 ] 310 0.145% 99.936% ( 170, 250 ] 77 0.036% 99.972% ( 250, 380 ] 61 0.029% 100.001% ( 380, 580 ] 32 0.015% 100.016% ( 580, 870 ] 17 0.008% 100.024% ( 870, 1300 ] 15 0.007% 100.031% ( 1300, 1900 ] 9 0.004% 100.035% ( 1900, 2900 ] 3 0.001% 100.037% ( 2900, 4400 ] 2 0.001% 100.037% ( 4400, 6600 ] 5 0.002% 100.040% ( 6600, 9900 ] 7 0.003% 100.043% ( 9900, 14000 ] 2 0.001% 100.044% ** Level 4 read latency histogram (micros): Count: 55 Average: 1592.6000 StdDev: 2560.81 Min: 1 Median: 93.0000 Max: 9566 Percentiles: P50: 93.00 P75: 1983.33 P99: 9446.25 P99.9: 9566.00 P99.99: 9566.00 ------------------------------------------------------ [ 0, 1 ] 8 14.545% 14.545% ### ( 1, 2 ] 10 18.182% 32.727% #### ( 4, 6 ] 2 3.636% 36.364% # ( 15, 22 ] 1 1.818% 38.182% ( 22, 34 ] 5 9.091% 47.273% ## ( 51, 76 ] 1 1.818% 49.091% ( 76, 110 ] 1 1.818% 50.909% ( 250, 380 ] 3 5.455% 56.364% # ( 380, 580 ] 1 1.818% 58.182% ( 580, 870 ] 4 7.273% 65.455% # ( 870, 1300 ] 3 5.455% 70.909% # ( 1300, 1900 ] 2 3.636% 74.545% # ( 1900, 2900 ] 3 5.455% 80.000% # ( 2900, 4400 ] 2 3.636% 83.636% # ( 4400, 6600 ] 5 9.091% 92.727% ## ( 6600, 9900 ] 4 7.273% 100.000% # ** DB Stats ** Uptime(secs): 6.6 total, 3.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 296.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.838 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 278.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.601 H:M:S, 17.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-18:08:33 ... thread 0: (1000000,3000000) ops and (294257.6,301521.5) ops/second in (3.398383,9.949539) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/12 2.32 GB 87.5 1.7 0.0 1.7 4.4 2.8 0.0 1.6 107.5 286.1 15.79 14.61 45 0.351 1724K 9124 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 237.8 236.7 1.06 1.02 1 1.058 255K 1203 0.0 0.0 L2 1/0 42.09 MB 0.4 0.4 0.2 0.2 0.4 0.2 0.2 1.9 246.3 245.4 1.53 1.46 3 0.509 382K 1382 0.0 0.0 L3 14/0 689.94 MB 0.7 1.4 0.4 0.9 1.3 0.4 0.0 3.2 214.8 211.6 6.47 6.06 4 1.618 1411K 20K 0.0 0.0 L4 122/0 9.75 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 187.9 187.9 0.46 0.41 1 0.461 88K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 264/12 21.96 GB 0.0 3.7 0.9 2.8 6.4 3.7 1.2 2.3 150.2 260.8 25.31 23.56 54 0.469 3861K 32K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 0.9 2.8 6.4 3.7 1.2 2.3 150.2 260.8 25.31 23.56 54 0.469 3861K 32K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 0.9 2.8 3.7 0.9 0.0 0.0 231.2 229.2 16.45 15.68 15 1.096 3861K 32K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 319.3 8.86 7.88 39 0.227 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 10.0 total, 10.0 interval Flush(GB): cumulative 2.763, interval 2.763 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.45 GB write, 657.64 MB/s write, 3.71 GB read, 378.88 MB/s read, 25.3 seconds Interval compaction: 6.45 GB write, 663.22 MB/s write, 3.71 GB read, 382.10 MB/s read, 25.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 17, interval: 17 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 776475 Average: 2.7512 StdDev: 15.89 Min: 0 Median: 1.6800 Max: 3498 Percentiles: P50: 1.68 P75: 2.25 P99: 8.06 P99.9: 20.86 P99.99: 217.52 ------------------------------------------------------ [ 0, 1 ] 62669 8.071% 8.071% ## ( 1, 2 ] 478787 61.662% 69.733% ############ ( 2, 3 ] 161300 20.773% 90.506% #### ( 3, 4 ] 33379 4.299% 94.805% # ( 4, 6 ] 27619 3.557% 98.362% # ( 6, 10 ] 9627 1.240% 99.602% ( 10, 15 ] 2138 0.275% 99.877% ( 15, 22 ] 217 0.028% 99.905% ( 22, 34 ] 26 0.003% 99.908% ( 34, 51 ] 9 0.001% 99.909% ( 51, 76 ] 99 0.013% 99.922% ( 76, 110 ] 125 0.016% 99.938% ( 110, 170 ] 301 0.039% 99.977% ( 170, 250 ] 174 0.022% 99.999% ( 250, 380 ] 84 0.011% 100.010% ( 380, 580 ] 95 0.012% 100.022% ( 580, 870 ] 25 0.003% 100.026% ( 870, 1300 ] 21 0.003% 100.028% ( 1300, 1900 ] 6 0.001% 100.029% ( 1900, 2900 ] 3 0.000% 100.029% ( 2900, 4400 ] 8 0.001% 100.031% ** Level 1 read latency histogram (micros): Count: 52926 Average: 3.0490 StdDev: 11.55 Min: 1 Median: 1.9011 Max: 1619 Percentiles: P50: 1.90 P75: 2.68 P99: 9.13 P99.9: 95.33 P99.99: 493.83 ------------------------------------------------------ [ 0, 1 ] 916 1.731% 1.731% ( 1, 2 ] 28351 53.567% 55.298% ########### ( 2, 3 ] 15257 28.827% 84.125% ###### ( 3, 4 ] 3808 7.195% 91.320% # ( 4, 6 ] 3485 6.585% 97.905% # ( 6, 10 ] 740 1.398% 99.303% ( 10, 15 ] 265 0.501% 99.803% ( 15, 22 ] 35 0.066% 99.870% ( 22, 34 ] 2 0.004% 99.873% ( 34, 51 ] 1 0.002% 99.875% ( 76, 110 ] 23 0.043% 99.919% ( 110, 170 ] 21 0.040% 99.958% ( 170, 250 ] 5 0.009% 99.968% ( 250, 380 ] 10 0.019% 99.987% ( 380, 580 ] 3 0.006% 99.992% ( 580, 870 ] 2 0.004% 99.996% ( 870, 1300 ] 1 0.002% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 104050 Average: 2.6672 StdDev: 23.39 Min: 1 Median: 1.5895 Max: 6312 Percentiles: P50: 1.59 P75: 1.99 P99: 8.27 P99.9: 68.48 P99.99: 506.58 ------------------------------------------------------ [ 0, 1 ] 13352 12.832% 12.832% ### ( 1, 2 ] 65599 63.046% 75.878% ############# ( 2, 3 ] 16263 15.630% 91.508% ### ( 3, 4 ] 3918 3.765% 95.273% # ( 4, 6 ] 3249 3.123% 98.396% # ( 6, 10 ] 1107 1.064% 99.460% ( 10, 15 ] 383 0.368% 99.828% ( 15, 22 ] 35 0.034% 99.862% ( 22, 34 ] 3 0.003% 99.864% ( 34, 51 ] 2 0.002% 99.866% ( 51, 76 ] 50 0.048% 99.914% ( 76, 110 ] 10 0.010% 99.924% ( 110, 170 ] 32 0.031% 99.955% ( 170, 250 ] 18 0.017% 99.972% ( 250, 380 ] 11 0.011% 99.983% ( 380, 580 ] 12 0.012% 99.994% ( 580, 870 ] 6 0.006% 100.000% ( 870, 1300 ] 2 0.002% 100.002% ( 1300, 1900 ] 1 0.001% 100.003% ( 1900, 2900 ] 1 0.001% 100.004% ( 4400, 6600 ] 1 0.001% 100.005% ** Level 3 read latency histogram (micros): Count: 265630 Average: 3.7509 StdDev: 62.59 Min: 1 Median: 1.7539 Max: 11124 Percentiles: P50: 1.75 P75: 2.45 P99: 9.58 P99.9: 158.44 P99.99: 381.86 ------------------------------------------------------ [ 0, 1 ] 14074 5.298% 5.298% # ( 1, 2 ] 157499 59.293% 64.591% ############ ( 2, 3 ] 61437 23.129% 87.720% ##### ( 3, 4 ] 14153 5.328% 93.048% # ( 4, 6 ] 11078 4.170% 97.218% # ( 6, 10 ] 5286 1.990% 99.208% ( 10, 15 ] 1269 0.478% 99.686% ( 15, 22 ] 129 0.049% 99.735% ( 22, 34 ] 20 0.008% 99.742% ( 34, 51 ] 3 0.001% 99.743% ( 51, 76 ] 6 0.002% 99.746% ( 76, 110 ] 106 0.040% 99.785% ( 110, 170 ] 377 0.142% 99.927% ( 170, 250 ] 99 0.037% 99.965% ( 250, 380 ] 67 0.025% 99.990% ( 380, 580 ] 47 0.018% 100.008% ( 580, 870 ] 25 0.009% 100.017% ( 870, 1300 ] 17 0.006% 100.023% ( 1300, 1900 ] 11 0.004% 100.027% ( 1900, 2900 ] 4 0.002% 100.029% ( 2900, 4400 ] 3 0.001% 100.030% ( 4400, 6600 ] 5 0.002% 100.032% ( 6600, 9900 ] 7 0.003% 100.035% ( 9900, 14000 ] 2 0.001% 100.035% ** Level 4 read latency histogram (micros): Count: 55 Average: 1592.6000 StdDev: 2560.81 Min: 1 Median: 93.0000 Max: 9566 Percentiles: P50: 93.00 P75: 1983.33 P99: 9446.25 P99.9: 9566.00 P99.99: 9566.00 ------------------------------------------------------ [ 0, 1 ] 8 14.545% 14.545% ### ( 1, 2 ] 10 18.182% 32.727% #### ( 4, 6 ] 2 3.636% 36.364% # ( 15, 22 ] 1 1.818% 38.182% ( 22, 34 ] 5 9.091% 47.273% ## ( 51, 76 ] 1 1.818% 49.091% ( 76, 110 ] 1 1.818% 50.909% ( 250, 380 ] 3 5.455% 56.364% # ( 380, 580 ] 1 1.818% 58.182% ( 580, 870 ] 4 7.273% 65.455% # ( 870, 1300 ] 3 5.455% 70.909% # ( 1300, 1900 ] 2 3.636% 74.545% # ( 1900, 2900 ] 3 5.455% 80.000% # ( 2900, 4400 ] 2 3.636% 83.636% # ( 4400, 6600 ] 5 9.091% 92.727% ## ( 6600, 9900 ] 4 7.273% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 1430.5000 StdDev: 1586.57 Min: 131 Median: 725.0000 Max: 5733 Percentiles: P50: 725.00 P75: 2233.33 P99: 5733.00 P99.9: 5733.00 P99.99: 5733.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 3 15.000% 20.000% ### ( 250, 380 ] 3 15.000% 35.000% ### ( 380, 580 ] 1 5.000% 40.000% # ( 580, 870 ] 4 20.000% 60.000% #### ( 870, 1300 ] 2 10.000% 70.000% ## ( 1900, 2900 ] 3 15.000% 85.000% ### ( 2900, 4400 ] 1 5.000% 90.000% # ( 4400, 6600 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 10.0 total, 3.4 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 294.20 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.334 H:M:S, 13.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 289.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.497 H:M:S, 14.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/24-18:08:36 ... thread 0: (1000000,4000000) ops and (307831.0,303074.5) ops/second in (3.248536,13.198075) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.14 GB 194.0 2.5 0.0 2.5 6.2 3.7 0.0 1.7 113.9 287.0 22.09 20.49 63 0.351 2554K 13K 0.0 0.0 L1 11/0 1.13 GB 116.1 1.4 1.4 0.0 1.4 1.4 0.2 1.0 215.0 210.5 6.71 6.35 2 3.354 1464K 30K 0.0 0.0 L2 1/0 42.09 MB 0.4 0.4 0.2 0.2 0.4 0.2 0.2 1.9 246.3 245.4 1.53 1.46 3 0.509 382K 1382 0.0 0.0 L3 14/0 689.94 MB 0.7 1.4 0.4 0.9 1.3 0.4 0.0 3.2 214.8 211.6 6.47 6.06 4 1.618 1411K 20K 0.0 0.0 L4 122/0 9.75 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 187.9 187.9 0.46 0.41 1 0.461 88K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 273/4 22.91 GB 0.0 5.7 2.1 3.6 9.4 5.8 1.2 2.5 156.0 257.2 37.25 34.77 73 0.510 5901K 66K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 2.1 3.6 9.4 5.8 1.2 2.5 156.0 257.2 37.25 34.77 73 0.510 5901K 66K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 2.1 3.6 5.6 2.0 0.0 0.0 228.8 226.2 25.39 24.23 19 1.336 5901K 66K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 323.4 11.86 10.55 54 0.220 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.3 total, 13.2 interval Flush(GB): cumulative 3.746, interval 3.746 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.36 GB write, 721.22 MB/s write, 5.67 GB read, 437.40 MB/s read, 37.3 seconds Interval compaction: 9.36 GB write, 725.84 MB/s write, 5.67 GB read, 440.20 MB/s read, 37.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 19, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1107503 Average: 2.6874 StdDev: 15.32 Min: 0 Median: 1.6499 Max: 3498 Percentiles: P50: 1.65 P75: 2.16 P99: 7.84 P99.9: 18.90 P99.99: 196.64 ------------------------------------------------------ [ 0, 1 ] 102300 9.237% 9.237% ## ( 1, 2 ] 694642 62.721% 71.958% ############# ( 2, 3 ] 214558 19.373% 91.332% #### ( 3, 4 ] 43534 3.931% 95.262% # ( 4, 6 ] 35538 3.209% 98.471% # ( 6, 10 ] 12713 1.148% 99.619% ( 10, 15 ] 2954 0.267% 99.886% ( 15, 22 ] 283 0.026% 99.911% ( 22, 34 ] 37 0.003% 99.915% ( 34, 51 ] 16 0.001% 99.916% ( 51, 76 ] 139 0.013% 99.929% ( 76, 110 ] 215 0.019% 99.948% ( 110, 170 ] 388 0.035% 99.983% ( 170, 250 ] 229 0.021% 100.004% ( 250, 380 ] 114 0.010% 100.014% ( 380, 580 ] 135 0.012% 100.026% ( 580, 870 ] 34 0.003% 100.029% ( 870, 1300 ] 31 0.003% 100.032% ( 1300, 1900 ] 10 0.001% 100.033% ( 1900, 2900 ] 3 0.000% 100.033% ( 2900, 4400 ] 10 0.001% 100.034% ** Level 1 read latency histogram (micros): Count: 52981 Average: 3.4651 StdDev: 27.73 Min: 1 Median: 1.9013 Max: 3312 Percentiles: P50: 1.90 P75: 2.68 P99: 9.28 P99.9: 152.91 P99.99: 1405.28 ------------------------------------------------------ [ 0, 1 ] 922 1.740% 1.740% ( 1, 2 ] 28369 53.546% 55.286% ########### ( 2, 3 ] 15260 28.803% 84.089% ###### ( 3, 4 ] 3808 7.187% 91.276% # ( 4, 6 ] 3485 6.578% 97.854% # ( 6, 10 ] 740 1.397% 99.251% ( 10, 15 ] 265 0.500% 99.751% ( 15, 22 ] 35 0.066% 99.817% ( 22, 34 ] 2 0.004% 99.821% ( 34, 51 ] 1 0.002% 99.823% ( 76, 110 ] 26 0.049% 99.872% ( 110, 170 ] 21 0.040% 99.911% ( 170, 250 ] 6 0.011% 99.923% ( 250, 380 ] 16 0.030% 99.953% ( 380, 580 ] 9 0.017% 99.970% ( 580, 870 ] 6 0.011% 99.981% ( 870, 1300 ] 4 0.008% 99.989% ( 1300, 1900 ] 4 0.008% 99.996% ( 1900, 2900 ] 1 0.002% 99.998% ( 2900, 4400 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 104050 Average: 2.6672 StdDev: 23.39 Min: 1 Median: 1.5895 Max: 6312 Percentiles: P50: 1.59 P75: 1.99 P99: 8.27 P99.9: 68.48 P99.99: 506.58 ------------------------------------------------------ [ 0, 1 ] 13352 12.832% 12.832% ### ( 1, 2 ] 65599 63.046% 75.878% ############# ( 2, 3 ] 16263 15.630% 91.508% ### ( 3, 4 ] 3918 3.765% 95.273% # ( 4, 6 ] 3249 3.123% 98.396% # ( 6, 10 ] 1107 1.064% 99.460% ( 10, 15 ] 383 0.368% 99.828% ( 15, 22 ] 35 0.034% 99.862% ( 22, 34 ] 3 0.003% 99.864% ( 34, 51 ] 2 0.002% 99.866% ( 51, 76 ] 50 0.048% 99.914% ( 76, 110 ] 10 0.010% 99.924% ( 110, 170 ] 32 0.031% 99.955% ( 170, 250 ] 18 0.017% 99.972% ( 250, 380 ] 11 0.011% 99.983% ( 380, 580 ] 12 0.012% 99.994% ( 580, 870 ] 6 0.006% 100.000% ( 870, 1300 ] 2 0.002% 100.002% ( 1300, 1900 ] 1 0.001% 100.003% ( 1900, 2900 ] 1 0.001% 100.004% ( 4400, 6600 ] 1 0.001% 100.005% ** Level 3 read latency histogram (micros): Count: 265630 Average: 3.7509 StdDev: 62.59 Min: 1 Median: 1.7539 Max: 11124 Percentiles: P50: 1.75 P75: 2.45 P99: 9.58 P99.9: 158.44 P99.99: 381.86 ------------------------------------------------------ [ 0, 1 ] 14074 5.298% 5.298% # ( 1, 2 ] 157499 59.293% 64.591% ############ ( 2, 3 ] 61437 23.129% 87.720% ##### ( 3, 4 ] 14153 5.328% 93.048% # ( 4, 6 ] 11078 4.170% 97.218% # ( 6, 10 ] 5286 1.990% 99.208% ( 10, 15 ] 1269 0.478% 99.686% ( 15, 22 ] 129 0.049% 99.735% ( 22, 34 ] 20 0.008% 99.742% ( 34, 51 ] 3 0.001% 99.743% ( 51, 76 ] 6 0.002% 99.746% ( 76, 110 ] 106 0.040% 99.785% ( 110, 170 ] 377 0.142% 99.927% ( 170, 250 ] 99 0.037% 99.965% ( 250, 380 ] 67 0.025% 99.990% ( 380, 580 ] 47 0.018% 100.008% ( 580, 870 ] 25 0.009% 100.017% ( 870, 1300 ] 17 0.006% 100.023% ( 1300, 1900 ] 11 0.004% 100.027% ( 1900, 2900 ] 4 0.002% 100.029% ( 2900, 4400 ] 3 0.001% 100.030% ( 4400, 6600 ] 5 0.002% 100.032% ( 6600, 9900 ] 7 0.003% 100.035% ( 9900, 14000 ] 2 0.001% 100.035% ** Level 4 read latency histogram (micros): Count: 55 Average: 1592.6000 StdDev: 2560.81 Min: 1 Median: 93.0000 Max: 9566 Percentiles: P50: 93.00 P75: 1983.33 P99: 9446.25 P99.9: 9566.00 P99.99: 9566.00 ------------------------------------------------------ [ 0, 1 ] 8 14.545% 14.545% ### ( 1, 2 ] 10 18.182% 32.727% #### ( 4, 6 ] 2 3.636% 36.364% # ( 15, 22 ] 1 1.818% 38.182% ( 22, 34 ] 5 9.091% 47.273% ## ( 51, 76 ] 1 1.818% 49.091% ( 76, 110 ] 1 1.818% 50.909% ( 250, 380 ] 3 5.455% 56.364% # ( 380, 580 ] 1 1.818% 58.182% ( 580, 870 ] 4 7.273% 65.455% # ( 870, 1300 ] 3 5.455% 70.909% # ( 1300, 1900 ] 2 3.636% 74.545% # ( 1900, 2900 ] 3 5.455% 80.000% # ( 2900, 4400 ] 2 3.636% 83.636% # ( 4400, 6600 ] 5 9.091% 92.727% ## ( 6600, 9900 ] 4 7.273% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 1430.5000 StdDev: 1586.57 Min: 131 Median: 725.0000 Max: 5733 Percentiles: P50: 725.00 P75: 2233.33 P99: 5733.00 P99.9: 5733.00 P99.99: 5733.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 3 15.000% 20.000% ### ( 250, 380 ] 3 15.000% 35.000% ### ( 380, 580 ] 1 5.000% 40.000% # ( 580, 870 ] 4 20.000% 60.000% #### ( 870, 1300 ] 2 10.000% 70.000% ## ( 1900, 2900 ] 3 15.000% 85.000% ### ( 2900, 4400 ] 1 5.000% 90.000% # ( 4400, 6600 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 13.3 total, 3.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 296.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.753 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 302.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.418 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/24-18:08:40 ... thread 0: (1000000,5000000) ops and (302558.3,302971.1) ops/second in (3.305148,16.503223) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.12 GB 68.9 3.3 0.0 3.3 8.0 4.7 0.0 1.7 117.6 287.8 28.34 26.34 80 0.354 3384K 17K 0.0 0.0 L1 11/11 1.13 GB 0.0 1.4 1.4 0.0 1.4 1.4 0.2 1.0 215.0 210.5 6.71 6.35 2 3.354 1464K 30K 0.0 0.0 L2 1/0 42.09 MB 0.4 0.4 0.2 0.2 0.4 0.2 0.2 1.9 246.3 245.4 1.53 1.46 3 0.509 382K 1382 0.0 0.0 L3 14/0 689.94 MB 0.7 1.4 0.4 0.9 1.3 0.4 0.0 3.2 214.8 211.6 6.47 6.06 4 1.618 1411K 20K 0.0 0.0 L4 122/0 9.75 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.5 1.0 187.9 187.9 0.46 0.41 1 0.461 88K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 278/25 23.89 GB 0.0 6.5 2.1 4.4 11.1 6.8 1.2 2.4 152.3 262.0 43.51 40.63 90 0.483 6731K 70K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.5 2.1 4.4 11.1 6.8 1.2 2.4 152.3 262.0 43.51 40.63 90 0.483 6731K 70K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.5 2.1 4.4 6.4 2.0 0.0 0.0 231.5 229.1 28.63 27.38 22 1.301 6731K 70K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 325.4 14.88 13.25 68 0.219 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 16.6 total, 16.5 interval Flush(GB): cumulative 4.729, interval 4.729 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.13 GB write, 687.21 MB/s write, 6.47 GB read, 399.55 MB/s read, 43.5 seconds Interval compaction: 11.13 GB write, 690.73 MB/s write, 6.47 GB read, 401.59 MB/s read, 43.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 23, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1397475 Average: 2.7035 StdDev: 15.17 Min: 0 Median: 1.6438 Max: 3498 Percentiles: P50: 1.64 P75: 2.13 P99: 7.81 P99.9: 66.18 P99.99: 211.00 ------------------------------------------------------ [ 0, 1 ] 129341 9.255% 9.255% ## ( 1, 2 ] 884474 63.291% 72.546% ############# ( 2, 3 ] 267334 19.130% 91.676% #### ( 3, 4 ] 53074 3.798% 95.474% # ( 4, 6 ] 42275 3.025% 98.499% # ( 6, 10 ] 15505 1.110% 99.608% ( 10, 15 ] 3586 0.257% 99.865% ( 15, 22 ] 334 0.024% 99.889% ( 22, 34 ] 42 0.003% 99.892% ( 34, 51 ] 19 0.001% 99.893% ( 51, 76 ] 154 0.011% 99.904% ( 76, 110 ] 344 0.025% 99.929% ( 110, 170 ] 699 0.050% 99.979% ( 170, 250 ] 301 0.022% 100.001% ( 250, 380 ] 154 0.011% 100.012% ( 380, 580 ] 184 0.013% 100.025% ( 580, 870 ] 47 0.003% 100.028% ( 870, 1300 ] 36 0.003% 100.031% ( 1300, 1900 ] 13 0.001% 100.032% ( 1900, 2900 ] 6 0.000% 100.032% ( 2900, 4400 ] 10 0.001% 100.033% ** Level 1 read latency histogram (micros): Count: 112487 Average: 3.1279 StdDev: 20.64 Min: 1 Median: 1.7471 Max: 3312 Percentiles: P50: 1.75 P75: 2.43 P99: 9.13 P99.9: 140.47 P99.99: 833.79 ------------------------------------------------------ [ 0, 1 ] 6382 5.674% 5.674% # ( 1, 2 ] 66743 59.334% 65.008% ############ ( 2, 3 ] 26212 23.302% 88.310% ##### ( 3, 4 ] 5628 5.003% 93.313% # ( 4, 6 ] 4943 4.394% 97.707% # ( 6, 10 ] 1860 1.654% 99.361% ( 10, 15 ] 394 0.350% 99.711% ( 15, 22 ] 52 0.046% 99.757% ( 22, 34 ] 3 0.003% 99.760% ( 34, 51 ] 2 0.002% 99.762% ( 76, 110 ] 122 0.108% 99.870% ( 110, 170 ] 66 0.059% 99.929% ( 170, 250 ] 21 0.019% 99.948% ( 250, 380 ] 23 0.020% 99.968% ( 380, 580 ] 16 0.014% 99.982% ( 580, 870 ] 10 0.009% 99.991% ( 870, 1300 ] 4 0.004% 99.995% ( 1300, 1900 ] 4 0.004% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 104050 Average: 2.6672 StdDev: 23.39 Min: 1 Median: 1.5895 Max: 6312 Percentiles: P50: 1.59 P75: 1.99 P99: 8.27 P99.9: 68.48 P99.99: 506.58 ------------------------------------------------------ [ 0, 1 ] 13352 12.832% 12.832% ### ( 1, 2 ] 65599 63.046% 75.878% ############# ( 2, 3 ] 16263 15.630% 91.508% ### ( 3, 4 ] 3918 3.765% 95.273% # ( 4, 6 ] 3249 3.123% 98.396% # ( 6, 10 ] 1107 1.064% 99.460% ( 10, 15 ] 383 0.368% 99.828% ( 15, 22 ] 35 0.034% 99.862% ( 22, 34 ] 3 0.003% 99.864% ( 34, 51 ] 2 0.002% 99.866% ( 51, 76 ] 50 0.048% 99.914% ( 76, 110 ] 10 0.010% 99.924% ( 110, 170 ] 32 0.031% 99.955% ( 170, 250 ] 18 0.017% 99.972% ( 250, 380 ] 11 0.011% 99.983% ( 380, 580 ] 12 0.012% 99.994% ( 580, 870 ] 6 0.006% 100.000% ( 870, 1300 ] 2 0.002% 100.002% ( 1300, 1900 ] 1 0.001% 100.003% ( 1900, 2900 ] 1 0.001% 100.004% ( 4400, 6600 ] 1 0.001% 100.005% ** Level 3 read latency histogram (micros): Count: 265630 Average: 3.7509 StdDev: 62.59 Min: 1 Median: 1.7539 Max: 11124 Percentiles: P50: 1.75 P75: 2.45 P99: 9.58 P99.9: 158.44 P99.99: 381.86 ------------------------------------------------------ [ 0, 1 ] 14074 5.298% 5.298% # ( 1, 2 ] 157499 59.293% 64.591% ############ ( 2, 3 ] 61437 23.129% 87.720% ##### ( 3, 4 ] 14153 5.328% 93.048% # ( 4, 6 ] 11078 4.170% 97.218% # ( 6, 10 ] 5286 1.990% 99.208% ( 10, 15 ] 1269 0.478% 99.686% ( 15, 22 ] 129 0.049% 99.735% ( 22, 34 ] 20 0.008% 99.742% ( 34, 51 ] 3 0.001% 99.743% ( 51, 76 ] 6 0.002% 99.746% ( 76, 110 ] 106 0.040% 99.785% ( 110, 170 ] 377 0.142% 99.927% ( 170, 250 ] 99 0.037% 99.965% ( 250, 380 ] 67 0.025% 99.990% ( 380, 580 ] 47 0.018% 100.008% ( 580, 870 ] 25 0.009% 100.017% ( 870, 1300 ] 17 0.006% 100.023% ( 1300, 1900 ] 11 0.004% 100.027% ( 1900, 2900 ] 4 0.002% 100.029% ( 2900, 4400 ] 3 0.001% 100.030% ( 4400, 6600 ] 5 0.002% 100.032% ( 6600, 9900 ] 7 0.003% 100.035% ( 9900, 14000 ] 2 0.001% 100.035% ** Level 4 read latency histogram (micros): Count: 55 Average: 1592.6000 StdDev: 2560.81 Min: 1 Median: 93.0000 Max: 9566 Percentiles: P50: 93.00 P75: 1983.33 P99: 9446.25 P99.9: 9566.00 P99.99: 9566.00 ------------------------------------------------------ [ 0, 1 ] 8 14.545% 14.545% ### ( 1, 2 ] 10 18.182% 32.727% #### ( 4, 6 ] 2 3.636% 36.364% # ( 15, 22 ] 1 1.818% 38.182% ( 22, 34 ] 5 9.091% 47.273% ## ( 51, 76 ] 1 1.818% 49.091% ( 76, 110 ] 1 1.818% 50.909% ( 250, 380 ] 3 5.455% 56.364% # ( 380, 580 ] 1 1.818% 58.182% ( 580, 870 ] 4 7.273% 65.455% # ( 870, 1300 ] 3 5.455% 70.909% # ( 1300, 1900 ] 2 3.636% 74.545% # ( 1900, 2900 ] 3 5.455% 80.000% # ( 2900, 4400 ] 2 3.636% 83.636% # ( 4400, 6600 ] 5 9.091% 92.727% ## ( 6600, 9900 ] 4 7.273% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 1430.5000 StdDev: 1586.57 Min: 131 Median: 725.0000 Max: 5733 Percentiles: P50: 725.00 P75: 2233.33 P99: 5733.00 P99.9: 5733.00 P99.99: 5733.00 ------------------------------------------------------ ( 110, 170 ] 1 5.000% 5.000% # ( 170, 250 ] 3 15.000% 20.000% ### ( 250, 380 ] 3 15.000% 35.000% ### ( 380, 580 ] 1 5.000% 40.000% # ( 580, 870 ] 4 20.000% 60.000% #### ( 870, 1300 ] 2 10.000% 70.000% ## ( 1900, 2900 ] 3 15.000% 85.000% ### ( 2900, 4400 ] 1 5.000% 90.000% # ( 4400, 6600 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 16.6 total, 3.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 296.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.194 H:M:S, 13.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 297.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.441 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.521 micros/op 283987 ops/sec 20.149 seconds 5721999 operations; 275.2 MB/s Microseconds per write: Count: 5721999 Average: 3.5212 StdDev: 265.77 Min: 0 Median: 1.7771 Max: 250626 Percentiles: P50: 1.78 P75: 3.04 P99: 8.37 P99.9: 127.68 P99.99: 1171.42 ------------------------------------------------------ [ 0, 1 ] 767000 13.404% 13.404% ### ( 1, 2 ] 2694529 47.091% 60.495% ######### ( 2, 3 ] 799373 13.970% 74.465% ### ( 3, 4 ] 801898 14.014% 88.480% ### ( 4, 6 ] 561746 9.817% 98.297% ## ( 6, 10 ] 67909 1.187% 99.484% ( 10, 15 ] 15920 0.278% 99.762% ( 15, 22 ] 4574 0.080% 99.842% ( 22, 34 ] 1534 0.027% 99.869% ( 34, 51 ] 180 0.003% 99.872% ( 51, 76 ] 26 0.000% 99.872% ( 76, 110 ] 3 0.000% 99.872% ( 110, 170 ] 5380 0.094% 99.966% ( 170, 250 ] 320 0.006% 99.972% ( 250, 380 ] 86 0.002% 99.973% ( 380, 580 ] 9 0.000% 99.974% ( 580, 870 ] 11 0.000% 99.974% ( 870, 1300 ] 1325 0.023% 99.997% ( 1300, 1900 ] 3 0.000% 99.997% ( 1900, 2900 ] 158 0.003% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 170000, 250000 ] 8 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 176584 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5721999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5905102968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 167 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 3716088 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9546042410 rocksdb.compact.write.bytes COUNT : 9369587193 rocksdb.flush.write.bytes COUNT : 5869178861 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 13 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 82 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5831729152 rocksdb.memtable.garbage.bytes.at.flush COUNT : 11348992 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 9591893780 rocksdb.non.last.level.read.count COUNT : 2315037 rocksdb.block.checksum.compute.count COUNT : 2314717 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.425602 P95 : 4.684615 P99 : 6.810553 P100 : 250623.000000 COUNT : 5721999 SUM : 17521300 rocksdb.compaction.times.micros P50 : 1060909.090909 P95 : 5125000.000000 P99 : 5649415.000000 P100 : 5649415.000000 COUNT : 25 SUM : 31896545 rocksdb.compaction.times.cpu_micros P50 : 1047000.000000 P95 : 3950000.000000 P99 : 5335940.000000 P100 : 5335940.000000 COUNT : 25 SUM : 30590691 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 828.571429 P95 : 1675.000000 P99 : 1914.000000 P100 : 1914.000000 COUNT : 80 SUM : 68977 rocksdb.compaction.outfile.sync.micros P50 : 774.512195 P95 : 1655.714286 P99 : 2130.000000 P100 : 2469.000000 COUNT : 77 SUM : 65669 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 95.550000 P95 : 239.666667 P99 : 330.000000 P100 : 330.000000 COUNT : 111 SUM : 12357 rocksdb.table.open.io.micros P50 : 1416.666667 P95 : 16920.000000 P99 : 22600.000000 P100 : 22600.000000 COUNT : 167 SUM : 529317 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.792843 P95 : 7.425227 P99 : 11.977892 P100 : 3753.000000 COUNT : 2314683 SUM : 11370607 rocksdb.read.block.get.micros P50 : 523.396226 P95 : 5371.666667 P99 : 9347.250000 P100 : 11346.000000 COUNT : 334 SUM : 408724 rocksdb.write.raw.block.micros P50 : 0.513217 P95 : 0.975113 P99 : 3.233872 P100 : 3441.000000 COUNT : 3692235 SUM : 7326595 rocksdb.numfiles.in.singlecompaction P50 : 3.368421 P95 : 12.000000 P99 : 19.760000 P100 : 21.000000 COUNT : 32 SUM : 139 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.562556 P95 : 1133.812123 P99 : 2121.202532 P100 : 250412.000000 COUNT : 13705 SUM : 3717727 rocksdb.sst.read.micros P50 : 1.657471 P95 : 3.966665 P99 : 8.241453 P100 : 11124.000000 COUNT : 2315785 SUM : 6682479 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5721999 SUM : 5905102968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 215217.391304 P95 : 380000.000000 P99 : 392442.000000 P100 : 392442.000000 COUNT : 80 SUM : 17197826 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 104 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0