[2024-12-12 21:19:20.991718] Starting SPDK v25.01-pre git sha1 dc2db8405 / DPDK 24.03.0 initialization... [2024-12-12 21:19:20.991817] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2114312 ] Set seed to 1734034760989284 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-12 21:19:21.114853] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-12 21:19:21.225275] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-12 21:19:21.225333] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2114312' to capture a snapshot of events at runtime. [2024-12-12 21:19:21.225344] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-12 21:19:21.225355] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-12 21:19:21.225362] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2114312 for offline analysis/debug. [2024-12-12 21:19:21.226624] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Dec 12 21:19:26 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/12-21:19:29 ... thread 0: (1000000,1000000) ops and (366745.6,366745.6) ops/second in (2.726686,2.726686) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 566.26 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 355.5 2.30 2.06 12 0.192 0 0 0.0 0.0 L1 3/3 188.07 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 257.9 257.3 0.73 0.70 1 0.731 191K 422 0.0 0.0 L2 2/2 160.48 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.0 2.6 248.1 247.7 0.65 0.62 1 0.648 163K 294 0.0 0.0 L3 9/9 755.91 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 247/22 20.03 GB 0.0 0.3 0.2 0.1 1.1 1.0 0.1 1.4 94.9 317.0 3.68 3.38 14 0.263 354K 716 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.1 1.0 0.1 1.4 94.9 317.0 3.68 3.38 14 0.263 354K 716 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 253.3 252.7 1.38 1.32 2 0.690 354K 716 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 355.5 2.30 2.06 12 0.192 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 2.8 total, 2.7 interval Flush(GB): cumulative 0.799, interval 0.799 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.14 GB write, 415.87 MB/s write, 0.34 GB read, 124.55 MB/s read, 3.7 seconds Interval compaction: 1.14 GB write, 427.44 MB/s write, 0.34 GB read, 128.01 MB/s read, 3.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 114190 Average: 2.1155 StdDev: 17.07 Min: 0 Median: 1.3690 Max: 3211 Percentiles: P50: 1.37 P75: 1.79 P99: 5.61 P99.9: 11.31 P99.99: 28.32 ------------------------------------------------------ [ 0, 1 ] 31902 27.938% 27.938% ###### ( 1, 2 ] 68279 59.794% 87.732% ############ ( 2, 3 ] 7839 6.865% 94.597% # ( 3, 4 ] 3184 2.788% 97.385% # ( 4, 6 ] 2288 2.004% 99.389% ( 6, 10 ] 553 0.484% 99.873% ( 10, 15 ] 121 0.106% 99.979% ( 15, 22 ] 12 0.011% 99.989% ( 22, 34 ] 3 0.003% 99.992% ( 34, 51 ] 3 0.003% 99.995% ( 51, 76 ] 2 0.002% 99.996% ( 110, 170 ] 8 0.007% 100.004% ( 170, 250 ] 3 0.003% 100.006% ( 250, 380 ] 1 0.001% 100.007% ( 380, 580 ] 5 0.004% 100.011% ( 580, 870 ] 1 0.001% 100.012% ( 1300, 1900 ] 2 0.002% 100.014% ( 1900, 2900 ] 3 0.003% 100.017% ( 2900, 4400 ] 1 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 22507 Average: 2.1159 StdDev: 7.71 Min: 1 Median: 1.4298 Max: 959 Percentiles: P50: 1.43 P75: 1.83 P99: 5.58 P99.9: 10.87 P99.99: 454.93 ------------------------------------------------------ [ 0, 1 ] 5284 23.477% 23.477% ##### ( 1, 2 ] 13889 61.710% 85.187% ############ ( 2, 3 ] 1946 8.646% 93.833% ## ( 3, 4 ] 713 3.168% 97.001% # ( 4, 6 ] 569 2.528% 99.529% # ( 6, 10 ] 80 0.355% 99.884% ( 10, 15 ] 20 0.089% 99.973% ( 15, 22 ] 1 0.004% 99.978% ( 34, 51 ] 1 0.004% 99.982% ( 110, 170 ] 1 0.004% 99.987% ( 380, 580 ] 2 0.009% 99.996% ( 870, 1300 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 39722 Average: 3.1173 StdDev: 49.17 Min: 1 Median: 1.4484 Max: 5840 Percentiles: P50: 1.45 P75: 1.88 P99: 8.63 P99.9: 74.84 P99.99: 2413.90 ------------------------------------------------------ [ 0, 1 ] 9549 24.040% 24.040% ##### ( 1, 2 ] 22999 57.900% 81.939% ############ ( 2, 3 ] 3498 8.806% 90.746% ## ( 3, 4 ] 1554 3.912% 94.658% # ( 4, 6 ] 1393 3.507% 98.165% # ( 6, 10 ] 505 1.271% 99.436% ( 10, 15 ] 67 0.169% 99.605% ( 15, 22 ] 9 0.023% 99.627% ( 22, 34 ] 4 0.010% 99.637% ( 34, 51 ] 28 0.070% 99.708% ( 51, 76 ] 80 0.201% 99.909% ( 76, 110 ] 5 0.013% 99.922% ( 170, 250 ] 11 0.028% 99.950% ( 250, 380 ] 5 0.013% 99.962% ( 380, 580 ] 4 0.010% 99.972% ( 580, 870 ] 1 0.003% 99.975% ( 870, 1300 ] 1 0.003% 99.977% ( 1300, 1900 ] 4 0.010% 99.987% ( 1900, 2900 ] 2 0.005% 99.992% ( 2900, 4400 ] 1 0.003% 99.995% ( 4400, 6600 ] 2 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 16489 Average: 12.9728 StdDev: 203.19 Min: 1 Median: 1.8066 Max: 7512 Percentiles: P50: 1.81 P75: 2.74 P99: 88.87 P99.9: 3745.81 P99.99: 7512.00 ------------------------------------------------------ [ 0, 1 ] 647 3.924% 3.924% # ( 1, 2 ] 9419 57.123% 61.047% ########### ( 2, 3 ] 3098 18.788% 79.835% #### ( 3, 4 ] 1204 7.302% 87.137% # ( 4, 6 ] 1340 8.127% 95.264% ## ( 6, 10 ] 468 2.838% 98.102% # ( 10, 15 ] 107 0.649% 98.751% ( 15, 22 ] 23 0.139% 98.890% ( 22, 34 ] 6 0.036% 98.927% ( 76, 110 ] 32 0.194% 99.121% ( 110, 170 ] 50 0.303% 99.424% ( 170, 250 ] 24 0.146% 99.569% ( 250, 380 ] 14 0.085% 99.654% ( 380, 580 ] 13 0.079% 99.733% ( 580, 870 ] 8 0.049% 99.782% ( 870, 1300 ] 4 0.024% 99.806% ( 1300, 1900 ] 5 0.030% 99.836% ( 1900, 2900 ] 6 0.036% 99.873% ( 2900, 4400 ] 8 0.049% 99.921% ( 4400, 6600 ] 8 0.049% 99.970% ( 6600, 9900 ] 5 0.030% 100.000% ** Level 4 read latency histogram (micros): Count: 25 Average: 3081.6000 StdDev: 2262.30 Min: 178 Median: 2483.3333 Max: 7215 Percentiles: P50: 2483.33 P75: 5170.00 P99: 7215.00 P99.9: 7215.00 P99.99: 7215.00 ------------------------------------------------------ ( 170, 250 ] 1 4.000% 4.000% # ( 380, 580 ] 3 12.000% 16.000% ## ( 580, 870 ] 2 8.000% 24.000% ## ( 1300, 1900 ] 3 12.000% 36.000% ## ( 1900, 2900 ] 6 24.000% 60.000% ##### ( 2900, 4400 ] 2 8.000% 68.000% ## ( 4400, 6600 ] 5 20.000% 88.000% #### ( 6600, 9900 ] 3 12.000% 100.000% ## ** DB Stats ** Uptime(secs): 2.8 total, 2.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 350.91 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.185 H:M:S, 6.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 360.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.185 H:M:S, 6.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/12-21:19:32 ... thread 0: (1000000,2000000) ops and (328170.8,346387.5) ops/second in (3.047194,5.773880) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 1.29 GB 12.6 0.8 0.0 0.8 2.6 1.8 0.0 1.4 98.0 316.1 8.34 7.69 29 0.288 830K 4219 0.0 0.0 L1 1/1 49.73 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 241.4 239.8 2.60 2.53 2 1.301 637K 4058 0.0 0.0 L2 1/1 100.19 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.6 248.1 247.7 0.65 0.62 1 0.648 163K 294 0.0 0.0 L3 19/9 1.17 GB 0.4 0.5 0.4 0.1 0.5 0.4 0.0 1.2 205.4 205.0 2.70 2.49 4 0.676 563K 1271 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 255/19 21.00 GB 0.0 2.1 0.9 1.2 3.9 2.7 0.4 2.2 151.2 278.1 14.30 13.32 36 0.397 2195K 9842 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 0.9 1.2 3.9 2.7 0.4 2.2 151.2 278.1 14.30 13.32 36 0.397 2195K 9842 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 0.9 1.2 2.1 0.9 0.0 0.0 236.5 235.4 9.14 8.76 10 0.914 2195K 9842 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 353.9 5.15 4.56 26 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.9 total, 5.8 interval Flush(GB): cumulative 1.781, interval 1.781 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.88 GB write, 679.46 MB/s write, 2.11 GB read, 369.47 MB/s read, 14.3 seconds Interval compaction: 3.88 GB write, 688.40 MB/s write, 2.11 GB read, 374.32 MB/s read, 14.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 356371 Average: 2.6640 StdDev: 19.24 Min: 0 Median: 1.6142 Max: 4468 Percentiles: P50: 1.61 P75: 2.09 P99: 5.98 P99.9: 14.05 P99.99: 251.28 ------------------------------------------------------ [ 0, 1 ] 45006 12.629% 12.629% ### ( 1, 2 ] 216837 60.846% 73.475% ############ ( 2, 3 ] 57889 16.244% 89.719% ### ( 3, 4 ] 17895 5.021% 94.740% # ( 4, 6 ] 15328 4.301% 99.041% # ( 6, 10 ] 2602 0.730% 99.772% ( 10, 15 ] 565 0.159% 99.930% ( 15, 22 ] 46 0.013% 99.943% ( 22, 34 ] 8 0.002% 99.945% ( 34, 51 ] 5 0.001% 99.947% ( 51, 76 ] 6 0.002% 99.948% ( 76, 110 ] 5 0.001% 99.950% ( 110, 170 ] 70 0.020% 99.969% ( 170, 250 ] 73 0.020% 99.990% ( 250, 380 ] 37 0.010% 100.000% ( 380, 580 ] 40 0.011% 100.012% ( 580, 870 ] 23 0.006% 100.018% ( 870, 1300 ] 6 0.002% 100.020% ( 1300, 1900 ] 8 0.002% 100.022% ( 1900, 2900 ] 6 0.002% 100.024% ( 2900, 4400 ] 2 0.001% 100.024% ( 4400, 6600 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 145815 Average: 3.0167 StdDev: 14.10 Min: 1 Median: 1.7814 Max: 2304 Percentiles: P50: 1.78 P75: 2.55 P99: 8.76 P99.9: 76.37 P99.99: 297.88 ------------------------------------------------------ [ 0, 1 ] 8502 5.831% 5.831% # ( 1, 2 ] 82418 56.522% 62.353% ########### ( 2, 3 ] 33241 22.797% 85.150% ##### ( 3, 4 ] 9249 6.343% 91.493% # ( 4, 6 ] 9343 6.407% 97.900% # ( 6, 10 ] 2323 1.593% 99.493% ( 10, 15 ] 530 0.363% 99.857% ( 15, 22 ] 53 0.036% 99.893% ( 22, 34 ] 7 0.005% 99.898% ( 34, 51 ] 2 0.001% 99.899% ( 51, 76 ] 1 0.001% 99.900% ( 76, 110 ] 17 0.012% 99.912% ( 110, 170 ] 68 0.047% 99.958% ( 170, 250 ] 35 0.024% 99.982% ( 250, 380 ] 31 0.021% 100.003% ( 380, 580 ] 23 0.016% 100.019% ( 580, 870 ] 10 0.007% 100.026% ( 870, 1300 ] 3 0.002% 100.028% ( 1300, 1900 ] 2 0.001% 100.029% ( 1900, 2900 ] 1 0.001% 100.030% ** Level 2 read latency histogram (micros): Count: 49662 Average: 3.2437 StdDev: 45.20 Min: 1 Median: 1.4988 Max: 5840 Percentiles: P50: 1.50 P75: 1.92 P99: 8.73 P99.9: 215.88 P99.99: 1916.90 ------------------------------------------------------ [ 0, 1 ] 10200 20.539% 20.539% #### ( 1, 2 ] 29332 59.063% 79.602% ############ ( 2, 3 ] 5413 10.900% 90.502% ## ( 3, 4 ] 1971 3.969% 94.471% # ( 4, 6 ] 1787 3.598% 98.069% # ( 6, 10 ] 680 1.369% 99.438% ( 10, 15 ] 76 0.153% 99.591% ( 15, 22 ] 15 0.030% 99.621% ( 22, 34 ] 4 0.008% 99.629% ( 34, 51 ] 28 0.056% 99.686% ( 51, 76 ] 80 0.161% 99.847% ( 76, 110 ] 6 0.012% 99.859% ( 110, 170 ] 7 0.014% 99.873% ( 170, 250 ] 25 0.050% 99.923% ( 250, 380 ] 12 0.024% 99.948% ( 380, 580 ] 12 0.024% 99.972% ( 580, 870 ] 4 0.008% 99.980% ( 870, 1300 ] 2 0.004% 99.984% ( 1300, 1900 ] 4 0.008% 99.992% ( 1900, 2900 ] 2 0.004% 99.996% ( 2900, 4400 ] 1 0.002% 99.998% ( 4400, 6600 ] 2 0.004% 100.002% ** Level 3 read latency histogram (micros): Count: 219618 Average: 4.0761 StdDev: 58.75 Min: 1 Median: 1.7384 Max: 7512 Percentiles: P50: 1.74 P75: 2.45 P99: 9.33 P99.9: 246.95 P99.99: 767.52 ------------------------------------------------------ [ 0, 1 ] 10883 4.955% 4.955% # ( 1, 2 ] 133975 61.004% 65.959% ############ ( 2, 3 ] 44189 20.121% 86.080% #### ( 3, 4 ] 13205 6.013% 92.093% # ( 4, 6 ] 11481 5.228% 97.320% # ( 6, 10 ] 4429 2.017% 99.337% ( 10, 15 ] 620 0.282% 99.619% ( 15, 22 ] 65 0.030% 99.649% ( 22, 34 ] 11 0.005% 99.654% ( 34, 51 ] 1 0.000% 99.654% ( 51, 76 ] 1 0.000% 99.655% ( 76, 110 ] 155 0.071% 99.725% ( 110, 170 ] 267 0.122% 99.847% ( 170, 250 ] 121 0.055% 99.902% ( 250, 380 ] 88 0.040% 99.942% ( 380, 580 ] 74 0.034% 99.976% ( 580, 870 ] 48 0.022% 99.998% ( 870, 1300 ] 15 0.007% 100.005% ( 1300, 1900 ] 7 0.003% 100.008% ( 1900, 2900 ] 6 0.003% 100.010% ( 2900, 4400 ] 9 0.004% 100.015% ( 4400, 6600 ] 8 0.004% 100.018% ( 6600, 9900 ] 5 0.002% 100.020% ** Level 4 read latency histogram (micros): Count: 25 Average: 3081.6000 StdDev: 2262.30 Min: 178 Median: 2483.3333 Max: 7215 Percentiles: P50: 2483.33 P75: 5170.00 P99: 7215.00 P99.9: 7215.00 P99.99: 7215.00 ------------------------------------------------------ ( 170, 250 ] 1 4.000% 4.000% # ( 380, 580 ] 3 12.000% 16.000% ## ( 580, 870 ] 2 8.000% 24.000% ## ( 1300, 1900 ] 3 12.000% 36.000% ## ( 1900, 2900 ] 6 24.000% 60.000% ##### ( 2900, 4400 ] 2 8.000% 68.000% ## ( 4400, 6600 ] 5 20.000% 88.000% #### ( 6600, 9900 ] 3 12.000% 100.000% ## ** DB Stats ** Uptime(secs): 5.9 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 336.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.579 H:M:S, 9.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.99 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.393 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/12-21:19:35 ... thread 0: (1000000,3000000) ops and (329673.3,340630.9) ops/second in (3.033306,8.807186) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 2.27 GB 56.3 1.4 0.0 1.4 4.1 2.8 0.0 1.5 103.6 314.8 13.36 12.35 45 0.297 1405K 7265 0.0 0.0 L1 1/1 49.73 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 241.4 239.8 2.60 2.53 2 1.301 637K 4058 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.6 248.1 247.7 0.65 0.62 1 0.648 163K 294 0.0 0.0 L3 18/0 811.86 MB 0.8 1.4 0.5 0.8 1.4 0.5 0.0 2.6 223.9 223.4 6.30 5.81 5 1.260 1433K 3645 0.0 0.0 L4 122/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 217.7 217.7 1.05 0.97 1 1.055 233K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 271/17 21.98 GB 0.0 3.7 1.2 2.5 6.5 4.0 1.0 2.3 159.1 276.5 23.97 22.28 54 0.444 3873K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 1.2 2.5 6.5 4.0 1.0 2.3 159.1 276.5 23.97 22.28 54 0.444 3873K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 1.2 2.5 3.7 1.2 0.0 0.0 238.4 237.4 16.00 15.22 14 1.143 3873K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 355.0 7.97 7.06 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.9 total, 8.8 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.47 GB write, 746.05 MB/s write, 3.72 GB read, 429.25 MB/s read, 24.0 seconds Interval compaction: 6.47 GB write, 752.48 MB/s write, 3.72 GB read, 432.95 MB/s read, 24.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 728373 Average: 2.5931 StdDev: 15.81 Min: 0 Median: 1.6073 Max: 4468 Percentiles: P50: 1.61 P75: 2.00 P99: 6.29 P99.9: 13.38 P99.99: 165.39 ------------------------------------------------------ [ 0, 1 ] 79938 10.975% 10.975% ## ( 1, 2 ] 468050 64.260% 75.235% ############# ( 2, 3 ] 113959 15.646% 90.880% ### ( 3, 4 ] 32718 4.492% 95.372% # ( 4, 6 ] 25973 3.566% 98.938% # ( 6, 10 ] 6287 0.863% 99.801% ( 10, 15 ] 1069 0.147% 99.948% ( 15, 22 ] 86 0.012% 99.960% ( 22, 34 ] 11 0.002% 99.961% ( 34, 51 ] 7 0.001% 99.962% ( 51, 76 ] 9 0.001% 99.963% ( 76, 110 ] 53 0.007% 99.971% ( 110, 170 ] 154 0.021% 99.992% ( 170, 250 ] 122 0.017% 100.009% ( 250, 380 ] 68 0.009% 100.018% ( 380, 580 ] 77 0.011% 100.029% ( 580, 870 ] 48 0.007% 100.035% ( 870, 1300 ] 12 0.002% 100.037% ( 1300, 1900 ] 11 0.002% 100.038% ( 1900, 2900 ] 6 0.001% 100.039% ( 2900, 4400 ] 3 0.000% 100.040% ( 4400, 6600 ] 1 0.000% 100.040% ** Level 1 read latency histogram (micros): Count: 145815 Average: 3.0167 StdDev: 14.10 Min: 1 Median: 1.7814 Max: 2304 Percentiles: P50: 1.78 P75: 2.55 P99: 8.76 P99.9: 76.37 P99.99: 297.88 ------------------------------------------------------ [ 0, 1 ] 8502 5.831% 5.831% # ( 1, 2 ] 82418 56.522% 62.353% ########### ( 2, 3 ] 33241 22.797% 85.150% ##### ( 3, 4 ] 9249 6.343% 91.493% # ( 4, 6 ] 9343 6.407% 97.900% # ( 6, 10 ] 2323 1.593% 99.493% ( 10, 15 ] 530 0.363% 99.857% ( 15, 22 ] 53 0.036% 99.893% ( 22, 34 ] 7 0.005% 99.898% ( 34, 51 ] 2 0.001% 99.899% ( 51, 76 ] 1 0.001% 99.900% ( 76, 110 ] 17 0.012% 99.912% ( 110, 170 ] 68 0.047% 99.958% ( 170, 250 ] 35 0.024% 99.982% ( 250, 380 ] 31 0.021% 100.003% ( 380, 580 ] 23 0.016% 100.019% ( 580, 870 ] 10 0.007% 100.026% ( 870, 1300 ] 3 0.002% 100.028% ( 1300, 1900 ] 2 0.001% 100.029% ( 1900, 2900 ] 1 0.001% 100.030% ** Level 2 read latency histogram (micros): Count: 65619 Average: 2.9753 StdDev: 39.33 Min: 1 Median: 1.4979 Max: 5840 Percentiles: P50: 1.50 P75: 1.90 P99: 8.46 P99.9: 156.12 P99.99: 1665.71 ------------------------------------------------------ [ 0, 1 ] 12654 19.284% 19.284% #### ( 1, 2 ] 40479 61.688% 80.972% ############ ( 2, 3 ] 6836 10.418% 91.390% ## ( 3, 4 ] 2368 3.609% 94.998% # ( 4, 6 ] 2037 3.104% 98.103% # ( 6, 10 ] 958 1.460% 99.563% ( 10, 15 ] 81 0.123% 99.686% ( 15, 22 ] 17 0.026% 99.712% ( 22, 34 ] 4 0.006% 99.718% ( 34, 51 ] 28 0.043% 99.761% ( 51, 76 ] 80 0.122% 99.883% ( 76, 110 ] 6 0.009% 99.892% ( 110, 170 ] 7 0.011% 99.902% ( 170, 250 ] 25 0.038% 99.941% ( 250, 380 ] 12 0.018% 99.959% ( 380, 580 ] 12 0.018% 99.977% ( 580, 870 ] 4 0.006% 99.983% ( 870, 1300 ] 2 0.003% 99.986% ( 1300, 1900 ] 4 0.006% 99.992% ( 1900, 2900 ] 2 0.003% 99.995% ( 2900, 4400 ] 1 0.002% 99.997% ( 4400, 6600 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 278015 Average: 3.9083 StdDev: 53.67 Min: 0 Median: 1.7342 Max: 7512 Percentiles: P50: 1.73 P75: 2.42 P99: 9.13 P99.9: 244.36 P99.99: 815.68 ------------------------------------------------------ [ 0, 1 ] 13371 4.809% 4.809% # ( 1, 2 ] 171112 61.548% 66.357% ############ ( 2, 3 ] 56809 20.434% 86.791% #### ( 3, 4 ] 15913 5.724% 92.515% # ( 4, 6 ] 13943 5.015% 97.530% # ( 6, 10 ] 5229 1.881% 99.411% ( 10, 15 ] 703 0.253% 99.664% ( 15, 22 ] 68 0.024% 99.688% ( 22, 34 ] 11 0.004% 99.692% ( 34, 51 ] 1 0.000% 99.692% ( 51, 76 ] 4 0.001% 99.694% ( 76, 110 ] 159 0.057% 99.751% ( 110, 170 ] 282 0.101% 99.853% ( 170, 250 ] 142 0.051% 99.904% ( 250, 380 ] 100 0.036% 99.940% ( 380, 580 ] 89 0.032% 99.972% ( 580, 870 ] 63 0.023% 99.994% ( 870, 1300 ] 20 0.007% 100.001% ( 1300, 1900 ] 12 0.004% 100.006% ( 1900, 2900 ] 6 0.002% 100.008% ( 2900, 4400 ] 10 0.004% 100.012% ( 4400, 6600 ] 8 0.003% 100.014% ( 6600, 9900 ] 5 0.002% 100.016% ** Level 4 read latency histogram (micros): Count: 55 Average: 1467.5091 StdDev: 2126.37 Min: 1 Median: 400.0000 Max: 7215 Percentiles: P50: 400.00 P75: 2275.00 P99: 7215.00 P99.9: 7215.00 P99.99: 7215.00 ------------------------------------------------------ [ 0, 1 ] 6 10.909% 10.909% ## ( 1, 2 ] 8 14.545% 25.455% ### ( 2, 3 ] 3 5.455% 30.909% # ( 4, 6 ] 1 1.818% 32.727% ( 22, 34 ] 1 1.818% 34.545% ( 110, 170 ] 5 9.091% 43.636% ## ( 170, 250 ] 2 3.636% 47.273% # ( 250, 380 ] 1 1.818% 49.091% ( 380, 580 ] 5 9.091% 58.182% ## ( 580, 870 ] 4 7.273% 65.455% # ( 1300, 1900 ] 3 5.455% 70.909% # ( 1900, 2900 ] 6 10.909% 81.818% ## ( 2900, 4400 ] 2 3.636% 85.455% # ( 4400, 6600 ] 5 9.091% 94.545% ## ( 6600, 9900 ] 3 5.455% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 1088.2000 StdDev: 1313.06 Min: 87 Median: 446.6667 Max: 4836 Percentiles: P50: 446.67 P75: 1900.00 P99: 4836.00 P99.9: 4836.00 P99.99: 4836.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 3 15.000% 35.000% ### ( 170, 250 ] 2 10.000% 45.000% ## ( 380, 580 ] 3 15.000% 60.000% ### ( 870, 1300 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 1 5.000% 75.000% # ( 1900, 2900 ] 2 10.000% 85.000% ## ( 2900, 4400 ] 2 10.000% 95.000% ## ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 8.9 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 332.31 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.956 H:M:S, 10.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.378 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/12-21:19:38 ... thread 0: (1000000,4000000) ops and (309863.8,332380.2) ops/second in (3.227224,12.034410) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/4 2.02 GB 181.4 2.5 0.0 2.5 6.1 3.7 0.0 1.7 123.8 308.9 20.31 18.93 63 0.322 2554K 13K 0.0 0.0 L1 11/0 1.18 GB 120.8 1.8 1.6 0.2 1.8 1.6 0.1 1.1 227.5 223.0 8.22 7.82 3 2.738 1897K 36K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.6 248.1 247.7 0.65 0.62 1 0.648 163K 294 0.0 0.0 L3 18/0 811.86 MB 0.8 1.4 0.5 0.8 1.4 0.5 0.0 2.6 223.9 223.4 6.30 5.81 5 1.260 1433K 3645 0.0 0.0 L4 122/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 217.7 217.7 1.05 0.97 1 1.055 233K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 275/4 22.86 GB 0.0 6.0 2.4 3.6 9.7 6.0 1.0 2.6 169.3 271.1 36.53 34.15 73 0.500 6282K 54K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.0 2.4 3.6 9.7 6.0 1.0 2.6 169.3 271.1 36.53 34.15 73 0.500 6282K 54K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.0 2.4 3.6 6.0 2.4 0.0 0.0 238.8 236.7 25.91 24.72 19 1.363 6282K 54K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 355.0 10.63 9.43 54 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 12.0 interval Flush(GB): cumulative 3.685, interval 3.685 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.67 GB write, 817.84 MB/s write, 6.04 GB read, 510.75 MB/s read, 36.5 seconds Interval compaction: 9.67 GB write, 823.00 MB/s write, 6.04 GB read, 513.97 MB/s read, 36.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 4, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 4, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 4, total-stops: 14, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1102726 Average: 2.5198 StdDev: 15.54 Min: 0 Median: 1.5820 Max: 4468 Percentiles: P50: 1.58 P75: 1.96 P99: 6.13 P99.9: 13.08 P99.99: 134.30 ------------------------------------------------------ [ 0, 1 ] 132050 11.975% 11.975% ## ( 1, 2 ] 720418 65.331% 77.306% ############# ( 2, 3 ] 159737 14.486% 91.791% ### ( 3, 4 ] 44712 4.055% 95.846% # ( 4, 6 ] 34487 3.127% 98.973% # ( 6, 10 ] 9168 0.831% 99.805% ( 10, 15 ] 1706 0.155% 99.959% ( 15, 22 ] 117 0.011% 99.970% ( 22, 34 ] 17 0.002% 99.972% ( 34, 51 ] 12 0.001% 99.973% ( 51, 76 ] 10 0.001% 99.974% ( 76, 110 ] 89 0.008% 99.982% ( 110, 170 ] 229 0.021% 100.002% ( 170, 250 ] 159 0.014% 100.017% ( 250, 380 ] 84 0.008% 100.024% ( 380, 580 ] 95 0.009% 100.033% ( 580, 870 ] 56 0.005% 100.038% ( 870, 1300 ] 19 0.002% 100.040% ( 1300, 1900 ] 15 0.001% 100.041% ( 1900, 2900 ] 11 0.001% 100.042% ( 2900, 4400 ] 5 0.000% 100.043% ( 4400, 6600 ] 1 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 158498 Average: 3.2226 StdDev: 22.60 Min: 1 Median: 1.7701 Max: 2944 Percentiles: P50: 1.77 P75: 2.53 P99: 8.85 P99.9: 142.46 P99.99: 409.43 ------------------------------------------------------ [ 0, 1 ] 9335 5.890% 5.890% # ( 1, 2 ] 90789 57.281% 63.171% ########### ( 2, 3 ] 35487 22.390% 85.560% #### ( 3, 4 ] 9758 6.157% 91.717% # ( 4, 6 ] 9739 6.145% 97.861% # ( 6, 10 ] 2536 1.600% 99.461% ( 10, 15 ] 549 0.346% 99.808% ( 15, 22 ] 55 0.035% 99.842% ( 22, 34 ] 7 0.004% 99.847% ( 34, 51 ] 2 0.001% 99.848% ( 51, 76 ] 1 0.001% 99.849% ( 76, 110 ] 22 0.014% 99.862% ( 110, 170 ] 110 0.069% 99.932% ( 170, 250 ] 46 0.029% 99.961% ( 250, 380 ] 41 0.026% 99.987% ( 380, 580 ] 35 0.022% 100.009% ( 580, 870 ] 12 0.008% 100.016% ( 870, 1300 ] 7 0.004% 100.021% ( 1300, 1900 ] 5 0.003% 100.024% ( 1900, 2900 ] 5 0.003% 100.027% ( 2900, 4400 ] 1 0.001% 100.028% ** Level 2 read latency histogram (micros): Count: 65619 Average: 2.9753 StdDev: 39.33 Min: 1 Median: 1.4979 Max: 5840 Percentiles: P50: 1.50 P75: 1.90 P99: 8.46 P99.9: 156.12 P99.99: 1665.71 ------------------------------------------------------ [ 0, 1 ] 12654 19.284% 19.284% #### ( 1, 2 ] 40479 61.688% 80.972% ############ ( 2, 3 ] 6836 10.418% 91.390% ## ( 3, 4 ] 2368 3.609% 94.998% # ( 4, 6 ] 2037 3.104% 98.103% # ( 6, 10 ] 958 1.460% 99.563% ( 10, 15 ] 81 0.123% 99.686% ( 15, 22 ] 17 0.026% 99.712% ( 22, 34 ] 4 0.006% 99.718% ( 34, 51 ] 28 0.043% 99.761% ( 51, 76 ] 80 0.122% 99.883% ( 76, 110 ] 6 0.009% 99.892% ( 110, 170 ] 7 0.011% 99.902% ( 170, 250 ] 25 0.038% 99.941% ( 250, 380 ] 12 0.018% 99.959% ( 380, 580 ] 12 0.018% 99.977% ( 580, 870 ] 4 0.006% 99.983% ( 870, 1300 ] 2 0.003% 99.986% ( 1300, 1900 ] 4 0.006% 99.992% ( 1900, 2900 ] 2 0.003% 99.995% ( 2900, 4400 ] 1 0.002% 99.997% ( 4400, 6600 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 278015 Average: 3.9083 StdDev: 53.67 Min: 0 Median: 1.7342 Max: 7512 Percentiles: P50: 1.73 P75: 2.42 P99: 9.13 P99.9: 244.36 P99.99: 815.68 ------------------------------------------------------ [ 0, 1 ] 13371 4.809% 4.809% # ( 1, 2 ] 171112 61.548% 66.357% ############ ( 2, 3 ] 56809 20.434% 86.791% #### ( 3, 4 ] 15913 5.724% 92.515% # ( 4, 6 ] 13943 5.015% 97.530% # ( 6, 10 ] 5229 1.881% 99.411% ( 10, 15 ] 703 0.253% 99.664% ( 15, 22 ] 68 0.024% 99.688% ( 22, 34 ] 11 0.004% 99.692% ( 34, 51 ] 1 0.000% 99.692% ( 51, 76 ] 4 0.001% 99.694% ( 76, 110 ] 159 0.057% 99.751% ( 110, 170 ] 282 0.101% 99.853% ( 170, 250 ] 142 0.051% 99.904% ( 250, 380 ] 100 0.036% 99.940% ( 380, 580 ] 89 0.032% 99.972% ( 580, 870 ] 63 0.023% 99.994% ( 870, 1300 ] 20 0.007% 100.001% ( 1300, 1900 ] 12 0.004% 100.006% ( 1900, 2900 ] 6 0.002% 100.008% ( 2900, 4400 ] 10 0.004% 100.012% ( 4400, 6600 ] 8 0.003% 100.014% ( 6600, 9900 ] 5 0.002% 100.016% ** Level 4 read latency histogram (micros): Count: 55 Average: 1467.5091 StdDev: 2126.37 Min: 1 Median: 400.0000 Max: 7215 Percentiles: P50: 400.00 P75: 2275.00 P99: 7215.00 P99.9: 7215.00 P99.99: 7215.00 ------------------------------------------------------ [ 0, 1 ] 6 10.909% 10.909% ## ( 1, 2 ] 8 14.545% 25.455% ### ( 2, 3 ] 3 5.455% 30.909% # ( 4, 6 ] 1 1.818% 32.727% ( 22, 34 ] 1 1.818% 34.545% ( 110, 170 ] 5 9.091% 43.636% ## ( 170, 250 ] 2 3.636% 47.273% # ( 250, 380 ] 1 1.818% 49.091% ( 380, 580 ] 5 9.091% 58.182% ## ( 580, 870 ] 4 7.273% 65.455% # ( 1300, 1900 ] 3 5.455% 70.909% # ( 1900, 2900 ] 6 10.909% 81.818% ## ( 2900, 4400 ] 2 3.636% 85.455% # ( 4400, 6600 ] 5 9.091% 94.545% ## ( 6600, 9900 ] 3 5.455% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 1088.2000 StdDev: 1313.06 Min: 87 Median: 446.6667 Max: 4836 Percentiles: P50: 446.67 P75: 1900.00 P99: 4836.00 P99.9: 4836.00 P99.99: 4836.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 3 15.000% 35.000% ### ( 170, 250 ] 2 10.000% 45.000% ## ( 380, 580 ] 3 15.000% 60.000% ### ( 870, 1300 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 1 5.000% 75.000% # ( 1900, 2900 ] 2 10.000% 85.000% ## ( 2900, 4400 ] 2 10.000% 95.000% ## ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.535 H:M:S, 12.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 304.96 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.579 H:M:S, 17.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/12-21:19:42 ... thread 0: (1000000,5000000) ops and (294022.1,323928.3) ops/second in (3.401105,15.435515) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 3.06 GB 37.6 3.3 0.0 3.3 8.0 4.7 0.0 1.7 126.5 309.7 26.34 24.60 81 0.325 3385K 17K 0.0 0.0 L1 11/11 1.18 GB 0.0 1.8 1.6 0.2 1.8 1.6 0.1 1.1 227.5 223.0 8.22 7.82 3 2.738 1897K 36K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 2.6 248.1 247.7 0.65 0.62 1 0.648 163K 294 0.0 0.0 L3 18/0 811.86 MB 0.8 1.4 0.5 0.8 1.4 0.5 0.0 2.6 223.9 223.4 6.30 5.81 5 1.260 1433K 3645 0.0 0.0 L4 122/0 9.70 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.3 1.0 217.7 217.7 1.05 0.97 1 1.055 233K 0 0.0 0.0 L5 112/0 9.17 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 281/27 23.90 GB 0.0 6.8 2.4 4.4 11.5 7.1 1.0 2.4 164.6 277.0 42.56 39.82 91 0.468 7112K 58K 0.0 0.0 Int 0/0 0.00 KB 0.0 6.8 2.4 4.4 11.5 7.1 1.0 2.4 164.6 277.0 42.56 39.82 91 0.468 7112K 58K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.8 2.4 4.4 6.8 2.4 0.0 0.0 241.7 239.7 28.97 27.74 22 1.317 7112K 58K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 356.3 13.59 12.08 69 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.5 total, 15.4 interval Flush(GB): cumulative 4.729, interval 4.729 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.51 GB write, 759.88 MB/s write, 6.84 GB read, 451.48 MB/s read, 42.6 seconds Interval compaction: 11.51 GB write, 763.61 MB/s write, 6.84 GB read, 453.70 MB/s read, 42.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 17, interval: 23 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1396468 Average: 2.4963 StdDev: 14.92 Min: 0 Median: 1.5637 Max: 4468 Percentiles: P50: 1.56 P75: 1.94 P99: 5.98 P99.9: 13.48 P99.99: 146.18 ------------------------------------------------------ [ 0, 1 ] 180841 12.950% 12.950% ### ( 1, 2 ] 917864 65.728% 78.677% ############# ( 2, 3 ] 190820 13.664% 92.342% ### ( 3, 4 ] 53019 3.797% 96.139% # ( 4, 6 ] 40296 2.886% 99.024% # ( 6, 10 ] 10794 0.773% 99.797% ( 10, 15 ] 2067 0.148% 99.945% ( 15, 22 ] 154 0.011% 99.956% ( 22, 34 ] 22 0.002% 99.958% ( 34, 51 ] 12 0.001% 99.959% ( 51, 76 ] 12 0.001% 99.959% ( 76, 110 ] 193 0.014% 99.973% ( 110, 170 ] 392 0.028% 100.001% ( 170, 250 ] 205 0.015% 100.016% ( 250, 380 ] 106 0.008% 100.024% ( 380, 580 ] 127 0.009% 100.033% ( 580, 870 ] 70 0.005% 100.038% ( 870, 1300 ] 26 0.002% 100.040% ( 1300, 1900 ] 18 0.001% 100.041% ( 1900, 2900 ] 13 0.001% 100.042% ( 2900, 4400 ] 5 0.000% 100.042% ( 4400, 6600 ] 1 0.000% 100.042% ** Level 1 read latency histogram (micros): Count: 198794 Average: 3.1807 StdDev: 21.47 Min: 1 Median: 1.7156 Max: 2944 Percentiles: P50: 1.72 P75: 2.40 P99: 8.85 P99.9: 157.81 P99.99: 465.62 ------------------------------------------------------ [ 0, 1 ] 15201 7.647% 7.647% ## ( 1, 2 ] 117652 59.183% 66.829% ############ ( 2, 3 ] 40350 20.297% 87.127% #### ( 3, 4 ] 10765 5.415% 92.542% # ( 4, 6 ] 10605 5.335% 97.877% # ( 6, 10 ] 3135 1.577% 99.454% ( 10, 15 ] 614 0.309% 99.763% ( 15, 22 ] 56 0.028% 99.791% ( 22, 34 ] 9 0.005% 99.795% ( 34, 51 ] 3 0.002% 99.797% ( 51, 76 ] 1 0.001% 99.797% ( 76, 110 ] 52 0.026% 99.823% ( 110, 170 ] 191 0.096% 99.920% ( 170, 250 ] 66 0.033% 99.953% ( 250, 380 ] 54 0.027% 99.980% ( 380, 580 ] 47 0.024% 100.004% ( 580, 870 ] 18 0.009% 100.013% ( 870, 1300 ] 8 0.004% 100.017% ( 1300, 1900 ] 5 0.003% 100.019% ( 1900, 2900 ] 5 0.003% 100.022% ( 2900, 4400 ] 1 0.001% 100.022% ** Level 2 read latency histogram (micros): Count: 65619 Average: 2.9753 StdDev: 39.33 Min: 1 Median: 1.4979 Max: 5840 Percentiles: P50: 1.50 P75: 1.90 P99: 8.46 P99.9: 156.12 P99.99: 1665.71 ------------------------------------------------------ [ 0, 1 ] 12654 19.284% 19.284% #### ( 1, 2 ] 40479 61.688% 80.972% ############ ( 2, 3 ] 6836 10.418% 91.390% ## ( 3, 4 ] 2368 3.609% 94.998% # ( 4, 6 ] 2037 3.104% 98.103% # ( 6, 10 ] 958 1.460% 99.563% ( 10, 15 ] 81 0.123% 99.686% ( 15, 22 ] 17 0.026% 99.712% ( 22, 34 ] 4 0.006% 99.718% ( 34, 51 ] 28 0.043% 99.761% ( 51, 76 ] 80 0.122% 99.883% ( 76, 110 ] 6 0.009% 99.892% ( 110, 170 ] 7 0.011% 99.902% ( 170, 250 ] 25 0.038% 99.941% ( 250, 380 ] 12 0.018% 99.959% ( 380, 580 ] 12 0.018% 99.977% ( 580, 870 ] 4 0.006% 99.983% ( 870, 1300 ] 2 0.003% 99.986% ( 1300, 1900 ] 4 0.006% 99.992% ( 1900, 2900 ] 2 0.003% 99.995% ( 2900, 4400 ] 1 0.002% 99.997% ( 4400, 6600 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 278015 Average: 3.9083 StdDev: 53.67 Min: 0 Median: 1.7342 Max: 7512 Percentiles: P50: 1.73 P75: 2.42 P99: 9.13 P99.9: 244.36 P99.99: 815.68 ------------------------------------------------------ [ 0, 1 ] 13371 4.809% 4.809% # ( 1, 2 ] 171112 61.548% 66.357% ############ ( 2, 3 ] 56809 20.434% 86.791% #### ( 3, 4 ] 15913 5.724% 92.515% # ( 4, 6 ] 13943 5.015% 97.530% # ( 6, 10 ] 5229 1.881% 99.411% ( 10, 15 ] 703 0.253% 99.664% ( 15, 22 ] 68 0.024% 99.688% ( 22, 34 ] 11 0.004% 99.692% ( 34, 51 ] 1 0.000% 99.692% ( 51, 76 ] 4 0.001% 99.694% ( 76, 110 ] 159 0.057% 99.751% ( 110, 170 ] 282 0.101% 99.853% ( 170, 250 ] 142 0.051% 99.904% ( 250, 380 ] 100 0.036% 99.940% ( 380, 580 ] 89 0.032% 99.972% ( 580, 870 ] 63 0.023% 99.994% ( 870, 1300 ] 20 0.007% 100.001% ( 1300, 1900 ] 12 0.004% 100.006% ( 1900, 2900 ] 6 0.002% 100.008% ( 2900, 4400 ] 10 0.004% 100.012% ( 4400, 6600 ] 8 0.003% 100.014% ( 6600, 9900 ] 5 0.002% 100.016% ** Level 4 read latency histogram (micros): Count: 55 Average: 1467.5091 StdDev: 2126.37 Min: 1 Median: 400.0000 Max: 7215 Percentiles: P50: 400.00 P75: 2275.00 P99: 7215.00 P99.9: 7215.00 P99.99: 7215.00 ------------------------------------------------------ [ 0, 1 ] 6 10.909% 10.909% ## ( 1, 2 ] 8 14.545% 25.455% ### ( 2, 3 ] 3 5.455% 30.909% # ( 4, 6 ] 1 1.818% 32.727% ( 22, 34 ] 1 1.818% 34.545% ( 110, 170 ] 5 9.091% 43.636% ## ( 170, 250 ] 2 3.636% 47.273% # ( 250, 380 ] 1 1.818% 49.091% ( 380, 580 ] 5 9.091% 58.182% ## ( 580, 870 ] 4 7.273% 65.455% # ( 1300, 1900 ] 3 5.455% 70.909% # ( 1900, 2900 ] 6 10.909% 81.818% ## ( 2900, 4400 ] 2 3.636% 85.455% # ( 4400, 6600 ] 5 9.091% 94.545% ## ( 6600, 9900 ] 3 5.455% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 1088.2000 StdDev: 1313.06 Min: 87 Median: 446.6667 Max: 4836 Percentiles: P50: 446.67 P75: 1900.00 P99: 4836.00 P99.9: 4836.00 P99.99: 4836.00 ------------------------------------------------------ ( 76, 110 ] 4 20.000% 20.000% #### ( 110, 170 ] 3 15.000% 35.000% ### ( 170, 250 ] 2 10.000% 45.000% ## ( 380, 580 ] 3 15.000% 60.000% ### ( 870, 1300 ] 2 10.000% 70.000% ## ( 1300, 1900 ] 1 5.000% 75.000% # ( 1900, 2900 ] 2 10.000% 85.000% ## ( 2900, 4400 ] 2 10.000% 95.000% ## ( 4400, 6600 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.5 total, 3.4 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 317.21 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.310 H:M:S, 14.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 289.37 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.775 H:M:S, 22.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.410 micros/op 293259 ops/sec 20.003 seconds 5865999 operations; 284.1 MB/s Microseconds per write: Count: 5865999 Average: 3.4099 StdDev: 216.45 Min: 0 Median: 1.7102 Max: 207766 Percentiles: P50: 1.71 P75: 2.67 P99: 6.73 P99.9: 96.31 P99.99: 1270.83 ------------------------------------------------------ [ 0, 1 ] 834474 14.226% 14.226% ### ( 1, 2 ] 2954682 50.370% 64.595% ########## ( 2, 3 ] 909764 15.509% 80.104% ### ( 3, 4 ] 809431 13.799% 93.903% ### ( 4, 6 ] 291423 4.968% 98.871% # ( 6, 10 ] 41727 0.711% 99.582% ( 10, 15 ] 11720 0.200% 99.782% ( 15, 22 ] 3582 0.061% 99.843% ( 22, 34 ] 728 0.012% 99.856% ( 34, 51 ] 84 0.001% 99.857% ( 51, 76 ] 26 0.000% 99.858% ( 76, 110 ] 4171 0.071% 99.929% ( 110, 170 ] 1575 0.027% 99.955% ( 170, 250 ] 163 0.003% 99.958% ( 250, 380 ] 46 0.001% 99.959% ( 380, 580 ] 3 0.000% 99.959% ( 580, 870 ] 5 0.000% 99.959% ( 870, 1300 ] 1940 0.033% 99.992% ( 1900, 2900 ] 443 0.008% 100.000% ( 6600, 9900 ] 1 0.000% 100.000% ( 9900, 14000 ] 1 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 6 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 182737 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5865999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6053710968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 176 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 4500098 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 10082740641 rocksdb.compact.write.bytes COUNT : 9900177598 rocksdb.flush.write.bytes COUNT : 5935453460 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 13 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 90 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5897189376 rocksdb.memtable.garbage.bytes.at.flush COUNT : 11101184 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 10129416518 rocksdb.non.last.level.read.count COUNT : 2445057 rocksdb.block.checksum.compute.count COUNT : 2444718 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.353220 P95 : 3.796310 P99 : 5.836225 P100 : 207763.000000 COUNT : 5865999 SUM : 17388973 rocksdb.compaction.times.micros P50 : 1030000.000000 P95 : 3880000.000000 P99 : 5612826.000000 P100 : 5612826.000000 COUNT : 26 SUM : 32768093 rocksdb.compaction.times.cpu_micros P50 : 1018666.666667 P95 : 3880000.000000 P99 : 5293405.000000 P100 : 5293405.000000 COUNT : 26 SUM : 31471871 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 682.352941 P95 : 1298.346154 P99 : 1727.000000 P100 : 1727.000000 COUNT : 82 SUM : 63211 rocksdb.compaction.outfile.sync.micros P50 : 773.333333 P95 : 1420.000000 P99 : 2060.000000 P100 : 2692.000000 COUNT : 84 SUM : 69003 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 86.419355 P95 : 233.692308 P99 : 331.033333 P100 : 357.000000 COUNT : 113 SUM : 12433 rocksdb.table.open.io.micros P50 : 1534.782609 P95 : 15600.000000 P99 : 20553.000000 P100 : 20553.000000 COUNT : 176 SUM : 521884 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.636821 P95 : 6.604007 P99 : 9.859333 P100 : 4440.000000 COUNT : 2444282 SUM : 11571633 rocksdb.read.block.get.micros P50 : 550.833333 P95 : 4636.923077 P99 : 7760.000000 P100 : 7760.000000 COUNT : 352 SUM : 392676 rocksdb.write.raw.block.micros P50 : 0.510504 P95 : 0.969958 P99 : 2.715805 P100 : 2972.000000 COUNT : 3843297 SUM : 7092429 rocksdb.numfiles.in.singlecompaction P50 : 3.444444 P95 : 9.200000 P99 : 23.000000 P100 : 23.000000 COUNT : 32 SUM : 149 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.561171 P95 : 1154.897165 P99 : 2424.311512 P100 : 207568.000000 COUNT : 22173 SUM : 4502675 rocksdb.sst.read.micros P50 : 1.585273 P95 : 3.866404 P99 : 7.406386 P100 : 7512.000000 COUNT : 2445234 SUM : 6856702 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5865999 SUM : 6053710968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 206610.169492 P95 : 320777.777778 P99 : 368155.555556 P100 : 376187.000000 COUNT : 82 SUM : 15896951 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 113 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0