[2024-11-27 05:34:48.311010] Starting SPDK v25.01-pre git sha1 a640d9f98 / DPDK 24.03.0 initialization... [2024-11-27 05:34:48.311318] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid141508 ] Set seed to 1732682088303890 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-27 05:34:48.464463] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-27 05:34:48.571698] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-27 05:34:48.571750] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 141508' to capture a snapshot of events at runtime. [2024-11-27 05:34:48.571763] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-27 05:34:48.571777] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-27 05:34:48.571786] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid141508 for offline analysis/debug. [2024-11-27 05:34:48.573007] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 27 05:34:54 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/27-05:34:57 ... thread 0: (1000000,1000000) ops and (325194.1,325194.1) ops/second in (3.075087,3.075087) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 377.50 MB 12.6 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 322.7 2.53 2.27 12 0.211 0 0 0.0 0.0 L1 4/0 250.40 MB 25.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 238.4 237.2 1.06 1.01 1 1.055 255K 1238 0.0 0.0 L2 3/2 222.67 MB 0.4 0.3 0.2 0.1 0.3 0.2 0.0 1.7 243.3 242.7 1.32 1.26 2 0.660 326K 720 0.0 0.0 L3 10/0 818.91 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 247/6 20.02 GB 0.0 0.6 0.4 0.1 1.4 1.2 0.2 1.7 116.7 282.8 4.91 4.53 15 0.327 581K 1958 0.0 0.0 Int 0/0 0.00 KB 0.0 0.6 0.4 0.1 1.4 1.2 0.2 1.7 116.7 282.8 4.91 4.53 15 0.327 581K 1958 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.6 0.4 0.1 0.6 0.4 0.0 0.0 241.1 240.3 2.38 2.27 3 0.792 581K 1958 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 322.7 2.53 2.27 12 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.1 interval Flush(GB): cumulative 0.799, interval 0.799 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.36 GB write, 437.72 MB/s write, 0.56 GB read, 180.56 MB/s read, 4.9 seconds Interval compaction: 1.36 GB write, 451.35 MB/s write, 0.56 GB read, 186.18 MB/s read, 4.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 147579 Average: 2.1480 StdDev: 13.25 Min: 0 Median: 1.4415 Max: 3672 Percentiles: P50: 1.44 P75: 1.84 P99: 5.73 P99.9: 12.27 P99.99: 18.39 ------------------------------------------------------ [ 0, 1 ] 32640 22.117% 22.117% #### ( 1, 2 ] 93207 63.157% 85.274% ############# ( 2, 3 ] 13703 9.285% 94.560% ## ( 3, 4 ] 4209 2.852% 97.412% # ( 4, 6 ] 2717 1.841% 99.253% ( 6, 10 ] 855 0.579% 99.832% ( 10, 15 ] 228 0.154% 99.986% ( 15, 22 ] 17 0.012% 99.998% ( 22, 34 ] 3 0.002% 100.000% ( 34, 51 ] 1 0.001% 100.001% ( 76, 110 ] 1 0.001% 100.001% ( 170, 250 ] 9 0.006% 100.007% ( 250, 380 ] 2 0.001% 100.009% ( 380, 580 ] 6 0.004% 100.013% ( 580, 870 ] 4 0.003% 100.016% ( 1900, 2900 ] 2 0.001% 100.017% ( 2900, 4400 ] 1 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 20 Average: 190.3000 StdDev: 375.55 Min: 1 Median: 1.8333 Max: 1517 Percentiles: P50: 1.83 P75: 170.00 P99: 1517.00 P99.9: 1517.00 P99.99: 1517.00 ------------------------------------------------------ [ 0, 1 ] 5 25.000% 25.000% ##### ( 1, 2 ] 6 30.000% 55.000% ###### ( 2, 3 ] 1 5.000% 60.000% # ( 4, 6 ] 1 5.000% 65.000% # ( 15, 22 ] 1 5.000% 70.000% # ( 110, 170 ] 1 5.000% 75.000% # ( 250, 380 ] 1 5.000% 80.000% # ( 380, 580 ] 2 10.000% 90.000% ## ( 580, 870 ] 1 5.000% 95.000% # ( 1300, 1900 ] 1 5.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 66809 Average: 2.4271 StdDev: 16.52 Min: 0 Median: 1.4796 Max: 2665 Percentiles: P50: 1.48 P75: 1.88 P99: 7.34 P99.9: 56.85 P99.99: 675.63 ------------------------------------------------------ [ 0, 1 ] 13190 19.743% 19.743% #### ( 1, 2 ] 42148 63.087% 82.830% ############# ( 2, 3 ] 7108 10.639% 93.469% ## ( 3, 4 ] 1965 2.941% 96.411% # ( 4, 6 ] 1542 2.308% 98.719% ( 6, 10 ] 562 0.841% 99.560% ( 10, 15 ] 183 0.274% 99.834% ( 15, 22 ] 22 0.033% 99.867% ( 22, 34 ] 7 0.010% 99.877% ( 34, 51 ] 7 0.010% 99.888% ( 51, 76 ] 35 0.052% 99.940% ( 76, 110 ] 5 0.007% 99.948% ( 110, 170 ] 3 0.004% 99.952% ( 170, 250 ] 12 0.018% 99.970% ( 250, 380 ] 7 0.010% 99.981% ( 380, 580 ] 5 0.007% 99.988% ( 580, 870 ] 4 0.006% 99.994% ( 870, 1300 ] 1 0.001% 99.996% ( 1300, 1900 ] 2 0.003% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 49 Average: 3052.3673 StdDev: 2382.62 Min: 194 Median: 2550.0000 Max: 8200 Percentiles: P50: 2550.00 P75: 4827.78 P99: 8200.00 P99.9: 8200.00 P99.99: 8200.00 ------------------------------------------------------ ( 170, 250 ] 4 8.163% 8.163% ## ( 250, 380 ] 1 2.041% 10.204% ( 380, 580 ] 4 8.163% 18.367% ## ( 580, 870 ] 4 8.163% 26.531% ## ( 870, 1300 ] 2 4.082% 30.612% # ( 1300, 1900 ] 3 6.122% 36.735% # ( 1900, 2900 ] 10 20.408% 57.143% #### ( 2900, 4400 ] 7 14.286% 71.429% ### ( 4400, 6600 ] 9 18.367% 89.796% #### ( 6600, 9900 ] 5 10.204% 100.000% ## ** Level 4 read latency histogram (micros): Count: 25 Average: 3158.6800 StdDev: 2353.53 Min: 48 Median: 2650.0000 Max: 7591 Percentiles: P50: 2650.00 P75: 4950.00 P99: 7591.00 P99.9: 7591.00 P99.99: 7591.00 ------------------------------------------------------ ( 34, 51 ] 1 4.000% 4.000% # ( 51, 76 ] 1 4.000% 8.000% # ( 170, 250 ] 1 4.000% 12.000% # ( 580, 870 ] 2 8.000% 20.000% ## ( 870, 1300 ] 2 8.000% 28.000% ## ( 1300, 1900 ] 1 4.000% 32.000% # ( 1900, 2900 ] 6 24.000% 56.000% ##### ( 2900, 4400 ] 4 16.000% 72.000% ### ( 4400, 6600 ] 3 12.000% 84.000% ## ( 6600, 9900 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.2 total, 3.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 310.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.211 H:M:S, 6.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.211 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-05:35:00 ... thread 0: (1000000,2000000) ops and (294817.4,309261.6) ops/second in (3.391930,6.467017) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.41 GB 31.3 0.7 0.0 0.7 2.6 1.8 0.0 1.4 85.1 297.2 8.88 8.15 30 0.296 766K 3673 0.0 0.0 L1 0/0 0.00 KB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 238.4 237.2 1.06 1.01 1 1.055 255K 1238 0.0 0.0 L2 2/0 95.87 MB 1.0 0.4 0.2 0.2 0.4 0.2 0.2 1.9 238.2 237.3 1.57 1.50 3 0.524 380K 1323 0.0 0.0 L3 18/0 992.68 MB 1.0 0.5 0.4 0.2 0.5 0.4 0.0 1.4 215.5 214.8 2.52 2.37 3 0.839 550K 1942 0.0 0.0 L4 122/0 9.73 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.0 1.0 209.8 209.8 0.96 0.89 1 0.958 204K 0 0.0 0.0 L5 108/0 8.86 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 262/10 21.06 GB 0.0 2.1 1.0 1.1 3.9 2.8 0.4 2.1 141.8 267.2 14.98 13.92 38 0.394 2157K 8176 0.0 0.0 Int 0/0 0.00 KB 0.0 2.1 1.0 1.1 3.9 2.8 0.4 2.1 141.8 267.2 14.98 13.92 38 0.394 2157K 8176 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.1 1.0 1.1 2.1 1.0 0.0 0.0 231.3 230.4 9.19 8.77 11 0.835 2157K 8176 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 325.7 5.79 5.15 27 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.6 total, 6.5 interval Flush(GB): cumulative 1.843, interval 1.843 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.91 GB write, 609.86 MB/s write, 2.07 GB read, 323.67 MB/s read, 15.0 seconds Interval compaction: 3.91 GB write, 618.90 MB/s write, 2.07 GB read, 328.47 MB/s read, 15.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 438386 Average: 2.3731 StdDev: 12.80 Min: 0 Median: 1.5746 Max: 3672 Percentiles: P50: 1.57 P75: 1.97 P99: 5.96 P99.9: 13.23 P99.99: 93.39 ------------------------------------------------------ [ 0, 1 ] 58438 13.330% 13.330% ### ( 1, 2 ] 279769 63.818% 77.148% ############# ( 2, 3 ] 67570 15.413% 92.562% ### ( 3, 4 ] 16670 3.803% 96.364% # ( 4, 6 ] 11801 2.692% 99.056% # ( 6, 10 ] 3189 0.727% 99.784% ( 10, 15 ] 791 0.180% 99.964% ( 15, 22 ] 70 0.016% 99.980% ( 22, 34 ] 13 0.003% 99.983% ( 34, 51 ] 2 0.000% 99.983% ( 51, 76 ] 23 0.005% 99.989% ( 76, 110 ] 14 0.003% 99.992% ( 110, 170 ] 29 0.007% 99.998% ( 170, 250 ] 24 0.005% 100.004% ( 250, 380 ] 7 0.002% 100.005% ( 380, 580 ] 20 0.005% 100.010% ( 580, 870 ] 7 0.002% 100.012% ( 870, 1300 ] 7 0.002% 100.013% ( 1300, 1900 ] 3 0.001% 100.014% ( 1900, 2900 ] 2 0.000% 100.014% ( 2900, 4400 ] 3 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 52724 Average: 2.6362 StdDev: 8.28 Min: 1 Median: 1.7491 Max: 1517 Percentiles: P50: 1.75 P75: 2.44 P99: 7.65 P99.9: 13.83 P99.99: 21.24 ------------------------------------------------------ [ 0, 1 ] 2570 4.874% 4.874% # ( 1, 2 ] 31762 60.242% 65.116% ############ ( 2, 3 ] 11791 22.364% 87.480% #### ( 3, 4 ] 3147 5.969% 93.449% # ( 4, 6 ] 2660 5.045% 98.494% # ( 6, 10 ] 647 1.227% 99.721% ( 10, 15 ] 123 0.233% 99.954% ( 15, 22 ] 21 0.040% 99.994% ( 22, 34 ] 5 0.009% 100.004% ( 34, 51 ] 1 0.002% 100.006% ( 110, 170 ] 1 0.002% 100.008% ( 250, 380 ] 1 0.002% 100.009% ( 380, 580 ] 2 0.004% 100.013% ( 580, 870 ] 1 0.002% 100.015% ( 1300, 1900 ] 1 0.002% 100.017% ** Level 2 read latency histogram (micros): Count: 90224 Average: 2.4844 StdDev: 14.31 Min: 0 Median: 1.5532 Max: 2665 Percentiles: P50: 1.55 P75: 1.96 P99: 7.69 P99.9: 26.53 P99.99: 545.92 ------------------------------------------------------ [ 0, 1 ] 14220 15.761% 15.761% ### ( 1, 2 ] 55845 61.896% 77.657% ############ ( 2, 3 ] 12644 14.014% 91.671% ### ( 3, 4 ] 3401 3.770% 95.440% # ( 4, 6 ] 2833 3.140% 98.580% # ( 6, 10 ] 894 0.991% 99.571% ( 10, 15 ] 264 0.293% 99.864% ( 15, 22 ] 29 0.032% 99.896% ( 22, 34 ] 10 0.011% 99.907% ( 34, 51 ] 7 0.008% 99.915% ( 51, 76 ] 35 0.039% 99.953% ( 76, 110 ] 5 0.006% 99.959% ( 110, 170 ] 3 0.003% 99.962% ( 170, 250 ] 13 0.014% 99.977% ( 250, 380 ] 7 0.008% 99.984% ( 380, 580 ] 6 0.007% 99.991% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 2 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 93210 Average: 4.1452 StdDev: 88.86 Min: 0 Median: 1.7067 Max: 8200 Percentiles: P50: 1.71 P75: 2.33 P99: 7.83 P99.9: 15.20 P99.99: 4331.21 ------------------------------------------------------ [ 0, 1 ] 5960 6.394% 6.394% # ( 1, 2 ] 57517 61.707% 68.101% ############ ( 2, 3 ] 19470 20.888% 88.989% #### ( 3, 4 ] 5003 5.367% 94.357% # ( 4, 6 ] 3804 4.081% 98.438% # ( 6, 10 ] 1146 1.229% 99.667% ( 10, 15 ] 216 0.232% 99.899% ( 15, 22 ] 28 0.030% 99.929% ( 22, 34 ] 5 0.005% 99.935% ( 34, 51 ] 2 0.002% 99.937% ( 76, 110 ] 1 0.001% 99.938% ( 110, 170 ] 4 0.004% 99.942% ( 170, 250 ] 6 0.006% 99.949% ( 250, 380 ] 5 0.005% 99.954% ( 380, 580 ] 5 0.005% 99.959% ( 580, 870 ] 7 0.008% 99.967% ( 870, 1300 ] 2 0.002% 99.969% ( 1300, 1900 ] 3 0.003% 99.972% ( 1900, 2900 ] 10 0.011% 99.983% ( 2900, 4400 ] 7 0.008% 99.990% ( 4400, 6600 ] 9 0.010% 100.000% ( 6600, 9900 ] 5 0.005% 100.005% ** Level 4 read latency histogram (micros): Count: 55 Average: 1508.7455 StdDev: 2193.63 Min: 1 Median: 282.5000 Max: 7591 Percentiles: P50: 282.50 P75: 2441.67 P99: 7591.00 P99.9: 7591.00 P99.99: 7591.00 ------------------------------------------------------ [ 0, 1 ] 4 7.273% 7.273% # ( 1, 2 ] 14 25.455% 32.727% ##### ( 34, 51 ] 1 1.818% 34.545% ( 51, 76 ] 1 1.818% 36.364% ( 110, 170 ] 6 10.909% 47.273% ## ( 170, 250 ] 1 1.818% 49.091% ( 250, 380 ] 2 3.636% 52.727% # ( 380, 580 ] 2 3.636% 56.364% # ( 580, 870 ] 4 7.273% 63.636% # ( 870, 1300 ] 2 3.636% 67.273% # ( 1300, 1900 ] 1 1.818% 69.091% ( 1900, 2900 ] 6 10.909% 80.000% ## ( 2900, 4400 ] 4 7.273% 87.273% # ( 4400, 6600 ] 3 5.455% 92.727% # ( 6600, 9900 ] 4 7.273% 100.000% # ** DB Stats ** Uptime(secs): 6.6 total, 3.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 299.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.638 H:M:S, 9.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 290.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.427 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-05:35:03 ... thread 0: (1000000,3000000) ops and (317415.4,311932.6) ops/second in (3.150446,9.617463) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 1.53 GB 0.0 1.5 0.0 1.5 4.3 2.8 0.0 1.6 104.8 292.9 15.00 13.89 47 0.319 1596K 7906 0.0 0.0 L1 4/4 415.72 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 225.8 222.8 4.72 4.54 2 2.362 1083K 14K 0.0 0.0 L2 2/0 95.87 MB 1.0 0.4 0.2 0.2 0.4 0.2 0.6 1.9 238.2 237.3 1.57 1.50 3 0.524 380K 1323 0.0 0.0 L3 14/0 685.75 MB 0.7 0.7 0.5 0.2 0.7 0.5 0.3 1.4 217.7 217.0 3.21 3.03 4 0.803 709K 2291 0.0 0.0 L4 122/0 9.73 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 209.8 209.8 0.96 0.89 1 0.958 204K 0 0.0 0.0 L5 116/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 269/15 21.97 GB 0.0 3.8 1.9 1.9 6.6 4.7 2.4 2.4 153.7 263.8 25.47 23.84 57 0.447 3974K 25K 0.0 0.0 Int 0/0 0.00 KB 0.0 3.8 1.9 1.9 6.6 4.7 2.4 2.4 153.7 263.8 25.47 23.84 57 0.447 3974K 25K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.8 1.9 1.9 3.8 1.9 0.0 0.0 232.7 231.2 16.82 16.15 16 1.051 3974K 25K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 327.1 8.65 7.69 41 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.7 total, 9.6 interval Flush(GB): cumulative 2.764, interval 2.764 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.56 GB write, 691.55 MB/s write, 3.82 GB read, 402.89 MB/s read, 25.5 seconds Interval compaction: 6.56 GB write, 698.44 MB/s write, 3.82 GB read, 406.90 MB/s read, 25.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 757899 Average: 2.4612 StdDev: 14.57 Min: 0 Median: 1.5869 Max: 4212 Percentiles: P50: 1.59 P75: 1.97 P99: 6.23 P99.9: 13.72 P99.99: 149.37 ------------------------------------------------------ [ 0, 1 ] 91118 12.022% 12.022% ## ( 1, 2 ] 490392 64.704% 76.727% ############# ( 2, 3 ] 120333 15.877% 92.604% ### ( 3, 4 ] 28424 3.750% 96.354% # ( 4, 6 ] 19692 2.598% 98.952% # ( 6, 10 ] 6218 0.820% 99.773% ( 10, 15 ] 1298 0.171% 99.944% ( 15, 22 ] 94 0.012% 99.956% ( 22, 34 ] 18 0.002% 99.959% ( 34, 51 ] 2 0.000% 99.959% ( 51, 76 ] 25 0.003% 99.962% ( 76, 110 ] 98 0.013% 99.975% ( 110, 170 ] 171 0.023% 99.998% ( 170, 250 ] 83 0.011% 100.009% ( 250, 380 ] 30 0.004% 100.013% ( 380, 580 ] 49 0.006% 100.019% ( 580, 870 ] 14 0.002% 100.021% ( 870, 1300 ] 15 0.002% 100.023% ( 1300, 1900 ] 6 0.001% 100.024% ( 1900, 2900 ] 4 0.001% 100.024% ( 2900, 4400 ] 6 0.001% 100.025% ** Level 1 read latency histogram (micros): Count: 85463 Average: 2.6644 StdDev: 14.18 Min: 1 Median: 1.7194 Max: 1988 Percentiles: P50: 1.72 P75: 2.34 P99: 7.06 P99.9: 13.75 P99.99: 153.61 ------------------------------------------------------ [ 0, 1 ] 4571 5.349% 5.349% # ( 1, 2 ] 53045 62.068% 67.416% ############ ( 2, 3 ] 18959 22.184% 89.600% #### ( 3, 4 ] 4336 5.074% 94.674% # ( 4, 6 ] 3467 4.057% 98.730% # ( 6, 10 ] 869 1.017% 99.747% ( 10, 15 ] 174 0.204% 99.951% ( 15, 22 ] 26 0.030% 99.981% ( 22, 34 ] 5 0.006% 99.987% ( 34, 51 ] 1 0.001% 99.988% ( 110, 170 ] 2 0.002% 99.991% ( 250, 380 ] 1 0.001% 99.992% ( 380, 580 ] 7 0.008% 100.000% ( 580, 870 ] 3 0.004% 100.004% ( 870, 1300 ] 2 0.002% 100.006% ( 1300, 1900 ] 3 0.004% 100.009% ( 1900, 2900 ] 1 0.001% 100.011% ** Level 2 read latency histogram (micros): Count: 90224 Average: 2.4844 StdDev: 14.31 Min: 0 Median: 1.5532 Max: 2665 Percentiles: P50: 1.55 P75: 1.96 P99: 7.69 P99.9: 26.53 P99.99: 545.92 ------------------------------------------------------ [ 0, 1 ] 14220 15.761% 15.761% ### ( 1, 2 ] 55845 61.896% 77.657% ############ ( 2, 3 ] 12644 14.014% 91.671% ### ( 3, 4 ] 3401 3.770% 95.440% # ( 4, 6 ] 2833 3.140% 98.580% # ( 6, 10 ] 894 0.991% 99.571% ( 10, 15 ] 264 0.293% 99.864% ( 15, 22 ] 29 0.032% 99.896% ( 22, 34 ] 10 0.011% 99.907% ( 34, 51 ] 7 0.008% 99.915% ( 51, 76 ] 35 0.039% 99.953% ( 76, 110 ] 5 0.006% 99.959% ( 110, 170 ] 3 0.003% 99.962% ( 170, 250 ] 13 0.014% 99.977% ( 250, 380 ] 7 0.008% 99.984% ( 380, 580 ] 6 0.007% 99.991% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 2 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 100251 Average: 4.1564 StdDev: 85.87 Min: 0 Median: 1.7061 Max: 8200 Percentiles: P50: 1.71 P75: 2.33 P99: 8.16 P99.9: 134.58 P99.99: 4180.34 ------------------------------------------------------ [ 0, 1 ] 6365 6.349% 6.349% # ( 1, 2 ] 61977 61.822% 68.171% ############ ( 2, 3 ] 20920 20.868% 89.039% #### ( 3, 4 ] 5334 5.321% 94.359% # ( 4, 6 ] 3963 3.953% 98.312% # ( 6, 10 ] 1279 1.276% 99.588% ( 10, 15 ] 245 0.244% 99.832% ( 15, 22 ] 32 0.032% 99.864% ( 22, 34 ] 5 0.005% 99.869% ( 34, 51 ] 2 0.002% 99.871% ( 76, 110 ] 14 0.014% 99.885% ( 110, 170 ] 36 0.036% 99.921% ( 170, 250 ] 21 0.021% 99.942% ( 250, 380 ] 10 0.010% 99.952% ( 380, 580 ] 9 0.009% 99.961% ( 580, 870 ] 8 0.008% 99.969% ( 870, 1300 ] 2 0.002% 99.971% ( 1300, 1900 ] 3 0.003% 99.974% ( 1900, 2900 ] 10 0.010% 99.984% ( 2900, 4400 ] 7 0.007% 99.991% ( 4400, 6600 ] 9 0.009% 100.000% ( 6600, 9900 ] 5 0.005% 100.005% ** Level 4 read latency histogram (micros): Count: 55 Average: 1508.7455 StdDev: 2193.63 Min: 1 Median: 282.5000 Max: 7591 Percentiles: P50: 282.50 P75: 2441.67 P99: 7591.00 P99.9: 7591.00 P99.99: 7591.00 ------------------------------------------------------ [ 0, 1 ] 4 7.273% 7.273% # ( 1, 2 ] 14 25.455% 32.727% ##### ( 34, 51 ] 1 1.818% 34.545% ( 51, 76 ] 1 1.818% 36.364% ( 110, 170 ] 6 10.909% 47.273% ## ( 170, 250 ] 1 1.818% 49.091% ( 250, 380 ] 2 3.636% 52.727% # ( 380, 580 ] 2 3.636% 56.364% # ( 580, 870 ] 4 7.273% 63.636% # ( 870, 1300 ] 2 3.636% 67.273% # ( 1300, 1900 ] 1 1.818% 69.091% ( 1900, 2900 ] 6 10.909% 80.000% ## ( 2900, 4400 ] 4 7.273% 87.273% # ( 4400, 6600 ] 3 5.455% 92.727% # ( 6600, 9900 ] 4 7.273% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 811.3250 StdDev: 987.20 Min: 97 Median: 250.0000 Max: 3304 Percentiles: P50: 250.00 P75: 1156.67 P99: 3304.00 P99.9: 3304.00 P99.99: 3304.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 13 32.500% 45.000% ####### ( 170, 250 ] 2 5.000% 50.000% # ( 250, 380 ] 2 5.000% 55.000% # ( 380, 580 ] 4 10.000% 65.000% ## ( 580, 870 ] 2 5.000% 70.000% # ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 4 10.000% 92.500% ## ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 9.7 total, 3.2 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 303.93 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.859 H:M:S, 8.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 312.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.221 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-05:35:07 ... thread 0: (1000000,4000000) ops and (294587.2,307407.5) ops/second in (3.394581,13.012044) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.51 GB 100.2 2.3 0.0 2.3 6.1 3.7 0.0 1.6 111.8 290.7 21.38 19.85 64 0.334 2427K 12K 0.0 0.0 L1 4/4 415.72 MB 0.0 1.0 1.0 0.0 1.0 1.0 0.2 1.0 225.8 222.8 4.72 4.54 2 2.362 1083K 14K 0.0 0.0 L2 2/0 95.87 MB 1.0 0.4 0.2 0.2 0.4 0.2 0.6 1.9 238.2 237.3 1.57 1.50 3 0.524 380K 1323 0.0 0.0 L3 14/0 685.75 MB 0.7 0.7 0.5 0.2 0.7 0.5 0.3 1.4 217.7 217.0 3.21 3.03 4 0.803 709K 2291 0.0 0.0 L4 122/0 9.73 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 209.8 209.8 0.96 0.89 1 0.958 204K 0 0.0 0.0 L5 116/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 274/15 22.94 GB 0.0 4.6 1.9 2.7 8.3 5.6 2.4 2.2 148.6 268.1 31.84 29.80 74 0.430 4805K 30K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 1.9 2.7 8.3 5.6 2.4 2.2 148.6 268.1 31.84 29.80 74 0.430 4805K 30K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 1.9 2.7 4.6 1.9 0.0 0.0 235.2 233.7 20.12 19.38 19 1.059 4805K 30K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 327.2 11.73 10.42 55 0.213 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 13.1 total, 13.0 interval Flush(GB): cumulative 3.746, interval 3.746 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.34 GB write, 651.27 MB/s write, 4.62 GB read, 360.94 MB/s read, 31.8 seconds Interval compaction: 8.34 GB write, 656.07 MB/s write, 4.62 GB read, 363.59 MB/s read, 31.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1173548 Average: 2.4915 StdDev: 13.58 Min: 0 Median: 1.6030 Max: 4212 Percentiles: P50: 1.60 P75: 1.99 P99: 6.58 P99.9: 13.77 P99.99: 140.83 ------------------------------------------------------ [ 0, 1 ] 126498 10.779% 10.779% ## ( 1, 2 ] 763326 65.044% 75.823% ############# ( 2, 3 ] 196126 16.712% 92.536% ### ( 3, 4 ] 43909 3.742% 96.277% # ( 4, 6 ] 30425 2.593% 98.870% # ( 6, 10 ] 10475 0.893% 99.762% ( 10, 15 ] 2148 0.183% 99.945% ( 15, 22 ] 143 0.012% 99.958% ( 22, 34 ] 26 0.002% 99.960% ( 34, 51 ] 4 0.000% 99.960% ( 51, 76 ] 28 0.002% 99.963% ( 76, 110 ] 171 0.015% 99.977% ( 110, 170 ] 299 0.025% 100.003% ( 170, 250 ] 134 0.011% 100.014% ( 250, 380 ] 60 0.005% 100.019% ( 380, 580 ] 77 0.007% 100.026% ( 580, 870 ] 24 0.002% 100.028% ( 870, 1300 ] 29 0.002% 100.030% ( 1300, 1900 ] 8 0.001% 100.031% ( 1900, 2900 ] 5 0.000% 100.031% ( 2900, 4400 ] 7 0.001% 100.032% ** Level 1 read latency histogram (micros): Count: 112006 Average: 2.7121 StdDev: 13.45 Min: 1 Median: 1.7113 Max: 1988 Percentiles: P50: 1.71 P75: 2.32 P99: 7.72 P99.9: 14.91 P99.99: 364.39 ------------------------------------------------------ [ 0, 1 ] 6206 5.541% 5.541% # ( 1, 2 ] 70005 62.501% 68.042% ############# ( 2, 3 ] 24407 21.791% 89.833% #### ( 3, 4 ] 5408 4.828% 94.661% # ( 4, 6 ] 4263 3.806% 98.467% # ( 6, 10 ] 1391 1.242% 99.709% ( 10, 15 ] 218 0.195% 99.904% ( 15, 22 ] 29 0.026% 99.929% ( 22, 34 ] 5 0.004% 99.934% ( 34, 51 ] 1 0.001% 99.935% ( 76, 110 ] 27 0.024% 99.959% ( 110, 170 ] 18 0.016% 99.975% ( 170, 250 ] 8 0.007% 99.982% ( 250, 380 ] 10 0.009% 99.991% ( 380, 580 ] 9 0.008% 99.999% ( 580, 870 ] 3 0.003% 100.002% ( 870, 1300 ] 3 0.003% 100.004% ( 1300, 1900 ] 3 0.003% 100.007% ( 1900, 2900 ] 1 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 90224 Average: 2.4844 StdDev: 14.31 Min: 0 Median: 1.5532 Max: 2665 Percentiles: P50: 1.55 P75: 1.96 P99: 7.69 P99.9: 26.53 P99.99: 545.92 ------------------------------------------------------ [ 0, 1 ] 14220 15.761% 15.761% ### ( 1, 2 ] 55845 61.896% 77.657% ############ ( 2, 3 ] 12644 14.014% 91.671% ### ( 3, 4 ] 3401 3.770% 95.440% # ( 4, 6 ] 2833 3.140% 98.580% # ( 6, 10 ] 894 0.991% 99.571% ( 10, 15 ] 264 0.293% 99.864% ( 15, 22 ] 29 0.032% 99.896% ( 22, 34 ] 10 0.011% 99.907% ( 34, 51 ] 7 0.008% 99.915% ( 51, 76 ] 35 0.039% 99.953% ( 76, 110 ] 5 0.006% 99.959% ( 110, 170 ] 3 0.003% 99.962% ( 170, 250 ] 13 0.014% 99.977% ( 250, 380 ] 7 0.008% 99.984% ( 380, 580 ] 6 0.007% 99.991% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 2 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 100251 Average: 4.1564 StdDev: 85.87 Min: 0 Median: 1.7061 Max: 8200 Percentiles: P50: 1.71 P75: 2.33 P99: 8.16 P99.9: 134.58 P99.99: 4180.34 ------------------------------------------------------ [ 0, 1 ] 6365 6.349% 6.349% # ( 1, 2 ] 61977 61.822% 68.171% ############ ( 2, 3 ] 20920 20.868% 89.039% #### ( 3, 4 ] 5334 5.321% 94.359% # ( 4, 6 ] 3963 3.953% 98.312% # ( 6, 10 ] 1279 1.276% 99.588% ( 10, 15 ] 245 0.244% 99.832% ( 15, 22 ] 32 0.032% 99.864% ( 22, 34 ] 5 0.005% 99.869% ( 34, 51 ] 2 0.002% 99.871% ( 76, 110 ] 14 0.014% 99.885% ( 110, 170 ] 36 0.036% 99.921% ( 170, 250 ] 21 0.021% 99.942% ( 250, 380 ] 10 0.010% 99.952% ( 380, 580 ] 9 0.009% 99.961% ( 580, 870 ] 8 0.008% 99.969% ( 870, 1300 ] 2 0.002% 99.971% ( 1300, 1900 ] 3 0.003% 99.974% ( 1900, 2900 ] 10 0.010% 99.984% ( 2900, 4400 ] 7 0.007% 99.991% ( 4400, 6600 ] 9 0.009% 100.000% ( 6600, 9900 ] 5 0.005% 100.005% ** Level 4 read latency histogram (micros): Count: 55 Average: 1508.7455 StdDev: 2193.63 Min: 1 Median: 282.5000 Max: 7591 Percentiles: P50: 282.50 P75: 2441.67 P99: 7591.00 P99.9: 7591.00 P99.99: 7591.00 ------------------------------------------------------ [ 0, 1 ] 4 7.273% 7.273% # ( 1, 2 ] 14 25.455% 32.727% ##### ( 34, 51 ] 1 1.818% 34.545% ( 51, 76 ] 1 1.818% 36.364% ( 110, 170 ] 6 10.909% 47.273% ## ( 170, 250 ] 1 1.818% 49.091% ( 250, 380 ] 2 3.636% 52.727% # ( 380, 580 ] 2 3.636% 56.364% # ( 580, 870 ] 4 7.273% 63.636% # ( 870, 1300 ] 2 3.636% 67.273% # ( 1300, 1900 ] 1 1.818% 69.091% ( 1900, 2900 ] 6 10.909% 80.000% ## ( 2900, 4400 ] 4 7.273% 87.273% # ( 4400, 6600 ] 3 5.455% 92.727% # ( 6600, 9900 ] 4 7.273% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 811.3250 StdDev: 987.20 Min: 97 Median: 250.0000 Max: 3304 Percentiles: P50: 250.00 P75: 1156.67 P99: 3304.00 P99.9: 3304.00 P99.99: 3304.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 13 32.500% 45.000% ####### ( 170, 250 ] 2 5.000% 50.000% # ( 250, 380 ] 2 5.000% 55.000% # ( 380, 580 ] 4 10.000% 65.000% ## ( 580, 870 ] 2 5.000% 70.000% # ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 4 10.000% 92.500% ## ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 13.1 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 300.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.286 H:M:S, 9.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 289.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.426 H:M:S, 12.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-05:35:11 ... thread 0: (1000000,5000000) ops and (239804.0,291000.2) ops/second in (4.170072,17.182116) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 2.14 GB 0.0 3.3 0.0 3.3 8.0 4.7 0.0 1.7 119.9 288.0 28.33 26.32 82 0.346 3449K 17K 0.0 0.0 L1 15/15 1.63 GB 0.0 2.7 2.3 0.4 2.7 2.3 0.2 1.1 218.4 212.3 12.81 12.11 3 4.270 2841K 78K 0.0 0.0 L2 2/0 95.87 MB 1.0 0.4 0.2 0.2 0.4 0.2 0.6 1.9 238.2 237.3 1.57 1.50 3 0.524 380K 1323 0.0 0.0 L3 14/0 685.75 MB 0.7 0.7 0.5 0.2 0.7 0.5 0.3 1.4 217.7 217.0 3.21 3.03 4 0.803 709K 2291 0.0 0.0 L4 122/0 9.73 GB 1.0 0.2 0.2 0.0 0.2 0.2 0.7 1.0 209.8 209.8 0.96 0.89 1 0.958 204K 0 0.0 0.0 L5 116/0 9.54 GB 0.1 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 280/26 23.80 GB 0.0 7.3 3.2 4.1 11.9 7.8 2.4 2.5 159.3 259.2 46.88 43.84 93 0.504 7585K 98K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.3 3.2 4.1 11.9 7.8 2.4 2.5 159.3 259.2 46.88 43.84 93 0.504 7585K 98K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.3 3.2 4.1 7.2 3.1 0.0 0.0 231.4 228.4 32.28 30.86 24 1.345 7585K 98K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 327.2 14.61 12.98 69 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 17.3 total, 17.2 interval Flush(GB): cumulative 4.668, interval 4.668 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.87 GB write, 703.20 MB/s write, 7.29 GB read, 432.25 MB/s read, 46.9 seconds Interval compaction: 11.87 GB write, 707.12 MB/s write, 7.29 GB read, 434.66 MB/s read, 46.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 13, interval: 18 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1514628 Average: 2.6948 StdDev: 16.10 Min: 0 Median: 1.5997 Max: 4212 Percentiles: P50: 1.60 P75: 1.98 P99: 7.41 P99.9: 107.51 P99.99: 240.22 ------------------------------------------------------ [ 0, 1 ] 164099 10.834% 10.834% ## ( 1, 2 ] 989251 65.313% 76.147% ############# ( 2, 3 ] 249288 16.459% 92.606% ### ( 3, 4 ] 54280 3.584% 96.190% # ( 4, 6 ] 37316 2.464% 98.654% ( 6, 10 ] 14910 0.984% 99.638% ( 10, 15 ] 2880 0.190% 99.828% ( 15, 22 ] 216 0.014% 99.842% ( 22, 34 ] 36 0.002% 99.845% ( 34, 51 ] 9 0.001% 99.845% ( 51, 76 ] 315 0.021% 99.866% ( 76, 110 ] 554 0.037% 99.903% ( 110, 170 ] 953 0.063% 99.966% ( 170, 250 ] 421 0.028% 99.993% ( 250, 380 ] 208 0.014% 100.007% ( 380, 580 ] 224 0.015% 100.022% ( 580, 870 ] 62 0.004% 100.026% ( 870, 1300 ] 46 0.003% 100.029% ( 1300, 1900 ] 13 0.001% 100.030% ( 1900, 2900 ] 6 0.000% 100.030% ( 2900, 4400 ] 11 0.001% 100.031% ** Level 1 read latency histogram (micros): Count: 191337 Average: 3.0228 StdDev: 19.90 Min: 0 Median: 1.6645 Max: 3451 Percentiles: P50: 1.66 P75: 2.19 P99: 8.56 P99.9: 157.72 P99.99: 714.19 ------------------------------------------------------ [ 0, 1 ] 14558 7.609% 7.609% ## ( 1, 2 ] 122066 63.796% 71.405% ############# ( 2, 3 ] 37164 19.423% 90.828% #### ( 3, 4 ] 7819 4.087% 94.915% # ( 4, 6 ] 6022 3.147% 98.062% # ( 6, 10 ] 2799 1.463% 99.525% ( 10, 15 ] 367 0.192% 99.717% ( 15, 22 ] 46 0.024% 99.741% ( 22, 34 ] 9 0.005% 99.745% ( 34, 51 ] 1 0.001% 99.746% ( 76, 110 ] 169 0.088% 99.834% ( 110, 170 ] 158 0.083% 99.917% ( 170, 250 ] 60 0.031% 99.948% ( 250, 380 ] 39 0.020% 99.969% ( 380, 580 ] 33 0.017% 99.986% ( 580, 870 ] 17 0.009% 99.995% ( 870, 1300 ] 11 0.006% 100.001% ( 1300, 1900 ] 4 0.002% 100.003% ( 1900, 2900 ] 3 0.002% 100.004% ( 2900, 4400 ] 1 0.001% 100.005% ** Level 2 read latency histogram (micros): Count: 90224 Average: 2.4844 StdDev: 14.31 Min: 0 Median: 1.5532 Max: 2665 Percentiles: P50: 1.55 P75: 1.96 P99: 7.69 P99.9: 26.53 P99.99: 545.92 ------------------------------------------------------ [ 0, 1 ] 14220 15.761% 15.761% ### ( 1, 2 ] 55845 61.896% 77.657% ############ ( 2, 3 ] 12644 14.014% 91.671% ### ( 3, 4 ] 3401 3.770% 95.440% # ( 4, 6 ] 2833 3.140% 98.580% # ( 6, 10 ] 894 0.991% 99.571% ( 10, 15 ] 264 0.293% 99.864% ( 15, 22 ] 29 0.032% 99.896% ( 22, 34 ] 10 0.011% 99.907% ( 34, 51 ] 7 0.008% 99.915% ( 51, 76 ] 35 0.039% 99.953% ( 76, 110 ] 5 0.006% 99.959% ( 110, 170 ] 3 0.003% 99.962% ( 170, 250 ] 13 0.014% 99.977% ( 250, 380 ] 7 0.008% 99.984% ( 380, 580 ] 6 0.007% 99.991% ( 580, 870 ] 4 0.004% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 2 0.002% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 100251 Average: 4.1564 StdDev: 85.87 Min: 0 Median: 1.7061 Max: 8200 Percentiles: P50: 1.71 P75: 2.33 P99: 8.16 P99.9: 134.58 P99.99: 4180.34 ------------------------------------------------------ [ 0, 1 ] 6365 6.349% 6.349% # ( 1, 2 ] 61977 61.822% 68.171% ############ ( 2, 3 ] 20920 20.868% 89.039% #### ( 3, 4 ] 5334 5.321% 94.359% # ( 4, 6 ] 3963 3.953% 98.312% # ( 6, 10 ] 1279 1.276% 99.588% ( 10, 15 ] 245 0.244% 99.832% ( 15, 22 ] 32 0.032% 99.864% ( 22, 34 ] 5 0.005% 99.869% ( 34, 51 ] 2 0.002% 99.871% ( 76, 110 ] 14 0.014% 99.885% ( 110, 170 ] 36 0.036% 99.921% ( 170, 250 ] 21 0.021% 99.942% ( 250, 380 ] 10 0.010% 99.952% ( 380, 580 ] 9 0.009% 99.961% ( 580, 870 ] 8 0.008% 99.969% ( 870, 1300 ] 2 0.002% 99.971% ( 1300, 1900 ] 3 0.003% 99.974% ( 1900, 2900 ] 10 0.010% 99.984% ( 2900, 4400 ] 7 0.007% 99.991% ( 4400, 6600 ] 9 0.009% 100.000% ( 6600, 9900 ] 5 0.005% 100.005% ** Level 4 read latency histogram (micros): Count: 55 Average: 1508.7455 StdDev: 2193.63 Min: 1 Median: 282.5000 Max: 7591 Percentiles: P50: 282.50 P75: 2441.67 P99: 7591.00 P99.9: 7591.00 P99.99: 7591.00 ------------------------------------------------------ [ 0, 1 ] 4 7.273% 7.273% # ( 1, 2 ] 14 25.455% 32.727% ##### ( 34, 51 ] 1 1.818% 34.545% ( 51, 76 ] 1 1.818% 36.364% ( 110, 170 ] 6 10.909% 47.273% ## ( 170, 250 ] 1 1.818% 49.091% ( 250, 380 ] 2 3.636% 52.727% # ( 380, 580 ] 2 3.636% 56.364% # ( 580, 870 ] 4 7.273% 63.636% # ( 870, 1300 ] 2 3.636% 67.273% # ( 1300, 1900 ] 1 1.818% 69.091% ( 1900, 2900 ] 6 10.909% 80.000% ## ( 2900, 4400 ] 4 7.273% 87.273% # ( 4400, 6600 ] 3 5.455% 92.727% # ( 6600, 9900 ] 4 7.273% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 811.3250 StdDev: 987.20 Min: 97 Median: 250.0000 Max: 3304 Percentiles: P50: 250.00 P75: 1156.67 P99: 3304.00 P99.9: 3304.00 P99.99: 3304.00 ------------------------------------------------------ ( 76, 110 ] 5 12.500% 12.500% ### ( 110, 170 ] 13 32.500% 45.000% ####### ( 170, 250 ] 2 5.000% 50.000% # ( 250, 380 ] 2 5.000% 55.000% # ( 380, 580 ] 4 10.000% 65.000% ## ( 580, 870 ] 2 5.000% 70.000% # ( 870, 1300 ] 3 7.500% 77.500% ## ( 1300, 1900 ] 2 5.000% 82.500% # ( 1900, 2900 ] 4 10.000% 92.500% ## ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 17.3 total, 4.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 284.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.431 H:M:S, 14.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 236.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.145 H:M:S, 27.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 20000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 19378.7 MB (estimated) FileSize: 19378.7 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 3.462 micros/op 288856 ops/sec 20.131 seconds 5814999 operations; 279.9 MB/s Microseconds per write: Count: 5814999 Average: 3.4619 StdDev: 228.68 Min: 0 Median: 1.8151 Max: 218563 Percentiles: P50: 1.82 P75: 3.11 P99: 8.60 P99.9: 125.66 P99.99: 1133.01 ------------------------------------------------------ [ 0, 1 ] 677900 11.658% 11.658% ## ( 1, 2 ] 2735203 47.037% 58.695% ######### ( 2, 3 ] 859570 14.782% 73.477% ### ( 3, 4 ] 783494 13.474% 86.950% ### ( 4, 6 ] 648710 11.156% 98.106% ## ( 6, 10 ] 79812 1.373% 99.479% ( 10, 15 ] 16642 0.286% 99.765% ( 15, 22 ] 4425 0.076% 99.841% ( 22, 34 ] 1765 0.030% 99.871% ( 34, 51 ] 219 0.004% 99.875% ( 51, 76 ] 26 0.000% 99.876% ( 76, 110 ] 8 0.000% 99.876% ( 110, 170 ] 5401 0.093% 99.969% ( 170, 250 ] 384 0.007% 99.975% ( 250, 380 ] 97 0.002% 99.977% ( 380, 580 ] 14 0.000% 99.977% ( 580, 870 ] 8 0.000% 99.977% ( 870, 1300 ] 1209 0.021% 99.998% ( 1300, 1900 ] 2 0.000% 99.998% ( 1900, 2900 ] 99 0.002% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 170000, 250000 ] 7 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 147195 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5814999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 6001078968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 179 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 2999170 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 9193937768 rocksdb.compact.write.bytes COUNT : 9043427132 rocksdb.flush.write.bytes COUNT : 5935496228 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 17 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 96 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5897168896 rocksdb.memtable.garbage.bytes.at.flush COUNT : 11036672 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 9243248170 rocksdb.non.last.level.read.count COUNT : 2228593 rocksdb.block.checksum.compute.count COUNT : 2228252 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.477708 P95 : 4.898099 P99 : 7.182759 P100 : 218561.000000 COUNT : 5814999 SUM : 17442474 rocksdb.compaction.times.micros P50 : 1030000.000000 P95 : 3880000.000000 P99 : 8087526.000000 P100 : 8087526.000000 COUNT : 26 SUM : 34526164 rocksdb.compaction.times.cpu_micros P50 : 1018666.666667 P95 : 3880000.000000 P99 : 7571167.000000 P100 : 7571167.000000 COUNT : 26 SUM : 33068670 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 767.647059 P95 : 1298.612903 P99 : 1593.000000 P100 : 1593.000000 COUNT : 82 SUM : 67459 rocksdb.compaction.outfile.sync.micros P50 : 812.763158 P95 : 1322.500000 P99 : 1784.500000 P100 : 1806.000000 COUNT : 77 SUM : 65945 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 108.425926 P95 : 351.500000 P99 : 446.000000 P100 : 446.000000 COUNT : 117 SUM : 17055 rocksdb.table.open.io.micros P50 : 1537.931034 P95 : 15490.909091 P99 : 20698.181818 P100 : 21102.000000 COUNT : 179 SUM : 539020 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.757794 P95 : 6.989970 P99 : 11.262205 P100 : 6225.000000 COUNT : 2228083 SUM : 10836328 rocksdb.read.block.get.micros P50 : 580.000000 P95 : 4820.000000 P99 : 8239.000000 P100 : 8239.000000 COUNT : 358 SUM : 421589 rocksdb.write.raw.block.micros P50 : 0.512823 P95 : 0.974363 P99 : 3.436839 P100 : 5881.000000 COUNT : 3629002 SUM : 7179510 rocksdb.numfiles.in.singlecompaction P50 : 3.309524 P95 : 10.750000 P99 : 26.000000 P100 : 26.000000 COUNT : 37 SUM : 159 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.563360 P95 : 1127.662397 P99 : 1296.520909 P100 : 218321.000000 COUNT : 11879 SUM : 3000668 rocksdb.sst.read.micros P50 : 1.611483 P95 : 3.763851 P99 : 7.765157 P100 : 8200.000000 COUNT : 2229169 SUM : 6301505 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5814999 SUM : 6001078968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214444.444444 P95 : 329625.000000 P99 : 387218.000000 P100 : 387218.000000 COUNT : 82 SUM : 17259753 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 104 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0