[2024-11-29 12:06:01.202774] Starting SPDK v25.01-pre git sha1 35cd3e84d / DPDK 23.11.0 initialization... [2024-11-29 12:06:01.203064] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid903262 ] Set seed to 1732878361195899 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-29 12:06:01.320802] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-29 12:06:01.343838] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-29 12:06:01.343884] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 903262' to capture a snapshot of events at runtime. [2024-11-29 12:06:01.343896] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-29 12:06:01.343907] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-29 12:06:01.343915] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid903262 for offline analysis/debug. [2024-11-29 12:06:01.344461] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Nov 29 12:06:05 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/29-12:06:08 ... thread 0: (1000000,1000000) ops and (335493.6,335493.6) ops/second in (2.980683,2.980683) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/5 567.00 MB 25.2 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 353.0 2.50 2.26 12 0.208 0 0 0.0 0.0 L1 3/3 251.73 MB 0.0 0.2 0.2 0.1 0.2 0.2 0.1 1.3 251.9 251.7 1.00 0.97 1 1.000 255K 204 0.0 0.0 L2 1/0 48.70 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 237.0 237.0 0.47 0.44 1 0.469 112K 26 0.0 0.0 L3 17/0 818.43 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.6 210.6 0.30 0.24 1 0.297 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/8 97.00 GB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 99.8 306.5 4.27 3.91 15 0.284 432K 230 0.0 0.0 Int 0/0 0.00 KB 0.0 0.4 0.3 0.1 1.3 1.2 0.2 1.5 99.8 306.5 4.27 3.91 15 0.284 432K 230 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.4 0.3 0.1 0.4 0.3 0.0 0.0 241.0 240.9 1.77 1.65 3 0.589 432K 230 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 353.0 2.50 2.26 12 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.28 GB write, 413.28 MB/s write, 0.42 GB read, 134.57 MB/s read, 4.3 seconds Interval compaction: 1.28 GB write, 438.37 MB/s write, 0.42 GB read, 142.74 MB/s read, 4.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 5, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 5, interval: 5 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 104658 Average: 1.8017 StdDev: 19.86 Min: 1 Median: 1.1160 Max: 4121 Percentiles: P50: 1.12 P75: 1.59 P99: 3.27 P99.9: 9.22 P99.99: 369.91 ------------------------------------------------------ [ 0, 1 ] 45867 43.826% 43.826% ######### ( 1, 2 ] 55713 53.233% 97.059% ########### ( 2, 3 ] 1846 1.764% 98.823% ( 3, 4 ] 689 0.658% 99.481% ( 4, 6 ] 312 0.298% 99.779% ( 6, 10 ] 158 0.151% 99.930% ( 10, 15 ] 41 0.039% 99.969% ( 15, 22 ] 5 0.005% 99.974% ( 22, 34 ] 1 0.001% 99.975% ( 34, 51 ] 2 0.002% 99.977% ( 51, 76 ] 1 0.001% 99.978% ( 110, 170 ] 7 0.007% 99.985% ( 170, 250 ] 1 0.001% 99.986% ( 250, 380 ] 6 0.006% 99.991% ( 380, 580 ] 1 0.001% 99.992% ( 580, 870 ] 3 0.003% 99.995% ( 870, 1300 ] 2 0.002% 99.997% ( 1300, 1900 ] 1 0.001% 99.998% ( 1900, 2900 ] 2 0.002% 100.000% ( 2900, 4400 ] 1 0.001% 100.001% ** Level 1 read latency histogram (micros): Count: 31899 Average: 2.1019 StdDev: 20.88 Min: 0 Median: 1.1371 Max: 2839 Percentiles: P50: 1.14 P75: 1.62 P99: 5.21 P99.9: 68.40 P99.99: 986.11 ------------------------------------------------------ [ 0, 1 ] 13664 42.835% 42.835% ######### ( 1, 2 ] 16668 52.252% 95.088% ########## ( 2, 3 ] 897 2.812% 97.900% # ( 3, 4 ] 247 0.774% 98.674% ( 4, 6 ] 172 0.539% 99.213% ( 6, 10 ] 149 0.467% 99.680% ( 10, 15 ] 20 0.063% 99.743% ( 15, 22 ] 9 0.028% 99.771% ( 34, 51 ] 23 0.072% 99.843% ( 51, 76 ] 26 0.082% 99.925% ( 76, 110 ] 5 0.016% 99.940% ( 110, 170 ] 1 0.003% 99.944% ( 170, 250 ] 7 0.022% 99.966% ( 250, 380 ] 5 0.016% 99.981% ( 580, 870 ] 2 0.006% 99.987% ( 870, 1300 ] 3 0.009% 99.997% ( 1900, 2900 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 15878 Average: 1.7083 StdDev: 3.62 Min: 1 Median: 1.0976 Max: 291 Percentiles: P50: 1.10 P75: 1.59 P99: 4.73 P99.9: 11.18 P99.99: 276.79 ------------------------------------------------------ [ 0, 1 ] 7160 45.094% 45.094% ######### ( 1, 2 ] 7983 50.277% 95.371% ########## ( 2, 3 ] 333 2.097% 97.468% ( 3, 4 ] 196 1.234% 98.703% ( 4, 6 ] 130 0.819% 99.521% ( 6, 10 ] 58 0.365% 99.887% ( 10, 15 ] 9 0.057% 99.943% ( 15, 22 ] 4 0.025% 99.969% ( 34, 51 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 924.8235 StdDev: 1340.77 Min: 0 Median: 277.8571 Max: 5283 Percentiles: P50: 277.86 P75: 1525.00 P99: 5283.00 P99.9: 5283.00 P99.99: 5283.00 ------------------------------------------------------ [ 0, 1 ] 32 37.647% 37.647% ######## ( 1, 2 ] 4 4.706% 42.353% # ( 6, 10 ] 1 1.176% 43.529% ( 110, 170 ] 3 3.529% 47.059% # ( 170, 250 ] 1 1.176% 48.235% ( 250, 380 ] 7 8.235% 56.471% ## ( 380, 580 ] 7 8.235% 64.706% ## ( 580, 870 ] 1 1.176% 65.882% ( 870, 1300 ] 4 4.706% 70.588% # ( 1300, 1900 ] 10 11.765% 82.353% ## ( 1900, 2900 ] 5 5.882% 88.235% # ( 2900, 4400 ] 6 7.059% 95.294% # ( 4400, 6600 ] 4 4.706% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1558.5000 StdDev: 1254.02 Min: 144 Median: 1013.3333 Max: 4552 Percentiles: P50: 1013.33 P75: 2483.33 P99: 4552.00 P99.9: 4552.00 P99.99: 4552.00 ------------------------------------------------------ ( 110, 170 ] 2 6.667% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 1 3.333% 13.333% # ( 380, 580 ] 4 13.333% 26.667% ### ( 580, 870 ] 6 20.000% 46.667% #### ( 870, 1300 ] 3 10.000% 56.667% ## ( 1300, 1900 ] 2 6.667% 63.333% # ( 1900, 2900 ] 6 20.000% 83.333% #### ( 2900, 4400 ] 4 13.333% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 311.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.366 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 329.91 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.366 H:M:S, 12.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-12:06:11 ... thread 0: (1000000,2000000) ops and (329129.6,332281.1) ops/second in (3.038317,6.019000) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.23 GB 18.9 0.6 0.0 0.6 2.4 1.8 0.0 1.3 75.7 327.9 7.49 6.89 28 0.268 575K 596 0.0 0.0 L1 6/6 565.45 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 242.8 242.4 3.37 3.28 2 1.686 831K 1428 0.0 0.0 L2 1/0 48.70 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 237.0 237.0 0.47 0.44 1 0.469 112K 26 0.0 0.0 L3 17/0 818.43 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.6 210.6 0.30 0.24 1 0.297 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1195/15 97.98 GB 0.0 1.5 0.6 0.9 3.4 2.5 0.2 1.8 134.1 296.4 11.63 10.85 32 0.363 1583K 2050 0.0 0.0 Int 0/0 0.00 KB 0.0 1.5 0.6 0.9 3.4 2.5 0.2 1.8 134.1 296.4 11.63 10.85 32 0.363 1583K 2050 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.5 0.6 0.9 1.5 0.6 0.0 0.0 249.7 249.4 6.24 6.04 6 1.041 1583K 2050 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.1 5.38 4.82 26 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.37 GB write, 555.83 MB/s write, 1.52 GB read, 251.45 MB/s read, 11.6 seconds Interval compaction: 3.37 GB write, 572.54 MB/s write, 1.52 GB read, 259.01 MB/s read, 11.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 387813 Average: 2.0367 StdDev: 16.15 Min: 1 Median: 1.3781 Max: 4121 Percentiles: P50: 1.38 P75: 1.78 P99: 4.90 P99.9: 9.42 P99.99: 14.95 ------------------------------------------------------ [ 0, 1 ] 101853 26.263% 26.263% ##### ( 1, 2 ] 243467 62.779% 89.043% ############# ( 2, 3 ] 27107 6.990% 96.033% # ( 3, 4 ] 9469 2.442% 98.474% ( 4, 6 ] 4540 1.171% 99.645% ( 6, 10 ] 1157 0.298% 99.943% ( 10, 15 ] 184 0.047% 99.991% ( 15, 22 ] 24 0.006% 99.997% ( 22, 34 ] 12 0.003% 100.000% ( 34, 51 ] 5 0.001% 100.001% ( 51, 76 ] 5 0.001% 100.003% ( 110, 170 ] 12 0.003% 100.006% ( 170, 250 ] 6 0.002% 100.007% ( 250, 380 ] 13 0.003% 100.011% ( 380, 580 ] 5 0.001% 100.012% ( 580, 870 ] 8 0.002% 100.014% ( 870, 1300 ] 2 0.001% 100.014% ( 1300, 1900 ] 2 0.001% 100.015% ( 1900, 2900 ] 3 0.001% 100.016% ( 2900, 4400 ] 5 0.001% 100.017% ** Level 1 read latency histogram (micros): Count: 105784 Average: 2.0937 StdDev: 13.27 Min: 0 Median: 1.3703 Max: 2839 Percentiles: P50: 1.37 P75: 1.77 P99: 5.15 P99.9: 14.83 P99.99: 464.32 ------------------------------------------------------ [ 0, 1 ] 28540 26.980% 26.980% ##### ( 1, 2 ] 65771 62.175% 89.154% ############ ( 2, 3 ] 7414 7.009% 96.163% # ( 3, 4 ] 2323 2.196% 98.359% ( 4, 6 ] 1184 1.119% 99.478% ( 6, 10 ] 397 0.375% 99.853% ( 10, 15 ] 51 0.048% 99.902% ( 15, 22 ] 18 0.017% 99.919% ( 22, 34 ] 3 0.003% 99.922% ( 34, 51 ] 23 0.022% 99.943% ( 51, 76 ] 26 0.025% 99.968% ( 76, 110 ] 5 0.005% 99.973% ( 110, 170 ] 2 0.002% 99.974% ( 170, 250 ] 7 0.007% 99.981% ( 250, 380 ] 9 0.009% 99.990% ( 380, 580 ] 1 0.001% 99.991% ( 580, 870 ] 4 0.004% 99.994% ( 870, 1300 ] 4 0.004% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15878 Average: 1.7083 StdDev: 3.62 Min: 1 Median: 1.0976 Max: 291 Percentiles: P50: 1.10 P75: 1.59 P99: 4.73 P99.9: 11.18 P99.99: 276.79 ------------------------------------------------------ [ 0, 1 ] 7160 45.094% 45.094% ######### ( 1, 2 ] 7983 50.277% 95.371% ########## ( 2, 3 ] 333 2.097% 97.468% ( 3, 4 ] 196 1.234% 98.703% ( 4, 6 ] 130 0.819% 99.521% ( 6, 10 ] 58 0.365% 99.887% ( 10, 15 ] 9 0.057% 99.943% ( 15, 22 ] 4 0.025% 99.969% ( 34, 51 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 924.8235 StdDev: 1340.77 Min: 0 Median: 277.8571 Max: 5283 Percentiles: P50: 277.86 P75: 1525.00 P99: 5283.00 P99.9: 5283.00 P99.99: 5283.00 ------------------------------------------------------ [ 0, 1 ] 32 37.647% 37.647% ######## ( 1, 2 ] 4 4.706% 42.353% # ( 6, 10 ] 1 1.176% 43.529% ( 110, 170 ] 3 3.529% 47.059% # ( 170, 250 ] 1 1.176% 48.235% ( 250, 380 ] 7 8.235% 56.471% ## ( 380, 580 ] 7 8.235% 64.706% ## ( 580, 870 ] 1 1.176% 65.882% ( 870, 1300 ] 4 4.706% 70.588% # ( 1300, 1900 ] 10 11.765% 82.353% ## ( 1900, 2900 ] 5 5.882% 88.235% # ( 2900, 4400 ] 6 7.059% 95.294% # ( 4400, 6600 ] 4 4.706% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1558.5000 StdDev: 1254.02 Min: 144 Median: 1013.3333 Max: 4552 Percentiles: P50: 1013.33 P75: 2483.33 P99: 4552.00 P99.9: 4552.00 P99.99: 4552.00 ------------------------------------------------------ ( 110, 170 ] 2 6.667% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 1 3.333% 13.333% # ( 380, 580 ] 4 13.333% 26.667% ### ( 580, 870 ] 6 20.000% 46.667% #### ( 870, 1300 ] 3 10.000% 56.667% ## ( 1300, 1900 ] 2 6.667% 63.333% # ( 1900, 2900 ] 6 20.000% 83.333% #### ( 2900, 4400 ] 4 13.333% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 317.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.780 H:M:S, 12.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.414 H:M:S, 13.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-12:06:14 ... thread 0: (1000000,3000000) ops and (333725.1,332761.1) ops/second in (2.996478,9.015478) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/9 2.15 GB 113.3 1.4 0.0 1.4 4.1 2.8 0.0 1.5 105.4 320.8 13.15 12.22 44 0.299 1407K 1412 0.0 0.0 L1 6/6 565.45 MB 0.0 0.8 0.5 0.3 0.8 0.5 0.1 1.6 242.8 242.4 3.37 3.28 2 1.686 831K 1428 0.0 0.0 L2 1/0 48.70 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 237.0 237.0 0.47 0.44 1 0.469 112K 26 0.0 0.0 L3 17/0 818.43 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.6 210.6 0.30 0.24 1 0.297 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1199/15 98.90 GB 0.0 2.3 0.6 1.7 5.1 3.4 0.2 1.8 137.6 301.3 17.29 16.18 48 0.360 2414K 2866 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 0.6 1.7 5.1 3.4 0.2 1.8 137.6 301.3 17.29 16.18 48 0.360 2414K 2866 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 0.6 1.7 2.3 0.6 0.0 0.0 257.1 256.8 9.25 8.98 9 1.028 2414K 2866 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 352.6 8.04 7.20 39 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 9.0 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.09 GB write, 566.44 MB/s write, 2.32 GB read, 258.57 MB/s read, 17.3 seconds Interval compaction: 5.09 GB write, 577.81 MB/s write, 2.32 GB read, 263.77 MB/s read, 17.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 706134 Average: 2.0783 StdDev: 13.11 Min: 1 Median: 1.4321 Max: 4121 Percentiles: P50: 1.43 P75: 1.81 P99: 5.03 P99.9: 9.30 P99.99: 14.25 ------------------------------------------------------ [ 0, 1 ] 153801 21.781% 21.781% #### ( 1, 2 ] 461122 65.302% 87.083% ############# ( 2, 3 ] 59491 8.425% 95.508% ## ( 3, 4 ] 19810 2.805% 98.313% # ( 4, 6 ] 9398 1.331% 99.644% ( 6, 10 ] 2188 0.310% 99.954% ( 10, 15 ] 298 0.042% 99.996% ( 15, 22 ] 37 0.005% 100.002% ( 22, 34 ] 15 0.002% 100.004% ( 34, 51 ] 8 0.001% 100.005% ( 51, 76 ] 6 0.001% 100.006% ( 110, 170 ] 16 0.002% 100.008% ( 170, 250 ] 14 0.002% 100.010% ( 250, 380 ] 20 0.003% 100.013% ( 380, 580 ] 9 0.001% 100.014% ( 580, 870 ] 11 0.002% 100.016% ( 870, 1300 ] 5 0.001% 100.016% ( 1300, 1900 ] 3 0.000% 100.017% ( 1900, 2900 ] 5 0.001% 100.017% ( 2900, 4400 ] 5 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 177831 Average: 2.0986 StdDev: 10.25 Min: 0 Median: 1.4340 Max: 2839 Percentiles: P50: 1.43 P75: 1.82 P99: 5.11 P99.9: 11.25 P99.99: 282.02 ------------------------------------------------------ [ 0, 1 ] 38684 21.753% 21.753% #### ( 1, 2 ] 115732 65.080% 86.833% ############# ( 2, 3 ] 15754 8.859% 95.692% ## ( 3, 4 ] 4601 2.587% 98.279% # ( 4, 6 ] 2310 1.299% 99.578% ( 6, 10 ] 548 0.308% 99.886% ( 10, 15 ] 97 0.055% 99.941% ( 15, 22 ] 19 0.011% 99.952% ( 22, 34 ] 3 0.002% 99.953% ( 34, 51 ] 23 0.013% 99.966% ( 51, 76 ] 26 0.015% 99.981% ( 76, 110 ] 5 0.003% 99.984% ( 110, 170 ] 2 0.001% 99.985% ( 170, 250 ] 7 0.004% 99.989% ( 250, 380 ] 9 0.005% 99.994% ( 380, 580 ] 1 0.001% 99.994% ( 580, 870 ] 4 0.002% 99.997% ( 870, 1300 ] 4 0.002% 99.999% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15878 Average: 1.7083 StdDev: 3.62 Min: 1 Median: 1.0976 Max: 291 Percentiles: P50: 1.10 P75: 1.59 P99: 4.73 P99.9: 11.18 P99.99: 276.79 ------------------------------------------------------ [ 0, 1 ] 7160 45.094% 45.094% ######### ( 1, 2 ] 7983 50.277% 95.371% ########## ( 2, 3 ] 333 2.097% 97.468% ( 3, 4 ] 196 1.234% 98.703% ( 4, 6 ] 130 0.819% 99.521% ( 6, 10 ] 58 0.365% 99.887% ( 10, 15 ] 9 0.057% 99.943% ( 15, 22 ] 4 0.025% 99.969% ( 34, 51 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 924.8235 StdDev: 1340.77 Min: 0 Median: 277.8571 Max: 5283 Percentiles: P50: 277.86 P75: 1525.00 P99: 5283.00 P99.9: 5283.00 P99.99: 5283.00 ------------------------------------------------------ [ 0, 1 ] 32 37.647% 37.647% ######## ( 1, 2 ] 4 4.706% 42.353% # ( 6, 10 ] 1 1.176% 43.529% ( 110, 170 ] 3 3.529% 47.059% # ( 170, 250 ] 1 1.176% 48.235% ( 250, 380 ] 7 8.235% 56.471% ## ( 380, 580 ] 7 8.235% 64.706% ## ( 580, 870 ] 1 1.176% 65.882% ( 870, 1300 ] 4 4.706% 70.588% # ( 1300, 1900 ] 10 11.765% 82.353% ## ( 1900, 2900 ] 5 5.882% 88.235% # ( 2900, 4400 ] 6 7.059% 95.294% # ( 4400, 6600 ] 4 4.706% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1558.5000 StdDev: 1254.02 Min: 144 Median: 1013.3333 Max: 4552 Percentiles: P50: 1013.33 P75: 2483.33 P99: 4552.00 P99.9: 4552.00 P99.99: 4552.00 ------------------------------------------------------ ( 110, 170 ] 2 6.667% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 1 3.333% 13.333% # ( 380, 580 ] 4 13.333% 26.667% ### ( 580, 870 ] 6 20.000% 46.667% #### ( 870, 1300 ] 3 10.000% 56.667% ## ( 1300, 1900 ] 2 6.667% 63.333% # ( 1900, 2900 ] 6 20.000% 83.333% #### ( 2900, 4400 ] 4 13.333% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 320.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.141 H:M:S, 12.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.46 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.361 H:M:S, 12.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-12:06:17 ... thread 0: (1000000,4000000) ops and (328309.6,331636.9) ops/second in (3.045905,12.061383) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.34 GB 214.0 2.2 0.0 2.2 5.9 3.8 0.0 1.6 115.7 317.3 19.06 17.77 61 0.312 2238K 2290 0.0 0.0 L1 12/0 1.34 GB 137.6 2.2 1.3 0.9 2.1 1.3 0.1 1.7 235.3 234.3 9.36 9.08 3 3.120 2236K 8707 0.0 0.0 L2 1/0 48.70 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 237.0 237.0 0.47 0.44 1 0.469 112K 26 0.0 0.0 L3 17/0 818.43 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.6 210.6 0.30 0.24 1 0.297 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1205/4 99.88 GB 0.0 4.5 1.4 3.1 8.2 5.2 0.2 2.2 157.0 288.3 29.18 27.54 66 0.442 4651K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 4.5 1.4 3.1 8.2 5.2 0.2 2.2 157.0 288.3 29.18 27.54 66 0.442 4651K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.5 1.4 3.1 4.5 1.4 0.0 0.0 250.4 249.8 18.29 17.79 13 1.407 4651K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 352.9 10.89 9.75 53 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.2 total, 12.1 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.22 GB write, 687.07 MB/s write, 4.47 GB read, 374.15 MB/s read, 29.2 seconds Interval compaction: 8.22 GB write, 697.38 MB/s write, 4.47 GB read, 379.77 MB/s read, 29.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 986266 Average: 2.0899 StdDev: 12.96 Min: 1 Median: 1.4267 Max: 4121 Percentiles: P50: 1.43 P75: 1.81 P99: 5.06 P99.9: 9.62 P99.99: 21.93 ------------------------------------------------------ [ 0, 1 ] 218329 22.137% 22.137% #### ( 1, 2 ] 644096 65.307% 87.443% ############# ( 2, 3 ] 80597 8.172% 95.615% ## ( 3, 4 ] 26599 2.697% 98.312% # ( 4, 6 ] 12750 1.293% 99.605% ( 6, 10 ] 3213 0.326% 99.931% ( 10, 15 ] 525 0.053% 99.984% ( 15, 22 ] 60 0.006% 99.990% ( 22, 34 ] 18 0.002% 99.992% ( 34, 51 ] 10 0.001% 99.993% ( 51, 76 ] 9 0.001% 99.994% ( 76, 110 ] 42 0.004% 99.998% ( 110, 170 ] 43 0.004% 100.003% ( 170, 250 ] 36 0.004% 100.006% ( 250, 380 ] 31 0.003% 100.009% ( 380, 580 ] 24 0.002% 100.012% ( 580, 870 ] 18 0.002% 100.014% ( 870, 1300 ] 10 0.001% 100.015% ( 1300, 1900 ] 5 0.001% 100.015% ( 1900, 2900 ] 6 0.001% 100.016% ( 2900, 4400 ] 7 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 219831 Average: 2.2573 StdDev: 14.74 Min: 0 Median: 1.4452 Max: 2839 Percentiles: P50: 1.45 P75: 1.83 P99: 5.20 P99.9: 18.39 P99.99: 570.64 ------------------------------------------------------ [ 0, 1 ] 45562 20.726% 20.726% #### ( 1, 2 ] 144562 65.761% 86.486% ############# ( 2, 3 ] 20051 9.121% 95.608% ## ( 3, 4 ] 5752 2.617% 98.224% # ( 4, 6 ] 2840 1.292% 99.516% ( 6, 10 ] 713 0.324% 99.840% ( 10, 15 ] 121 0.055% 99.895% ( 15, 22 ] 21 0.010% 99.905% ( 22, 34 ] 3 0.001% 99.906% ( 34, 51 ] 24 0.011% 99.917% ( 51, 76 ] 26 0.012% 99.929% ( 76, 110 ] 38 0.017% 99.946% ( 110, 170 ] 42 0.019% 99.965% ( 170, 250 ] 20 0.009% 99.975% ( 250, 380 ] 14 0.006% 99.981% ( 380, 580 ] 21 0.010% 99.990% ( 580, 870 ] 6 0.003% 99.993% ( 870, 1300 ] 7 0.003% 99.996% ( 1300, 1900 ] 6 0.003% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15878 Average: 1.7083 StdDev: 3.62 Min: 1 Median: 1.0976 Max: 291 Percentiles: P50: 1.10 P75: 1.59 P99: 4.73 P99.9: 11.18 P99.99: 276.79 ------------------------------------------------------ [ 0, 1 ] 7160 45.094% 45.094% ######### ( 1, 2 ] 7983 50.277% 95.371% ########## ( 2, 3 ] 333 2.097% 97.468% ( 3, 4 ] 196 1.234% 98.703% ( 4, 6 ] 130 0.819% 99.521% ( 6, 10 ] 58 0.365% 99.887% ( 10, 15 ] 9 0.057% 99.943% ( 15, 22 ] 4 0.025% 99.969% ( 34, 51 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 924.8235 StdDev: 1340.77 Min: 0 Median: 277.8571 Max: 5283 Percentiles: P50: 277.86 P75: 1525.00 P99: 5283.00 P99.9: 5283.00 P99.99: 5283.00 ------------------------------------------------------ [ 0, 1 ] 32 37.647% 37.647% ######## ( 1, 2 ] 4 4.706% 42.353% # ( 6, 10 ] 1 1.176% 43.529% ( 110, 170 ] 3 3.529% 47.059% # ( 170, 250 ] 1 1.176% 48.235% ( 250, 380 ] 7 8.235% 56.471% ## ( 380, 580 ] 7 8.235% 64.706% ## ( 580, 870 ] 1 1.176% 65.882% ( 870, 1300 ] 4 4.706% 70.588% # ( 1300, 1900 ] 10 11.765% 82.353% ## ( 1900, 2900 ] 5 5.882% 88.235% # ( 2900, 4400 ] 6 7.059% 95.294% # ( 4400, 6600 ] 4 4.706% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1558.5000 StdDev: 1254.02 Min: 144 Median: 1013.3333 Max: 4552 Percentiles: P50: 1013.33 P75: 2483.33 P99: 4552.00 P99.9: 4552.00 P99.99: 4552.00 ------------------------------------------------------ ( 110, 170 ] 2 6.667% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 1 3.333% 13.333% # ( 380, 580 ] 4 13.333% 26.667% ### ( 580, 870 ] 6 20.000% 46.667% #### ( 870, 1300 ] 3 10.000% 56.667% ## ( 1300, 1900 ] 2 6.667% 63.333% # ( 1900, 2900 ] 6 20.000% 83.333% #### ( 2900, 4400 ] 4 13.333% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 12.2 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 321.52 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.522 H:M:S, 12.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.381 H:M:S, 12.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-12:06:21 ... thread 0: (1000000,5000000) ops and (284669.5,321043.2) ops/second in (3.512845,15.574228) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 3.32 GB 100.7 3.2 0.0 3.2 7.9 4.7 0.0 1.7 126.6 314.0 25.87 24.21 80 0.323 3326K 3400 0.0 0.0 L1 12/12 1.34 GB 0.0 2.2 1.3 0.9 2.1 1.3 0.1 1.7 235.3 234.3 9.36 9.08 3 3.120 2236K 8707 0.0 0.0 L2 1/0 48.70 MB 0.5 0.1 0.1 0.0 0.1 0.1 0.0 1.8 237.0 237.0 0.47 0.44 1 0.469 112K 26 0.0 0.0 L3 17/0 818.43 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.6 210.6 0.30 0.24 1 0.297 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1208/24 100.86 GB 0.0 5.5 1.4 4.1 10.2 6.1 0.2 2.2 157.0 291.5 35.99 33.98 85 0.423 5739K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 1.4 4.1 10.2 6.1 0.2 2.2 157.0 291.5 35.99 33.98 85 0.423 5739K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 1.4 4.1 5.5 1.4 0.0 0.0 253.8 253.2 22.27 21.70 17 1.310 5739K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.5 13.72 12.28 68 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.8 total, 15.6 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.24 GB write, 665.75 MB/s write, 5.52 GB read, 358.71 MB/s read, 36.0 seconds Interval compaction: 10.24 GB write, 673.49 MB/s write, 5.52 GB read, 362.88 MB/s read, 36.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 16, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1324207 Average: 2.1241 StdDev: 12.05 Min: 1 Median: 1.4410 Max: 4121 Percentiles: P50: 1.44 P75: 1.82 P99: 5.21 P99.9: 9.75 P99.99: 80.86 ------------------------------------------------------ [ 0, 1 ] 276719 20.897% 20.897% #### ( 1, 2 ] 873905 65.995% 86.892% ############# ( 2, 3 ] 111717 8.437% 95.328% ## ( 3, 4 ] 37362 2.821% 98.150% # ( 4, 6 ] 18647 1.408% 99.558% ( 6, 10 ] 4840 0.366% 99.923% ( 10, 15 ] 724 0.055% 99.978% ( 15, 22 ] 87 0.007% 99.984% ( 22, 34 ] 30 0.002% 99.987% ( 34, 51 ] 13 0.001% 99.988% ( 51, 76 ] 13 0.001% 99.989% ( 76, 110 ] 123 0.009% 99.998% ( 110, 170 ] 100 0.008% 100.006% ( 170, 250 ] 73 0.006% 100.011% ( 250, 380 ] 52 0.004% 100.015% ( 380, 580 ] 35 0.003% 100.018% ( 580, 870 ] 28 0.002% 100.020% ( 870, 1300 ] 14 0.001% 100.021% ( 1300, 1900 ] 7 0.001% 100.021% ( 1900, 2900 ] 7 0.001% 100.022% ( 2900, 4400 ] 7 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 291890 Average: 2.3123 StdDev: 13.44 Min: 0 Median: 1.4574 Max: 2839 Percentiles: P50: 1.46 P75: 1.84 P99: 5.70 P99.9: 85.57 P99.99: 532.39 ------------------------------------------------------ [ 0, 1 ] 57545 19.715% 19.715% #### ( 1, 2 ] 193258 66.209% 85.924% ############# ( 2, 3 ] 26764 9.169% 95.093% ## ( 3, 4 ] 7852 2.690% 97.783% # ( 4, 6 ] 4171 1.429% 99.212% ( 6, 10 ] 1658 0.568% 99.780% ( 10, 15 ] 207 0.071% 99.851% ( 15, 22 ] 31 0.011% 99.862% ( 22, 34 ] 5 0.002% 99.863% ( 34, 51 ] 24 0.008% 99.872% ( 51, 76 ] 44 0.015% 99.887% ( 76, 110 ] 139 0.048% 99.934% ( 110, 170 ] 88 0.030% 99.964% ( 170, 250 ] 30 0.010% 99.975% ( 250, 380 ] 25 0.009% 99.983% ( 380, 580 ] 26 0.009% 99.992% ( 580, 870 ] 8 0.003% 99.995% ( 870, 1300 ] 7 0.002% 99.997% ( 1300, 1900 ] 6 0.002% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15878 Average: 1.7083 StdDev: 3.62 Min: 1 Median: 1.0976 Max: 291 Percentiles: P50: 1.10 P75: 1.59 P99: 4.73 P99.9: 11.18 P99.99: 276.79 ------------------------------------------------------ [ 0, 1 ] 7160 45.094% 45.094% ######### ( 1, 2 ] 7983 50.277% 95.371% ########## ( 2, 3 ] 333 2.097% 97.468% ( 3, 4 ] 196 1.234% 98.703% ( 4, 6 ] 130 0.819% 99.521% ( 6, 10 ] 58 0.365% 99.887% ( 10, 15 ] 9 0.057% 99.943% ( 15, 22 ] 4 0.025% 99.969% ( 34, 51 ] 1 0.006% 99.975% ( 110, 170 ] 1 0.006% 99.981% ( 170, 250 ] 1 0.006% 99.987% ( 250, 380 ] 2 0.013% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 924.8235 StdDev: 1340.77 Min: 0 Median: 277.8571 Max: 5283 Percentiles: P50: 277.86 P75: 1525.00 P99: 5283.00 P99.9: 5283.00 P99.99: 5283.00 ------------------------------------------------------ [ 0, 1 ] 32 37.647% 37.647% ######## ( 1, 2 ] 4 4.706% 42.353% # ( 6, 10 ] 1 1.176% 43.529% ( 110, 170 ] 3 3.529% 47.059% # ( 170, 250 ] 1 1.176% 48.235% ( 250, 380 ] 7 8.235% 56.471% ## ( 380, 580 ] 7 8.235% 64.706% ## ( 580, 870 ] 1 1.176% 65.882% ( 870, 1300 ] 4 4.706% 70.588% # ( 1300, 1900 ] 10 11.765% 82.353% ## ( 1900, 2900 ] 5 5.882% 88.235% # ( 2900, 4400 ] 6 7.059% 95.294% # ( 4400, 6600 ] 4 4.706% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1558.5000 StdDev: 1254.02 Min: 144 Median: 1013.3333 Max: 4552 Percentiles: P50: 1013.33 P75: 2483.33 P99: 4552.00 P99.9: 4552.00 P99.99: 4552.00 ------------------------------------------------------ ( 110, 170 ] 2 6.667% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 1 3.333% 13.333% # ( 380, 580 ] 4 13.333% 26.667% ### ( 580, 870 ] 6 20.000% 46.667% #### ( 870, 1300 ] 3 10.000% 56.667% ## ( 1300, 1900 ] 2 6.667% 63.333% # ( 1900, 2900 ] 6 20.000% 83.333% #### ( 2900, 4400 ] 4 13.333% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 15.8 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 312.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.344 H:M:S, 14.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 280.17 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.822 H:M:S, 23.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/29-12:06:35 ... thread 0: (1000000,6000000) ops and (71991.9,203633.6) ops/second in (13.890454,29.464682) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/5 1.90 GB 6.3 5.0 0.0 5.0 10.6 5.7 0.0 1.9 144.4 308.3 35.33 33.27 100 0.353 5180K 6916 0.0 0.0 L1 14/14 1.61 GB 0.0 5.8 3.6 2.2 5.8 3.6 0.1 1.6 227.1 224.5 26.29 24.94 4 6.571 6063K 68K 0.0 0.0 L2 17/5 2.06 GB 15.5 0.1 0.1 0.0 0.1 0.1 2.1 1.8 237.0 237.0 0.47 0.44 1 0.469 112K 26 0.0 0.0 L3 17/10 818.43 MB 0.0 0.1 0.1 0.0 0.1 0.1 0.0 1.0 210.6 210.6 0.30 0.24 1 0.297 63K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1214/34 101.72 GB 0.0 11.0 3.7 7.2 16.6 9.3 2.2 2.9 180.3 272.0 62.38 58.90 106 0.588 11M 75K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.0 3.7 7.2 16.6 9.3 2.2 2.9 180.3 272.0 62.38 58.90 106 0.588 11M 75K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.0 3.7 7.2 10.9 3.7 0.0 0.0 245.2 243.6 45.86 44.15 23 1.994 11M 75K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 350.9 16.52 14.74 83 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.6 total, 29.5 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.57 GB write, 572.26 MB/s write, 10.98 GB read, 379.34 MB/s read, 62.4 seconds Interval compaction: 16.57 GB write, 575.78 MB/s write, 10.98 GB read, 381.67 MB/s read, 62.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 4, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 16, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2278679 Average: 2.3784 StdDev: 14.45 Min: 1 Median: 1.4295 Max: 4121 Percentiles: P50: 1.43 P75: 1.81 P99: 5.52 P99.9: 111.72 P99.99: 267.11 ------------------------------------------------------ [ 0, 1 ] 493794 21.670% 21.670% #### ( 1, 2 ] 1502942 65.957% 87.627% ############# ( 2, 3 ] 174231 7.646% 95.273% ## ( 3, 4 ] 60761 2.667% 97.940% # ( 4, 6 ] 31795 1.395% 99.335% ( 6, 10 ] 9082 0.399% 99.733% ( 10, 15 ] 1303 0.057% 99.791% ( 15, 22 ] 238 0.010% 99.801% ( 22, 34 ] 36 0.002% 99.803% ( 34, 51 ] 17 0.001% 99.803% ( 51, 76 ] 44 0.002% 99.805% ( 76, 110 ] 2108 0.093% 99.898% ( 110, 170 ] 1716 0.075% 99.973% ( 170, 250 ] 344 0.015% 99.988% ( 250, 380 ] 305 0.013% 100.002% ( 380, 580 ] 238 0.010% 100.012% ( 580, 870 ] 93 0.004% 100.016% ( 870, 1300 ] 35 0.002% 100.018% ( 1300, 1900 ] 20 0.001% 100.019% ( 1900, 2900 ] 14 0.001% 100.019% ( 2900, 4400 ] 10 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 583287 Average: 2.5184 StdDev: 16.06 Min: 0 Median: 1.4229 Max: 2839 Percentiles: P50: 1.42 P75: 1.81 P99: 6.34 P99.9: 138.48 P99.99: 721.82 ------------------------------------------------------ [ 0, 1 ] 132035 22.636% 22.636% ##### ( 1, 2 ] 377434 64.708% 87.344% ############# ( 2, 3 ] 44424 7.616% 94.961% ## ( 3, 4 ] 13860 2.376% 97.337% ( 4, 6 ] 9373 1.607% 98.944% ( 6, 10 ] 3921 0.672% 99.616% ( 10, 15 ] 410 0.070% 99.686% ( 15, 22 ] 90 0.015% 99.702% ( 22, 34 ] 7 0.001% 99.703% ( 34, 51 ] 25 0.004% 99.707% ( 51, 76 ] 136 0.023% 99.730% ( 76, 110 ] 760 0.130% 99.861% ( 110, 170 ] 484 0.083% 99.944% ( 170, 250 ] 83 0.014% 99.958% ( 250, 380 ] 78 0.013% 99.971% ( 380, 580 ] 95 0.016% 99.988% ( 580, 870 ] 30 0.005% 99.993% ( 870, 1300 ] 24 0.004% 99.997% ( 1300, 1900 ] 16 0.003% 100.000% ( 1900, 2900 ] 3 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 15888 Average: 2.0563 StdDev: 20.81 Min: 1 Median: 1.0982 Max: 2143 Percentiles: P50: 1.10 P75: 1.60 P99: 4.88 P99.9: 20.45 P99.99: 1046.82 ------------------------------------------------------ [ 0, 1 ] 7160 45.065% 45.065% ######### ( 1, 2 ] 7983 50.245% 95.311% ########## ( 2, 3 ] 333 2.096% 97.407% ( 3, 4 ] 196 1.234% 98.640% ( 4, 6 ] 130 0.818% 99.459% ( 6, 10 ] 58 0.365% 99.824% ( 10, 15 ] 9 0.057% 99.880% ( 15, 22 ] 4 0.025% 99.906% ( 34, 51 ] 1 0.006% 99.912% ( 76, 110 ] 3 0.019% 99.931% ( 110, 170 ] 2 0.013% 99.943% ( 170, 250 ] 1 0.006% 99.950% ( 250, 380 ] 3 0.019% 99.969% ( 380, 580 ] 2 0.013% 99.981% ( 580, 870 ] 1 0.006% 99.987% ( 870, 1300 ] 1 0.006% 99.994% ( 1900, 2900 ] 1 0.006% 100.000% ** Level 3 read latency histogram (micros): Count: 16672 Average: 10.2322 StdDev: 124.46 Min: 0 Median: 1.6002 Max: 5283 Percentiles: P50: 1.60 P75: 2.00 P99: 117.03 P99.9: 1868.98 P99.99: 5283.00 ------------------------------------------------------ [ 0, 1 ] 2022 12.128% 12.128% ## ( 1, 2 ] 10519 63.094% 75.222% ############# ( 2, 3 ] 2028 12.164% 87.386% ## ( 3, 4 ] 876 5.254% 92.640% # ( 4, 6 ] 689 4.133% 96.773% # ( 6, 10 ] 298 1.787% 98.560% ( 10, 15 ] 44 0.264% 98.824% ( 15, 22 ] 15 0.090% 98.914% ( 76, 110 ] 11 0.066% 98.980% ( 110, 170 ] 28 0.168% 99.148% ( 170, 250 ] 23 0.138% 99.286% ( 250, 380 ] 30 0.180% 99.466% ( 380, 580 ] 34 0.204% 99.670% ( 580, 870 ] 15 0.090% 99.760% ( 870, 1300 ] 11 0.066% 99.826% ( 1300, 1900 ] 13 0.078% 99.904% ( 1900, 2900 ] 6 0.036% 99.940% ( 2900, 4400 ] 6 0.036% 99.976% ( 4400, 6600 ] 4 0.024% 100.000% ** Level 4 read latency histogram (micros): Count: 30 Average: 1558.5000 StdDev: 1254.02 Min: 144 Median: 1013.3333 Max: 4552 Percentiles: P50: 1013.33 P75: 2483.33 P99: 4552.00 P99.9: 4552.00 P99.99: 4552.00 ------------------------------------------------------ ( 110, 170 ] 2 6.667% 6.667% # ( 170, 250 ] 1 3.333% 10.000% # ( 250, 380 ] 1 3.333% 13.333% # ( 380, 580 ] 4 13.333% 26.667% ### ( 580, 870 ] 6 20.000% 46.667% #### ( 870, 1300 ] 3 10.000% 56.667% ## ( 1300, 1900 ] 2 6.667% 63.333% # ( 1900, 2900 ] 6 20.000% 83.333% #### ( 2900, 4400 ] 4 13.333% 96.667% ### ( 4400, 6600 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 29.6 total, 13.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 199.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.968 H:M:S, 43.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 70.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:10.624 H:M:S, 76.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/29-12:06:41 ... thread 0: (1000000,7000000) ops and (156598.3,195255.6) ops/second in (6.385765,35.850447) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 2.82 GB 75.5 5.5 0.0 5.5 12.1 6.6 0.0 1.8 139.4 304.9 40.68 37.94 115 0.354 5756K 7553 0.0 0.0 L1 14/14 1.61 GB 0.0 5.8 3.6 2.2 5.8 3.6 0.1 1.6 227.1 224.5 26.29 24.94 4 6.571 6063K 68K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.1 1.8 237.0 237.0 0.47 0.44 1 0.469 112K 26 0.0 0.0 L3 22/0 940.94 MB 0.9 3.0 2.0 1.0 3.0 2.0 0.1 1.5 192.7 192.6 16.05 13.47 14 1.147 3131K 1082 0.0 0.0 L4 160/0 9.51 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.8 1.0 209.2 209.2 0.56 0.53 2 0.282 119K 0 0.0 0.0 L5 1068/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/23 102.64 GB 0.0 14.6 5.8 8.8 21.1 12.3 6.1 3.2 178.0 257.3 84.05 77.32 136 0.618 15M 77K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.6 5.8 8.8 21.1 12.3 6.1 3.2 178.0 257.3 84.05 77.32 136 0.618 15M 77K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.6 5.8 8.8 14.5 5.7 0.0 0.0 232.3 231.1 64.40 60.08 40 1.610 15M 77K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 343.1 19.65 17.24 96 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 36.0 total, 35.9 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.12 GB write, 600.14 MB/s write, 14.61 GB read, 415.24 MB/s read, 84.0 seconds Interval compaction: 21.12 GB write, 603.17 MB/s write, 14.61 GB read, 417.33 MB/s read, 84.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 33, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 33, interval: 54 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2759006 Average: 2.4512 StdDev: 16.61 Min: 1 Median: 1.4687 Max: 5970 Percentiles: P50: 1.47 P75: 1.85 P99: 5.80 P99.9: 104.04 P99.99: 258.02 ------------------------------------------------------ [ 0, 1 ] 529707 19.199% 19.199% #### ( 1, 2 ] 1813142 65.717% 84.916% ############# ( 2, 3 ] 248538 9.008% 93.925% ## ( 3, 4 ] 90435 3.278% 97.202% # ( 4, 6 ] 55050 1.995% 99.198% ( 6, 10 ] 15132 0.548% 99.746% ( 10, 15 ] 2083 0.075% 99.822% ( 15, 22 ] 318 0.012% 99.833% ( 22, 34 ] 37 0.001% 99.835% ( 34, 51 ] 18 0.001% 99.835% ( 51, 76 ] 49 0.002% 99.837% ( 76, 110 ] 2110 0.076% 99.913% ( 110, 170 ] 1721 0.062% 99.976% ( 170, 250 ] 371 0.013% 99.989% ( 250, 380 ] 342 0.012% 100.002% ( 380, 580 ] 280 0.010% 100.012% ( 580, 870 ] 135 0.005% 100.017% ( 870, 1300 ] 53 0.002% 100.019% ( 1300, 1900 ] 28 0.001% 100.020% ( 1900, 2900 ] 31 0.001% 100.021% ( 2900, 4400 ] 14 0.001% 100.021% ( 4400, 6600 ] 2 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1115693 Average: 3.3167 StdDev: 29.40 Min: 0 Median: 1.6092 Max: 4607 Percentiles: P50: 1.61 P75: 2.09 P99: 8.53 P99.9: 112.29 P99.99: 235.79 ------------------------------------------------------ [ 0, 1 ] 144875 12.985% 12.985% ### ( 1, 2 ] 677862 60.757% 73.742% ############ ( 2, 3 ] 155257 13.916% 87.658% ### ( 3, 4 ] 62429 5.596% 93.254% # ( 4, 6 ] 53258 4.774% 98.027% # ( 6, 10 ] 17159 1.538% 99.565% ( 10, 15 ] 2289 0.205% 99.770% ( 15, 22 ] 335 0.030% 99.800% ( 22, 34 ] 26 0.002% 99.803% ( 34, 51 ] 28 0.003% 99.805% ( 51, 76 ] 139 0.012% 99.818% ( 76, 110 ] 891 0.080% 99.897% ( 110, 170 ] 767 0.069% 99.966% ( 170, 250 ] 324 0.029% 99.995% ( 250, 380 ] 330 0.030% 100.025% ( 380, 580 ] 316 0.028% 100.053% ( 580, 870 ] 227 0.020% 100.073% ( 870, 1300 ] 116 0.010% 100.084% ( 1300, 1900 ] 61 0.005% 100.089% ( 1900, 2900 ] 45 0.004% 100.093% ( 2900, 4400 ] 13 0.001% 100.094% ( 4400, 6600 ] 1 0.000% 100.095% ** Level 2 read latency histogram (micros): Count: 28247 Average: 4.0207 StdDev: 38.81 Min: 1 Median: 1.4691 Max: 2810 Percentiles: P50: 1.47 P75: 1.97 P99: 9.17 P99.9: 606.76 P99.99: 1958.43 ------------------------------------------------------ [ 0, 1 ] 7494 26.530% 26.530% ##### ( 1, 2 ] 14133 50.034% 76.564% ########## ( 2, 3 ] 2721 9.633% 86.197% ## ( 3, 4 ] 1707 6.043% 92.240% # ( 4, 6 ] 1544 5.466% 97.706% # ( 6, 10 ] 461 1.632% 99.338% ( 10, 15 ] 67 0.237% 99.575% ( 15, 22 ] 14 0.050% 99.625% ( 34, 51 ] 1 0.004% 99.628% ( 76, 110 ] 4 0.014% 99.642% ( 110, 170 ] 12 0.042% 99.685% ( 170, 250 ] 17 0.060% 99.745% ( 250, 380 ] 28 0.099% 99.844% ( 380, 580 ] 14 0.050% 99.894% ( 580, 870 ] 19 0.067% 99.961% ( 870, 1300 ] 7 0.025% 99.986% ( 1300, 1900 ] 1 0.004% 99.989% ( 1900, 2900 ] 3 0.011% 100.000% ** Level 3 read latency histogram (micros): Count: 297154 Average: 3.6984 StdDev: 37.57 Min: 0 Median: 1.6924 Max: 5283 Percentiles: P50: 1.69 P75: 2.35 P99: 8.68 P99.9: 235.90 P99.99: 679.87 ------------------------------------------------------ [ 0, 1 ] 20355 6.850% 6.850% # ( 1, 2 ] 185175 62.316% 69.166% ############ ( 2, 3 ] 49049 16.506% 85.672% ### ( 3, 4 ] 20434 6.877% 92.549% # ( 4, 6 ] 15963 5.372% 97.921% # ( 6, 10 ] 4778 1.608% 99.529% ( 10, 15 ] 511 0.172% 99.701% ( 15, 22 ] 75 0.025% 99.726% ( 22, 34 ] 5 0.002% 99.728% ( 34, 51 ] 1 0.000% 99.728% ( 51, 76 ] 5 0.002% 99.730% ( 76, 110 ] 116 0.039% 99.769% ( 110, 170 ] 291 0.098% 99.867% ( 170, 250 ] 120 0.040% 99.907% ( 250, 380 ] 118 0.040% 99.947% ( 380, 580 ] 109 0.037% 99.984% ( 580, 870 ] 56 0.019% 100.002% ( 870, 1300 ] 45 0.015% 100.017% ( 1300, 1900 ] 24 0.008% 100.026% ( 1900, 2900 ] 8 0.003% 100.028% ( 2900, 4400 ] 7 0.002% 100.031% ( 4400, 6600 ] 5 0.002% 100.032% ** Level 4 read latency histogram (micros): Count: 50 Average: 961.6400 StdDev: 1219.75 Min: 1 Median: 480.0000 Max: 4552 Percentiles: P50: 480.00 P75: 1450.00 P99: 4552.00 P99.9: 4552.00 P99.99: 4552.00 ------------------------------------------------------ [ 0, 1 ] 4 8.000% 8.000% ## ( 1, 2 ] 7 14.000% 22.000% ### ( 2, 3 ] 3 6.000% 28.000% # ( 4, 6 ] 2 4.000% 32.000% # ( 110, 170 ] 4 8.000% 40.000% ## ( 170, 250 ] 1 2.000% 42.000% ( 250, 380 ] 2 4.000% 46.000% # ( 380, 580 ] 4 8.000% 54.000% ## ( 580, 870 ] 7 14.000% 68.000% ### ( 870, 1300 ] 3 6.000% 74.000% # ( 1300, 1900 ] 2 4.000% 78.000% # ( 1900, 2900 ] 6 12.000% 90.000% ## ( 2900, 4400 ] 4 8.000% 98.000% ## ( 4400, 6600 ] 1 2.000% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 1262.3417 StdDev: 1345.18 Min: 77 Median: 743.1250 Max: 6651 Percentiles: P50: 743.12 P75: 1814.29 P99: 6512.00 P99.9: 6651.00 P99.99: 6651.00 ------------------------------------------------------ ( 76, 110 ] 8 6.667% 6.667% # ( 110, 170 ] 17 14.167% 20.833% ### ( 170, 250 ] 4 3.333% 24.167% # ( 250, 380 ] 13 10.833% 35.000% ## ( 380, 580 ] 9 7.500% 42.500% ## ( 580, 870 ] 16 13.333% 55.833% ### ( 870, 1300 ] 11 9.167% 65.000% ## ( 1300, 1900 ] 14 11.667% 76.667% ## ( 1900, 2900 ] 11 9.167% 85.833% ## ( 2900, 4400 ] 11 9.167% 95.000% ## ( 4400, 6600 ] 5 4.167% 99.167% # ( 6600, 9900 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 36.0 total, 6.4 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 191.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.527 H:M:S, 45.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 154.12 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.559 H:M:S, 55.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-12:06:44 ... thread 0: (1000000,8000000) ops and (328216.0,205670.2) ops/second in (3.046774,38.897221) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/9 3.81 GB 169.9 6.3 0.0 6.3 13.8 7.6 0.0 1.8 138.3 304.9 46.46 43.36 132 0.352 6523K 8278 0.0 0.0 L1 14/14 1.61 GB 0.0 5.8 3.6 2.2 5.8 3.6 0.1 1.6 227.1 224.5 26.29 24.94 4 6.571 6063K 68K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.0 0.1 0.1 2.1 1.8 237.0 237.0 0.47 0.44 1 0.469 112K 26 0.0 0.0 L3 22/0 940.94 MB 0.9 3.0 2.0 1.0 3.0 2.0 0.1 1.5 192.7 192.6 16.05 13.47 14 1.147 3131K 1082 0.0 0.0 L4 160/0 9.51 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.8 1.0 209.2 209.2 0.56 0.53 2 0.282 119K 0 0.0 0.0 L5 1068/0 87.78 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/23 103.63 GB 0.0 15.3 5.8 9.6 22.8 13.3 6.1 3.0 175.0 260.4 89.83 82.74 153 0.587 15M 77K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.3 5.8 9.6 22.8 13.3 6.1 3.0 175.0 260.4 89.83 82.74 153 0.587 15M 77K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.3 5.8 9.6 15.3 5.7 0.0 0.0 233.7 232.5 67.27 62.89 43 1.564 15M 77K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 343.5 22.56 19.85 110 0.205 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.1 total, 38.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.84 GB write, 598.47 MB/s write, 15.35 GB read, 402.21 MB/s read, 89.8 seconds Interval compaction: 22.84 GB write, 601.25 MB/s write, 15.35 GB read, 404.08 MB/s read, 89.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 35, pending-compaction-bytes-delays: 9, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 35, interval: 56 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2990181 Average: 2.4381 StdDev: 16.22 Min: 1 Median: 1.4700 Max: 5970 Percentiles: P50: 1.47 P75: 1.85 P99: 5.79 P99.9: 102.59 P99.99: 255.06 ------------------------------------------------------ [ 0, 1 ] 568514 19.013% 19.013% #### ( 1, 2 ] 1971633 65.937% 84.950% ############# ( 2, 3 ] 270489 9.046% 93.996% ## ( 3, 4 ] 97062 3.246% 97.242% # ( 4, 6 ] 58714 1.964% 99.205% ( 6, 10 ] 16341 0.546% 99.752% ( 10, 15 ] 2305 0.077% 99.829% ( 15, 22 ] 337 0.011% 99.840% ( 22, 34 ] 42 0.001% 99.841% ( 34, 51 ] 19 0.001% 99.842% ( 51, 76 ] 50 0.002% 99.844% ( 76, 110 ] 2154 0.072% 99.916% ( 110, 170 ] 1812 0.061% 99.976% ( 170, 250 ] 396 0.013% 99.990% ( 250, 380 ] 359 0.012% 100.002% ( 380, 580 ] 289 0.010% 100.011% ( 580, 870 ] 146 0.005% 100.016% ( 870, 1300 ] 57 0.002% 100.018% ( 1300, 1900 ] 31 0.001% 100.019% ( 1900, 2900 ] 31 0.001% 100.020% ( 2900, 4400 ] 14 0.000% 100.021% ( 4400, 6600 ] 2 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 1231581 Average: 3.2483 StdDev: 28.28 Min: 0 Median: 1.5998 Max: 4607 Percentiles: P50: 1.60 P75: 2.03 P99: 8.49 P99.9: 117.11 P99.99: 243.13 ------------------------------------------------------ [ 0, 1 ] 161871 13.143% 13.143% ### ( 1, 2 ] 756823 61.451% 74.595% ############ ( 2, 3 ] 167662 13.614% 88.208% ### ( 3, 4 ] 65731 5.337% 93.545% # ( 4, 6 ] 55482 4.505% 98.050% # ( 6, 10 ] 18773 1.524% 99.575% ( 10, 15 ] 2411 0.196% 99.770% ( 15, 22 ] 342 0.028% 99.798% ( 22, 34 ] 26 0.002% 99.800% ( 34, 51 ] 28 0.002% 99.803% ( 51, 76 ] 140 0.011% 99.814% ( 76, 110 ] 956 0.078% 99.892% ( 110, 170 ] 881 0.072% 99.963% ( 170, 250 ] 363 0.029% 99.993% ( 250, 380 ] 345 0.028% 100.021% ( 380, 580 ] 331 0.027% 100.047% ( 580, 870 ] 233 0.019% 100.066% ( 870, 1300 ] 117 0.009% 100.076% ( 1300, 1900 ] 61 0.005% 100.081% ( 1900, 2900 ] 46 0.004% 100.085% ( 2900, 4400 ] 13 0.001% 100.086% ( 4400, 6600 ] 1 0.000% 100.086% ** Level 2 read latency histogram (micros): Count: 28247 Average: 4.0207 StdDev: 38.81 Min: 1 Median: 1.4691 Max: 2810 Percentiles: P50: 1.47 P75: 1.97 P99: 9.17 P99.9: 606.76 P99.99: 1958.43 ------------------------------------------------------ [ 0, 1 ] 7494 26.530% 26.530% ##### ( 1, 2 ] 14133 50.034% 76.564% ########## ( 2, 3 ] 2721 9.633% 86.197% ## ( 3, 4 ] 1707 6.043% 92.240% # ( 4, 6 ] 1544 5.466% 97.706% # ( 6, 10 ] 461 1.632% 99.338% ( 10, 15 ] 67 0.237% 99.575% ( 15, 22 ] 14 0.050% 99.625% ( 34, 51 ] 1 0.004% 99.628% ( 76, 110 ] 4 0.014% 99.642% ( 110, 170 ] 12 0.042% 99.685% ( 170, 250 ] 17 0.060% 99.745% ( 250, 380 ] 28 0.099% 99.844% ( 380, 580 ] 14 0.050% 99.894% ( 580, 870 ] 19 0.067% 99.961% ( 870, 1300 ] 7 0.025% 99.986% ( 1300, 1900 ] 1 0.004% 99.989% ( 1900, 2900 ] 3 0.011% 100.000% ** Level 3 read latency histogram (micros): Count: 297154 Average: 3.6984 StdDev: 37.57 Min: 0 Median: 1.6924 Max: 5283 Percentiles: P50: 1.69 P75: 2.35 P99: 8.68 P99.9: 235.90 P99.99: 679.87 ------------------------------------------------------ [ 0, 1 ] 20355 6.850% 6.850% # ( 1, 2 ] 185175 62.316% 69.166% ############ ( 2, 3 ] 49049 16.506% 85.672% ### ( 3, 4 ] 20434 6.877% 92.549% # ( 4, 6 ] 15963 5.372% 97.921% # ( 6, 10 ] 4778 1.608% 99.529% ( 10, 15 ] 511 0.172% 99.701% ( 15, 22 ] 75 0.025% 99.726% ( 22, 34 ] 5 0.002% 99.728% ( 34, 51 ] 1 0.000% 99.728% ( 51, 76 ] 5 0.002% 99.730% ( 76, 110 ] 116 0.039% 99.769% ( 110, 170 ] 291 0.098% 99.867% ( 170, 250 ] 120 0.040% 99.907% ( 250, 380 ] 118 0.040% 99.947% ( 380, 580 ] 109 0.037% 99.984% ( 580, 870 ] 56 0.019% 100.002% ( 870, 1300 ] 45 0.015% 100.017% ( 1300, 1900 ] 24 0.008% 100.026% ( 1900, 2900 ] 8 0.003% 100.028% ( 2900, 4400 ] 7 0.002% 100.031% ( 4400, 6600 ] 5 0.002% 100.032% ** Level 4 read latency histogram (micros): Count: 50 Average: 961.6400 StdDev: 1219.75 Min: 1 Median: 480.0000 Max: 4552 Percentiles: P50: 480.00 P75: 1450.00 P99: 4552.00 P99.9: 4552.00 P99.99: 4552.00 ------------------------------------------------------ [ 0, 1 ] 4 8.000% 8.000% ## ( 1, 2 ] 7 14.000% 22.000% ### ( 2, 3 ] 3 6.000% 28.000% # ( 4, 6 ] 2 4.000% 32.000% # ( 110, 170 ] 4 8.000% 40.000% ## ( 170, 250 ] 1 2.000% 42.000% ( 250, 380 ] 2 4.000% 46.000% # ( 380, 580 ] 4 8.000% 54.000% ## ( 580, 870 ] 7 14.000% 68.000% ### ( 870, 1300 ] 3 6.000% 74.000% # ( 1300, 1900 ] 2 4.000% 78.000% # ( 1900, 2900 ] 6 12.000% 90.000% ## ( 2900, 4400 ] 4 8.000% 98.000% ## ( 4400, 6600 ] 1 2.000% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 1262.3417 StdDev: 1345.18 Min: 77 Median: 743.1250 Max: 6651 Percentiles: P50: 743.12 P75: 1814.29 P99: 6512.00 P99.9: 6651.00 P99.99: 6651.00 ------------------------------------------------------ ( 76, 110 ] 8 6.667% 6.667% # ( 110, 170 ] 17 14.167% 20.833% ### ( 170, 250 ] 4 3.333% 24.167% # ( 250, 380 ] 13 10.833% 35.000% ## ( 380, 580 ] 9 7.500% 42.500% ## ( 580, 870 ] 16 13.333% 55.833% ### ( 870, 1300 ] 11 9.167% 65.000% ## ( 1300, 1900 ] 14 11.667% 76.667% ## ( 1900, 2900 ] 11 9.167% 85.833% ## ( 2900, 4400 ] 11 9.167% 95.000% ## ( 4400, 6600 ] 5 4.167% 99.167% # ( 6600, 9900 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 39.1 total, 3.0 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 201.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:16.950 H:M:S, 43.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 323.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.423 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.831 micros/op 146397 ops/sec 60.028 seconds 8787999 operations; 141.8 MB/s Microseconds per write: Count: 8787999 Average: 6.8307 StdDev: 275.30 Min: 1 Median: 1.7519 Max: 365437 Percentiles: P50: 1.75 P75: 2.81 P99: 10.60 P99.9: 1216.00 P99.99: 2725.92 ------------------------------------------------------ [ 0, 1 ] 1098585 12.501% 12.501% ### ( 1, 2 ] 4382625 49.871% 62.372% ########## ( 2, 3 ] 1369266 15.581% 77.953% ### ( 3, 4 ] 1216471 13.842% 91.795% ### ( 4, 6 ] 487845 5.551% 97.346% # ( 6, 10 ] 139597 1.588% 98.935% ( 10, 15 ] 47563 0.541% 99.476% ( 15, 22 ] 9588 0.109% 99.585% ( 22, 34 ] 1487 0.017% 99.602% ( 34, 51 ] 200 0.002% 99.604% ( 51, 76 ] 39 0.000% 99.605% ( 76, 110 ] 6202 0.071% 99.675% ( 110, 170 ] 2267 0.026% 99.701% ( 170, 250 ] 249 0.003% 99.704% ( 250, 380 ] 191 0.002% 99.706% ( 380, 580 ] 22 0.000% 99.706% ( 580, 870 ] 19 0.000% 99.707% ( 870, 1300 ] 21121 0.240% 99.947% ( 1300, 1900 ] 55 0.001% 99.948% ( 1900, 2900 ] 4514 0.051% 99.999% ( 2900, 4400 ] 60 0.001% 100.000% ( 4400, 6600 ] 11 0.000% 100.000% ( 6600, 9900 ] 3 0.000% 100.000% ( 14000, 22000 ] 2 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 12 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 196217 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 8787999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9069214968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 435 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 35328479 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 26581630489 rocksdb.compact.write.bytes COUNT : 26395069860 rocksdb.flush.write.bytes COUNT : 9049921651 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 42 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 223 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 8976868352 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3409920 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 26661327885 rocksdb.non.last.level.read.count COUNT : 6443555 rocksdb.block.checksum.compute.count COUNT : 6442727 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.390857 P95 : 3.996777 P99 : 9.087372 P100 : 365434.000000 COUNT : 8787999 SUM : 55690612 rocksdb.compaction.times.micros P50 : 968181.818182 P95 : 4276666.666667 P99 : 16924758.000000 P100 : 16924758.000000 COUNT : 61 SUM : 96552362 rocksdb.compaction.times.cpu_micros P50 : 905769.230769 P95 : 4265000.000000 P99 : 15862007.000000 P100 : 15862007.000000 COUNT : 61 SUM : 89370221 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 700.833333 P95 : 1195.807692 P99 : 17080.000000 P100 : 21169.000000 COUNT : 123 SUM : 122968 rocksdb.compaction.outfile.sync.micros P50 : 823.088235 P95 : 29300.000000 P99 : 48224.444444 P100 : 54486.000000 COUNT : 294 SUM : 1251717 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 99.134021 P95 : 370.545455 P99 : 1468.000000 P100 : 1762.000000 COUNT : 216 SUM : 33490 rocksdb.table.open.io.micros P50 : 1395.833333 P95 : 7036.764706 P99 : 11452.142857 P100 : 13447.000000 COUNT : 435 SUM : 861501 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.547072 P95 : 6.528495 P99 : 9.850569 P100 : 8363.000000 COUNT : 6441481 SUM : 31445512 rocksdb.read.block.get.micros P50 : 480.000000 P95 : 3265.384615 P99 : 5296.923077 P100 : 6802.000000 COUNT : 870 SUM : 698135 rocksdb.write.raw.block.micros P50 : 0.511122 P95 : 0.971132 P99 : 2.833468 P100 : 9886.000000 COUNT : 8584950 SUM : 15333678 rocksdb.numfiles.in.singlecompaction P50 : 3.265152 P95 : 6.900000 P99 : 27.340000 P100 : 33.000000 COUNT : 111 SUM : 439 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560386 P95 : 1150.130827 P99 : 2387.456763 P100 : 365184.000000 COUNT : 240057 SUM : 35351953 rocksdb.sst.read.micros P50 : 1.498785 P95 : 3.863911 P99 : 7.245699 P100 : 8360.000000 COUNT : 6443721 SUM : 18467196 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 8787999 SUM : 9069214968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213750.000000 P95 : 340617.647059 P99 : 378241.176471 P100 : 531544.000000 COUNT : 123 SUM : 25275983 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 268 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0