[2024-11-16 21:49:13.658261] Starting SPDK v25.01-pre git sha1 83e8405e4 / DPDK 22.11.4 initialization... [2024-11-16 21:49:13.658530] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid179969 ] Set seed to 1731790153651586 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-16 21:49:13.771171] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-16 21:49:13.792763] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-16 21:49:13.792804] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 179969' to capture a snapshot of events at runtime. [2024-11-16 21:49:13.792814] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-16 21:49:13.792825] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-16 21:49:13.792832] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid179969 for offline analysis/debug. [2024-11-16 21:49:13.793377] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Nov 16 21:49:18 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/16-21:49:20 ... thread 0: (1000000,1000000) ops and (349054.8,349054.8) ops/second in (2.864880,2.864880) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 630.03 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 343.8 2.38 2.16 12 0.199 0 0 0.0 0.0 L2 3/2 237.06 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 250.0 249.9 1.39 1.34 2 0.697 353K 205 0.0 0.0 L3 9/0 755.92 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/11 96.94 GB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 92.3 309.1 3.78 3.49 14 0.270 353K 205 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.1 1.0 0.0 1.4 92.3 309.1 3.78 3.49 14 0.270 353K 205 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 250.0 249.9 1.39 1.34 2 0.697 353K 205 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 343.8 2.38 2.16 12 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.1 total, 2.9 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.14 GB write, 378.79 MB/s write, 0.34 GB read, 113.10 MB/s read, 3.8 seconds Interval compaction: 1.14 GB write, 407.26 MB/s write, 0.34 GB read, 121.61 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 126686 Average: 2.0371 StdDev: 18.39 Min: 1 Median: 1.3308 Max: 4095 Percentiles: P50: 1.33 P75: 1.76 P99: 5.32 P99.9: 9.72 P99.99: 25.98 ------------------------------------------------------ [ 0, 1 ] 38872 30.684% 30.684% ###### ( 1, 2 ] 73984 58.400% 89.083% ############ ( 2, 3 ] 7849 6.196% 95.279% # ( 3, 4 ] 3332 2.630% 97.909% # ( 4, 6 ] 2098 1.656% 99.565% ( 6, 10 ] 459 0.362% 99.927% ( 10, 15 ] 64 0.051% 99.978% ( 15, 22 ] 17 0.013% 99.991% ( 22, 34 ] 1 0.001% 99.992% ( 34, 51 ] 2 0.002% 99.994% ( 51, 76 ] 1 0.001% 99.994% ( 110, 170 ] 4 0.003% 99.998% ( 170, 250 ] 7 0.006% 100.003% ( 250, 380 ] 6 0.005% 100.008% ( 580, 870 ] 1 0.001% 100.009% ( 870, 1300 ] 2 0.002% 100.010% ( 1300, 1900 ] 1 0.001% 100.011% ( 2900, 4400 ] 3 0.002% 100.013% ** Level 2 read latency histogram (micros): Count: 69763 Average: 2.2209 StdDev: 27.97 Min: 1 Median: 1.3473 Max: 6684 Percentiles: P50: 1.35 P75: 1.77 P99: 5.88 P99.9: 39.77 P99.99: 583.44 ------------------------------------------------------ [ 0, 1 ] 20663 29.619% 29.619% ###### ( 1, 2 ] 40939 58.683% 88.302% ############ ( 2, 3 ] 4316 6.187% 94.488% # ( 3, 4 ] 1761 2.524% 97.013% # ( 4, 6 ] 1476 2.116% 99.128% ( 6, 10 ] 456 0.654% 99.782% ( 10, 15 ] 56 0.080% 99.862% ( 15, 22 ] 9 0.013% 99.875% ( 22, 34 ] 4 0.006% 99.881% ( 34, 51 ] 39 0.056% 99.937% ( 51, 76 ] 13 0.019% 99.956% ( 76, 110 ] 7 0.010% 99.966% ( 110, 170 ] 5 0.007% 99.973% ( 170, 250 ] 7 0.010% 99.983% ( 250, 380 ] 5 0.007% 99.990% ( 580, 870 ] 2 0.003% 99.993% ( 870, 1300 ] 3 0.004% 99.997% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 45 Average: 1854.5111 StdDev: 2054.10 Min: 152 Median: 725.0000 Max: 7762 Percentiles: P50: 725.00 P75: 2850.00 P99: 7762.00 P99.9: 7762.00 P99.99: 7762.00 ------------------------------------------------------ ( 110, 170 ] 1 2.222% 2.222% ( 170, 250 ] 7 15.556% 17.778% ### ( 250, 380 ] 4 8.889% 26.667% ## ( 380, 580 ] 9 20.000% 46.667% #### ( 580, 870 ] 3 6.667% 53.333% # ( 870, 1300 ] 1 2.222% 55.556% ( 1300, 1900 ] 4 8.889% 64.444% ## ( 1900, 2900 ] 5 11.111% 75.556% ## ( 2900, 4400 ] 6 13.333% 88.889% ### ( 4400, 6600 ] 2 4.444% 93.333% # ( 6600, 9900 ] 3 6.667% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1645.5333 StdDev: 1610.78 Min: 139 Median: 1085.0000 Max: 7540 Percentiles: P50: 1085.00 P75: 2400.00 P99: 7540.00 P99.9: 7540.00 P99.99: 7540.00 ------------------------------------------------------ ( 110, 170 ] 3 10.000% 10.000% ## ( 170, 250 ] 1 3.333% 13.333% # ( 250, 380 ] 2 6.667% 20.000% # ( 580, 870 ] 5 16.667% 36.667% ### ( 870, 1300 ] 8 26.667% 63.333% ##### ( 1300, 1900 ] 1 3.333% 66.667% # ( 1900, 2900 ] 5 16.667% 83.333% ### ( 2900, 4400 ] 3 10.000% 93.333% ## ( 4400, 6600 ] 1 3.333% 96.667% # ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.1 total, 2.9 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 319.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.232 H:M:S, 7.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 343.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.232 H:M:S, 8.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/16-21:49:23 ... thread 0: (1000000,2000000) ops and (332112.4,340372.9) ops/second in (3.011029,5.875909) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/12 1.29 GB 25.2 0.5 0.0 0.5 2.3 1.8 0.0 1.3 71.1 328.7 7.09 6.52 28 0.253 511K 468 0.0 0.0 L1 4/4 314.57 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 238.9 238.6 1.32 1.27 1 1.319 319K 404 0.0 0.0 L2 1/0 49.82 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 250.0 249.9 1.39 1.34 2 0.697 353K 205 0.0 0.0 L3 18/0 943.17 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 217.5 217.5 0.86 0.79 1 0.861 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1196/16 97.92 GB 0.0 1.3 0.7 0.6 3.1 2.5 0.2 1.7 127.1 298.3 10.66 9.92 32 0.333 1375K 1077 0.0 0.0 Int 0/0 0.00 KB 0.0 1.3 0.7 0.6 3.1 2.5 0.2 1.7 127.1 298.3 10.66 9.92 32 0.333 1375K 1077 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.3 0.7 0.6 1.3 0.7 0.0 0.0 247.6 247.4 5.47 5.26 6 0.912 1375K 1077 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 351.9 5.19 4.66 26 0.200 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.1 total, 5.9 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.11 GB write, 522.03 MB/s write, 1.32 GB read, 222.37 MB/s read, 10.7 seconds Interval compaction: 3.11 GB write, 541.17 MB/s write, 1.32 GB read, 230.52 MB/s read, 10.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 402740 Average: 2.1070 StdDev: 13.84 Min: 1 Median: 1.4286 Max: 4095 Percentiles: P50: 1.43 P75: 1.82 P99: 5.39 P99.9: 9.88 P99.99: 14.68 ------------------------------------------------------ [ 0, 1 ] 91259 22.660% 22.660% ##### ( 1, 2 ] 256920 63.793% 86.453% ############# ( 2, 3 ] 33813 8.396% 94.848% ## ( 3, 4 ] 11995 2.978% 97.827% # ( 4, 6 ] 6804 1.689% 99.516% ( 6, 10 ] 1597 0.397% 99.913% ( 10, 15 ] 335 0.083% 99.996% ( 15, 22 ] 29 0.007% 100.003% ( 22, 34 ] 4 0.001% 100.004% ( 34, 51 ] 4 0.001% 100.005% ( 51, 76 ] 2 0.000% 100.005% ( 110, 170 ] 7 0.002% 100.007% ( 170, 250 ] 16 0.004% 100.011% ( 250, 380 ] 11 0.003% 100.014% ( 380, 580 ] 2 0.000% 100.014% ( 580, 870 ] 4 0.001% 100.015% ( 870, 1300 ] 6 0.001% 100.017% ( 1300, 1900 ] 5 0.001% 100.018% ( 2900, 4400 ] 5 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 55073 Average: 2.0554 StdDev: 5.99 Min: 0 Median: 1.4475 Max: 1214 Percentiles: P50: 1.45 P75: 1.82 P99: 5.04 P99.9: 9.69 P99.99: 189.71 ------------------------------------------------------ [ 0, 1 ] 11166 20.275% 20.275% #### ( 1, 2 ] 36585 66.430% 86.705% ############# ( 2, 3 ] 4914 8.923% 95.628% ## ( 3, 4 ] 1490 2.705% 98.333% # ( 4, 6 ] 709 1.287% 99.621% ( 6, 10 ] 168 0.305% 99.926% ( 10, 15 ] 32 0.058% 99.984% ( 15, 22 ] 3 0.005% 99.989% ( 22, 34 ] 1 0.002% 99.991% ( 170, 250 ] 2 0.004% 99.995% ( 250, 380 ] 2 0.004% 99.998% ( 380, 580 ] 1 0.002% 100.000% ( 870, 1300 ] 1 0.002% 100.002% ** Level 2 read latency histogram (micros): Count: 88089 Average: 2.2515 StdDev: 24.90 Min: 1 Median: 1.4142 Max: 6684 Percentiles: P50: 1.41 P75: 1.83 P99: 5.88 P99.9: 21.15 P99.99: 332.97 ------------------------------------------------------ [ 0, 1 ] 22085 25.071% 25.071% ##### ( 1, 2 ] 53022 60.191% 85.263% ############ ( 2, 3 ] 7300 8.287% 93.550% ## ( 3, 4 ] 2731 3.100% 96.650% # ( 4, 6 ] 2198 2.495% 99.145% ( 6, 10 ] 589 0.669% 99.814% ( 10, 15 ] 68 0.077% 99.891% ( 15, 22 ] 9 0.010% 99.901% ( 22, 34 ] 4 0.005% 99.906% ( 34, 51 ] 39 0.044% 99.950% ( 51, 76 ] 13 0.015% 99.965% ( 76, 110 ] 7 0.008% 99.973% ( 110, 170 ] 5 0.006% 99.978% ( 170, 250 ] 7 0.008% 99.986% ( 250, 380 ] 5 0.006% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 948.2444 StdDev: 1715.42 Min: 1 Median: 192.8571 Max: 7762 Percentiles: P50: 192.86 P75: 821.67 P99: 7762.00 P99.9: 7762.00 P99.99: 7762.00 ------------------------------------------------------ [ 0, 1 ] 15 16.667% 16.667% ### ( 1, 2 ] 17 18.889% 35.556% #### ( 2, 3 ] 2 2.222% 37.778% ( 4, 6 ] 1 1.111% 38.889% ( 6, 10 ] 6 6.667% 45.556% # ( 110, 170 ] 2 2.222% 47.778% ( 170, 250 ] 7 7.778% 55.556% ## ( 250, 380 ] 5 5.556% 61.111% # ( 380, 580 ] 10 11.111% 72.222% ## ( 580, 870 ] 3 3.333% 75.556% # ( 870, 1300 ] 2 2.222% 77.778% ( 1300, 1900 ] 4 4.444% 82.222% # ( 1900, 2900 ] 5 5.556% 87.778% # ( 2900, 4400 ] 6 6.667% 94.444% # ( 4400, 6600 ] 2 2.222% 96.667% ( 6600, 9900 ] 3 3.333% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1645.5333 StdDev: 1610.78 Min: 139 Median: 1085.0000 Max: 7540 Percentiles: P50: 1085.00 P75: 2400.00 P99: 7540.00 P99.9: 7540.00 P99.99: 7540.00 ------------------------------------------------------ ( 110, 170 ] 3 10.000% 10.000% ## ( 170, 250 ] 1 3.333% 13.333% # ( 250, 380 ] 2 6.667% 20.000% # ( 580, 870 ] 5 16.667% 36.667% ### ( 870, 1300 ] 8 26.667% 63.333% ##### ( 1300, 1900 ] 1 3.333% 66.667% # ( 1900, 2900 ] 5 16.667% 83.333% ### ( 2900, 4400 ] 3 10.000% 93.333% ## ( 4400, 6600 ] 1 3.333% 96.667% # ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 6.1 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 323.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.592 H:M:S, 9.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.360 H:M:S, 12.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/16-21:49:26 ... thread 0: (1000000,3000000) ops and (331319.8,337300.7) ops/second in (3.018232,8.894141) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/4 1.78 GB 151.0 1.6 0.0 1.6 4.4 2.8 0.0 1.6 116.1 317.0 14.10 13.16 46 0.307 1663K 1645 0.0 0.0 L1 8/0 815.69 MB 81.6 1.1 0.8 0.3 1.1 0.8 0.2 1.4 236.8 236.1 4.79 4.66 2 2.393 1150K 2897 0.0 0.0 L2 1/0 49.82 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 250.0 249.9 1.39 1.34 2 0.697 353K 205 0.0 0.0 L3 18/0 943.17 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 217.5 217.5 0.86 0.79 1 0.861 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1198/4 98.90 GB 0.0 3.2 1.2 2.1 6.0 3.9 0.2 2.2 156.4 290.2 21.14 19.94 51 0.415 3357K 4747 0.0 0.0 Int 0/0 0.00 KB 0.0 3.2 1.2 2.1 6.0 3.9 0.2 2.2 156.4 290.2 21.14 19.94 51 0.415 3357K 4747 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.2 1.2 2.1 3.2 1.2 0.0 0.0 250.9 250.6 13.18 12.81 11 1.198 3357K 4747 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 355.9 7.97 7.14 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.99 GB write, 673.57 MB/s write, 3.23 GB read, 362.97 MB/s read, 21.1 seconds Interval compaction: 5.99 GB write, 689.89 MB/s write, 3.23 GB read, 371.77 MB/s read, 21.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 701346 Average: 2.0877 StdDev: 11.95 Min: 0 Median: 1.4268 Max: 4095 Percentiles: P50: 1.43 P75: 1.82 P99: 5.34 P99.9: 9.98 P99.99: 14.57 ------------------------------------------------------ [ 0, 1 ] 159109 22.686% 22.686% ##### ( 1, 2 ] 448811 63.993% 86.679% ############# ( 2, 3 ] 58298 8.312% 94.991% ## ( 3, 4 ] 20474 2.919% 97.911% # ( 4, 6 ] 11365 1.620% 99.531% ( 6, 10 ] 2598 0.370% 99.901% ( 10, 15 ] 679 0.097% 99.998% ( 15, 22 ] 56 0.008% 100.006% ( 22, 34 ] 6 0.001% 100.007% ( 34, 51 ] 5 0.001% 100.008% ( 51, 76 ] 5 0.001% 100.009% ( 110, 170 ] 8 0.001% 100.010% ( 170, 250 ] 28 0.004% 100.014% ( 250, 380 ] 19 0.003% 100.016% ( 380, 580 ] 6 0.001% 100.017% ( 580, 870 ] 7 0.001% 100.018% ( 870, 1300 ] 9 0.001% 100.020% ( 1300, 1900 ] 8 0.001% 100.021% ( 1900, 2900 ] 2 0.000% 100.021% ( 2900, 4400 ] 5 0.001% 100.022% ** Level 1 read latency histogram (micros): Count: 79921 Average: 2.2165 StdDev: 11.58 Min: 0 Median: 1.4818 Max: 1374 Percentiles: P50: 1.48 P75: 1.85 P99: 5.24 P99.9: 9.89 P99.99: 530.39 ------------------------------------------------------ [ 0, 1 ] 14112 17.657% 17.657% #### ( 1, 2 ] 53653 67.133% 84.790% ############# ( 2, 3 ] 8093 10.126% 94.916% ## ( 3, 4 ] 2490 3.116% 98.032% # ( 4, 6 ] 1250 1.564% 99.596% ( 6, 10 ] 250 0.313% 99.909% ( 10, 15 ] 46 0.058% 99.966% ( 15, 22 ] 5 0.006% 99.972% ( 22, 34 ] 1 0.001% 99.974% ( 110, 170 ] 1 0.001% 99.975% ( 170, 250 ] 4 0.005% 99.980% ( 250, 380 ] 5 0.006% 99.986% ( 380, 580 ] 4 0.005% 99.991% ( 870, 1300 ] 6 0.008% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 88089 Average: 2.2515 StdDev: 24.90 Min: 1 Median: 1.4142 Max: 6684 Percentiles: P50: 1.41 P75: 1.83 P99: 5.88 P99.9: 21.15 P99.99: 332.97 ------------------------------------------------------ [ 0, 1 ] 22085 25.071% 25.071% ##### ( 1, 2 ] 53022 60.191% 85.263% ############ ( 2, 3 ] 7300 8.287% 93.550% ## ( 3, 4 ] 2731 3.100% 96.650% # ( 4, 6 ] 2198 2.495% 99.145% ( 6, 10 ] 589 0.669% 99.814% ( 10, 15 ] 68 0.077% 99.891% ( 15, 22 ] 9 0.010% 99.901% ( 22, 34 ] 4 0.005% 99.906% ( 34, 51 ] 39 0.044% 99.950% ( 51, 76 ] 13 0.015% 99.965% ( 76, 110 ] 7 0.008% 99.973% ( 110, 170 ] 5 0.006% 99.978% ( 170, 250 ] 7 0.008% 99.986% ( 250, 380 ] 5 0.006% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 948.2444 StdDev: 1715.42 Min: 1 Median: 192.8571 Max: 7762 Percentiles: P50: 192.86 P75: 821.67 P99: 7762.00 P99.9: 7762.00 P99.99: 7762.00 ------------------------------------------------------ [ 0, 1 ] 15 16.667% 16.667% ### ( 1, 2 ] 17 18.889% 35.556% #### ( 2, 3 ] 2 2.222% 37.778% ( 4, 6 ] 1 1.111% 38.889% ( 6, 10 ] 6 6.667% 45.556% # ( 110, 170 ] 2 2.222% 47.778% ( 170, 250 ] 7 7.778% 55.556% ## ( 250, 380 ] 5 5.556% 61.111% # ( 380, 580 ] 10 11.111% 72.222% ## ( 580, 870 ] 3 3.333% 75.556% # ( 870, 1300 ] 2 2.222% 77.778% ( 1300, 1900 ] 4 4.444% 82.222% # ( 1900, 2900 ] 5 5.556% 87.778% # ( 2900, 4400 ] 6 6.667% 94.444% # ( 4400, 6600 ] 2 2.222% 96.667% ( 6600, 9900 ] 3 3.333% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1645.5333 StdDev: 1610.78 Min: 139 Median: 1085.0000 Max: 7540 Percentiles: P50: 1085.00 P75: 2400.00 P99: 7540.00 P99.9: 7540.00 P99.99: 7540.00 ------------------------------------------------------ ( 110, 170 ] 3 10.000% 10.000% ## ( 170, 250 ] 1 3.333% 13.333% # ( 250, 380 ] 2 6.667% 20.000% # ( 580, 870 ] 5 16.667% 36.667% ### ( 870, 1300 ] 8 26.667% 63.333% ##### ( 1300, 1900 ] 1 3.333% 66.667% # ( 1900, 2900 ] 5 16.667% 83.333% ### ( 2900, 4400 ] 3 10.000% 93.333% ## ( 4400, 6600 ] 1 3.333% 96.667% # ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 324.06 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.947 H:M:S, 10.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.355 H:M:S, 11.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/16-21:49:29 ... thread 0: (1000000,4000000) ops and (332434.0,336070.7) ops/second in (3.008116,11.902257) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.77 GB 251.7 2.7 0.0 2.7 6.5 3.7 0.0 1.7 131.2 312.9 21.13 19.82 64 0.330 2814K 2850 0.0 0.0 L1 8/0 815.69 MB 81.6 1.1 0.8 0.3 1.1 0.8 0.2 1.4 236.8 236.1 4.79 4.66 2 2.393 1150K 2897 0.0 0.0 L2 1/0 49.82 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 250.0 249.9 1.39 1.34 2 0.697 353K 205 0.0 0.0 L3 18/0 943.17 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 217.5 217.5 0.86 0.79 1 0.861 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1200/4 99.88 GB 0.0 4.3 1.2 3.2 8.1 4.9 0.2 2.2 157.6 293.8 28.17 26.60 69 0.408 4509K 5952 0.0 0.0 Int 0/0 0.00 KB 0.0 4.3 1.2 3.2 8.1 4.9 0.2 2.2 157.6 293.8 28.17 26.60 69 0.408 4509K 5952 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.3 1.2 3.2 4.3 1.2 0.0 0.0 254.5 254.2 17.45 17.00 15 1.163 4509K 5952 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 358.4 10.72 9.60 54 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.08 GB write, 683.01 MB/s write, 4.34 GB read, 366.45 MB/s read, 28.2 seconds Interval compaction: 8.08 GB write, 695.38 MB/s write, 4.34 GB read, 373.08 MB/s read, 28.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 10, interval: 10 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 964082 Average: 2.0495 StdDev: 11.18 Min: 0 Median: 1.4037 Max: 4095 Percentiles: P50: 1.40 P75: 1.80 P99: 5.26 P99.9: 10.25 P99.99: 14.84 ------------------------------------------------------ [ 0, 1 ] 235054 24.381% 24.381% ##### ( 1, 2 ] 611741 63.453% 87.834% ############# ( 2, 3 ] 73074 7.580% 95.414% ## ( 3, 4 ] 25719 2.668% 98.082% # ( 4, 6 ] 14064 1.459% 99.540% ( 6, 10 ] 3419 0.355% 99.895% ( 10, 15 ] 945 0.098% 99.993% ( 15, 22 ] 97 0.010% 100.003% ( 22, 34 ] 9 0.001% 100.004% ( 34, 51 ] 8 0.001% 100.005% ( 51, 76 ] 8 0.001% 100.006% ( 110, 170 ] 13 0.001% 100.007% ( 170, 250 ] 36 0.004% 100.011% ( 250, 380 ] 24 0.002% 100.013% ( 380, 580 ] 8 0.001% 100.014% ( 580, 870 ] 17 0.002% 100.016% ( 870, 1300 ] 14 0.001% 100.017% ( 1300, 1900 ] 8 0.001% 100.018% ( 1900, 2900 ] 2 0.000% 100.018% ( 2900, 4400 ] 6 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 79921 Average: 2.2165 StdDev: 11.58 Min: 0 Median: 1.4818 Max: 1374 Percentiles: P50: 1.48 P75: 1.85 P99: 5.24 P99.9: 9.89 P99.99: 530.39 ------------------------------------------------------ [ 0, 1 ] 14112 17.657% 17.657% #### ( 1, 2 ] 53653 67.133% 84.790% ############# ( 2, 3 ] 8093 10.126% 94.916% ## ( 3, 4 ] 2490 3.116% 98.032% # ( 4, 6 ] 1250 1.564% 99.596% ( 6, 10 ] 250 0.313% 99.909% ( 10, 15 ] 46 0.058% 99.966% ( 15, 22 ] 5 0.006% 99.972% ( 22, 34 ] 1 0.001% 99.974% ( 110, 170 ] 1 0.001% 99.975% ( 170, 250 ] 4 0.005% 99.980% ( 250, 380 ] 5 0.006% 99.986% ( 380, 580 ] 4 0.005% 99.991% ( 870, 1300 ] 6 0.008% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 88089 Average: 2.2515 StdDev: 24.90 Min: 1 Median: 1.4142 Max: 6684 Percentiles: P50: 1.41 P75: 1.83 P99: 5.88 P99.9: 21.15 P99.99: 332.97 ------------------------------------------------------ [ 0, 1 ] 22085 25.071% 25.071% ##### ( 1, 2 ] 53022 60.191% 85.263% ############ ( 2, 3 ] 7300 8.287% 93.550% ## ( 3, 4 ] 2731 3.100% 96.650% # ( 4, 6 ] 2198 2.495% 99.145% ( 6, 10 ] 589 0.669% 99.814% ( 10, 15 ] 68 0.077% 99.891% ( 15, 22 ] 9 0.010% 99.901% ( 22, 34 ] 4 0.005% 99.906% ( 34, 51 ] 39 0.044% 99.950% ( 51, 76 ] 13 0.015% 99.965% ( 76, 110 ] 7 0.008% 99.973% ( 110, 170 ] 5 0.006% 99.978% ( 170, 250 ] 7 0.008% 99.986% ( 250, 380 ] 5 0.006% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 948.2444 StdDev: 1715.42 Min: 1 Median: 192.8571 Max: 7762 Percentiles: P50: 192.86 P75: 821.67 P99: 7762.00 P99.9: 7762.00 P99.99: 7762.00 ------------------------------------------------------ [ 0, 1 ] 15 16.667% 16.667% ### ( 1, 2 ] 17 18.889% 35.556% #### ( 2, 3 ] 2 2.222% 37.778% ( 4, 6 ] 1 1.111% 38.889% ( 6, 10 ] 6 6.667% 45.556% # ( 110, 170 ] 2 2.222% 47.778% ( 170, 250 ] 7 7.778% 55.556% ## ( 250, 380 ] 5 5.556% 61.111% # ( 380, 580 ] 10 11.111% 72.222% ## ( 580, 870 ] 3 3.333% 75.556% # ( 870, 1300 ] 2 2.222% 77.778% ( 1300, 1900 ] 4 4.444% 82.222% # ( 1900, 2900 ] 5 5.556% 87.778% # ( 2900, 4400 ] 6 6.667% 94.444% # ( 4400, 6600 ] 2 2.222% 96.667% ( 6600, 9900 ] 3 3.333% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1645.5333 StdDev: 1610.78 Min: 139 Median: 1085.0000 Max: 7540 Percentiles: P50: 1085.00 P75: 2400.00 P99: 7540.00 P99.9: 7540.00 P99.99: 7540.00 ------------------------------------------------------ ( 110, 170 ] 3 10.000% 10.000% ## ( 170, 250 ] 1 3.333% 13.333% # ( 250, 380 ] 2 6.667% 20.000% # ( 580, 870 ] 5 16.667% 36.667% ### ( 870, 1300 ] 8 26.667% 63.333% ##### ( 1300, 1900 ] 1 3.333% 66.667% # ( 1900, 2900 ] 5 16.667% 83.333% ### ( 2900, 4400 ] 3 10.000% 93.333% ## ( 4400, 6600 ] 1 3.333% 96.667% # ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.83 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.318 H:M:S, 10.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.18 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.372 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/16-21:49:33 ... thread 0: (1000000,5000000) ops and (279204.8,322917.0) ops/second in (3.581600,15.483857) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/14 3.69 GB 50.4 3.5 0.0 3.5 8.2 4.7 0.0 1.7 134.2 312.9 26.76 25.12 81 0.330 3645K 3714 0.0 0.0 L1 8/8 815.69 MB 0.0 1.1 0.8 0.3 1.1 0.8 0.2 1.4 236.8 236.1 4.79 4.66 2 2.393 1150K 2897 0.0 0.0 L2 1/0 49.82 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 250.0 249.9 1.39 1.34 2 0.697 353K 205 0.0 0.0 L3 18/0 943.17 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.0 1.0 217.5 217.5 0.86 0.79 1 0.861 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1205/22 100.81 GB 0.0 5.1 1.2 4.0 9.8 5.8 0.2 2.1 155.6 297.0 33.80 31.90 86 0.393 5340K 6816 0.0 0.0 Int 0/0 0.00 KB 0.0 5.1 1.2 4.0 9.8 5.8 0.2 2.1 155.6 297.0 33.80 31.90 86 0.393 5340K 6816 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.1 1.2 4.0 5.1 1.2 0.0 0.0 256.9 256.5 20.48 19.97 18 1.138 5340K 6816 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 359.3 13.33 11.93 68 0.196 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.7 total, 15.5 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 9.81 GB write, 639.49 MB/s write, 5.14 GB read, 335.01 MB/s read, 33.8 seconds Interval compaction: 9.81 GB write, 648.39 MB/s write, 5.14 GB read, 339.67 MB/s read, 33.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 2, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 2, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 2, total-stops: 13, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1259667 Average: 2.0466 StdDev: 11.01 Min: 0 Median: 1.3958 Max: 4095 Percentiles: P50: 1.40 P75: 1.79 P99: 5.24 P99.9: 10.91 P99.99: 20.66 ------------------------------------------------------ [ 0, 1 ] 312909 24.841% 24.841% ##### ( 1, 2 ] 800800 63.572% 88.413% ############# ( 2, 3 ] 90928 7.218% 95.631% # ( 3, 4 ] 31823 2.526% 98.158% # ( 4, 6 ] 17134 1.360% 99.518% ( 6, 10 ] 4587 0.364% 99.882% ( 10, 15 ] 1250 0.099% 99.981% ( 15, 22 ] 136 0.011% 99.992% ( 22, 34 ] 13 0.001% 99.993% ( 34, 51 ] 11 0.001% 99.994% ( 51, 76 ] 11 0.001% 99.995% ( 76, 110 ] 45 0.004% 99.998% ( 110, 170 ] 88 0.007% 100.005% ( 170, 250 ] 53 0.004% 100.010% ( 250, 380 ] 31 0.002% 100.012% ( 380, 580 ] 17 0.001% 100.013% ( 580, 870 ] 22 0.002% 100.015% ( 870, 1300 ] 18 0.001% 100.017% ( 1300, 1900 ] 9 0.001% 100.017% ( 1900, 2900 ] 2 0.000% 100.017% ( 2900, 4400 ] 7 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 103105 Average: 2.2695 StdDev: 11.21 Min: 0 Median: 1.4641 Max: 1374 Percentiles: P50: 1.46 P75: 1.84 P99: 5.56 P99.9: 14.74 P99.99: 487.58 ------------------------------------------------------ [ 0, 1 ] 19694 19.101% 19.101% #### ( 1, 2 ] 68648 66.581% 85.682% ############# ( 2, 3 ] 9530 9.243% 94.925% ## ( 3, 4 ] 2984 2.894% 97.819% # ( 4, 6 ] 1560 1.513% 99.332% ( 6, 10 ] 512 0.497% 99.828% ( 10, 15 ] 78 0.076% 99.904% ( 15, 22 ] 9 0.009% 99.913% ( 22, 34 ] 4 0.004% 99.917% ( 34, 51 ] 1 0.001% 99.918% ( 76, 110 ] 2 0.002% 99.919% ( 110, 170 ] 52 0.050% 99.970% ( 170, 250 ] 12 0.012% 99.982% ( 250, 380 ] 6 0.006% 99.987% ( 380, 580 ] 5 0.005% 99.992% ( 580, 870 ] 1 0.001% 99.993% ( 870, 1300 ] 6 0.006% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 88089 Average: 2.2515 StdDev: 24.90 Min: 1 Median: 1.4142 Max: 6684 Percentiles: P50: 1.41 P75: 1.83 P99: 5.88 P99.9: 21.15 P99.99: 332.97 ------------------------------------------------------ [ 0, 1 ] 22085 25.071% 25.071% ##### ( 1, 2 ] 53022 60.191% 85.263% ############ ( 2, 3 ] 7300 8.287% 93.550% ## ( 3, 4 ] 2731 3.100% 96.650% # ( 4, 6 ] 2198 2.495% 99.145% ( 6, 10 ] 589 0.669% 99.814% ( 10, 15 ] 68 0.077% 99.891% ( 15, 22 ] 9 0.010% 99.901% ( 22, 34 ] 4 0.005% 99.906% ( 34, 51 ] 39 0.044% 99.950% ( 51, 76 ] 13 0.015% 99.965% ( 76, 110 ] 7 0.008% 99.973% ( 110, 170 ] 5 0.006% 99.978% ( 170, 250 ] 7 0.008% 99.986% ( 250, 380 ] 5 0.006% 99.992% ( 580, 870 ] 2 0.002% 99.994% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 90 Average: 948.2444 StdDev: 1715.42 Min: 1 Median: 192.8571 Max: 7762 Percentiles: P50: 192.86 P75: 821.67 P99: 7762.00 P99.9: 7762.00 P99.99: 7762.00 ------------------------------------------------------ [ 0, 1 ] 15 16.667% 16.667% ### ( 1, 2 ] 17 18.889% 35.556% #### ( 2, 3 ] 2 2.222% 37.778% ( 4, 6 ] 1 1.111% 38.889% ( 6, 10 ] 6 6.667% 45.556% # ( 110, 170 ] 2 2.222% 47.778% ( 170, 250 ] 7 7.778% 55.556% ## ( 250, 380 ] 5 5.556% 61.111% # ( 380, 580 ] 10 11.111% 72.222% ## ( 580, 870 ] 3 3.333% 75.556% # ( 870, 1300 ] 2 2.222% 77.778% ( 1300, 1900 ] 4 4.444% 82.222% # ( 1900, 2900 ] 5 5.556% 87.778% # ( 2900, 4400 ] 6 6.667% 94.444% # ( 4400, 6600 ] 2 2.222% 96.667% ( 6600, 9900 ] 3 3.333% 100.000% # ** Level 4 read latency histogram (micros): Count: 30 Average: 1645.5333 StdDev: 1610.78 Min: 139 Median: 1085.0000 Max: 7540 Percentiles: P50: 1085.00 P75: 2400.00 P99: 7540.00 P99.9: 7540.00 P99.99: 7540.00 ------------------------------------------------------ ( 110, 170 ] 3 10.000% 10.000% ## ( 170, 250 ] 1 3.333% 13.333% # ( 250, 380 ] 2 6.667% 20.000% # ( 580, 870 ] 5 16.667% 36.667% ### ( 870, 1300 ] 8 26.667% 63.333% ##### ( 1300, 1900 ] 1 3.333% 66.667% # ( 1900, 2900 ] 5 16.667% 83.333% ### ( 2900, 4400 ] 3 10.000% 93.333% ## ( 4400, 6600 ] 1 3.333% 96.667% # ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 15.7 total, 3.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 313.42 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.199 H:M:S, 14.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 274.79 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.881 H:M:S, 24.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/16-21:49:50 ... thread 0: (1000000,6000000) ops and (59147.4,185237.9) ops/second in (16.906914,32.390771) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 2/2 1.47 GB 0.0 6.0 0.0 6.0 11.6 5.7 0.0 2.1 155.9 303.5 39.20 36.87 103 0.381 6203K 8842 0.0 0.0 L1 12/12 1.40 GB 0.0 5.1 4.0 1.1 5.0 3.9 0.2 1.3 224.2 220.8 23.28 21.88 3 7.761 5302K 80K 0.0 0.0 L2 21/5 2.56 GB 20.6 0.3 0.2 0.2 0.3 0.2 2.5 1.8 250.0 249.9 1.39 1.34 2 0.697 353K 205 0.0 0.0 L3 18/10 943.17 MB 0.1 0.2 0.2 0.0 0.2 0.2 0.0 1.0 217.5 217.5 0.86 0.79 1 0.861 190K 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1213/29 101.71 GB 0.0 11.6 4.4 7.2 17.2 9.9 2.7 3.0 183.3 271.4 64.74 60.87 109 0.594 12M 89K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.6 4.4 7.2 17.2 9.9 2.7 3.0 183.3 271.4 64.74 60.87 109 0.594 12M 89K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.6 4.4 7.2 11.5 4.3 0.0 0.0 244.7 242.9 48.49 46.35 25 1.940 12M 89K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 356.7 16.25 14.53 84 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 32.6 total, 32.4 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.16 GB write, 538.92 MB/s write, 11.59 GB read, 363.92 MB/s read, 64.7 seconds Interval compaction: 17.16 GB write, 542.50 MB/s write, 11.59 GB read, 366.35 MB/s read, 64.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 13, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 18, total-stops: 13, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2647581 Average: 2.4821 StdDev: 14.44 Min: 0 Median: 1.4126 Max: 4095 Percentiles: P50: 1.41 P75: 1.80 P99: 5.89 P99.9: 140.29 P99.99: 308.82 ------------------------------------------------------ [ 0, 1 ] 621745 23.484% 23.484% ##### ( 1, 2 ] 1701671 64.273% 87.756% ############# ( 2, 3 ] 191026 7.215% 94.971% # ( 3, 4 ] 69032 2.607% 97.579% # ( 4, 6 ] 39861 1.506% 99.084% ( 6, 10 ] 13765 0.520% 99.604% ( 10, 15 ] 2803 0.106% 99.710% ( 15, 22 ] 492 0.019% 99.729% ( 22, 34 ] 21 0.001% 99.729% ( 34, 51 ] 48 0.002% 99.731% ( 51, 76 ] 124 0.005% 99.736% ( 76, 110 ] 2843 0.107% 99.843% ( 110, 170 ] 2978 0.112% 99.956% ( 170, 250 ] 725 0.027% 99.983% ( 250, 380 ] 405 0.015% 99.998% ( 380, 580 ] 349 0.013% 100.012% ( 580, 870 ] 140 0.005% 100.017% ( 870, 1300 ] 37 0.001% 100.018% ( 1300, 1900 ] 16 0.001% 100.019% ( 1900, 2900 ] 14 0.001% 100.019% ( 2900, 4400 ] 9 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 297106 Average: 2.8255 StdDev: 21.55 Min: 0 Median: 1.4357 Max: 4679 Percentiles: P50: 1.44 P75: 1.83 P99: 7.62 P99.9: 164.98 P99.99: 1077.36 ------------------------------------------------------ [ 0, 1 ] 66120 22.255% 22.255% #### ( 1, 2 ] 189189 63.677% 85.932% ############# ( 2, 3 ] 23366 7.865% 93.796% ## ( 3, 4 ] 8546 2.876% 96.673% # ( 4, 6 ] 5946 2.001% 98.674% ( 6, 10 ] 2392 0.805% 99.479% ( 10, 15 ] 326 0.110% 99.589% ( 15, 22 ] 72 0.024% 99.613% ( 22, 34 ] 8 0.003% 99.616% ( 34, 51 ] 1 0.000% 99.616% ( 51, 76 ] 14 0.005% 99.621% ( 76, 110 ] 402 0.135% 99.756% ( 110, 170 ] 467 0.157% 99.913% ( 170, 250 ] 80 0.027% 99.940% ( 250, 380 ] 52 0.018% 99.958% ( 380, 580 ] 55 0.019% 99.976% ( 580, 870 ] 22 0.007% 99.984% ( 870, 1300 ] 40 0.013% 99.997% ( 1300, 1900 ] 6 0.002% 99.999% ( 1900, 2900 ] 1 0.000% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ( 4400, 6600 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 88114 Average: 2.3180 StdDev: 25.34 Min: 1 Median: 1.4144 Max: 6684 Percentiles: P50: 1.41 P75: 1.83 P99: 5.91 P99.9: 42.67 P99.99: 525.91 ------------------------------------------------------ [ 0, 1 ] 22085 25.064% 25.064% ##### ( 1, 2 ] 53022 60.174% 85.238% ############ ( 2, 3 ] 7300 8.285% 93.523% ## ( 3, 4 ] 2731 3.099% 96.623% # ( 4, 6 ] 2198 2.494% 99.117% ( 6, 10 ] 589 0.668% 99.786% ( 10, 15 ] 68 0.077% 99.863% ( 15, 22 ] 9 0.010% 99.873% ( 22, 34 ] 4 0.005% 99.877% ( 34, 51 ] 39 0.044% 99.922% ( 51, 76 ] 13 0.015% 99.936% ( 76, 110 ] 8 0.009% 99.946% ( 110, 170 ] 17 0.019% 99.965% ( 170, 250 ] 11 0.012% 99.977% ( 250, 380 ] 9 0.010% 99.988% ( 380, 580 ] 3 0.003% 99.991% ( 580, 870 ] 3 0.003% 99.994% ( 870, 1300 ] 3 0.003% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 12743 Average: 12.7501 StdDev: 169.85 Min: 1 Median: 1.6774 Max: 7762 Percentiles: P50: 1.68 P75: 2.34 P99: 203.92 P99.9: 2151.40 P99.99: 6298.27 ------------------------------------------------------ [ 0, 1 ] 1011 7.934% 7.934% ## ( 1, 2 ] 7913 62.097% 70.031% ############ ( 2, 3 ] 1848 14.502% 84.533% ### ( 3, 4 ] 908 7.125% 91.658% # ( 4, 6 ] 599 4.701% 96.359% # ( 6, 10 ] 244 1.915% 98.274% ( 10, 15 ] 32 0.251% 98.525% ( 15, 22 ] 7 0.055% 98.580% ( 22, 34 ] 1 0.008% 98.587% ( 76, 110 ] 7 0.055% 98.642% ( 110, 170 ] 32 0.251% 98.894% ( 170, 250 ] 32 0.251% 99.145% ( 250, 380 ] 32 0.251% 99.396% ( 380, 580 ] 34 0.267% 99.663% ( 580, 870 ] 19 0.149% 99.812% ( 870, 1300 ] 4 0.031% 99.843% ( 1300, 1900 ] 6 0.047% 99.890% ( 1900, 2900 ] 5 0.039% 99.929% ( 2900, 4400 ] 6 0.047% 99.976% ( 4400, 6600 ] 2 0.016% 99.992% ( 6600, 9900 ] 3 0.024% 100.016% ** Level 4 read latency histogram (micros): Count: 30 Average: 1645.5333 StdDev: 1610.78 Min: 139 Median: 1085.0000 Max: 7540 Percentiles: P50: 1085.00 P75: 2400.00 P99: 7540.00 P99.9: 7540.00 P99.99: 7540.00 ------------------------------------------------------ ( 110, 170 ] 3 10.000% 10.000% ## ( 170, 250 ] 1 3.333% 13.333% # ( 250, 380 ] 2 6.667% 20.000% # ( 580, 870 ] 5 16.667% 36.667% ### ( 870, 1300 ] 8 26.667% 63.333% ##### ( 1300, 1900 ] 1 3.333% 66.667% # ( 1900, 2900 ] 5 16.667% 83.333% ### ( 2900, 4400 ] 3 10.000% 93.333% ## ( 4400, 6600 ] 1 3.333% 96.667% # ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 32.6 total, 16.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 181.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.738 H:M:S, 48.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 58.21 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:13.539 H:M:S, 80.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/16-21:49:57 ... thread 0: (1000000,7000000) ops and (150633.5,179352.0) ops/second in (6.638629,39.029400) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 2.39 GB 69.2 6.5 0.0 6.5 13.1 6.6 0.0 2.0 146.4 294.0 45.61 41.62 118 0.387 6779K 9461 0.0 0.0 L1 12/12 1.40 GB 0.0 5.1 4.0 1.1 5.0 3.9 0.2 1.3 224.2 220.8 23.28 21.88 3 7.761 5302K 80K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.5 1.8 250.0 249.9 1.39 1.34 2 0.697 353K 205 0.0 0.0 L3 26/6 991.79 MB 0.8 4.1 2.7 1.3 4.1 2.7 0.0 1.5 163.5 163.3 25.58 18.55 19 1.347 4187K 3860 0.0 0.0 L4 140/4 9.77 GB 1.0 0.1 0.1 0.0 0.1 0.1 2.4 1.0 218.3 218.3 0.38 0.37 1 0.381 84K 0 0.0 0.0 L5 1072/0 88.09 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1259/28 102.63 GB 0.0 16.1 7.0 9.1 22.6 13.5 7.4 3.4 171.6 240.6 96.25 83.74 143 0.673 16M 93K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.1 7.0 9.1 22.6 13.5 7.4 3.4 171.6 240.6 96.25 83.74 143 0.673 16M 93K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.1 7.0 9.1 16.0 6.9 0.0 0.0 217.3 216.0 76.01 66.71 46 1.652 16M 93K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 332.9 20.25 17.04 97 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 39.2 total, 39.0 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.62 GB write, 590.07 MB/s write, 16.13 GB read, 420.77 MB/s read, 96.3 seconds Interval compaction: 22.62 GB write, 593.33 MB/s write, 16.13 GB read, 423.10 MB/s read, 96.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 39, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 39, interval: 62 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3056698 Average: 2.5864 StdDev: 18.38 Min: 0 Median: 1.4560 Max: 5723 Percentiles: P50: 1.46 P75: 1.85 P99: 6.44 P99.9: 136.13 P99.99: 332.08 ------------------------------------------------------ [ 0, 1 ] 641471 20.986% 20.986% #### ( 1, 2 ] 1944881 63.627% 84.613% ############# ( 2, 3 ] 268967 8.799% 93.412% ## ( 3, 4 ] 98715 3.229% 96.641% # ( 4, 6 ] 69771 2.283% 98.924% ( 6, 10 ] 20976 0.686% 99.610% ( 10, 15 ] 3870 0.127% 99.737% ( 15, 22 ] 616 0.020% 99.757% ( 22, 34 ] 26 0.001% 99.758% ( 34, 51 ] 52 0.002% 99.759% ( 51, 76 ] 126 0.004% 99.764% ( 76, 110 ] 2859 0.094% 99.857% ( 110, 170 ] 3013 0.099% 99.956% ( 170, 250 ] 770 0.025% 99.981% ( 250, 380 ] 444 0.015% 99.995% ( 380, 580 ] 411 0.013% 100.009% ( 580, 870 ] 187 0.006% 100.015% ( 870, 1300 ] 59 0.002% 100.017% ( 1300, 1900 ] 34 0.001% 100.018% ( 1900, 2900 ] 30 0.001% 100.019% ( 2900, 4400 ] 22 0.001% 100.020% ( 4400, 6600 ] 4 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1005450 Average: 5.5855 StdDev: 83.82 Min: 0 Median: 1.7656 Max: 8468 Percentiles: P50: 1.77 P75: 2.63 P99: 9.24 P99.9: 140.16 P99.99: 307.18 ------------------------------------------------------ [ 0, 1 ] 76268 7.585% 7.585% ## ( 1, 2 ] 557026 55.401% 62.986% ########### ( 2, 3 ] 193034 19.199% 82.185% #### ( 3, 4 ] 76088 7.568% 89.752% ## ( 4, 6 ] 75524 7.511% 97.264% ## ( 6, 10 ] 21580 2.146% 99.410% ( 10, 15 ] 3457 0.344% 99.754% ( 15, 22 ] 480 0.048% 99.802% ( 22, 34 ] 33 0.003% 99.805% ( 34, 51 ] 13 0.001% 99.806% ( 51, 76 ] 18 0.002% 99.808% ( 76, 110 ] 538 0.054% 99.862% ( 110, 170 ] 767 0.076% 99.938% ( 170, 250 ] 355 0.035% 99.973% ( 250, 380 ] 383 0.038% 100.011% ( 380, 580 ] 382 0.038% 100.049% ( 580, 870 ] 349 0.035% 100.084% ( 870, 1300 ] 221 0.022% 100.106% ( 1300, 1900 ] 170 0.017% 100.123% ( 1900, 2900 ] 217 0.022% 100.145% ( 2900, 4400 ] 220 0.022% 100.166% ( 4400, 6600 ] 58 0.006% 100.172% ( 6600, 9900 ] 9 0.001% 100.173% ** Level 2 read latency histogram (micros): Count: 100742 Average: 2.5530 StdDev: 26.12 Min: 1 Median: 1.4414 Max: 6684 Percentiles: P50: 1.44 P75: 1.86 P99: 6.63 P99.9: 126.75 P99.99: 770.94 ------------------------------------------------------ [ 0, 1 ] 23582 23.408% 23.408% ##### ( 1, 2 ] 60693 60.246% 83.654% ############ ( 2, 3 ] 9064 8.997% 92.652% ## ( 3, 4 ] 3415 3.390% 96.041% # ( 4, 6 ] 2842 2.821% 98.862% # ( 6, 10 ] 876 0.870% 99.732% ( 10, 15 ] 82 0.081% 99.813% ( 15, 22 ] 11 0.011% 99.824% ( 22, 34 ] 5 0.005% 99.829% ( 34, 51 ] 39 0.039% 99.868% ( 51, 76 ] 13 0.013% 99.881% ( 76, 110 ] 12 0.012% 99.893% ( 110, 170 ] 26 0.026% 99.919% ( 170, 250 ] 30 0.030% 99.948% ( 250, 380 ] 19 0.019% 99.967% ( 380, 580 ] 17 0.017% 99.984% ( 580, 870 ] 9 0.009% 99.993% ( 870, 1300 ] 3 0.003% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 412273 Average: 3.8725 StdDev: 41.02 Min: 0 Median: 1.7922 Max: 7762 Percentiles: P50: 1.79 P75: 2.66 P99: 8.85 P99.9: 128.94 P99.99: 228.13 ------------------------------------------------------ [ 0, 1 ] 19260 4.672% 4.672% # ( 1, 2 ] 235900 57.219% 61.891% ########### ( 2, 3 ] 81755 19.830% 81.721% #### ( 3, 4 ] 34973 8.483% 90.204% ## ( 4, 6 ] 30472 7.391% 97.596% # ( 6, 10 ] 8139 1.974% 99.570% ( 10, 15 ] 1023 0.248% 99.818% ( 15, 22 ] 112 0.027% 99.845% ( 22, 34 ] 16 0.004% 99.849% ( 34, 51 ] 2 0.000% 99.849% ( 51, 76 ] 19 0.005% 99.854% ( 76, 110 ] 90 0.022% 99.876% ( 110, 170 ] 316 0.077% 99.952% ( 170, 250 ] 213 0.052% 100.004% ( 250, 380 ] 175 0.042% 100.047% ( 380, 580 ] 160 0.039% 100.085% ( 580, 870 ] 94 0.023% 100.108% ( 870, 1300 ] 44 0.011% 100.119% ( 1300, 1900 ] 20 0.005% 100.124% ( 1900, 2900 ] 11 0.003% 100.126% ( 2900, 4400 ] 15 0.004% 100.130% ( 4400, 6600 ] 2 0.000% 100.130% ( 6600, 9900 ] 3 0.001% 100.131% ** Level 4 read latency histogram (micros): Count: 44 Average: 1162.4773 StdDev: 1512.06 Min: 1 Median: 725.0000 Max: 7540 Percentiles: P50: 725.00 P75: 1300.00 P99: 7540.00 P99.9: 7540.00 P99.99: 7540.00 ------------------------------------------------------ [ 0, 1 ] 3 6.818% 6.818% # ( 1, 2 ] 1 2.273% 9.091% ( 2, 3 ] 4 9.091% 18.182% ## ( 3, 4 ] 1 2.273% 20.455% ( 51, 76 ] 1 2.273% 22.727% ( 110, 170 ] 3 6.818% 29.545% # ( 170, 250 ] 3 6.818% 36.364% # ( 250, 380 ] 2 4.545% 40.909% # ( 380, 580 ] 1 2.273% 43.182% ( 580, 870 ] 6 13.636% 56.818% ### ( 870, 1300 ] 8 18.182% 75.000% #### ( 1300, 1900 ] 1 2.273% 77.273% ( 1900, 2900 ] 5 11.364% 88.636% ## ( 2900, 4400 ] 3 6.818% 95.455% # ( 4400, 6600 ] 1 2.273% 97.727% ( 6600, 9900 ] 1 2.273% 100.000% ** Level 5 read latency histogram (micros): Count: 153 Average: 1280.0196 StdDev: 1351.61 Min: 97 Median: 693.9286 Max: 6648 Percentiles: P50: 693.93 P75: 1803.57 P99: 6433.43 P99.9: 6648.00 P99.99: 6648.00 ------------------------------------------------------ ( 76, 110 ] 6 3.922% 3.922% # ( 110, 170 ] 7 4.575% 8.497% # ( 170, 250 ] 11 7.190% 15.686% # ( 250, 380 ] 21 13.725% 29.412% ### ( 380, 580 ] 26 16.993% 46.405% ### ( 580, 870 ] 14 9.150% 55.556% ## ( 870, 1300 ] 18 11.765% 67.320% ## ( 1300, 1900 ] 14 9.150% 76.471% ## ( 1900, 2900 ] 15 9.804% 86.275% ## ( 2900, 4400 ] 13 8.497% 94.771% ## ( 4400, 6600 ] 7 4.575% 99.346% # ( 6600, 9900 ] 1 0.654% 100.000% ** DB Stats ** Uptime(secs): 39.2 total, 6.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 175.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.404 H:M:S, 49.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 148.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.666 H:M:S, 55.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/11/16-21:50:00 ... thread 0: (1000000,8000000) ops and (319189.6,189742.8) ops/second in (3.132934,42.162334) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/6 3.38 GB 169.9 7.3 0.0 7.3 14.9 7.6 0.0 2.0 145.1 294.9 51.65 47.26 135 0.383 7610K 10K 0.0 0.0 L1 12/12 1.40 GB 0.0 5.1 4.0 1.1 5.0 3.9 0.2 1.3 224.2 220.8 23.28 21.88 3 7.761 5302K 80K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.5 1.8 250.0 249.9 1.39 1.34 2 0.697 353K 205 0.0 0.0 L3 20/0 798.21 MB 0.8 4.1 2.7 1.3 4.1 2.7 0.0 1.5 163.5 163.3 25.58 18.55 19 1.347 4187K 3860 0.0 0.0 L4 156/0 9.65 GB 1.0 0.3 0.3 0.0 0.3 0.3 2.4 1.0 179.1 179.1 1.55 1.31 4 0.386 276K 0 0.0 0.0 L5 1076/0 88.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1278/18 103.61 GB 0.0 17.1 7.2 9.9 24.6 14.7 7.7 3.2 169.4 243.4 103.46 90.32 163 0.635 17M 94K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.1 7.2 9.9 24.6 14.7 7.7 3.2 169.4 243.4 103.46 90.32 163 0.635 17M 94K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.1 7.2 9.9 17.0 7.1 0.0 0.0 218.3 217.1 80.30 70.70 52 1.544 17M 94K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 334.5 23.16 19.62 111 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 42.4 total, 42.2 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.59 GB write, 594.11 MB/s write, 17.12 GB read, 413.56 MB/s read, 103.5 seconds Interval compaction: 24.59 GB write, 597.14 MB/s write, 17.12 GB read, 415.67 MB/s read, 103.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 43, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 43, interval: 66 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3325293 Average: 2.5570 StdDev: 17.91 Min: 0 Median: 1.4616 Max: 5723 Percentiles: P50: 1.46 P75: 1.85 P99: 6.22 P99.9: 130.72 P99.99: 319.18 ------------------------------------------------------ [ 0, 1 ] 680257 20.457% 20.457% #### ( 1, 2 ] 2128435 64.007% 84.464% ############# ( 2, 3 ] 298591 8.979% 93.444% ## ( 3, 4 ] 108224 3.255% 96.698% # ( 4, 6 ] 75297 2.264% 98.963% ( 6, 10 ] 22416 0.674% 99.637% ( 10, 15 ] 4009 0.121% 99.757% ( 15, 22 ] 630 0.019% 99.776% ( 22, 34 ] 28 0.001% 99.777% ( 34, 51 ] 53 0.002% 99.779% ( 51, 76 ] 128 0.004% 99.783% ( 76, 110 ] 2859 0.086% 99.869% ( 110, 170 ] 3016 0.091% 99.959% ( 170, 250 ] 779 0.023% 99.983% ( 250, 380 ] 450 0.014% 99.996% ( 380, 580 ] 417 0.013% 100.009% ( 580, 870 ] 190 0.006% 100.015% ( 870, 1300 ] 61 0.002% 100.016% ( 1300, 1900 ] 36 0.001% 100.018% ( 1900, 2900 ] 32 0.001% 100.018% ( 2900, 4400 ] 23 0.001% 100.019% ( 4400, 6600 ] 4 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 1141789 Average: 5.2255 StdDev: 78.76 Min: 0 Median: 1.7356 Max: 8468 Percentiles: P50: 1.74 P75: 2.54 P99: 9.14 P99.9: 138.08 P99.99: 313.31 ------------------------------------------------------ [ 0, 1 ] 92524 8.103% 8.103% ## ( 1, 2 ] 650338 56.958% 65.061% ########### ( 2, 3 ] 209947 18.388% 83.449% #### ( 3, 4 ] 80552 7.055% 90.504% # ( 4, 6 ] 78490 6.874% 97.378% # ( 6, 10 ] 23615 2.068% 99.446% ( 10, 15 ] 3568 0.312% 99.759% ( 15, 22 ] 495 0.043% 99.802% ( 22, 34 ] 34 0.003% 99.805% ( 34, 51 ] 13 0.001% 99.806% ( 51, 76 ] 28 0.002% 99.809% ( 76, 110 ] 645 0.056% 99.865% ( 110, 170 ] 853 0.075% 99.940% ( 170, 250 ] 380 0.033% 99.973% ( 250, 380 ] 398 0.035% 100.008% ( 380, 580 ] 396 0.035% 100.043% ( 580, 870 ] 358 0.031% 100.074% ( 870, 1300 ] 221 0.019% 100.093% ( 1300, 1900 ] 170 0.015% 100.108% ( 1900, 2900 ] 218 0.019% 100.127% ( 2900, 4400 ] 220 0.019% 100.147% ( 4400, 6600 ] 58 0.005% 100.152% ( 6600, 9900 ] 9 0.001% 100.152% ** Level 2 read latency histogram (micros): Count: 100742 Average: 2.5530 StdDev: 26.12 Min: 1 Median: 1.4414 Max: 6684 Percentiles: P50: 1.44 P75: 1.86 P99: 6.63 P99.9: 126.75 P99.99: 770.94 ------------------------------------------------------ [ 0, 1 ] 23582 23.408% 23.408% ##### ( 1, 2 ] 60693 60.246% 83.654% ############ ( 2, 3 ] 9064 8.997% 92.652% ## ( 3, 4 ] 3415 3.390% 96.041% # ( 4, 6 ] 2842 2.821% 98.862% # ( 6, 10 ] 876 0.870% 99.732% ( 10, 15 ] 82 0.081% 99.813% ( 15, 22 ] 11 0.011% 99.824% ( 22, 34 ] 5 0.005% 99.829% ( 34, 51 ] 39 0.039% 99.868% ( 51, 76 ] 13 0.013% 99.881% ( 76, 110 ] 12 0.012% 99.893% ( 110, 170 ] 26 0.026% 99.919% ( 170, 250 ] 30 0.030% 99.948% ( 250, 380 ] 19 0.019% 99.967% ( 380, 580 ] 17 0.017% 99.984% ( 580, 870 ] 9 0.009% 99.993% ( 870, 1300 ] 3 0.003% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 418093 Average: 3.8558 StdDev: 40.74 Min: 0 Median: 1.7928 Max: 7762 Percentiles: P50: 1.79 P75: 2.66 P99: 8.83 P99.9: 127.64 P99.99: 227.54 ------------------------------------------------------ [ 0, 1 ] 19334 4.624% 4.624% # ( 1, 2 ] 239289 57.233% 61.858% ########### ( 2, 3 ] 83315 19.927% 81.785% #### ( 3, 4 ] 35332 8.451% 90.236% ## ( 4, 6 ] 30823 7.372% 97.608% # ( 6, 10 ] 8222 1.967% 99.575% ( 10, 15 ] 1027 0.246% 99.820% ( 15, 22 ] 113 0.027% 99.847% ( 22, 34 ] 16 0.004% 99.851% ( 34, 51 ] 2 0.000% 99.852% ( 51, 76 ] 19 0.005% 99.856% ( 76, 110 ] 90 0.022% 99.878% ( 110, 170 ] 316 0.076% 99.953% ( 170, 250 ] 213 0.051% 100.004% ( 250, 380 ] 175 0.042% 100.046% ( 380, 580 ] 160 0.038% 100.084% ( 580, 870 ] 94 0.022% 100.107% ( 870, 1300 ] 44 0.011% 100.117% ( 1300, 1900 ] 20 0.005% 100.122% ( 1900, 2900 ] 11 0.003% 100.125% ( 2900, 4400 ] 15 0.004% 100.128% ( 4400, 6600 ] 2 0.000% 100.129% ( 6600, 9900 ] 3 0.001% 100.130% ** Level 4 read latency histogram (micros): Count: 140 Average: 383.7786 StdDev: 1003.41 Min: 0 Median: 1.8718 Max: 7540 Percentiles: P50: 1.87 P75: 170.00 P99: 5720.00 P99.9: 7540.00 P99.99: 7540.00 ------------------------------------------------------ [ 0, 1 ] 36 25.714% 25.714% ##### ( 1, 2 ] 39 27.857% 53.571% ###### ( 2, 3 ] 6 4.286% 57.857% # ( 3, 4 ] 3 2.143% 60.000% ( 4, 6 ] 2 1.429% 61.429% ( 6, 10 ] 12 8.571% 70.000% ## ( 10, 15 ] 1 0.714% 70.714% ( 34, 51 ] 1 0.714% 71.429% ( 51, 76 ] 1 0.714% 72.143% ( 110, 170 ] 4 2.857% 75.000% # ( 170, 250 ] 4 2.857% 77.857% # ( 250, 380 ] 3 2.143% 80.000% ( 380, 580 ] 1 0.714% 80.714% ( 580, 870 ] 7 5.000% 85.714% # ( 870, 1300 ] 9 6.429% 92.143% # ( 1300, 1900 ] 1 0.714% 92.857% ( 1900, 2900 ] 5 3.571% 96.429% # ( 2900, 4400 ] 3 2.143% 98.571% ( 4400, 6600 ] 1 0.714% 99.286% ( 6600, 9900 ] 1 0.714% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1280.4562 StdDev: 1341.49 Min: 97 Median: 704.2857 Max: 6648 Percentiles: P50: 704.29 P75: 1825.00 P99: 6411.43 P99.9: 6648.00 P99.99: 6648.00 ------------------------------------------------------ ( 76, 110 ] 6 3.750% 3.750% # ( 110, 170 ] 9 5.625% 9.375% # ( 170, 250 ] 11 6.875% 16.250% # ( 250, 380 ] 22 13.750% 30.000% ### ( 380, 580 ] 26 16.250% 46.250% ### ( 580, 870 ] 14 8.750% 55.000% ## ( 870, 1300 ] 18 11.250% 66.250% ## ( 1300, 1900 ] 16 10.000% 76.250% ## ( 1900, 2900 ] 17 10.625% 86.875% ## ( 2900, 4400 ] 13 8.125% 95.000% ## ( 4400, 6600 ] 7 4.375% 99.375% # ( 6600, 9900 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 42.4 total, 3.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 185.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:19.834 H:M:S, 46.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 314.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.430 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/16-21:50:03 ... thread 0: (1000000,9000000) ops and (324820.5,198934.8) ops/second in (3.078623,45.240957) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/6 4.30 GB 264.3 8.1 0.0 8.1 16.6 8.5 0.0 2.0 144.8 296.1 57.40 52.68 151 0.380 8442K 11K 0.0 0.0 L1 12/12 1.40 GB 0.0 5.1 4.0 1.1 5.0 3.9 0.2 1.3 224.2 220.8 23.28 21.88 3 7.761 5302K 80K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.5 1.8 250.0 249.9 1.39 1.34 2 0.697 353K 205 0.0 0.0 L3 20/0 798.21 MB 0.8 4.1 2.7 1.3 4.1 2.7 0.0 1.5 163.5 163.3 25.58 18.55 19 1.347 4187K 3860 0.0 0.0 L4 156/0 9.65 GB 1.0 0.3 0.3 0.0 0.3 0.3 2.4 1.0 179.1 179.1 1.55 1.31 4 0.386 276K 0 0.0 0.0 L5 1076/0 88.40 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/18 104.53 GB 0.0 17.9 7.2 10.7 26.3 15.6 7.7 3.1 168.0 246.7 109.21 95.75 179 0.610 18M 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.9 7.2 10.7 26.3 15.6 7.7 3.1 168.0 246.7 109.21 95.75 179 0.610 18M 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.9 7.2 10.7 17.8 7.1 0.0 0.0 220.0 218.8 83.39 73.75 55 1.516 18M 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 336.7 25.82 22.00 124 0.208 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.5 total, 45.2 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.31 GB write, 592.65 MB/s write, 17.92 GB read, 403.57 MB/s read, 109.2 seconds Interval compaction: 26.31 GB write, 595.48 MB/s write, 17.92 GB read, 405.49 MB/s read, 109.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 45, pending-compaction-bytes-delays: 11, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 45, interval: 68 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3590656 Average: 2.5351 StdDev: 17.52 Min: 0 Median: 1.4665 Max: 5723 Percentiles: P50: 1.47 P75: 1.86 P99: 6.07 P99.9: 124.97 P99.99: 297.85 ------------------------------------------------------ [ 0, 1 ] 718428 20.008% 20.008% #### ( 1, 2 ] 2308359 64.288% 84.296% ############# ( 2, 3 ] 328461 9.148% 93.444% ## ( 3, 4 ] 117567 3.274% 96.718% # ( 4, 6 ] 81532 2.271% 98.989% ( 6, 10 ] 23983 0.668% 99.657% ( 10, 15 ] 4247 0.118% 99.775% ( 15, 22 ] 642 0.018% 99.793% ( 22, 34 ] 29 0.001% 99.794% ( 34, 51 ] 54 0.002% 99.795% ( 51, 76 ] 128 0.004% 99.799% ( 76, 110 ] 2882 0.080% 99.879% ( 110, 170 ] 3027 0.084% 99.963% ( 170, 250 ] 791 0.022% 99.985% ( 250, 380 ] 459 0.013% 99.998% ( 380, 580 ] 421 0.012% 100.010% ( 580, 870 ] 196 0.005% 100.015% ( 870, 1300 ] 65 0.002% 100.017% ( 1300, 1900 ] 37 0.001% 100.018% ( 1900, 2900 ] 33 0.001% 100.019% ( 2900, 4400 ] 24 0.001% 100.020% ( 4400, 6600 ] 4 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 1273516 Average: 4.9524 StdDev: 74.65 Min: 0 Median: 1.7138 Max: 8468 Percentiles: P50: 1.71 P75: 2.47 P99: 9.06 P99.9: 137.17 P99.99: 320.88 ------------------------------------------------------ [ 0, 1 ] 108182 8.495% 8.495% ## ( 1, 2 ] 740475 58.144% 66.639% ############ ( 2, 3 ] 226389 17.777% 84.416% #### ( 3, 4 ] 84702 6.651% 91.067% # ( 4, 6 ] 81478 6.398% 97.464% # ( 6, 10 ] 25558 2.007% 99.471% ( 10, 15 ] 3694 0.290% 99.761% ( 15, 22 ] 510 0.040% 99.801% ( 22, 34 ] 35 0.003% 99.804% ( 34, 51 ] 13 0.001% 99.805% ( 51, 76 ] 38 0.003% 99.808% ( 76, 110 ] 746 0.059% 99.867% ( 110, 170 ] 933 0.073% 99.940% ( 170, 250 ] 405 0.032% 99.972% ( 250, 380 ] 423 0.033% 100.005% ( 380, 580 ] 413 0.032% 100.038% ( 580, 870 ] 366 0.029% 100.066% ( 870, 1300 ] 221 0.017% 100.084% ( 1300, 1900 ] 170 0.013% 100.097% ( 1900, 2900 ] 218 0.017% 100.114% ( 2900, 4400 ] 220 0.017% 100.131% ( 4400, 6600 ] 58 0.005% 100.136% ( 6600, 9900 ] 9 0.001% 100.137% ** Level 2 read latency histogram (micros): Count: 100742 Average: 2.5530 StdDev: 26.12 Min: 1 Median: 1.4414 Max: 6684 Percentiles: P50: 1.44 P75: 1.86 P99: 6.63 P99.9: 126.75 P99.99: 770.94 ------------------------------------------------------ [ 0, 1 ] 23582 23.408% 23.408% ##### ( 1, 2 ] 60693 60.246% 83.654% ############ ( 2, 3 ] 9064 8.997% 92.652% ## ( 3, 4 ] 3415 3.390% 96.041% # ( 4, 6 ] 2842 2.821% 98.862% # ( 6, 10 ] 876 0.870% 99.732% ( 10, 15 ] 82 0.081% 99.813% ( 15, 22 ] 11 0.011% 99.824% ( 22, 34 ] 5 0.005% 99.829% ( 34, 51 ] 39 0.039% 99.868% ( 51, 76 ] 13 0.013% 99.881% ( 76, 110 ] 12 0.012% 99.893% ( 110, 170 ] 26 0.026% 99.919% ( 170, 250 ] 30 0.030% 99.948% ( 250, 380 ] 19 0.019% 99.967% ( 380, 580 ] 17 0.017% 99.984% ( 580, 870 ] 9 0.009% 99.993% ( 870, 1300 ] 3 0.003% 99.996% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 418093 Average: 3.8558 StdDev: 40.74 Min: 0 Median: 1.7928 Max: 7762 Percentiles: P50: 1.79 P75: 2.66 P99: 8.83 P99.9: 127.64 P99.99: 227.54 ------------------------------------------------------ [ 0, 1 ] 19334 4.624% 4.624% # ( 1, 2 ] 239289 57.233% 61.858% ########### ( 2, 3 ] 83315 19.927% 81.785% #### ( 3, 4 ] 35332 8.451% 90.236% ## ( 4, 6 ] 30823 7.372% 97.608% # ( 6, 10 ] 8222 1.967% 99.575% ( 10, 15 ] 1027 0.246% 99.820% ( 15, 22 ] 113 0.027% 99.847% ( 22, 34 ] 16 0.004% 99.851% ( 34, 51 ] 2 0.000% 99.852% ( 51, 76 ] 19 0.005% 99.856% ( 76, 110 ] 90 0.022% 99.878% ( 110, 170 ] 316 0.076% 99.953% ( 170, 250 ] 213 0.051% 100.004% ( 250, 380 ] 175 0.042% 100.046% ( 380, 580 ] 160 0.038% 100.084% ( 580, 870 ] 94 0.022% 100.107% ( 870, 1300 ] 44 0.011% 100.117% ( 1300, 1900 ] 20 0.005% 100.122% ( 1900, 2900 ] 11 0.003% 100.125% ( 2900, 4400 ] 15 0.004% 100.128% ( 4400, 6600 ] 2 0.000% 100.129% ( 6600, 9900 ] 3 0.001% 100.130% ** Level 4 read latency histogram (micros): Count: 140 Average: 383.7786 StdDev: 1003.41 Min: 0 Median: 1.8718 Max: 7540 Percentiles: P50: 1.87 P75: 170.00 P99: 5720.00 P99.9: 7540.00 P99.99: 7540.00 ------------------------------------------------------ [ 0, 1 ] 36 25.714% 25.714% ##### ( 1, 2 ] 39 27.857% 53.571% ###### ( 2, 3 ] 6 4.286% 57.857% # ( 3, 4 ] 3 2.143% 60.000% ( 4, 6 ] 2 1.429% 61.429% ( 6, 10 ] 12 8.571% 70.000% ## ( 10, 15 ] 1 0.714% 70.714% ( 34, 51 ] 1 0.714% 71.429% ( 51, 76 ] 1 0.714% 72.143% ( 110, 170 ] 4 2.857% 75.000% # ( 170, 250 ] 4 2.857% 77.857% # ( 250, 380 ] 3 2.143% 80.000% ( 380, 580 ] 1 0.714% 80.714% ( 580, 870 ] 7 5.000% 85.714% # ( 870, 1300 ] 9 6.429% 92.143% # ( 1300, 1900 ] 1 0.714% 92.857% ( 1900, 2900 ] 5 3.571% 96.429% # ( 2900, 4400 ] 3 2.143% 98.571% ( 4400, 6600 ] 1 0.714% 99.286% ( 6600, 9900 ] 1 0.714% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1280.4562 StdDev: 1341.49 Min: 97 Median: 704.2857 Max: 6648 Percentiles: P50: 704.29 P75: 1825.00 P99: 6411.43 P99.9: 6648.00 P99.99: 6648.00 ------------------------------------------------------ ( 76, 110 ] 6 3.750% 3.750% # ( 110, 170 ] 9 5.625% 9.375% # ( 170, 250 ] 11 6.875% 16.250% # ( 250, 380 ] 22 13.750% 30.000% ### ( 380, 580 ] 26 16.250% 46.250% ### ( 580, 870 ] 14 8.750% 55.000% ## ( 870, 1300 ] 18 11.250% 66.250% ## ( 1300, 1900 ] 16 10.000% 76.250% ## ( 1900, 2900 ] 17 10.625% 86.875% ## ( 2900, 4400 ] 13 8.125% 95.000% ## ( 4400, 6600 ] 7 4.375% 99.375% # ( 6600, 9900 ] 1 0.625% 100.000% ** DB Stats ** Uptime(secs): 45.5 total, 3.1 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 194.85 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:20.230 H:M:S, 44.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 319.70 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.396 H:M:S, 12.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.403 micros/op 156185 ops/sec 60.121 seconds 9389999 operations; 151.3 MB/s Microseconds per write: Count: 9389999 Average: 6.4026 StdDev: 370.87 Min: 1 Median: 1.7603 Max: 786768 Percentiles: P50: 1.76 P75: 2.82 P99: 10.95 P99.9: 1182.00 P99.99: 2658.86 ------------------------------------------------------ [ 0, 1 ] 1105456 11.773% 11.773% ## ( 1, 2 ] 4721246 50.280% 62.052% ########## ( 2, 3 ] 1485292 15.818% 77.870% ### ( 3, 4 ] 1296459 13.807% 91.677% ### ( 4, 6 ] 519445 5.532% 97.209% # ( 6, 10 ] 157493 1.677% 98.886% ( 10, 15 ] 56460 0.601% 99.487% ( 15, 22 ] 12246 0.130% 99.618% ( 22, 34 ] 1933 0.021% 99.638% ( 34, 51 ] 233 0.002% 99.641% ( 51, 76 ] 30 0.000% 99.641% ( 76, 110 ] 6526 0.069% 99.711% ( 110, 170 ] 2446 0.026% 99.737% ( 170, 250 ] 275 0.003% 99.740% ( 250, 380 ] 247 0.003% 99.742% ( 380, 580 ] 27 0.000% 99.742% ( 580, 870 ] 20 0.000% 99.743% ( 870, 1300 ] 20363 0.217% 99.960% ( 1300, 1900 ] 37 0.000% 99.960% ( 1900, 2900 ] 3724 0.040% 100.000% ( 2900, 4400 ] 18 0.000% 100.000% ( 4400, 6600 ] 4 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 1 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 13 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 191449 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9389999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9690478968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 443 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33445098 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 26161962849 rocksdb.compact.write.bytes COUNT : 25978696550 rocksdb.flush.write.bytes COUNT : 9644414207 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 42 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 260 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9566584832 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3656704 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 26244101654 rocksdb.non.last.level.read.count COUNT : 6341193 rocksdb.block.checksum.compute.count COUNT : 6340349 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.425899 P95 : 4.035212 P99 : 9.205915 P100 : 786765.000000 COUNT : 9389999 SUM : 55564739 rocksdb.compaction.times.micros P50 : 1090322.580645 P95 : 3985000.000000 P99 : 17360000.000000 P100 : 18497573.000000 COUNT : 58 SUM : 99295751 rocksdb.compaction.times.cpu_micros P50 : 980645.161290 P95 : 3880000.000000 P99 : 17219321.000000 P100 : 17219321.000000 COUNT : 58 SUM : 88264659 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 685.273973 P95 : 1435.000000 P99 : 58625.000000 P100 : 73970.000000 COUNT : 131 SUM : 257529 rocksdb.compaction.outfile.sync.micros P50 : 957.500000 P95 : 81781.250000 P99 : 153800.000000 P100 : 173282.000000 COUNT : 289 SUM : 3121048 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 97.013889 P95 : 536.666667 P99 : 2770.000000 P100 : 5430.000000 COUNT : 213 SUM : 43488 rocksdb.table.open.io.micros P50 : 1417.567568 P95 : 8060.250000 P99 : 12348.818182 P100 : 13305.000000 COUNT : 443 SUM : 933393 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.509442 P95 : 6.721483 P99 : 9.938179 P100 : 8475.000000 COUNT : 6339225 SUM : 32064637 rocksdb.read.block.get.micros P50 : 451.910112 P95 : 3537.500000 P99 : 6116.000000 P100 : 7881.000000 COUNT : 886 SUM : 771153 rocksdb.write.raw.block.micros P50 : 0.512482 P95 : 0.973717 P99 : 2.924984 P100 : 9935.000000 COUNT : 8627815 SUM : 16241022 rocksdb.numfiles.in.singlecompaction P50 : 3.442623 P95 : 6.600000 P99 : 35.020000 P100 : 48.000000 COUNT : 94 SUM : 420 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.565941 P95 : 1159.601698 P99 : 2348.001076 P100 : 786510.000000 COUNT : 208178 SUM : 33469179 rocksdb.sst.read.micros P50 : 1.499799 P95 : 3.924352 P99 : 7.641832 P100 : 8468.000000 COUNT : 6341557 SUM : 19576408 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9389999 SUM : 9690478968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 207303.370787 P95 : 364500.000000 P99 : 555275.000000 P100 : 935908.000000 COUNT : 131 SUM : 27293140 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 276 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0