[2024-12-06 05:15:32.262702] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-06 05:15:32.262825] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2761603 ] Set seed to 1733458532260513 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-06 05:15:32.371373] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-06 05:15:32.400709] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-06 05:15:32.400757] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2761603' to capture a snapshot of events at runtime. [2024-12-06 05:15:32.400773] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2761603 for offline analysis/debug. [2024-12-06 05:15:32.400801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Dec 6 05:15:33 2024 CPU: 144 * Intel(R) Xeon(R) Platinum 8360Y CPU @ 2.40GHz CPUCache: 55296 KB 2024/12/06-05:15:36 ... thread 0: (1000000,1000000) ops and (337416.2,337416.2) ops/second in (2.963699,2.963699) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 567.03 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 474.7 1.86 1.70 14 0.133 0 0 0.0 0.0 L1 3/3 188.86 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 270.0 269.7 0.70 0.69 1 0.700 191K 140 0.0 0.0 L2 2/1 125.96 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.1 2.0 252.2 252.1 0.50 0.49 1 0.500 127K 42 0.0 0.0 L3 11/0 867.26 MB 0.9 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 120/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1132/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1277/12 97.00 GB 0.0 0.3 0.2 0.1 1.2 1.1 0.4 1.4 103.0 391.4 3.06 2.88 16 0.191 319K 182 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.2 1.1 0.4 1.4 103.0 391.4 3.06 2.88 16 0.191 319K 182 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 262.6 262.4 1.20 1.18 2 0.600 319K 182 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 474.7 1.86 1.70 14 0.133 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.17 GB write, 376.61 MB/s write, 0.31 GB read, 99.12 MB/s read, 3.1 seconds Interval compaction: 1.17 GB write, 403.54 MB/s write, 0.31 GB read, 106.21 MB/s read, 3.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 0, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 0, ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 145839 Average: 1.9087 StdDev: 4.69 Min: 0 Median: 1.3524 Max: 1378 Percentiles: P50: 1.35 P75: 1.74 P99: 4.42 P99.9: 9.13 P99.99: 139.61 ------------------------------------------------------ [ 0, 1 ] 39605 27.157% 27.157% ##### ( 1, 2 ] 94545 64.828% 91.985% ############# ( 2, 3 ] 7528 5.162% 97.147% # ( 3, 4 ] 2440 1.673% 98.820% ( 4, 6 ] 1266 0.868% 99.688% ( 6, 10 ] 400 0.274% 99.962% ( 10, 15 ] 26 0.018% 99.980% ( 15, 22 ] 5 0.003% 99.984% ( 22, 34 ] 3 0.002% 99.986% ( 34, 51 ] 1 0.001% 99.986% ( 51, 76 ] 2 0.001% 99.988% ( 76, 110 ] 1 0.001% 99.988% ( 110, 170 ] 13 0.009% 99.997% ( 170, 250 ] 7 0.005% 100.002% ( 250, 380 ] 7 0.005% 100.007% ( 1300, 1900 ] 1 0.001% 100.008% ** Level 1 read latency histogram (micros): Count: 38225 Average: 1.9089 StdDev: 3.17 Min: 1 Median: 1.3733 Max: 388 Percentiles: P50: 1.37 P75: 1.75 P99: 3.99 P99.9: 8.58 P99.99: 120.65 ------------------------------------------------------ [ 0, 1 ] 9525 24.918% 24.918% ##### ( 1, 2 ] 25685 67.194% 92.112% ############# ( 2, 3 ] 1883 4.926% 97.039% # ( 3, 4 ] 755 1.975% 99.014% ( 4, 6 ] 291 0.761% 99.775% ( 6, 10 ] 74 0.194% 99.969% ( 10, 15 ] 3 0.008% 99.976% ( 15, 22 ] 4 0.010% 99.987% ( 22, 34 ] 1 0.003% 99.990% ( 110, 170 ] 1 0.003% 99.992% ( 250, 380 ] 2 0.005% 99.997% ( 380, 580 ] 1 0.003% 100.000% ** Level 2 read latency histogram (micros): Count: 23598 Average: 2.5011 StdDev: 15.95 Min: 1 Median: 1.5107 Max: 1173 Percentiles: P50: 1.51 P75: 1.91 P99: 5.95 P99.9: 14.86 P99.99: 961.76 ------------------------------------------------------ [ 0, 1 ] 4268 18.086% 18.086% #### ( 1, 2 ] 14747 62.493% 80.579% ############ ( 2, 3 ] 2384 10.103% 90.681% ## ( 3, 4 ] 1327 5.623% 96.305% # ( 4, 6 ] 655 2.776% 99.080% # ( 6, 10 ] 174 0.737% 99.818% ( 10, 15 ] 21 0.089% 99.907% ( 15, 22 ] 6 0.025% 99.932% ( 22, 34 ] 3 0.013% 99.945% ( 51, 76 ] 1 0.004% 99.949% ( 76, 110 ] 2 0.008% 99.958% ( 170, 250 ] 1 0.004% 99.962% ( 250, 380 ] 2 0.008% 99.970% ( 380, 580 ] 3 0.013% 99.983% ( 580, 870 ] 2 0.008% 99.992% ( 870, 1300 ] 3 0.013% 100.004% ** Level 3 read latency histogram (micros): Count: 45 Average: 975.6000 StdDev: 494.99 Min: 140 Median: 893.8889 Max: 2151 Percentiles: P50: 893.89 P75: 1437.50 P99: 2151.00 P99.9: 2151.00 P99.99: 2151.00 ------------------------------------------------------ ( 110, 170 ] 1 2.222% 2.222% ( 250, 380 ] 5 11.111% 13.333% ## ( 380, 580 ] 4 8.889% 22.222% ## ( 580, 870 ] 12 26.667% 48.889% ##### ( 870, 1300 ] 9 20.000% 68.889% #### ( 1300, 1900 ] 12 26.667% 95.556% ##### ( 1900, 2900 ] 2 4.444% 100.000% # ** Level 4 read latency histogram (micros): Count: 25 Average: 1127.7200 StdDev: 542.74 Min: 313 Median: 1037.2222 Max: 2383 Percentiles: P50: 1037.22 P75: 1450.00 P99: 2383.00 P99.9: 2383.00 P99.99: 2383.00 ------------------------------------------------------ ( 250, 380 ] 1 4.000% 4.000% # ( 580, 870 ] 8 32.000% 36.000% ###### ( 870, 1300 ] 9 36.000% 72.000% ####### ( 1300, 1900 ] 3 12.000% 84.000% ## ( 1900, 2900 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 309.67 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/06-05:15:39 ... thread 0: (1000000,2000000) ops and (375011.6,355221.9) ops/second in (2.666584,5.630283) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.29 GB 100.7 0.8 0.0 0.8 2.6 1.8 0.0 1.4 114.6 370.1 7.15 6.67 31 0.231 831K 895 0.0 0.0 L1 1/0 3.38 MB 0.3 0.6 0.4 0.2 0.6 0.4 0.1 1.5 269.9 269.6 2.10 2.06 2 1.050 575K 617 0.0 0.0 L2 2/2 117.56 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 252.2 252.1 0.50 0.49 1 0.500 127K 42 0.0 0.0 L3 75/33 1.22 GB 0.3 0.5 0.4 0.1 0.5 0.4 0.2 1.3 219.9 219.7 2.25 2.09 2 1.125 502K 359 0.0 0.0 L4 120/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1132/0 85.75 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1340/39 97.92 GB 0.0 2.0 0.8 1.2 3.7 2.6 0.7 2.1 167.3 319.4 12.00 11.31 36 0.333 2037K 1913 0.0 0.0 Int 0/0 0.00 KB 0.0 2.0 0.8 1.2 3.7 2.6 0.7 2.1 167.3 319.4 12.00 11.31 36 0.333 2037K 1913 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.0 0.8 1.2 2.0 0.8 0.0 0.0 262.5 262.2 7.65 7.38 8 0.956 2037K 1913 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 419.9 4.35 3.93 28 0.155 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 5.8 total, 5.6 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.74 GB write, 655.59 MB/s write, 1.96 GB read, 343.32 MB/s read, 12.0 seconds Interval compaction: 3.74 GB write, 680.27 MB/s write, 1.96 GB read, 356.25 MB/s read, 12.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 389800 Average: 1.9509 StdDev: 5.87 Min: 0 Median: 1.3462 Max: 1595 Percentiles: P50: 1.35 P75: 1.78 P99: 4.92 P99.9: 9.11 P99.99: 20.96 ------------------------------------------------------ [ 0, 1 ] 116605 29.914% 29.914% ###### ( 1, 2 ] 226128 58.011% 87.925% ############ ( 2, 3 ] 29655 7.608% 95.533% ## ( 3, 4 ] 11296 2.898% 98.431% # ( 4, 6 ] 4799 1.231% 99.662% ( 6, 10 ] 1192 0.306% 99.968% ( 10, 15 ] 70 0.018% 99.986% ( 15, 22 ] 20 0.005% 99.991% ( 22, 34 ] 8 0.002% 99.993% ( 34, 51 ] 4 0.001% 99.994% ( 51, 76 ] 7 0.002% 99.996% ( 76, 110 ] 1 0.000% 99.996% ( 110, 170 ] 22 0.006% 100.002% ( 170, 250 ] 12 0.003% 100.005% ( 250, 380 ] 21 0.005% 100.010% ( 380, 580 ] 1 0.000% 100.011% ( 580, 870 ] 3 0.001% 100.011% ( 870, 1300 ] 1 0.000% 100.012% ( 1300, 1900 ] 3 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 141966 Average: 2.0890 StdDev: 3.06 Min: 1 Median: 1.4729 Max: 537 Percentiles: P50: 1.47 P75: 1.86 P99: 5.26 P99.9: 9.27 P99.99: 25.21 ------------------------------------------------------ [ 0, 1 ] 27801 19.583% 19.583% #### ( 1, 2 ] 91321 64.326% 83.909% ############# ( 2, 3 ] 13787 9.711% 93.620% ## ( 3, 4 ] 6154 4.335% 97.955% # ( 4, 6 ] 2361 1.663% 99.618% ( 6, 10 ] 490 0.345% 99.963% ( 10, 15 ] 25 0.018% 99.981% ( 15, 22 ] 12 0.008% 99.989% ( 22, 34 ] 3 0.002% 99.992% ( 34, 51 ] 2 0.001% 99.993% ( 110, 170 ] 1 0.001% 99.994% ( 250, 380 ] 6 0.004% 99.998% ( 380, 580 ] 3 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 66473 Average: 2.2745 StdDev: 12.23 Min: 0 Median: 1.2764 Max: 1173 Percentiles: P50: 1.28 P75: 1.78 P99: 5.70 P99.9: 158.82 P99.99: 525.09 ------------------------------------------------------ [ 0, 1 ] 24184 36.382% 36.382% ####### ( 1, 2 ] 32750 49.268% 85.650% ########## ( 2, 3 ] 5475 8.236% 93.886% ## ( 3, 4 ] 2269 3.413% 97.300% # ( 4, 6 ] 1329 1.999% 99.299% ( 6, 10 ] 285 0.429% 99.728% ( 10, 15 ] 26 0.039% 99.767% ( 15, 22 ] 9 0.014% 99.780% ( 22, 34 ] 3 0.005% 99.785% ( 34, 51 ] 24 0.036% 99.821% ( 51, 76 ] 28 0.042% 99.863% ( 76, 110 ] 5 0.008% 99.871% ( 110, 170 ] 24 0.036% 99.907% ( 170, 250 ] 36 0.054% 99.961% ( 250, 380 ] 15 0.023% 99.983% ( 380, 580 ] 6 0.009% 99.992% ( 580, 870 ] 2 0.003% 99.995% ( 870, 1300 ] 3 0.005% 100.000% ** Level 3 read latency histogram (micros): Count: 216111 Average: 2.3934 StdDev: 18.16 Min: 0 Median: 1.1765 Max: 2151 Percentiles: P50: 1.18 P75: 1.75 P99: 5.77 P99.9: 164.86 P99.99: 664.85 ------------------------------------------------------ [ 0, 1 ] 91532 42.354% 42.354% ######## ( 1, 2 ] 93619 43.320% 85.674% ######### ( 2, 3 ] 18742 8.672% 94.346% ## ( 3, 4 ] 6466 2.992% 97.338% # ( 4, 6 ] 4061 1.879% 99.218% ( 6, 10 ] 855 0.396% 99.613% ( 10, 15 ] 89 0.041% 99.654% ( 15, 22 ] 78 0.036% 99.690% ( 22, 34 ] 37 0.017% 99.708% ( 34, 51 ] 147 0.068% 99.776% ( 51, 76 ] 53 0.025% 99.800% ( 76, 110 ] 77 0.036% 99.836% ( 110, 170 ] 153 0.071% 99.907% ( 170, 250 ] 127 0.059% 99.965% ( 250, 380 ] 40 0.019% 99.984% ( 380, 580 ] 10 0.005% 99.988% ( 580, 870 ] 15 0.007% 99.995% ( 870, 1300 ] 9 0.004% 100.000% ( 1300, 1900 ] 13 0.006% 100.006% ( 1900, 2900 ] 2 0.001% 100.006% ** Level 4 read latency histogram (micros): Count: 25 Average: 1127.7200 StdDev: 542.74 Min: 313 Median: 1037.2222 Max: 2383 Percentiles: P50: 1037.22 P75: 1450.00 P99: 2383.00 P99.9: 2383.00 P99.99: 2383.00 ------------------------------------------------------ ( 250, 380 ] 1 4.000% 4.000% # ( 580, 870 ] 8 32.000% 36.000% ###### ( 870, 1300 ] 9 36.000% 72.000% ####### ( 1300, 1900 ] 3 12.000% 84.000% ## ( 1900, 2900 ] 4 16.000% 100.000% ### ** DB Stats ** Uptime(secs): 5.8 total, 2.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 336.79 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.220 H:M:S, 3.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 369.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.220 H:M:S, 8.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/06-05:15:42 ... thread 0: (1000000,3000000) ops and (350387.6,353595.7) ops/second in (2.853982,8.484265) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 2.27 GB 25.2 1.8 0.0 1.8 4.6 2.8 0.0 1.7 149.0 372.5 12.68 11.93 51 0.249 1919K 1975 0.0 0.0 L1 1/1 3.38 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.5 269.9 269.6 2.10 2.06 2 1.050 575K 617 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 252.2 252.1 0.50 0.49 1 0.500 127K 42 0.0 0.0 L3 21/0 917.61 MB 0.9 1.5 0.5 1.0 1.5 0.5 0.2 3.0 280.0 279.7 5.45 5.12 4 1.362 1515K 1490 0.0 0.0 L4 173/0 9.66 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 289.7 289.8 0.44 0.40 1 0.440 113K 0 0.0 0.0 L5 1136/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1345/14 98.90 GB 0.0 4.1 1.0 3.1 6.9 3.8 1.3 2.5 200.1 333.8 21.17 20.01 59 0.359 4251K 4124 0.0 0.0 Int 0/0 0.00 KB 0.0 4.1 1.0 3.1 6.9 3.8 1.3 2.5 200.1 333.8 21.17 20.01 59 0.359 4251K 4124 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.1 1.0 3.1 4.1 1.0 0.0 0.0 294.2 293.9 14.40 13.87 15 0.960 4251K 4124 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 418.7 6.77 6.14 44 0.154 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.7 total, 8.5 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.90 GB write, 812.37 MB/s write, 4.14 GB read, 486.95 MB/s read, 21.2 seconds Interval compaction: 6.90 GB write, 832.66 MB/s write, 4.14 GB read, 499.12 MB/s read, 21.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 705073 Average: 1.9021 StdDev: 5.90 Min: 0 Median: 1.2964 Max: 1595 Percentiles: P50: 1.30 P75: 1.74 P99: 4.50 P99.9: 8.88 P99.99: 12.56 ------------------------------------------------------ [ 0, 1 ] 235448 33.393% 33.393% ####### ( 1, 2 ] 395011 56.024% 89.418% ########### ( 2, 3 ] 48585 6.891% 96.308% # ( 3, 4 ] 17355 2.461% 98.770% ( 4, 6 ] 6550 0.929% 99.699% ( 6, 10 ] 1970 0.279% 99.978% ( 10, 15 ] 165 0.023% 100.002% ( 15, 22 ] 31 0.004% 100.006% ( 22, 34 ] 14 0.002% 100.008% ( 34, 51 ] 7 0.001% 100.009% ( 51, 76 ] 7 0.001% 100.010% ( 76, 110 ] 4 0.001% 100.010% ( 110, 170 ] 73 0.010% 100.021% ( 170, 250 ] 38 0.005% 100.026% ( 250, 380 ] 38 0.005% 100.032% ( 380, 580 ] 5 0.001% 100.032% ( 580, 870 ] 8 0.001% 100.033% ( 870, 1300 ] 2 0.000% 100.034% ( 1300, 1900 ] 4 0.001% 100.034% ** Level 1 read latency histogram (micros): Count: 142923 Average: 2.0891 StdDev: 3.05 Min: 1 Median: 1.4731 Max: 537 Percentiles: P50: 1.47 P75: 1.86 P99: 5.26 P99.9: 9.27 P99.99: 24.83 ------------------------------------------------------ [ 0, 1 ] 27953 19.558% 19.558% #### ( 1, 2 ] 91972 64.351% 83.909% ############# ( 2, 3 ] 13876 9.709% 93.618% ## ( 3, 4 ] 6201 4.339% 97.956% # ( 4, 6 ] 2374 1.661% 99.617% ( 6, 10 ] 495 0.346% 99.964% ( 10, 15 ] 25 0.017% 99.981% ( 15, 22 ] 12 0.008% 99.990% ( 22, 34 ] 3 0.002% 99.992% ( 34, 51 ] 2 0.001% 99.993% ( 110, 170 ] 1 0.001% 99.994% ( 250, 380 ] 6 0.004% 99.998% ( 380, 580 ] 3 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 76268 Average: 2.1841 StdDev: 11.42 Min: 0 Median: 1.2302 Max: 1173 Percentiles: P50: 1.23 P75: 1.76 P99: 5.62 P99.9: 134.33 P99.99: 492.44 ------------------------------------------------------ [ 0, 1 ] 29825 39.106% 39.106% ######## ( 1, 2 ] 36097 47.329% 86.435% ######### ( 2, 3 ] 5977 7.837% 94.272% ## ( 3, 4 ] 2402 3.149% 97.421% # ( 4, 6 ] 1484 1.946% 99.367% ( 6, 10 ] 301 0.395% 99.761% ( 10, 15 ] 26 0.034% 99.795% ( 15, 22 ] 9 0.012% 99.807% ( 22, 34 ] 3 0.004% 99.811% ( 34, 51 ] 25 0.033% 99.844% ( 51, 76 ] 28 0.037% 99.881% ( 76, 110 ] 5 0.007% 99.887% ( 110, 170 ] 24 0.031% 99.919% ( 170, 250 ] 36 0.047% 99.966% ( 250, 380 ] 15 0.020% 99.986% ( 380, 580 ] 6 0.008% 99.993% ( 580, 870 ] 2 0.003% 99.996% ( 870, 1300 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 248954 Average: 2.3205 StdDev: 17.18 Min: 0 Median: 1.1549 Max: 2151 Percentiles: P50: 1.15 P75: 1.73 P99: 5.67 P99.9: 158.88 P99.99: 618.15 ------------------------------------------------------ [ 0, 1 ] 107803 43.302% 43.302% ######### ( 1, 2 ] 107619 43.228% 86.531% ######### ( 2, 3 ] 20522 8.243% 94.774% ## ( 3, 4 ] 6949 2.791% 97.565% # ( 4, 6 ] 4275 1.717% 99.283% ( 6, 10 ] 909 0.365% 99.648% ( 10, 15 ] 94 0.038% 99.685% ( 15, 22 ] 80 0.032% 99.718% ( 22, 34 ] 39 0.016% 99.733% ( 34, 51 ] 148 0.059% 99.793% ( 51, 76 ] 53 0.021% 99.814% ( 76, 110 ] 78 0.031% 99.845% ( 110, 170 ] 167 0.067% 99.912% ( 170, 250 ] 132 0.053% 99.965% ( 250, 380 ] 47 0.019% 99.984% ( 380, 580 ] 12 0.005% 99.989% ( 580, 870 ] 16 0.006% 99.996% ( 870, 1300 ] 9 0.004% 99.999% ( 1300, 1900 ] 13 0.005% 100.004% ( 1900, 2900 ] 2 0.001% 100.005% ** Level 4 read latency histogram (micros): Count: 110 Average: 265.0636 StdDev: 535.35 Min: 0 Median: 2.0000 Max: 2383 Percentiles: P50: 2.00 P75: 132.50 P99: 2383.00 P99.9: 2383.00 P99.99: 2383.00 ------------------------------------------------------ [ 0, 1 ] 51 46.364% 46.364% ######### ( 1, 2 ] 4 3.636% 50.000% # ( 2, 3 ] 4 3.636% 53.636% # ( 3, 4 ] 4 3.636% 57.273% # ( 6, 10 ] 6 5.455% 62.727% # ( 10, 15 ] 5 4.545% 67.273% # ( 15, 22 ] 6 5.455% 72.727% # ( 76, 110 ] 1 0.909% 73.636% ( 110, 170 ] 4 3.636% 77.273% # ( 250, 380 ] 1 0.909% 78.182% ( 580, 870 ] 8 7.273% 85.455% # ( 870, 1300 ] 9 8.182% 93.636% ## ( 1300, 1900 ] 3 2.727% 96.364% # ( 1900, 2900 ] 4 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 404.0000 StdDev: 318.49 Min: 127 Median: 240.0000 Max: 1322 Percentiles: P50: 240.00 P75: 580.00 P99: 1322.00 P99.9: 1322.00 P99.99: 1322.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 8 40.000% 55.000% ######## ( 250, 380 ] 3 15.000% 70.000% ### ( 380, 580 ] 1 5.000% 75.000% # ( 580, 870 ] 2 10.000% 85.000% ## ( 870, 1300 ] 2 10.000% 95.000% ## ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 8.7 total, 2.9 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 339.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.220 H:M:S, 2.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 344.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-05:15:45 ... thread 0: (1000000,4000000) ops and (356579.7,354337.0) ops/second in (2.804422,11.288687) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.26 GB 119.6 2.6 0.0 2.6 6.4 3.7 0.0 1.7 154.4 373.2 17.55 16.52 67 0.262 2750K 2858 0.0 0.0 L1 1/1 3.38 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.5 269.9 269.6 2.10 2.06 2 1.050 575K 617 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 252.2 252.1 0.50 0.49 1 0.500 127K 42 0.0 0.0 L3 21/0 917.61 MB 0.9 1.5 0.5 1.0 1.5 0.5 0.2 3.0 280.0 279.7 5.45 5.12 4 1.362 1515K 1490 0.0 0.0 L4 173/0 9.66 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 289.7 289.8 0.44 0.40 1 0.440 113K 0 0.0 0.0 L5 1136/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1349/14 99.88 GB 0.0 4.9 1.0 3.9 8.7 4.8 1.3 2.3 194.1 341.5 26.04 24.59 75 0.347 5082K 5007 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 1.0 3.9 8.7 4.8 1.3 2.3 194.1 341.5 26.04 24.59 75 0.347 5082K 5007 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 1.0 3.9 4.9 1.0 0.0 0.0 303.3 303.0 16.66 16.08 18 0.926 5082K 5007 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 410.0 9.37 8.51 57 0.164 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 11.5 total, 11.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.68 GB write, 773.05 MB/s write, 4.94 GB read, 439.43 MB/s read, 26.0 seconds Interval compaction: 8.68 GB write, 787.57 MB/s write, 4.94 GB read, 447.68 MB/s read, 26.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 8, interval: 8 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1120743 Average: 1.8238 StdDev: 5.94 Min: 0 Median: 1.2173 Max: 1595 Percentiles: P50: 1.22 P75: 1.70 P99: 4.20 P99.9: 8.49 P99.99: 9.94 ------------------------------------------------------ [ 0, 1 ] 433306 38.662% 38.662% ######## ( 1, 2 ] 584665 52.168% 90.830% ########## ( 2, 3 ] 67824 6.052% 96.882% # ( 3, 4 ] 22800 2.034% 98.916% ( 4, 6 ] 9306 0.830% 99.746% ( 6, 10 ] 2771 0.247% 99.994% ( 10, 15 ] 207 0.018% 100.012% ( 15, 22 ] 38 0.003% 100.016% ( 22, 34 ] 22 0.002% 100.017% ( 34, 51 ] 9 0.001% 100.018% ( 51, 76 ] 9 0.001% 100.019% ( 76, 110 ] 22 0.002% 100.021% ( 110, 170 ] 97 0.009% 100.030% ( 170, 250 ] 53 0.005% 100.034% ( 250, 380 ] 52 0.005% 100.039% ( 380, 580 ] 11 0.001% 100.040% ( 580, 870 ] 10 0.001% 100.041% ( 870, 1300 ] 4 0.000% 100.041% ( 1300, 1900 ] 8 0.001% 100.042% ** Level 1 read latency histogram (micros): Count: 142923 Average: 2.0891 StdDev: 3.05 Min: 1 Median: 1.4731 Max: 537 Percentiles: P50: 1.47 P75: 1.86 P99: 5.26 P99.9: 9.27 P99.99: 24.83 ------------------------------------------------------ [ 0, 1 ] 27953 19.558% 19.558% #### ( 1, 2 ] 91972 64.351% 83.909% ############# ( 2, 3 ] 13876 9.709% 93.618% ## ( 3, 4 ] 6201 4.339% 97.956% # ( 4, 6 ] 2374 1.661% 99.617% ( 6, 10 ] 495 0.346% 99.964% ( 10, 15 ] 25 0.017% 99.981% ( 15, 22 ] 12 0.008% 99.990% ( 22, 34 ] 3 0.002% 99.992% ( 34, 51 ] 2 0.001% 99.993% ( 110, 170 ] 1 0.001% 99.994% ( 250, 380 ] 6 0.004% 99.998% ( 380, 580 ] 3 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 76268 Average: 2.1841 StdDev: 11.42 Min: 0 Median: 1.2302 Max: 1173 Percentiles: P50: 1.23 P75: 1.76 P99: 5.62 P99.9: 134.33 P99.99: 492.44 ------------------------------------------------------ [ 0, 1 ] 29825 39.106% 39.106% ######## ( 1, 2 ] 36097 47.329% 86.435% ######### ( 2, 3 ] 5977 7.837% 94.272% ## ( 3, 4 ] 2402 3.149% 97.421% # ( 4, 6 ] 1484 1.946% 99.367% ( 6, 10 ] 301 0.395% 99.761% ( 10, 15 ] 26 0.034% 99.795% ( 15, 22 ] 9 0.012% 99.807% ( 22, 34 ] 3 0.004% 99.811% ( 34, 51 ] 25 0.033% 99.844% ( 51, 76 ] 28 0.037% 99.881% ( 76, 110 ] 5 0.007% 99.887% ( 110, 170 ] 24 0.031% 99.919% ( 170, 250 ] 36 0.047% 99.966% ( 250, 380 ] 15 0.020% 99.986% ( 380, 580 ] 6 0.008% 99.993% ( 580, 870 ] 2 0.003% 99.996% ( 870, 1300 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 248954 Average: 2.3205 StdDev: 17.18 Min: 0 Median: 1.1549 Max: 2151 Percentiles: P50: 1.15 P75: 1.73 P99: 5.67 P99.9: 158.88 P99.99: 618.15 ------------------------------------------------------ [ 0, 1 ] 107803 43.302% 43.302% ######### ( 1, 2 ] 107619 43.228% 86.531% ######### ( 2, 3 ] 20522 8.243% 94.774% ## ( 3, 4 ] 6949 2.791% 97.565% # ( 4, 6 ] 4275 1.717% 99.283% ( 6, 10 ] 909 0.365% 99.648% ( 10, 15 ] 94 0.038% 99.685% ( 15, 22 ] 80 0.032% 99.718% ( 22, 34 ] 39 0.016% 99.733% ( 34, 51 ] 148 0.059% 99.793% ( 51, 76 ] 53 0.021% 99.814% ( 76, 110 ] 78 0.031% 99.845% ( 110, 170 ] 167 0.067% 99.912% ( 170, 250 ] 132 0.053% 99.965% ( 250, 380 ] 47 0.019% 99.984% ( 380, 580 ] 12 0.005% 99.989% ( 580, 870 ] 16 0.006% 99.996% ( 870, 1300 ] 9 0.004% 99.999% ( 1300, 1900 ] 13 0.005% 100.004% ( 1900, 2900 ] 2 0.001% 100.005% ** Level 4 read latency histogram (micros): Count: 110 Average: 265.0636 StdDev: 535.35 Min: 0 Median: 2.0000 Max: 2383 Percentiles: P50: 2.00 P75: 132.50 P99: 2383.00 P99.9: 2383.00 P99.99: 2383.00 ------------------------------------------------------ [ 0, 1 ] 51 46.364% 46.364% ######### ( 1, 2 ] 4 3.636% 50.000% # ( 2, 3 ] 4 3.636% 53.636% # ( 3, 4 ] 4 3.636% 57.273% # ( 6, 10 ] 6 5.455% 62.727% # ( 10, 15 ] 5 4.545% 67.273% # ( 15, 22 ] 6 5.455% 72.727% # ( 76, 110 ] 1 0.909% 73.636% ( 110, 170 ] 4 3.636% 77.273% # ( 250, 380 ] 1 0.909% 78.182% ( 580, 870 ] 8 7.273% 85.455% # ( 870, 1300 ] 9 8.182% 93.636% ## ( 1300, 1900 ] 3 2.727% 96.364% # ( 1900, 2900 ] 4 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 404.0000 StdDev: 318.49 Min: 127 Median: 240.0000 Max: 1322 Percentiles: P50: 240.00 P75: 580.00 P99: 1322.00 P99.9: 1322.00 P99.99: 1322.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 8 40.000% 55.000% ######## ( 250, 380 ] 3 15.000% 70.000% ### ( 380, 580 ] 1 5.000% 75.000% # ( 580, 870 ] 2 10.000% 85.000% ## ( 870, 1300 ] 2 10.000% 95.000% ## ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 11.5 total, 2.8 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 342.24 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.815 H:M:S, 7.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 350.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.596 H:M:S, 21.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-05:15:48 ... thread 0: (1000000,5000000) ops and (302680.5,342641.7) ops/second in (3.303814,14.592501) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/18 2.40 GB 0.0 3.2 0.0 3.2 7.9 4.7 0.0 1.7 155.0 381.4 21.13 19.89 84 0.252 3326K 3440 0.0 0.0 L1 17/17 1.77 GB 0.0 2.3 2.2 0.2 2.3 2.1 0.1 1.1 283.0 281.1 8.47 8.24 3 2.822 2432K 15K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 252.2 252.1 0.50 0.49 1 0.500 127K 42 0.0 0.0 L3 21/0 917.61 MB 0.9 1.5 0.5 1.0 1.5 0.5 0.2 3.0 280.0 279.7 5.45 5.12 4 1.362 1515K 1490 0.0 0.0 L4 173/0 9.66 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 289.7 289.8 0.44 0.40 1 0.440 113K 0 0.0 0.0 L5 1136/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1365/35 100.79 GB 0.0 7.3 2.8 4.4 11.9 7.5 1.3 2.6 207.0 339.5 35.99 34.14 93 0.387 7515K 20K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.3 2.8 4.4 11.9 7.5 1.3 2.6 207.0 339.5 35.99 34.14 93 0.387 7515K 20K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.3 2.8 4.4 7.3 2.8 0.0 0.0 302.9 302.0 24.60 23.80 21 1.171 7515K 20K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 420.5 11.39 10.34 72 0.158 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.8 total, 14.6 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 11.93 GB write, 825.09 MB/s write, 7.28 GB read, 503.17 MB/s read, 36.0 seconds Interval compaction: 11.93 GB write, 837.07 MB/s write, 7.28 GB read, 510.48 MB/s read, 36.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 8, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 8, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1521051 Average: 1.8079 StdDev: 6.41 Min: 0 Median: 1.1517 Max: 1595 Percentiles: P50: 1.15 P75: 1.66 P99: 4.10 P99.9: 8.66 P99.99: 17.27 ------------------------------------------------------ [ 0, 1 ] 647153 42.546% 42.546% ######### ( 1, 2 ] 747536 49.146% 91.692% ########## ( 2, 3 ] 83106 5.464% 97.156% # ( 3, 4 ] 27420 1.803% 98.959% ( 4, 6 ] 12209 0.803% 99.762% ( 6, 10 ] 3170 0.208% 99.970% ( 10, 15 ] 292 0.019% 99.989% ( 15, 22 ] 46 0.003% 99.992% ( 22, 34 ] 26 0.002% 99.994% ( 34, 51 ] 16 0.001% 99.995% ( 51, 76 ] 10 0.001% 99.996% ( 76, 110 ] 80 0.005% 100.001% ( 110, 170 ] 230 0.015% 100.016% ( 170, 250 ] 203 0.013% 100.029% ( 250, 380 ] 106 0.007% 100.036% ( 380, 580 ] 22 0.001% 100.038% ( 580, 870 ] 16 0.001% 100.039% ( 870, 1300 ] 5 0.000% 100.039% ( 1300, 1900 ] 9 0.001% 100.040% ** Level 1 read latency histogram (micros): Count: 185259 Average: 2.2131 StdDev: 8.10 Min: 0 Median: 1.3799 Max: 584 Percentiles: P50: 1.38 P75: 1.81 P99: 5.41 P99.9: 125.79 P99.99: 372.18 ------------------------------------------------------ [ 0, 1 ] 51855 27.991% 27.991% ###### ( 1, 2 ] 107337 57.939% 85.929% ############ ( 2, 3 ] 15174 8.191% 94.120% ## ( 3, 4 ] 6846 3.695% 97.815% # ( 4, 6 ] 3102 1.674% 99.490% ( 6, 10 ] 626 0.338% 99.828% ( 10, 15 ] 56 0.030% 99.858% ( 15, 22 ] 17 0.009% 99.867% ( 22, 34 ] 6 0.003% 99.870% ( 34, 51 ] 5 0.003% 99.873% ( 76, 110 ] 30 0.016% 99.889% ( 110, 170 ] 75 0.040% 99.930% ( 170, 250 ] 72 0.039% 99.969% ( 250, 380 ] 42 0.023% 99.991% ( 380, 580 ] 15 0.008% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 76268 Average: 2.1841 StdDev: 11.42 Min: 0 Median: 1.2302 Max: 1173 Percentiles: P50: 1.23 P75: 1.76 P99: 5.62 P99.9: 134.33 P99.99: 492.44 ------------------------------------------------------ [ 0, 1 ] 29825 39.106% 39.106% ######## ( 1, 2 ] 36097 47.329% 86.435% ######### ( 2, 3 ] 5977 7.837% 94.272% ## ( 3, 4 ] 2402 3.149% 97.421% # ( 4, 6 ] 1484 1.946% 99.367% ( 6, 10 ] 301 0.395% 99.761% ( 10, 15 ] 26 0.034% 99.795% ( 15, 22 ] 9 0.012% 99.807% ( 22, 34 ] 3 0.004% 99.811% ( 34, 51 ] 25 0.033% 99.844% ( 51, 76 ] 28 0.037% 99.881% ( 76, 110 ] 5 0.007% 99.887% ( 110, 170 ] 24 0.031% 99.919% ( 170, 250 ] 36 0.047% 99.966% ( 250, 380 ] 15 0.020% 99.986% ( 380, 580 ] 6 0.008% 99.993% ( 580, 870 ] 2 0.003% 99.996% ( 870, 1300 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 248954 Average: 2.3205 StdDev: 17.18 Min: 0 Median: 1.1549 Max: 2151 Percentiles: P50: 1.15 P75: 1.73 P99: 5.67 P99.9: 158.88 P99.99: 618.15 ------------------------------------------------------ [ 0, 1 ] 107803 43.302% 43.302% ######### ( 1, 2 ] 107619 43.228% 86.531% ######### ( 2, 3 ] 20522 8.243% 94.774% ## ( 3, 4 ] 6949 2.791% 97.565% # ( 4, 6 ] 4275 1.717% 99.283% ( 6, 10 ] 909 0.365% 99.648% ( 10, 15 ] 94 0.038% 99.685% ( 15, 22 ] 80 0.032% 99.718% ( 22, 34 ] 39 0.016% 99.733% ( 34, 51 ] 148 0.059% 99.793% ( 51, 76 ] 53 0.021% 99.814% ( 76, 110 ] 78 0.031% 99.845% ( 110, 170 ] 167 0.067% 99.912% ( 170, 250 ] 132 0.053% 99.965% ( 250, 380 ] 47 0.019% 99.984% ( 380, 580 ] 12 0.005% 99.989% ( 580, 870 ] 16 0.006% 99.996% ( 870, 1300 ] 9 0.004% 99.999% ( 1300, 1900 ] 13 0.005% 100.004% ( 1900, 2900 ] 2 0.001% 100.005% ** Level 4 read latency histogram (micros): Count: 110 Average: 265.0636 StdDev: 535.35 Min: 0 Median: 2.0000 Max: 2383 Percentiles: P50: 2.00 P75: 132.50 P99: 2383.00 P99.9: 2383.00 P99.99: 2383.00 ------------------------------------------------------ [ 0, 1 ] 51 46.364% 46.364% ######### ( 1, 2 ] 4 3.636% 50.000% # ( 2, 3 ] 4 3.636% 53.636% # ( 3, 4 ] 4 3.636% 57.273% # ( 6, 10 ] 6 5.455% 62.727% # ( 10, 15 ] 5 4.545% 67.273% # ( 15, 22 ] 6 5.455% 72.727% # ( 76, 110 ] 1 0.909% 73.636% ( 110, 170 ] 4 3.636% 77.273% # ( 250, 380 ] 1 0.909% 78.182% ( 580, 870 ] 8 7.273% 85.455% # ( 870, 1300 ] 9 8.182% 93.636% ## ( 1300, 1900 ] 3 2.727% 96.364% # ( 1900, 2900 ] 4 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 404.0000 StdDev: 318.49 Min: 127 Median: 240.0000 Max: 1322 Percentiles: P50: 240.00 P75: 580.00 P99: 1322.00 P99.9: 1322.00 P99.99: 1322.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 8 40.000% 55.000% ######## ( 250, 380 ] 3 15.000% 70.000% ### ( 380, 580 ] 1 5.000% 75.000% # ( 580, 870 ] 2 10.000% 85.000% ## ( 870, 1300 ] 2 10.000% 95.000% ## ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 14.8 total, 3.3 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 332.34 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.837 H:M:S, 12.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 297.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.022 H:M:S, 30.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/06-05:15:51 ... thread 0: (1000000,6000000) ops and (314225.0,337554.0) ops/second in (3.182433,17.774934) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 3.38 GB 151.1 4.5 0.0 4.5 10.1 5.7 0.0 1.8 167.6 378.7 27.43 25.91 104 0.264 4669K 4791 0.0 0.0 L1 17/17 1.77 GB 0.0 2.3 2.2 0.2 2.3 2.1 0.1 1.1 283.0 281.1 8.47 8.24 3 2.822 2432K 15K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 0.4 2.0 252.2 252.1 0.50 0.49 1 0.500 127K 42 0.0 0.0 L3 21/0 917.61 MB 0.9 1.5 0.5 1.0 1.5 0.5 0.2 3.0 280.0 279.7 5.45 5.12 4 1.362 1515K 1490 0.0 0.0 L4 173/0 9.66 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.3 1.0 289.7 289.8 0.44 0.40 1 0.440 113K 0 0.0 0.0 L5 1136/0 86.06 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1365/27 101.77 GB 0.0 8.6 2.8 5.7 14.2 8.5 1.3 2.5 207.5 344.0 42.29 40.16 113 0.374 8858K 22K 0.0 0.0 Int 0/0 0.00 KB 0.0 8.6 2.8 5.7 14.2 8.5 1.3 2.5 207.5 344.0 42.29 40.16 113 0.374 8858K 22K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 8.6 2.8 5.7 8.5 2.8 0.0 0.0 305.9 305.1 28.68 27.82 26 1.103 8858K 22K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 426.1 13.60 12.34 87 0.156 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.0 total, 17.8 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.21 GB write, 808.62 MB/s write, 8.57 GB read, 487.70 MB/s read, 42.3 seconds Interval compaction: 14.21 GB write, 818.27 MB/s write, 8.57 GB read, 493.52 MB/s read, 42.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 9, total-stops: 10, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1932323 Average: 1.8170 StdDev: 6.52 Min: 0 Median: 1.1613 Max: 1595 Percentiles: P50: 1.16 P75: 1.66 P99: 4.02 P99.9: 8.51 P99.99: 14.49 ------------------------------------------------------ [ 0, 1 ] 811459 41.994% 41.994% ######## ( 1, 2 ] 959359 49.648% 91.642% ########## ( 2, 3 ] 106689 5.521% 97.163% # ( 3, 4 ] 35366 1.830% 98.993% ( 4, 6 ] 15156 0.784% 99.778% ( 6, 10 ] 3764 0.195% 99.973% ( 10, 15 ] 376 0.019% 99.992% ( 15, 22 ] 57 0.003% 99.995% ( 22, 34 ] 29 0.002% 99.996% ( 34, 51 ] 22 0.001% 99.998% ( 51, 76 ] 10 0.001% 99.998% ( 76, 110 ] 127 0.007% 100.005% ( 110, 170 ] 294 0.015% 100.020% ( 170, 250 ] 254 0.013% 100.033% ( 250, 380 ] 140 0.007% 100.040% ( 380, 580 ] 32 0.002% 100.042% ( 580, 870 ] 20 0.001% 100.043% ( 870, 1300 ] 10 0.001% 100.044% ( 1300, 1900 ] 11 0.001% 100.044% ** Level 1 read latency histogram (micros): Count: 306038 Average: 2.0852 StdDev: 7.94 Min: 0 Median: 1.2432 Max: 584 Percentiles: P50: 1.24 P75: 1.73 P99: 5.33 P99.9: 131.22 P99.99: 355.67 ------------------------------------------------------ [ 0, 1 ] 115143 37.624% 37.624% ######## ( 1, 2 ] 155733 50.887% 88.511% ########## ( 2, 3 ] 20401 6.666% 95.177% # ( 3, 4 ] 8398 2.744% 97.921% # ( 4, 6 ] 4969 1.624% 99.545% ( 6, 10 ] 869 0.284% 99.828% ( 10, 15 ] 67 0.022% 99.850% ( 15, 22 ] 17 0.006% 99.856% ( 22, 34 ] 6 0.002% 99.858% ( 34, 51 ] 8 0.003% 99.860% ( 76, 110 ] 81 0.026% 99.887% ( 110, 170 ] 113 0.037% 99.924% ( 170, 250 ] 152 0.050% 99.974% ( 250, 380 ] 62 0.020% 99.994% ( 380, 580 ] 18 0.006% 100.000% ( 580, 870 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 76268 Average: 2.1841 StdDev: 11.42 Min: 0 Median: 1.2302 Max: 1173 Percentiles: P50: 1.23 P75: 1.76 P99: 5.62 P99.9: 134.33 P99.99: 492.44 ------------------------------------------------------ [ 0, 1 ] 29825 39.106% 39.106% ######## ( 1, 2 ] 36097 47.329% 86.435% ######### ( 2, 3 ] 5977 7.837% 94.272% ## ( 3, 4 ] 2402 3.149% 97.421% # ( 4, 6 ] 1484 1.946% 99.367% ( 6, 10 ] 301 0.395% 99.761% ( 10, 15 ] 26 0.034% 99.795% ( 15, 22 ] 9 0.012% 99.807% ( 22, 34 ] 3 0.004% 99.811% ( 34, 51 ] 25 0.033% 99.844% ( 51, 76 ] 28 0.037% 99.881% ( 76, 110 ] 5 0.007% 99.887% ( 110, 170 ] 24 0.031% 99.919% ( 170, 250 ] 36 0.047% 99.966% ( 250, 380 ] 15 0.020% 99.986% ( 380, 580 ] 6 0.008% 99.993% ( 580, 870 ] 2 0.003% 99.996% ( 870, 1300 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 248954 Average: 2.3205 StdDev: 17.18 Min: 0 Median: 1.1549 Max: 2151 Percentiles: P50: 1.15 P75: 1.73 P99: 5.67 P99.9: 158.88 P99.99: 618.15 ------------------------------------------------------ [ 0, 1 ] 107803 43.302% 43.302% ######### ( 1, 2 ] 107619 43.228% 86.531% ######### ( 2, 3 ] 20522 8.243% 94.774% ## ( 3, 4 ] 6949 2.791% 97.565% # ( 4, 6 ] 4275 1.717% 99.283% ( 6, 10 ] 909 0.365% 99.648% ( 10, 15 ] 94 0.038% 99.685% ( 15, 22 ] 80 0.032% 99.718% ( 22, 34 ] 39 0.016% 99.733% ( 34, 51 ] 148 0.059% 99.793% ( 51, 76 ] 53 0.021% 99.814% ( 76, 110 ] 78 0.031% 99.845% ( 110, 170 ] 167 0.067% 99.912% ( 170, 250 ] 132 0.053% 99.965% ( 250, 380 ] 47 0.019% 99.984% ( 380, 580 ] 12 0.005% 99.989% ( 580, 870 ] 16 0.006% 99.996% ( 870, 1300 ] 9 0.004% 99.999% ( 1300, 1900 ] 13 0.005% 100.004% ( 1900, 2900 ] 2 0.001% 100.005% ** Level 4 read latency histogram (micros): Count: 110 Average: 265.0636 StdDev: 535.35 Min: 0 Median: 2.0000 Max: 2383 Percentiles: P50: 2.00 P75: 132.50 P99: 2383.00 P99.9: 2383.00 P99.99: 2383.00 ------------------------------------------------------ [ 0, 1 ] 51 46.364% 46.364% ######### ( 1, 2 ] 4 3.636% 50.000% # ( 2, 3 ] 4 3.636% 53.636% # ( 3, 4 ] 4 3.636% 57.273% # ( 6, 10 ] 6 5.455% 62.727% # ( 10, 15 ] 5 4.545% 67.273% # ( 15, 22 ] 6 5.455% 72.727% # ( 76, 110 ] 1 0.909% 73.636% ( 110, 170 ] 4 3.636% 77.273% # ( 250, 380 ] 1 0.909% 78.182% ( 580, 870 ] 8 7.273% 85.455% # ( 870, 1300 ] 9 8.182% 93.636% ## ( 1300, 1900 ] 3 2.727% 96.364% # ( 1900, 2900 ] 4 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 20 Average: 404.0000 StdDev: 318.49 Min: 127 Median: 240.0000 Max: 1322 Percentiles: P50: 240.00 P75: 580.00 P99: 1322.00 P99.9: 1322.00 P99.99: 1322.00 ------------------------------------------------------ ( 110, 170 ] 3 15.000% 15.000% ### ( 170, 250 ] 8 40.000% 55.000% ######## ( 250, 380 ] 3 15.000% 70.000% ### ( 380, 580 ] 1 5.000% 75.000% # ( 580, 870 ] 2 10.000% 85.000% ## ( 870, 1300 ] 2 10.000% 95.000% ## ( 1300, 1900 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 18.0 total, 3.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 328.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.829 H:M:S, 15.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 309.26 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.992 H:M:S, 31.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/06-05:16:00 ... thread 0: (1000000,7000000) ops and (116886.2,265853.8) ops/second in (8.555329,26.330263) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 2.45 GB 6.3 6.5 0.0 6.5 13.2 6.6 0.0 2.0 182.9 368.9 36.51 34.48 125 0.292 6779K 10K 0.0 0.0 L1 21/21 2.11 GB 0.0 6.0 4.1 2.0 5.9 4.0 0.1 1.5 292.4 289.2 21.06 20.16 4 5.266 6255K 68K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 1.9 2.0 252.2 252.1 0.50 0.49 1 0.500 127K 42 0.0 0.0 L3 19/5 1.56 GB 1.0 1.5 0.5 1.0 1.5 0.5 1.7 3.0 280.0 279.7 5.45 5.12 4 1.362 1515K 1490 0.0 0.0 L4 175/15 9.59 GB 1.0 0.1 0.1 0.0 0.1 0.1 1.2 1.0 289.7 289.8 0.44 0.40 1 0.440 113K 0 0.0 0.0 L5 1148/0 86.98 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1371/48 102.70 GB 0.0 14.3 4.7 9.5 20.8 11.3 6.1 3.1 228.5 333.6 63.96 60.66 135 0.474 14M 80K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.3 4.7 9.5 20.8 11.3 6.1 3.1 228.5 333.6 63.96 60.66 135 0.474 14M 80K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.3 4.7 9.5 14.2 4.7 0.0 0.0 306.0 304.3 47.77 45.97 32 1.493 14M 80K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 420.1 16.19 14.69 103 0.157 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.5 total, 26.3 interval Flush(GB): cumulative 6.645, interval 6.645 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.84 GB write, 803.85 MB/s write, 14.27 GB read, 550.61 MB/s read, 64.0 seconds Interval compaction: 20.84 GB write, 810.33 MB/s write, 14.27 GB read, 555.04 MB/s read, 64.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 10, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 10, interval: 34 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2791957 Average: 1.9927 StdDev: 11.11 Min: 0 Median: 1.1423 Max: 3941 Percentiles: P50: 1.14 P75: 1.65 P99: 4.44 P99.9: 84.51 P99.99: 203.63 ------------------------------------------------------ [ 0, 1 ] 1202243 43.061% 43.061% ######### ( 1, 2 ] 1361692 48.772% 91.833% ########## ( 2, 3 ] 145432 5.209% 97.042% # ( 3, 4 ] 49304 1.766% 98.808% ( 4, 6 ] 24126 0.864% 99.672% ( 6, 10 ] 5407 0.194% 99.866% ( 10, 15 ] 600 0.021% 99.887% ( 15, 22 ] 99 0.004% 99.891% ( 22, 34 ] 48 0.002% 99.892% ( 34, 51 ] 35 0.001% 99.894% ( 51, 76 ] 11 0.000% 99.894% ( 76, 110 ] 671 0.024% 99.918% ( 110, 170 ] 1560 0.056% 99.974% ( 170, 250 ] 1070 0.038% 100.012% ( 250, 380 ] 511 0.018% 100.031% ( 380, 580 ] 124 0.004% 100.035% ( 580, 870 ] 59 0.002% 100.037% ( 870, 1300 ] 16 0.001% 100.038% ( 1300, 1900 ] 16 0.001% 100.038% ( 1900, 2900 ] 11 0.000% 100.039% ( 2900, 4400 ] 4 0.000% 100.039% ** Level 1 read latency histogram (micros): Count: 662238 Average: 2.2382 StdDev: 13.13 Min: 0 Median: 1.1244 Max: 3347 Percentiles: P50: 1.12 P75: 1.68 P99: 5.57 P99.9: 177.85 P99.99: 359.19 ------------------------------------------------------ [ 0, 1 ] 294345 44.447% 44.447% ######### ( 1, 2 ] 295729 44.656% 89.103% ######### ( 2, 3 ] 39360 5.943% 95.046% # ( 3, 4 ] 16850 2.544% 97.591% # ( 4, 6 ] 11886 1.795% 99.386% ( 6, 10 ] 2178 0.329% 99.715% ( 10, 15 ] 214 0.032% 99.747% ( 15, 22 ] 50 0.008% 99.754% ( 22, 34 ] 17 0.003% 99.757% ( 34, 51 ] 8 0.001% 99.758% ( 76, 110 ] 499 0.075% 99.834% ( 110, 170 ] 398 0.060% 99.894% ( 170, 250 ] 456 0.069% 99.963% ( 250, 380 ] 220 0.033% 99.996% ( 380, 580 ] 79 0.012% 100.008% ( 580, 870 ] 18 0.003% 100.010% ( 870, 1300 ] 1 0.000% 100.011% ( 1300, 1900 ] 1 0.000% 100.011% ( 1900, 2900 ] 2 0.000% 100.011% ( 2900, 4400 ] 2 0.000% 100.011% ** Level 2 read latency histogram (micros): Count: 76268 Average: 2.1841 StdDev: 11.42 Min: 0 Median: 1.2302 Max: 1173 Percentiles: P50: 1.23 P75: 1.76 P99: 5.62 P99.9: 134.33 P99.99: 492.44 ------------------------------------------------------ [ 0, 1 ] 29825 39.106% 39.106% ######## ( 1, 2 ] 36097 47.329% 86.435% ######### ( 2, 3 ] 5977 7.837% 94.272% ## ( 3, 4 ] 2402 3.149% 97.421% # ( 4, 6 ] 1484 1.946% 99.367% ( 6, 10 ] 301 0.395% 99.761% ( 10, 15 ] 26 0.034% 99.795% ( 15, 22 ] 9 0.012% 99.807% ( 22, 34 ] 3 0.004% 99.811% ( 34, 51 ] 25 0.033% 99.844% ( 51, 76 ] 28 0.037% 99.881% ( 76, 110 ] 5 0.007% 99.887% ( 110, 170 ] 24 0.031% 99.919% ( 170, 250 ] 36 0.047% 99.966% ( 250, 380 ] 15 0.020% 99.986% ( 380, 580 ] 6 0.008% 99.993% ( 580, 870 ] 2 0.003% 99.996% ( 870, 1300 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 260057 Average: 3.0866 StdDev: 31.05 Min: 0 Median: 1.1823 Max: 3745 Percentiles: P50: 1.18 P75: 1.76 P99: 6.03 P99.9: 323.08 P99.99: 1170.75 ------------------------------------------------------ [ 0, 1 ] 109537 42.120% 42.120% ######## ( 1, 2 ] 112419 43.229% 85.349% ######### ( 2, 3 ] 22653 8.711% 94.060% ## ( 3, 4 ] 8064 3.101% 97.161% # ( 4, 6 ] 4775 1.836% 98.997% ( 6, 10 ] 1152 0.443% 99.440% ( 10, 15 ] 147 0.057% 99.496% ( 15, 22 ] 96 0.037% 99.533% ( 22, 34 ] 41 0.016% 99.549% ( 34, 51 ] 148 0.057% 99.606% ( 51, 76 ] 53 0.020% 99.626% ( 76, 110 ] 82 0.032% 99.658% ( 110, 170 ] 283 0.109% 99.767% ( 170, 250 ] 248 0.095% 99.862% ( 250, 380 ] 176 0.068% 99.930% ( 380, 580 ] 104 0.040% 99.970% ( 580, 870 ] 46 0.018% 99.987% ( 870, 1300 ] 10 0.004% 99.991% ( 1300, 1900 ] 23 0.009% 100.000% ( 1900, 2900 ] 12 0.005% 100.005% ( 2900, 4400 ] 4 0.002% 100.006% ** Level 4 read latency histogram (micros): Count: 110 Average: 265.0636 StdDev: 535.35 Min: 0 Median: 2.0000 Max: 2383 Percentiles: P50: 2.00 P75: 132.50 P99: 2383.00 P99.9: 2383.00 P99.99: 2383.00 ------------------------------------------------------ [ 0, 1 ] 51 46.364% 46.364% ######### ( 1, 2 ] 4 3.636% 50.000% # ( 2, 3 ] 4 3.636% 53.636% # ( 3, 4 ] 4 3.636% 57.273% # ( 6, 10 ] 6 5.455% 62.727% # ( 10, 15 ] 5 4.545% 67.273% # ( 15, 22 ] 6 5.455% 72.727% # ( 76, 110 ] 1 0.909% 73.636% ( 110, 170 ] 4 3.636% 77.273% # ( 250, 380 ] 1 0.909% 78.182% ( 580, 870 ] 8 7.273% 85.455% # ( 870, 1300 ] 9 8.182% 93.636% ## ( 1300, 1900 ] 3 2.727% 96.364% # ( 1900, 2900 ] 4 3.636% 100.000% # ** Level 5 read latency histogram (micros): Count: 80 Average: 331.6625 StdDev: 260.11 Min: 111 Median: 223.3333 Max: 1322 Percentiles: P50: 223.33 P75: 424.44 P99: 1322.00 P99.9: 1322.00 P99.99: 1322.00 ------------------------------------------------------ ( 110, 170 ] 24 30.000% 30.000% ###### ( 170, 250 ] 24 30.000% 60.000% ###### ( 250, 380 ] 10 12.500% 72.500% ### ( 380, 580 ] 9 11.250% 83.750% ## ( 580, 870 ] 7 8.750% 92.500% ## ( 870, 1300 ] 5 6.250% 98.750% # ( 1300, 1900 ] 1 1.250% 100.000% ** DB Stats ** Uptime(secs): 26.5 total, 8.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 259.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.059 H:M:S, 34.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 115.04 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.230 H:M:S, 72.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/06-05:16:03 ... thread 0: (1000000,8000000) ops and (321038.4,271691.6) ops/second in (3.114892,29.445155) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 3.44 GB 81.8 7.3 0.0 7.3 14.9 7.6 0.0 2.0 180.2 367.8 41.59 39.17 143 0.291 7611K 11K 0.0 0.0 L1 21/21 2.11 GB 0.0 6.0 4.1 2.0 5.9 4.0 0.1 1.5 292.4 289.2 21.06 20.16 4 5.266 6255K 68K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.1 0.1 0.1 0.1 0.1 1.9 2.0 252.2 252.1 0.50 0.49 1 0.500 127K 42 0.0 0.0 L3 14/0 951.80 MB 1.0 1.5 0.5 1.0 1.5 0.5 1.7 3.0 280.0 279.7 5.45 5.12 4 1.362 1515K 1490 0.0 0.0 L4 172/0 9.54 GB 1.0 0.9 0.8 0.1 0.9 0.8 1.2 1.2 210.6 209.8 4.23 3.54 6 0.706 889K 3312 0.0 0.0 L5 1156/0 87.66 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1377/32 103.68 GB 0.0 15.8 5.4 10.5 23.4 12.9 6.8 3.1 222.4 328.5 72.83 68.48 158 0.461 16M 85K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.8 5.4 10.5 23.4 12.9 6.8 3.1 222.4 328.5 72.83 68.48 158 0.461 16M 85K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.8 5.4 10.5 15.7 5.3 0.0 0.0 300.0 298.4 54.00 51.50 40 1.350 16M 85K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 414.8 18.83 16.98 118 0.160 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 29.7 total, 29.4 interval Flush(GB): cumulative 7.629, interval 7.629 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.36 GB write, 806.65 MB/s write, 15.82 GB read, 546.15 MB/s read, 72.8 seconds Interval compaction: 23.36 GB write, 812.45 MB/s write, 15.82 GB read, 550.08 MB/s read, 72.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 12, interval: 36 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3245148 Average: 1.9557 StdDev: 10.44 Min: 0 Median: 1.1372 Max: 3941 Percentiles: P50: 1.14 P75: 1.65 P99: 4.44 P99.9: 12.93 P99.99: 183.71 ------------------------------------------------------ [ 0, 1 ] 1406865 43.353% 43.353% ######### ( 1, 2 ] 1572387 48.453% 91.806% ########## ( 2, 3 ] 169589 5.226% 97.032% # ( 3, 4 ] 57489 1.772% 98.804% ( 4, 6 ] 29024 0.894% 99.698% ( 6, 10 ] 6181 0.190% 99.889% ( 10, 15 ] 633 0.020% 99.908% ( 15, 22 ] 110 0.003% 99.912% ( 22, 34 ] 53 0.002% 99.913% ( 34, 51 ] 41 0.001% 99.914% ( 51, 76 ] 13 0.000% 99.915% ( 76, 110 ] 671 0.021% 99.936% ( 110, 170 ] 1584 0.049% 99.984% ( 170, 250 ] 1088 0.034% 100.018% ( 250, 380 ] 527 0.016% 100.034% ( 380, 580 ] 129 0.004% 100.038% ( 580, 870 ] 62 0.002% 100.040% ( 870, 1300 ] 17 0.001% 100.041% ( 1300, 1900 ] 17 0.001% 100.041% ( 1900, 2900 ] 11 0.000% 100.041% ( 2900, 4400 ] 4 0.000% 100.042% ** Level 1 read latency histogram (micros): Count: 767803 Average: 2.2777 StdDev: 13.57 Min: 0 Median: 1.1969 Max: 3883 Percentiles: P50: 1.20 P75: 1.74 P99: 5.76 P99.9: 153.91 P99.99: 314.55 ------------------------------------------------------ [ 0, 1 ] 314657 40.981% 40.981% ######## ( 1, 2 ] 351759 45.814% 86.795% ######### ( 2, 3 ] 53733 6.998% 93.793% # ( 3, 4 ] 25330 3.299% 97.092% # ( 4, 6 ] 16656 2.169% 99.262% ( 6, 10 ] 3729 0.486% 99.747% ( 10, 15 ] 279 0.036% 99.784% ( 15, 22 ] 55 0.007% 99.791% ( 22, 34 ] 18 0.002% 99.793% ( 34, 51 ] 11 0.001% 99.795% ( 51, 76 ] 1 0.000% 99.795% ( 76, 110 ] 502 0.065% 99.860% ( 110, 170 ] 417 0.054% 99.915% ( 170, 250 ] 468 0.061% 99.976% ( 250, 380 ] 224 0.029% 100.005% ( 380, 580 ] 88 0.011% 100.016% ( 580, 870 ] 19 0.002% 100.019% ( 870, 1300 ] 2 0.000% 100.019% ( 1300, 1900 ] 2 0.000% 100.019% ( 1900, 2900 ] 3 0.000% 100.020% ( 2900, 4400 ] 3 0.000% 100.020% ** Level 2 read latency histogram (micros): Count: 76268 Average: 2.1841 StdDev: 11.42 Min: 0 Median: 1.2302 Max: 1173 Percentiles: P50: 1.23 P75: 1.76 P99: 5.62 P99.9: 134.33 P99.99: 492.44 ------------------------------------------------------ [ 0, 1 ] 29825 39.106% 39.106% ######## ( 1, 2 ] 36097 47.329% 86.435% ######### ( 2, 3 ] 5977 7.837% 94.272% ## ( 3, 4 ] 2402 3.149% 97.421% # ( 4, 6 ] 1484 1.946% 99.367% ( 6, 10 ] 301 0.395% 99.761% ( 10, 15 ] 26 0.034% 99.795% ( 15, 22 ] 9 0.012% 99.807% ( 22, 34 ] 3 0.004% 99.811% ( 34, 51 ] 25 0.033% 99.844% ( 51, 76 ] 28 0.037% 99.881% ( 76, 110 ] 5 0.007% 99.887% ( 110, 170 ] 24 0.031% 99.919% ( 170, 250 ] 36 0.047% 99.966% ( 250, 380 ] 15 0.020% 99.986% ( 380, 580 ] 6 0.008% 99.993% ( 580, 870 ] 2 0.003% 99.996% ( 870, 1300 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 279433 Average: 3.6765 StdDev: 39.07 Min: 0 Median: 1.2033 Max: 4422 Percentiles: P50: 1.20 P75: 1.78 P99: 7.34 P99.9: 426.41 P99.99: 1487.38 ------------------------------------------------------ [ 0, 1 ] 114949 41.137% 41.137% ######## ( 1, 2 ] 121844 43.604% 84.741% ######### ( 2, 3 ] 25020 8.954% 93.694% ## ( 3, 4 ] 9151 3.275% 96.969% # ( 4, 6 ] 5232 1.872% 98.842% ( 6, 10 ] 1323 0.473% 99.315% ( 10, 15 ] 157 0.056% 99.371% ( 15, 22 ] 97 0.035% 99.406% ( 22, 34 ] 42 0.015% 99.421% ( 34, 51 ] 148 0.053% 99.474% ( 51, 76 ] 53 0.019% 99.493% ( 76, 110 ] 88 0.031% 99.524% ( 110, 170 ] 332 0.119% 99.643% ( 170, 250 ] 351 0.126% 99.769% ( 250, 380 ] 319 0.114% 99.883% ( 380, 580 ] 205 0.073% 99.956% ( 580, 870 ] 71 0.025% 99.982% ( 870, 1300 ] 14 0.005% 99.987% ( 1300, 1900 ] 29 0.010% 99.997% ( 1900, 2900 ] 20 0.007% 100.004% ( 2900, 4400 ] 7 0.003% 100.007% ( 4400, 6600 ] 1 0.000% 100.007% ** Level 4 read latency histogram (micros): Count: 210 Average: 171.9238 StdDev: 410.80 Min: 0 Median: 1.4000 Max: 2383 Percentiles: P50: 1.40 P75: 106.60 P99: 2375.00 P99.9: 2383.00 P99.99: 2383.00 ------------------------------------------------------ [ 0, 1 ] 97 46.190% 46.190% ######### ( 1, 2 ] 20 9.524% 55.714% ## ( 2, 3 ] 5 2.381% 58.095% ( 3, 4 ] 8 3.810% 61.905% # ( 4, 6 ] 2 0.952% 62.857% ( 6, 10 ] 8 3.810% 66.667% # ( 10, 15 ] 5 2.381% 69.048% ( 15, 22 ] 7 3.333% 72.381% # ( 51, 76 ] 1 0.476% 72.857% ( 76, 110 ] 5 2.381% 75.238% ( 110, 170 ] 11 5.238% 80.476% # ( 170, 250 ] 7 3.333% 83.810% # ( 250, 380 ] 5 2.381% 86.190% ( 380, 580 ] 3 1.429% 87.619% ( 580, 870 ] 10 4.762% 92.381% # ( 870, 1300 ] 9 4.286% 96.667% # ( 1300, 1900 ] 3 1.429% 98.095% ( 1900, 2900 ] 4 1.905% 100.000% ** Level 5 read latency histogram (micros): Count: 120 Average: 328.9417 StdDev: 273.59 Min: 101 Median: 218.0000 Max: 1322 Percentiles: P50: 218.00 P75: 413.33 P99: 1289.25 P99.9: 1322.00 P99.99: 1322.00 ------------------------------------------------------ ( 76, 110 ] 3 2.500% 2.500% # ( 110, 170 ] 39 32.500% 35.000% ####### ( 170, 250 ] 30 25.000% 60.000% ##### ( 250, 380 ] 16 13.333% 73.333% ### ( 380, 580 ] 12 10.000% 83.333% ## ( 580, 870 ] 11 9.167% 92.500% ## ( 870, 1300 ] 8 6.667% 99.167% # ( 1300, 1900 ] 1 0.833% 100.000% ** DB Stats ** Uptime(secs): 29.7 total, 3.1 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 265.46 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.210 H:M:S, 31.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 315.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.151 H:M:S, 4.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-05:16:19 ... thread 0: (1000000,9000000) ops and (62873.2,198455.6) ops/second in (15.905036,45.350191) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/6 1.96 GB 0.0 9.6 0.0 9.6 18.1 8.5 0.0 2.1 189.0 357.1 51.97 47.78 160 0.325 9976K 22K 0.0 0.0 L1 12/12 1.43 GB 0.0 10.5 6.4 4.1 10.4 6.3 0.1 1.6 295.6 291.6 36.45 34.50 5 7.290 9789K 68K 0.0 0.0 L2 1/0 84.06 MB 0.8 0.1 0.1 0.1 0.1 0.1 4.9 2.0 252.2 252.1 0.50 0.49 1 0.500 127K 42 0.0 0.0 L3 21/4 1.44 GB 1.0 2.7 1.0 1.8 2.7 1.0 4.1 2.8 216.6 215.0 12.95 10.49 10 1.295 2815K 20K 0.0 0.0 L4 172/9 10.01 GB 1.0 3.8 3.1 0.6 3.8 3.1 1.2 1.2 150.0 149.4 25.73 17.05 28 0.919 3888K 15K 0.0 0.0 L5 1180/0 89.57 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1392/31 104.49 GB 0.0 26.8 10.6 16.1 35.1 19.0 14.2 4.1 214.7 281.7 127.61 110.31 204 0.626 26M 127K 0.0 0.0 Int 0/0 0.00 KB 0.0 26.8 10.6 16.1 35.1 19.0 14.2 4.1 214.7 281.7 127.61 110.31 204 0.626 26M 127K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 26.8 10.6 16.1 26.5 10.4 0.0 0.0 260.4 258.5 105.19 91.08 73 1.441 26M 127K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 390.6 22.42 19.23 131 0.171 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.6 total, 45.4 interval Flush(GB): cumulative 8.552, interval 8.552 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 35.10 GB write, 788.85 MB/s write, 26.75 GB read, 601.17 MB/s read, 127.6 seconds Interval compaction: 35.10 GB write, 792.54 MB/s write, 26.75 GB read, 603.98 MB/s read, 127.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 29, pending-compaction-bytes-stops: 0, total-delays: 47, total-stops: 23, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4353786 Average: 2.3390 StdDev: 45.71 Min: 0 Median: 1.1246 Max: 33244 Percentiles: P50: 1.12 P75: 1.66 P99: 5.09 P99.9: 145.48 P99.99: 241.52 ------------------------------------------------------ [ 0, 1 ] 1921747 44.140% 44.140% ######### ( 1, 2 ] 2047684 47.032% 91.172% ######### ( 2, 3 ] 228862 5.257% 96.429% # ( 3, 4 ] 84164 1.933% 98.362% ( 4, 6 ] 50960 1.170% 99.532% ( 6, 10 ] 10435 0.240% 99.772% ( 10, 15 ] 979 0.022% 99.794% ( 15, 22 ] 218 0.005% 99.799% ( 22, 34 ] 76 0.002% 99.801% ( 34, 51 ] 54 0.001% 99.802% ( 51, 76 ] 20 0.000% 99.803% ( 76, 110 ] 2168 0.050% 99.853% ( 110, 170 ] 3494 0.080% 99.933% ( 170, 250 ] 2786 0.064% 99.997% ( 250, 380 ] 1077 0.025% 100.022% ( 380, 580 ] 263 0.006% 100.028% ( 580, 870 ] 124 0.003% 100.030% ( 870, 1300 ] 36 0.001% 100.031% ( 1300, 1900 ] 55 0.001% 100.033% ( 1900, 2900 ] 66 0.002% 100.034% ( 2900, 4400 ] 70 0.002% 100.036% ( 4400, 6600 ] 21 0.000% 100.036% ( 6600, 9900 ] 10 0.000% 100.036% ( 9900, 14000 ] 2 0.000% 100.036% ( 14000, 22000 ] 9 0.000% 100.037% ( 22000, 33000 ] 3 0.000% 100.037% ( 33000, 50000 ] 1 0.000% 100.037% ** Level 1 read latency histogram (micros): Count: 2095070 Average: 4.3194 StdDev: 125.05 Min: 0 Median: 1.2813 Max: 38040 Percentiles: P50: 1.28 P75: 1.86 P99: 6.66 P99.9: 210.13 P99.99: 732.08 ------------------------------------------------------ [ 0, 1 ] 793311 37.866% 37.866% ######## ( 1, 2 ] 903738 43.136% 81.002% ######### ( 2, 3 ] 188747 9.009% 90.011% ## ( 3, 4 ] 109533 5.228% 95.239% # ( 4, 6 ] 75991 3.627% 98.866% # ( 6, 10 ] 16999 0.811% 99.678% ( 10, 15 ] 1075 0.051% 99.729% ( 15, 22 ] 284 0.014% 99.743% ( 22, 34 ] 87 0.004% 99.747% ( 34, 51 ] 45 0.002% 99.749% ( 51, 76 ] 58 0.003% 99.752% ( 76, 110 ] 1504 0.072% 99.823% ( 110, 170 ] 1011 0.048% 99.872% ( 170, 250 ] 1180 0.056% 99.928% ( 250, 380 ] 724 0.035% 99.963% ( 380, 580 ] 434 0.021% 99.983% ( 580, 870 ] 266 0.013% 99.996% ( 870, 1300 ] 121 0.006% 100.002% ( 1300, 1900 ] 125 0.006% 100.008% ( 1900, 2900 ] 228 0.011% 100.019% ( 2900, 4400 ] 312 0.015% 100.034% ( 4400, 6600 ] 91 0.004% 100.038% ( 6600, 9900 ] 37 0.002% 100.040% ( 9900, 14000 ] 14 0.001% 100.040% ( 14000, 22000 ] 28 0.001% 100.042% ( 22000, 33000 ] 13 0.001% 100.042% ( 33000, 50000 ] 2 0.000% 100.042% ** Level 2 read latency histogram (micros): Count: 76268 Average: 2.1841 StdDev: 11.42 Min: 0 Median: 1.2302 Max: 1173 Percentiles: P50: 1.23 P75: 1.76 P99: 5.62 P99.9: 134.33 P99.99: 492.44 ------------------------------------------------------ [ 0, 1 ] 29825 39.106% 39.106% ######## ( 1, 2 ] 36097 47.329% 86.435% ######### ( 2, 3 ] 5977 7.837% 94.272% ## ( 3, 4 ] 2402 3.149% 97.421% # ( 4, 6 ] 1484 1.946% 99.367% ( 6, 10 ] 301 0.395% 99.761% ( 10, 15 ] 26 0.034% 99.795% ( 15, 22 ] 9 0.012% 99.807% ( 22, 34 ] 3 0.004% 99.811% ( 34, 51 ] 25 0.033% 99.844% ( 51, 76 ] 28 0.037% 99.881% ( 76, 110 ] 5 0.007% 99.887% ( 110, 170 ] 24 0.031% 99.919% ( 170, 250 ] 36 0.047% 99.966% ( 250, 380 ] 15 0.020% 99.986% ( 380, 580 ] 6 0.008% 99.993% ( 580, 870 ] 2 0.003% 99.996% ( 870, 1300 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 588601 Average: 7.1272 StdDev: 215.80 Min: 0 Median: 1.4261 Max: 49900 Percentiles: P50: 1.43 P75: 1.96 P99: 7.32 P99.9: 717.49 P99.99: 3288.36 ------------------------------------------------------ [ 0, 1 ] 177928 30.229% 30.229% ###### ( 1, 2 ] 273118 46.401% 76.630% ######### ( 2, 3 ] 72636 12.340% 88.971% ## ( 3, 4 ] 37339 6.344% 95.314% # ( 4, 6 ] 20554 3.492% 98.806% # ( 6, 10 ] 3444 0.585% 99.391% ( 10, 15 ] 243 0.041% 99.433% ( 15, 22 ] 118 0.020% 99.453% ( 22, 34 ] 47 0.008% 99.461% ( 34, 51 ] 155 0.026% 99.487% ( 51, 76 ] 59 0.010% 99.497% ( 76, 110 ] 95 0.016% 99.513% ( 110, 170 ] 433 0.074% 99.587% ( 170, 250 ] 499 0.085% 99.672% ( 250, 380 ] 618 0.105% 99.777% ( 380, 580 ] 569 0.097% 99.873% ( 580, 870 ] 332 0.056% 99.930% ( 870, 1300 ] 115 0.020% 99.949% ( 1300, 1900 ] 83 0.014% 99.963% ( 1900, 2900 ] 124 0.021% 99.984% ( 2900, 4400 ] 128 0.022% 100.006% ( 4400, 6600 ] 31 0.005% 100.011% ( 6600, 9900 ] 11 0.002% 100.013% ( 9900, 14000 ] 6 0.001% 100.014% ( 14000, 22000 ] 13 0.002% 100.016% ( 22000, 33000 ] 12 0.002% 100.019% ( 33000, 50000 ] 6 0.001% 100.020% ** Level 4 read latency histogram (micros): Count: 126656 Average: 14.6142 StdDev: 215.72 Min: 0 Median: 1.5840 Max: 37842 Percentiles: P50: 1.58 P75: 2.36 P99: 220.61 P99.9: 2792.24 P99.99: 4633.44 ------------------------------------------------------ [ 0, 1 ] 28478 22.485% 22.485% #### ( 1, 2 ] 59676 47.117% 69.601% ######### ( 2, 3 ] 19161 15.128% 84.730% ### ( 3, 4 ] 11058 8.731% 93.460% ## ( 4, 6 ] 5497 4.340% 97.800% # ( 6, 10 ] 1229 0.970% 98.771% ( 10, 15 ] 79 0.062% 98.833% ( 15, 22 ] 24 0.019% 98.852% ( 22, 34 ] 14 0.011% 98.863% ( 34, 51 ] 5 0.004% 98.867% ( 51, 76 ] 5 0.004% 98.871% ( 76, 110 ] 11 0.009% 98.880% ( 110, 170 ] 44 0.035% 98.914% ( 170, 250 ] 173 0.137% 99.051% ( 250, 380 ] 228 0.180% 99.231% ( 380, 580 ] 288 0.227% 99.458% ( 580, 870 ] 255 0.201% 99.660% ( 870, 1300 ] 113 0.089% 99.749% ( 1300, 1900 ] 71 0.056% 99.805% ( 1900, 2900 ] 136 0.107% 99.912% ( 2900, 4400 ] 97 0.077% 99.989% ( 4400, 6600 ] 22 0.017% 100.006% ( 6600, 9900 ] 3 0.002% 100.009% ( 9900, 14000 ] 1 0.001% 100.009% ( 14000, 22000 ] 2 0.002% 100.011% ( 22000, 33000 ] 1 0.001% 100.012% ( 33000, 50000 ] 1 0.001% 100.013% ** Level 5 read latency histogram (micros): Count: 240 Average: 693.3125 StdDev: 888.26 Min: 101 Median: 345.7895 Max: 5411 Percentiles: P50: 345.79 P75: 787.14 P99: 4333.33 P99.9: 5411.00 P99.99: 5411.00 ------------------------------------------------------ ( 76, 110 ] 3 1.250% 1.250% ( 110, 170 ] 45 18.750% 20.000% #### ( 170, 250 ] 44 18.333% 38.333% #### ( 250, 380 ] 38 15.833% 54.167% ### ( 380, 580 ] 30 12.500% 66.667% ### ( 580, 870 ] 28 11.667% 78.333% ## ( 870, 1300 ] 23 9.583% 87.917% ## ( 1300, 1900 ] 6 2.500% 90.417% # ( 1900, 2900 ] 12 5.000% 95.417% # ( 2900, 4400 ] 9 3.750% 99.167% # ( 4400, 6600 ] 2 0.833% 100.000% ** DB Stats ** Uptime(secs): 45.6 total, 15.9 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 194.40 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.206 H:M:S, 46.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 61.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:11.996 H:M:S, 75.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 6 num-running-flushes: 1 2024/12/06-05:16:21 ... thread 0: (1000000,10000000) ops and (446678.2,210132.9) ops/second in (2.238748,47.588939) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/6 2.88 GB 107.0 10.5 0.0 10.5 19.9 9.5 0.0 2.1 188.5 358.8 56.82 52.25 178 0.319 10M 23K 0.0 0.0 L1 12/12 1.43 GB 0.0 10.5 6.4 4.1 10.4 6.3 0.1 1.6 295.6 291.6 36.45 34.50 5 7.290 9789K 68K 0.0 0.0 L2 1/0 84.06 MB 0.8 0.1 0.1 0.1 0.1 0.1 4.9 2.0 252.2 252.1 0.50 0.49 1 0.500 127K 42 0.0 0.0 L3 17/0 990.72 MB 1.0 2.7 1.0 1.8 2.7 1.0 4.1 2.8 216.6 215.0 12.95 10.49 10 1.295 2815K 20K 0.0 0.0 L4 165/0 9.50 GB 1.0 4.5 3.6 0.9 4.5 3.6 1.2 1.2 156.8 156.2 29.42 19.71 32 0.919 4653K 17K 0.0 0.0 L5 1192/0 90.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1399/18 105.41 GB 0.0 28.3 11.1 17.3 37.6 20.4 15.1 4.0 213.2 282.9 136.14 117.44 226 0.602 28M 130K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.3 11.1 17.3 37.6 20.4 15.1 4.0 213.2 282.9 136.14 117.44 226 0.602 28M 130K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.3 11.1 17.3 28.1 10.9 0.0 0.0 260.0 258.1 111.65 96.42 80 1.396 28M 130K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 396.1 24.49 21.02 146 0.168 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 47.8 total, 47.6 interval Flush(GB): cumulative 9.475, interval 9.475 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 37.62 GB write, 805.81 MB/s write, 28.35 GB read, 607.22 MB/s read, 136.1 seconds Interval compaction: 37.62 GB write, 809.40 MB/s write, 28.35 GB read, 609.92 MB/s read, 136.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 23, pending-compaction-bytes-delays: 29, pending-compaction-bytes-stops: 0, total-delays: 47, total-stops: 23, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4789123 Average: 2.2937 StdDev: 43.62 Min: 0 Median: 1.1301 Max: 33244 Percentiles: P50: 1.13 P75: 1.66 P99: 5.07 P99.9: 129.74 P99.99: 225.76 ------------------------------------------------------ [ 0, 1 ] 2101427 43.879% 43.879% ######### ( 1, 2 ] 2252657 47.037% 90.916% ######### ( 2, 3 ] 260182 5.433% 96.349% # ( 3, 4 ] 96453 2.014% 98.363% ( 4, 6 ] 57017 1.191% 99.553% ( 6, 10 ] 11822 0.247% 99.800% ( 10, 15 ] 1063 0.022% 99.822% ( 15, 22 ] 229 0.005% 99.827% ( 22, 34 ] 77 0.002% 99.829% ( 34, 51 ] 60 0.001% 99.830% ( 51, 76 ] 21 0.000% 99.831% ( 76, 110 ] 2170 0.045% 99.876% ( 110, 170 ] 3513 0.073% 99.949% ( 170, 250 ] 2802 0.059% 100.008% ( 250, 380 ] 1097 0.023% 100.031% ( 380, 580 ] 270 0.006% 100.036% ( 580, 870 ] 128 0.003% 100.039% ( 870, 1300 ] 38 0.001% 100.040% ( 1300, 1900 ] 58 0.001% 100.041% ( 1900, 2900 ] 66 0.001% 100.042% ( 2900, 4400 ] 70 0.001% 100.044% ( 4400, 6600 ] 21 0.000% 100.044% ( 6600, 9900 ] 10 0.000% 100.044% ( 9900, 14000 ] 2 0.000% 100.044% ( 14000, 22000 ] 9 0.000% 100.045% ( 22000, 33000 ] 3 0.000% 100.045% ( 33000, 50000 ] 1 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 2109354 Average: 4.3061 StdDev: 124.63 Min: 0 Median: 1.2799 Max: 38040 Percentiles: P50: 1.28 P75: 1.86 P99: 6.65 P99.9: 209.84 P99.99: 730.52 ------------------------------------------------------ [ 0, 1 ] 800176 37.935% 37.935% ######## ( 1, 2 ] 909377 43.112% 81.046% ######### ( 2, 3 ] 189760 8.996% 90.042% ## ( 3, 4 ] 109911 5.211% 95.253% # ( 4, 6 ] 76260 3.615% 98.868% # ( 6, 10 ] 17056 0.809% 99.677% ( 10, 15 ] 1075 0.051% 99.728% ( 15, 22 ] 284 0.013% 99.741% ( 22, 34 ] 87 0.004% 99.746% ( 34, 51 ] 45 0.002% 99.748% ( 51, 76 ] 58 0.003% 99.750% ( 76, 110 ] 1537 0.073% 99.823% ( 110, 170 ] 1024 0.049% 99.872% ( 170, 250 ] 1194 0.057% 99.928% ( 250, 380 ] 726 0.034% 99.963% ( 380, 580 ] 435 0.021% 99.983% ( 580, 870 ] 266 0.013% 99.996% ( 870, 1300 ] 121 0.006% 100.002% ( 1300, 1900 ] 125 0.006% 100.008% ( 1900, 2900 ] 228 0.011% 100.019% ( 2900, 4400 ] 312 0.015% 100.033% ( 4400, 6600 ] 91 0.004% 100.038% ( 6600, 9900 ] 37 0.002% 100.039% ( 9900, 14000 ] 14 0.001% 100.040% ( 14000, 22000 ] 28 0.001% 100.041% ( 22000, 33000 ] 13 0.001% 100.042% ( 33000, 50000 ] 2 0.000% 100.042% ** Level 2 read latency histogram (micros): Count: 76268 Average: 2.1841 StdDev: 11.42 Min: 0 Median: 1.2302 Max: 1173 Percentiles: P50: 1.23 P75: 1.76 P99: 5.62 P99.9: 134.33 P99.99: 492.44 ------------------------------------------------------ [ 0, 1 ] 29825 39.106% 39.106% ######## ( 1, 2 ] 36097 47.329% 86.435% ######### ( 2, 3 ] 5977 7.837% 94.272% ## ( 3, 4 ] 2402 3.149% 97.421% # ( 4, 6 ] 1484 1.946% 99.367% ( 6, 10 ] 301 0.395% 99.761% ( 10, 15 ] 26 0.034% 99.795% ( 15, 22 ] 9 0.012% 99.807% ( 22, 34 ] 3 0.004% 99.811% ( 34, 51 ] 25 0.033% 99.844% ( 51, 76 ] 28 0.037% 99.881% ( 76, 110 ] 5 0.007% 99.887% ( 110, 170 ] 24 0.031% 99.919% ( 170, 250 ] 36 0.047% 99.966% ( 250, 380 ] 15 0.020% 99.986% ( 380, 580 ] 6 0.008% 99.993% ( 580, 870 ] 2 0.003% 99.996% ( 870, 1300 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 608929 Average: 6.9676 StdDev: 212.17 Min: 0 Median: 1.4345 Max: 49900 Percentiles: P50: 1.43 P75: 1.97 P99: 7.18 P99.9: 699.73 P99.99: 3264.54 ------------------------------------------------------ [ 0, 1 ] 180397 29.625% 29.625% ###### ( 1, 2 ] 285509 46.887% 76.512% ######### ( 2, 3 ] 75526 12.403% 88.915% ## ( 3, 4 ] 38984 6.402% 95.318% # ( 4, 6 ] 21374 3.510% 98.828% # ( 6, 10 ] 3554 0.584% 99.411% ( 10, 15 ] 245 0.040% 99.451% ( 15, 22 ] 119 0.020% 99.471% ( 22, 34 ] 47 0.008% 99.479% ( 34, 51 ] 155 0.025% 99.504% ( 51, 76 ] 59 0.010% 99.514% ( 76, 110 ] 95 0.016% 99.530% ( 110, 170 ] 433 0.071% 99.601% ( 170, 250 ] 499 0.082% 99.683% ( 250, 380 ] 618 0.101% 99.784% ( 380, 580 ] 569 0.093% 99.877% ( 580, 870 ] 332 0.055% 99.932% ( 870, 1300 ] 115 0.019% 99.951% ( 1300, 1900 ] 83 0.014% 99.965% ( 1900, 2900 ] 124 0.020% 99.985% ( 2900, 4400 ] 128 0.021% 100.006% ( 4400, 6600 ] 31 0.005% 100.011% ( 6600, 9900 ] 11 0.002% 100.013% ( 9900, 14000 ] 6 0.001% 100.014% ( 14000, 22000 ] 13 0.002% 100.016% ( 22000, 33000 ] 12 0.002% 100.018% ( 33000, 50000 ] 6 0.001% 100.019% ** Level 4 read latency histogram (micros): Count: 158179 Average: 12.4193 StdDev: 194.31 Min: 0 Median: 1.5274 Max: 37842 Percentiles: P50: 1.53 P75: 2.22 P99: 14.53 P99.9: 2577.53 P99.99: 4372.73 ------------------------------------------------------ [ 0, 1 ] 40579 25.654% 25.654% ##### ( 1, 2 ] 73022 46.164% 71.818% ######### ( 2, 3 ] 22673 14.334% 86.152% ### ( 3, 4 ] 12647 7.995% 94.147% ## ( 4, 6 ] 6219 3.932% 98.079% # ( 6, 10 ] 1382 0.874% 98.952% ( 10, 15 ] 83 0.052% 99.005% ( 15, 22 ] 27 0.017% 99.022% ( 22, 34 ] 14 0.009% 99.031% ( 34, 51 ] 6 0.004% 99.035% ( 51, 76 ] 5 0.003% 99.038% ( 76, 110 ] 11 0.007% 99.045% ( 110, 170 ] 59 0.037% 99.082% ( 170, 250 ] 191 0.121% 99.203% ( 250, 380 ] 250 0.158% 99.361% ( 380, 580 ] 306 0.193% 99.554% ( 580, 870 ] 261 0.165% 99.719% ( 870, 1300 ] 114 0.072% 99.791% ( 1300, 1900 ] 79 0.050% 99.841% ( 1900, 2900 ] 137 0.087% 99.928% ( 2900, 4400 ] 100 0.063% 99.991% ( 4400, 6600 ] 22 0.014% 100.005% ( 6600, 9900 ] 3 0.002% 100.007% ( 9900, 14000 ] 1 0.001% 100.008% ( 14000, 22000 ] 2 0.001% 100.009% ( 22000, 33000 ] 1 0.001% 100.009% ( 33000, 50000 ] 1 0.001% 100.010% ** Level 5 read latency histogram (micros): Count: 300 Average: 656.1567 StdDev: 831.00 Min: 101 Median: 342.8571 Max: 5411 Percentiles: P50: 342.86 P75: 762.29 P99: 4250.00 P99.9: 5411.00 P99.99: 5411.00 ------------------------------------------------------ ( 76, 110 ] 5 1.667% 1.667% ( 110, 170 ] 54 18.000% 19.667% #### ( 170, 250 ] 51 17.000% 36.667% ### ( 250, 380 ] 56 18.667% 55.333% #### ( 380, 580 ] 37 12.333% 67.667% ## ( 580, 870 ] 35 11.667% 79.333% ## ( 870, 1300 ] 29 9.667% 89.000% ## ( 1300, 1900 ] 8 2.667% 91.667% # ( 1900, 2900 ] 13 4.333% 96.000% # ( 2900, 4400 ] 10 3.333% 99.333% # ( 4400, 6600 ] 2 0.667% 100.000% ** DB Stats ** Uptime(secs): 47.8 total, 2.2 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 205.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:21.206 H:M:S, 44.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 439.65 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/06-05:16:27 ... thread 0: (1000000,11000000) ops and (157342.2,203913.2) ops/second in (6.355573,53.944512) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/6 2.21 GB 69.2 11.7 0.0 11.7 22.1 10.4 0.0 2.1 190.0 357.7 63.33 58.21 197 0.321 12M 24K 0.0 0.0 L1 4/0 343.49 MB 34.3 13.5 8.0 5.5 13.4 7.9 0.1 1.7 288.7 285.1 48.04 44.35 6 8.006 11M 68K 0.0 0.0 L2 12/10 888.44 MB 1.9 0.1 0.1 0.1 0.1 0.1 7.6 2.0 252.2 252.1 0.50 0.49 1 0.500 127K 42 0.0 0.0 L3 35/10 2.84 GB 2.1 3.2 1.3 1.8 3.1 1.3 5.7 2.3 205.9 204.5 15.71 12.13 14 1.122 2991K 21K 0.0 0.0 L4 165/0 9.50 GB 1.0 4.5 3.6 0.9 4.5 3.6 1.2 1.2 156.8 156.2 29.42 19.71 32 0.919 4653K 17K 0.0 0.0 L5 1192/0 90.55 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.8 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1417/26 106.30 GB 0.0 33.1 13.0 20.0 43.2 23.2 19.4 4.2 215.7 282.0 156.99 134.88 250 0.628 31M 132K 0.0 0.0 Int 0/0 0.00 KB 0.0 33.1 13.0 20.0 43.2 23.2 19.4 4.2 215.7 282.0 156.99 134.88 250 0.628 31M 132K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 33.1 13.0 20.0 32.8 12.8 0.0 0.0 260.2 258.4 130.18 112.02 90 1.446 31M 132K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 10.4 10.4 0.0 0.0 0.0 397.1 26.81 22.87 160 0.168 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.2 total, 53.9 interval Flush(GB): cumulative 10.397, interval 10.397 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 43.24 GB write, 817.60 MB/s write, 33.08 GB read, 625.39 MB/s read, 157.0 seconds Interval compaction: 43.24 GB write, 820.81 MB/s write, 33.08 GB read, 627.85 MB/s read, 157.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 26, pending-compaction-bytes-delays: 36, pending-compaction-bytes-stops: 0, total-delays: 54, total-stops: 26, interval: 80 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5385913 Average: 2.2465 StdDev: 41.19 Min: 0 Median: 1.1353 Max: 33244 Percentiles: P50: 1.14 P75: 1.66 P99: 5.03 P99.9: 121.73 P99.99: 222.77 ------------------------------------------------------ [ 0, 1 ] 2348937 43.613% 43.613% ######### ( 1, 2 ] 2543427 47.224% 90.836% ######### ( 2, 3 ] 296608 5.507% 96.343% # ( 3, 4 ] 110239 2.047% 98.390% ( 4, 6 ] 63839 1.185% 99.576% ( 6, 10 ] 12976 0.241% 99.816% ( 10, 15 ] 1173 0.022% 99.838% ( 15, 22 ] 242 0.004% 99.843% ( 22, 34 ] 80 0.001% 99.844% ( 34, 51 ] 64 0.001% 99.845% ( 51, 76 ] 27 0.001% 99.846% ( 76, 110 ] 2202 0.041% 99.887% ( 110, 170 ] 3653 0.068% 99.955% ( 170, 250 ] 2893 0.054% 100.008% ( 250, 380 ] 1154 0.021% 100.030% ( 380, 580 ] 282 0.005% 100.035% ( 580, 870 ] 134 0.002% 100.037% ( 870, 1300 ] 41 0.001% 100.038% ( 1300, 1900 ] 61 0.001% 100.039% ( 1900, 2900 ] 66 0.001% 100.041% ( 2900, 4400 ] 70 0.001% 100.042% ( 4400, 6600 ] 21 0.000% 100.042% ( 6600, 9900 ] 10 0.000% 100.042% ( 9900, 14000 ] 2 0.000% 100.042% ( 14000, 22000 ] 9 0.000% 100.043% ( 22000, 33000 ] 3 0.000% 100.043% ( 33000, 50000 ] 1 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 2703100 Average: 4.2947 StdDev: 116.69 Min: 0 Median: 1.2512 Max: 38040 Percentiles: P50: 1.25 P75: 1.84 P99: 6.40 P99.9: 226.52 P99.99: 757.98 ------------------------------------------------------ [ 0, 1 ] 1064109 39.366% 39.366% ######## ( 1, 2 ] 1144279 42.332% 81.698% ######## ( 2, 3 ] 237606 8.790% 90.488% ## ( 3, 4 ] 134488 4.975% 95.464% # ( 4, 6 ] 93594 3.462% 98.926% # ( 6, 10 ] 20191 0.747% 99.673% ( 10, 15 ] 1297 0.048% 99.721% ( 15, 22 ] 332 0.012% 99.733% ( 22, 34 ] 104 0.004% 99.737% ( 34, 51 ] 51 0.002% 99.739% ( 51, 76 ] 60 0.002% 99.741% ( 76, 110 ] 1815 0.067% 99.809% ( 110, 170 ] 1349 0.050% 99.858% ( 170, 250 ] 1595 0.059% 99.918% ( 250, 380 ] 1081 0.040% 99.957% ( 380, 580 ] 656 0.024% 99.982% ( 580, 870 ] 371 0.014% 99.995% ( 870, 1300 ] 149 0.006% 100.001% ( 1300, 1900 ] 155 0.006% 100.007% ( 1900, 2900 ] 303 0.011% 100.018% ( 2900, 4400 ] 432 0.016% 100.034% ( 4400, 6600 ] 135 0.005% 100.039% ( 6600, 9900 ] 50 0.002% 100.041% ( 9900, 14000 ] 14 0.001% 100.041% ( 14000, 22000 ] 28 0.001% 100.042% ( 22000, 33000 ] 13 0.000% 100.043% ( 33000, 50000 ] 2 0.000% 100.043% ** Level 2 read latency histogram (micros): Count: 76268 Average: 2.1841 StdDev: 11.42 Min: 0 Median: 1.2302 Max: 1173 Percentiles: P50: 1.23 P75: 1.76 P99: 5.62 P99.9: 134.33 P99.99: 492.44 ------------------------------------------------------ [ 0, 1 ] 29825 39.106% 39.106% ######## ( 1, 2 ] 36097 47.329% 86.435% ######### ( 2, 3 ] 5977 7.837% 94.272% ## ( 3, 4 ] 2402 3.149% 97.421% # ( 4, 6 ] 1484 1.946% 99.367% ( 6, 10 ] 301 0.395% 99.761% ( 10, 15 ] 26 0.034% 99.795% ( 15, 22 ] 9 0.012% 99.807% ( 22, 34 ] 3 0.004% 99.811% ( 34, 51 ] 25 0.033% 99.844% ( 51, 76 ] 28 0.037% 99.881% ( 76, 110 ] 5 0.007% 99.887% ( 110, 170 ] 24 0.031% 99.919% ( 170, 250 ] 36 0.047% 99.966% ( 250, 380 ] 15 0.020% 99.986% ( 380, 580 ] 6 0.008% 99.993% ( 580, 870 ] 2 0.003% 99.996% ( 870, 1300 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 623872 Average: 7.6673 StdDev: 215.03 Min: 0 Median: 1.4368 Max: 49900 Percentiles: P50: 1.44 P75: 1.97 P99: 7.57 P99.9: 839.45 P99.99: 3704.50 ------------------------------------------------------ [ 0, 1 ] 184270 29.537% 29.537% ###### ( 1, 2 ] 292302 46.853% 76.389% ######### ( 2, 3 ] 77688 12.453% 88.842% ## ( 3, 4 ] 39995 6.411% 95.253% # ( 4, 6 ] 21905 3.511% 98.764% # ( 6, 10 ] 3747 0.601% 99.364% ( 10, 15 ] 260 0.042% 99.406% ( 15, 22 ] 122 0.020% 99.426% ( 22, 34 ] 47 0.008% 99.433% ( 34, 51 ] 155 0.025% 99.458% ( 51, 76 ] 59 0.009% 99.468% ( 76, 110 ] 95 0.015% 99.483% ( 110, 170 ] 445 0.071% 99.554% ( 170, 250 ] 525 0.084% 99.638% ( 250, 380 ] 661 0.106% 99.744% ( 380, 580 ] 625 0.100% 99.844% ( 580, 870 ] 388 0.062% 99.907% ( 870, 1300 ] 175 0.028% 99.935% ( 1300, 1900 ] 95 0.015% 99.950% ( 1900, 2900 ] 153 0.025% 99.974% ( 2900, 4400 ] 182 0.029% 100.004% ( 4400, 6600 ] 45 0.007% 100.011% ( 6600, 9900 ] 12 0.002% 100.013% ( 9900, 14000 ] 6 0.001% 100.014% ( 14000, 22000 ] 13 0.002% 100.016% ( 22000, 33000 ] 12 0.002% 100.018% ( 33000, 50000 ] 6 0.001% 100.019% ** Level 4 read latency histogram (micros): Count: 158179 Average: 12.4193 StdDev: 194.31 Min: 0 Median: 1.5274 Max: 37842 Percentiles: P50: 1.53 P75: 2.22 P99: 14.53 P99.9: 2577.53 P99.99: 4372.73 ------------------------------------------------------ [ 0, 1 ] 40579 25.654% 25.654% ##### ( 1, 2 ] 73022 46.164% 71.818% ######### ( 2, 3 ] 22673 14.334% 86.152% ### ( 3, 4 ] 12647 7.995% 94.147% ## ( 4, 6 ] 6219 3.932% 98.079% # ( 6, 10 ] 1382 0.874% 98.952% ( 10, 15 ] 83 0.052% 99.005% ( 15, 22 ] 27 0.017% 99.022% ( 22, 34 ] 14 0.009% 99.031% ( 34, 51 ] 6 0.004% 99.035% ( 51, 76 ] 5 0.003% 99.038% ( 76, 110 ] 11 0.007% 99.045% ( 110, 170 ] 59 0.037% 99.082% ( 170, 250 ] 191 0.121% 99.203% ( 250, 380 ] 250 0.158% 99.361% ( 380, 580 ] 306 0.193% 99.554% ( 580, 870 ] 261 0.165% 99.719% ( 870, 1300 ] 114 0.072% 99.791% ( 1300, 1900 ] 79 0.050% 99.841% ( 1900, 2900 ] 137 0.087% 99.928% ( 2900, 4400 ] 100 0.063% 99.991% ( 4400, 6600 ] 22 0.014% 100.005% ( 6600, 9900 ] 3 0.002% 100.007% ( 9900, 14000 ] 1 0.001% 100.008% ( 14000, 22000 ] 2 0.001% 100.009% ( 22000, 33000 ] 1 0.001% 100.009% ( 33000, 50000 ] 1 0.001% 100.010% ** Level 5 read latency histogram (micros): Count: 300 Average: 656.1567 StdDev: 831.00 Min: 101 Median: 342.8571 Max: 5411 Percentiles: P50: 342.86 P75: 762.29 P99: 4250.00 P99.9: 5411.00 P99.99: 5411.00 ------------------------------------------------------ ( 76, 110 ] 5 1.667% 1.667% ( 110, 170 ] 54 18.000% 19.667% #### ( 170, 250 ] 51 17.000% 36.667% ### ( 250, 380 ] 56 18.667% 55.333% #### ( 380, 580 ] 37 12.333% 67.667% ## ( 580, 870 ] 35 11.667% 79.333% ## ( 870, 1300 ] 29 9.667% 89.000% ## ( 1300, 1900 ] 8 2.667% 91.667% # ( 1900, 2900 ] 13 4.333% 96.000% # ( 2900, 4400 ] 10 3.333% 99.333% # ( 4400, 6600 ] 2 0.667% 100.000% ** DB Stats ** Uptime(secs): 54.2 total, 6.4 interval Cumulative writes: 0 writes, 11M keys, 0 commit groups, 0.0 writes per commit group, ingest: 10.57 GB, 199.89 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:24.847 H:M:S, 45.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 154.85 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.640 H:M:S, 57.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/06-05:16:32 ... thread 0: (1000000,12000000) ops and (210466.7,204443.7) ops/second in (4.751345,58.695857) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/14 3.19 GB 0.0 13.6 0.0 13.6 24.9 11.3 0.0 2.2 187.5 344.0 74.23 65.96 212 0.350 14M 35K 0.0 0.0 L1 4/4 343.49 MB 0.0 13.5 8.0 5.5 13.4 7.9 0.1 1.7 288.7 285.1 48.04 44.35 6 8.006 11M 68K 0.0 0.0 L2 1/0 56.47 MB 0.6 0.1 0.1 0.1 0.1 0.1 7.6 2.0 252.2 252.1 0.50 0.49 1 0.500 127K 42 0.0 0.0 L3 22/0 987.49 MB 1.0 4.7 2.0 2.7 4.7 2.0 5.7 2.3 187.3 185.9 25.68 17.96 23 1.116 4288K 33K 0.0 0.0 L4 169/0 9.61 GB 1.0 8.7 6.3 2.5 8.7 6.2 1.2 1.4 160.8 159.6 55.71 35.30 63 0.884 8924K 54K 0.0 0.0 L5 1225/0 93.06 GB 1.0 0.0 0.0 0.0 0.0 0.0 7.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1435/18 107.22 GB 0.0 40.7 16.4 24.3 51.8 27.5 21.9 4.5 204.2 259.7 204.16 164.05 305 0.669 38M 192K 0.0 0.0 Int 0/0 0.00 KB 0.0 40.7 16.4 24.3 51.8 27.5 21.9 4.5 204.2 259.7 204.16 164.05 305 0.669 38M 192K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 40.7 16.4 24.3 40.4 16.1 0.0 0.0 241.2 239.4 172.82 138.99 132 1.309 38M 192K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 11.4 11.4 0.0 0.0 0.0 371.8 31.35 25.06 173 0.181 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 58.9 total, 58.7 interval Flush(GB): cumulative 11.382, interval 11.382 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 51.78 GB write, 900.10 MB/s write, 40.70 GB read, 707.53 MB/s read, 204.2 seconds Interval compaction: 51.78 GB write, 903.35 MB/s write, 40.70 GB read, 710.08 MB/s read, 204.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 18, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 18, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 58, pending-compaction-bytes-delays: 36, pending-compaction-bytes-stops: 0, total-delays: 54, total-stops: 58, interval: 112 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 5828530 Average: 2.3690 StdDev: 43.85 Min: 0 Median: 1.1528 Max: 33244 Percentiles: P50: 1.15 P75: 1.68 P99: 5.15 P99.9: 122.21 P99.99: 233.72 ------------------------------------------------------ [ 0, 1 ] 2494825 42.804% 42.804% ######### ( 1, 2 ] 2745171 47.099% 89.903% ######### ( 2, 3 ] 348604 5.981% 95.884% # ( 3, 4 ] 137714 2.363% 98.246% ( 4, 6 ] 76542 1.313% 99.560% ( 6, 10 ] 15176 0.260% 99.820% ( 10, 15 ] 1284 0.022% 99.842% ( 15, 22 ] 258 0.004% 99.846% ( 22, 34 ] 82 0.001% 99.848% ( 34, 51 ] 67 0.001% 99.849% ( 51, 76 ] 30 0.001% 99.849% ( 76, 110 ] 2203 0.038% 99.887% ( 110, 170 ] 3667 0.063% 99.950% ( 170, 250 ] 2919 0.050% 100.000% ( 250, 380 ] 1243 0.021% 100.022% ( 380, 580 ] 421 0.007% 100.029% ( 580, 870 ] 257 0.004% 100.033% ( 870, 1300 ] 104 0.002% 100.035% ( 1300, 1900 ] 103 0.002% 100.037% ( 1900, 2900 ] 117 0.002% 100.039% ( 2900, 4400 ] 145 0.002% 100.041% ( 4400, 6600 ] 37 0.001% 100.042% ( 6600, 9900 ] 12 0.000% 100.042% ( 9900, 14000 ] 2 0.000% 100.042% ( 14000, 22000 ] 9 0.000% 100.042% ( 22000, 33000 ] 3 0.000% 100.042% ( 33000, 50000 ] 1 0.000% 100.042% ** Level 1 read latency histogram (micros): Count: 3243938 Average: 5.2113 StdDev: 125.95 Min: 0 Median: 1.3065 Max: 38040 Percentiles: P50: 1.31 P75: 1.89 P99: 6.79 P99.9: 293.99 P99.99: 1958.32 ------------------------------------------------------ [ 0, 1 ] 1194629 36.827% 36.827% ####### ( 1, 2 ] 1394475 42.987% 79.814% ######### ( 2, 3 ] 316594 9.760% 89.573% ## ( 3, 4 ] 182100 5.614% 95.187% # ( 4, 6 ] 118499 3.653% 98.840% # ( 6, 10 ] 26495 0.817% 99.656% ( 10, 15 ] 1848 0.057% 99.713% ( 15, 22 ] 483 0.015% 99.728% ( 22, 34 ] 142 0.004% 99.733% ( 34, 51 ] 73 0.002% 99.735% ( 51, 76 ] 66 0.002% 99.737% ( 76, 110 ] 1816 0.056% 99.793% ( 110, 170 ] 1364 0.042% 99.835% ( 170, 250 ] 1679 0.052% 99.887% ( 250, 380 ] 1274 0.039% 99.926% ( 380, 580 ] 930 0.029% 99.955% ( 580, 870 ] 551 0.017% 99.972% ( 870, 1300 ] 245 0.008% 99.979% ( 1300, 1900 ] 312 0.010% 99.989% ( 1900, 2900 ] 662 0.020% 100.009% ( 2900, 4400 ] 831 0.026% 100.035% ( 4400, 6600 ] 286 0.009% 100.044% ( 6600, 9900 ] 86 0.003% 100.046% ( 9900, 14000 ] 14 0.000% 100.047% ( 14000, 22000 ] 31 0.001% 100.048% ( 22000, 33000 ] 13 0.000% 100.048% ( 33000, 50000 ] 2 0.000% 100.048% ** Level 2 read latency histogram (micros): Count: 76268 Average: 2.1841 StdDev: 11.42 Min: 0 Median: 1.2302 Max: 1173 Percentiles: P50: 1.23 P75: 1.76 P99: 5.62 P99.9: 134.33 P99.99: 492.44 ------------------------------------------------------ [ 0, 1 ] 29825 39.106% 39.106% ######## ( 1, 2 ] 36097 47.329% 86.435% ######### ( 2, 3 ] 5977 7.837% 94.272% ## ( 3, 4 ] 2402 3.149% 97.421% # ( 4, 6 ] 1484 1.946% 99.367% ( 6, 10 ] 301 0.395% 99.761% ( 10, 15 ] 26 0.034% 99.795% ( 15, 22 ] 9 0.012% 99.807% ( 22, 34 ] 3 0.004% 99.811% ( 34, 51 ] 25 0.033% 99.844% ( 51, 76 ] 28 0.037% 99.881% ( 76, 110 ] 5 0.007% 99.887% ( 110, 170 ] 24 0.031% 99.919% ( 170, 250 ] 36 0.047% 99.966% ( 250, 380 ] 15 0.020% 99.986% ( 380, 580 ] 6 0.008% 99.993% ( 580, 870 ] 2 0.003% 99.996% ( 870, 1300 ] 3 0.004% 100.000% ** Level 3 read latency histogram (micros): Count: 1048611 Average: 7.2906 StdDev: 186.52 Min: 0 Median: 1.4586 Max: 49900 Percentiles: P50: 1.46 P75: 1.99 P99: 6.82 P99.9: 903.54 P99.99: 3736.99 ------------------------------------------------------ [ 0, 1 ] 299861 28.596% 28.596% ###### ( 1, 2 ] 489453 46.676% 75.272% ######### ( 2, 3 ] 136590 13.026% 88.298% ### ( 3, 4 ] 73900 7.047% 95.346% # ( 4, 6 ] 37035 3.532% 98.877% # ( 6, 10 ] 6287 0.600% 99.477% ( 10, 15 ] 463 0.044% 99.521% ( 15, 22 ] 157 0.015% 99.536% ( 22, 34 ] 70 0.007% 99.543% ( 34, 51 ] 164 0.016% 99.558% ( 51, 76 ] 70 0.007% 99.565% ( 76, 110 ] 99 0.009% 99.574% ( 110, 170 ] 462 0.044% 99.619% ( 170, 250 ] 597 0.057% 99.675% ( 250, 380 ] 853 0.081% 99.757% ( 380, 580 ] 887 0.085% 99.841% ( 580, 870 ] 592 0.056% 99.898% ( 870, 1300 ] 287 0.027% 99.925% ( 1300, 1900 ] 185 0.018% 99.943% ( 1900, 2900 ] 310 0.030% 99.972% ( 2900, 4400 ] 330 0.031% 100.004% ( 4400, 6600 ] 90 0.009% 100.012% ( 6600, 9900 ] 26 0.002% 100.015% ( 9900, 14000 ] 7 0.001% 100.016% ( 14000, 22000 ] 15 0.001% 100.017% ( 22000, 33000 ] 12 0.001% 100.018% ( 33000, 50000 ] 7 0.001% 100.019% ** Level 4 read latency histogram (micros): Count: 527436 Average: 12.2505 StdDev: 176.07 Min: 0 Median: 1.5064 Max: 37842 Percentiles: P50: 1.51 P75: 2.17 P99: 9.51 P99.9: 2743.45 P99.99: 4425.83 ------------------------------------------------------ [ 0, 1 ] 141453 26.819% 26.819% ##### ( 1, 2 ] 241429 45.774% 72.593% ######### ( 2, 3 ] 73651 13.964% 86.557% ### ( 3, 4 ] 41838 7.932% 94.489% ## ( 4, 6 ] 19815 3.757% 98.246% # ( 6, 10 ] 4530 0.859% 99.105% ( 10, 15 ] 327 0.062% 99.167% ( 15, 22 ] 79 0.015% 99.182% ( 22, 34 ] 35 0.007% 99.189% ( 34, 51 ] 15 0.003% 99.192% ( 51, 76 ] 13 0.002% 99.194% ( 76, 110 ] 24 0.005% 99.199% ( 110, 170 ] 137 0.026% 99.225% ( 170, 250 ] 315 0.060% 99.284% ( 250, 380 ] 599 0.114% 99.398% ( 380, 580 ] 858 0.163% 99.561% ( 580, 870 ] 771 0.146% 99.707% ( 870, 1300 ] 412 0.078% 99.785% ( 1300, 1900 ] 255 0.048% 99.833% ( 1900, 2900 ] 418 0.079% 99.912% ( 2900, 4400 ] 408 0.077% 99.990% ( 4400, 6600 ] 107 0.020% 100.010% ( 6600, 9900 ] 17 0.003% 100.013% ( 9900, 14000 ] 3 0.001% 100.014% ( 14000, 22000 ] 3 0.001% 100.014% ( 22000, 33000 ] 1 0.000% 100.015% ( 33000, 50000 ] 1 0.000% 100.015% ** Level 5 read latency histogram (micros): Count: 460 Average: 740.6022 StdDev: 856.03 Min: 101 Median: 418.8060 Max: 5411 Percentiles: P50: 418.81 P75: 870.00 P99: 4266.67 P99.9: 5411.00 P99.99: 5411.00 ------------------------------------------------------ ( 76, 110 ] 5 1.087% 1.087% ( 110, 170 ] 63 13.696% 14.783% ### ( 170, 250 ] 63 13.696% 28.478% ### ( 250, 380 ] 86 18.696% 47.174% #### ( 380, 580 ] 67 14.565% 61.739% ### ( 580, 870 ] 61 13.261% 75.000% ### ( 870, 1300 ] 49 10.652% 85.652% ## ( 1300, 1900 ] 24 5.217% 90.870% # ( 1900, 2900 ] 21 4.565% 95.435% # ( 2900, 4400 ] 18 3.913% 99.348% # ( 4400, 6600 ] 3 0.652% 100.000% ** DB Stats ** Uptime(secs): 58.9 total, 4.8 interval Cumulative writes: 0 writes, 12M keys, 0 commit groups, 0.0 writes per commit group, ingest: 11.53 GB, 200.48 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.871 H:M:S, 45.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 207.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.025 H:M:S, 42.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 4.794 micros/op 208581 ops/sec 60.001 seconds 12514999 operations; 202.1 MB/s Microseconds per write: Count: 12514999 Average: 4.7943 StdDev: 365.50 Min: 0 Median: 1.6748 Max: 749632 Percentiles: P50: 1.67 P75: 2.53 P99: 9.04 P99.9: 1035.86 P99.99: 2305.52 ------------------------------------------------------ [ 0, 1 ] 2556204 20.425% 20.425% #### ( 1, 2 ] 5485338 43.830% 64.255% ######### ( 2, 3 ] 2550382 20.379% 84.634% #### ( 3, 4 ] 1197404 9.568% 94.202% ## ( 4, 6 ] 510158 4.076% 98.278% # ( 6, 10 ] 118841 0.950% 99.228% ( 10, 15 ] 34334 0.274% 99.502% ( 15, 22 ] 19219 0.154% 99.655% ( 22, 34 ] 9280 0.074% 99.730% ( 34, 51 ] 1710 0.014% 99.743% ( 51, 76 ] 1077 0.009% 99.752% ( 76, 110 ] 9448 0.075% 99.827% ( 110, 170 ] 1866 0.015% 99.842% ( 170, 250 ] 351 0.003% 99.845% ( 250, 380 ] 201 0.002% 99.847% ( 380, 580 ] 57 0.000% 99.847% ( 580, 870 ] 44 0.000% 99.848% ( 870, 1300 ] 17033 0.136% 99.984% ( 1300, 1900 ] 58 0.000% 99.984% ( 1900, 2900 ] 1831 0.015% 99.999% ( 2900, 4400 ] 107 0.001% 100.000% ( 4400, 6600 ] 25 0.000% 100.000% ( 6600, 9900 ] 8 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 1 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% ( 110000, 170000 ] 5 0.000% 100.000% ( 170000, 250000 ] 5 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% ( 570000, 860000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 319417 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 12514999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 12915478968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 800 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 27006534 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 45431205644 rocksdb.compact.write.bytes COUNT : 45099366433 rocksdb.flush.write.bytes COUNT : 12815571738 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 102 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 473 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 12711811072 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4560896 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 45430832315 rocksdb.non.last.level.read.count COUNT : 10973973 rocksdb.block.checksum.compute.count COUNT : 11004476 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.315652 P95 : 3.782709 P99 : 7.762433 P100 : 749625.000000 COUNT : 12514999 SUM : 54869197 rocksdb.compaction.times.micros P50 : 868947.368421 P95 : 3320000.000000 P99 : 13286000.000000 P100 : 15384785.000000 COUNT : 134 SUM : 174455882 rocksdb.compaction.times.cpu_micros P50 : 698360.655738 P95 : 2550000.000000 P99 : 13286000.000000 P100 : 14343278.000000 COUNT : 134 SUM : 140582712 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 561.927711 P95 : 1870.000000 P99 : 6913.500000 P100 : 8879.000000 COUNT : 181 SUM : 143879 rocksdb.compaction.outfile.sync.micros P50 : 825.181818 P95 : 8720.000000 P99 : 15680.000000 P100 : 51362.000000 COUNT : 516 SUM : 1205657 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 159.615385 P95 : 1742.500000 P99 : 3995.000000 P100 : 8302.000000 COUNT : 362 SUM : 137851 rocksdb.table.open.io.micros P50 : 915.819672 P95 : 5500.000000 P99 : 10583.333333 P100 : 18440.000000 COUNT : 800 SUM : 1248901 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 2.519874 P95 : 5.405365 P99 : 8.981862 P100 : 49903.000000 COUNT : 11004074 SUM : 60763899 rocksdb.read.block.get.micros P50 : 305.020747 P95 : 2188.888889 P99 : 4871.428571 P100 : 9053.000000 COUNT : 1600 SUM : 936833 rocksdb.write.raw.block.micros P50 : 0.509797 P95 : 0.968615 P99 : 2.199270 P100 : 58299.000000 COUNT : 14038524 SUM : 24113747 rocksdb.numfiles.in.singlecompaction P50 : 3.159483 P95 : 4.420000 P99 : 25.240000 P100 : 28.000000 COUNT : 219 SUM : 813 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.585152 P95 : 1129.984402 P99 : 1987.021751 P100 : 749448.000000 COUNT : 172697 SUM : 27037883 rocksdb.sst.read.micros P50 : 1.240750 P95 : 3.540156 P99 : 5.845469 P100 : 49900.000000 COUNT : 10977082 SUM : 45928207 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 12514999 SUM : 12915478968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 147448.275862 P95 : 368625.000000 P99 : 801275.000000 P100 : 866459.000000 COUNT : 181 SUM : 32550192 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 517 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0