[2024-12-14 03:44:10.443885] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 22.11.4 initialization... [2024-12-14 03:44:10.444044] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid698015 ] Set seed to 1734144250440416 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-14 03:44:10.530948] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-14 03:44:10.571990] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-14 03:44:10.572031] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 698015' to capture a snapshot of events at runtime. [2024-12-14 03:44:10.572044] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid698015 for offline analysis/debug. [2024-12-14 03:44:10.572074] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 14 03:44:14 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/14-03:44:17 ... thread 0: (1000000,1000000) ops and (358809.9,358809.9) ops/second in (2.786991,2.786991) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/8 504.00 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 353.6 2.32 2.10 12 0.193 0 0 0.0 0.0 L1 3/3 188.85 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.1 1.0 258.8 258.6 0.73 0.70 1 0.730 191K 93 0.0 0.0 L2 2/1 125.96 MB 0.0 0.1 0.1 0.1 0.1 0.1 0.2 2.0 230.1 230.0 0.55 0.52 1 0.548 127K 39 0.0 0.0 L3 9/0 741.67 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.1 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1182/12 96.94 GB 0.0 0.3 0.2 0.1 1.1 1.0 0.4 1.4 87.6 315.5 3.59 3.32 14 0.257 319K 132 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.1 1.1 1.0 0.3 1.4 87.6 315.5 3.59 3.32 14 0.257 319K 132 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.1 0.3 0.2 0.0 0.0 246.5 246.4 1.28 1.22 2 0.639 319K 132 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 353.6 2.32 2.10 12 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.0 total, 2.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.11 GB write, 383.08 MB/s write, 0.31 GB read, 106.42 MB/s read, 3.6 seconds Interval compaction: 1.11 GB write, 406.65 MB/s write, 0.31 GB read, 112.97 MB/s read, 3.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 2, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 2, interval: 2 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 118017 Average: 1.8648 StdDev: 19.76 Min: 0 Median: 1.1529 Max: 3401 Percentiles: P50: 1.15 P75: 1.63 P99: 4.56 P99.9: 10.41 P99.99: 258.59 ------------------------------------------------------ [ 0, 1 ] 49491 41.935% 41.935% ######## ( 1, 2 ] 62255 52.751% 94.686% ########### ( 2, 3 ] 3393 2.875% 97.561% # ( 3, 4 ] 1430 1.212% 98.773% ( 4, 6 ] 956 0.810% 99.583% ( 6, 10 ] 368 0.312% 99.895% ( 10, 15 ] 86 0.073% 99.968% ( 15, 22 ] 11 0.009% 99.977% ( 22, 34 ] 2 0.002% 99.979% ( 34, 51 ] 1 0.001% 99.980% ( 51, 76 ] 2 0.002% 99.981% ( 110, 170 ] 5 0.004% 99.986% ( 170, 250 ] 6 0.005% 99.991% ( 250, 380 ] 3 0.003% 99.993% ( 380, 580 ] 2 0.002% 99.995% ( 580, 870 ] 1 0.001% 99.996% ( 870, 1300 ] 1 0.001% 99.997% ( 1300, 1900 ] 2 0.002% 99.998% ( 1900, 2900 ] 1 0.001% 99.999% ( 2900, 4400 ] 3 0.003% 100.002% ** Level 1 read latency histogram (micros): Count: 23465 Average: 1.9643 StdDev: 21.86 Min: 0 Median: 1.1645 Max: 2698 Percentiles: P50: 1.16 P75: 1.63 P99: 3.94 P99.9: 9.48 P99.99: 769.51 ------------------------------------------------------ [ 0, 1 ] 9664 41.185% 41.185% ######## ( 1, 2 ] 12574 53.586% 94.771% ########### ( 2, 3 ] 702 2.992% 97.763% # ( 3, 4 ] 309 1.317% 99.079% ( 4, 6 ] 156 0.665% 99.744% ( 6, 10 ] 42 0.179% 99.923% ( 10, 15 ] 9 0.038% 99.962% ( 51, 76 ] 1 0.004% 99.966% ( 170, 250 ] 1 0.004% 99.970% ( 250, 380 ] 4 0.017% 99.987% ( 580, 870 ] 1 0.004% 99.991% ( 1300, 1900 ] 1 0.004% 99.996% ( 1900, 2900 ] 1 0.004% 100.000% ** Level 2 read latency histogram (micros): Count: 7065 Average: 2.6258 StdDev: 9.90 Min: 1 Median: 1.5913 Max: 703 Percentiles: P50: 1.59 P75: 2.12 P99: 9.19 P99.9: 17.26 P99.99: 665.09 ------------------------------------------------------ [ 0, 1 ] 1120 15.853% 15.853% ### ( 1, 2 ] 4082 57.778% 73.631% ############ ( 2, 3 ] 793 11.224% 84.855% ## ( 3, 4 ] 474 6.709% 91.564% # ( 4, 6 ] 402 5.690% 97.254% # ( 6, 10 ] 156 2.208% 99.462% ( 10, 15 ] 30 0.425% 99.887% ( 15, 22 ] 6 0.085% 99.972% ( 34, 51 ] 1 0.014% 99.986% ( 380, 580 ] 1 0.014% 100.000% ( 580, 870 ] 1 0.014% 100.014% ** Level 3 read latency histogram (micros): Count: 40 Average: 1408.5500 StdDev: 880.14 Min: 170 Median: 1428.5714 Max: 3968 Percentiles: P50: 1428.57 P75: 1857.14 P99: 3968.00 P99.9: 3968.00 P99.99: 3968.00 ------------------------------------------------------ ( 110, 170 ] 1 2.500% 2.500% # ( 170, 250 ] 2 5.000% 7.500% # ( 250, 380 ] 3 7.500% 15.000% ## ( 380, 580 ] 1 2.500% 17.500% # ( 580, 870 ] 7 17.500% 35.000% #### ( 870, 1300 ] 3 7.500% 42.500% ## ( 1300, 1900 ] 14 35.000% 77.500% ####### ( 1900, 2900 ] 6 15.000% 92.500% ### ( 2900, 4400 ] 3 7.500% 100.000% ## ** Level 4 read latency histogram (micros): Count: 34 Average: 1695.2353 StdDev: 1134.08 Min: 135 Median: 1433.3333 Max: 5274 Percentiles: P50: 1433.33 P75: 2114.29 P99: 4230.00 P99.9: 4383.00 P99.99: 4398.30 ------------------------------------------------------ ( 110, 170 ] 1 2.941% 2.941% # ( 250, 380 ] 2 5.882% 8.824% # ( 380, 580 ] 1 2.941% 11.765% # ( 580, 870 ] 2 5.882% 17.647% # ( 870, 1300 ] 9 26.471% 44.118% ##### ( 1300, 1900 ] 9 26.471% 70.588% ##### ( 1900, 2900 ] 7 20.588% 91.176% #### ( 2900, 4400 ] 3 8.824% 100.000% ## ( 4400, 6600 ] 1 2.941% 102.941% # ** DB Stats ** Uptime(secs): 3.0 total, 2.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 332.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.193 H:M:S, 6.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 352.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.193 H:M:S, 6.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/14-03:44:20 ... thread 0: (1000000,2000000) ops and (331010.2,344349.9) ops/second in (3.021055,5.808046) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 1.23 GB 12.6 0.8 0.0 0.8 2.6 1.8 0.0 1.4 99.8 322.4 8.20 7.65 29 0.283 831K 847 0.0 0.0 L1 1/1 3.37 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 250.6 250.2 2.51 2.43 2 1.257 639K 832 0.0 0.0 L2 5/3 437.60 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 230.1 230.0 0.55 0.52 1 0.548 127K 39 0.0 0.0 L3 17/1 866.72 MB 0.8 0.1 0.1 0.0 0.1 0.1 0.1 1.0 221.0 221.0 0.57 0.52 1 0.566 126K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1192/12 97.92 GB 0.0 1.7 0.6 1.0 3.4 2.4 0.8 1.9 143.7 297.9 11.83 11.12 33 0.359 1725K 1718 0.0 0.0 Int 0/0 0.00 KB 0.0 1.7 0.6 1.0 3.4 2.4 0.7 1.9 143.7 297.9 11.83 11.12 33 0.359 1725K 1718 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.7 0.6 1.0 1.7 0.6 0.0 0.0 253.6 253.3 6.70 6.49 7 0.958 1725K 1718 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 356.3 5.13 4.62 26 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.0 total, 5.8 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.44 GB write, 589.39 MB/s write, 1.66 GB read, 284.23 MB/s read, 11.8 seconds Interval compaction: 3.44 GB write, 606.80 MB/s write, 1.66 GB read, 292.62 MB/s read, 11.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 377019 Average: 2.0109 StdDev: 14.69 Min: 0 Median: 1.3346 Max: 3401 Percentiles: P50: 1.33 P75: 1.75 P99: 5.42 P99.9: 10.31 P99.99: 21.21 ------------------------------------------------------ [ 0, 1 ] 113437 30.088% 30.088% ###### ( 1, 2 ] 224347 59.505% 89.593% ############ ( 2, 3 ] 21218 5.628% 95.221% # ( 3, 4 ] 10007 2.654% 97.875% # ( 4, 6 ] 5974 1.585% 99.460% ( 6, 10 ] 1639 0.435% 99.895% ( 10, 15 ] 339 0.090% 99.985% ( 15, 22 ] 24 0.006% 99.991% ( 22, 34 ] 7 0.002% 99.993% ( 34, 51 ] 4 0.001% 99.994% ( 51, 76 ] 6 0.002% 99.995% ( 110, 170 ] 9 0.002% 99.998% ( 170, 250 ] 16 0.004% 100.002% ( 250, 380 ] 9 0.002% 100.005% ( 380, 580 ] 5 0.001% 100.006% ( 580, 870 ] 4 0.001% 100.007% ( 870, 1300 ] 4 0.001% 100.008% ( 1300, 1900 ] 5 0.001% 100.009% ( 1900, 2900 ] 1 0.000% 100.010% ( 2900, 4400 ] 5 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 103594 Average: 2.1275 StdDev: 13.02 Min: 0 Median: 1.4300 Max: 2698 Percentiles: P50: 1.43 P75: 1.82 P99: 5.43 P99.9: 9.78 P99.99: 328.88 ------------------------------------------------------ [ 0, 1 ] 23378 22.567% 22.567% ##### ( 1, 2 ] 66086 63.793% 86.360% ############# ( 2, 3 ] 8219 7.934% 94.294% ## ( 3, 4 ] 3437 3.318% 97.612% # ( 4, 6 ] 2015 1.945% 99.557% ( 6, 10 ] 377 0.364% 99.921% ( 10, 15 ] 63 0.061% 99.982% ( 15, 22 ] 1 0.001% 99.983% ( 34, 51 ] 2 0.002% 99.985% ( 51, 76 ] 1 0.001% 99.986% ( 170, 250 ] 2 0.002% 99.987% ( 250, 380 ] 6 0.006% 99.993% ( 380, 580 ] 2 0.002% 99.995% ( 580, 870 ] 1 0.001% 99.996% ( 870, 1300 ] 2 0.002% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 2 0.002% 100.001% ** Level 2 read latency histogram (micros): Count: 31755 Average: 2.3106 StdDev: 4.78 Min: 1 Median: 1.5400 Max: 703 Percentiles: P50: 1.54 P75: 1.94 P99: 7.12 P99.9: 13.35 P99.99: 41.01 ------------------------------------------------------ [ 0, 1 ] 5116 16.111% 16.111% ### ( 1, 2 ] 19930 62.762% 78.873% ############# ( 2, 3 ] 3189 10.043% 88.915% ## ( 3, 4 ] 1750 5.511% 94.426% # ( 4, 6 ] 1357 4.273% 98.699% # ( 6, 10 ] 341 1.074% 99.773% ( 10, 15 ] 60 0.189% 99.962% ( 15, 22 ] 8 0.025% 99.987% ( 34, 51 ] 2 0.006% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 15994 Average: 5.7025 StdDev: 83.79 Min: 0 Median: 1.4773 Max: 3968 Percentiles: P50: 1.48 P75: 1.86 P99: 5.70 P99.9: 1620.24 P99.99: 3600.30 ------------------------------------------------------ [ 0, 1 ] 2947 18.426% 18.426% #### ( 1, 2 ] 10581 66.156% 84.582% ############# ( 2, 3 ] 1481 9.260% 93.841% ## ( 3, 4 ] 569 3.558% 97.399% # ( 4, 6 ] 302 1.888% 99.287% ( 6, 10 ] 56 0.350% 99.637% ( 10, 15 ] 15 0.094% 99.731% ( 15, 22 ] 1 0.006% 99.737% ( 110, 170 ] 1 0.006% 99.744% ( 170, 250 ] 2 0.013% 99.756% ( 250, 380 ] 4 0.025% 99.781% ( 380, 580 ] 1 0.006% 99.787% ( 580, 870 ] 7 0.044% 99.831% ( 870, 1300 ] 3 0.019% 99.850% ( 1300, 1900 ] 15 0.094% 99.944% ( 1900, 2900 ] 6 0.038% 99.981% ( 2900, 4400 ] 3 0.019% 100.000% ** Level 4 read latency histogram (micros): Count: 34 Average: 1695.2353 StdDev: 1134.08 Min: 135 Median: 1433.3333 Max: 5274 Percentiles: P50: 1433.33 P75: 2114.29 P99: 4230.00 P99.9: 4383.00 P99.99: 4398.30 ------------------------------------------------------ ( 110, 170 ] 1 2.941% 2.941% # ( 250, 380 ] 2 5.882% 8.824% # ( 380, 580 ] 1 2.941% 11.765% # ( 580, 870 ] 2 5.882% 17.647% # ( 870, 1300 ] 9 26.471% 44.118% ##### ( 1300, 1900 ] 9 26.471% 70.588% ##### ( 1900, 2900 ] 7 20.588% 91.176% #### ( 2900, 4400 ] 3 8.824% 100.000% ## ( 4400, 6600 ] 1 2.941% 102.941% # ** DB Stats ** Uptime(secs): 6.0 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 329.11 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.563 H:M:S, 9.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.370 H:M:S, 12.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-03:44:23 ... thread 0: (1000000,3000000) ops and (327100.0,338401.3) ops/second in (3.057169,8.865215) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 2.21 GB 81.9 1.3 0.0 1.3 4.1 2.8 0.0 1.5 102.2 321.1 12.95 12.06 45 0.288 1343K 1326 0.0 0.0 L1 1/1 3.37 MB 0.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 250.6 250.2 2.51 2.43 2 1.257 639K 832 0.0 0.0 L2 2/0 51.31 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 230.1 230.0 0.55 0.52 1 0.548 127K 39 0.0 0.0 L3 42/0 971.00 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 204.0 203.9 3.06 2.63 2 1.529 633K 528 0.0 0.0 L4 144/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1254/12 98.90 GB 0.0 2.6 1.0 1.6 5.4 3.8 1.5 2.0 141.8 290.3 19.07 17.64 50 0.381 2744K 2725 0.0 0.0 Int 0/0 0.00 KB 0.0 2.6 1.0 1.6 5.4 3.8 1.4 2.0 141.8 290.3 19.07 17.64 50 0.381 2744K 2725 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.6 1.0 1.6 2.6 1.0 0.0 0.0 243.8 243.5 11.09 10.46 10 1.109 2744K 2725 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 355.4 7.98 7.18 40 0.199 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.0 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.41 GB write, 612.41 MB/s write, 2.64 GB read, 299.06 MB/s read, 19.1 seconds Interval compaction: 5.41 GB write, 624.26 MB/s write, 2.64 GB read, 304.84 MB/s read, 19.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 7, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 7, interval: 7 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 733065 Average: 2.0591 StdDev: 12.08 Min: 0 Median: 1.3998 Max: 3401 Percentiles: P50: 1.40 P75: 1.80 P99: 5.46 P99.9: 10.00 P99.99: 14.65 ------------------------------------------------------ [ 0, 1 ] 181555 24.767% 24.767% ##### ( 1, 2 ] 462705 63.119% 87.886% ############# ( 2, 3 ] 49589 6.765% 94.650% # ( 3, 4 ] 22503 3.070% 97.720% # ( 4, 6 ] 12823 1.749% 99.469% ( 6, 10 ] 3157 0.431% 99.900% ( 10, 15 ] 709 0.097% 99.997% ( 15, 22 ] 37 0.005% 100.002% ( 22, 34 ] 10 0.001% 100.003% ( 34, 51 ] 7 0.001% 100.004% ( 51, 76 ] 6 0.001% 100.005% ( 76, 110 ] 1 0.000% 100.005% ( 110, 170 ] 11 0.002% 100.007% ( 170, 250 ] 27 0.004% 100.010% ( 250, 380 ] 15 0.002% 100.012% ( 380, 580 ] 6 0.001% 100.013% ( 580, 870 ] 10 0.001% 100.014% ( 870, 1300 ] 6 0.001% 100.015% ( 1300, 1900 ] 7 0.001% 100.016% ( 1900, 2900 ] 3 0.000% 100.017% ( 2900, 4400 ] 5 0.001% 100.017% ** Level 1 read latency histogram (micros): Count: 146060 Average: 2.1494 StdDev: 10.98 Min: 0 Median: 1.4626 Max: 2698 Percentiles: P50: 1.46 P75: 1.85 P99: 5.56 P99.9: 10.04 P99.99: 225.76 ------------------------------------------------------ [ 0, 1 ] 29068 19.901% 19.901% #### ( 1, 2 ] 95032 65.064% 84.965% ############# ( 2, 3 ] 12436 8.514% 93.479% ## ( 3, 4 ] 5428 3.716% 97.196% # ( 4, 6 ] 3382 2.315% 99.511% ( 6, 10 ] 567 0.388% 99.899% ( 10, 15 ] 122 0.084% 99.983% ( 15, 22 ] 5 0.003% 99.986% ( 22, 34 ] 1 0.001% 99.987% ( 34, 51 ] 2 0.001% 99.988% ( 51, 76 ] 1 0.001% 99.989% ( 170, 250 ] 2 0.001% 99.990% ( 250, 380 ] 6 0.004% 99.995% ( 380, 580 ] 2 0.001% 99.996% ( 580, 870 ] 1 0.001% 99.997% ( 870, 1300 ] 2 0.001% 99.998% ( 1300, 1900 ] 1 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31755 Average: 2.3106 StdDev: 4.78 Min: 1 Median: 1.5400 Max: 703 Percentiles: P50: 1.54 P75: 1.94 P99: 7.12 P99.9: 13.35 P99.99: 41.01 ------------------------------------------------------ [ 0, 1 ] 5116 16.111% 16.111% ### ( 1, 2 ] 19930 62.762% 78.873% ############# ( 2, 3 ] 3189 10.043% 88.915% ## ( 3, 4 ] 1750 5.511% 94.426% # ( 4, 6 ] 1357 4.273% 98.699% # ( 6, 10 ] 341 1.074% 99.773% ( 10, 15 ] 60 0.189% 99.962% ( 15, 22 ] 8 0.025% 99.987% ( 34, 51 ] 2 0.006% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28961 Average: 4.3077 StdDev: 63.18 Min: 0 Median: 1.4958 Max: 3968 Percentiles: P50: 1.50 P75: 1.87 P99: 5.85 P99.9: 830.19 P99.99: 2951.95 ------------------------------------------------------ [ 0, 1 ] 5006 17.285% 17.285% ### ( 1, 2 ] 19108 65.978% 83.264% ############# ( 2, 3 ] 2763 9.540% 92.804% ## ( 3, 4 ] 1188 4.102% 96.906% # ( 4, 6 ] 654 2.258% 99.164% ( 6, 10 ] 101 0.349% 99.513% ( 10, 15 ] 32 0.110% 99.624% ( 15, 22 ] 1 0.003% 99.627% ( 22, 34 ] 56 0.193% 99.820% ( 76, 110 ] 1 0.003% 99.824% ( 110, 170 ] 2 0.007% 99.831% ( 170, 250 ] 4 0.014% 99.845% ( 250, 380 ] 4 0.014% 99.858% ( 380, 580 ] 6 0.021% 99.879% ( 580, 870 ] 7 0.024% 99.903% ( 870, 1300 ] 3 0.010% 99.914% ( 1300, 1900 ] 16 0.055% 99.969% ( 1900, 2900 ] 6 0.021% 99.990% ( 2900, 4400 ] 3 0.010% 100.000% ** Level 4 read latency histogram (micros): Count: 34 Average: 1695.2353 StdDev: 1134.08 Min: 135 Median: 1433.3333 Max: 5274 Percentiles: P50: 1433.33 P75: 2114.29 P99: 4230.00 P99.9: 4383.00 P99.99: 4398.30 ------------------------------------------------------ ( 110, 170 ] 1 2.941% 2.941% # ( 250, 380 ] 2 5.882% 8.824% # ( 380, 580 ] 1 2.941% 11.765% # ( 580, 870 ] 2 5.882% 17.647% # ( 870, 1300 ] 9 26.471% 44.118% ##### ( 1300, 1900 ] 9 26.471% 70.588% ##### ( 1900, 2900 ] 7 20.588% 91.176% #### ( 2900, 4400 ] 3 8.824% 100.000% ## ( 4400, 6600 ] 1 2.941% 102.941% # ** Level 5 read latency histogram (micros): Count: 20 Average: 769.3000 StdDev: 836.58 Min: 89 Median: 250.0000 Max: 2970 Percentiles: P50: 250.00 P75: 1300.00 P99: 2970.00 P99.9: 2970.00 P99.99: 2970.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 6 30.000% 35.000% ###### ( 170, 250 ] 3 15.000% 50.000% ### ( 380, 580 ] 3 15.000% 65.000% ### ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 9.0 total, 3.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 326.68 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.941 H:M:S, 10.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 321.93 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.378 H:M:S, 12.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-03:44:26 ... thread 0: (1000000,4000000) ops and (327338.0,335565.9) ops/second in (3.054946,11.920161) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/10 2.03 GB 6.3 2.4 0.0 2.4 6.1 3.7 0.0 1.6 123.4 313.1 19.91 18.63 62 0.321 2494K 2515 0.0 0.0 L1 11/11 1.10 GB 0.0 1.7 1.5 0.2 1.7 1.5 0.1 1.1 240.5 239.6 7.34 7.13 3 2.448 1793K 6181 0.0 0.0 L2 2/0 51.31 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 230.1 230.0 0.55 0.52 1 0.548 127K 39 0.0 0.0 L3 42/0 971.00 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 204.0 203.9 3.06 2.63 2 1.529 633K 528 0.0 0.0 L4 144/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1258/21 99.82 GB 0.0 4.9 2.1 2.8 8.5 5.8 1.5 2.3 161.1 283.3 30.86 28.91 68 0.454 5049K 9263 0.0 0.0 Int 0/0 0.00 KB 0.0 4.9 2.1 2.8 8.5 5.8 1.4 2.3 161.1 283.3 30.86 28.91 68 0.454 5049K 9263 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.9 2.1 2.8 4.8 2.1 0.0 0.0 246.8 246.3 20.15 19.31 15 1.344 5049K 9263 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 352.9 10.71 9.60 53 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.54 GB write, 723.02 MB/s write, 4.86 GB read, 411.25 MB/s read, 30.9 seconds Interval compaction: 8.54 GB write, 733.43 MB/s write, 4.86 GB read, 417.17 MB/s read, 30.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 11, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 11, interval: 11 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1059287 Average: 2.0599 StdDev: 12.12 Min: 0 Median: 1.4008 Max: 3742 Percentiles: P50: 1.40 P75: 1.79 P99: 5.40 P99.9: 9.91 P99.99: 14.40 ------------------------------------------------------ [ 0, 1 ] 260182 24.562% 24.562% ##### ( 1, 2 ] 672267 63.464% 88.026% ############# ( 2, 3 ] 71135 6.715% 94.741% # ( 3, 4 ] 32395 3.058% 97.800% # ( 4, 6 ] 18154 1.714% 99.513% ( 6, 10 ] 4189 0.395% 99.909% ( 10, 15 ] 976 0.092% 100.001% ( 15, 22 ] 56 0.005% 100.006% ( 22, 34 ] 12 0.001% 100.007% ( 34, 51 ] 10 0.001% 100.008% ( 51, 76 ] 8 0.001% 100.009% ( 76, 110 ] 7 0.001% 100.010% ( 110, 170 ] 21 0.002% 100.012% ( 170, 250 ] 34 0.003% 100.015% ( 250, 380 ] 21 0.002% 100.017% ( 380, 580 ] 10 0.001% 100.018% ( 580, 870 ] 19 0.002% 100.020% ( 870, 1300 ] 11 0.001% 100.021% ( 1300, 1900 ] 9 0.001% 100.022% ( 1900, 2900 ] 4 0.000% 100.022% ( 2900, 4400 ] 7 0.001% 100.023% ** Level 1 read latency histogram (micros): Count: 149454 Average: 2.2890 StdDev: 13.80 Min: 0 Median: 1.4605 Max: 2698 Percentiles: P50: 1.46 P75: 1.85 P99: 5.62 P99.9: 13.56 P99.99: 630.97 ------------------------------------------------------ [ 0, 1 ] 30113 20.149% 20.149% #### ( 1, 2 ] 96889 64.829% 84.977% ############# ( 2, 3 ] 12658 8.469% 93.447% ## ( 3, 4 ] 5548 3.712% 97.159% # ( 4, 6 ] 3402 2.276% 99.435% ( 6, 10 ] 602 0.403% 99.838% ( 10, 15 ] 130 0.087% 99.925% ( 15, 22 ] 7 0.005% 99.930% ( 22, 34 ] 1 0.001% 99.930% ( 34, 51 ] 3 0.002% 99.932% ( 51, 76 ] 1 0.001% 99.933% ( 76, 110 ] 7 0.005% 99.938% ( 110, 170 ] 47 0.031% 99.969% ( 170, 250 ] 11 0.007% 99.977% ( 250, 380 ] 14 0.009% 99.986% ( 380, 580 ] 5 0.003% 99.989% ( 580, 870 ] 6 0.004% 99.993% ( 870, 1300 ] 6 0.004% 99.997% ( 1300, 1900 ] 2 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31755 Average: 2.3106 StdDev: 4.78 Min: 1 Median: 1.5400 Max: 703 Percentiles: P50: 1.54 P75: 1.94 P99: 7.12 P99.9: 13.35 P99.99: 41.01 ------------------------------------------------------ [ 0, 1 ] 5116 16.111% 16.111% ### ( 1, 2 ] 19930 62.762% 78.873% ############# ( 2, 3 ] 3189 10.043% 88.915% ## ( 3, 4 ] 1750 5.511% 94.426% # ( 4, 6 ] 1357 4.273% 98.699% # ( 6, 10 ] 341 1.074% 99.773% ( 10, 15 ] 60 0.189% 99.962% ( 15, 22 ] 8 0.025% 99.987% ( 34, 51 ] 2 0.006% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28961 Average: 4.3077 StdDev: 63.18 Min: 0 Median: 1.4958 Max: 3968 Percentiles: P50: 1.50 P75: 1.87 P99: 5.85 P99.9: 830.19 P99.99: 2951.95 ------------------------------------------------------ [ 0, 1 ] 5006 17.285% 17.285% ### ( 1, 2 ] 19108 65.978% 83.264% ############# ( 2, 3 ] 2763 9.540% 92.804% ## ( 3, 4 ] 1188 4.102% 96.906% # ( 4, 6 ] 654 2.258% 99.164% ( 6, 10 ] 101 0.349% 99.513% ( 10, 15 ] 32 0.110% 99.624% ( 15, 22 ] 1 0.003% 99.627% ( 22, 34 ] 56 0.193% 99.820% ( 76, 110 ] 1 0.003% 99.824% ( 110, 170 ] 2 0.007% 99.831% ( 170, 250 ] 4 0.014% 99.845% ( 250, 380 ] 4 0.014% 99.858% ( 380, 580 ] 6 0.021% 99.879% ( 580, 870 ] 7 0.024% 99.903% ( 870, 1300 ] 3 0.010% 99.914% ( 1300, 1900 ] 16 0.055% 99.969% ( 1900, 2900 ] 6 0.021% 99.990% ( 2900, 4400 ] 3 0.010% 100.000% ** Level 4 read latency histogram (micros): Count: 34 Average: 1695.2353 StdDev: 1134.08 Min: 135 Median: 1433.3333 Max: 5274 Percentiles: P50: 1433.33 P75: 2114.29 P99: 4230.00 P99.9: 4383.00 P99.99: 4398.30 ------------------------------------------------------ ( 110, 170 ] 1 2.941% 2.941% # ( 250, 380 ] 2 5.882% 8.824% # ( 380, 580 ] 1 2.941% 11.765% # ( 580, 870 ] 2 5.882% 17.647% # ( 870, 1300 ] 9 26.471% 44.118% ##### ( 1300, 1900 ] 9 26.471% 70.588% ##### ( 1900, 2900 ] 7 20.588% 91.176% #### ( 2900, 4400 ] 3 8.824% 100.000% ## ( 4400, 6600 ] 1 2.941% 102.941% # ** Level 5 read latency histogram (micros): Count: 20 Average: 769.3000 StdDev: 836.58 Min: 89 Median: 250.0000 Max: 2970 Percentiles: P50: 250.00 P75: 1300.00 P99: 2970.00 P99.9: 2970.00 P99.99: 2970.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 6 30.000% 35.000% ###### ( 170, 250 ] 3 15.000% 50.000% ### ( 380, 580 ] 3 15.000% 65.000% ### ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.1 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.54 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.358 H:M:S, 11.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.417 H:M:S, 13.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-03:44:29 ... thread 0: (1000000,5000000) ops and (328124.1,334050.7) ops/second in (3.047627,14.967788) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/14 3.01 GB 75.5 3.0 0.0 3.0 7.6 4.7 0.0 1.6 121.5 313.7 24.90 23.29 78 0.319 3070K 3115 0.0 0.0 L1 11/11 1.10 GB 0.0 1.7 1.5 0.2 1.7 1.5 0.1 1.1 240.5 239.6 7.34 7.13 3 2.448 1793K 6181 0.0 0.0 L2 2/0 51.31 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 230.1 230.0 0.55 0.52 1 0.548 127K 39 0.0 0.0 L3 42/0 971.00 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 204.0 203.9 3.06 2.63 2 1.529 633K 528 0.0 0.0 L4 144/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1266/25 100.80 GB 0.0 5.4 2.1 3.3 10.1 6.8 1.5 2.2 154.6 287.8 35.84 33.57 84 0.427 5625K 9863 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 2.1 3.3 10.1 6.8 1.4 2.2 154.6 287.8 35.84 33.57 84 0.427 5625K 9863 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 2.1 3.3 5.4 2.1 0.0 0.0 248.5 248.1 22.29 21.42 17 1.311 5625K 9863 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 353.3 13.55 12.16 67 0.202 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.1 total, 15.0 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.08 GB write, 681.46 MB/s write, 5.41 GB read, 365.92 MB/s read, 35.8 seconds Interval compaction: 10.08 GB write, 689.27 MB/s write, 5.41 GB read, 370.11 MB/s read, 35.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 14, interval: 14 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1366563 Average: 2.0878 StdDev: 11.86 Min: 0 Median: 1.4126 Max: 3742 Percentiles: P50: 1.41 P75: 1.80 P99: 5.44 P99.9: 9.99 P99.99: 14.71 ------------------------------------------------------ [ 0, 1 ] 321469 23.524% 23.524% ##### ( 1, 2 ] 876931 64.171% 87.694% ############# ( 2, 3 ] 94866 6.942% 94.636% # ( 3, 4 ] 42390 3.102% 97.738% # ( 4, 6 ] 23953 1.753% 99.491% ( 6, 10 ] 5607 0.410% 99.901% ( 10, 15 ] 1286 0.094% 99.996% ( 15, 22 ] 80 0.006% 100.001% ( 22, 34 ] 12 0.001% 100.002% ( 34, 51 ] 11 0.001% 100.003% ( 51, 76 ] 11 0.001% 100.004% ( 76, 110 ] 14 0.001% 100.005% ( 110, 170 ] 69 0.005% 100.010% ( 170, 250 ] 58 0.004% 100.014% ( 250, 380 ] 38 0.003% 100.017% ( 380, 580 ] 22 0.002% 100.019% ( 580, 870 ] 26 0.002% 100.020% ( 870, 1300 ] 17 0.001% 100.022% ( 1300, 1900 ] 14 0.001% 100.023% ( 1900, 2900 ] 4 0.000% 100.023% ( 2900, 4400 ] 8 0.001% 100.024% ** Level 1 read latency histogram (micros): Count: 214369 Average: 2.3423 StdDev: 12.79 Min: 0 Median: 1.4587 Max: 2698 Percentiles: P50: 1.46 P75: 1.84 P99: 6.03 P99.9: 85.66 P99.99: 530.90 ------------------------------------------------------ [ 0, 1 ] 43148 20.128% 20.128% #### ( 1, 2 ] 139619 65.130% 85.258% ############# ( 2, 3 ] 17440 8.136% 93.394% ## ( 3, 4 ] 7404 3.454% 96.847% # ( 4, 6 ] 4600 2.146% 98.993% ( 6, 10 ] 1675 0.781% 99.775% ( 10, 15 ] 235 0.110% 99.884% ( 15, 22 ] 12 0.006% 99.890% ( 22, 34 ] 2 0.001% 99.891% ( 34, 51 ] 4 0.002% 99.893% ( 51, 76 ] 2 0.001% 99.894% ( 76, 110 ] 48 0.022% 99.916% ( 110, 170 ] 91 0.042% 99.958% ( 170, 250 ] 32 0.015% 99.973% ( 250, 380 ] 25 0.012% 99.985% ( 380, 580 ] 14 0.007% 99.992% ( 580, 870 ] 7 0.003% 99.995% ( 870, 1300 ] 7 0.003% 99.998% ( 1300, 1900 ] 2 0.001% 99.999% ( 1900, 2900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 31755 Average: 2.3106 StdDev: 4.78 Min: 1 Median: 1.5400 Max: 703 Percentiles: P50: 1.54 P75: 1.94 P99: 7.12 P99.9: 13.35 P99.99: 41.01 ------------------------------------------------------ [ 0, 1 ] 5116 16.111% 16.111% ### ( 1, 2 ] 19930 62.762% 78.873% ############# ( 2, 3 ] 3189 10.043% 88.915% ## ( 3, 4 ] 1750 5.511% 94.426% # ( 4, 6 ] 1357 4.273% 98.699% # ( 6, 10 ] 341 1.074% 99.773% ( 10, 15 ] 60 0.189% 99.962% ( 15, 22 ] 8 0.025% 99.987% ( 34, 51 ] 2 0.006% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28961 Average: 4.3077 StdDev: 63.18 Min: 0 Median: 1.4958 Max: 3968 Percentiles: P50: 1.50 P75: 1.87 P99: 5.85 P99.9: 830.19 P99.99: 2951.95 ------------------------------------------------------ [ 0, 1 ] 5006 17.285% 17.285% ### ( 1, 2 ] 19108 65.978% 83.264% ############# ( 2, 3 ] 2763 9.540% 92.804% ## ( 3, 4 ] 1188 4.102% 96.906% # ( 4, 6 ] 654 2.258% 99.164% ( 6, 10 ] 101 0.349% 99.513% ( 10, 15 ] 32 0.110% 99.624% ( 15, 22 ] 1 0.003% 99.627% ( 22, 34 ] 56 0.193% 99.820% ( 76, 110 ] 1 0.003% 99.824% ( 110, 170 ] 2 0.007% 99.831% ( 170, 250 ] 4 0.014% 99.845% ( 250, 380 ] 4 0.014% 99.858% ( 380, 580 ] 6 0.021% 99.879% ( 580, 870 ] 7 0.024% 99.903% ( 870, 1300 ] 3 0.010% 99.914% ( 1300, 1900 ] 16 0.055% 99.969% ( 1900, 2900 ] 6 0.021% 99.990% ( 2900, 4400 ] 3 0.010% 100.000% ** Level 4 read latency histogram (micros): Count: 34 Average: 1695.2353 StdDev: 1134.08 Min: 135 Median: 1433.3333 Max: 5274 Percentiles: P50: 1433.33 P75: 2114.29 P99: 4230.00 P99.9: 4383.00 P99.99: 4398.30 ------------------------------------------------------ ( 110, 170 ] 1 2.941% 2.941% # ( 250, 380 ] 2 5.882% 8.824% # ( 380, 580 ] 1 2.941% 11.765% # ( 580, 870 ] 2 5.882% 17.647% # ( 870, 1300 ] 9 26.471% 44.118% ##### ( 1300, 1900 ] 9 26.471% 70.588% ##### ( 1900, 2900 ] 7 20.588% 91.176% #### ( 2900, 4400 ] 3 8.824% 100.000% ## ( 4400, 6600 ] 1 2.941% 102.941% # ** Level 5 read latency histogram (micros): Count: 20 Average: 769.3000 StdDev: 836.58 Min: 89 Median: 250.0000 Max: 2970 Percentiles: P50: 250.00 P75: 1300.00 P99: 2970.00 P99.9: 2970.00 P99.99: 2970.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 6 30.000% 35.000% ###### ( 170, 250 ] 3 15.000% 50.000% ### ( 380, 580 ] 3 15.000% 65.000% ### ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 15.1 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 325.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.755 H:M:S, 11.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 322.94 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.397 H:M:S, 13.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-03:44:38 ... thread 0: (1000000,6000000) ops and (112806.3,251756.6) ops/second in (8.864751,23.832539) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 4.05 GB 213.5 5.3 0.0 5.3 11.0 5.7 0.0 1.9 146.4 304.4 37.01 34.73 101 0.366 5500K 9021 0.0 0.0 L1 11/11 1.10 GB 0.0 1.7 1.5 0.2 1.7 1.5 0.1 1.1 240.5 239.6 7.34 7.13 3 2.448 1793K 6181 0.0 0.0 L2 2/0 51.31 MB 0.5 0.1 0.1 0.1 0.1 0.1 0.6 2.0 230.1 230.0 0.55 0.52 1 0.548 127K 39 0.0 0.0 L3 42/0 971.00 MB 1.0 0.6 0.5 0.1 0.6 0.5 0.1 1.2 204.0 203.9 3.06 2.63 2 1.529 633K 528 0.0 0.0 L4 144/0 9.50 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.18 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1264/21 101.84 GB 0.0 7.7 2.1 5.6 13.5 7.8 1.5 2.4 165.4 287.2 47.96 45.01 107 0.448 8055K 15K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.7 2.1 5.6 13.5 7.8 1.4 2.4 165.4 287.2 47.96 45.01 107 0.448 8055K 15K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.7 2.1 5.6 7.7 2.1 0.0 0.0 253.1 252.6 31.35 30.12 23 1.363 8055K 15K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 352.6 16.62 14.89 84 0.198 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.0 total, 23.8 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 13.45 GB write, 573.86 MB/s write, 7.75 GB read, 330.48 MB/s read, 48.0 seconds Interval compaction: 13.45 GB write, 577.99 MB/s write, 7.75 GB read, 332.86 MB/s read, 48.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 14, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 14, interval: 25 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2239619 Average: 2.3636 StdDev: 13.94 Min: 0 Median: 1.4219 Max: 3742 Percentiles: P50: 1.42 P75: 1.81 P99: 5.83 P99.9: 106.53 P99.99: 215.15 ------------------------------------------------------ [ 0, 1 ] 508030 22.684% 22.684% ##### ( 1, 2 ] 1450210 64.753% 87.436% ############# ( 2, 3 ] 153086 6.835% 94.272% # ( 3, 4 ] 70752 3.159% 97.431% # ( 4, 6 ] 38510 1.719% 99.150% ( 6, 10 ] 12663 0.565% 99.716% ( 10, 15 ] 2274 0.102% 99.817% ( 15, 22 ] 387 0.017% 99.834% ( 22, 34 ] 27 0.001% 99.836% ( 34, 51 ] 13 0.001% 99.836% ( 51, 76 ] 23 0.001% 99.837% ( 76, 110 ] 1564 0.070% 99.907% ( 110, 170 ] 1619 0.072% 99.979% ( 170, 250 ] 420 0.019% 99.998% ( 250, 380 ] 272 0.012% 100.010% ( 380, 580 ] 180 0.008% 100.018% ( 580, 870 ] 95 0.004% 100.023% ( 870, 1300 ] 30 0.001% 100.024% ( 1300, 1900 ] 17 0.001% 100.025% ( 1900, 2900 ] 11 0.000% 100.025% ( 2900, 4400 ] 11 0.000% 100.026% ** Level 1 read latency histogram (micros): Count: 389993 Average: 2.5235 StdDev: 14.27 Min: 0 Median: 1.4619 Max: 3579 Percentiles: P50: 1.46 P75: 1.84 P99: 7.76 P99.9: 141.40 P99.99: 542.17 ------------------------------------------------------ [ 0, 1 ] 76677 19.661% 19.661% #### ( 1, 2 ] 256166 65.685% 85.346% ############# ( 2, 3 ] 29811 7.644% 92.990% ## ( 3, 4 ] 13304 3.411% 96.401% # ( 4, 6 ] 8231 2.111% 98.512% ( 6, 10 ] 4326 1.109% 99.621% ( 10, 15 ] 479 0.123% 99.744% ( 15, 22 ] 76 0.019% 99.763% ( 22, 34 ] 5 0.001% 99.765% ( 34, 51 ] 5 0.001% 99.766% ( 51, 76 ] 24 0.006% 99.772% ( 76, 110 ] 309 0.079% 99.851% ( 110, 170 ] 365 0.094% 99.945% ( 170, 250 ] 93 0.024% 99.969% ( 250, 380 ] 54 0.014% 99.983% ( 380, 580 ] 37 0.009% 99.992% ( 580, 870 ] 19 0.005% 99.997% ( 870, 1300 ] 7 0.002% 99.999% ( 1300, 1900 ] 2 0.001% 99.999% ( 1900, 2900 ] 3 0.001% 100.000% ( 2900, 4400 ] 1 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 31755 Average: 2.3106 StdDev: 4.78 Min: 1 Median: 1.5400 Max: 703 Percentiles: P50: 1.54 P75: 1.94 P99: 7.12 P99.9: 13.35 P99.99: 41.01 ------------------------------------------------------ [ 0, 1 ] 5116 16.111% 16.111% ### ( 1, 2 ] 19930 62.762% 78.873% ############# ( 2, 3 ] 3189 10.043% 88.915% ## ( 3, 4 ] 1750 5.511% 94.426% # ( 4, 6 ] 1357 4.273% 98.699% # ( 6, 10 ] 341 1.074% 99.773% ( 10, 15 ] 60 0.189% 99.962% ( 15, 22 ] 8 0.025% 99.987% ( 34, 51 ] 2 0.006% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 28961 Average: 4.3077 StdDev: 63.18 Min: 0 Median: 1.4958 Max: 3968 Percentiles: P50: 1.50 P75: 1.87 P99: 5.85 P99.9: 830.19 P99.99: 2951.95 ------------------------------------------------------ [ 0, 1 ] 5006 17.285% 17.285% ### ( 1, 2 ] 19108 65.978% 83.264% ############# ( 2, 3 ] 2763 9.540% 92.804% ## ( 3, 4 ] 1188 4.102% 96.906% # ( 4, 6 ] 654 2.258% 99.164% ( 6, 10 ] 101 0.349% 99.513% ( 10, 15 ] 32 0.110% 99.624% ( 15, 22 ] 1 0.003% 99.627% ( 22, 34 ] 56 0.193% 99.820% ( 76, 110 ] 1 0.003% 99.824% ( 110, 170 ] 2 0.007% 99.831% ( 170, 250 ] 4 0.014% 99.845% ( 250, 380 ] 4 0.014% 99.858% ( 380, 580 ] 6 0.021% 99.879% ( 580, 870 ] 7 0.024% 99.903% ( 870, 1300 ] 3 0.010% 99.914% ( 1300, 1900 ] 16 0.055% 99.969% ( 1900, 2900 ] 6 0.021% 99.990% ( 2900, 4400 ] 3 0.010% 100.000% ** Level 4 read latency histogram (micros): Count: 34 Average: 1695.2353 StdDev: 1134.08 Min: 135 Median: 1433.3333 Max: 5274 Percentiles: P50: 1433.33 P75: 2114.29 P99: 4230.00 P99.9: 4383.00 P99.99: 4398.30 ------------------------------------------------------ ( 110, 170 ] 1 2.941% 2.941% # ( 250, 380 ] 2 5.882% 8.824% # ( 380, 580 ] 1 2.941% 11.765% # ( 580, 870 ] 2 5.882% 17.647% # ( 870, 1300 ] 9 26.471% 44.118% ##### ( 1300, 1900 ] 9 26.471% 70.588% ##### ( 1900, 2900 ] 7 20.588% 91.176% #### ( 2900, 4400 ] 3 8.824% 100.000% ## ( 4400, 6600 ] 1 2.941% 102.941% # ** Level 5 read latency histogram (micros): Count: 20 Average: 769.3000 StdDev: 836.58 Min: 89 Median: 250.0000 Max: 2970 Percentiles: P50: 250.00 P75: 1300.00 P99: 2970.00 P99.9: 2970.00 P99.99: 2970.00 ------------------------------------------------------ ( 76, 110 ] 1 5.000% 5.000% # ( 110, 170 ] 6 30.000% 35.000% ###### ( 170, 250 ] 3 15.000% 50.000% ### ( 380, 580 ] 3 15.000% 65.000% ### ( 580, 870 ] 1 5.000% 70.000% # ( 870, 1300 ] 1 5.000% 75.000% # ( 1300, 1900 ] 3 15.000% 90.000% ### ( 1900, 2900 ] 1 5.000% 95.000% # ( 2900, 4400 ] 1 5.000% 100.000% # ** DB Stats ** Uptime(secs): 24.0 total, 8.9 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 245.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.867 H:M:S, 32.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 111.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.112 H:M:S, 68.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 2024/12/14-03:44:42 ... thread 0: (1000000,7000000) ops and (233030.1,248899.2) ops/second in (4.291291,28.123830) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/12 2.95 GB 31.5 5.8 0.0 5.8 12.4 6.6 0.0 1.9 142.8 305.2 41.46 38.85 116 0.357 6011K 9529 0.0 0.0 L1 17/17 2.02 GB 0.0 4.8 3.5 1.3 4.7 3.5 0.1 1.4 229.0 226.7 21.45 20.42 4 5.362 4987K 47K 0.0 0.0 L2 2/0 51.31 MB 0.5 0.1 0.1 0.1 0.1 0.1 1.6 2.0 230.1 230.0 0.55 0.52 1 0.548 127K 39 0.0 0.0 L3 14/0 913.90 MB 0.9 0.6 0.5 0.1 0.6 0.5 1.1 1.2 204.0 203.9 3.06 2.63 2 1.529 633K 528 0.0 0.0 L4 167/0 9.58 GB 1.0 0.2 0.1 0.0 0.2 0.1 1.2 1.2 203.8 202.9 0.76 0.67 1 0.759 157K 720 0.0 0.0 L5 1060/0 87.17 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1274/29 102.66 GB 0.0 11.5 4.2 7.3 18.0 10.7 5.4 2.7 174.5 273.8 67.27 63.09 124 0.543 11M 58K 0.0 0.0 Int 0/0 0.00 KB 0.0 11.5 4.2 7.3 18.0 10.7 5.3 2.7 174.5 273.8 67.27 63.09 124 0.543 11M 58K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 11.5 4.2 7.3 11.4 4.1 0.0 0.0 243.9 242.6 48.13 45.94 27 1.782 11M 58K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 352.1 19.15 17.15 97 0.197 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.3 total, 28.1 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.99 GB write, 650.91 MB/s write, 11.46 GB read, 414.78 MB/s read, 67.3 seconds Interval compaction: 17.99 GB write, 654.88 MB/s write, 11.46 GB read, 417.31 MB/s read, 67.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 16, total-stops: 16, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2594985 Average: 2.3728 StdDev: 14.19 Min: 0 Median: 1.4258 Max: 3742 Percentiles: P50: 1.43 P75: 1.81 P99: 5.89 P99.9: 105.54 P99.99: 226.75 ------------------------------------------------------ [ 0, 1 ] 579833 22.344% 22.344% #### ( 1, 2 ] 1685436 64.950% 87.294% ############# ( 2, 3 ] 180650 6.962% 94.256% # ( 3, 4 ] 80885 3.117% 97.373% # ( 4, 6 ] 44669 1.721% 99.094% ( 6, 10 ] 16238 0.626% 99.720% ( 10, 15 ] 2700 0.104% 99.824% ( 15, 22 ] 453 0.017% 99.841% ( 22, 34 ] 28 0.001% 99.842% ( 34, 51 ] 16 0.001% 99.843% ( 51, 76 ] 25 0.001% 99.844% ( 76, 110 ] 1677 0.065% 99.908% ( 110, 170 ] 1758 0.068% 99.976% ( 170, 250 ] 504 0.019% 99.996% ( 250, 380 ] 323 0.012% 100.008% ( 380, 580 ] 224 0.009% 100.017% ( 580, 870 ] 126 0.005% 100.022% ( 870, 1300 ] 38 0.001% 100.023% ( 1300, 1900 ] 20 0.001% 100.024% ( 1900, 2900 ] 15 0.001% 100.024% ( 2900, 4400 ] 12 0.000% 100.025% ** Level 1 read latency histogram (micros): Count: 466953 Average: 2.6221 StdDev: 17.17 Min: 0 Median: 1.4529 Max: 3579 Percentiles: P50: 1.45 P75: 1.84 P99: 8.00 P99.9: 151.33 P99.99: 769.80 ------------------------------------------------------ [ 0, 1 ] 95951 20.548% 20.548% #### ( 1, 2 ] 303636 65.025% 85.573% ############# ( 2, 3 ] 34870 7.468% 93.041% # ( 3, 4 ] 15525 3.325% 96.366% # ( 4, 6 ] 9604 2.057% 98.422% ( 6, 10 ] 5404 1.157% 99.580% ( 10, 15 ] 671 0.144% 99.723% ( 15, 22 ] 110 0.024% 99.747% ( 22, 34 ] 8 0.002% 99.749% ( 34, 51 ] 5 0.001% 99.750% ( 51, 76 ] 27 0.006% 99.755% ( 76, 110 ] 374 0.080% 99.836% ( 110, 170 ] 437 0.094% 99.929% ( 170, 250 ] 115 0.025% 99.954% ( 250, 380 ] 68 0.015% 99.968% ( 380, 580 ] 64 0.014% 99.982% ( 580, 870 ] 57 0.012% 99.994% ( 870, 1300 ] 17 0.004% 99.998% ( 1300, 1900 ] 5 0.001% 99.999% ( 1900, 2900 ] 3 0.001% 100.000% ( 2900, 4400 ] 2 0.000% 100.000% ** Level 2 read latency histogram (micros): Count: 31755 Average: 2.3106 StdDev: 4.78 Min: 1 Median: 1.5400 Max: 703 Percentiles: P50: 1.54 P75: 1.94 P99: 7.12 P99.9: 13.35 P99.99: 41.01 ------------------------------------------------------ [ 0, 1 ] 5116 16.111% 16.111% ### ( 1, 2 ] 19930 62.762% 78.873% ############# ( 2, 3 ] 3189 10.043% 88.915% ## ( 3, 4 ] 1750 5.511% 94.426% # ( 4, 6 ] 1357 4.273% 98.699% # ( 6, 10 ] 341 1.074% 99.773% ( 10, 15 ] 60 0.189% 99.962% ( 15, 22 ] 8 0.025% 99.987% ( 34, 51 ] 2 0.006% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 35528 Average: 5.3264 StdDev: 62.35 Min: 0 Median: 1.4847 Max: 3968 Percentiles: P50: 1.48 P75: 1.87 P99: 9.91 P99.9: 823.49 P99.99: 2807.87 ------------------------------------------------------ [ 0, 1 ] 6628 18.656% 18.656% #### ( 1, 2 ] 22975 64.667% 83.323% ############# ( 2, 3 ] 3212 9.041% 92.364% ## ( 3, 4 ] 1419 3.994% 96.358% # ( 4, 6 ] 745 2.097% 98.455% ( 6, 10 ] 198 0.557% 99.012% ( 10, 15 ] 48 0.135% 99.147% ( 15, 22 ] 2 0.006% 99.153% ( 22, 34 ] 57 0.160% 99.313% ( 76, 110 ] 25 0.070% 99.384% ( 110, 170 ] 74 0.208% 99.592% ( 170, 250 ] 33 0.093% 99.685% ( 250, 380 ] 30 0.084% 99.769% ( 380, 580 ] 28 0.079% 99.848% ( 580, 870 ] 22 0.062% 99.910% ( 870, 1300 ] 6 0.017% 99.927% ( 1300, 1900 ] 17 0.048% 99.975% ( 1900, 2900 ] 6 0.017% 99.992% ( 2900, 4400 ] 3 0.008% 100.000% ** Level 4 read latency histogram (micros): Count: 49 Average: 1213.9592 StdDev: 1194.87 Min: 1 Median: 1037.2222 Max: 5274 Percentiles: P50: 1037.22 P75: 1750.00 P99: 4155.00 P99.9: 4375.50 P99.99: 4397.55 ------------------------------------------------------ [ 0, 1 ] 6 12.245% 12.245% ## ( 1, 2 ] 2 4.082% 16.327% # ( 3, 4 ] 1 2.041% 18.367% ( 110, 170 ] 3 6.122% 24.490% # ( 170, 250 ] 1 2.041% 26.531% ( 250, 380 ] 4 8.163% 34.694% ## ( 380, 580 ] 1 2.041% 36.735% ( 580, 870 ] 3 6.122% 42.857% # ( 870, 1300 ] 9 18.367% 61.224% #### ( 1300, 1900 ] 9 18.367% 79.592% #### ( 1900, 2900 ] 7 14.286% 93.878% ### ( 2900, 4400 ] 3 6.122% 100.000% # ( 4400, 6600 ] 1 2.041% 102.041% ** Level 5 read latency histogram (micros): Count: 80 Average: 881.0750 StdDev: 1018.93 Min: 89 Median: 446.6667 Max: 4284 Percentiles: P50: 446.67 P75: 1214.00 P99: 4200.00 P99.9: 4284.00 P99.99: 4284.00 ------------------------------------------------------ ( 76, 110 ] 8 10.000% 10.000% ## ( 110, 170 ] 14 17.500% 27.500% #### ( 170, 250 ] 9 11.250% 38.750% ## ( 250, 380 ] 7 8.750% 47.500% ## ( 380, 580 ] 6 7.500% 55.000% ## ( 580, 870 ] 12 15.000% 70.000% ### ( 870, 1300 ] 5 6.250% 76.250% # ( 1300, 1900 ] 8 10.000% 86.250% ## ( 1900, 2900 ] 5 6.250% 92.500% # ( 2900, 4400 ] 6 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 28.3 total, 4.3 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 243.47 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.460 H:M:S, 33.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 229.36 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.593 H:M:S, 37.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-03:45:05 ... thread 0: (1000000,8000000) ops and (44532.7,158167.7) ops/second in (22.455384,50.579214) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 1.60 GB 18.9 6.3 0.0 6.3 13.9 7.6 0.0 1.8 131.8 289.0 49.23 43.73 130 0.379 6587K 10K 0.0 0.0 L1 10/10 1.00 GB 0.0 9.2 5.8 3.3 9.0 5.7 0.1 1.5 228.6 225.7 40.99 38.66 5 8.198 8980K 47K 0.0 0.0 L2 2/1 196.26 MB 1.0 0.1 0.1 0.1 0.1 0.1 4.9 2.0 230.1 230.0 0.55 0.52 1 0.548 127K 39 0.0 0.0 L3 22/7 1.81 GB 1.0 1.8 1.0 0.8 1.8 1.0 3.7 1.7 125.4 124.3 14.55 8.11 8 1.819 1852K 16K 0.0 0.0 L4 169/18 10.12 GB 1.0 2.7 2.3 0.3 2.7 2.3 1.2 1.1 116.7 116.1 23.48 12.75 23 1.021 2755K 12K 0.0 0.0 L5 1080/0 88.83 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1295/46 103.55 GB 0.0 20.1 9.3 10.8 27.5 16.7 13.0 3.6 159.5 218.5 128.80 103.77 167 0.771 20M 86K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.1 9.3 10.8 27.5 16.7 12.9 3.6 159.5 218.5 128.80 103.77 167 0.771 20M 86K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.1 9.3 10.8 19.9 9.1 0.0 0.0 197.7 196.1 103.96 83.79 58 1.792 20M 86K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 312.0 24.83 19.98 109 0.228 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 50.8 total, 50.6 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.48 GB write, 554.41 MB/s write, 20.07 GB read, 404.89 MB/s read, 128.8 seconds Interval compaction: 27.48 GB write, 556.29 MB/s write, 20.07 GB read, 406.27 MB/s read, 128.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 42, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 42, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3437416 Average: 2.7813 StdDev: 31.04 Min: 0 Median: 1.4380 Max: 10701 Percentiles: P50: 1.44 P75: 1.83 P99: 7.15 P99.9: 142.42 P99.99: 383.44 ------------------------------------------------------ [ 0, 1 ] 761312 22.148% 22.148% #### ( 1, 2 ] 2185881 63.591% 85.739% ############# ( 2, 3 ] 249641 7.262% 93.001% # ( 3, 4 ] 117810 3.427% 96.428% # ( 4, 6 ] 80524 2.343% 98.771% ( 6, 10 ] 27341 0.795% 99.566% ( 10, 15 ] 4709 0.137% 99.703% ( 15, 22 ] 799 0.023% 99.727% ( 22, 34 ] 45 0.001% 99.728% ( 34, 51 ] 22 0.001% 99.729% ( 51, 76 ] 47 0.001% 99.730% ( 76, 110 ] 3900 0.113% 99.843% ( 110, 170 ] 3606 0.105% 99.948% ( 170, 250 ] 807 0.023% 99.972% ( 250, 380 ] 620 0.018% 99.990% ( 380, 580 ] 539 0.016% 100.005% ( 580, 870 ] 277 0.008% 100.013% ( 870, 1300 ] 99 0.003% 100.016% ( 1300, 1900 ] 65 0.002% 100.018% ( 1900, 2900 ] 66 0.002% 100.020% ( 2900, 4400 ] 76 0.002% 100.022% ( 4400, 6600 ] 28 0.001% 100.023% ( 6600, 9900 ] 7 0.000% 100.023% ( 9900, 14000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 1750056 Average: 5.4679 StdDev: 101.02 Min: 0 Median: 1.5471 Max: 12515 Percentiles: P50: 1.55 P75: 2.01 P99: 9.27 P99.9: 145.95 P99.99: 452.46 ------------------------------------------------------ [ 0, 1 ] 349798 19.988% 19.988% #### ( 1, 2 ] 960040 54.858% 74.845% ########### ( 2, 3 ] 197083 11.262% 86.107% ## ( 3, 4 ] 99885 5.708% 91.815% # ( 4, 6 ] 99377 5.679% 97.493% # ( 6, 10 ] 32242 1.842% 99.335% ( 10, 15 ] 6193 0.354% 99.689% ( 15, 22 ] 992 0.057% 99.746% ( 22, 34 ] 92 0.005% 99.751% ( 34, 51 ] 23 0.001% 99.753% ( 51, 76 ] 103 0.006% 99.758% ( 76, 110 ] 1624 0.093% 99.851% ( 110, 170 ] 1427 0.082% 99.933% ( 170, 250 ] 385 0.022% 99.955% ( 250, 380 ] 443 0.025% 99.980% ( 380, 580 ] 483 0.028% 100.008% ( 580, 870 ] 510 0.029% 100.037% ( 870, 1300 ] 328 0.019% 100.056% ( 1300, 1900 ] 179 0.010% 100.066% ( 1900, 2900 ] 287 0.016% 100.082% ( 2900, 4400 ] 412 0.024% 100.106% ( 4400, 6600 ] 185 0.011% 100.116% ( 6600, 9900 ] 57 0.003% 100.120% ( 9900, 14000 ] 10 0.001% 100.120% ** Level 2 read latency histogram (micros): Count: 31755 Average: 2.3106 StdDev: 4.78 Min: 1 Median: 1.5400 Max: 703 Percentiles: P50: 1.54 P75: 1.94 P99: 7.12 P99.9: 13.35 P99.99: 41.01 ------------------------------------------------------ [ 0, 1 ] 5116 16.111% 16.111% ### ( 1, 2 ] 19930 62.762% 78.873% ############# ( 2, 3 ] 3189 10.043% 88.915% ## ( 3, 4 ] 1750 5.511% 94.426% # ( 4, 6 ] 1357 4.273% 98.699% # ( 6, 10 ] 341 1.074% 99.773% ( 10, 15 ] 60 0.189% 99.962% ( 15, 22 ] 8 0.025% 99.987% ( 34, 51 ] 2 0.006% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 393161 Average: 12.5198 StdDev: 149.28 Min: 0 Median: 1.9156 Max: 9794 Percentiles: P50: 1.92 P75: 3.07 P99: 12.82 P99.9: 973.71 P99.99: 1277.41 ------------------------------------------------------ [ 0, 1 ] 17344 4.411% 4.411% # ( 1, 2 ] 195769 49.794% 54.205% ########## ( 2, 3 ] 78712 20.020% 74.225% #### ( 3, 4 ] 44468 11.310% 85.536% ## ( 4, 6 ] 43850 11.153% 96.689% ## ( 6, 10 ] 8006 2.036% 98.725% ( 10, 15 ] 1917 0.488% 99.213% ( 15, 22 ] 227 0.058% 99.271% ( 22, 34 ] 71 0.018% 99.289% ( 34, 51 ] 5 0.001% 99.290% ( 51, 76 ] 7 0.002% 99.292% ( 76, 110 ] 46 0.012% 99.303% ( 110, 170 ] 204 0.052% 99.355% ( 170, 250 ] 279 0.071% 99.426% ( 250, 380 ] 401 0.102% 99.528% ( 380, 580 ] 612 0.156% 99.684% ( 580, 870 ] 730 0.186% 99.870% ( 870, 1300 ] 501 0.127% 99.997% ( 1300, 1900 ] 272 0.069% 100.066% ( 1900, 2900 ] 184 0.047% 100.113% ( 2900, 4400 ] 257 0.065% 100.178% ( 4400, 6600 ] 68 0.017% 100.196% ( 6600, 9900 ] 14 0.004% 100.199% ** Level 4 read latency histogram (micros): Count: 45365 Average: 12.8395 StdDev: 173.58 Min: 1 Median: 1.9609 Max: 11591 Percentiles: P50: 1.96 P75: 3.13 P99: 13.09 P99.9: 2855.97 P99.99: 4343.79 ------------------------------------------------------ [ 0, 1 ] 946 2.085% 2.085% ( 1, 2 ] 22621 49.864% 51.950% ########## ( 2, 3 ] 9823 21.653% 73.603% #### ( 3, 4 ] 4887 10.773% 84.376% ## ( 4, 6 ] 5492 12.106% 96.482% ## ( 6, 10 ] 974 2.147% 98.629% ( 10, 15 ] 272 0.600% 99.228% ( 15, 22 ] 27 0.060% 99.288% ( 22, 34 ] 8 0.018% 99.306% ( 34, 51 ] 2 0.004% 99.310% ( 51, 76 ] 3 0.007% 99.317% ( 76, 110 ] 16 0.035% 99.352% ( 110, 170 ] 19 0.042% 99.394% ( 170, 250 ] 43 0.095% 99.489% ( 250, 380 ] 27 0.060% 99.548% ( 380, 580 ] 28 0.062% 99.610% ( 580, 870 ] 36 0.079% 99.689% ( 870, 1300 ] 37 0.082% 99.771% ( 1300, 1900 ] 29 0.064% 99.835% ( 1900, 2900 ] 31 0.068% 99.903% ( 2900, 4400 ] 41 0.090% 99.993% ( 4400, 6600 ] 13 0.029% 100.022% ( 9900, 14000 ] 1 0.002% 100.024% ** Level 5 read latency histogram (micros): Count: 180 Average: 1471.6111 StdDev: 1605.61 Min: 89 Median: 745.7143 Max: 7231 Percentiles: P50: 745.71 P75: 2194.12 P99: 6930.00 P99.9: 7231.00 P99.99: 7231.00 ------------------------------------------------------ ( 76, 110 ] 8 4.444% 4.444% # ( 110, 170 ] 15 8.333% 12.778% ## ( 170, 250 ] 13 7.222% 20.000% # ( 250, 380 ] 20 11.111% 31.111% ## ( 380, 580 ] 22 12.222% 43.333% ## ( 580, 870 ] 21 11.667% 55.000% ## ( 870, 1300 ] 13 7.222% 62.222% # ( 1300, 1900 ] 18 10.000% 72.222% ## ( 1900, 2900 ] 17 9.444% 81.667% ## ( 2900, 4400 ] 21 11.667% 93.333% ## ( 4400, 6600 ] 10 5.556% 98.889% # ( 6600, 9900 ] 2 1.111% 100.000% ** DB Stats ** Uptime(secs): 50.8 total, 22.5 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 155.14 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.474 H:M:S, 56.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 43.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:19.013 H:M:S, 84.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/12/14-03:45:08 ... thread 0: (1000000,9000000) ops and (306469.3,167155.2) ops/second in (3.262970,53.842184) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/10 2.52 GB 119.5 7.3 0.0 7.3 15.8 8.5 0.0 1.9 132.4 285.7 56.62 50.08 146 0.388 7610K 11K 0.0 0.0 L1 10/10 1.00 GB 0.0 9.2 5.8 3.3 9.0 5.7 0.1 1.5 228.6 225.7 40.99 38.66 5 8.198 8980K 47K 0.0 0.0 L2 1/0 97.93 MB 1.0 0.1 0.1 0.1 0.1 0.1 4.9 2.0 230.1 230.0 0.55 0.52 1 0.548 127K 39 0.0 0.0 L3 15/0 992.62 MB 1.0 2.0 1.1 0.9 2.0 1.1 3.7 1.8 126.5 125.3 16.22 9.15 9 1.802 2083K 19K 0.0 0.0 L4 161/0 9.75 GB 1.0 4.0 3.3 0.8 4.0 3.3 1.2 1.2 119.6 119.0 34.67 19.35 32 1.083 4165K 17K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1299/20 104.46 GB 0.0 22.6 10.3 12.4 31.0 18.6 14.3 3.6 155.6 212.8 149.04 117.76 193 0.772 22M 95K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.6 10.3 12.4 31.0 18.6 14.1 3.6 155.6 212.8 149.04 117.76 193 0.772 22M 95K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.6 10.3 12.4 22.5 10.1 0.0 0.0 191.5 190.0 121.12 95.35 71 1.706 22M 95K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 311.3 27.93 22.41 122 0.229 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 54.0 total, 53.8 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.97 GB write, 587.10 MB/s write, 22.65 GB read, 429.31 MB/s read, 149.0 seconds Interval compaction: 30.97 GB write, 588.97 MB/s write, 22.65 GB read, 430.67 MB/s read, 149.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 13, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 13, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 51, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 23, total-stops: 51, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3737816 Average: 2.7631 StdDev: 30.16 Min: 0 Median: 1.4482 Max: 10701 Percentiles: P50: 1.45 P75: 1.84 P99: 7.12 P99.9: 138.36 P99.99: 365.87 ------------------------------------------------------ [ 0, 1 ] 802834 21.479% 21.479% #### ( 1, 2 ] 2378562 63.635% 85.114% ############# ( 2, 3 ] 283302 7.579% 92.693% ## ( 3, 4 ] 133768 3.579% 96.272% # ( 4, 6 ] 93497 2.501% 98.773% # ( 6, 10 ] 30231 0.809% 99.582% ( 10, 15 ] 5234 0.140% 99.722% ( 15, 22 ] 848 0.023% 99.745% ( 22, 34 ] 47 0.001% 99.746% ( 34, 51 ] 22 0.001% 99.747% ( 51, 76 ] 50 0.001% 99.748% ( 76, 110 ] 3940 0.105% 99.853% ( 110, 170 ] 3690 0.099% 99.952% ( 170, 250 ] 838 0.022% 99.975% ( 250, 380 ] 651 0.017% 99.992% ( 380, 580 ] 558 0.015% 100.007% ( 580, 870 ] 291 0.008% 100.015% ( 870, 1300 ] 102 0.003% 100.017% ( 1300, 1900 ] 72 0.002% 100.019% ( 1900, 2900 ] 69 0.002% 100.021% ( 2900, 4400 ] 77 0.002% 100.023% ( 4400, 6600 ] 29 0.001% 100.024% ( 6600, 9900 ] 7 0.000% 100.024% ( 9900, 14000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 1931680 Average: 5.3545 StdDev: 98.40 Min: 0 Median: 1.5643 Max: 12515 Percentiles: P50: 1.56 P75: 2.07 P99: 9.26 P99.9: 144.06 P99.99: 462.68 ------------------------------------------------------ [ 0, 1 ] 361246 18.701% 18.701% #### ( 1, 2 ] 1071337 55.461% 74.163% ########### ( 2, 3 ] 226713 11.737% 85.899% ## ( 3, 4 ] 112181 5.807% 91.707% # ( 4, 6 ] 111391 5.767% 97.473% # ( 6, 10 ] 36183 1.873% 99.346% ( 10, 15 ] 6859 0.355% 99.701% ( 15, 22 ] 1063 0.055% 99.756% ( 22, 34 ] 95 0.005% 99.761% ( 34, 51 ] 25 0.001% 99.763% ( 51, 76 ] 110 0.006% 99.768% ( 76, 110 ] 1696 0.088% 99.856% ( 110, 170 ] 1496 0.077% 99.933% ( 170, 250 ] 409 0.021% 99.955% ( 250, 380 ] 472 0.024% 99.979% ( 380, 580 ] 510 0.026% 100.005% ( 580, 870 ] 537 0.028% 100.033% ( 870, 1300 ] 342 0.018% 100.051% ( 1300, 1900 ] 189 0.010% 100.061% ( 1900, 2900 ] 309 0.016% 100.077% ( 2900, 4400 ] 437 0.023% 100.099% ( 4400, 6600 ] 198 0.010% 100.110% ( 6600, 9900 ] 57 0.003% 100.113% ( 9900, 14000 ] 10 0.001% 100.113% ** Level 2 read latency histogram (micros): Count: 31755 Average: 2.3106 StdDev: 4.78 Min: 1 Median: 1.5400 Max: 703 Percentiles: P50: 1.54 P75: 1.94 P99: 7.12 P99.9: 13.35 P99.99: 41.01 ------------------------------------------------------ [ 0, 1 ] 5116 16.111% 16.111% ### ( 1, 2 ] 19930 62.762% 78.873% ############# ( 2, 3 ] 3189 10.043% 88.915% ## ( 3, 4 ] 1750 5.511% 94.426% # ( 4, 6 ] 1357 4.273% 98.699% # ( 6, 10 ] 341 1.074% 99.773% ( 10, 15 ] 60 0.189% 99.962% ( 15, 22 ] 8 0.025% 99.987% ( 34, 51 ] 2 0.006% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 463827 Average: 12.1681 StdDev: 145.06 Min: 0 Median: 1.9089 Max: 9794 Percentiles: P50: 1.91 P75: 3.04 P99: 12.60 P99.9: 1002.43 P99.99: 1324.74 ------------------------------------------------------ [ 0, 1 ] 19692 4.246% 4.246% # ( 1, 2 ] 233489 50.340% 54.585% ########## ( 2, 3 ] 92614 19.967% 74.553% #### ( 3, 4 ] 52040 11.220% 85.772% ## ( 4, 6 ] 50821 10.957% 96.729% ## ( 6, 10 ] 9398 2.026% 98.755% ( 10, 15 ] 2184 0.471% 99.226% ( 15, 22 ] 253 0.055% 99.281% ( 22, 34 ] 72 0.016% 99.296% ( 34, 51 ] 5 0.001% 99.297% ( 51, 76 ] 7 0.002% 99.299% ( 76, 110 ] 53 0.011% 99.310% ( 110, 170 ] 222 0.048% 99.358% ( 170, 250 ] 315 0.068% 99.426% ( 250, 380 ] 468 0.101% 99.527% ( 380, 580 ] 722 0.156% 99.683% ( 580, 870 ] 828 0.179% 99.861% ( 870, 1300 ] 585 0.126% 99.987% ( 1300, 1900 ] 306 0.066% 100.053% ( 1900, 2900 ] 221 0.048% 100.101% ( 2900, 4400 ] 286 0.062% 100.163% ( 4400, 6600 ] 74 0.016% 100.179% ( 6600, 9900 ] 14 0.003% 100.182% ** Level 4 read latency histogram (micros): Count: 96084 Average: 9.1161 StdDev: 126.76 Min: 1 Median: 1.8562 Max: 11591 Percentiles: P50: 1.86 P75: 2.87 P99: 11.80 P99.9: 1425.75 P99.99: 3731.53 ------------------------------------------------------ [ 0, 1 ] 2840 2.956% 2.956% # ( 1, 2 ] 52791 54.943% 57.898% ########### ( 2, 3 ] 18965 19.738% 77.636% #### ( 3, 4 ] 8901 9.264% 86.900% ## ( 4, 6 ] 9388 9.771% 96.671% ## ( 6, 10 ] 2059 2.143% 98.814% ( 10, 15 ] 499 0.519% 99.333% ( 15, 22 ] 47 0.049% 99.382% ( 22, 34 ] 13 0.014% 99.395% ( 34, 51 ] 2 0.002% 99.397% ( 51, 76 ] 4 0.004% 99.402% ( 76, 110 ] 19 0.020% 99.421% ( 110, 170 ] 47 0.049% 99.470% ( 170, 250 ] 97 0.101% 99.571% ( 250, 380 ] 76 0.079% 99.650% ( 380, 580 ] 80 0.083% 99.734% ( 580, 870 ] 89 0.093% 99.826% ( 870, 1300 ] 64 0.067% 99.893% ( 1300, 1900 ] 33 0.034% 99.927% ( 1900, 2900 ] 36 0.037% 99.965% ( 2900, 4400 ] 44 0.046% 100.010% ( 4400, 6600 ] 14 0.015% 100.025% ( 9900, 14000 ] 1 0.001% 100.026% ** Level 5 read latency histogram (micros): Count: 260 Average: 1553.5192 StdDev: 1638.48 Min: 89 Median: 776.4516 Max: 7231 Percentiles: P50: 776.45 P75: 2471.43 P99: 7040.00 P99.9: 7231.00 P99.99: 7231.00 ------------------------------------------------------ ( 76, 110 ] 9 3.462% 3.462% # ( 110, 170 ] 22 8.462% 11.923% ## ( 170, 250 ] 22 8.462% 20.385% ## ( 250, 380 ] 27 10.385% 30.769% ## ( 380, 580 ] 29 11.154% 41.923% ## ( 580, 870 ] 31 11.923% 53.846% ## ( 870, 1300 ] 16 6.154% 60.000% # ( 1300, 1900 ] 23 8.846% 68.846% ## ( 1900, 2900 ] 28 10.769% 79.615% ## ( 2900, 4400 ] 35 13.462% 93.077% ### ( 4400, 6600 ] 15 5.769% 98.846% # ( 6600, 9900 ] 3 1.154% 100.000% ** DB Stats ** Uptime(secs): 54.0 total, 3.3 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 163.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.025 H:M:S, 53.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 301.63 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.552 H:M:S, 16.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-03:45:12 ... thread 0: (1000000,10000000) ops and (293243.1,174665.4) ops/second in (3.410140,57.252324) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/6 3.56 GB 258.0 8.4 0.0 8.4 17.9 9.5 0.0 1.9 135.0 287.6 63.90 56.99 164 0.390 8762K 12K 0.0 0.0 L1 10/10 1.00 GB 0.0 9.2 5.8 3.3 9.0 5.7 0.1 1.5 228.6 225.7 40.99 38.66 5 8.198 8980K 47K 0.0 0.0 L2 1/0 97.93 MB 1.0 0.1 0.1 0.1 0.1 0.1 4.9 2.0 230.1 230.0 0.55 0.52 1 0.548 127K 39 0.0 0.0 L3 15/0 992.62 MB 1.0 2.0 1.1 0.9 2.0 1.1 3.7 1.8 126.5 125.3 16.22 9.15 9 1.802 2083K 19K 0.0 0.0 L4 161/0 9.75 GB 1.0 4.0 3.3 0.8 4.0 3.3 1.2 1.2 119.6 119.0 34.67 19.35 32 1.083 4165K 17K 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1301/16 105.50 GB 0.0 23.8 10.3 13.5 33.1 19.7 14.3 3.5 155.6 217.0 156.32 124.67 211 0.741 24M 97K 0.0 0.0 Int 0/0 0.00 KB 0.0 23.8 10.3 13.5 33.1 19.7 14.1 3.5 155.6 217.0 156.32 124.67 211 0.741 24M 97K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 23.8 10.3 13.5 23.6 10.1 0.0 0.0 194.1 192.7 125.32 99.48 75 1.671 24M 97K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 314.9 31.01 25.19 136 0.228 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.4 total, 57.3 interval Flush(GB): cumulative 9.536, interval 9.536 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.12 GB write, 590.60 MB/s write, 23.75 GB read, 423.56 MB/s read, 156.3 seconds Interval compaction: 33.12 GB write, 592.37 MB/s write, 23.75 GB read, 424.83 MB/s read, 156.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 10, pending-compaction-bytes-stops: 0, total-delays: 24, total-stops: 55, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 4009060 Average: 2.7226 StdDev: 29.29 Min: 0 Median: 1.4497 Max: 10701 Percentiles: P50: 1.45 P75: 1.84 P99: 6.93 P99.9: 133.44 P99.99: 351.06 ------------------------------------------------------ [ 0, 1 ] 852632 21.268% 21.268% #### ( 1, 2 ] 2561225 63.886% 85.154% ############# ( 2, 3 ] 305199 7.613% 92.766% ## ( 3, 4 ] 143599 3.582% 96.348% # ( 4, 6 ] 98949 2.468% 98.816% ( 6, 10 ] 31585 0.788% 99.604% ( 10, 15 ] 5490 0.137% 99.741% ( 15, 22 ] 859 0.021% 99.762% ( 22, 34 ] 51 0.001% 99.764% ( 34, 51 ] 24 0.001% 99.764% ( 51, 76 ] 53 0.001% 99.766% ( 76, 110 ] 3940 0.098% 99.864% ( 110, 170 ] 3699 0.092% 99.956% ( 170, 250 ] 841 0.021% 99.977% ( 250, 380 ] 660 0.016% 99.994% ( 380, 580 ] 560 0.014% 100.008% ( 580, 870 ] 298 0.007% 100.015% ( 870, 1300 ] 105 0.003% 100.018% ( 1300, 1900 ] 73 0.002% 100.020% ( 1900, 2900 ] 70 0.002% 100.021% ( 2900, 4400 ] 79 0.002% 100.023% ( 4400, 6600 ] 29 0.001% 100.024% ( 6600, 9900 ] 7 0.000% 100.024% ( 9900, 14000 ] 1 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 2098200 Average: 5.1381 StdDev: 94.48 Min: 0 Median: 1.5590 Max: 12515 Percentiles: P50: 1.56 P75: 2.01 P99: 9.21 P99.9: 144.82 P99.99: 466.68 ------------------------------------------------------ [ 0, 1 ] 386093 18.401% 18.401% #### ( 1, 2 ] 1186010 56.525% 74.926% ########### ( 2, 3 ] 241323 11.501% 86.428% ## ( 3, 4 ] 117565 5.603% 92.031% # ( 4, 6 ] 114958 5.479% 97.510% # ( 6, 10 ] 39020 1.860% 99.369% ( 10, 15 ] 7053 0.336% 99.706% ( 15, 22 ] 1076 0.051% 99.757% ( 22, 34 ] 96 0.005% 99.761% ( 34, 51 ] 25 0.001% 99.763% ( 51, 76 ] 127 0.006% 99.769% ( 76, 110 ] 1815 0.087% 99.855% ( 110, 170 ] 1623 0.077% 99.933% ( 170, 250 ] 467 0.022% 99.955% ( 250, 380 ] 507 0.024% 99.979% ( 380, 580 ] 538 0.026% 100.005% ( 580, 870 ] 545 0.026% 100.031% ( 870, 1300 ] 345 0.016% 100.047% ( 1300, 1900 ] 189 0.009% 100.056% ( 1900, 2900 ] 309 0.015% 100.071% ( 2900, 4400 ] 437 0.021% 100.092% ( 4400, 6600 ] 198 0.009% 100.101% ( 6600, 9900 ] 57 0.003% 100.104% ( 9900, 14000 ] 10 0.000% 100.104% ** Level 2 read latency histogram (micros): Count: 31755 Average: 2.3106 StdDev: 4.78 Min: 1 Median: 1.5400 Max: 703 Percentiles: P50: 1.54 P75: 1.94 P99: 7.12 P99.9: 13.35 P99.99: 41.01 ------------------------------------------------------ [ 0, 1 ] 5116 16.111% 16.111% ### ( 1, 2 ] 19930 62.762% 78.873% ############# ( 2, 3 ] 3189 10.043% 88.915% ## ( 3, 4 ] 1750 5.511% 94.426% # ( 4, 6 ] 1357 4.273% 98.699% # ( 6, 10 ] 341 1.074% 99.773% ( 10, 15 ] 60 0.189% 99.962% ( 15, 22 ] 8 0.025% 99.987% ( 34, 51 ] 2 0.006% 99.994% ( 380, 580 ] 1 0.003% 99.997% ( 580, 870 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 463827 Average: 12.1681 StdDev: 145.06 Min: 0 Median: 1.9089 Max: 9794 Percentiles: P50: 1.91 P75: 3.04 P99: 12.60 P99.9: 1002.43 P99.99: 1324.74 ------------------------------------------------------ [ 0, 1 ] 19692 4.246% 4.246% # ( 1, 2 ] 233489 50.340% 54.585% ########## ( 2, 3 ] 92614 19.967% 74.553% #### ( 3, 4 ] 52040 11.220% 85.772% ## ( 4, 6 ] 50821 10.957% 96.729% ## ( 6, 10 ] 9398 2.026% 98.755% ( 10, 15 ] 2184 0.471% 99.226% ( 15, 22 ] 253 0.055% 99.281% ( 22, 34 ] 72 0.016% 99.296% ( 34, 51 ] 5 0.001% 99.297% ( 51, 76 ] 7 0.002% 99.299% ( 76, 110 ] 53 0.011% 99.310% ( 110, 170 ] 222 0.048% 99.358% ( 170, 250 ] 315 0.068% 99.426% ( 250, 380 ] 468 0.101% 99.527% ( 380, 580 ] 722 0.156% 99.683% ( 580, 870 ] 828 0.179% 99.861% ( 870, 1300 ] 585 0.126% 99.987% ( 1300, 1900 ] 306 0.066% 100.053% ( 1900, 2900 ] 221 0.048% 100.101% ( 2900, 4400 ] 286 0.062% 100.163% ( 4400, 6600 ] 74 0.016% 100.179% ( 6600, 9900 ] 14 0.003% 100.182% ** Level 4 read latency histogram (micros): Count: 96084 Average: 9.1161 StdDev: 126.76 Min: 1 Median: 1.8562 Max: 11591 Percentiles: P50: 1.86 P75: 2.87 P99: 11.80 P99.9: 1425.75 P99.99: 3731.53 ------------------------------------------------------ [ 0, 1 ] 2840 2.956% 2.956% # ( 1, 2 ] 52791 54.943% 57.898% ########### ( 2, 3 ] 18965 19.738% 77.636% #### ( 3, 4 ] 8901 9.264% 86.900% ## ( 4, 6 ] 9388 9.771% 96.671% ## ( 6, 10 ] 2059 2.143% 98.814% ( 10, 15 ] 499 0.519% 99.333% ( 15, 22 ] 47 0.049% 99.382% ( 22, 34 ] 13 0.014% 99.395% ( 34, 51 ] 2 0.002% 99.397% ( 51, 76 ] 4 0.004% 99.402% ( 76, 110 ] 19 0.020% 99.421% ( 110, 170 ] 47 0.049% 99.470% ( 170, 250 ] 97 0.101% 99.571% ( 250, 380 ] 76 0.079% 99.650% ( 380, 580 ] 80 0.083% 99.734% ( 580, 870 ] 89 0.093% 99.826% ( 870, 1300 ] 64 0.067% 99.893% ( 1300, 1900 ] 33 0.034% 99.927% ( 1900, 2900 ] 36 0.037% 99.965% ( 2900, 4400 ] 44 0.046% 100.010% ( 4400, 6600 ] 14 0.015% 100.025% ( 9900, 14000 ] 1 0.001% 100.026% ** Level 5 read latency histogram (micros): Count: 260 Average: 1553.5192 StdDev: 1638.48 Min: 89 Median: 776.4516 Max: 7231 Percentiles: P50: 776.45 P75: 2471.43 P99: 7040.00 P99.9: 7231.00 P99.99: 7231.00 ------------------------------------------------------ ( 76, 110 ] 9 3.462% 3.462% # ( 110, 170 ] 22 8.462% 11.923% ## ( 170, 250 ] 22 8.462% 20.385% ## ( 250, 380 ] 27 10.385% 30.769% ## ( 380, 580 ] 29 11.154% 41.923% ## ( 580, 870 ] 31 11.923% 53.846% ## ( 870, 1300 ] 16 6.154% 60.000% # ( 1300, 1900 ] 23 8.846% 68.846% ## ( 1900, 2900 ] 28 10.769% 79.615% ## ( 2900, 4400 ] 35 13.462% 93.077% ### ( 4400, 6600 ] 15 5.769% 98.846% # ( 6600, 9900 ] 3 1.154% 100.000% ** DB Stats ** Uptime(secs): 57.4 total, 3.4 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 171.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.756 H:M:S, 51.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.731 H:M:S, 21.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.748 micros/op 173960 ops/sec 60.123 seconds 10458999 operations; 168.6 MB/s Microseconds per write: Count: 10458999 Average: 5.7484 StdDev: 523.71 Min: 1 Median: 1.7484 Max: 995005 Percentiles: P50: 1.75 P75: 2.77 P99: 8.38 P99.9: 1127.74 P99.99: 2686.90 ------------------------------------------------------ [ 0, 1 ] 1292560 12.358% 12.358% ## ( 1, 2 ] 5260483 50.296% 62.655% ########## ( 2, 3 ] 1671794 15.984% 78.639% ### ( 3, 4 ] 1485852 14.206% 92.845% ### ( 4, 6 ] 585174 5.595% 98.440% # ( 6, 10 ] 98594 0.943% 99.383% ( 10, 15 ] 25419 0.243% 99.626% ( 15, 22 ] 7365 0.070% 99.696% ( 22, 34 ] 1717 0.016% 99.713% ( 34, 51 ] 215 0.002% 99.715% ( 51, 76 ] 38 0.000% 99.715% ( 76, 110 ] 7190 0.069% 99.784% ( 110, 170 ] 2977 0.028% 99.812% ( 170, 250 ] 324 0.003% 99.815% ( 250, 380 ] 93 0.001% 99.816% ( 380, 580 ] 20 0.000% 99.817% ( 580, 870 ] 14 0.000% 99.817% ( 870, 1300 ] 14533 0.139% 99.956% ( 1300, 1900 ] 28 0.000% 99.956% ( 1900, 2900 ] 4528 0.043% 99.999% ( 2900, 4400 ] 42 0.000% 100.000% ( 4400, 6600 ] 6 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 14000, 22000 ] 3 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 75000, 110000 ] 3 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% ( 860000, 1200000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 198122 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10458999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10793686968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 535 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31360100 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 28680382132 rocksdb.compact.write.bytes COUNT : 28474335559 rocksdb.flush.write.bytes COUNT : 10767191034 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 63 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 314 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10680484864 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4247552 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 28780313597 rocksdb.non.last.level.read.count COUNT : 6947749 rocksdb.block.checksum.compute.count COUNT : 6946742 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.402661 P95 : 3.881177 P99 : 6.550909 P100 : 995003.000000 COUNT : 10458999 SUM : 55245653 rocksdb.compaction.times.micros P50 : 1108928.571429 P95 : 4630000.000000 P99 : 18920000.000000 P100 : 19541397.000000 COUNT : 77 SUM : 138156792 rocksdb.compaction.times.cpu_micros P50 : 913428.571429 P95 : 4630000.000000 P99 : 15840000.000000 P100 : 18242516.000000 COUNT : 77 SUM : 109725864 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 696.381579 P95 : 1855.000000 P99 : 215600.000000 P100 : 253813.000000 COUNT : 143 SUM : 625294 rocksdb.compaction.outfile.sync.micros P50 : 1057.258065 P95 : 188909.090909 P99 : 326700.000000 P100 : 372986.000000 COUNT : 328 SUM : 9689937 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 104.456522 P95 : 1685.714286 P99 : 4250.000000 P100 : 5330.000000 COUNT : 250 SUM : 84111 rocksdb.table.open.io.micros P50 : 1649.484536 P95 : 8284.375000 P99 : 13856.500000 P100 : 19030.000000 COUNT : 535 SUM : 1281608 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.517396 P95 : 7.452066 P99 : 11.644447 P100 : 12522.000000 COUNT : 6945074 SUM : 43142329 rocksdb.read.block.get.micros P50 : 537.281553 P95 : 3755.468750 P99 : 6002.857143 P100 : 10525.000000 COUNT : 1070 SUM : 1034429 rocksdb.write.raw.block.micros P50 : 0.513338 P95 : 0.975342 P99 : 2.902985 P100 : 20813.000000 COUNT : 9503988 SUM : 19604703 rocksdb.numfiles.in.singlecompaction P50 : 3.290123 P95 : 6.466667 P99 : 30.040000 P100 : 42.000000 COUNT : 133 SUM : 553 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.560706 P95 : 1173.411892 P99 : 2515.054264 P100 : 994828.000000 COUNT : 176703 SUM : 31374012 rocksdb.sst.read.micros P50 : 1.509542 P95 : 4.421277 P99 : 8.665424 P100 : 12515.000000 COUNT : 6947751 SUM : 29429080 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10458999 SUM : 10793686968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 214230.769231 P95 : 412300.000000 P99 : 1037933.333333 P100 : 1145251.000000 COUNT : 143 SUM : 32442553 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 321 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0