[2024-12-14 21:09:52.268354] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-14 21:09:52.268462] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1981908 ] Set seed to 1734206992265980 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-14 21:09:52.374848] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-14 21:09:52.587393] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-14 21:09:52.587446] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1981908' to capture a snapshot of events at runtime. [2024-12-14 21:09:52.587456] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1981908 for offline analysis/debug. [2024-12-14 21:09:52.587485] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 14 21:10:01 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/14-21:10:04 ... thread 0: (1000000,1000000) ops and (334259.1,334259.1) ops/second in (2.991691,2.991691) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/9 693.01 MB 6.3 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 343.6 2.57 2.31 12 0.214 0 0 0.0 0.0 L2 3/2 237.32 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 241.9 241.8 1.44 1.40 2 0.721 354K 183 0.0 0.0 L3 8/0 692.92 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.54 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1181/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 87.0 306.9 4.01 3.71 14 0.286 354K 183 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 87.0 306.9 4.01 3.71 14 0.286 354K 183 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 241.9 241.8 1.44 1.40 2 0.721 354K 183 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 343.6 2.57 2.31 12 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 383.53 MB/s write, 0.34 GB read, 108.76 MB/s read, 4.0 seconds Interval compaction: 1.20 GB write, 411.14 MB/s write, 0.34 GB read, 116.59 MB/s read, 4.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 123474 Average: 2.1206 StdDev: 17.18 Min: 1 Median: 1.3970 Max: 3601 Percentiles: P50: 1.40 P75: 1.79 P99: 5.52 P99.9: 11.57 P99.99: 149.79 ------------------------------------------------------ [ 0, 1 ] 30645 24.819% 24.819% ##### ( 1, 2 ] 78319 63.430% 88.249% ############# ( 2, 3 ] 8425 6.823% 95.072% # ( 3, 4 ] 3247 2.630% 97.702% # ( 4, 6 ] 2113 1.711% 99.413% ( 6, 10 ] 566 0.458% 99.871% ( 10, 15 ] 123 0.100% 99.971% ( 15, 22 ] 18 0.015% 99.985% ( 22, 34 ] 3 0.002% 99.988% ( 34, 51 ] 1 0.001% 99.989% ( 51, 76 ] 2 0.002% 99.990% ( 110, 170 ] 4 0.003% 99.994% ( 170, 250 ] 5 0.004% 99.998% ( 250, 380 ] 5 0.004% 100.002% ( 380, 580 ] 3 0.002% 100.004% ( 870, 1300 ] 2 0.002% 100.006% ( 1300, 1900 ] 2 0.002% 100.007% ( 1900, 2900 ] 1 0.001% 100.008% ( 2900, 4400 ] 2 0.002% 100.010% ** Level 1 read latency histogram (micros): Count: 12334 Average: 3.6446 StdDev: 89.92 Min: 1 Median: 1.2527 Max: 7114 Percentiles: P50: 1.25 P75: 1.68 P99: 11.51 P99.9: 212.66 P99.99: 7114.00 ------------------------------------------------------ [ 0, 1 ] 4328 35.090% 35.090% ####### ( 1, 2 ] 7277 59.000% 94.090% ############ ( 2, 3 ] 280 2.270% 96.360% ( 3, 4 ] 109 0.884% 97.243% ( 4, 6 ] 45 0.365% 97.608% ( 6, 10 ] 152 1.232% 98.841% ( 10, 15 ] 65 0.527% 99.368% ( 15, 22 ] 6 0.049% 99.416% ( 34, 51 ] 5 0.041% 99.457% ( 51, 76 ] 43 0.349% 99.805% ( 76, 110 ] 7 0.057% 99.862% ( 110, 170 ] 2 0.016% 99.878% ( 170, 250 ] 5 0.041% 99.919% ( 250, 380 ] 2 0.016% 99.935% ( 380, 580 ] 4 0.032% 99.968% ( 580, 870 ] 2 0.016% 99.984% ( 6600, 9900 ] 2 0.016% 100.000% ** Level 2 read latency histogram (micros): Count: 74168 Average: 2.0100 StdDev: 7.11 Min: 1 Median: 1.3863 Max: 1350 Percentiles: P50: 1.39 P75: 1.78 P99: 5.57 P99.9: 9.96 P99.99: 161.66 ------------------------------------------------------ [ 0, 1 ] 18724 25.245% 25.245% ##### ( 1, 2 ] 47522 64.073% 89.319% ############# ( 2, 3 ] 4429 5.972% 95.290% # ( 3, 4 ] 1793 2.417% 97.708% ( 4, 6 ] 1224 1.650% 99.358% ( 6, 10 ] 406 0.547% 99.906% ( 10, 15 ] 55 0.074% 99.980% ( 15, 22 ] 2 0.003% 99.982% ( 22, 34 ] 2 0.003% 99.985% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 4 0.005% 99.997% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 40 Average: 3045.2250 StdDev: 3154.19 Min: 368 Median: 725.0000 Max: 8643 Percentiles: P50: 725.00 P75: 5866.67 P99: 8643.00 P99.9: 8643.00 P99.99: 8643.00 ------------------------------------------------------ ( 250, 380 ] 5 12.500% 12.500% ### ( 380, 580 ] 14 35.000% 47.500% ####### ( 580, 870 ] 2 5.000% 52.500% # ( 870, 1300 ] 2 5.000% 57.500% # ( 2900, 4400 ] 3 7.500% 65.000% ## ( 4400, 6600 ] 6 15.000% 80.000% ### ( 6600, 9900 ] 8 20.000% 100.000% #### ** Level 4 read latency histogram (micros): Count: 35 Average: 4068.3429 StdDev: 2995.98 Min: 376 Median: 3275.0000 Max: 9677 Percentiles: P50: 3275.00 P75: 6393.75 P99: 9677.00 P99.9: 9677.00 P99.99: 9677.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 5 14.286% 17.143% ### ( 580, 870 ] 1 2.857% 20.000% # ( 870, 1300 ] 1 2.857% 22.857% # ( 1300, 1900 ] 5 14.286% 37.143% ### ( 1900, 2900 ] 4 11.429% 48.571% ## ( 2900, 4400 ] 2 5.714% 54.286% # ( 4400, 6600 ] 8 22.857% 77.143% ##### ( 6600, 9900 ] 8 22.857% 100.000% ##### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 306.65 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.427 H:M:S, 13.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.427 H:M:S, 14.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/14-21:10:07 ... thread 0: (1000000,2000000) ops and (319784.9,326861.9) ops/second in (3.127102,6.118793) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 113.3 0.9 0.0 0.9 2.7 1.8 0.0 1.5 98.3 308.7 8.98 8.33 29 0.310 895K 994 0.0 0.0 L1 1/0 2.35 MB 0.2 0.3 0.3 0.0 0.3 0.3 0.2 1.0 229.3 228.9 1.37 1.34 1 1.374 319K 405 0.0 0.0 L2 1/0 49.86 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 241.9 241.8 1.44 1.40 2 0.721 354K 183 0.0 0.0 L3 32/0 973.18 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 197.0 196.8 3.49 3.07 3 1.163 697K 591 0.0 0.0 L4 144/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1232/4 97.98 GB 0.0 2.2 1.0 1.2 4.0 2.8 0.8 2.2 146.1 269.7 15.28 14.14 35 0.437 2267K 2173 0.0 0.0 Int 0/0 0.00 KB 0.0 2.2 1.0 1.2 4.0 2.8 0.8 2.2 146.1 269.7 15.28 14.14 35 0.437 2267K 2173 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.2 1.0 1.2 2.2 1.0 0.0 0.0 228.4 228.2 9.78 9.20 9 1.086 2267K 2173 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 343.3 5.50 4.93 26 0.212 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.3 total, 6.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.02 GB write, 650.36 MB/s write, 2.18 GB read, 352.44 MB/s read, 15.3 seconds Interval compaction: 4.02 GB write, 673.26 MB/s write, 2.18 GB read, 364.85 MB/s read, 15.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 9, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 9, interval: 9 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 404451 Average: 2.1849 StdDev: 13.25 Min: 1 Median: 1.4696 Max: 3601 Percentiles: P50: 1.47 P75: 1.85 P99: 5.69 P99.9: 10.96 P99.99: 17.53 ------------------------------------------------------ [ 0, 1 ] 77570 19.179% 19.179% #### ( 1, 2 ] 265455 65.633% 84.812% ############# ( 2, 3 ] 36098 8.925% 93.738% ## ( 3, 4 ] 13381 3.308% 97.046% # ( 4, 6 ] 9336 2.308% 99.354% ( 6, 10 ] 2124 0.525% 99.880% ( 10, 15 ] 431 0.107% 99.986% ( 15, 22 ] 43 0.011% 99.997% ( 22, 34 ] 6 0.001% 99.998% ( 34, 51 ] 3 0.001% 99.999% ( 51, 76 ] 5 0.001% 100.000% ( 110, 170 ] 6 0.001% 100.002% ( 170, 250 ] 14 0.003% 100.005% ( 250, 380 ] 8 0.002% 100.007% ( 380, 580 ] 10 0.002% 100.010% ( 580, 870 ] 6 0.001% 100.011% ( 870, 1300 ] 6 0.001% 100.013% ( 1300, 1900 ] 2 0.000% 100.013% ( 1900, 2900 ] 2 0.000% 100.014% ( 2900, 4400 ] 4 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 91593 Average: 2.5871 StdDev: 33.43 Min: 1 Median: 1.5871 Max: 7114 Percentiles: P50: 1.59 P75: 1.97 P99: 6.65 P99.9: 14.70 P99.99: 165.22 ------------------------------------------------------ [ 0, 1 ] 10993 12.002% 12.002% ## ( 1, 2 ] 59280 64.721% 76.723% ############# ( 2, 3 ] 12511 13.659% 90.382% ### ( 3, 4 ] 4238 4.627% 95.009% # ( 4, 6 ] 3533 3.857% 98.867% # ( 6, 10 ] 750 0.819% 99.686% ( 10, 15 ] 209 0.228% 99.914% ( 15, 22 ] 11 0.012% 99.926% ( 22, 34 ] 1 0.001% 99.927% ( 34, 51 ] 5 0.005% 99.932% ( 51, 76 ] 44 0.048% 99.980% ( 76, 110 ] 7 0.008% 99.988% ( 110, 170 ] 2 0.002% 99.990% ( 170, 250 ] 6 0.007% 99.997% ( 250, 380 ] 4 0.004% 100.001% ( 380, 580 ] 5 0.005% 100.007% ( 580, 870 ] 3 0.003% 100.010% ( 870, 1300 ] 1 0.001% 100.011% ( 6600, 9900 ] 2 0.002% 100.013% ** Level 2 read latency histogram (micros): Count: 75928 Average: 2.0225 StdDev: 7.03 Min: 1 Median: 1.3942 Max: 1350 Percentiles: P50: 1.39 P75: 1.78 P99: 5.61 P99.9: 9.97 P99.99: 158.14 ------------------------------------------------------ [ 0, 1 ] 18796 24.755% 24.755% ##### ( 1, 2 ] 48624 64.040% 88.795% ############# ( 2, 3 ] 4795 6.315% 95.110% # ( 3, 4 ] 1879 2.475% 97.585% ( 4, 6 ] 1339 1.764% 99.348% ( 6, 10 ] 422 0.556% 99.904% ( 10, 15 ] 57 0.075% 99.979% ( 15, 22 ] 3 0.004% 99.983% ( 22, 34 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 4 0.005% 99.997% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47930 Average: 5.0458 StdDev: 127.15 Min: 0 Median: 1.6169 Max: 8643 Percentiles: P50: 1.62 P75: 2.00 P99: 6.63 P99.9: 111.40 P99.99: 6309.23 ------------------------------------------------------ [ 0, 1 ] 4695 9.796% 9.796% ## ( 1, 2 ] 31238 65.174% 74.970% ############# ( 2, 3 ] 7026 14.659% 89.629% ### ( 3, 4 ] 2509 5.235% 94.863% # ( 4, 6 ] 1928 4.023% 98.886% # ( 6, 10 ] 349 0.728% 99.614% ( 10, 15 ] 107 0.223% 99.837% ( 15, 22 ] 20 0.042% 99.879% ( 22, 34 ] 10 0.021% 99.900% ( 110, 170 ] 3 0.006% 99.906% ( 250, 380 ] 6 0.013% 99.919% ( 380, 580 ] 17 0.035% 99.954% ( 580, 870 ] 5 0.010% 99.965% ( 870, 1300 ] 2 0.004% 99.969% ( 1300, 1900 ] 2 0.004% 99.973% ( 2900, 4400 ] 3 0.006% 99.979% ( 4400, 6600 ] 6 0.013% 99.992% ( 6600, 9900 ] 8 0.017% 100.008% ** Level 4 read latency histogram (micros): Count: 35 Average: 4068.3429 StdDev: 2995.98 Min: 376 Median: 3275.0000 Max: 9677 Percentiles: P50: 3275.00 P75: 6393.75 P99: 9677.00 P99.9: 9677.00 P99.99: 9677.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 5 14.286% 17.143% ### ( 580, 870 ] 1 2.857% 20.000% # ( 870, 1300 ] 1 2.857% 22.857% # ( 1300, 1900 ] 5 14.286% 37.143% ### ( 1900, 2900 ] 4 11.429% 48.571% ## ( 2900, 4400 ] 2 5.714% 54.286% # ( 4400, 6600 ] 8 22.857% 77.143% ##### ( 6600, 9900 ] 8 22.857% 100.000% ##### ** DB Stats ** Uptime(secs): 6.3 total, 3.1 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 310.64 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.899 H:M:S, 14.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 314.73 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.472 H:M:S, 15.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-21:10:10 ... thread 0: (1000000,3000000) ops and (333085.0,328910.2) ops/second in (3.002237,9.121030) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/11 2.27 GB 62.9 1.6 0.0 1.6 4.4 2.8 0.0 1.6 111.9 305.4 14.64 13.65 45 0.325 1663K 1802 0.0 0.0 L1 1/1 2.35 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 229.3 228.9 1.37 1.34 1 1.374 319K 405 0.0 0.0 L2 1/0 49.86 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 241.9 241.8 1.44 1.40 2 0.721 354K 183 0.0 0.0 L3 32/0 973.18 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 197.0 196.8 3.49 3.07 3 1.163 697K 591 0.0 0.0 L4 144/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1236/12 98.90 GB 0.0 2.9 1.0 1.9 5.7 3.7 0.8 2.1 142.7 277.9 20.94 19.46 51 0.411 3035K 2981 0.0 0.0 Int 0/0 0.00 KB 0.0 2.9 1.0 1.9 5.7 3.7 0.8 2.1 142.7 277.9 20.94 19.46 51 0.411 3035K 2981 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.9 1.0 1.9 2.9 1.0 0.0 0.0 234.4 234.1 12.75 12.12 12 1.063 3035K 2981 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 346.1 8.19 7.33 39 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.3 total, 9.1 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 5.68 GB write, 623.32 MB/s write, 2.92 GB read, 320.09 MB/s read, 20.9 seconds Interval compaction: 5.68 GB write, 638.05 MB/s write, 2.92 GB read, 327.66 MB/s read, 20.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 12, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 12, interval: 12 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 712103 Average: 2.1548 StdDev: 10.81 Min: 1 Median: 1.4732 Max: 3601 Percentiles: P50: 1.47 P75: 1.85 P99: 5.60 P99.9: 10.99 P99.99: 16.70 ------------------------------------------------------ [ 0, 1 ] 129582 18.197% 18.197% #### ( 1, 2 ] 478557 67.203% 85.400% ############# ( 2, 3 ] 64069 8.997% 94.398% ## ( 3, 4 ] 21163 2.972% 97.369% # ( 4, 6 ] 14526 2.040% 99.409% ( 6, 10 ] 3342 0.469% 99.879% ( 10, 15 ] 779 0.109% 99.988% ( 15, 22 ] 65 0.009% 99.997% ( 22, 34 ] 11 0.002% 99.999% ( 34, 51 ] 5 0.001% 99.999% ( 51, 76 ] 8 0.001% 100.001% ( 110, 170 ] 11 0.002% 100.002% ( 170, 250 ] 20 0.003% 100.005% ( 250, 380 ] 11 0.002% 100.006% ( 380, 580 ] 15 0.002% 100.009% ( 580, 870 ] 14 0.002% 100.011% ( 870, 1300 ] 10 0.001% 100.012% ( 1300, 1900 ] 3 0.000% 100.012% ( 1900, 2900 ] 2 0.000% 100.013% ( 2900, 4400 ] 4 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 91594 Average: 2.5870 StdDev: 33.43 Min: 1 Median: 1.5871 Max: 7114 Percentiles: P50: 1.59 P75: 1.97 P99: 6.65 P99.9: 14.70 P99.99: 165.22 ------------------------------------------------------ [ 0, 1 ] 10993 12.002% 12.002% ## ( 1, 2 ] 59281 64.721% 76.723% ############# ( 2, 3 ] 12511 13.659% 90.383% ### ( 3, 4 ] 4238 4.627% 95.009% # ( 4, 6 ] 3533 3.857% 98.867% # ( 6, 10 ] 750 0.819% 99.686% ( 10, 15 ] 209 0.228% 99.914% ( 15, 22 ] 11 0.012% 99.926% ( 22, 34 ] 1 0.001% 99.927% ( 34, 51 ] 5 0.005% 99.932% ( 51, 76 ] 44 0.048% 99.980% ( 76, 110 ] 7 0.008% 99.988% ( 110, 170 ] 2 0.002% 99.990% ( 170, 250 ] 6 0.007% 99.997% ( 250, 380 ] 4 0.004% 100.001% ( 380, 580 ] 5 0.005% 100.007% ( 580, 870 ] 3 0.003% 100.010% ( 870, 1300 ] 1 0.001% 100.011% ( 6600, 9900 ] 2 0.002% 100.013% ** Level 2 read latency histogram (micros): Count: 75928 Average: 2.0225 StdDev: 7.03 Min: 1 Median: 1.3942 Max: 1350 Percentiles: P50: 1.39 P75: 1.78 P99: 5.61 P99.9: 9.97 P99.99: 158.14 ------------------------------------------------------ [ 0, 1 ] 18796 24.755% 24.755% ##### ( 1, 2 ] 48624 64.040% 88.795% ############# ( 2, 3 ] 4795 6.315% 95.110% # ( 3, 4 ] 1879 2.475% 97.585% ( 4, 6 ] 1339 1.764% 99.348% ( 6, 10 ] 422 0.556% 99.904% ( 10, 15 ] 57 0.075% 99.979% ( 15, 22 ] 3 0.004% 99.983% ( 22, 34 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 4 0.005% 99.997% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47930 Average: 5.0458 StdDev: 127.15 Min: 0 Median: 1.6169 Max: 8643 Percentiles: P50: 1.62 P75: 2.00 P99: 6.63 P99.9: 111.40 P99.99: 6309.23 ------------------------------------------------------ [ 0, 1 ] 4695 9.796% 9.796% ## ( 1, 2 ] 31238 65.174% 74.970% ############# ( 2, 3 ] 7026 14.659% 89.629% ### ( 3, 4 ] 2509 5.235% 94.863% # ( 4, 6 ] 1928 4.023% 98.886% # ( 6, 10 ] 349 0.728% 99.614% ( 10, 15 ] 107 0.223% 99.837% ( 15, 22 ] 20 0.042% 99.879% ( 22, 34 ] 10 0.021% 99.900% ( 110, 170 ] 3 0.006% 99.906% ( 250, 380 ] 6 0.013% 99.919% ( 380, 580 ] 17 0.035% 99.954% ( 580, 870 ] 5 0.010% 99.965% ( 870, 1300 ] 2 0.004% 99.969% ( 1300, 1900 ] 2 0.004% 99.973% ( 2900, 4400 ] 3 0.006% 99.979% ( 4400, 6600 ] 6 0.013% 99.992% ( 6600, 9900 ] 8 0.017% 100.008% ** Level 4 read latency histogram (micros): Count: 35 Average: 4068.3429 StdDev: 2995.98 Min: 376 Median: 3275.0000 Max: 9677 Percentiles: P50: 3275.00 P75: 6393.75 P99: 9677.00 P99.9: 9677.00 P99.99: 9677.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 5 14.286% 17.143% ### ( 580, 870 ] 1 2.857% 20.000% # ( 870, 1300 ] 1 2.857% 22.857% # ( 1300, 1900 ] 5 14.286% 37.143% ### ( 1900, 2900 ] 4 11.429% 48.571% ## ( 2900, 4400 ] 2 5.714% 54.286% # ( 4400, 6600 ] 8 22.857% 77.143% ##### ( 6600, 9900 ] 8 22.857% 100.000% ##### ** DB Stats ** Uptime(secs): 9.3 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 316.16 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.334 H:M:S, 14.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 327.82 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.435 H:M:S, 14.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-21:10:13 ... thread 0: (1000000,4000000) ops and (310247.6,324037.2) ops/second in (3.223232,12.344262) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 3.26 GB 169.9 2.4 0.0 2.4 6.1 3.7 0.0 1.6 118.1 302.6 20.81 19.46 62 0.336 2494K 2664 0.0 0.0 L1 1/1 2.35 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 229.3 228.9 1.37 1.34 1 1.374 319K 405 0.0 0.0 L2 1/0 49.86 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 241.9 241.8 1.44 1.40 2 0.721 354K 183 0.0 0.0 L3 32/0 973.18 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 197.0 196.8 3.49 3.07 3 1.163 697K 591 0.0 0.0 L4 144/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/12 99.89 GB 0.0 3.7 1.0 2.7 7.5 4.7 0.8 2.0 140.4 282.0 27.12 25.26 68 0.399 3866K 3843 0.0 0.0 Int 0/0 0.00 KB 0.0 3.7 1.0 2.7 7.5 4.7 0.8 2.0 140.4 282.0 27.12 25.26 68 0.399 3866K 3843 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.7 1.0 2.7 3.7 1.0 0.0 0.0 238.1 237.8 16.00 15.30 15 1.066 3866K 3843 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 345.5 11.12 9.97 53 0.210 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.6 total, 12.3 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.47 GB write, 608.75 MB/s write, 3.72 GB read, 303.16 MB/s read, 27.1 seconds Interval compaction: 7.47 GB write, 619.37 MB/s write, 3.72 GB read, 308.45 MB/s read, 27.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 15, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1101422 Average: 2.2243 StdDev: 12.27 Min: 1 Median: 1.4933 Max: 3971 Percentiles: P50: 1.49 P75: 1.86 P99: 5.62 P99.9: 11.17 P99.99: 89.89 ------------------------------------------------------ [ 0, 1 ] 181190 16.451% 16.451% ### ( 1, 2 ] 749091 68.011% 84.462% ############## ( 2, 3 ] 107389 9.750% 94.212% ## ( 3, 4 ] 34069 3.093% 97.305% # ( 4, 6 ] 23101 2.097% 99.402% ( 6, 10 ] 5225 0.474% 99.877% ( 10, 15 ] 1093 0.099% 99.976% ( 15, 22 ] 85 0.008% 99.984% ( 22, 34 ] 13 0.001% 99.985% ( 34, 51 ] 5 0.000% 99.985% ( 51, 76 ] 11 0.001% 99.986% ( 76, 110 ] 100 0.009% 99.995% ( 110, 170 ] 109 0.010% 100.005% ( 170, 250 ] 55 0.005% 100.010% ( 250, 380 ] 27 0.002% 100.013% ( 380, 580 ] 33 0.003% 100.016% ( 580, 870 ] 26 0.002% 100.018% ( 870, 1300 ] 15 0.001% 100.020% ( 1300, 1900 ] 6 0.001% 100.020% ( 1900, 2900 ] 3 0.000% 100.020% ( 2900, 4400 ] 8 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 91594 Average: 2.5870 StdDev: 33.43 Min: 1 Median: 1.5871 Max: 7114 Percentiles: P50: 1.59 P75: 1.97 P99: 6.65 P99.9: 14.70 P99.99: 165.22 ------------------------------------------------------ [ 0, 1 ] 10993 12.002% 12.002% ## ( 1, 2 ] 59281 64.721% 76.723% ############# ( 2, 3 ] 12511 13.659% 90.383% ### ( 3, 4 ] 4238 4.627% 95.009% # ( 4, 6 ] 3533 3.857% 98.867% # ( 6, 10 ] 750 0.819% 99.686% ( 10, 15 ] 209 0.228% 99.914% ( 15, 22 ] 11 0.012% 99.926% ( 22, 34 ] 1 0.001% 99.927% ( 34, 51 ] 5 0.005% 99.932% ( 51, 76 ] 44 0.048% 99.980% ( 76, 110 ] 7 0.008% 99.988% ( 110, 170 ] 2 0.002% 99.990% ( 170, 250 ] 6 0.007% 99.997% ( 250, 380 ] 4 0.004% 100.001% ( 380, 580 ] 5 0.005% 100.007% ( 580, 870 ] 3 0.003% 100.010% ( 870, 1300 ] 1 0.001% 100.011% ( 6600, 9900 ] 2 0.002% 100.013% ** Level 2 read latency histogram (micros): Count: 75928 Average: 2.0225 StdDev: 7.03 Min: 1 Median: 1.3942 Max: 1350 Percentiles: P50: 1.39 P75: 1.78 P99: 5.61 P99.9: 9.97 P99.99: 158.14 ------------------------------------------------------ [ 0, 1 ] 18796 24.755% 24.755% ##### ( 1, 2 ] 48624 64.040% 88.795% ############# ( 2, 3 ] 4795 6.315% 95.110% # ( 3, 4 ] 1879 2.475% 97.585% ( 4, 6 ] 1339 1.764% 99.348% ( 6, 10 ] 422 0.556% 99.904% ( 10, 15 ] 57 0.075% 99.979% ( 15, 22 ] 3 0.004% 99.983% ( 22, 34 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 4 0.005% 99.997% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47930 Average: 5.0458 StdDev: 127.15 Min: 0 Median: 1.6169 Max: 8643 Percentiles: P50: 1.62 P75: 2.00 P99: 6.63 P99.9: 111.40 P99.99: 6309.23 ------------------------------------------------------ [ 0, 1 ] 4695 9.796% 9.796% ## ( 1, 2 ] 31238 65.174% 74.970% ############# ( 2, 3 ] 7026 14.659% 89.629% ### ( 3, 4 ] 2509 5.235% 94.863% # ( 4, 6 ] 1928 4.023% 98.886% # ( 6, 10 ] 349 0.728% 99.614% ( 10, 15 ] 107 0.223% 99.837% ( 15, 22 ] 20 0.042% 99.879% ( 22, 34 ] 10 0.021% 99.900% ( 110, 170 ] 3 0.006% 99.906% ( 250, 380 ] 6 0.013% 99.919% ( 380, 580 ] 17 0.035% 99.954% ( 580, 870 ] 5 0.010% 99.965% ( 870, 1300 ] 2 0.004% 99.969% ( 1300, 1900 ] 2 0.004% 99.973% ( 2900, 4400 ] 3 0.006% 99.979% ( 4400, 6600 ] 6 0.013% 99.992% ( 6600, 9900 ] 8 0.017% 100.008% ** Level 4 read latency histogram (micros): Count: 35 Average: 4068.3429 StdDev: 2995.98 Min: 376 Median: 3275.0000 Max: 9677 Percentiles: P50: 3275.00 P75: 6393.75 P99: 9677.00 P99.9: 9677.00 P99.99: 9677.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 5 14.286% 17.143% ### ( 580, 870 ] 1 2.857% 20.000% # ( 870, 1300 ] 1 2.857% 22.857% # ( 1300, 1900 ] 5 14.286% 37.143% ### ( 1900, 2900 ] 4 11.429% 48.571% ## ( 2900, 4400 ] 2 5.714% 54.286% # ( 4400, 6600 ] 8 22.857% 77.143% ##### ( 6600, 9900 ] 8 22.857% 100.000% ##### ** DB Stats ** Uptime(secs): 12.6 total, 3.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 313.39 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.930 H:M:S, 15.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 305.34 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.596 H:M:S, 18.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-21:10:16 ... thread 0: (1000000,5000000) ops and (331732.2,325547.5) ops/second in (3.014480,15.358742) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/4 2.83 GB 258.0 3.2 0.0 3.2 7.9 4.7 0.0 1.7 122.9 302.5 26.65 24.98 78 0.342 3326K 3551 0.0 0.0 L1 12/0 1.35 GB 137.9 1.7 1.7 0.0 1.7 1.7 0.2 1.0 226.6 225.5 7.51 7.29 2 3.755 1728K 8542 0.0 0.0 L2 1/0 49.86 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 241.9 241.8 1.44 1.40 2 0.721 354K 183 0.0 0.0 L3 32/0 973.18 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 197.0 196.8 3.49 3.07 3 1.163 697K 591 0.0 0.0 L4 144/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1249/4 100.80 GB 0.0 5.9 2.3 3.5 10.5 7.0 0.8 2.3 153.9 276.0 39.09 36.73 85 0.460 6106K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 5.9 2.3 3.5 10.5 7.0 0.8 2.3 153.9 276.0 39.09 36.73 85 0.460 6106K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.9 2.3 3.5 5.9 2.3 0.0 0.0 237.6 237.1 25.31 24.38 19 1.332 6106K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 347.6 13.77 12.35 66 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.6 total, 15.4 interval Flush(GB): cumulative 4.676, interval 4.676 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.54 GB write, 692.62 MB/s write, 5.87 GB read, 386.10 MB/s read, 39.1 seconds Interval compaction: 10.54 GB write, 702.34 MB/s write, 5.87 GB read, 391.52 MB/s read, 39.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 18, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 18, interval: 19 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1332386 Average: 2.1740 StdDev: 12.00 Min: 1 Median: 1.4677 Max: 3971 Percentiles: P50: 1.47 P75: 1.84 P99: 5.52 P99.9: 11.00 P99.99: 87.92 ------------------------------------------------------ [ 0, 1 ] 245239 18.406% 18.406% #### ( 1, 2 ] 900035 67.551% 85.957% ############## ( 2, 3 ] 117078 8.787% 94.744% ## ( 3, 4 ] 37798 2.837% 97.581% # ( 4, 6 ] 24914 1.870% 99.450% ( 6, 10 ] 5735 0.430% 99.881% ( 10, 15 ] 1275 0.096% 99.977% ( 15, 22 ] 109 0.008% 99.985% ( 22, 34 ] 16 0.001% 99.986% ( 34, 51 ] 5 0.000% 99.986% ( 51, 76 ] 14 0.001% 99.987% ( 76, 110 ] 102 0.008% 99.995% ( 110, 170 ] 114 0.009% 100.004% ( 170, 250 ] 60 0.005% 100.008% ( 250, 380 ] 30 0.002% 100.010% ( 380, 580 ] 39 0.003% 100.013% ( 580, 870 ] 31 0.002% 100.016% ( 870, 1300 ] 21 0.002% 100.017% ( 1300, 1900 ] 6 0.000% 100.018% ( 1900, 2900 ] 4 0.000% 100.018% ( 2900, 4400 ] 9 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 92250 Average: 2.9380 StdDev: 38.00 Min: 0 Median: 1.5876 Max: 7114 Percentiles: P50: 1.59 P75: 1.97 P99: 7.11 P99.9: 95.24 P99.99: 556.58 ------------------------------------------------------ [ 0, 1 ] 11077 12.008% 12.008% ## ( 1, 2 ] 59651 64.662% 76.670% ############# ( 2, 3 ] 12595 13.653% 90.323% ### ( 3, 4 ] 4254 4.611% 94.934% # ( 4, 6 ] 3539 3.836% 98.771% # ( 6, 10 ] 760 0.824% 99.595% ( 10, 15 ] 209 0.227% 99.821% ( 15, 22 ] 11 0.012% 99.833% ( 22, 34 ] 1 0.001% 99.834% ( 34, 51 ] 6 0.007% 99.841% ( 51, 76 ] 44 0.048% 99.888% ( 76, 110 ] 19 0.021% 99.909% ( 110, 170 ] 37 0.040% 99.949% ( 170, 250 ] 12 0.013% 99.962% ( 250, 380 ] 9 0.010% 99.972% ( 380, 580 ] 19 0.021% 99.992% ( 580, 870 ] 5 0.005% 99.998% ( 870, 1300 ] 4 0.004% 100.002% ( 1300, 1900 ] 6 0.007% 100.009% ( 1900, 2900 ] 2 0.002% 100.011% ( 6600, 9900 ] 2 0.002% 100.013% ** Level 2 read latency histogram (micros): Count: 75928 Average: 2.0225 StdDev: 7.03 Min: 1 Median: 1.3942 Max: 1350 Percentiles: P50: 1.39 P75: 1.78 P99: 5.61 P99.9: 9.97 P99.99: 158.14 ------------------------------------------------------ [ 0, 1 ] 18796 24.755% 24.755% ##### ( 1, 2 ] 48624 64.040% 88.795% ############# ( 2, 3 ] 4795 6.315% 95.110% # ( 3, 4 ] 1879 2.475% 97.585% ( 4, 6 ] 1339 1.764% 99.348% ( 6, 10 ] 422 0.556% 99.904% ( 10, 15 ] 57 0.075% 99.979% ( 15, 22 ] 3 0.004% 99.983% ( 22, 34 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 4 0.005% 99.997% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47930 Average: 5.0458 StdDev: 127.15 Min: 0 Median: 1.6169 Max: 8643 Percentiles: P50: 1.62 P75: 2.00 P99: 6.63 P99.9: 111.40 P99.99: 6309.23 ------------------------------------------------------ [ 0, 1 ] 4695 9.796% 9.796% ## ( 1, 2 ] 31238 65.174% 74.970% ############# ( 2, 3 ] 7026 14.659% 89.629% ### ( 3, 4 ] 2509 5.235% 94.863% # ( 4, 6 ] 1928 4.023% 98.886% # ( 6, 10 ] 349 0.728% 99.614% ( 10, 15 ] 107 0.223% 99.837% ( 15, 22 ] 20 0.042% 99.879% ( 22, 34 ] 10 0.021% 99.900% ( 110, 170 ] 3 0.006% 99.906% ( 250, 380 ] 6 0.013% 99.919% ( 380, 580 ] 17 0.035% 99.954% ( 580, 870 ] 5 0.010% 99.965% ( 870, 1300 ] 2 0.004% 99.969% ( 1300, 1900 ] 2 0.004% 99.973% ( 2900, 4400 ] 3 0.006% 99.979% ( 4400, 6600 ] 6 0.013% 99.992% ( 6600, 9900 ] 8 0.017% 100.008% ** Level 4 read latency histogram (micros): Count: 35 Average: 4068.3429 StdDev: 2995.98 Min: 376 Median: 3275.0000 Max: 9677 Percentiles: P50: 3275.00 P75: 6393.75 P99: 9677.00 P99.9: 9677.00 P99.99: 9677.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 5 14.286% 17.143% ### ( 580, 870 ] 1 2.857% 20.000% # ( 870, 1300 ] 1 2.857% 22.857% # ( 1300, 1900 ] 5 14.286% 37.143% ### ( 1900, 2900 ] 4 11.429% 48.571% ## ( 2900, 4400 ] 2 5.714% 54.286% # ( 4400, 6600 ] 8 22.857% 77.143% ##### ( 6600, 9900 ] 8 22.857% 100.000% ##### ** DB Stats ** Uptime(secs): 15.6 total, 3.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 315.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.352 H:M:S, 15.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 326.49 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.423 H:M:S, 14.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-21:10:21 ... thread 0: (1000000,6000000) ops and (186320.1,289493.6) ops/second in (5.367108,20.725850) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/16 3.81 GB 56.6 4.3 0.0 4.3 10.0 5.7 0.0 1.8 129.9 300.4 33.95 31.91 96 0.354 4477K 4769 0.0 0.0 L1 12/12 1.35 GB 0.0 1.7 1.7 0.0 1.7 1.7 0.2 1.0 226.6 225.5 7.51 7.29 2 3.755 1728K 8542 0.0 0.0 L2 1/0 49.86 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 241.9 241.8 1.44 1.40 2 0.721 354K 183 0.0 0.0 L3 32/0 973.18 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 197.0 196.8 3.49 3.07 3 1.163 697K 591 0.0 0.0 L4 144/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1251/28 101.78 GB 0.0 7.0 2.3 4.6 12.6 8.0 0.8 2.2 154.1 278.7 46.39 43.67 103 0.450 7257K 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 7.0 2.3 4.6 12.6 8.0 0.8 2.2 154.1 278.7 46.39 43.67 103 0.450 7257K 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 7.0 2.3 4.6 7.0 2.3 0.0 0.0 240.6 240.2 29.70 28.69 23 1.291 7257K 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 347.2 16.69 14.98 80 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.9 total, 20.7 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 12.63 GB write, 617.33 MB/s write, 6.98 GB read, 341.30 MB/s read, 46.4 seconds Interval compaction: 12.63 GB write, 623.75 MB/s write, 6.98 GB read, 344.85 MB/s read, 46.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 6, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 6, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 6, total-stops: 20, interval: 26 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1755273 Average: 2.1809 StdDev: 12.18 Min: 1 Median: 1.4611 Max: 4036 Percentiles: P50: 1.46 P75: 1.83 P99: 5.48 P99.9: 11.71 P99.99: 137.59 ------------------------------------------------------ [ 0, 1 ] 326664 18.610% 18.610% #### ( 1, 2 ] 1194838 68.071% 86.682% ############## ( 2, 3 ] 146651 8.355% 95.037% ## ( 3, 4 ] 47292 2.694% 97.731% # ( 4, 6 ] 30027 1.711% 99.442% ( 6, 10 ] 7490 0.427% 99.868% ( 10, 15 ] 1628 0.093% 99.961% ( 15, 22 ] 137 0.008% 99.969% ( 22, 34 ] 18 0.001% 99.970% ( 34, 51 ] 8 0.000% 99.970% ( 51, 76 ] 20 0.001% 99.972% ( 76, 110 ] 204 0.012% 99.983% ( 110, 170 ] 262 0.015% 99.998% ( 170, 250 ] 104 0.006% 100.004% ( 250, 380 ] 45 0.003% 100.007% ( 380, 580 ] 72 0.004% 100.011% ( 580, 870 ] 42 0.002% 100.013% ( 870, 1300 ] 28 0.002% 100.015% ( 1300, 1900 ] 9 0.001% 100.015% ( 1900, 2900 ] 4 0.000% 100.015% ( 2900, 4400 ] 12 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 156978 Average: 2.6796 StdDev: 29.43 Min: 0 Median: 1.5242 Max: 7114 Percentiles: P50: 1.52 P75: 1.90 P99: 7.77 P99.9: 104.93 P99.99: 504.37 ------------------------------------------------------ [ 0, 1 ] 23895 15.222% 15.222% ### ( 1, 2 ] 104144 66.343% 81.565% ############# ( 2, 3 ] 16676 10.623% 92.188% ## ( 3, 4 ] 5639 3.592% 95.780% # ( 4, 6 ] 4264 2.716% 98.497% # ( 6, 10 ] 1782 1.135% 99.632% ( 10, 15 ] 279 0.178% 99.810% ( 15, 22 ] 16 0.010% 99.820% ( 22, 34 ] 1 0.001% 99.820% ( 34, 51 ] 7 0.004% 99.825% ( 51, 76 ] 44 0.028% 99.853% ( 76, 110 ] 87 0.055% 99.908% ( 110, 170 ] 82 0.052% 99.961% ( 170, 250 ] 21 0.013% 99.974% ( 250, 380 ] 11 0.007% 99.981% ( 380, 580 ] 23 0.015% 99.996% ( 580, 870 ] 5 0.003% 99.999% ( 870, 1300 ] 4 0.003% 100.001% ( 1300, 1900 ] 6 0.004% 100.005% ( 1900, 2900 ] 2 0.001% 100.006% ( 6600, 9900 ] 2 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 75928 Average: 2.0225 StdDev: 7.03 Min: 1 Median: 1.3942 Max: 1350 Percentiles: P50: 1.39 P75: 1.78 P99: 5.61 P99.9: 9.97 P99.99: 158.14 ------------------------------------------------------ [ 0, 1 ] 18796 24.755% 24.755% ##### ( 1, 2 ] 48624 64.040% 88.795% ############# ( 2, 3 ] 4795 6.315% 95.110% # ( 3, 4 ] 1879 2.475% 97.585% ( 4, 6 ] 1339 1.764% 99.348% ( 6, 10 ] 422 0.556% 99.904% ( 10, 15 ] 57 0.075% 99.979% ( 15, 22 ] 3 0.004% 99.983% ( 22, 34 ] 2 0.003% 99.986% ( 51, 76 ] 1 0.001% 99.987% ( 110, 170 ] 3 0.004% 99.991% ( 170, 250 ] 1 0.001% 99.992% ( 250, 380 ] 4 0.005% 99.997% ( 870, 1300 ] 1 0.001% 99.999% ( 1300, 1900 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47930 Average: 5.0458 StdDev: 127.15 Min: 0 Median: 1.6169 Max: 8643 Percentiles: P50: 1.62 P75: 2.00 P99: 6.63 P99.9: 111.40 P99.99: 6309.23 ------------------------------------------------------ [ 0, 1 ] 4695 9.796% 9.796% ## ( 1, 2 ] 31238 65.174% 74.970% ############# ( 2, 3 ] 7026 14.659% 89.629% ### ( 3, 4 ] 2509 5.235% 94.863% # ( 4, 6 ] 1928 4.023% 98.886% # ( 6, 10 ] 349 0.728% 99.614% ( 10, 15 ] 107 0.223% 99.837% ( 15, 22 ] 20 0.042% 99.879% ( 22, 34 ] 10 0.021% 99.900% ( 110, 170 ] 3 0.006% 99.906% ( 250, 380 ] 6 0.013% 99.919% ( 380, 580 ] 17 0.035% 99.954% ( 580, 870 ] 5 0.010% 99.965% ( 870, 1300 ] 2 0.004% 99.969% ( 1300, 1900 ] 2 0.004% 99.973% ( 2900, 4400 ] 3 0.006% 99.979% ( 4400, 6600 ] 6 0.013% 99.992% ( 6600, 9900 ] 8 0.017% 100.008% ** Level 4 read latency histogram (micros): Count: 35 Average: 4068.3429 StdDev: 2995.98 Min: 376 Median: 3275.0000 Max: 9677 Percentiles: P50: 3275.00 P75: 6393.75 P99: 9677.00 P99.9: 9677.00 P99.99: 9677.00 ------------------------------------------------------ ( 250, 380 ] 1 2.857% 2.857% # ( 380, 580 ] 5 14.286% 17.143% ### ( 580, 870 ] 1 2.857% 20.000% # ( 870, 1300 ] 1 2.857% 22.857% # ( 1300, 1900 ] 5 14.286% 37.143% ### ( 1900, 2900 ] 4 11.429% 48.571% ## ( 2900, 4400 ] 2 5.714% 54.286% # ( 4400, 6600 ] 8 22.857% 77.143% ##### ( 6600, 9900 ] 8 22.857% 100.000% ##### ** DB Stats ** Uptime(secs): 20.9 total, 5.4 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 281.95 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.026 H:M:S, 24.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 183.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.673 H:M:S, 49.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-21:10:46 ... thread 0: (1000000,7000000) ops and (40350.0,153815.7) ops/second in (24.783157,45.509007) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 1.54 GB 44.0 4.7 0.0 4.7 11.3 6.6 0.0 1.7 115.5 279.5 41.45 36.27 109 0.380 4861K 5339 0.0 0.0 L1 5/5 493.53 MB 0.0 6.3 4.9 1.3 6.2 4.8 0.2 1.3 210.7 207.2 30.45 27.93 3 10.149 6515K 108K 0.0 0.0 L2 9/7 1.05 GB 2.6 0.3 0.2 0.2 0.3 0.2 4.4 1.8 241.9 241.8 1.44 1.40 2 0.721 354K 183 0.0 0.0 L3 24/9 1.66 GB 0.9 2.1 1.6 0.5 2.1 1.6 1.9 1.3 139.1 138.9 15.41 10.04 12 1.284 2112K 1247 0.0 0.0 L4 145/0 9.40 GB 1.0 2.2 1.9 0.3 2.2 1.9 0.6 1.1 123.8 123.3 18.00 10.76 19 0.947 2247K 8098 0.0 0.0 L5 1076/0 88.52 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1270/30 102.66 GB 0.0 15.6 8.6 6.9 22.1 15.2 9.7 3.3 149.2 211.7 106.74 86.39 145 0.736 16M 123K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.6 8.6 6.9 22.1 15.2 9.7 3.3 149.2 211.7 106.74 86.39 145 0.736 16M 123K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.6 8.6 6.9 15.4 8.5 0.0 0.0 188.8 187.3 84.34 68.61 53 1.591 16M 123K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 303.7 22.40 17.78 92 0.244 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.7 total, 45.5 interval Flush(GB): cumulative 6.644, interval 6.644 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.07 GB write, 494.29 MB/s write, 15.55 GB read, 348.27 MB/s read, 106.7 seconds Interval compaction: 22.07 GB write, 496.63 MB/s write, 15.55 GB read, 349.92 MB/s read, 106.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 55, interval: 67 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2726894 Average: 3.1511 StdDev: 31.39 Min: 1 Median: 1.4683 Max: 7758 Percentiles: P50: 1.47 P75: 1.85 P99: 8.38 P99.9: 165.09 P99.99: 583.27 ------------------------------------------------------ [ 0, 1 ] 528914 19.396% 19.396% #### ( 1, 2 ] 1781906 65.346% 84.742% ############# ( 2, 3 ] 224294 8.225% 92.967% ## ( 3, 4 ] 84211 3.088% 96.055% # ( 4, 6 ] 67360 2.470% 98.525% ( 6, 10 ] 21749 0.798% 99.323% ( 10, 15 ] 4192 0.154% 99.477% ( 15, 22 ] 547 0.020% 99.497% ( 22, 34 ] 47 0.002% 99.499% ( 34, 51 ] 9 0.000% 99.499% ( 51, 76 ] 23 0.001% 99.500% ( 76, 110 ] 4976 0.182% 99.682% ( 110, 170 ] 6468 0.237% 99.919% ( 170, 250 ] 799 0.029% 99.949% ( 250, 380 ] 565 0.021% 99.969% ( 380, 580 ] 558 0.020% 99.990% ( 580, 870 ] 294 0.011% 100.001% ( 870, 1300 ] 115 0.004% 100.005% ( 1300, 1900 ] 65 0.002% 100.007% ( 1900, 2900 ] 57 0.002% 100.009% ( 2900, 4400 ] 91 0.003% 100.013% ( 4400, 6600 ] 9 0.000% 100.013% ( 6600, 9900 ] 4 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 1209981 Average: 6.3638 StdDev: 103.62 Min: 0 Median: 1.7574 Max: 11780 Percentiles: P50: 1.76 P75: 2.66 P99: 9.77 P99.9: 155.45 P99.99: 556.59 ------------------------------------------------------ [ 0, 1 ] 125515 10.373% 10.373% ## ( 1, 2 ] 633036 52.318% 62.691% ########## ( 2, 3 ] 224281 18.536% 81.227% #### ( 3, 4 ] 91469 7.560% 88.787% ## ( 4, 6 ] 100114 8.274% 97.061% ## ( 6, 10 ] 24912 2.059% 99.119% ( 10, 15 ] 6569 0.543% 99.662% ( 15, 22 ] 783 0.065% 99.727% ( 22, 34 ] 43 0.004% 99.731% ( 34, 51 ] 19 0.002% 99.732% ( 51, 76 ] 60 0.005% 99.737% ( 76, 110 ] 1162 0.096% 99.833% ( 110, 170 ] 1068 0.088% 99.921% ( 170, 250 ] 217 0.018% 99.939% ( 250, 380 ] 266 0.022% 99.961% ( 380, 580 ] 393 0.032% 99.994% ( 580, 870 ] 389 0.032% 100.026% ( 870, 1300 ] 331 0.027% 100.053% ( 1300, 1900 ] 216 0.018% 100.071% ( 1900, 2900 ] 303 0.025% 100.096% ( 2900, 4400 ] 398 0.033% 100.129% ( 4400, 6600 ] 97 0.008% 100.137% ( 6600, 9900 ] 33 0.003% 100.140% ( 9900, 14000 ] 3 0.000% 100.140% ** Level 2 read latency histogram (micros): Count: 87312 Average: 4.0037 StdDev: 75.11 Min: 1 Median: 1.4391 Max: 7333 Percentiles: P50: 1.44 P75: 1.83 P99: 6.00 P99.9: 446.92 P99.99: 4000.23 ------------------------------------------------------ [ 0, 1 ] 19259 22.058% 22.058% #### ( 1, 2 ] 55565 63.640% 85.697% ############# ( 2, 3 ] 6925 7.931% 93.629% ## ( 3, 4 ] 2630 3.012% 96.641% # ( 4, 6 ] 2062 2.362% 99.002% ( 6, 10 ] 654 0.749% 99.751% ( 10, 15 ] 98 0.112% 99.864% ( 15, 22 ] 5 0.006% 99.869% ( 22, 34 ] 2 0.002% 99.872% ( 51, 76 ] 1 0.001% 99.873% ( 76, 110 ] 1 0.001% 99.874% ( 110, 170 ] 4 0.005% 99.879% ( 170, 250 ] 1 0.001% 99.880% ( 250, 380 ] 13 0.015% 99.895% ( 380, 580 ] 17 0.019% 99.914% ( 580, 870 ] 18 0.021% 99.935% ( 870, 1300 ] 12 0.014% 99.948% ( 1300, 1900 ] 12 0.014% 99.962% ( 1900, 2900 ] 15 0.017% 99.979% ( 2900, 4400 ] 14 0.016% 99.995% ( 4400, 6600 ] 3 0.003% 99.999% ( 6600, 9900 ] 2 0.002% 100.001% ** Level 3 read latency histogram (micros): Count: 576724 Average: 10.1834 StdDev: 135.60 Min: 0 Median: 1.9745 Max: 9312 Percentiles: P50: 1.97 P75: 2.99 P99: 11.35 P99.9: 815.58 P99.99: 1231.73 ------------------------------------------------------ [ 0, 1 ] 14711 2.551% 2.551% # ( 1, 2 ] 280811 48.691% 51.241% ########## ( 2, 3 ] 138234 23.969% 75.210% ##### ( 3, 4 ] 58790 10.194% 85.404% ## ( 4, 6 ] 65088 11.286% 96.690% ## ( 6, 10 ] 12357 2.143% 98.833% ( 10, 15 ] 3575 0.620% 99.452% ( 15, 22 ] 420 0.073% 99.525% ( 22, 34 ] 36 0.006% 99.531% ( 34, 51 ] 14 0.002% 99.534% ( 51, 76 ] 6 0.001% 99.535% ( 76, 110 ] 22 0.004% 99.539% ( 110, 170 ] 144 0.025% 99.564% ( 170, 250 ] 242 0.042% 99.606% ( 250, 380 ] 468 0.081% 99.687% ( 380, 580 ] 672 0.117% 99.803% ( 580, 870 ] 686 0.119% 99.922% ( 870, 1300 ] 464 0.080% 100.003% ( 1300, 1900 ] 276 0.048% 100.051% ( 1900, 2900 ] 213 0.037% 100.088% ( 2900, 4400 ] 309 0.054% 100.141% ( 4400, 6600 ] 85 0.015% 100.156% ( 6600, 9900 ] 23 0.004% 100.160% ** Level 4 read latency histogram (micros): Count: 12690 Average: 19.7844 StdDev: 286.60 Min: 1 Median: 2.0707 Max: 9677 Percentiles: P50: 2.07 P75: 3.04 P99: 14.91 P99.9: 5568.20 P99.99: 9376.54 ------------------------------------------------------ [ 0, 1 ] 196 1.545% 1.545% ( 1, 2 ] 5912 46.588% 48.132% ######### ( 2, 3 ] 3351 26.407% 74.539% ##### ( 3, 4 ] 1310 10.323% 84.862% ## ( 4, 6 ] 1489 11.734% 96.596% ## ( 6, 10 ] 256 2.017% 98.613% ( 10, 15 ] 50 0.394% 99.007% ( 15, 22 ] 7 0.055% 99.062% ( 22, 34 ] 3 0.024% 99.086% ( 34, 51 ] 2 0.016% 99.102% ( 51, 76 ] 5 0.039% 99.141% ( 110, 170 ] 7 0.055% 99.196% ( 170, 250 ] 28 0.221% 99.417% ( 250, 380 ] 4 0.032% 99.448% ( 380, 580 ] 5 0.039% 99.488% ( 580, 870 ] 9 0.071% 99.559% ( 870, 1300 ] 9 0.071% 99.630% ( 1300, 1900 ] 13 0.102% 99.732% ( 1900, 2900 ] 12 0.095% 99.827% ( 2900, 4400 ] 4 0.032% 99.858% ( 4400, 6600 ] 10 0.079% 99.937% ( 6600, 9900 ] 8 0.063% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 1910.2875 StdDev: 1846.62 Min: 107 Median: 1146.4286 Max: 8449 Percentiles: P50: 1146.43 P75: 2965.22 P99: 8449.00 P99.9: 8449.00 P99.99: 8449.00 ------------------------------------------------------ ( 76, 110 ] 1 0.625% 0.625% ( 110, 170 ] 6 3.750% 4.375% # ( 170, 250 ] 7 4.375% 8.750% # ( 250, 380 ] 17 10.625% 19.375% ## ( 380, 580 ] 19 11.875% 31.250% ## ( 580, 870 ] 21 13.125% 44.375% ### ( 870, 1300 ] 14 8.750% 53.125% ## ( 1300, 1900 ] 18 11.250% 64.375% ## ( 1900, 2900 ] 16 10.000% 74.375% ## ( 2900, 4400 ] 23 14.375% 88.750% ### ( 4400, 6600 ] 13 8.125% 96.875% ## ( 6600, 9900 ] 5 3.125% 100.000% # ** DB Stats ** Uptime(secs): 45.7 total, 24.8 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 150.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.187 H:M:S, 57.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 39.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:21.161 H:M:S, 85.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/12/14-21:10:50 ... thread 0: (1000000,8000000) ops and (294535.4,163585.2) ops/second in (3.395178,48.904185) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/7 1.72 GB 18.9 5.6 0.0 5.6 13.2 7.6 0.0 1.7 118.8 279.2 48.26 42.60 124 0.389 5820K 6471 0.0 0.0 L1 16/16 1.21 GB 0.0 7.5 5.7 1.8 7.4 5.5 0.2 1.3 198.5 195.5 38.61 33.95 4 9.654 7282K 108K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.4 1.8 241.9 241.8 1.44 1.40 2 0.721 354K 183 0.0 0.0 L3 16/0 953.84 MB 1.0 4.0 2.7 1.3 4.0 2.7 1.9 1.5 141.1 140.7 28.88 18.78 16 1.805 3026K 2584 0.0 0.0 L4 157/0 9.58 GB 1.0 2.4 2.2 0.3 2.4 2.1 2.1 1.1 129.4 128.9 19.14 11.85 21 0.911 2499K 8098 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1294/23 103.57 GB 0.0 19.8 10.7 9.2 27.3 18.1 12.8 3.6 148.9 204.7 136.33 108.58 167 0.816 18M 125K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.8 10.7 9.2 27.3 18.1 12.8 3.6 148.9 204.7 136.33 108.58 167 0.816 18M 125K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.8 10.7 9.2 19.7 10.5 0.0 0.0 182.9 181.6 110.98 88.22 63 1.762 18M 125K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 305.6 25.35 20.35 104 0.244 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.1 total, 48.9 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.25 GB write, 568.09 MB/s write, 19.82 GB read, 413.20 MB/s read, 136.3 seconds Interval compaction: 27.25 GB write, 570.59 MB/s write, 19.82 GB read, 415.02 MB/s read, 136.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 67, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 67, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2993845 Average: 3.1163 StdDev: 30.28 Min: 1 Median: 1.4848 Max: 7758 Percentiles: P50: 1.48 P75: 1.87 P99: 8.21 P99.9: 162.96 P99.99: 548.05 ------------------------------------------------------ [ 0, 1 ] 553302 18.481% 18.481% #### ( 1, 2 ] 1946297 65.010% 83.491% ############# ( 2, 3 ] 267832 8.946% 92.437% ## ( 3, 4 ] 100095 3.343% 95.781% # ( 4, 6 ] 83003 2.772% 98.553% # ( 6, 10 ] 24225 0.809% 99.362% ( 10, 15 ] 4691 0.157% 99.519% ( 15, 22 ] 584 0.020% 99.539% ( 22, 34 ] 49 0.002% 99.540% ( 34, 51 ] 9 0.000% 99.540% ( 51, 76 ] 26 0.001% 99.541% ( 76, 110 ] 4981 0.166% 99.708% ( 110, 170 ] 6524 0.218% 99.926% ( 170, 250 ] 834 0.028% 99.953% ( 250, 380 ] 593 0.020% 99.973% ( 380, 580 ] 597 0.020% 99.993% ( 580, 870 ] 320 0.011% 100.004% ( 870, 1300 ] 126 0.004% 100.008% ( 1300, 1900 ] 69 0.002% 100.010% ( 1900, 2900 ] 57 0.002% 100.012% ( 2900, 4400 ] 92 0.003% 100.015% ( 4400, 6600 ] 9 0.000% 100.016% ( 6600, 9900 ] 4 0.000% 100.016% ** Level 1 read latency histogram (micros): Count: 1424097 Average: 5.9639 StdDev: 96.02 Min: 0 Median: 1.7674 Max: 11780 Percentiles: P50: 1.77 P75: 2.66 P99: 9.73 P99.9: 157.50 P99.99: 541.75 ------------------------------------------------------ [ 0, 1 ] 132677 9.317% 9.317% ## ( 1, 2 ] 754950 53.013% 62.329% ########### ( 2, 3 ] 273825 19.228% 81.557% #### ( 3, 4 ] 105172 7.385% 88.942% # ( 4, 6 ] 115685 8.123% 97.066% ## ( 6, 10 ] 29578 2.077% 99.143% ( 10, 15 ] 7621 0.535% 99.678% ( 15, 22 ] 855 0.060% 99.738% ( 22, 34 ] 48 0.003% 99.741% ( 34, 51 ] 20 0.001% 99.743% ( 51, 76 ] 60 0.004% 99.747% ( 76, 110 ] 1225 0.086% 99.833% ( 110, 170 ] 1210 0.085% 99.918% ( 170, 250 ] 293 0.021% 99.938% ( 250, 380 ] 350 0.025% 99.963% ( 380, 580 ] 478 0.034% 99.996% ( 580, 870 ] 449 0.032% 100.028% ( 870, 1300 ] 359 0.025% 100.053% ( 1300, 1900 ] 225 0.016% 100.069% ( 1900, 2900 ] 307 0.022% 100.091% ( 2900, 4400 ] 398 0.028% 100.119% ( 4400, 6600 ] 97 0.007% 100.125% ( 6600, 9900 ] 33 0.002% 100.128% ( 9900, 14000 ] 3 0.000% 100.128% ** Level 2 read latency histogram (micros): Count: 88591 Average: 3.9867 StdDev: 74.57 Min: 1 Median: 1.4444 Max: 7333 Percentiles: P50: 1.44 P75: 1.84 P99: 6.10 P99.9: 431.87 P99.99: 3986.52 ------------------------------------------------------ [ 0, 1 ] 19312 21.799% 21.799% #### ( 1, 2 ] 56218 63.458% 85.257% ############# ( 2, 3 ] 7292 8.231% 93.488% ## ( 3, 4 ] 2707 3.056% 96.544% # ( 4, 6 ] 2159 2.437% 98.981% ( 6, 10 ] 673 0.760% 99.740% ( 10, 15 ] 109 0.123% 99.863% ( 15, 22 ] 5 0.006% 99.869% ( 22, 34 ] 3 0.003% 99.872% ( 51, 76 ] 1 0.001% 99.874% ( 76, 110 ] 1 0.001% 99.875% ( 110, 170 ] 4 0.005% 99.879% ( 170, 250 ] 1 0.001% 99.880% ( 250, 380 ] 13 0.015% 99.895% ( 380, 580 ] 17 0.019% 99.914% ( 580, 870 ] 18 0.020% 99.935% ( 870, 1300 ] 12 0.014% 99.948% ( 1300, 1900 ] 12 0.014% 99.962% ( 1900, 2900 ] 15 0.017% 99.979% ( 2900, 4400 ] 14 0.016% 99.994% ( 4400, 6600 ] 3 0.003% 99.998% ( 6600, 9900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 659434 Average: 9.3618 StdDev: 127.30 Min: 0 Median: 1.9527 Max: 9312 Percentiles: P50: 1.95 P75: 2.95 P99: 10.61 P99.9: 783.56 P99.99: 1214.59 ------------------------------------------------------ [ 0, 1 ] 16196 2.456% 2.456% ( 1, 2 ] 329096 49.906% 52.362% ########## ( 2, 3 ] 157841 23.936% 76.298% ##### ( 3, 4 ] 64722 9.815% 86.112% ## ( 4, 6 ] 71223 10.801% 96.913% ## ( 6, 10 ] 13304 2.017% 98.931% ( 10, 15 ] 3755 0.569% 99.500% ( 15, 22 ] 432 0.066% 99.566% ( 22, 34 ] 37 0.006% 99.571% ( 34, 51 ] 14 0.002% 99.573% ( 51, 76 ] 6 0.001% 99.574% ( 76, 110 ] 26 0.004% 99.578% ( 110, 170 ] 161 0.024% 99.603% ( 170, 250 ] 272 0.041% 99.644% ( 250, 380 ] 497 0.075% 99.719% ( 380, 580 ] 697 0.106% 99.825% ( 580, 870 ] 706 0.107% 99.932% ( 870, 1300 ] 478 0.072% 100.004% ( 1300, 1900 ] 283 0.043% 100.047% ( 1900, 2900 ] 215 0.033% 100.080% ( 2900, 4400 ] 310 0.047% 100.127% ( 4400, 6600 ] 85 0.013% 100.140% ( 6600, 9900 ] 23 0.003% 100.143% ** Level 4 read latency histogram (micros): Count: 12715 Average: 19.9671 StdDev: 286.47 Min: 1 Median: 2.0717 Max: 9677 Percentiles: P50: 2.07 P75: 3.05 P99: 25.40 P99.9: 5562.70 P99.99: 9375.51 ------------------------------------------------------ [ 0, 1 ] 201 1.581% 1.581% ( 1, 2 ] 5916 46.528% 48.109% ######### ( 2, 3 ] 3356 26.394% 74.503% ##### ( 3, 4 ] 1310 10.303% 84.805% ## ( 4, 6 ] 1490 11.718% 96.524% ## ( 6, 10 ] 256 2.013% 98.537% ( 10, 15 ] 50 0.393% 98.930% ( 15, 22 ] 8 0.063% 98.993% ( 22, 34 ] 3 0.024% 99.017% ( 34, 51 ] 2 0.016% 99.033% ( 51, 76 ] 6 0.047% 99.080% ( 110, 170 ] 8 0.063% 99.143% ( 170, 250 ] 31 0.244% 99.387% ( 250, 380 ] 5 0.039% 99.426% ( 380, 580 ] 7 0.055% 99.481% ( 580, 870 ] 10 0.079% 99.560% ( 870, 1300 ] 9 0.071% 99.630% ( 1300, 1900 ] 13 0.102% 99.733% ( 1900, 2900 ] 12 0.094% 99.827% ( 2900, 4400 ] 4 0.031% 99.858% ( 4400, 6600 ] 10 0.079% 99.937% ( 6600, 9900 ] 8 0.063% 100.000% ** Level 5 read latency histogram (micros): Count: 260 Average: 1511.3077 StdDev: 1670.16 Min: 82 Median: 766.4286 Max: 8449 Percentiles: P50: 766.43 P75: 2260.00 P99: 8184.00 P99.9: 8449.00 P99.99: 8449.00 ------------------------------------------------------ ( 76, 110 ] 8 3.077% 3.077% # ( 110, 170 ] 36 13.846% 16.923% ### ( 170, 250 ] 19 7.308% 24.231% # ( 250, 380 ] 23 8.846% 33.077% ## ( 380, 580 ] 26 10.000% 43.077% ## ( 580, 870 ] 28 10.769% 53.846% ## ( 870, 1300 ] 19 7.308% 61.154% # ( 1300, 1900 ] 27 10.385% 71.538% ## ( 1900, 2900 ] 25 9.615% 81.154% ## ( 2900, 4400 ] 30 11.538% 92.692% ## ( 4400, 6600 ] 14 5.385% 98.077% # ( 6600, 9900 ] 5 1.923% 100.000% ** DB Stats ** Uptime(secs): 49.1 total, 3.4 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 160.29 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:26.918 H:M:S, 54.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 289.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.731 H:M:S, 21.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/14-21:10:53 ... thread 0: (1000000,9000000) ops and (330033.4,173296.3) ops/second in (3.029996,51.934181) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/11 2.64 GB 81.8 6.2 0.0 6.2 14.7 8.5 0.0 1.7 118.8 281.0 53.56 47.55 139 0.385 6460K 7218 0.0 0.0 L1 16/16 1.21 GB 0.0 7.5 5.7 1.8 7.4 5.5 0.2 1.3 198.5 195.5 38.61 33.95 4 9.654 7282K 108K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.4 1.8 241.9 241.8 1.44 1.40 2 0.721 354K 183 0.0 0.0 L3 16/0 953.84 MB 1.0 4.0 2.7 1.3 4.0 2.7 1.9 1.5 141.1 140.7 28.88 18.78 16 1.805 3026K 2584 0.0 0.0 L4 157/0 9.58 GB 1.0 2.4 2.2 0.3 2.4 2.1 2.1 1.1 129.4 128.9 19.14 11.85 21 0.911 2499K 8098 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1301/27 104.49 GB 0.0 20.4 10.7 9.8 28.8 19.0 12.8 3.4 147.8 208.1 141.64 113.53 182 0.778 19M 126K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.4 10.7 9.8 28.8 19.0 12.8 3.4 147.8 208.1 141.64 113.53 182 0.778 19M 126K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.4 10.7 9.8 20.3 10.5 0.0 0.0 184.4 183.2 113.47 90.68 65 1.746 19M 126K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.5 8.5 0.0 0.0 0.0 308.7 28.16 22.85 117 0.241 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 52.2 total, 51.9 interval Flush(GB): cumulative 8.490, interval 8.490 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.79 GB write, 565.26 MB/s write, 20.44 GB read, 401.27 MB/s read, 141.6 seconds Interval compaction: 28.79 GB write, 567.61 MB/s write, 20.44 GB read, 402.93 MB/s read, 141.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 9, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 9, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 70, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 70, interval: 82 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3311834 Average: 3.0326 StdDev: 29.00 Min: 1 Median: 1.4904 Max: 7758 Percentiles: P50: 1.49 P75: 1.87 P99: 7.84 P99.9: 159.27 P99.99: 504.19 ------------------------------------------------------ [ 0, 1 ] 593700 17.927% 17.927% #### ( 1, 2 ] 2165921 65.399% 83.326% ############# ( 2, 3 ] 306319 9.249% 92.575% ## ( 3, 4 ] 110293 3.330% 95.906% # ( 4, 6 ] 90647 2.737% 98.643% # ( 6, 10 ] 25683 0.775% 99.418% ( 10, 15 ] 4927 0.149% 99.567% ( 15, 22 ] 601 0.018% 99.585% ( 22, 34 ] 50 0.002% 99.587% ( 34, 51 ] 9 0.000% 99.587% ( 51, 76 ] 27 0.001% 99.588% ( 76, 110 ] 4986 0.151% 99.738% ( 110, 170 ] 6526 0.197% 99.935% ( 170, 250 ] 843 0.025% 99.961% ( 250, 380 ] 597 0.018% 99.979% ( 380, 580 ] 602 0.018% 99.997% ( 580, 870 ] 323 0.010% 100.007% ( 870, 1300 ] 133 0.004% 100.011% ( 1300, 1900 ] 70 0.002% 100.013% ( 1900, 2900 ] 57 0.002% 100.014% ( 2900, 4400 ] 94 0.003% 100.017% ( 4400, 6600 ] 9 0.000% 100.018% ( 6600, 9900 ] 4 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 1476649 Average: 5.8561 StdDev: 94.33 Min: 0 Median: 1.7588 Max: 11780 Percentiles: P50: 1.76 P75: 2.64 P99: 9.70 P99.9: 158.51 P99.99: 541.61 ------------------------------------------------------ [ 0, 1 ] 138198 9.359% 9.359% ## ( 1, 2 ] 790902 53.561% 62.919% ########### ( 2, 3 ] 280839 19.019% 81.938% #### ( 3, 4 ] 106738 7.228% 89.167% # ( 4, 6 ] 116989 7.923% 97.089% ## ( 6, 10 ] 30477 2.064% 99.153% ( 10, 15 ] 7717 0.523% 99.676% ( 15, 22 ] 861 0.058% 99.734% ( 22, 34 ] 48 0.003% 99.737% ( 34, 51 ] 20 0.001% 99.739% ( 51, 76 ] 61 0.004% 99.743% ( 76, 110 ] 1273 0.086% 99.829% ( 110, 170 ] 1298 0.088% 99.917% ( 170, 250 ] 322 0.022% 99.939% ( 250, 380 ] 364 0.025% 99.963% ( 380, 580 ] 488 0.033% 99.996% ( 580, 870 ] 451 0.031% 100.027% ( 870, 1300 ] 360 0.024% 100.051% ( 1300, 1900 ] 225 0.015% 100.067% ( 1900, 2900 ] 307 0.021% 100.087% ( 2900, 4400 ] 398 0.027% 100.114% ( 4400, 6600 ] 97 0.007% 100.121% ( 6600, 9900 ] 33 0.002% 100.123% ( 9900, 14000 ] 3 0.000% 100.123% ** Level 2 read latency histogram (micros): Count: 88591 Average: 3.9867 StdDev: 74.57 Min: 1 Median: 1.4444 Max: 7333 Percentiles: P50: 1.44 P75: 1.84 P99: 6.10 P99.9: 431.87 P99.99: 3986.52 ------------------------------------------------------ [ 0, 1 ] 19312 21.799% 21.799% #### ( 1, 2 ] 56218 63.458% 85.257% ############# ( 2, 3 ] 7292 8.231% 93.488% ## ( 3, 4 ] 2707 3.056% 96.544% # ( 4, 6 ] 2159 2.437% 98.981% ( 6, 10 ] 673 0.760% 99.740% ( 10, 15 ] 109 0.123% 99.863% ( 15, 22 ] 5 0.006% 99.869% ( 22, 34 ] 3 0.003% 99.872% ( 51, 76 ] 1 0.001% 99.874% ( 76, 110 ] 1 0.001% 99.875% ( 110, 170 ] 4 0.005% 99.879% ( 170, 250 ] 1 0.001% 99.880% ( 250, 380 ] 13 0.015% 99.895% ( 380, 580 ] 17 0.019% 99.914% ( 580, 870 ] 18 0.020% 99.935% ( 870, 1300 ] 12 0.014% 99.948% ( 1300, 1900 ] 12 0.014% 99.962% ( 1900, 2900 ] 15 0.017% 99.979% ( 2900, 4400 ] 14 0.016% 99.994% ( 4400, 6600 ] 3 0.003% 99.998% ( 6600, 9900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 659434 Average: 9.3618 StdDev: 127.30 Min: 0 Median: 1.9527 Max: 9312 Percentiles: P50: 1.95 P75: 2.95 P99: 10.61 P99.9: 783.56 P99.99: 1214.59 ------------------------------------------------------ [ 0, 1 ] 16196 2.456% 2.456% ( 1, 2 ] 329096 49.906% 52.362% ########## ( 2, 3 ] 157841 23.936% 76.298% ##### ( 3, 4 ] 64722 9.815% 86.112% ## ( 4, 6 ] 71223 10.801% 96.913% ## ( 6, 10 ] 13304 2.017% 98.931% ( 10, 15 ] 3755 0.569% 99.500% ( 15, 22 ] 432 0.066% 99.566% ( 22, 34 ] 37 0.006% 99.571% ( 34, 51 ] 14 0.002% 99.573% ( 51, 76 ] 6 0.001% 99.574% ( 76, 110 ] 26 0.004% 99.578% ( 110, 170 ] 161 0.024% 99.603% ( 170, 250 ] 272 0.041% 99.644% ( 250, 380 ] 497 0.075% 99.719% ( 380, 580 ] 697 0.106% 99.825% ( 580, 870 ] 706 0.107% 99.932% ( 870, 1300 ] 478 0.072% 100.004% ( 1300, 1900 ] 283 0.043% 100.047% ( 1900, 2900 ] 215 0.033% 100.080% ( 2900, 4400 ] 310 0.047% 100.127% ( 4400, 6600 ] 85 0.013% 100.140% ( 6600, 9900 ] 23 0.003% 100.143% ** Level 4 read latency histogram (micros): Count: 12715 Average: 19.9671 StdDev: 286.47 Min: 1 Median: 2.0717 Max: 9677 Percentiles: P50: 2.07 P75: 3.05 P99: 25.40 P99.9: 5562.70 P99.99: 9375.51 ------------------------------------------------------ [ 0, 1 ] 201 1.581% 1.581% ( 1, 2 ] 5916 46.528% 48.109% ######### ( 2, 3 ] 3356 26.394% 74.503% ##### ( 3, 4 ] 1310 10.303% 84.805% ## ( 4, 6 ] 1490 11.718% 96.524% ## ( 6, 10 ] 256 2.013% 98.537% ( 10, 15 ] 50 0.393% 98.930% ( 15, 22 ] 8 0.063% 98.993% ( 22, 34 ] 3 0.024% 99.017% ( 34, 51 ] 2 0.016% 99.033% ( 51, 76 ] 6 0.047% 99.080% ( 110, 170 ] 8 0.063% 99.143% ( 170, 250 ] 31 0.244% 99.387% ( 250, 380 ] 5 0.039% 99.426% ( 380, 580 ] 7 0.055% 99.481% ( 580, 870 ] 10 0.079% 99.560% ( 870, 1300 ] 9 0.071% 99.630% ( 1300, 1900 ] 13 0.102% 99.733% ( 1900, 2900 ] 12 0.094% 99.827% ( 2900, 4400 ] 4 0.031% 99.858% ( 4400, 6600 ] 10 0.079% 99.937% ( 6600, 9900 ] 8 0.063% 100.000% ** Level 5 read latency histogram (micros): Count: 260 Average: 1511.3077 StdDev: 1670.16 Min: 82 Median: 766.4286 Max: 8449 Percentiles: P50: 766.43 P75: 2260.00 P99: 8184.00 P99.9: 8449.00 P99.99: 8449.00 ------------------------------------------------------ ( 76, 110 ] 8 3.077% 3.077% # ( 110, 170 ] 36 13.846% 16.923% ### ( 170, 250 ] 19 7.308% 24.231% # ( 250, 380 ] 23 8.846% 33.077% ## ( 380, 580 ] 26 10.000% 43.077% ## ( 580, 870 ] 28 10.769% 53.846% ## ( 870, 1300 ] 19 7.308% 61.154% # ( 1300, 1900 ] 27 10.385% 71.538% ## ( 1900, 2900 ] 25 9.615% 81.154% ## ( 2900, 4400 ] 30 11.538% 92.692% ## ( 4400, 6600 ] 14 5.385% 98.077% # ( 6600, 9900 ] 5 1.923% 100.000% ** DB Stats ** Uptime(secs): 52.2 total, 3.0 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 169.84 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:27.363 H:M:S, 52.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.81 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.445 H:M:S, 14.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/14-21:10:56 ... thread 0: (1000000,10000000) ops and (275327.7,179965.5) ops/second in (3.632036,55.566217) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/7 3.69 GB 220.3 7.3 0.0 7.3 16.8 9.5 0.0 1.8 122.1 282.2 60.90 54.51 157 0.388 7547K 8399 0.0 0.0 L1 16/16 1.21 GB 0.0 7.5 5.7 1.8 7.4 5.5 0.2 1.3 198.5 195.5 38.61 33.95 4 9.654 7282K 108K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 4.4 1.8 241.9 241.8 1.44 1.40 2 0.721 354K 183 0.0 0.0 L3 16/0 953.84 MB 1.0 4.0 2.7 1.3 4.0 2.7 1.9 1.5 141.1 140.7 28.88 18.78 16 1.805 3026K 2584 0.0 0.0 L4 157/0 9.58 GB 1.0 2.4 2.2 0.3 2.4 2.1 2.1 1.1 129.4 128.9 19.14 11.85 21 0.911 2499K 8098 0.0 0.0 L5 1096/0 90.12 GB 0.9 0.0 0.0 0.0 0.0 0.0 4.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1303/23 105.53 GB 0.0 21.5 10.7 10.8 30.9 20.1 12.8 3.2 147.7 212.2 148.98 120.48 200 0.745 20M 127K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.5 10.7 10.8 30.9 20.1 12.8 3.2 147.7 212.2 148.98 120.48 200 0.745 20M 127K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.5 10.7 10.8 21.3 10.5 0.0 0.0 186.9 185.7 117.68 94.81 69 1.706 20M 127K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 9.5 9.5 0.0 0.0 0.0 312.0 31.30 25.67 131 0.239 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.8 total, 55.6 interval Flush(GB): cumulative 9.535, interval 9.535 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.88 GB write, 566.83 MB/s write, 21.48 GB read, 394.34 MB/s read, 149.0 seconds Interval compaction: 30.88 GB write, 569.03 MB/s write, 21.48 GB read, 395.87 MB/s read, 149.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 74, pending-compaction-bytes-delays: 3, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 74, interval: 88 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3666381 Average: 2.9686 StdDev: 27.92 Min: 0 Median: 1.4946 Max: 7758 Percentiles: P50: 1.49 P75: 1.87 P99: 7.61 P99.9: 156.07 P99.99: 467.90 ------------------------------------------------------ [ 0, 1 ] 641144 17.487% 17.487% ### ( 1, 2 ] 2409973 65.732% 83.219% ############# ( 2, 3 ] 346789 9.459% 92.677% ## ( 3, 4 ] 121375 3.310% 95.988% # ( 4, 6 ] 99090 2.703% 98.691% # ( 6, 10 ] 28258 0.771% 99.461% ( 10, 15 ] 5283 0.144% 99.605% ( 15, 22 ] 621 0.017% 99.622% ( 22, 34 ] 56 0.002% 99.624% ( 34, 51 ] 10 0.000% 99.624% ( 51, 76 ] 32 0.001% 99.625% ( 76, 110 ] 5018 0.137% 99.762% ( 110, 170 ] 6597 0.180% 99.942% ( 170, 250 ] 879 0.024% 99.966% ( 250, 380 ] 616 0.017% 99.983% ( 380, 580 ] 622 0.017% 100.000% ( 580, 870 ] 333 0.009% 100.009% ( 870, 1300 ] 142 0.004% 100.012% ( 1300, 1900 ] 74 0.002% 100.014% ( 1900, 2900 ] 59 0.002% 100.016% ( 2900, 4400 ] 96 0.003% 100.019% ( 4400, 6600 ] 9 0.000% 100.019% ( 6600, 9900 ] 4 0.000% 100.019% ** Level 1 read latency histogram (micros): Count: 1539835 Average: 5.7412 StdDev: 92.42 Min: 0 Median: 1.7480 Max: 11780 Percentiles: P50: 1.75 P75: 2.61 P99: 9.69 P99.9: 159.60 P99.99: 542.01 ------------------------------------------------------ [ 0, 1 ] 146335 9.503% 9.503% ## ( 1, 2 ] 833625 54.137% 63.641% ########### ( 2, 3 ] 288404 18.730% 82.370% #### ( 3, 4 ] 108500 7.046% 89.416% # ( 4, 6 ] 118479 7.694% 97.111% ## ( 6, 10 ] 31548 2.049% 99.159% ( 10, 15 ] 7828 0.508% 99.668% ( 15, 22 ] 866 0.056% 99.724% ( 22, 34 ] 49 0.003% 99.727% ( 34, 51 ] 20 0.001% 99.728% ( 51, 76 ] 62 0.004% 99.733% ( 76, 110 ] 1402 0.091% 99.824% ( 110, 170 ] 1424 0.092% 99.916% ( 170, 250 ] 348 0.023% 99.939% ( 250, 380 ] 386 0.025% 99.964% ( 380, 580 ] 500 0.032% 99.996% ( 580, 870 ] 455 0.030% 100.026% ( 870, 1300 ] 361 0.023% 100.049% ( 1300, 1900 ] 225 0.015% 100.064% ( 1900, 2900 ] 307 0.020% 100.084% ( 2900, 4400 ] 398 0.026% 100.110% ( 4400, 6600 ] 97 0.006% 100.116% ( 6600, 9900 ] 33 0.002% 100.118% ( 9900, 14000 ] 3 0.000% 100.118% ** Level 2 read latency histogram (micros): Count: 88591 Average: 3.9867 StdDev: 74.57 Min: 1 Median: 1.4444 Max: 7333 Percentiles: P50: 1.44 P75: 1.84 P99: 6.10 P99.9: 431.87 P99.99: 3986.52 ------------------------------------------------------ [ 0, 1 ] 19312 21.799% 21.799% #### ( 1, 2 ] 56218 63.458% 85.257% ############# ( 2, 3 ] 7292 8.231% 93.488% ## ( 3, 4 ] 2707 3.056% 96.544% # ( 4, 6 ] 2159 2.437% 98.981% ( 6, 10 ] 673 0.760% 99.740% ( 10, 15 ] 109 0.123% 99.863% ( 15, 22 ] 5 0.006% 99.869% ( 22, 34 ] 3 0.003% 99.872% ( 51, 76 ] 1 0.001% 99.874% ( 76, 110 ] 1 0.001% 99.875% ( 110, 170 ] 4 0.005% 99.879% ( 170, 250 ] 1 0.001% 99.880% ( 250, 380 ] 13 0.015% 99.895% ( 380, 580 ] 17 0.019% 99.914% ( 580, 870 ] 18 0.020% 99.935% ( 870, 1300 ] 12 0.014% 99.948% ( 1300, 1900 ] 12 0.014% 99.962% ( 1900, 2900 ] 15 0.017% 99.979% ( 2900, 4400 ] 14 0.016% 99.994% ( 4400, 6600 ] 3 0.003% 99.998% ( 6600, 9900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 659434 Average: 9.3618 StdDev: 127.30 Min: 0 Median: 1.9527 Max: 9312 Percentiles: P50: 1.95 P75: 2.95 P99: 10.61 P99.9: 783.56 P99.99: 1214.59 ------------------------------------------------------ [ 0, 1 ] 16196 2.456% 2.456% ( 1, 2 ] 329096 49.906% 52.362% ########## ( 2, 3 ] 157841 23.936% 76.298% ##### ( 3, 4 ] 64722 9.815% 86.112% ## ( 4, 6 ] 71223 10.801% 96.913% ## ( 6, 10 ] 13304 2.017% 98.931% ( 10, 15 ] 3755 0.569% 99.500% ( 15, 22 ] 432 0.066% 99.566% ( 22, 34 ] 37 0.006% 99.571% ( 34, 51 ] 14 0.002% 99.573% ( 51, 76 ] 6 0.001% 99.574% ( 76, 110 ] 26 0.004% 99.578% ( 110, 170 ] 161 0.024% 99.603% ( 170, 250 ] 272 0.041% 99.644% ( 250, 380 ] 497 0.075% 99.719% ( 380, 580 ] 697 0.106% 99.825% ( 580, 870 ] 706 0.107% 99.932% ( 870, 1300 ] 478 0.072% 100.004% ( 1300, 1900 ] 283 0.043% 100.047% ( 1900, 2900 ] 215 0.033% 100.080% ( 2900, 4400 ] 310 0.047% 100.127% ( 4400, 6600 ] 85 0.013% 100.140% ( 6600, 9900 ] 23 0.003% 100.143% ** Level 4 read latency histogram (micros): Count: 12715 Average: 19.9671 StdDev: 286.47 Min: 1 Median: 2.0717 Max: 9677 Percentiles: P50: 2.07 P75: 3.05 P99: 25.40 P99.9: 5562.70 P99.99: 9375.51 ------------------------------------------------------ [ 0, 1 ] 201 1.581% 1.581% ( 1, 2 ] 5916 46.528% 48.109% ######### ( 2, 3 ] 3356 26.394% 74.503% ##### ( 3, 4 ] 1310 10.303% 84.805% ## ( 4, 6 ] 1490 11.718% 96.524% ## ( 6, 10 ] 256 2.013% 98.537% ( 10, 15 ] 50 0.393% 98.930% ( 15, 22 ] 8 0.063% 98.993% ( 22, 34 ] 3 0.024% 99.017% ( 34, 51 ] 2 0.016% 99.033% ( 51, 76 ] 6 0.047% 99.080% ( 110, 170 ] 8 0.063% 99.143% ( 170, 250 ] 31 0.244% 99.387% ( 250, 380 ] 5 0.039% 99.426% ( 380, 580 ] 7 0.055% 99.481% ( 580, 870 ] 10 0.079% 99.560% ( 870, 1300 ] 9 0.071% 99.630% ( 1300, 1900 ] 13 0.102% 99.733% ( 1900, 2900 ] 12 0.094% 99.827% ( 2900, 4400 ] 4 0.031% 99.858% ( 4400, 6600 ] 10 0.079% 99.937% ( 6600, 9900 ] 8 0.063% 100.000% ** Level 5 read latency histogram (micros): Count: 260 Average: 1511.3077 StdDev: 1670.16 Min: 82 Median: 766.4286 Max: 8449 Percentiles: P50: 766.43 P75: 2260.00 P99: 8184.00 P99.9: 8449.00 P99.99: 8449.00 ------------------------------------------------------ ( 76, 110 ] 8 3.077% 3.077% # ( 110, 170 ] 36 13.846% 16.923% ### ( 170, 250 ] 19 7.308% 24.231% # ( 250, 380 ] 23 8.846% 33.077% ## ( 380, 580 ] 26 10.000% 43.077% ## ( 580, 870 ] 28 10.769% 53.846% ## ( 870, 1300 ] 19 7.308% 61.154% # ( 1300, 1900 ] 27 10.385% 71.538% ## ( 1900, 2900 ] 25 9.615% 81.154% ## ( 2900, 4400 ] 30 11.538% 92.692% ## ( 4400, 6600 ] 14 5.385% 98.077% # ( 6600, 9900 ] 5 1.923% 100.000% ** DB Stats ** Uptime(secs): 55.8 total, 3.6 interval Cumulative writes: 0 writes, 10M keys, 0 commit groups, 0.0 writes per commit group, ingest: 9.61 GB, 176.43 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:28.409 H:M:S, 50.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 270.98 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.046 H:M:S, 28.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 5.701 micros/op 175400 ops/sec 60.051 seconds 10532999 operations; 170.0 MB/s Microseconds per write: Count: 10532999 Average: 5.7012 StdDev: 515.18 Min: 0 Median: 1.7169 Max: 811330 Percentiles: P50: 1.72 P75: 2.69 P99: 8.71 P99.9: 1132.86 P99.99: 2758.91 ------------------------------------------------------ [ 0, 1 ] 1511325 14.348% 14.348% ### ( 1, 2 ] 5237801 49.728% 64.076% ########## ( 2, 3 ] 1666184 15.819% 79.895% ### ( 3, 4 ] 1414515 13.429% 93.324% ### ( 4, 6 ] 524591 4.980% 98.305% # ( 6, 10 ] 107964 1.025% 99.330% ( 10, 15 ] 33890 0.322% 99.651% ( 15, 22 ] 8285 0.079% 99.730% ( 22, 34 ] 1410 0.013% 99.743% ( 34, 51 ] 208 0.002% 99.745% ( 51, 76 ] 27 0.000% 99.746% ( 76, 110 ] 7486 0.071% 99.817% ( 110, 170 ] 2673 0.025% 99.842% ( 170, 250 ] 335 0.003% 99.845% ( 250, 380 ] 147 0.001% 99.847% ( 380, 580 ] 21 0.000% 99.847% ( 580, 870 ] 18 0.000% 99.847% ( 870, 1300 ] 9138 0.087% 99.934% ( 1300, 1900 ] 27 0.000% 99.934% ( 1900, 2900 ] 6870 0.065% 99.999% ( 2900, 4400 ] 38 0.000% 100.000% ( 4400, 6600 ] 5 0.000% 100.000% ( 6600, 9900 ] 5 0.000% 100.000% ( 9900, 14000 ] 3 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 170000, 250000 ] 21 0.000% 100.000% ( 250000, 380000 ] 1 0.000% 100.000% ( 570000, 860000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 170264 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 10532999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10870054968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 486 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31487270 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 26590685527 rocksdb.compact.write.bytes COUNT : 26425527094 rocksdb.flush.write.bytes COUNT : 10833233753 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 63 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 250 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10746133504 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4388864 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 26691283285 rocksdb.non.last.level.read.count COUNT : 6445114 rocksdb.block.checksum.compute.count COUNT : 6444206 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.360916 P95 : 3.858307 P99 : 7.010107 P100 : 811327.000000 COUNT : 10532999 SUM : 55252410 rocksdb.compaction.times.micros P50 : 1125200.000000 P95 : 5363333.333333 P99 : 22937317.000000 P100 : 22937317.000000 COUNT : 71 SUM : 119654295 rocksdb.compaction.times.cpu_micros P50 : 900476.190476 P95 : 3915000.000000 P99 : 16320000.000000 P100 : 20642021.000000 COUNT : 71 SUM : 96767378 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 710.000000 P95 : 3650.000000 P99 : 128000.000000 P100 : 160423.000000 COUNT : 140 SUM : 557944 rocksdb.compaction.outfile.sync.micros P50 : 1039.736842 P95 : 126071.428571 P99 : 201200.000000 P100 : 224301.000000 COUNT : 305 SUM : 6150791 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 99.402597 P95 : 2516.666667 P99 : 4156.666667 P100 : 4738.000000 COUNT : 246 SUM : 95794 rocksdb.table.open.io.micros P50 : 1724.000000 P95 : 11796.250000 P99 : 22308.000000 P100 : 22976.000000 COUNT : 486 SUM : 1401333 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.655939 P95 : 7.927863 P99 : 12.448030 P100 : 12361.000000 COUNT : 6442885 SUM : 41073230 rocksdb.read.block.get.micros P50 : 570.400000 P95 : 4493.333333 P99 : 8013.176471 P100 : 9731.000000 COUNT : 972 SUM : 1108240 rocksdb.write.raw.block.micros P50 : 0.513984 P95 : 0.976569 P99 : 2.854124 P100 : 18765.000000 COUNT : 9024680 SUM : 19231456 rocksdb.numfiles.in.singlecompaction P50 : 3.256944 P95 : 7.166667 P99 : 26.500000 P100 : 28.000000 COUNT : 125 SUM : 485 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564694 P95 : 1294.027255 P99 : 2700.557664 P100 : 811138.000000 COUNT : 140418 SUM : 31502120 rocksdb.sst.read.micros P50 : 1.588527 P95 : 4.708071 P99 : 9.039882 P100 : 11780.000000 COUNT : 6445434 SUM : 28152646 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 10532999 SUM : 10870054968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 219056.603774 P95 : 475000.000000 P99 : 962000.000000 P100 : 1005034.000000 COUNT : 140 SUM : 32965391 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 294 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0