[2024-11-27 12:54:59.421940] Starting SPDK v25.01-pre git sha1 2f2acf4eb / DPDK 24.03.0 initialization... [2024-11-27 12:54:59.422250] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid64925 ] Set seed to 1732708499414771 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-27 12:54:59.572590] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-27 12:54:59.677373] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-27 12:54:59.677433] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 64925' to capture a snapshot of events at runtime. [2024-11-27 12:54:59.677446] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-27 12:54:59.677459] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-27 12:54:59.677469] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid64925 for offline analysis/debug. [2024-11-27 12:54:59.678713] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Wed Nov 27 12:55:05 2024 CPU: 72 * Intel(R) Xeon(R) Gold 6140 CPU @ 2.30GHz CPUCache: 25344 KB 2024/11/27-12:55:08 ... thread 0: (1000000,1000000) ops and (329864.6,329864.6) ops/second in (3.031547,3.031547) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/9 693.01 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 357.6 2.47 2.29 13 0.190 0 0 0.0 0.0 L2 3/2 236.98 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.0 1.8 255.2 255.1 1.36 1.33 2 0.682 353K 146 0.0 0.0 L3 9/0 755.91 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L4 116/0 9.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1191/11 97.00 GB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 90.9 321.1 3.83 3.62 15 0.255 353K 146 0.0 0.0 Int 0/0 0.00 KB 0.0 0.3 0.2 0.2 1.2 1.0 0.0 1.4 90.9 321.1 3.83 3.62 15 0.255 353K 146 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 0.0 0.0 255.2 255.1 1.36 1.33 2 0.682 353K 146 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 357.6 2.47 2.29 13 0.190 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.20 GB write, 382.41 MB/s write, 0.34 GB read, 108.27 MB/s read, 3.8 seconds Interval compaction: 1.20 GB write, 405.60 MB/s write, 0.34 GB read, 114.84 MB/s read, 3.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 147622 Average: 2.1010 StdDev: 5.72 Min: 1 Median: 1.4441 Max: 1588 Percentiles: P50: 1.44 P75: 1.84 P99: 5.61 P99.9: 9.90 P99.99: 16.74 ------------------------------------------------------ [ 0, 1 ] 32589 22.076% 22.076% #### ( 1, 2 ] 92815 62.873% 84.949% ############# ( 2, 3 ] 13495 9.142% 94.091% ## ( 3, 4 ] 4955 3.357% 97.448% # ( 4, 6 ] 2851 1.931% 99.379% ( 6, 10 ] 791 0.536% 99.915% ( 10, 15 ] 111 0.075% 99.990% ( 15, 22 ] 9 0.006% 99.996% ( 22, 34 ] 4 0.003% 99.999% ( 34, 51 ] 3 0.002% 100.001% ( 51, 76 ] 2 0.001% 100.002% ( 76, 110 ] 1 0.001% 100.003% ( 170, 250 ] 12 0.008% 100.011% ( 250, 380 ] 10 0.007% 100.018% ( 380, 580 ] 3 0.002% 100.020% ( 1300, 1900 ] 1 0.001% 100.020% ** Level 1 read latency histogram (micros): Count: 12240 Average: 2.8330 StdDev: 22.19 Min: 1 Median: 1.2593 Max: 1601 Percentiles: P50: 1.26 P75: 1.69 P99: 10.06 P99.9: 185.64 P99.99: 1532.80 ------------------------------------------------------ [ 0, 1 ] 4299 35.123% 35.123% ####### ( 1, 2 ] 7024 57.386% 92.508% ########### ( 2, 3 ] 452 3.693% 96.201% # ( 3, 4 ] 120 0.980% 97.181% ( 4, 6 ] 97 0.792% 97.974% ( 6, 10 ] 125 1.021% 98.995% ( 10, 15 ] 48 0.392% 99.387% ( 15, 22 ] 2 0.016% 99.404% ( 22, 34 ] 3 0.025% 99.428% ( 34, 51 ] 1 0.008% 99.436% ( 76, 110 ] 29 0.237% 99.673% ( 110, 170 ] 26 0.212% 99.886% ( 170, 250 ] 9 0.074% 99.959% ( 250, 380 ] 3 0.025% 99.984% ( 1300, 1900 ] 2 0.016% 100.000% ** Level 2 read latency histogram (micros): Count: 71163 Average: 2.1532 StdDev: 4.14 Min: 1 Median: 1.4758 Max: 689 Percentiles: P50: 1.48 P75: 1.86 P99: 5.97 P99.9: 13.12 P99.99: 207.67 ------------------------------------------------------ [ 0, 1 ] 13824 19.426% 19.426% #### ( 1, 2 ] 45724 64.252% 83.678% ############# ( 2, 3 ] 6887 9.678% 93.356% ## ( 3, 4 ] 2417 3.396% 96.753% # ( 4, 6 ] 1625 2.283% 99.036% ( 6, 10 ] 533 0.749% 99.785% ( 10, 15 ] 131 0.184% 99.969% ( 15, 22 ] 11 0.015% 99.985% ( 34, 51 ] 1 0.001% 99.986% ( 110, 170 ] 1 0.001% 99.987% ( 170, 250 ] 4 0.006% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 45 Average: 2799.9111 StdDev: 1691.59 Min: 194 Median: 2953.5714 Max: 6493 Percentiles: P50: 2953.57 P75: 4158.93 P99: 6490.00 P99.9: 6493.00 P99.99: 6493.00 ------------------------------------------------------ ( 170, 250 ] 1 2.222% 2.222% ( 250, 380 ] 3 6.667% 8.889% # ( 380, 580 ] 1 2.222% 11.111% ( 580, 870 ] 1 2.222% 13.333% ( 870, 1300 ] 4 8.889% 22.222% ## ( 1300, 1900 ] 10 22.222% 44.444% #### ( 1900, 2900 ] 2 4.444% 48.889% # ( 2900, 4400 ] 14 31.111% 80.000% ###### ( 4400, 6600 ] 9 20.000% 100.000% #### ** Level 4 read latency histogram (micros): Count: 30 Average: 3573.7333 StdDev: 1503.64 Min: 993 Median: 3500.0000 Max: 7170 Percentiles: P50: 3500.00 P75: 4250.00 P99: 7170.00 P99.9: 7170.00 P99.99: 7170.00 ------------------------------------------------------ ( 870, 1300 ] 3 10.000% 10.000% ## ( 1300, 1900 ] 2 6.667% 16.667% # ( 1900, 2900 ] 4 13.333% 30.000% ### ( 2900, 4400 ] 15 50.000% 80.000% ########## ( 4400, 6600 ] 5 16.667% 96.667% ### ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 305.94 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.187 H:M:S, 5.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.40 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.187 H:M:S, 6.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/27-12:55:11 ... thread 0: (1000000,2000000) ops and (330514.6,330189.3) ops/second in (3.025585,6.057132) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/4 1.35 GB 113.3 1.0 0.0 1.0 2.8 1.8 0.0 1.5 108.1 310.6 9.33 8.83 33 0.283 1023K 1011 0.0 0.0 L1 1/0 2.61 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 236.8 236.5 1.33 1.30 1 1.330 319K 416 0.0 0.0 L2 1/0 49.67 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 255.2 255.1 1.36 1.33 2 0.682 353K 146 0.0 0.0 L3 25/0 971.92 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 216.9 216.7 3.16 3.01 3 1.055 697K 580 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1241/4 97.98 GB 0.0 2.3 1.0 1.3 4.1 2.8 0.8 2.2 155.3 279.6 15.19 14.47 39 0.389 2394K 2153 0.0 0.0 Int 0/0 0.00 KB 0.0 2.3 1.0 1.3 4.1 2.8 0.8 2.2 155.3 279.6 15.19 14.47 39 0.389 2394K 2153 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.3 1.0 1.3 2.3 1.0 0.0 0.0 239.2 239.0 9.86 9.54 10 0.986 2394K 2153 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 354.7 5.33 4.94 29 0.184 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.1 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.15 GB write, 680.14 MB/s write, 2.30 GB read, 377.73 MB/s read, 15.2 seconds Interval compaction: 4.15 GB write, 700.78 MB/s write, 2.30 GB read, 389.19 MB/s read, 15.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 409833 Average: 2.2187 StdDev: 6.37 Min: 1 Median: 1.5124 Max: 1694 Percentiles: P50: 1.51 P75: 1.90 P99: 5.85 P99.9: 11.81 P99.99: 20.58 ------------------------------------------------------ [ 0, 1 ] 69862 17.046% 17.046% ### ( 1, 2 ] 263563 64.310% 81.356% ############# ( 2, 3 ] 47660 11.629% 92.985% ## ( 3, 4 ] 15809 3.857% 96.843% # ( 4, 6 ] 9536 2.327% 99.170% ( 6, 10 ] 2813 0.686% 99.856% ( 10, 15 ] 498 0.122% 99.978% ( 15, 22 ] 64 0.016% 99.993% ( 22, 34 ] 21 0.005% 99.998% ( 34, 51 ] 9 0.002% 100.000% ( 51, 76 ] 3 0.001% 100.001% ( 76, 110 ] 2 0.000% 100.002% ( 170, 250 ] 27 0.007% 100.008% ( 250, 380 ] 22 0.005% 100.014% ( 380, 580 ] 10 0.002% 100.016% ( 580, 870 ] 1 0.000% 100.016% ( 870, 1300 ] 3 0.001% 100.017% ( 1300, 1900 ] 3 0.001% 100.018% ** Level 1 read latency histogram (micros): Count: 91423 Average: 2.5613 StdDev: 8.81 Min: 1 Median: 1.6456 Max: 1601 Percentiles: P50: 1.65 P75: 2.15 P99: 7.77 P99.9: 18.61 P99.99: 176.24 ------------------------------------------------------ [ 0, 1 ] 8531 9.331% 9.331% ## ( 1, 2 ] 57587 62.990% 72.321% ############# ( 2, 3 ] 15950 17.446% 89.767% ### ( 3, 4 ] 4622 5.056% 94.823% # ( 4, 6 ] 3398 3.717% 98.540% # ( 6, 10 ] 953 1.042% 99.582% ( 10, 15 ] 272 0.298% 99.880% ( 15, 22 ] 36 0.039% 99.919% ( 22, 34 ] 7 0.008% 99.927% ( 34, 51 ] 2 0.002% 99.929% ( 76, 110 ] 29 0.032% 99.961% ( 110, 170 ] 26 0.028% 99.989% ( 170, 250 ] 11 0.012% 100.001% ( 250, 380 ] 5 0.005% 100.007% ( 380, 580 ] 1 0.001% 100.008% ( 580, 870 ] 1 0.001% 100.009% ( 1300, 1900 ] 2 0.002% 100.011% ** Level 2 read latency histogram (micros): Count: 75792 Average: 2.1739 StdDev: 4.02 Min: 1 Median: 1.4909 Max: 689 Percentiles: P50: 1.49 P75: 1.88 P99: 5.97 P99.9: 13.11 P99.99: 198.42 ------------------------------------------------------ [ 0, 1 ] 13981 18.447% 18.447% #### ( 1, 2 ] 48712 64.271% 82.717% ############# ( 2, 3 ] 7858 10.368% 93.085% ## ( 3, 4 ] 2706 3.570% 96.655% # ( 4, 6 ] 1806 2.383% 99.038% ( 6, 10 ] 568 0.749% 99.788% ( 10, 15 ] 137 0.181% 99.968% ( 15, 22 ] 13 0.017% 99.985% ( 34, 51 ] 1 0.001% 99.987% ( 110, 170 ] 1 0.001% 99.988% ( 170, 250 ] 4 0.005% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47892 Average: 5.1858 StdDev: 100.34 Min: 0 Median: 1.6830 Max: 6493 Percentiles: P50: 1.68 P75: 2.25 P99: 8.14 P99.9: 159.30 P99.99: 4208.30 ------------------------------------------------------ [ 0, 1 ] 3002 6.268% 6.268% # ( 1, 2 ] 30663 64.025% 70.294% ############# ( 2, 3 ] 8885 18.552% 88.846% #### ( 3, 4 ] 2697 5.631% 94.477% # ( 4, 6 ] 1906 3.980% 98.457% # ( 6, 10 ] 485 1.013% 99.470% ( 10, 15 ] 168 0.351% 99.820% ( 15, 22 ] 21 0.044% 99.864% ( 22, 34 ] 11 0.023% 99.887% ( 34, 51 ] 2 0.004% 99.891% ( 110, 170 ] 5 0.010% 99.902% ( 170, 250 ] 2 0.004% 99.906% ( 250, 380 ] 5 0.010% 99.916% ( 380, 580 ] 5 0.010% 99.927% ( 580, 870 ] 2 0.004% 99.931% ( 870, 1300 ] 4 0.008% 99.939% ( 1300, 1900 ] 10 0.021% 99.960% ( 1900, 2900 ] 2 0.004% 99.965% ( 2900, 4400 ] 14 0.029% 99.994% ( 4400, 6600 ] 9 0.019% 100.013% ** Level 4 read latency histogram (micros): Count: 30 Average: 3573.7333 StdDev: 1503.64 Min: 993 Median: 3500.0000 Max: 7170 Percentiles: P50: 3500.00 P75: 4250.00 P99: 7170.00 P99.9: 7170.00 P99.99: 7170.00 ------------------------------------------------------ ( 870, 1300 ] 3 10.000% 10.000% ## ( 1300, 1900 ] 2 6.667% 16.667% # ( 1900, 2900 ] 4 13.333% 30.000% ### ( 2900, 4400 ] 15 50.000% 80.000% ########## ( 4400, 6600 ] 5 16.667% 96.667% ### ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 315.32 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.187 H:M:S, 3.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 325.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-12:55:13 ... thread 0: (1000000,3000000) ops and (352404.5,337276.5) ops/second in (2.837648,8.894780) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 2.27 GB 207.7 2.0 0.0 2.0 4.7 2.8 0.0 1.7 128.8 309.9 15.65 14.91 52 0.301 2046K 1997 0.0 0.0 L1 1/0 2.61 MB 0.3 0.3 0.3 0.0 0.3 0.3 0.2 1.0 236.8 236.5 1.33 1.30 1 1.330 319K 416 0.0 0.0 L2 1/0 49.67 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 255.2 255.1 1.36 1.33 2 0.682 353K 146 0.0 0.0 L3 25/0 971.92 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 216.9 216.7 3.16 3.01 3 1.055 697K 580 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1244/4 98.90 GB 0.0 3.3 1.0 2.3 6.1 3.7 0.8 2.2 156.5 288.1 21.51 20.55 58 0.371 3417K 3139 0.0 0.0 Int 0/0 0.00 KB 0.0 3.3 1.0 2.3 6.1 3.7 0.8 2.2 156.5 288.1 21.51 20.55 58 0.371 3417K 3139 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.3 1.0 2.3 3.3 1.0 0.0 0.0 246.8 246.5 13.64 13.25 14 0.974 3417K 3139 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 360.3 7.87 7.30 44 0.179 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.1 total, 8.9 interval Flush(GB): cumulative 2.769, interval 2.769 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.05 GB write, 682.56 MB/s write, 3.29 GB read, 370.70 MB/s read, 21.5 seconds Interval compaction: 6.05 GB write, 696.66 MB/s write, 3.29 GB read, 378.36 MB/s read, 21.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 1, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 1, interval: 1 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 653866 Average: 2.1361 StdDev: 6.12 Min: 1 Median: 1.4700 Max: 1694 Percentiles: P50: 1.47 P75: 1.86 P99: 5.66 P99.9: 11.08 P99.99: 21.35 ------------------------------------------------------ [ 0, 1 ] 127800 19.545% 19.545% #### ( 1, 2 ] 423701 64.799% 84.345% ############# ( 2, 3 ] 65109 9.958% 94.302% ## ( 3, 4 ] 21049 3.219% 97.521% # ( 4, 6 ] 11637 1.780% 99.301% ( 6, 10 ] 3774 0.577% 99.878% ( 10, 15 ] 659 0.101% 99.979% ( 15, 22 ] 79 0.012% 99.991% ( 22, 34 ] 27 0.004% 99.995% ( 34, 51 ] 11 0.002% 99.997% ( 51, 76 ] 4 0.001% 99.998% ( 76, 110 ] 3 0.000% 99.998% ( 170, 250 ] 42 0.006% 100.004% ( 250, 380 ] 32 0.005% 100.009% ( 380, 580 ] 18 0.003% 100.012% ( 580, 870 ] 2 0.000% 100.012% ( 870, 1300 ] 7 0.001% 100.013% ( 1300, 1900 ] 3 0.000% 100.014% ** Level 1 read latency histogram (micros): Count: 91423 Average: 2.5613 StdDev: 8.81 Min: 1 Median: 1.6456 Max: 1601 Percentiles: P50: 1.65 P75: 2.15 P99: 7.77 P99.9: 18.61 P99.99: 176.24 ------------------------------------------------------ [ 0, 1 ] 8531 9.331% 9.331% ## ( 1, 2 ] 57587 62.990% 72.321% ############# ( 2, 3 ] 15950 17.446% 89.767% ### ( 3, 4 ] 4622 5.056% 94.823% # ( 4, 6 ] 3398 3.717% 98.540% # ( 6, 10 ] 953 1.042% 99.582% ( 10, 15 ] 272 0.298% 99.880% ( 15, 22 ] 36 0.039% 99.919% ( 22, 34 ] 7 0.008% 99.927% ( 34, 51 ] 2 0.002% 99.929% ( 76, 110 ] 29 0.032% 99.961% ( 110, 170 ] 26 0.028% 99.989% ( 170, 250 ] 11 0.012% 100.001% ( 250, 380 ] 5 0.005% 100.007% ( 380, 580 ] 1 0.001% 100.008% ( 580, 870 ] 1 0.001% 100.009% ( 1300, 1900 ] 2 0.002% 100.011% ** Level 2 read latency histogram (micros): Count: 75792 Average: 2.1739 StdDev: 4.02 Min: 1 Median: 1.4909 Max: 689 Percentiles: P50: 1.49 P75: 1.88 P99: 5.97 P99.9: 13.11 P99.99: 198.42 ------------------------------------------------------ [ 0, 1 ] 13981 18.447% 18.447% #### ( 1, 2 ] 48712 64.271% 82.717% ############# ( 2, 3 ] 7858 10.368% 93.085% ## ( 3, 4 ] 2706 3.570% 96.655% # ( 4, 6 ] 1806 2.383% 99.038% ( 6, 10 ] 568 0.749% 99.788% ( 10, 15 ] 137 0.181% 99.968% ( 15, 22 ] 13 0.017% 99.985% ( 34, 51 ] 1 0.001% 99.987% ( 110, 170 ] 1 0.001% 99.988% ( 170, 250 ] 4 0.005% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47892 Average: 5.1858 StdDev: 100.34 Min: 0 Median: 1.6830 Max: 6493 Percentiles: P50: 1.68 P75: 2.25 P99: 8.14 P99.9: 159.30 P99.99: 4208.30 ------------------------------------------------------ [ 0, 1 ] 3002 6.268% 6.268% # ( 1, 2 ] 30663 64.025% 70.294% ############# ( 2, 3 ] 8885 18.552% 88.846% #### ( 3, 4 ] 2697 5.631% 94.477% # ( 4, 6 ] 1906 3.980% 98.457% # ( 6, 10 ] 485 1.013% 99.470% ( 10, 15 ] 168 0.351% 99.820% ( 15, 22 ] 21 0.044% 99.864% ( 22, 34 ] 11 0.023% 99.887% ( 34, 51 ] 2 0.004% 99.891% ( 110, 170 ] 5 0.010% 99.902% ( 170, 250 ] 2 0.004% 99.906% ( 250, 380 ] 5 0.010% 99.916% ( 380, 580 ] 5 0.010% 99.927% ( 580, 870 ] 2 0.004% 99.931% ( 870, 1300 ] 4 0.008% 99.939% ( 1300, 1900 ] 10 0.021% 99.960% ( 1900, 2900 ] 2 0.004% 99.965% ( 2900, 4400 ] 14 0.029% 99.994% ( 4400, 6600 ] 9 0.019% 100.013% ** Level 4 read latency histogram (micros): Count: 30 Average: 3573.7333 StdDev: 1503.64 Min: 993 Median: 3500.0000 Max: 7170 Percentiles: P50: 3500.00 P75: 4250.00 P99: 7170.00 P99.9: 7170.00 P99.99: 7170.00 ------------------------------------------------------ ( 870, 1300 ] 3 10.000% 10.000% ## ( 1300, 1900 ] 2 6.667% 16.667% # ( 1900, 2900 ] 4 13.333% 30.000% ### ( 2900, 4400 ] 15 50.000% 80.000% ########## ( 4400, 6600 ] 5 16.667% 96.667% ### ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 9.1 total, 2.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 325.17 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.187 H:M:S, 2.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 346.83 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/27-12:55:16 ... thread 0: (1000000,4000000) ops and (329374.9,335265.7) ops/second in (3.036054,11.930834) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/18 3.26 GB 12.6 2.7 0.0 2.7 6.5 3.7 0.0 1.7 130.5 311.2 21.25 20.26 70 0.304 2814K 2770 0.0 0.0 L1 1/1 2.61 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 236.8 236.5 1.33 1.30 1 1.330 319K 416 0.0 0.0 L2 1/0 49.67 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 255.2 255.1 1.36 1.33 2 0.682 353K 146 0.0 0.0 L3 25/0 971.92 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 216.9 216.7 3.16 3.01 3 1.055 697K 580 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1250/19 99.89 GB 0.0 4.0 1.0 3.0 7.8 4.7 0.8 2.1 152.1 293.7 27.11 25.90 76 0.357 4185K 3912 0.0 0.0 Int 0/0 0.00 KB 0.0 4.0 1.0 3.0 7.8 4.7 0.8 2.1 152.1 293.7 27.11 25.90 76 0.357 4185K 3912 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.0 1.0 3.0 4.0 1.0 0.0 0.0 250.0 249.7 16.49 16.05 17 0.970 4185K 3912 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 361.9 10.62 9.85 59 0.180 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.77 GB write, 657.04 MB/s write, 4.03 GB read, 340.20 MB/s read, 27.1 seconds Interval compaction: 7.77 GB write, 667.16 MB/s write, 4.03 GB read, 345.44 MB/s read, 27.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 4, interval: 4 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 882037 Average: 2.1186 StdDev: 6.84 Min: 0 Median: 1.4478 Max: 1694 Percentiles: P50: 1.45 P75: 1.83 P99: 5.58 P99.9: 12.15 P99.99: 147.22 ------------------------------------------------------ [ 0, 1 ] 183322 20.784% 20.784% #### ( 1, 2 ] 575433 65.239% 86.023% ############# ( 2, 3 ] 78661 8.918% 94.941% ## ( 3, 4 ] 25302 2.869% 97.810% # ( 4, 6 ] 13314 1.509% 99.319% ( 6, 10 ] 4706 0.534% 99.853% ( 10, 15 ] 976 0.111% 99.963% ( 15, 22 ] 108 0.012% 99.976% ( 22, 34 ] 33 0.004% 99.979% ( 34, 51 ] 12 0.001% 99.981% ( 51, 76 ] 4 0.000% 99.981% ( 76, 110 ] 19 0.002% 99.983% ( 110, 170 ] 98 0.011% 99.994% ( 170, 250 ] 64 0.007% 100.002% ( 250, 380 ] 45 0.005% 100.007% ( 380, 580 ] 26 0.003% 100.010% ( 580, 870 ] 3 0.000% 100.010% ( 870, 1300 ] 10 0.001% 100.011% ( 1300, 1900 ] 6 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 91424 Average: 2.5625 StdDev: 8.82 Min: 1 Median: 1.6456 Max: 1601 Percentiles: P50: 1.65 P75: 2.15 P99: 7.77 P99.9: 18.81 P99.99: 176.24 ------------------------------------------------------ [ 0, 1 ] 8531 9.331% 9.331% ## ( 1, 2 ] 57587 62.989% 72.320% ############# ( 2, 3 ] 15950 17.446% 89.766% ### ( 3, 4 ] 4622 5.056% 94.822% # ( 4, 6 ] 3398 3.717% 98.539% # ( 6, 10 ] 953 1.042% 99.581% ( 10, 15 ] 272 0.298% 99.879% ( 15, 22 ] 36 0.039% 99.918% ( 22, 34 ] 7 0.008% 99.926% ( 34, 51 ] 2 0.002% 99.928% ( 76, 110 ] 29 0.032% 99.960% ( 110, 170 ] 27 0.030% 99.989% ( 170, 250 ] 11 0.012% 100.001% ( 250, 380 ] 5 0.005% 100.007% ( 380, 580 ] 1 0.001% 100.008% ( 580, 870 ] 1 0.001% 100.009% ( 1300, 1900 ] 2 0.002% 100.011% ** Level 2 read latency histogram (micros): Count: 75792 Average: 2.1739 StdDev: 4.02 Min: 1 Median: 1.4909 Max: 689 Percentiles: P50: 1.49 P75: 1.88 P99: 5.97 P99.9: 13.11 P99.99: 198.42 ------------------------------------------------------ [ 0, 1 ] 13981 18.447% 18.447% #### ( 1, 2 ] 48712 64.271% 82.717% ############# ( 2, 3 ] 7858 10.368% 93.085% ## ( 3, 4 ] 2706 3.570% 96.655% # ( 4, 6 ] 1806 2.383% 99.038% ( 6, 10 ] 568 0.749% 99.788% ( 10, 15 ] 137 0.181% 99.968% ( 15, 22 ] 13 0.017% 99.985% ( 34, 51 ] 1 0.001% 99.987% ( 110, 170 ] 1 0.001% 99.988% ( 170, 250 ] 4 0.005% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47892 Average: 5.1858 StdDev: 100.34 Min: 0 Median: 1.6830 Max: 6493 Percentiles: P50: 1.68 P75: 2.25 P99: 8.14 P99.9: 159.30 P99.99: 4208.30 ------------------------------------------------------ [ 0, 1 ] 3002 6.268% 6.268% # ( 1, 2 ] 30663 64.025% 70.294% ############# ( 2, 3 ] 8885 18.552% 88.846% #### ( 3, 4 ] 2697 5.631% 94.477% # ( 4, 6 ] 1906 3.980% 98.457% # ( 6, 10 ] 485 1.013% 99.470% ( 10, 15 ] 168 0.351% 99.820% ( 15, 22 ] 21 0.044% 99.864% ( 22, 34 ] 11 0.023% 99.887% ( 34, 51 ] 2 0.004% 99.891% ( 110, 170 ] 5 0.010% 99.902% ( 170, 250 ] 2 0.004% 99.906% ( 250, 380 ] 5 0.010% 99.916% ( 380, 580 ] 5 0.010% 99.927% ( 580, 870 ] 2 0.004% 99.931% ( 870, 1300 ] 4 0.008% 99.939% ( 1300, 1900 ] 10 0.021% 99.960% ( 1900, 2900 ] 2 0.004% 99.965% ( 2900, 4400 ] 14 0.029% 99.994% ( 4400, 6600 ] 9 0.019% 100.013% ** Level 4 read latency histogram (micros): Count: 30 Average: 3573.7333 StdDev: 1503.64 Min: 993 Median: 3500.0000 Max: 7170 Percentiles: P50: 3500.00 P75: 4250.00 P99: 7170.00 P99.9: 7170.00 P99.99: 7170.00 ------------------------------------------------------ ( 870, 1300 ] 3 10.000% 10.000% ## ( 1300, 1900 ] 2 6.667% 16.667% # ( 1900, 2900 ] 4 13.333% 30.000% ### ( 2900, 4400 ] 15 50.000% 80.000% ########## ( 4400, 6600 ] 5 16.667% 96.667% ### ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 12.1 total, 3.0 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 324.92 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.369 H:M:S, 3.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.182 H:M:S, 6.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-12:55:25 ... thread 0: (1000000,5000000) ops and (116324.3,243575.8) ops/second in (8.596654,20.527488) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 21/18 4.30 GB 119.4 4.4 0.0 4.4 9.2 4.8 0.0 1.9 146.3 306.9 30.56 29.29 92 0.332 4541K 5391 0.0 0.0 L1 1/1 2.61 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.2 1.0 236.8 236.5 1.33 1.30 1 1.330 319K 416 0.0 0.0 L2 1/0 49.67 MB 0.5 0.3 0.2 0.2 0.3 0.2 0.4 1.8 255.2 255.1 1.36 1.33 2 0.682 353K 146 0.0 0.0 L3 25/0 971.92 MB 1.0 0.7 0.5 0.2 0.7 0.5 0.0 1.4 216.9 216.7 3.16 3.01 3 1.055 697K 580 0.0 0.0 L4 152/0 9.75 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1052/0 85.88 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1252/19 100.93 GB 0.0 5.7 1.0 4.7 10.5 5.8 0.8 2.2 159.9 294.6 36.42 34.93 98 0.372 5911K 6533 0.0 0.0 Int 0/0 0.00 KB 0.0 5.7 1.0 4.7 10.5 5.8 0.8 2.2 159.9 294.6 36.42 34.93 98 0.372 5911K 6533 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.7 1.0 4.7 5.7 1.0 0.0 0.0 255.1 254.8 22.83 22.31 22 1.038 5911K 6533 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.8 4.8 0.0 0.0 0.0 361.4 13.60 12.63 76 0.179 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.7 total, 20.5 interval Flush(GB): cumulative 4.799, interval 4.799 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.48 GB write, 518.01 MB/s write, 5.69 GB read, 281.10 MB/s read, 36.4 seconds Interval compaction: 10.48 GB write, 522.65 MB/s write, 5.69 GB read, 283.61 MB/s read, 36.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 4, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 4, interval: 16 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1824346 Average: 2.1774 StdDev: 6.81 Min: 0 Median: 1.4863 Max: 2463 Percentiles: P50: 1.49 P75: 1.86 P99: 5.61 P99.9: 11.96 P99.99: 149.99 ------------------------------------------------------ [ 0, 1 ] 315514 17.295% 17.295% ### ( 1, 2 ] 1226891 67.251% 84.546% ############# ( 2, 3 ] 190147 10.423% 94.968% ## ( 3, 4 ] 51680 2.833% 97.801% # ( 4, 6 ] 27218 1.492% 99.293% ( 6, 10 ] 10445 0.573% 99.866% ( 10, 15 ] 1606 0.088% 99.954% ( 15, 22 ] 191 0.010% 99.964% ( 22, 34 ] 39 0.002% 99.966% ( 34, 51 ] 14 0.001% 99.967% ( 51, 76 ] 9 0.000% 99.968% ( 76, 110 ] 128 0.007% 99.975% ( 110, 170 ] 427 0.023% 99.998% ( 170, 250 ] 113 0.006% 100.004% ( 250, 380 ] 76 0.004% 100.008% ( 380, 580 ] 41 0.002% 100.011% ( 580, 870 ] 14 0.001% 100.011% ( 870, 1300 ] 19 0.001% 100.012% ( 1300, 1900 ] 7 0.000% 100.013% ( 1900, 2900 ] 2 0.000% 100.013% ** Level 1 read latency histogram (micros): Count: 91424 Average: 2.5625 StdDev: 8.82 Min: 1 Median: 1.6456 Max: 1601 Percentiles: P50: 1.65 P75: 2.15 P99: 7.77 P99.9: 18.81 P99.99: 176.24 ------------------------------------------------------ [ 0, 1 ] 8531 9.331% 9.331% ## ( 1, 2 ] 57587 62.989% 72.320% ############# ( 2, 3 ] 15950 17.446% 89.766% ### ( 3, 4 ] 4622 5.056% 94.822% # ( 4, 6 ] 3398 3.717% 98.539% # ( 6, 10 ] 953 1.042% 99.581% ( 10, 15 ] 272 0.298% 99.879% ( 15, 22 ] 36 0.039% 99.918% ( 22, 34 ] 7 0.008% 99.926% ( 34, 51 ] 2 0.002% 99.928% ( 76, 110 ] 29 0.032% 99.960% ( 110, 170 ] 27 0.030% 99.989% ( 170, 250 ] 11 0.012% 100.001% ( 250, 380 ] 5 0.005% 100.007% ( 380, 580 ] 1 0.001% 100.008% ( 580, 870 ] 1 0.001% 100.009% ( 1300, 1900 ] 2 0.002% 100.011% ** Level 2 read latency histogram (micros): Count: 75792 Average: 2.1739 StdDev: 4.02 Min: 1 Median: 1.4909 Max: 689 Percentiles: P50: 1.49 P75: 1.88 P99: 5.97 P99.9: 13.11 P99.99: 198.42 ------------------------------------------------------ [ 0, 1 ] 13981 18.447% 18.447% #### ( 1, 2 ] 48712 64.271% 82.717% ############# ( 2, 3 ] 7858 10.368% 93.085% ## ( 3, 4 ] 2706 3.570% 96.655% # ( 4, 6 ] 1806 2.383% 99.038% ( 6, 10 ] 568 0.749% 99.788% ( 10, 15 ] 137 0.181% 99.968% ( 15, 22 ] 13 0.017% 99.985% ( 34, 51 ] 1 0.001% 99.987% ( 110, 170 ] 1 0.001% 99.988% ( 170, 250 ] 4 0.005% 99.993% ( 250, 380 ] 3 0.004% 99.997% ( 380, 580 ] 1 0.001% 99.999% ( 580, 870 ] 1 0.001% 100.000% ** Level 3 read latency histogram (micros): Count: 47892 Average: 5.1858 StdDev: 100.34 Min: 0 Median: 1.6830 Max: 6493 Percentiles: P50: 1.68 P75: 2.25 P99: 8.14 P99.9: 159.30 P99.99: 4208.30 ------------------------------------------------------ [ 0, 1 ] 3002 6.268% 6.268% # ( 1, 2 ] 30663 64.025% 70.294% ############# ( 2, 3 ] 8885 18.552% 88.846% #### ( 3, 4 ] 2697 5.631% 94.477% # ( 4, 6 ] 1906 3.980% 98.457% # ( 6, 10 ] 485 1.013% 99.470% ( 10, 15 ] 168 0.351% 99.820% ( 15, 22 ] 21 0.044% 99.864% ( 22, 34 ] 11 0.023% 99.887% ( 34, 51 ] 2 0.004% 99.891% ( 110, 170 ] 5 0.010% 99.902% ( 170, 250 ] 2 0.004% 99.906% ( 250, 380 ] 5 0.010% 99.916% ( 380, 580 ] 5 0.010% 99.927% ( 580, 870 ] 2 0.004% 99.931% ( 870, 1300 ] 4 0.008% 99.939% ( 1300, 1900 ] 10 0.021% 99.960% ( 1900, 2900 ] 2 0.004% 99.965% ( 2900, 4400 ] 14 0.029% 99.994% ( 4400, 6600 ] 9 0.019% 100.013% ** Level 4 read latency histogram (micros): Count: 30 Average: 3573.7333 StdDev: 1503.64 Min: 993 Median: 3500.0000 Max: 7170 Percentiles: P50: 3500.00 P75: 4250.00 P99: 7170.00 P99.9: 7170.00 P99.99: 7170.00 ------------------------------------------------------ ( 870, 1300 ] 3 10.000% 10.000% ## ( 1300, 1900 ] 2 6.667% 16.667% # ( 1900, 2900 ] 4 13.333% 30.000% ### ( 2900, 4400 ] 15 50.000% 80.000% ########## ( 4400, 6600 ] 5 16.667% 96.667% ### ( 6600, 9900 ] 1 3.333% 100.000% # ** DB Stats ** Uptime(secs): 20.7 total, 8.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 237.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:5.812 H:M:S, 28.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 114.47 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.443 H:M:S, 63.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/27-12:55:32 ... thread 0: (1000000,6000000) ops and (136716.0,215502.4) ops/second in (7.314435,27.841923) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 2.27 GB 37.8 5.7 0.0 5.7 11.4 5.7 0.0 2.0 147.9 294.0 39.60 37.05 107 0.370 5947K 8482 0.0 0.0 L1 4/4 343.90 MB 0.0 3.2 3.2 0.0 3.2 3.2 0.2 1.0 224.9 222.0 14.57 14.12 2 7.283 3326K 41K 0.0 0.0 L2 1/1 49.67 MB 0.0 0.3 0.2 0.2 0.3 0.2 2.9 1.8 255.2 255.1 1.36 1.33 2 0.682 353K 146 0.0 0.0 L3 25/10 1.77 GB 0.9 1.7 1.4 0.3 1.7 1.4 1.6 1.3 185.4 184.9 9.49 8.14 7 1.355 1745K 3475 0.0 0.0 L4 162/9 9.84 GB 1.0 1.1 0.9 0.2 1.1 0.9 1.0 1.2 132.1 131.6 8.77 5.61 10 0.877 1160K 3800 0.0 0.0 L5 1072/0 87.48 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1274/32 101.74 GB 0.0 12.1 5.7 6.4 17.7 11.3 7.3 3.1 168.0 245.8 73.79 66.26 128 0.576 12M 57K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.1 5.7 6.4 17.7 11.3 7.3 3.1 168.0 245.8 73.79 66.26 128 0.576 12M 57K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.1 5.7 6.4 12.0 5.6 0.0 0.0 218.7 217.6 56.70 51.17 40 1.417 12M 57K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 339.1 17.09 15.09 88 0.194 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.0 total, 27.8 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 17.71 GB write, 647.04 MB/s write, 12.11 GB read, 442.36 MB/s read, 73.8 seconds Interval compaction: 17.71 GB write, 651.32 MB/s write, 12.11 GB read, 445.28 MB/s read, 73.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 16, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 16, interval: 30 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2524741 Average: 2.5178 StdDev: 24.87 Min: 0 Median: 1.5395 Max: 17832 Percentiles: P50: 1.54 P75: 1.92 P99: 6.52 P99.9: 20.06 P99.99: 188.00 ------------------------------------------------------ [ 0, 1 ] 376087 14.896% 14.896% ### ( 1, 2 ] 1642660 65.063% 79.959% ############# ( 2, 3 ] 324731 12.862% 92.821% ### ( 3, 4 ] 90589 3.588% 96.409% # ( 4, 6 ] 62601 2.480% 98.888% ( 6, 10 ] 21716 0.860% 99.748% ( 10, 15 ] 3522 0.139% 99.888% ( 15, 22 ] 433 0.017% 99.905% ( 22, 34 ] 51 0.002% 99.907% ( 34, 51 ] 15 0.001% 99.907% ( 51, 76 ] 10 0.000% 99.908% ( 76, 110 ] 401 0.016% 99.924% ( 110, 170 ] 1615 0.064% 99.988% ( 170, 250 ] 269 0.011% 99.998% ( 250, 380 ] 185 0.007% 100.006% ( 380, 580 ] 111 0.004% 100.010% ( 580, 870 ] 64 0.003% 100.013% ( 870, 1300 ] 45 0.002% 100.014% ( 1300, 1900 ] 19 0.001% 100.015% ( 1900, 2900 ] 9 0.000% 100.016% ( 2900, 4400 ] 49 0.002% 100.017% ( 4400, 6600 ] 7 0.000% 100.018% ( 6600, 9900 ] 3 0.000% 100.018% ( 14000, 22000 ] 1 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 515240 Average: 4.8236 StdDev: 78.82 Min: 1 Median: 2.0947 Max: 14378 Percentiles: P50: 2.09 P75: 2.95 P99: 9.23 P99.9: 14.64 P99.99: 23.64 ------------------------------------------------------ [ 0, 1 ] 10552 2.048% 2.048% ( 1, 2 ] 232791 45.181% 47.229% ######### ( 2, 3 ] 150702 29.249% 76.478% ###### ( 3, 4 ] 52209 10.133% 86.611% ## ( 4, 6 ] 54369 10.552% 97.163% ## ( 6, 10 ] 11723 2.275% 99.438% ( 10, 15 ] 2561 0.497% 99.935% ( 15, 22 ] 276 0.054% 99.989% ( 22, 34 ] 40 0.008% 99.997% ( 34, 51 ] 22 0.004% 100.001% ( 51, 76 ] 8 0.002% 100.003% ( 76, 110 ] 58 0.011% 100.014% ( 110, 170 ] 168 0.033% 100.046% ( 170, 250 ] 148 0.029% 100.075% ( 250, 380 ] 97 0.019% 100.094% ( 380, 580 ] 71 0.014% 100.108% ( 580, 870 ] 68 0.013% 100.121% ( 870, 1300 ] 45 0.009% 100.130% ( 1300, 1900 ] 31 0.006% 100.136% ( 1900, 2900 ] 61 0.012% 100.148% ( 2900, 4400 ] 81 0.016% 100.163% ( 4400, 6600 ] 23 0.004% 100.168% ( 6600, 9900 ] 12 0.002% 100.170% ( 14000, 22000 ] 1 0.000% 100.170% ** Level 2 read latency histogram (micros): Count: 76105 Average: 4.1791 StdDev: 85.93 Min: 1 Median: 1.4941 Max: 7937 Percentiles: P50: 1.49 P75: 1.88 P99: 6.35 P99.9: 186.84 P99.99: 4279.21 ------------------------------------------------------ [ 0, 1 ] 13981 18.371% 18.371% #### ( 1, 2 ] 48720 64.017% 82.387% ############# ( 2, 3 ] 7982 10.488% 92.876% ## ( 3, 4 ] 2765 3.633% 96.509% # ( 4, 6 ] 1846 2.426% 98.934% ( 6, 10 ] 575 0.756% 99.690% ( 10, 15 ] 139 0.183% 99.873% ( 15, 22 ] 13 0.017% 99.890% ( 34, 51 ] 1 0.001% 99.891% ( 110, 170 ] 5 0.007% 99.898% ( 170, 250 ] 9 0.012% 99.909% ( 250, 380 ] 6 0.008% 99.917% ( 380, 580 ] 11 0.014% 99.932% ( 580, 870 ] 10 0.013% 99.945% ( 870, 1300 ] 4 0.005% 99.950% ( 1300, 1900 ] 3 0.004% 99.954% ( 1900, 2900 ] 9 0.012% 99.966% ( 2900, 4400 ] 20 0.026% 99.992% ( 4400, 6600 ] 4 0.005% 99.997% ( 6600, 9900 ] 2 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 341961 Average: 9.1893 StdDev: 138.04 Min: 0 Median: 2.0041 Max: 21790 Percentiles: P50: 2.00 P75: 2.93 P99: 12.46 P99.9: 798.56 P99.99: 2370.94 ------------------------------------------------------ [ 0, 1 ] 6151 1.799% 1.799% ( 1, 2 ] 164453 48.091% 49.890% ########## ( 2, 3 ] 92062 26.922% 76.812% ##### ( 3, 4 ] 34559 10.106% 86.918% ## ( 4, 6 ] 32543 9.517% 96.434% ## ( 6, 10 ] 7939 2.322% 98.756% ( 10, 15 ] 1696 0.496% 99.252% ( 15, 22 ] 256 0.075% 99.327% ( 22, 34 ] 49 0.014% 99.341% ( 34, 51 ] 9 0.003% 99.344% ( 51, 76 ] 8 0.002% 99.346% ( 76, 110 ] 24 0.007% 99.353% ( 110, 170 ] 318 0.093% 99.446% ( 170, 250 ] 499 0.146% 99.592% ( 250, 380 ] 485 0.142% 99.734% ( 380, 580 ] 406 0.119% 99.853% ( 580, 870 ] 215 0.063% 99.915% ( 870, 1300 ] 129 0.038% 99.953% ( 1300, 1900 ] 74 0.022% 99.975% ( 1900, 2900 ] 110 0.032% 100.007% ( 2900, 4400 ] 166 0.049% 100.056% ( 4400, 6600 ] 34 0.010% 100.066% ( 6600, 9900 ] 14 0.004% 100.070% ( 9900, 14000 ] 4 0.001% 100.071% ( 14000, 22000 ] 3 0.001% 100.072% ** Level 4 read latency histogram (micros): Count: 8283 Average: 21.0045 StdDev: 248.30 Min: 1 Median: 2.2619 Max: 7170 Percentiles: P50: 2.26 P75: 3.22 P99: 195.51 P99.9: 4198.47 P99.99: 7166.28 ------------------------------------------------------ [ 0, 1 ] 65 0.785% 0.785% ( 1, 2 ] 3416 41.241% 42.026% ######## ( 2, 3 ] 2524 30.472% 72.498% ###### ( 3, 4 ] 928 11.204% 83.702% ## ( 4, 6 ] 886 10.697% 94.398% ## ( 6, 10 ] 270 3.260% 97.658% # ( 10, 15 ] 68 0.821% 98.479% ( 15, 22 ] 7 0.085% 98.563% ( 22, 34 ] 1 0.012% 98.575% ( 76, 110 ] 2 0.024% 98.600% ( 110, 170 ] 23 0.278% 98.877% ( 170, 250 ] 35 0.423% 99.300% ( 250, 380 ] 8 0.097% 99.396% ( 380, 580 ] 9 0.109% 99.505% ( 580, 870 ] 4 0.048% 99.553% ( 870, 1300 ] 4 0.048% 99.602% ( 1300, 1900 ] 2 0.024% 99.626% ( 1900, 2900 ] 9 0.109% 99.734% ( 2900, 4400 ] 17 0.205% 99.940% ( 4400, 6600 ] 5 0.060% 100.000% ( 6600, 9900 ] 1 0.012% 100.012% ** Level 5 read latency histogram (micros): Count: 118 Average: 822.5169 StdDev: 849.67 Min: 113 Median: 380.0000 Max: 3996 Percentiles: P50: 380.00 P75: 1192.50 P99: 3810.00 P99.9: 3996.00 P99.99: 3996.00 ------------------------------------------------------ ( 110, 170 ] 22 18.644% 18.644% #### ( 170, 250 ] 21 17.797% 36.441% #### ( 250, 380 ] 16 13.559% 50.000% ### ( 380, 580 ] 8 6.780% 56.780% # ( 580, 870 ] 11 9.322% 66.102% ## ( 870, 1300 ] 14 11.864% 77.966% ## ( 1300, 1900 ] 10 8.475% 86.441% ## ( 1900, 2900 ] 13 11.017% 97.458% ## ( 2900, 4400 ] 3 2.542% 100.000% # ** DB Stats ** Uptime(secs): 28.0 total, 7.3 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 210.69 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.767 H:M:S, 34.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 134.57 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.955 H:M:S, 54.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/27-12:55:35 ... thread 0: (1000000,7000000) ops and (329210.6,226687.7) ops/second in (3.037569,30.879492) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/12 3.19 GB 113.3 6.5 0.0 6.5 13.1 6.6 0.0 2.0 146.3 293.8 45.64 42.75 125 0.365 6779K 9315 0.0 0.0 L1 4/4 343.90 MB 0.0 3.2 3.2 0.0 3.2 3.2 0.2 1.0 224.9 222.0 14.57 14.12 2 7.283 3326K 41K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.9 1.8 255.2 255.1 1.36 1.33 2 0.682 353K 146 0.0 0.0 L3 15/0 948.01 MB 0.9 2.5 1.4 1.1 2.5 1.4 1.6 1.8 187.5 187.0 13.68 11.48 8 1.710 2564K 4995 0.0 0.0 L4 163/0 9.74 GB 1.0 1.3 1.1 0.2 1.3 1.1 1.8 1.2 138.2 137.6 9.69 6.46 11 0.881 1328K 3800 0.0 0.0 L5 1084/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1282/16 102.66 GB 0.0 13.9 5.9 8.0 20.4 12.4 9.1 3.1 167.2 245.9 84.94 76.15 148 0.574 14M 59K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.9 5.9 8.0 20.4 12.4 9.0 3.1 167.2 245.9 84.94 76.15 148 0.574 14M 59K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.9 5.9 8.0 13.8 5.8 0.0 0.0 218.3 217.3 65.06 58.54 45 1.446 14M 59K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 339.2 19.87 17.60 103 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.1 total, 30.9 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.39 GB write, 672.23 MB/s write, 13.87 GB read, 457.24 MB/s read, 84.9 seconds Interval compaction: 20.39 GB write, 676.23 MB/s write, 13.87 GB read, 459.96 MB/s read, 84.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 17, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 17, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2939016 Average: 2.5253 StdDev: 23.16 Min: 0 Median: 1.5604 Max: 17832 Percentiles: P50: 1.56 P75: 1.95 P99: 6.71 P99.9: 14.94 P99.99: 165.86 ------------------------------------------------------ [ 0, 1 ] 403802 13.739% 13.739% ### ( 1, 2 ] 1901720 64.706% 78.445% ############# ( 2, 3 ] 405921 13.811% 92.257% ### ( 3, 4 ] 113637 3.866% 96.123% # ( 4, 6 ] 79787 2.715% 98.838% # ( 6, 10 ] 26962 0.917% 99.755% ( 10, 15 ] 4304 0.146% 99.902% ( 15, 22 ] 526 0.018% 99.920% ( 22, 34 ] 58 0.002% 99.922% ( 34, 51 ] 16 0.001% 99.922% ( 51, 76 ] 11 0.000% 99.923% ( 76, 110 ] 403 0.014% 99.936% ( 110, 170 ] 1694 0.058% 99.994% ( 170, 250 ] 319 0.011% 100.005% ( 250, 380 ] 211 0.007% 100.012% ( 380, 580 ] 124 0.004% 100.016% ( 580, 870 ] 69 0.002% 100.019% ( 870, 1300 ] 47 0.002% 100.020% ( 1300, 1900 ] 20 0.001% 100.021% ( 1900, 2900 ] 9 0.000% 100.021% ( 2900, 4400 ] 49 0.002% 100.023% ( 4400, 6600 ] 7 0.000% 100.023% ( 6600, 9900 ] 3 0.000% 100.023% ( 14000, 22000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 547941 Average: 4.7355 StdDev: 76.46 Min: 1 Median: 2.0916 Max: 14378 Percentiles: P50: 2.09 P75: 2.95 P99: 9.26 P99.9: 14.76 P99.99: 61.02 ------------------------------------------------------ [ 0, 1 ] 10750 1.962% 1.962% ( 1, 2 ] 248539 45.359% 47.321% ######### ( 2, 3 ] 160357 29.265% 76.586% ###### ( 3, 4 ] 55289 10.090% 86.676% ## ( 4, 6 ] 57256 10.449% 97.126% ## ( 6, 10 ] 12619 2.303% 99.429% ( 10, 15 ] 2714 0.495% 99.924% ( 15, 22 ] 296 0.054% 99.978% ( 22, 34 ] 41 0.007% 99.985% ( 34, 51 ] 22 0.004% 99.989% ( 51, 76 ] 8 0.001% 99.991% ( 76, 110 ] 66 0.012% 100.003% ( 110, 170 ] 195 0.036% 100.039% ( 170, 250 ] 165 0.030% 100.069% ( 250, 380 ] 105 0.019% 100.088% ( 380, 580 ] 74 0.014% 100.101% ( 580, 870 ] 68 0.012% 100.114% ( 870, 1300 ] 45 0.008% 100.122% ( 1300, 1900 ] 31 0.006% 100.128% ( 1900, 2900 ] 61 0.011% 100.139% ( 2900, 4400 ] 81 0.015% 100.153% ( 4400, 6600 ] 23 0.004% 100.158% ( 6600, 9900 ] 12 0.002% 100.160% ( 14000, 22000 ] 1 0.000% 100.160% ** Level 2 read latency histogram (micros): Count: 88407 Average: 4.0325 StdDev: 79.78 Min: 1 Median: 1.5487 Max: 7937 Percentiles: P50: 1.55 P75: 1.95 P99: 7.27 P99.9: 123.65 P99.99: 4186.95 ------------------------------------------------------ [ 0, 1 ] 14133 15.986% 15.986% ### ( 1, 2 ] 54805 61.992% 77.978% ############ ( 2, 3 ] 11180 12.646% 90.624% ### ( 3, 4 ] 4001 4.526% 95.150% # ( 4, 6 ] 3124 3.534% 98.683% # ( 6, 10 ] 880 0.995% 99.679% ( 10, 15 ] 174 0.197% 99.876% ( 15, 22 ] 19 0.021% 99.897% ( 34, 51 ] 1 0.001% 99.898% ( 110, 170 ] 7 0.008% 99.906% ( 170, 250 ] 12 0.014% 99.920% ( 250, 380 ] 6 0.007% 99.926% ( 380, 580 ] 13 0.015% 99.941% ( 580, 870 ] 10 0.011% 99.952% ( 870, 1300 ] 4 0.005% 99.957% ( 1300, 1900 ] 3 0.003% 99.960% ( 1900, 2900 ] 9 0.010% 99.971% ( 2900, 4400 ] 20 0.023% 99.993% ( 4400, 6600 ] 4 0.005% 99.998% ( 6600, 9900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 380107 Average: 8.7565 StdDev: 131.24 Min: 0 Median: 1.9852 Max: 21790 Percentiles: P50: 1.99 P75: 2.91 P99: 12.56 P99.9: 756.94 P99.99: 2299.90 ------------------------------------------------------ [ 0, 1 ] 6984 1.837% 1.837% ( 1, 2 ] 185829 48.889% 50.726% ########## ( 2, 3 ] 100929 26.553% 77.279% ##### ( 3, 4 ] 37717 9.923% 87.201% ## ( 4, 6 ] 35066 9.225% 96.427% ## ( 6, 10 ] 8859 2.331% 98.757% ( 10, 15 ] 1801 0.474% 99.231% ( 15, 22 ] 272 0.072% 99.303% ( 22, 34 ] 50 0.013% 99.316% ( 34, 51 ] 9 0.002% 99.318% ( 51, 76 ] 8 0.002% 99.320% ( 76, 110 ] 42 0.011% 99.332% ( 110, 170 ] 483 0.127% 99.459% ( 170, 250 ] 576 0.152% 99.610% ( 250, 380 ] 534 0.140% 99.751% ( 380, 580 ] 430 0.113% 99.864% ( 580, 870 ] 226 0.059% 99.923% ( 870, 1300 ] 136 0.036% 99.959% ( 1300, 1900 ] 74 0.019% 99.978% ( 1900, 2900 ] 110 0.029% 100.007% ( 2900, 4400 ] 166 0.044% 100.051% ( 4400, 6600 ] 34 0.009% 100.060% ( 6600, 9900 ] 14 0.004% 100.064% ( 9900, 14000 ] 4 0.001% 100.065% ( 14000, 22000 ] 3 0.001% 100.066% ** Level 4 read latency histogram (micros): Count: 14074 Average: 13.6078 StdDev: 190.74 Min: 1 Median: 2.1101 Max: 7170 Percentiles: P50: 2.11 P75: 2.93 P99: 14.86 P99.9: 3687.59 P99.99: 6420.74 ------------------------------------------------------ [ 0, 1 ] 115 0.817% 0.817% ( 1, 2 ] 6452 45.843% 46.661% ######### ( 2, 3 ] 4267 30.318% 76.979% ###### ( 3, 4 ] 1369 9.727% 86.706% ## ( 4, 6 ] 1303 9.258% 95.964% ## ( 6, 10 ] 334 2.373% 98.337% ( 10, 15 ] 96 0.682% 99.019% ( 15, 22 ] 11 0.078% 99.098% ( 22, 34 ] 1 0.007% 99.105% ( 76, 110 ] 3 0.021% 99.126% ( 110, 170 ] 23 0.163% 99.289% ( 170, 250 ] 40 0.284% 99.574% ( 250, 380 ] 9 0.064% 99.638% ( 380, 580 ] 9 0.064% 99.702% ( 580, 870 ] 4 0.028% 99.730% ( 870, 1300 ] 4 0.028% 99.758% ( 1300, 1900 ] 2 0.014% 99.773% ( 1900, 2900 ] 9 0.064% 99.837% ( 2900, 4400 ] 17 0.121% 99.957% ( 4400, 6600 ] 5 0.036% 99.993% ( 6600, 9900 ] 1 0.007% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 745.4937 StdDev: 785.62 Min: 113 Median: 362.2727 Max: 3996 Percentiles: P50: 362.27 P75: 1085.00 P99: 3600.00 P99.9: 3996.00 P99.99: 3996.00 ------------------------------------------------------ ( 110, 170 ] 33 20.625% 20.625% #### ( 170, 250 ] 28 17.500% 38.125% #### ( 250, 380 ] 22 13.750% 51.875% ### ( 380, 580 ] 14 8.750% 60.625% ## ( 580, 870 ] 12 7.500% 68.125% ## ( 870, 1300 ] 22 13.750% 81.875% ### ( 1300, 1900 ] 11 6.875% 88.750% # ( 1900, 2900 ] 15 9.375% 98.125% ## ( 2900, 4400 ] 3 1.875% 100.000% ** DB Stats ** Uptime(secs): 31.1 total, 3.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 221.77 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.801 H:M:S, 31.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 324.01 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.034 H:M:S, 1.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/27-12:55:39 ... thread 0: (1000000,8000000) ops and (300862.8,233895.8) ops/second in (3.323774,34.203266) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/8 4.18 GB 239.1 7.5 0.0 7.5 15.1 7.6 0.0 2.0 146.4 293.7 52.50 49.34 144 0.365 7802K 10K 0.0 0.0 L1 4/4 343.90 MB 0.0 3.2 3.2 0.0 3.2 3.2 0.2 1.0 224.9 222.0 14.57 14.12 2 7.283 3326K 41K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.9 1.8 255.2 255.1 1.36 1.33 2 0.682 353K 146 0.0 0.0 L3 15/0 948.01 MB 0.9 2.5 1.4 1.1 2.5 1.4 1.6 1.8 187.5 187.0 13.68 11.48 8 1.710 2564K 4995 0.0 0.0 L4 163/0 9.74 GB 1.0 1.3 1.1 0.2 1.3 1.1 1.8 1.2 138.2 137.6 9.69 6.46 11 0.881 1328K 3800 0.0 0.0 L5 1084/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1285/12 103.64 GB 0.0 14.9 5.9 9.0 22.4 13.4 9.1 3.0 165.7 249.4 91.81 82.73 167 0.550 15M 60K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.9 5.9 9.0 22.4 13.4 9.0 3.0 165.7 249.4 91.81 82.73 167 0.550 15M 60K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.9 5.9 9.0 14.8 5.8 0.0 0.0 220.3 219.4 69.04 62.45 49 1.409 15M 60K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 340.5 22.76 20.28 118 0.193 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.4 total, 34.2 interval Flush(GB): cumulative 7.567, interval 7.567 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.36 GB write, 665.84 MB/s write, 14.86 GB read, 442.35 MB/s read, 91.8 seconds Interval compaction: 22.36 GB write, 669.42 MB/s write, 14.86 GB read, 444.73 MB/s read, 91.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 17, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 17, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 19, interval: 36 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3284333 Average: 2.5110 StdDev: 22.02 Min: 0 Median: 1.5641 Max: 17832 Percentiles: P50: 1.56 P75: 1.95 P99: 6.71 P99.9: 14.73 P99.99: 164.50 ------------------------------------------------------ [ 0, 1 ] 438224 13.343% 13.343% ### ( 1, 2 ] 2134108 64.978% 78.321% ############# ( 2, 3 ] 459568 13.993% 92.314% ### ( 3, 4 ] 126646 3.856% 96.170% # ( 4, 6 ] 87604 2.667% 98.837% # ( 6, 10 ] 30189 0.919% 99.757% ( 10, 15 ] 4976 0.152% 99.908% ( 15, 22 ] 557 0.017% 99.925% ( 22, 34 ] 65 0.002% 99.927% ( 34, 51 ] 18 0.001% 99.928% ( 51, 76 ] 14 0.000% 99.928% ( 76, 110 ] 415 0.013% 99.941% ( 110, 170 ] 1784 0.054% 99.995% ( 170, 250 ] 346 0.011% 100.006% ( 250, 380 ] 225 0.007% 100.012% ( 380, 580 ] 141 0.004% 100.017% ( 580, 870 ] 70 0.002% 100.019% ( 870, 1300 ] 50 0.002% 100.020% ( 1300, 1900 ] 22 0.001% 100.021% ( 1900, 2900 ] 9 0.000% 100.021% ( 2900, 4400 ] 49 0.001% 100.023% ( 4400, 6600 ] 7 0.000% 100.023% ( 6600, 9900 ] 3 0.000% 100.023% ( 14000, 22000 ] 1 0.000% 100.023% ** Level 1 read latency histogram (micros): Count: 634364 Average: 4.4698 StdDev: 71.13 Min: 1 Median: 1.9789 Max: 14378 Percentiles: P50: 1.98 P75: 2.87 P99: 9.19 P99.9: 15.95 P99.99: 128.89 ------------------------------------------------------ [ 0, 1 ] 17175 2.707% 2.707% # ( 1, 2 ] 306459 48.310% 51.017% ########## ( 2, 3 ] 175089 27.601% 78.618% ###### ( 3, 4 ] 58528 9.226% 87.844% ## ( 4, 6 ] 59384 9.361% 97.205% ## ( 6, 10 ] 14258 2.248% 99.453% ( 10, 15 ] 2796 0.441% 99.894% ( 15, 22 ] 299 0.047% 99.941% ( 22, 34 ] 41 0.006% 99.947% ( 34, 51 ] 22 0.003% 99.951% ( 51, 76 ] 8 0.001% 99.952% ( 76, 110 ] 138 0.022% 99.974% ( 110, 170 ] 329 0.052% 100.026% ( 170, 250 ] 204 0.032% 100.058% ( 250, 380 ] 113 0.018% 100.076% ( 380, 580 ] 75 0.012% 100.087% ( 580, 870 ] 69 0.011% 100.098% ( 870, 1300 ] 45 0.007% 100.105% ( 1300, 1900 ] 31 0.005% 100.110% ( 1900, 2900 ] 61 0.010% 100.120% ( 2900, 4400 ] 81 0.013% 100.133% ( 4400, 6600 ] 23 0.004% 100.136% ( 6600, 9900 ] 12 0.002% 100.138% ( 14000, 22000 ] 1 0.000% 100.138% ** Level 2 read latency histogram (micros): Count: 88407 Average: 4.0325 StdDev: 79.78 Min: 1 Median: 1.5487 Max: 7937 Percentiles: P50: 1.55 P75: 1.95 P99: 7.27 P99.9: 123.65 P99.99: 4186.95 ------------------------------------------------------ [ 0, 1 ] 14133 15.986% 15.986% ### ( 1, 2 ] 54805 61.992% 77.978% ############ ( 2, 3 ] 11180 12.646% 90.624% ### ( 3, 4 ] 4001 4.526% 95.150% # ( 4, 6 ] 3124 3.534% 98.683% # ( 6, 10 ] 880 0.995% 99.679% ( 10, 15 ] 174 0.197% 99.876% ( 15, 22 ] 19 0.021% 99.897% ( 34, 51 ] 1 0.001% 99.898% ( 110, 170 ] 7 0.008% 99.906% ( 170, 250 ] 12 0.014% 99.920% ( 250, 380 ] 6 0.007% 99.926% ( 380, 580 ] 13 0.015% 99.941% ( 580, 870 ] 10 0.011% 99.952% ( 870, 1300 ] 4 0.005% 99.957% ( 1300, 1900 ] 3 0.003% 99.960% ( 1900, 2900 ] 9 0.010% 99.971% ( 2900, 4400 ] 20 0.023% 99.993% ( 4400, 6600 ] 4 0.005% 99.998% ( 6600, 9900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 380107 Average: 8.7565 StdDev: 131.24 Min: 0 Median: 1.9852 Max: 21790 Percentiles: P50: 1.99 P75: 2.91 P99: 12.56 P99.9: 756.94 P99.99: 2299.90 ------------------------------------------------------ [ 0, 1 ] 6984 1.837% 1.837% ( 1, 2 ] 185829 48.889% 50.726% ########## ( 2, 3 ] 100929 26.553% 77.279% ##### ( 3, 4 ] 37717 9.923% 87.201% ## ( 4, 6 ] 35066 9.225% 96.427% ## ( 6, 10 ] 8859 2.331% 98.757% ( 10, 15 ] 1801 0.474% 99.231% ( 15, 22 ] 272 0.072% 99.303% ( 22, 34 ] 50 0.013% 99.316% ( 34, 51 ] 9 0.002% 99.318% ( 51, 76 ] 8 0.002% 99.320% ( 76, 110 ] 42 0.011% 99.332% ( 110, 170 ] 483 0.127% 99.459% ( 170, 250 ] 576 0.152% 99.610% ( 250, 380 ] 534 0.140% 99.751% ( 380, 580 ] 430 0.113% 99.864% ( 580, 870 ] 226 0.059% 99.923% ( 870, 1300 ] 136 0.036% 99.959% ( 1300, 1900 ] 74 0.019% 99.978% ( 1900, 2900 ] 110 0.029% 100.007% ( 2900, 4400 ] 166 0.044% 100.051% ( 4400, 6600 ] 34 0.009% 100.060% ( 6600, 9900 ] 14 0.004% 100.064% ( 9900, 14000 ] 4 0.001% 100.065% ( 14000, 22000 ] 3 0.001% 100.066% ** Level 4 read latency histogram (micros): Count: 14074 Average: 13.6078 StdDev: 190.74 Min: 1 Median: 2.1101 Max: 7170 Percentiles: P50: 2.11 P75: 2.93 P99: 14.86 P99.9: 3687.59 P99.99: 6420.74 ------------------------------------------------------ [ 0, 1 ] 115 0.817% 0.817% ( 1, 2 ] 6452 45.843% 46.661% ######### ( 2, 3 ] 4267 30.318% 76.979% ###### ( 3, 4 ] 1369 9.727% 86.706% ## ( 4, 6 ] 1303 9.258% 95.964% ## ( 6, 10 ] 334 2.373% 98.337% ( 10, 15 ] 96 0.682% 99.019% ( 15, 22 ] 11 0.078% 99.098% ( 22, 34 ] 1 0.007% 99.105% ( 76, 110 ] 3 0.021% 99.126% ( 110, 170 ] 23 0.163% 99.289% ( 170, 250 ] 40 0.284% 99.574% ( 250, 380 ] 9 0.064% 99.638% ( 380, 580 ] 9 0.064% 99.702% ( 580, 870 ] 4 0.028% 99.730% ( 870, 1300 ] 4 0.028% 99.758% ( 1300, 1900 ] 2 0.014% 99.773% ( 1900, 2900 ] 9 0.064% 99.837% ( 2900, 4400 ] 17 0.121% 99.957% ( 4400, 6600 ] 5 0.036% 99.993% ( 6600, 9900 ] 1 0.007% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 745.4937 StdDev: 785.62 Min: 113 Median: 362.2727 Max: 3996 Percentiles: P50: 362.27 P75: 1085.00 P99: 3600.00 P99.9: 3996.00 P99.99: 3996.00 ------------------------------------------------------ ( 110, 170 ] 33 20.625% 20.625% #### ( 170, 250 ] 28 17.500% 38.125% #### ( 250, 380 ] 22 13.750% 51.875% ### ( 380, 580 ] 14 8.750% 60.625% ## ( 580, 870 ] 12 7.500% 68.125% ## ( 870, 1300 ] 22 13.750% 81.875% ### ( 1300, 1900 ] 11 6.875% 88.750% # ( 1900, 2900 ] 15 9.375% 98.125% ## ( 2900, 4400 ] 3 1.875% 100.000% ** DB Stats ** Uptime(secs): 34.4 total, 3.3 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 228.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.165 H:M:S, 29.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 296.11 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.364 H:M:S, 11.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/27-12:55:42 ... thread 0: (1000000,9000000) ops and (312029.5,240589.7) ops/second in (3.204825,37.408091) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/4 3.56 GB 339.8 8.5 0.0 8.5 17.0 8.5 0.0 2.0 146.8 294.6 59.20 55.73 164 0.361 8826K 11K 0.0 0.0 L1 20/0 1.92 GB 196.3 5.1 4.8 0.3 5.1 4.7 0.2 1.1 220.2 217.8 23.86 22.77 3 7.952 4984K 41K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.3 0.2 0.2 0.3 0.2 2.9 1.8 255.2 255.1 1.36 1.33 2 0.682 353K 146 0.0 0.0 L3 15/0 948.01 MB 0.9 2.5 1.4 1.1 2.5 1.4 1.6 1.8 187.5 187.0 13.68 11.48 8 1.710 2564K 4995 0.0 0.0 L4 163/0 9.74 GB 1.0 1.3 1.1 0.2 1.3 1.1 1.8 1.2 138.2 137.6 9.69 6.46 11 0.881 1328K 3800 0.0 0.0 L5 1084/0 88.46 GB 0.9 0.0 0.0 0.0 0.0 0.0 2.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1301/4 104.61 GB 0.0 17.8 7.5 10.3 26.2 15.9 9.1 3.1 168.8 249.3 107.79 97.77 188 0.573 18M 61K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.8 7.5 10.3 26.2 15.9 9.0 3.1 168.8 249.3 107.79 97.77 188 0.573 18M 61K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.8 7.5 10.3 17.7 7.4 0.0 0.0 221.2 220.3 82.26 74.93 54 1.523 18M 61K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 343.0 25.53 22.84 134 0.191 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.6 total, 37.4 interval Flush(GB): cumulative 8.552, interval 8.552 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.25 GB write, 714.89 MB/s write, 17.77 GB read, 484.03 MB/s read, 107.8 seconds Interval compaction: 26.25 GB write, 718.40 MB/s write, 17.77 GB read, 486.41 MB/s read, 107.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 21, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 21, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 19, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 21, total-stops: 19, interval: 40 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3543466 Average: 2.4732 StdDev: 21.29 Min: 0 Median: 1.5516 Max: 17832 Percentiles: P50: 1.55 P75: 1.94 P99: 6.50 P99.9: 14.54 P99.99: 164.47 ------------------------------------------------------ [ 0, 1 ] 500543 14.126% 14.126% ### ( 1, 2 ] 2304688 65.040% 79.166% ############# ( 2, 3 ] 477153 13.466% 92.632% ### ( 3, 4 ] 132068 3.727% 96.359% # ( 4, 6 ] 89716 2.532% 98.891% # ( 6, 10 ] 31071 0.877% 99.768% ( 10, 15 ] 5154 0.145% 99.913% ( 15, 22 ] 578 0.016% 99.930% ( 22, 34 ] 69 0.002% 99.932% ( 34, 51 ] 18 0.001% 99.932% ( 51, 76 ] 20 0.001% 99.933% ( 76, 110 ] 415 0.012% 99.944% ( 110, 170 ] 1784 0.050% 99.995% ( 170, 250 ] 360 0.010% 100.005% ( 250, 380 ] 237 0.007% 100.012% ( 380, 580 ] 147 0.004% 100.016% ( 580, 870 ] 73 0.002% 100.018% ( 870, 1300 ] 53 0.001% 100.019% ( 1300, 1900 ] 24 0.001% 100.020% ( 1900, 2900 ] 9 0.000% 100.020% ( 2900, 4400 ] 49 0.001% 100.022% ( 4400, 6600 ] 7 0.000% 100.022% ( 6600, 9900 ] 3 0.000% 100.022% ( 14000, 22000 ] 1 0.000% 100.022% ** Level 1 read latency histogram (micros): Count: 635370 Average: 4.5146 StdDev: 71.41 Min: 1 Median: 1.9785 Max: 14378 Percentiles: P50: 1.98 P75: 2.87 P99: 9.21 P99.9: 17.22 P99.99: 137.50 ------------------------------------------------------ [ 0, 1 ] 17223 2.711% 2.711% # ( 1, 2 ] 307076 48.330% 51.041% ########## ( 2, 3 ] 175277 27.587% 78.628% ###### ( 3, 4 ] 58592 9.222% 87.849% ## ( 4, 6 ] 59401 9.349% 97.198% ## ( 6, 10 ] 14273 2.246% 99.445% ( 10, 15 ] 2798 0.440% 99.885% ( 15, 22 ] 299 0.047% 99.932% ( 22, 34 ] 41 0.006% 99.939% ( 34, 51 ] 22 0.003% 99.942% ( 51, 76 ] 8 0.001% 99.943% ( 76, 110 ] 142 0.022% 99.966% ( 110, 170 ] 337 0.053% 100.019% ( 170, 250 ] 206 0.032% 100.051% ( 250, 380 ] 122 0.019% 100.070% ( 380, 580 ] 90 0.014% 100.085% ( 580, 870 ] 77 0.012% 100.097% ( 870, 1300 ] 49 0.008% 100.104% ( 1300, 1900 ] 33 0.005% 100.110% ( 1900, 2900 ] 64 0.010% 100.120% ( 2900, 4400 ] 81 0.013% 100.132% ( 4400, 6600 ] 23 0.004% 100.136% ( 6600, 9900 ] 12 0.002% 100.138% ( 14000, 22000 ] 1 0.000% 100.138% ** Level 2 read latency histogram (micros): Count: 88407 Average: 4.0325 StdDev: 79.78 Min: 1 Median: 1.5487 Max: 7937 Percentiles: P50: 1.55 P75: 1.95 P99: 7.27 P99.9: 123.65 P99.99: 4186.95 ------------------------------------------------------ [ 0, 1 ] 14133 15.986% 15.986% ### ( 1, 2 ] 54805 61.992% 77.978% ############ ( 2, 3 ] 11180 12.646% 90.624% ### ( 3, 4 ] 4001 4.526% 95.150% # ( 4, 6 ] 3124 3.534% 98.683% # ( 6, 10 ] 880 0.995% 99.679% ( 10, 15 ] 174 0.197% 99.876% ( 15, 22 ] 19 0.021% 99.897% ( 34, 51 ] 1 0.001% 99.898% ( 110, 170 ] 7 0.008% 99.906% ( 170, 250 ] 12 0.014% 99.920% ( 250, 380 ] 6 0.007% 99.926% ( 380, 580 ] 13 0.015% 99.941% ( 580, 870 ] 10 0.011% 99.952% ( 870, 1300 ] 4 0.005% 99.957% ( 1300, 1900 ] 3 0.003% 99.960% ( 1900, 2900 ] 9 0.010% 99.971% ( 2900, 4400 ] 20 0.023% 99.993% ( 4400, 6600 ] 4 0.005% 99.998% ( 6600, 9900 ] 2 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 380107 Average: 8.7565 StdDev: 131.24 Min: 0 Median: 1.9852 Max: 21790 Percentiles: P50: 1.99 P75: 2.91 P99: 12.56 P99.9: 756.94 P99.99: 2299.90 ------------------------------------------------------ [ 0, 1 ] 6984 1.837% 1.837% ( 1, 2 ] 185829 48.889% 50.726% ########## ( 2, 3 ] 100929 26.553% 77.279% ##### ( 3, 4 ] 37717 9.923% 87.201% ## ( 4, 6 ] 35066 9.225% 96.427% ## ( 6, 10 ] 8859 2.331% 98.757% ( 10, 15 ] 1801 0.474% 99.231% ( 15, 22 ] 272 0.072% 99.303% ( 22, 34 ] 50 0.013% 99.316% ( 34, 51 ] 9 0.002% 99.318% ( 51, 76 ] 8 0.002% 99.320% ( 76, 110 ] 42 0.011% 99.332% ( 110, 170 ] 483 0.127% 99.459% ( 170, 250 ] 576 0.152% 99.610% ( 250, 380 ] 534 0.140% 99.751% ( 380, 580 ] 430 0.113% 99.864% ( 580, 870 ] 226 0.059% 99.923% ( 870, 1300 ] 136 0.036% 99.959% ( 1300, 1900 ] 74 0.019% 99.978% ( 1900, 2900 ] 110 0.029% 100.007% ( 2900, 4400 ] 166 0.044% 100.051% ( 4400, 6600 ] 34 0.009% 100.060% ( 6600, 9900 ] 14 0.004% 100.064% ( 9900, 14000 ] 4 0.001% 100.065% ( 14000, 22000 ] 3 0.001% 100.066% ** Level 4 read latency histogram (micros): Count: 14074 Average: 13.6078 StdDev: 190.74 Min: 1 Median: 2.1101 Max: 7170 Percentiles: P50: 2.11 P75: 2.93 P99: 14.86 P99.9: 3687.59 P99.99: 6420.74 ------------------------------------------------------ [ 0, 1 ] 115 0.817% 0.817% ( 1, 2 ] 6452 45.843% 46.661% ######### ( 2, 3 ] 4267 30.318% 76.979% ###### ( 3, 4 ] 1369 9.727% 86.706% ## ( 4, 6 ] 1303 9.258% 95.964% ## ( 6, 10 ] 334 2.373% 98.337% ( 10, 15 ] 96 0.682% 99.019% ( 15, 22 ] 11 0.078% 99.098% ( 22, 34 ] 1 0.007% 99.105% ( 76, 110 ] 3 0.021% 99.126% ( 110, 170 ] 23 0.163% 99.289% ( 170, 250 ] 40 0.284% 99.574% ( 250, 380 ] 9 0.064% 99.638% ( 380, 580 ] 9 0.064% 99.702% ( 580, 870 ] 4 0.028% 99.730% ( 870, 1300 ] 4 0.028% 99.758% ( 1300, 1900 ] 2 0.014% 99.773% ( 1900, 2900 ] 9 0.064% 99.837% ( 2900, 4400 ] 17 0.121% 99.957% ( 4400, 6600 ] 5 0.036% 99.993% ( 6600, 9900 ] 1 0.007% 100.000% ** Level 5 read latency histogram (micros): Count: 160 Average: 745.4937 StdDev: 785.62 Min: 113 Median: 362.2727 Max: 3996 Percentiles: P50: 362.27 P75: 1085.00 P99: 3600.00 P99.9: 3996.00 P99.99: 3996.00 ------------------------------------------------------ ( 110, 170 ] 33 20.625% 20.625% #### ( 170, 250 ] 28 17.500% 38.125% #### ( 250, 380 ] 22 13.750% 51.875% ### ( 380, 580 ] 14 8.750% 60.625% ## ( 580, 870 ] 12 7.500% 68.125% ## ( 870, 1300 ] 22 13.750% 81.875% ### ( 1300, 1900 ] 11 6.875% 88.750% # ( 1900, 2900 ] 15 9.375% 98.125% ## ( 2900, 4400 ] 3 1.875% 100.000% ** DB Stats ** Uptime(secs): 37.6 total, 3.2 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 235.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.453 H:M:S, 27.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 307.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.288 H:M:S, 9.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.445 micros/op 155168 ops/sec 60.263 seconds 9350999 operations; 150.3 MB/s Microseconds per write: Count: 9350999 Average: 6.4446 StdDev: 210.66 Min: 1 Median: 1.8381 Max: 482780 Percentiles: P50: 1.84 P75: 3.20 P99: 11.03 P99.9: 1190.65 P99.99: 2694.61 ------------------------------------------------------ [ 0, 1 ] 940726 10.060% 10.060% ## ( 1, 2 ] 4456355 47.656% 57.717% ########## ( 2, 3 ] 1367756 14.627% 72.343% ### ( 3, 4 ] 1259098 13.465% 85.808% ### ( 4, 6 ] 1034830 11.067% 96.875% ## ( 6, 10 ] 188106 2.012% 98.886% ( 10, 15 ] 51712 0.553% 99.439% ( 15, 22 ] 15270 0.163% 99.603% ( 22, 34 ] 2951 0.032% 99.634% ( 34, 51 ] 517 0.006% 99.640% ( 51, 76 ] 96 0.001% 99.641% ( 76, 110 ] 13 0.000% 99.641% ( 110, 170 ] 8561 0.092% 99.733% ( 170, 250 ] 663 0.007% 99.740% ( 250, 380 ] 233 0.002% 99.742% ( 380, 580 ] 53 0.001% 99.743% ( 580, 870 ] 17 0.000% 99.743% ( 870, 1300 ] 19701 0.211% 99.954% ( 1300, 1900 ] 32 0.000% 99.954% ( 1900, 2900 ] 4246 0.045% 99.999% ( 2900, 4400 ] 51 0.001% 100.000% ( 4400, 6600 ] 2 0.000% 100.000% ( 6600, 9900 ] 2 0.000% 100.000% ( 22000, 33000 ] 2 0.000% 100.000% ( 33000, 50000 ] 1 0.000% 100.000% ( 110000, 170000 ] 1 0.000% 100.000% ( 170000, 250000 ] 3 0.000% 100.000% ( 380000, 570000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 193345 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9350999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 9650230968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 410 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 31328979 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 24658601284 rocksdb.compact.write.bytes COUNT : 24484429443 rocksdb.flush.write.bytes COUNT : 9644752515 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 42 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 235 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 9566521344 rocksdb.memtable.garbage.bytes.at.flush COUNT : 3317760 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 24740402242 rocksdb.non.last.level.read.count COUNT : 5979361 rocksdb.block.checksum.compute.count COUNT : 5978583 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.492725 P95 : 5.133152 P99 : 9.747108 P100 : 482777.000000 COUNT : 9350999 SUM : 55494859 rocksdb.compaction.times.micros P50 : 1066060.606061 P95 : 3926666.666667 P99 : 11648000.000000 P100 : 13236268.000000 COUNT : 56 SUM : 84160178 rocksdb.compaction.times.cpu_micros P50 : 988965.517241 P95 : 3926666.666667 P99 : 11648000.000000 P100 : 12816747.000000 COUNT : 56 SUM : 76807070 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 534.117647 P95 : 869.670455 P99 : 1087.000000 P100 : 1087.000000 COUNT : 141 SUM : 82661 rocksdb.compaction.outfile.sync.micros P50 : 759.587156 P95 : 4394.642857 P99 : 7243.500000 P100 : 29470.000000 COUNT : 261 SUM : 333543 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 98.342857 P95 : 329.181818 P99 : 2640.000000 P100 : 3315.000000 COUNT : 226 SUM : 37564 rocksdb.table.open.io.micros P50 : 816.225166 P95 : 6380.000000 P99 : 19018.181818 P100 : 21314.000000 COUNT : 410 SUM : 768445 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.655807 P95 : 7.365880 P99 : 12.108567 P100 : 21797.000000 COUNT : 5977311 SUM : 32845125 rocksdb.read.block.get.micros P50 : 359.396226 P95 : 2669.230769 P99 : 5889.230769 P100 : 8279.000000 COUNT : 820 SUM : 557823 rocksdb.write.raw.block.micros P50 : 0.513812 P95 : 0.976242 P99 : 3.017114 P100 : 28224.000000 COUNT : 8265408 SUM : 16606468 rocksdb.numfiles.in.singlecompaction P50 : 3.447761 P95 : 6.133333 P99 : 34.340000 P100 : 37.000000 COUNT : 98 SUM : 416 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.569737 P95 : 1177.934042 P99 : 2436.882228 P100 : 482544.000000 COUNT : 197023 SUM : 31351488 rocksdb.sst.read.micros P50 : 1.562212 P95 : 4.056294 P99 : 8.567106 P100 : 21790.000000 COUNT : 5979361 SUM : 20060426 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9350999 SUM : 9650230968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 195054.945055 P95 : 274700.000000 P99 : 531050.000000 P100 : 765612.000000 COUNT : 141 SUM : 26829486 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 253 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0