[2024-07-26 04:11:09.987445] Starting SPDK v24.05.1-pre git sha1 241d0f3c9 / DPDK 22.11.4 initialization... [2024-07-26 04:11:09.987573] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid248649 ] Set seed to 1721959869985023 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-07-26 04:11:10.076561] app.c: 909:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-07-26 04:11:10.120317] app.c: 604:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-07-26 04:11:10.120364] app.c: 605:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 248649' to capture a snapshot of events at runtime. [2024-07-26 04:11:10.120374] app.c: 610:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-07-26 04:11:10.120384] app.c: 611:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-07-26 04:11:10.120391] app.c: 612:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid248649 for offline analysis/debug. [2024-07-26 04:11:10.120481] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Jul 26 04:11:14 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/07/26-04:11:17 ... thread 0: (1000000,1000000) ops and (333729.0,333729.0) ops/second in (2.996443,2.996443) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 440.96 MB 12.6 0.0 0.0 0.0 0.9 0.9 0.0 1.0 0.0 341.5 2.58 2.33 12 0.215 0 0 0.0 0.0 L1 4/0 251.73 MB 25.2 0.2 0.2 0.0 0.2 0.2 0.2 1.0 251.2 250.9 1.00 0.97 1 1.003 255K 259 0.0 0.0 L2 1/0 1.46 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.2 1.5 259.2 259.1 0.73 0.70 1 0.729 191K 90 0.0 0.0 L3 18/0 928.71 MB 0.9 0.2 0.2 0.0 0.2 0.2 0.1 1.0 231.9 231.9 0.81 0.75 1 0.808 190K 0 0.0 0.0 L4 116/0 9.60 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1044/0 85.82 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1189/4 97.00 GB 0.0 0.6 0.6 0.1 1.5 1.4 0.5 1.7 122.7 294.7 5.12 4.75 15 0.342 638K 349 0.0 0.0 Int 0/0 0.00 KB 0.0 0.6 0.6 0.1 1.5 1.4 0.4 1.7 122.7 294.7 5.12 4.75 15 0.342 638K 349 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 0.6 0.6 0.1 0.6 0.6 0.0 0.0 247.3 247.2 2.54 2.42 3 0.847 638K 349 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 341.5 2.58 2.33 12 0.215 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 3.2 total, 3.0 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 1.47 GB write, 469.46 MB/s write, 0.61 GB read, 195.38 MB/s read, 5.1 seconds Interval compaction: 1.47 GB write, 503.60 MB/s write, 0.61 GB read, 209.58 MB/s read, 5.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 3, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 3, interval: 3 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 144644 Average: 1.9350 StdDev: 18.82 Min: 0 Median: 1.2595 Max: 3449 Percentiles: P50: 1.26 P75: 1.69 P99: 4.47 P99.9: 9.90 P99.99: 149.21 ------------------------------------------------------ [ 0, 1 ] 50708 35.057% 35.057% ####### ( 1, 2 ] 83295 57.586% 92.643% ############ ( 2, 3 ] 6313 4.365% 97.008% # ( 3, 4 ] 2600 1.798% 98.805% ( 4, 6 ] 1196 0.827% 99.632% ( 6, 10 ] 399 0.276% 99.908% ( 10, 15 ] 94 0.065% 99.973% ( 15, 22 ] 12 0.008% 99.981% ( 22, 34 ] 6 0.004% 99.985% ( 34, 51 ] 2 0.001% 99.987% ( 110, 170 ] 10 0.007% 99.994% ( 250, 380 ] 6 0.004% 99.998% ( 580, 870 ] 1 0.001% 99.999% ( 1300, 1900 ] 2 0.001% 100.000% ( 1900, 2900 ] 3 0.002% 100.002% ( 2900, 4400 ] 2 0.001% 100.003% ** Level 1 read latency histogram (micros): Count: 25 Average: 399.5600 StdDev: 879.08 Min: 1 Median: 2.8333 Max: 3818 Percentiles: P50: 2.83 P75: 369.17 P99: 3818.00 P99.9: 3818.00 P99.99: 3818.00 ------------------------------------------------------ [ 0, 1 ] 4 16.000% 16.000% ### ( 1, 2 ] 6 24.000% 40.000% ##### ( 2, 3 ] 3 12.000% 52.000% ## ( 3, 4 ] 1 4.000% 56.000% # ( 110, 170 ] 2 8.000% 64.000% ## ( 250, 380 ] 3 12.000% 76.000% ## ( 380, 580 ] 3 12.000% 88.000% ## ( 580, 870 ] 1 4.000% 92.000% # ( 1900, 2900 ] 1 4.000% 96.000% # ( 2900, 4400 ] 1 4.000% 100.000% # ** Level 2 read latency histogram (micros): Count: 47592 Average: 2.1012 StdDev: 4.77 Min: 0 Median: 1.4717 Max: 899 Percentiles: P50: 1.47 P75: 1.84 P99: 5.57 P99.9: 9.88 P99.99: 16.69 ------------------------------------------------------ [ 0, 1 ] 8620 18.112% 18.112% #### ( 1, 2 ] 32172 67.600% 85.712% ############## ( 2, 3 ] 4135 8.688% 94.400% ## ( 3, 4 ] 1498 3.148% 97.548% # ( 4, 6 ] 882 1.853% 99.401% ( 6, 10 ] 245 0.515% 99.916% ( 10, 15 ] 35 0.074% 99.989% ( 15, 22 ] 1 0.002% 99.992% ( 110, 170 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 85 Average: 746.2706 StdDev: 1225.86 Min: 0 Median: 230.0000 Max: 6979 Percentiles: P50: 230.00 P75: 1017.81 P99: 6979.00 P99.9: 6979.00 P99.99: 6979.00 ------------------------------------------------------ [ 0, 1 ] 21 24.706% 24.706% ##### ( 1, 2 ] 12 14.118% 38.824% ### ( 2, 3 ] 1 1.176% 40.000% ( 3, 4 ] 2 2.353% 42.353% ( 4, 6 ] 2 2.353% 44.706% ( 6, 10 ] 1 1.176% 45.882% ( 10, 15 ] 1 1.176% 47.059% ( 110, 170 ] 1 1.176% 48.235% ( 170, 250 ] 2 2.353% 50.588% ( 250, 380 ] 4 4.706% 55.294% # ( 380, 580 ] 9 10.588% 65.882% ## ( 580, 870 ] 5 5.882% 71.765% # ( 870, 1300 ] 8 9.412% 81.176% ## ( 1300, 1900 ] 6 7.059% 88.235% # ( 1900, 2900 ] 3 3.529% 91.765% # ( 2900, 4400 ] 5 5.882% 97.647% # ( 4400, 6600 ] 1 1.176% 98.824% ( 6600, 9900 ] 1 1.176% 100.000% ** Level 4 read latency histogram (micros): Count: 35 Average: 1465.8000 StdDev: 1323.70 Min: 111 Median: 797.5000 Max: 4274 Percentiles: P50: 797.50 P75: 2650.00 P99: 4274.00 P99.9: 4274.00 P99.99: 4274.00 ------------------------------------------------------ ( 110, 170 ] 2 5.714% 5.714% # ( 170, 250 ] 2 5.714% 11.429% # ( 250, 380 ] 3 8.571% 20.000% ## ( 380, 580 ] 6 17.143% 37.143% ### ( 580, 870 ] 6 17.143% 54.286% ### ( 870, 1300 ] 3 8.571% 62.857% ## ( 1300, 1900 ] 2 5.714% 68.571% # ( 1900, 2900 ] 3 8.571% 77.143% ## ( 2900, 4400 ] 8 22.857% 100.000% ##### ** DB Stats ** Uptime(secs): 3.2 total, 3.0 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 305.97 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.455 H:M:S, 14.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 328.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.455 H:M:S, 15.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/26-04:11:20 ... thread 0: (1000000,2000000) ops and (335501.5,334612.9) ops/second in (2.980613,5.977056) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/10 1.35 GB 25.2 0.6 0.0 0.6 2.3 1.8 0.0 1.3 76.9 324.4 7.38 6.78 27 0.273 575K 609 0.0 0.0 L1 1/1 1.89 MB 0.0 0.2 0.2 0.0 0.2 0.2 0.2 1.0 251.2 250.9 1.00 0.97 1 1.003 255K 259 0.0 0.0 L2 1/0 1.46 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 1.5 259.2 259.1 0.73 0.70 1 0.729 191K 90 0.0 0.0 L3 33/0 986.90 MB 1.0 0.6 0.4 0.2 0.6 0.4 0.1 1.4 203.1 202.9 3.08 2.67 3 1.025 634K 481 0.0 0.0 L4 140/0 9.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L5 1048/0 86.19 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1236/11 97.92 GB 0.0 1.6 0.8 0.8 3.4 2.6 1.3 1.9 134.0 283.8 12.18 11.13 32 0.381 1657K 1439 0.0 0.0 Int 0/0 0.00 KB 0.0 1.6 0.8 0.8 3.4 2.6 1.2 1.9 134.0 283.8 12.18 11.13 32 0.381 1657K 1439 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.6 0.8 0.8 1.6 0.8 0.0 0.0 236.5 236.3 6.90 6.40 7 0.986 1657K 1439 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 345.9 5.28 4.73 25 0.211 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 6.2 total, 6.0 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 3.38 GB write, 558.01 MB/s write, 1.59 GB read, 263.45 MB/s read, 12.2 seconds Interval compaction: 3.38 GB write, 578.36 MB/s write, 1.59 GB read, 273.06 MB/s read, 12.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 416576 Average: 2.0601 StdDev: 13.40 Min: 0 Median: 1.3978 Max: 3449 Percentiles: P50: 1.40 P75: 1.80 P99: 5.36 P99.9: 9.96 P99.99: 17.83 ------------------------------------------------------ [ 0, 1 ] 104441 25.071% 25.071% ##### ( 1, 2 ] 261037 62.663% 87.734% ############# ( 2, 3 ] 30547 7.333% 95.067% # ( 3, 4 ] 11846 2.844% 97.910% # ( 4, 6 ] 6677 1.603% 99.513% ( 6, 10 ] 1628 0.391% 99.904% ( 10, 15 ] 344 0.083% 99.987% ( 15, 22 ] 38 0.009% 99.996% ( 22, 34 ] 8 0.002% 99.998% ( 34, 51 ] 5 0.001% 99.999% ( 51, 76 ] 3 0.001% 100.000% ( 110, 170 ] 20 0.005% 100.004% ( 170, 250 ] 3 0.001% 100.005% ( 250, 380 ] 12 0.003% 100.008% ( 380, 580 ] 1 0.000% 100.008% ( 580, 870 ] 5 0.001% 100.009% ( 870, 1300 ] 2 0.000% 100.010% ( 1300, 1900 ] 4 0.001% 100.011% ( 1900, 2900 ] 4 0.001% 100.012% ( 2900, 4400 ] 3 0.001% 100.012% ** Level 1 read latency histogram (micros): Count: 63435 Average: 2.4588 StdDev: 19.18 Min: 1 Median: 1.5889 Max: 3818 Percentiles: P50: 1.59 P75: 1.97 P99: 5.93 P99.9: 12.45 P99.99: 25.94 ------------------------------------------------------ [ 0, 1 ] 7087 11.172% 11.172% ## ( 1, 2 ] 41822 65.929% 77.101% ############# ( 2, 3 ] 8474 13.359% 90.460% ### ( 3, 4 ] 3033 4.781% 95.241% # ( 4, 6 ] 2475 3.902% 99.142% # ( 6, 10 ] 434 0.684% 99.827% ( 10, 15 ] 95 0.150% 99.976% ( 15, 22 ] 8 0.013% 99.989% ( 22, 34 ] 2 0.003% 99.992% ( 34, 51 ] 1 0.002% 99.994% ( 51, 76 ] 1 0.002% 99.995% ( 110, 170 ] 2 0.003% 99.998% ( 250, 380 ] 3 0.005% 100.003% ( 380, 580 ] 3 0.005% 100.008% ( 580, 870 ] 1 0.002% 100.009% ( 1900, 2900 ] 1 0.002% 100.011% ( 2900, 4400 ] 1 0.002% 100.013% ** Level 2 read latency histogram (micros): Count: 47592 Average: 2.1012 StdDev: 4.77 Min: 0 Median: 1.4717 Max: 899 Percentiles: P50: 1.47 P75: 1.84 P99: 5.57 P99.9: 9.88 P99.99: 16.69 ------------------------------------------------------ [ 0, 1 ] 8620 18.112% 18.112% #### ( 1, 2 ] 32172 67.600% 85.712% ############## ( 2, 3 ] 4135 8.688% 94.400% ## ( 3, 4 ] 1498 3.148% 97.548% # ( 4, 6 ] 882 1.853% 99.401% ( 6, 10 ] 245 0.515% 99.916% ( 10, 15 ] 35 0.074% 99.989% ( 15, 22 ] 1 0.002% 99.992% ( 110, 170 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 47918 Average: 3.6947 StdDev: 60.83 Min: 0 Median: 1.5714 Max: 6979 Percentiles: P50: 1.57 P75: 1.95 P99: 6.44 P99.9: 197.76 P99.99: 2636.07 ------------------------------------------------------ [ 0, 1 ] 6041 12.607% 12.607% ### ( 1, 2 ] 31358 65.441% 78.048% ############# ( 2, 3 ] 6021 12.565% 90.613% ### ( 3, 4 ] 2260 4.716% 95.330% # ( 4, 6 ] 1720 3.589% 98.919% # ( 6, 10 ] 352 0.735% 99.654% ( 10, 15 ] 61 0.127% 99.781% ( 15, 22 ] 31 0.065% 99.846% ( 22, 34 ] 18 0.038% 99.883% ( 51, 76 ] 1 0.002% 99.885% ( 110, 170 ] 5 0.010% 99.896% ( 170, 250 ] 6 0.013% 99.908% ( 250, 380 ] 6 0.013% 99.921% ( 380, 580 ] 11 0.023% 99.944% ( 580, 870 ] 5 0.010% 99.954% ( 870, 1300 ] 8 0.017% 99.971% ( 1300, 1900 ] 7 0.015% 99.985% ( 1900, 2900 ] 3 0.006% 99.992% ( 2900, 4400 ] 5 0.010% 100.002% ( 4400, 6600 ] 1 0.002% 100.004% ( 6600, 9900 ] 1 0.002% 100.006% ** Level 4 read latency histogram (micros): Count: 35 Average: 1465.8000 StdDev: 1323.70 Min: 111 Median: 797.5000 Max: 4274 Percentiles: P50: 797.50 P75: 2650.00 P99: 4274.00 P99.9: 4274.00 P99.99: 4274.00 ------------------------------------------------------ ( 110, 170 ] 2 5.714% 5.714% # ( 170, 250 ] 2 5.714% 11.429% # ( 250, 380 ] 3 8.571% 20.000% ## ( 380, 580 ] 6 17.143% 37.143% ### ( 580, 870 ] 6 17.143% 54.286% ### ( 870, 1300 ] 3 8.571% 62.857% ## ( 1300, 1900 ] 2 5.714% 68.571% # ( 1900, 2900 ] 3 8.571% 77.143% ## ( 2900, 4400 ] 8 22.857% 100.000% ##### ** Level 5 read latency histogram (micros): Count: 20 Average: 825.2500 StdDev: 1068.13 Min: 94 Median: 315.0000 Max: 3534 Percentiles: P50: 315.00 P75: 1085.00 P99: 3534.00 P99.9: 3534.00 P99.99: 3534.00 ------------------------------------------------------ ( 76, 110 ] 3 15.000% 15.000% ### ( 110, 170 ] 3 15.000% 30.000% ### ( 170, 250 ] 3 15.000% 45.000% ### ( 250, 380 ] 2 10.000% 55.000% ## ( 380, 580 ] 3 15.000% 70.000% ### ( 870, 1300 ] 2 10.000% 80.000% ## ( 1300, 1900 ] 1 5.000% 85.000% # ( 1900, 2900 ] 1 5.000% 90.000% # ( 2900, 4400 ] 2 10.000% 100.000% ## ** DB Stats ** Uptime(secs): 6.2 total, 3.0 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 317.62 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.852 H:M:S, 13.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 330.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.397 H:M:S, 13.3 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-04:11:23 ... thread 0: (1000000,3000000) ops and (336705.7,335307.6) ops/second in (2.969953,8.947009) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.48 GB 94.4 1.4 0.0 1.4 4.1 2.8 0.0 1.5 104.3 317.4 13.29 12.33 44 0.302 1407K 1429 0.0 0.0 L1 5/0 430.71 MB 43.1 1.1 1.1 0.0 1.1 1.1 0.2 1.0 238.2 237.5 4.77 4.63 2 2.383 1152K 3205 0.0 0.0 L2 2/0 64.52 MB 0.6 0.2 0.1 0.1 0.2 0.1 0.9 1.5 259.2 259.1 0.73 0.70 1 0.729 191K 90 0.0 0.0 L3 16/0 863.52 MB 0.9 0.7 0.6 0.2 0.7 0.6 0.4 1.3 208.3 208.2 3.65 3.23 4 0.912 765K 481 0.0 0.0 L4 169/0 9.60 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.6 1.0 168.3 168.3 0.67 0.55 1 0.665 93K 0 0.0 0.0 L5 1052/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1256/8 98.90 GB 0.0 3.5 1.9 1.6 6.3 4.7 2.6 2.3 155.1 277.5 23.10 21.44 52 0.444 3610K 5205 0.0 0.0 Int 0/0 0.00 KB 0.0 3.5 1.9 1.6 6.3 4.7 2.5 2.3 155.1 277.5 23.10 21.44 52 0.444 3610K 5205 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 3.5 1.9 1.6 3.5 1.9 0.0 0.0 239.6 239.2 14.95 14.14 13 1.150 3610K 5205 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 347.8 8.15 7.29 39 0.209 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 9.2 total, 8.9 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.26 GB write, 699.44 MB/s write, 3.50 GB read, 390.80 MB/s read, 23.1 seconds Interval compaction: 6.26 GB write, 716.48 MB/s write, 3.50 GB read, 400.32 MB/s read, 23.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 15, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 15, interval: 15 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 741809 Average: 2.0873 StdDev: 11.39 Min: 0 Median: 1.4335 Max: 3449 Percentiles: P50: 1.43 P75: 1.82 P99: 5.37 P99.9: 9.95 P99.99: 14.89 ------------------------------------------------------ [ 0, 1 ] 163402 22.028% 22.028% #### ( 1, 2 ] 478673 64.528% 86.555% ############# ( 2, 3 ] 61399 8.277% 94.832% ## ( 3, 4 ] 22539 3.038% 97.871% # ( 4, 6 ] 12237 1.650% 99.520% ( 6, 10 ] 2858 0.385% 99.906% ( 10, 15 ] 643 0.087% 99.992% ( 15, 22 ] 57 0.008% 100.000% ( 22, 34 ] 13 0.002% 100.002% ( 34, 51 ] 6 0.001% 100.002% ( 51, 76 ] 5 0.001% 100.003% ( 76, 110 ] 1 0.000% 100.003% ( 110, 170 ] 28 0.004% 100.007% ( 170, 250 ] 9 0.001% 100.008% ( 250, 380 ] 21 0.003% 100.011% ( 380, 580 ] 4 0.001% 100.012% ( 580, 870 ] 10 0.001% 100.013% ( 870, 1300 ] 5 0.001% 100.014% ( 1300, 1900 ] 5 0.001% 100.014% ( 1900, 2900 ] 4 0.001% 100.015% ( 2900, 4400 ] 4 0.001% 100.015% ** Level 1 read latency histogram (micros): Count: 96656 Average: 2.5891 StdDev: 19.74 Min: 0 Median: 1.6256 Max: 3818 Percentiles: P50: 1.63 P75: 2.03 P99: 5.93 P99.9: 12.73 P99.99: 349.07 ------------------------------------------------------ [ 0, 1 ] 8710 9.011% 9.011% ## ( 1, 2 ] 63328 65.519% 74.530% ############# ( 2, 3 ] 14666 15.173% 89.704% ### ( 3, 4 ] 5017 5.191% 94.894% # ( 4, 6 ] 4110 4.252% 99.146% # ( 6, 10 ] 654 0.677% 99.823% ( 10, 15 ] 136 0.141% 99.964% ( 15, 22 ] 11 0.011% 99.975% ( 22, 34 ] 3 0.003% 99.978% ( 34, 51 ] 1 0.001% 99.979% ( 51, 76 ] 1 0.001% 99.980% ( 110, 170 ] 3 0.003% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 250, 380 ] 7 0.007% 99.992% ( 380, 580 ] 7 0.007% 99.999% ( 580, 870 ] 1 0.001% 100.000% ( 870, 1300 ] 3 0.003% 100.003% ( 1300, 1900 ] 3 0.003% 100.006% ( 1900, 2900 ] 1 0.001% 100.007% ( 2900, 4400 ] 1 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 47592 Average: 2.1012 StdDev: 4.77 Min: 0 Median: 1.4717 Max: 899 Percentiles: P50: 1.47 P75: 1.84 P99: 5.57 P99.9: 9.88 P99.99: 16.69 ------------------------------------------------------ [ 0, 1 ] 8620 18.112% 18.112% #### ( 1, 2 ] 32172 67.600% 85.712% ############## ( 2, 3 ] 4135 8.688% 94.400% ## ( 3, 4 ] 1498 3.148% 97.548% # ( 4, 6 ] 882 1.853% 99.401% ( 6, 10 ] 245 0.515% 99.916% ( 10, 15 ] 35 0.074% 99.989% ( 15, 22 ] 1 0.002% 99.992% ( 110, 170 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 78104 Average: 3.2698 StdDev: 47.73 Min: 0 Median: 1.6399 Max: 6979 Percentiles: P50: 1.64 P75: 2.12 P99: 6.19 P99.9: 22.60 P99.99: 1744.82 ------------------------------------------------------ [ 0, 1 ] 7198 9.216% 9.216% ## ( 1, 2 ] 49783 63.739% 72.955% ############# ( 2, 3 ] 12836 16.434% 89.390% ### ( 3, 4 ] 4225 5.409% 94.799% # ( 4, 6 ] 3253 4.165% 98.964% # ( 6, 10 ] 584 0.748% 99.712% ( 10, 15 ] 108 0.138% 99.850% ( 15, 22 ] 38 0.049% 99.899% ( 22, 34 ] 18 0.023% 99.922% ( 34, 51 ] 1 0.001% 99.923% ( 51, 76 ] 1 0.001% 99.924% ( 76, 110 ] 1 0.001% 99.926% ( 110, 170 ] 5 0.006% 99.932% ( 170, 250 ] 8 0.010% 99.942% ( 250, 380 ] 6 0.008% 99.950% ( 380, 580 ] 12 0.015% 99.965% ( 580, 870 ] 6 0.008% 99.973% ( 870, 1300 ] 8 0.010% 99.983% ( 1300, 1900 ] 7 0.009% 99.992% ( 1900, 2900 ] 3 0.004% 99.996% ( 2900, 4400 ] 5 0.006% 100.003% ( 4400, 6600 ] 1 0.001% 100.004% ( 6600, 9900 ] 1 0.001% 100.005% ** Level 4 read latency histogram (micros): Count: 120 Average: 440.3917 StdDev: 972.38 Min: 0 Median: 4.6667 Max: 4274 Percentiles: P50: 4.67 P75: 293.33 P99: 4175.00 P99.9: 4274.00 P99.99: 4274.00 ------------------------------------------------------ [ 0, 1 ] 27 22.500% 22.500% ##### ( 1, 2 ] 22 18.333% 40.833% #### ( 2, 3 ] 4 3.333% 44.167% # ( 3, 4 ] 6 5.000% 49.167% # ( 4, 6 ] 3 2.500% 51.667% # ( 6, 10 ] 1 0.833% 52.500% ( 10, 15 ] 4 3.333% 55.833% # ( 15, 22 ] 10 8.333% 64.167% ## ( 22, 34 ] 1 0.833% 65.000% ( 51, 76 ] 1 0.833% 65.833% ( 110, 170 ] 5 4.167% 70.000% # ( 170, 250 ] 5 4.167% 74.167% # ( 250, 380 ] 3 2.500% 76.667% # ( 380, 580 ] 6 5.000% 81.667% # ( 580, 870 ] 6 5.000% 86.667% # ( 870, 1300 ] 3 2.500% 89.167% # ( 1300, 1900 ] 2 1.667% 90.833% ( 1900, 2900 ] 3 2.500% 93.333% # ( 2900, 4400 ] 8 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 751.3000 StdDev: 1015.51 Min: 79 Median: 230.0000 Max: 3534 Percentiles: P50: 230.00 P75: 1013.33 P99: 3534.00 P99.9: 3534.00 P99.99: 3534.00 ------------------------------------------------------ ( 76, 110 ] 9 22.500% 22.500% ##### ( 110, 170 ] 8 20.000% 42.500% #### ( 170, 250 ] 4 10.000% 52.500% ## ( 250, 380 ] 2 5.000% 57.500% # ( 380, 580 ] 5 12.500% 70.000% ### ( 580, 870 ] 1 2.500% 72.500% # ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 3 7.500% 87.500% ## ( 1900, 2900 ] 2 5.000% 92.500% # ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 9.2 total, 3.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 322.08 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.266 H:M:S, 13.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 331.38 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.414 H:M:S, 13.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-04:11:26 ... thread 0: (1000000,4000000) ops and (342166.2,336996.3) ops/second in (2.922556,11.869565) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/11 2.40 GB 12.6 2.5 0.0 2.5 6.1 3.7 0.0 1.7 125.5 313.7 20.08 18.76 61 0.329 2558K 2673 0.0 0.0 L1 5/5 430.71 MB 0.0 1.1 1.1 0.0 1.1 1.1 0.2 1.0 238.2 237.5 4.77 4.63 2 2.383 1152K 3205 0.0 0.0 L2 2/0 64.52 MB 0.6 0.2 0.1 0.1 0.2 0.1 0.9 1.5 259.2 259.1 0.73 0.70 1 0.729 191K 90 0.0 0.0 L3 16/0 863.52 MB 0.9 0.7 0.6 0.2 0.7 0.6 0.4 1.3 208.3 208.2 3.65 3.23 4 0.912 765K 481 0.0 0.0 L4 169/0 9.60 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.6 1.0 168.3 168.3 0.67 0.55 1 0.665 93K 0 0.0 0.0 L5 1052/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1257/16 99.82 GB 0.0 4.6 1.9 2.7 8.3 5.6 2.6 2.2 157.8 284.1 29.89 27.87 69 0.433 4762K 6449 0.0 0.0 Int 0/0 0.00 KB 0.0 4.6 1.9 2.7 8.3 5.6 2.5 2.2 157.8 284.1 29.89 27.87 69 0.433 4762K 6449 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 4.6 1.9 2.7 4.6 1.9 0.0 0.0 246.5 246.2 19.13 18.25 17 1.125 4762K 6449 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.7 3.7 0.0 0.0 0.0 351.5 10.75 9.62 52 0.207 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 12.1 total, 11.9 interval Flush(GB): cumulative 3.691, interval 3.691 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 8.29 GB write, 702.21 MB/s write, 4.61 GB read, 390.12 MB/s read, 29.9 seconds Interval compaction: 8.29 GB write, 715.10 MB/s write, 4.61 GB read, 397.28 MB/s read, 29.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 20, interval: 20 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 995173 Average: 2.0588 StdDev: 13.38 Min: 0 Median: 1.4036 Max: 3449 Percentiles: P50: 1.40 P75: 1.80 P99: 5.24 P99.9: 9.99 P99.99: 14.96 ------------------------------------------------------ [ 0, 1 ] 242163 24.334% 24.334% ##### ( 1, 2 ] 632886 63.596% 87.929% ############# ( 2, 3 ] 74266 7.463% 95.392% # ( 3, 4 ] 27010 2.714% 98.106% # ( 4, 6 ] 14298 1.437% 99.543% ( 6, 10 ] 3564 0.358% 99.901% ( 10, 15 ] 893 0.090% 99.991% ( 15, 22 ] 75 0.008% 99.998% ( 22, 34 ] 14 0.001% 100.000% ( 34, 51 ] 7 0.001% 100.000% ( 51, 76 ] 6 0.001% 100.001% ( 76, 110 ] 1 0.000% 100.001% ( 110, 170 ] 37 0.004% 100.005% ( 170, 250 ] 10 0.001% 100.006% ( 250, 380 ] 23 0.002% 100.008% ( 380, 580 ] 9 0.001% 100.009% ( 580, 870 ] 14 0.001% 100.010% ( 870, 1300 ] 8 0.001% 100.011% ( 1300, 1900 ] 8 0.001% 100.012% ( 1900, 2900 ] 5 0.001% 100.012% ( 2900, 4400 ] 10 0.001% 100.013% ** Level 1 read latency histogram (micros): Count: 96657 Average: 2.5891 StdDev: 19.74 Min: 0 Median: 1.6256 Max: 3818 Percentiles: P50: 1.63 P75: 2.03 P99: 5.93 P99.9: 12.73 P99.99: 349.07 ------------------------------------------------------ [ 0, 1 ] 8710 9.011% 9.011% ## ( 1, 2 ] 63329 65.519% 74.531% ############# ( 2, 3 ] 14666 15.173% 89.704% ### ( 3, 4 ] 5017 5.191% 94.894% # ( 4, 6 ] 4110 4.252% 99.146% # ( 6, 10 ] 654 0.677% 99.823% ( 10, 15 ] 136 0.141% 99.964% ( 15, 22 ] 11 0.011% 99.975% ( 22, 34 ] 3 0.003% 99.978% ( 34, 51 ] 1 0.001% 99.979% ( 51, 76 ] 1 0.001% 99.980% ( 110, 170 ] 3 0.003% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 250, 380 ] 7 0.007% 99.992% ( 380, 580 ] 7 0.007% 99.999% ( 580, 870 ] 1 0.001% 100.000% ( 870, 1300 ] 3 0.003% 100.003% ( 1300, 1900 ] 3 0.003% 100.006% ( 1900, 2900 ] 1 0.001% 100.007% ( 2900, 4400 ] 1 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 47592 Average: 2.1012 StdDev: 4.77 Min: 0 Median: 1.4717 Max: 899 Percentiles: P50: 1.47 P75: 1.84 P99: 5.57 P99.9: 9.88 P99.99: 16.69 ------------------------------------------------------ [ 0, 1 ] 8620 18.112% 18.112% #### ( 1, 2 ] 32172 67.600% 85.712% ############## ( 2, 3 ] 4135 8.688% 94.400% ## ( 3, 4 ] 1498 3.148% 97.548% # ( 4, 6 ] 882 1.853% 99.401% ( 6, 10 ] 245 0.515% 99.916% ( 10, 15 ] 35 0.074% 99.989% ( 15, 22 ] 1 0.002% 99.992% ( 110, 170 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 78104 Average: 3.2698 StdDev: 47.73 Min: 0 Median: 1.6399 Max: 6979 Percentiles: P50: 1.64 P75: 2.12 P99: 6.19 P99.9: 22.60 P99.99: 1744.82 ------------------------------------------------------ [ 0, 1 ] 7198 9.216% 9.216% ## ( 1, 2 ] 49783 63.739% 72.955% ############# ( 2, 3 ] 12836 16.434% 89.390% ### ( 3, 4 ] 4225 5.409% 94.799% # ( 4, 6 ] 3253 4.165% 98.964% # ( 6, 10 ] 584 0.748% 99.712% ( 10, 15 ] 108 0.138% 99.850% ( 15, 22 ] 38 0.049% 99.899% ( 22, 34 ] 18 0.023% 99.922% ( 34, 51 ] 1 0.001% 99.923% ( 51, 76 ] 1 0.001% 99.924% ( 76, 110 ] 1 0.001% 99.926% ( 110, 170 ] 5 0.006% 99.932% ( 170, 250 ] 8 0.010% 99.942% ( 250, 380 ] 6 0.008% 99.950% ( 380, 580 ] 12 0.015% 99.965% ( 580, 870 ] 6 0.008% 99.973% ( 870, 1300 ] 8 0.010% 99.983% ( 1300, 1900 ] 7 0.009% 99.992% ( 1900, 2900 ] 3 0.004% 99.996% ( 2900, 4400 ] 5 0.006% 100.003% ( 4400, 6600 ] 1 0.001% 100.004% ( 6600, 9900 ] 1 0.001% 100.005% ** Level 4 read latency histogram (micros): Count: 120 Average: 440.3917 StdDev: 972.38 Min: 0 Median: 4.6667 Max: 4274 Percentiles: P50: 4.67 P75: 293.33 P99: 4175.00 P99.9: 4274.00 P99.99: 4274.00 ------------------------------------------------------ [ 0, 1 ] 27 22.500% 22.500% ##### ( 1, 2 ] 22 18.333% 40.833% #### ( 2, 3 ] 4 3.333% 44.167% # ( 3, 4 ] 6 5.000% 49.167% # ( 4, 6 ] 3 2.500% 51.667% # ( 6, 10 ] 1 0.833% 52.500% ( 10, 15 ] 4 3.333% 55.833% # ( 15, 22 ] 10 8.333% 64.167% ## ( 22, 34 ] 1 0.833% 65.000% ( 51, 76 ] 1 0.833% 65.833% ( 110, 170 ] 5 4.167% 70.000% # ( 170, 250 ] 5 4.167% 74.167% # ( 250, 380 ] 3 2.500% 76.667% # ( 380, 580 ] 6 5.000% 81.667% # ( 580, 870 ] 6 5.000% 86.667% # ( 870, 1300 ] 3 2.500% 89.167% # ( 1300, 1900 ] 2 1.667% 90.833% ( 1900, 2900 ] 3 2.500% 93.333% # ( 2900, 4400 ] 8 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 751.3000 StdDev: 1015.51 Min: 79 Median: 230.0000 Max: 3534 Percentiles: P50: 230.00 P75: 1013.33 P99: 3534.00 P99.9: 3534.00 P99.99: 3534.00 ------------------------------------------------------ ( 76, 110 ] 9 22.500% 22.500% ##### ( 110, 170 ] 8 20.000% 42.500% #### ( 170, 250 ] 4 10.000% 52.500% ## ( 250, 380 ] 2 5.000% 57.500% # ( 380, 580 ] 5 12.500% 70.000% ### ( 580, 870 ] 1 2.500% 72.500% # ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 3 7.500% 87.500% ## ( 1900, 2900 ] 2 5.000% 92.500% # ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 12.1 total, 2.9 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 325.63 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:1.677 H:M:S, 13.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 336.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.411 H:M:S, 14.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/26-04:11:30 ... thread 0: (1000000,5000000) ops and (264309.3,319427.4) ops/second in (3.783446,15.653011) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/11 3.38 GB 113.3 3.3 0.0 3.3 7.9 4.7 0.0 1.7 128.9 313.6 25.90 24.24 78 0.332 3390K 3538 0.0 0.0 L1 5/5 430.71 MB 0.0 1.1 1.1 0.0 1.1 1.1 0.2 1.0 238.2 237.5 4.77 4.63 2 2.383 1152K 3205 0.0 0.0 L2 2/0 64.52 MB 0.6 0.2 0.1 0.1 0.2 0.1 0.9 1.5 259.2 259.1 0.73 0.70 1 0.729 191K 90 0.0 0.0 L3 16/0 863.52 MB 0.9 0.7 0.6 0.2 0.7 0.6 0.4 1.3 208.3 208.2 3.65 3.23 4 0.912 765K 481 0.0 0.0 L4 169/0 9.60 GB 1.0 0.1 0.1 0.0 0.1 0.1 0.6 1.0 168.3 168.3 0.67 0.55 1 0.665 93K 0 0.0 0.0 L5 1052/0 86.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1262/16 100.80 GB 0.0 5.4 1.9 3.5 10.1 6.6 2.6 2.2 155.0 288.8 35.71 33.35 86 0.415 5593K 7314 0.0 0.0 Int 0/0 0.00 KB 0.0 5.4 1.9 3.5 10.1 6.6 2.5 2.2 155.0 288.8 35.71 33.35 86 0.415 5593K 7314 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.4 1.9 3.5 5.4 1.9 0.0 0.0 250.2 249.8 22.13 21.19 20 1.106 5593K 7314 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 352.4 13.59 12.16 66 0.206 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 15.9 total, 15.7 interval Flush(GB): cumulative 4.675, interval 4.675 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 10.07 GB write, 649.87 MB/s write, 5.41 GB read, 348.73 MB/s read, 35.7 seconds Interval compaction: 10.07 GB write, 658.92 MB/s write, 5.41 GB read, 353.58 MB/s read, 35.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 3, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 3, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 24, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 3, total-stops: 24, interval: 27 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1426435 Average: 2.0800 StdDev: 12.47 Min: 0 Median: 1.4186 Max: 3449 Percentiles: P50: 1.42 P75: 1.80 P99: 5.24 P99.9: 9.98 P99.99: 18.33 ------------------------------------------------------ [ 0, 1 ] 325962 22.852% 22.852% ##### ( 1, 2 ] 925017 64.848% 87.700% ############# ( 2, 3 ] 110166 7.723% 95.423% ## ( 3, 4 ] 39092 2.741% 98.163% # ( 4, 6 ] 19324 1.355% 99.518% ( 6, 10 ] 5471 0.384% 99.902% ( 10, 15 ] 1210 0.085% 99.986% ( 15, 22 ] 108 0.008% 99.994% ( 22, 34 ] 17 0.001% 99.995% ( 34, 51 ] 12 0.001% 99.996% ( 51, 76 ] 7 0.000% 99.997% ( 76, 110 ] 38 0.003% 99.999% ( 110, 170 ] 102 0.007% 100.006% ( 170, 250 ] 20 0.001% 100.008% ( 250, 380 ] 38 0.003% 100.010% ( 380, 580 ] 21 0.001% 100.012% ( 580, 870 ] 23 0.002% 100.014% ( 870, 1300 ] 13 0.001% 100.014% ( 1300, 1900 ] 10 0.001% 100.015% ( 1900, 2900 ] 8 0.001% 100.016% ( 2900, 4400 ] 11 0.001% 100.016% ** Level 1 read latency histogram (micros): Count: 96657 Average: 2.5891 StdDev: 19.74 Min: 0 Median: 1.6256 Max: 3818 Percentiles: P50: 1.63 P75: 2.03 P99: 5.93 P99.9: 12.73 P99.99: 349.07 ------------------------------------------------------ [ 0, 1 ] 8710 9.011% 9.011% ## ( 1, 2 ] 63329 65.519% 74.531% ############# ( 2, 3 ] 14666 15.173% 89.704% ### ( 3, 4 ] 5017 5.191% 94.894% # ( 4, 6 ] 4110 4.252% 99.146% # ( 6, 10 ] 654 0.677% 99.823% ( 10, 15 ] 136 0.141% 99.964% ( 15, 22 ] 11 0.011% 99.975% ( 22, 34 ] 3 0.003% 99.978% ( 34, 51 ] 1 0.001% 99.979% ( 51, 76 ] 1 0.001% 99.980% ( 110, 170 ] 3 0.003% 99.983% ( 170, 250 ] 1 0.001% 99.984% ( 250, 380 ] 7 0.007% 99.992% ( 380, 580 ] 7 0.007% 99.999% ( 580, 870 ] 1 0.001% 100.000% ( 870, 1300 ] 3 0.003% 100.003% ( 1300, 1900 ] 3 0.003% 100.006% ( 1900, 2900 ] 1 0.001% 100.007% ( 2900, 4400 ] 1 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 47592 Average: 2.1012 StdDev: 4.77 Min: 0 Median: 1.4717 Max: 899 Percentiles: P50: 1.47 P75: 1.84 P99: 5.57 P99.9: 9.88 P99.99: 16.69 ------------------------------------------------------ [ 0, 1 ] 8620 18.112% 18.112% #### ( 1, 2 ] 32172 67.600% 85.712% ############## ( 2, 3 ] 4135 8.688% 94.400% ## ( 3, 4 ] 1498 3.148% 97.548% # ( 4, 6 ] 882 1.853% 99.401% ( 6, 10 ] 245 0.515% 99.916% ( 10, 15 ] 35 0.074% 99.989% ( 15, 22 ] 1 0.002% 99.992% ( 110, 170 ] 1 0.002% 99.994% ( 250, 380 ] 2 0.004% 99.998% ( 870, 1300 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 78104 Average: 3.2698 StdDev: 47.73 Min: 0 Median: 1.6399 Max: 6979 Percentiles: P50: 1.64 P75: 2.12 P99: 6.19 P99.9: 22.60 P99.99: 1744.82 ------------------------------------------------------ [ 0, 1 ] 7198 9.216% 9.216% ## ( 1, 2 ] 49783 63.739% 72.955% ############# ( 2, 3 ] 12836 16.434% 89.390% ### ( 3, 4 ] 4225 5.409% 94.799% # ( 4, 6 ] 3253 4.165% 98.964% # ( 6, 10 ] 584 0.748% 99.712% ( 10, 15 ] 108 0.138% 99.850% ( 15, 22 ] 38 0.049% 99.899% ( 22, 34 ] 18 0.023% 99.922% ( 34, 51 ] 1 0.001% 99.923% ( 51, 76 ] 1 0.001% 99.924% ( 76, 110 ] 1 0.001% 99.926% ( 110, 170 ] 5 0.006% 99.932% ( 170, 250 ] 8 0.010% 99.942% ( 250, 380 ] 6 0.008% 99.950% ( 380, 580 ] 12 0.015% 99.965% ( 580, 870 ] 6 0.008% 99.973% ( 870, 1300 ] 8 0.010% 99.983% ( 1300, 1900 ] 7 0.009% 99.992% ( 1900, 2900 ] 3 0.004% 99.996% ( 2900, 4400 ] 5 0.006% 100.003% ( 4400, 6600 ] 1 0.001% 100.004% ( 6600, 9900 ] 1 0.001% 100.005% ** Level 4 read latency histogram (micros): Count: 120 Average: 440.3917 StdDev: 972.38 Min: 0 Median: 4.6667 Max: 4274 Percentiles: P50: 4.67 P75: 293.33 P99: 4175.00 P99.9: 4274.00 P99.99: 4274.00 ------------------------------------------------------ [ 0, 1 ] 27 22.500% 22.500% ##### ( 1, 2 ] 22 18.333% 40.833% #### ( 2, 3 ] 4 3.333% 44.167% # ( 3, 4 ] 6 5.000% 49.167% # ( 4, 6 ] 3 2.500% 51.667% # ( 6, 10 ] 1 0.833% 52.500% ( 10, 15 ] 4 3.333% 55.833% # ( 15, 22 ] 10 8.333% 64.167% ## ( 22, 34 ] 1 0.833% 65.000% ( 51, 76 ] 1 0.833% 65.833% ( 110, 170 ] 5 4.167% 70.000% # ( 170, 250 ] 5 4.167% 74.167% # ( 250, 380 ] 3 2.500% 76.667% # ( 380, 580 ] 6 5.000% 81.667% # ( 580, 870 ] 6 5.000% 86.667% # ( 870, 1300 ] 3 2.500% 89.167% # ( 1300, 1900 ] 2 1.667% 90.833% ( 1900, 2900 ] 3 2.500% 93.333% # ( 2900, 4400 ] 8 6.667% 100.000% # ** Level 5 read latency histogram (micros): Count: 40 Average: 751.3000 StdDev: 1015.51 Min: 79 Median: 230.0000 Max: 3534 Percentiles: P50: 230.00 P75: 1013.33 P99: 3534.00 P99.9: 3534.00 P99.99: 3534.00 ------------------------------------------------------ ( 76, 110 ] 9 22.500% 22.500% ##### ( 110, 170 ] 8 20.000% 42.500% #### ( 170, 250 ] 4 10.000% 52.500% ## ( 250, 380 ] 2 5.000% 57.500% # ( 380, 580 ] 5 12.500% 70.000% ### ( 580, 870 ] 1 2.500% 72.500% # ( 870, 1300 ] 3 7.500% 80.000% ## ( 1300, 1900 ] 3 7.500% 87.500% ## ( 1900, 2900 ] 2 5.000% 92.500% # ( 2900, 4400 ] 3 7.500% 100.000% ## ** DB Stats ** Uptime(secs): 15.9 total, 3.8 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 310.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:2.916 H:M:S, 18.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 260.13 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.239 H:M:S, 32.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/07/26-04:11:40 ... thread 0: (1000000,6000000) ops and (98134.7,232170.4) ops/second in (10.190072,25.843083) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/10 2.03 GB 37.8 4.0 0.0 4.0 9.6 5.6 0.0 1.7 127.1 304.8 32.23 29.47 95 0.339 4157K 4299 0.0 0.0 L1 3/0 191.95 MB 19.2 3.8 3.4 0.4 3.8 3.3 0.2 1.1 226.9 224.6 17.16 16.32 3 5.721 3954K 38K 0.0 0.0 L2 10/6 1.12 GB 5.2 0.2 0.1 0.1 0.2 0.1 3.3 1.5 259.2 259.1 0.73 0.70 1 0.729 191K 90 0.0 0.0 L3 25/14 2.01 GB 1.0 1.1 0.8 0.3 1.1 0.8 1.5 1.3 166.7 166.5 6.90 5.18 7 0.986 1160K 1402 0.0 0.0 L4 166/7 9.55 GB 1.0 0.4 0.4 0.0 0.4 0.4 0.6 1.1 123.8 123.5 3.31 1.94 3 1.105 397K 1181 0.0 0.0 L5 1056/0 86.80 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1272/37 101.69 GB 0.0 9.5 4.7 4.8 15.1 10.3 6.6 2.7 161.4 255.7 60.34 53.61 109 0.554 9862K 45K 0.0 0.0 Int 0/0 0.00 KB 0.0 9.5 4.7 4.8 15.1 10.3 6.5 2.7 161.4 255.7 60.34 53.61 109 0.554 9862K 45K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 9.5 4.7 4.8 9.5 4.7 0.0 0.0 225.2 224.1 43.25 39.00 29 1.491 9862K 45K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.6 5.6 0.0 0.0 0.0 335.4 17.09 14.61 80 0.214 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.1 total, 25.8 interval Flush(GB): cumulative 5.598, interval 5.598 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.06 GB write, 591.84 MB/s write, 9.51 GB read, 373.66 MB/s read, 60.3 seconds Interval compaction: 15.06 GB write, 596.84 MB/s write, 9.51 GB read, 376.81 MB/s read, 60.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 32, interval: 43 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2395509 Average: 2.5524 StdDev: 26.32 Min: 0 Median: 1.4557 Max: 8223 Percentiles: P50: 1.46 P75: 1.84 P99: 6.33 P99.9: 114.48 P99.99: 307.09 ------------------------------------------------------ [ 0, 1 ] 492713 20.568% 20.568% #### ( 1, 2 ] 1547108 64.584% 85.152% ############# ( 2, 3 ] 204794 8.549% 93.701% ## ( 3, 4 ] 79620 3.324% 97.025% # ( 4, 6 ] 45870 1.915% 98.940% ( 6, 10 ] 17496 0.730% 99.670% ( 10, 15 ] 3223 0.135% 99.804% ( 15, 22 ] 392 0.016% 99.821% ( 22, 34 ] 39 0.002% 99.822% ( 34, 51 ] 19 0.001% 99.823% ( 51, 76 ] 39 0.002% 99.825% ( 76, 110 ] 1667 0.070% 99.894% ( 110, 170 ] 1788 0.075% 99.969% ( 170, 250 ] 382 0.016% 99.985% ( 250, 380 ] 272 0.011% 99.996% ( 380, 580 ] 222 0.009% 100.006% ( 580, 870 ] 135 0.006% 100.011% ( 870, 1300 ] 63 0.003% 100.014% ( 1300, 1900 ] 24 0.001% 100.015% ( 1900, 2900 ] 21 0.001% 100.016% ( 2900, 4400 ] 38 0.002% 100.017% ( 4400, 6600 ] 11 0.000% 100.018% ( 6600, 9900 ] 8 0.000% 100.018% ** Level 1 read latency histogram (micros): Count: 500636 Average: 6.3669 StdDev: 107.06 Min: 0 Median: 1.7980 Max: 11204 Percentiles: P50: 1.80 P75: 2.72 P99: 9.49 P99.9: 160.56 P99.99: 571.06 ------------------------------------------------------ [ 0, 1 ] 32196 6.431% 6.431% # ( 1, 2 ] 273324 54.595% 61.026% ########### ( 2, 3 ] 97494 19.474% 80.500% #### ( 3, 4 ] 42633 8.516% 89.016% ## ( 4, 6 ] 41979 8.385% 97.401% ## ( 6, 10 ] 9172 1.832% 99.233% ( 10, 15 ] 2518 0.503% 99.736% ( 15, 22 ] 313 0.063% 99.799% ( 22, 34 ] 19 0.004% 99.803% ( 34, 51 ] 5 0.001% 99.804% ( 51, 76 ] 28 0.006% 99.809% ( 76, 110 ] 185 0.037% 99.846% ( 110, 170 ] 322 0.064% 99.911% ( 170, 250 ] 132 0.026% 99.937% ( 250, 380 ] 117 0.023% 99.960% ( 380, 580 ] 158 0.032% 99.992% ( 580, 870 ] 195 0.039% 100.031% ( 870, 1300 ] 143 0.029% 100.059% ( 1300, 1900 ] 79 0.016% 100.075% ( 1900, 2900 ] 91 0.018% 100.093% ( 2900, 4400 ] 155 0.031% 100.124% ( 4400, 6600 ] 50 0.010% 100.134% ( 6600, 9900 ] 24 0.005% 100.139% ( 9900, 14000 ] 1 0.000% 100.139% ** Level 2 read latency histogram (micros): Count: 47847 Average: 2.4996 StdDev: 14.25 Min: 0 Median: 1.4755 Max: 1333 Percentiles: P50: 1.48 P75: 1.85 P99: 5.74 P99.9: 164.46 P99.99: 740.61 ------------------------------------------------------ [ 0, 1 ] 8620 18.016% 18.016% #### ( 1, 2 ] 32184 67.264% 85.280% ############# ( 2, 3 ] 4184 8.745% 94.025% ## ( 3, 4 ] 1577 3.296% 97.321% # ( 4, 6 ] 923 1.929% 99.250% ( 6, 10 ] 251 0.525% 99.774% ( 10, 15 ] 37 0.077% 99.852% ( 15, 22 ] 3 0.006% 99.858% ( 76, 110 ] 2 0.004% 99.862% ( 110, 170 ] 20 0.042% 99.904% ( 170, 250 ] 20 0.042% 99.946% ( 250, 380 ] 11 0.023% 99.969% ( 380, 580 ] 8 0.017% 99.985% ( 580, 870 ] 4 0.008% 99.994% ( 870, 1300 ] 2 0.004% 99.998% ( 1300, 1900 ] 1 0.002% 100.000% ** Level 3 read latency histogram (micros): Count: 178057 Average: 13.1182 StdDev: 186.42 Min: 0 Median: 1.8559 Max: 15795 Percentiles: P50: 1.86 P75: 2.79 P99: 12.87 P99.9: 2662.30 P99.99: 4245.04 ------------------------------------------------------ [ 0, 1 ] 8146 4.575% 4.575% # ( 1, 2 ] 94503 53.075% 57.650% ########### ( 2, 3 ] 38900 21.847% 79.496% #### ( 3, 4 ] 16101 9.043% 88.539% ## ( 4, 6 ] 15002 8.425% 96.964% ## ( 6, 10 ] 3074 1.726% 98.691% ( 10, 15 ] 960 0.539% 99.230% ( 15, 22 ] 148 0.083% 99.313% ( 22, 34 ] 25 0.014% 99.327% ( 34, 51 ] 5 0.003% 99.330% ( 51, 76 ] 6 0.003% 99.333% ( 76, 110 ] 4 0.002% 99.336% ( 110, 170 ] 65 0.037% 99.372% ( 170, 250 ] 87 0.049% 99.421% ( 250, 380 ] 109 0.061% 99.482% ( 380, 580 ] 176 0.099% 99.581% ( 580, 870 ] 198 0.111% 99.692% ( 870, 1300 ] 176 0.099% 99.791% ( 1300, 1900 ] 120 0.067% 99.858% ( 1900, 2900 ] 97 0.054% 99.913% ( 2900, 4400 ] 153 0.086% 99.999% ( 4400, 6600 ] 30 0.017% 100.016% ( 6600, 9900 ] 25 0.014% 100.030% ( 9900, 14000 ] 5 0.003% 100.033% ( 14000, 22000 ] 1 0.001% 100.033% ** Level 4 read latency histogram (micros): Count: 7932 Average: 74.4492 StdDev: 452.14 Min: 0 Median: 1.9259 Max: 7704 Percentiles: P50: 1.93 P75: 3.11 P99: 2756.00 P99.9: 5934.58 P99.99: 7704.00 ------------------------------------------------------ [ 0, 1 ] 279 3.517% 3.517% # ( 1, 2 ] 3982 50.202% 53.719% ########## ( 2, 3 ] 1583 19.957% 73.676% #### ( 3, 4 ] 983 12.393% 86.069% ## ( 4, 6 ] 513 6.467% 92.537% # ( 6, 10 ] 145 1.828% 94.365% ( 10, 15 ] 48 0.605% 94.970% ( 15, 22 ] 12 0.151% 95.121% ( 22, 34 ] 1 0.013% 95.134% ( 51, 76 ] 1 0.013% 95.146% ( 76, 110 ] 6 0.076% 95.222% ( 110, 170 ] 28 0.353% 95.575% ( 170, 250 ] 22 0.277% 95.852% ( 250, 380 ] 28 0.353% 96.205% ( 380, 580 ] 53 0.668% 96.873% ( 580, 870 ] 52 0.656% 97.529% ( 870, 1300 ] 52 0.656% 98.185% ( 1300, 1900 ] 39 0.492% 98.676% ( 1900, 2900 ] 30 0.378% 99.054% ( 2900, 4400 ] 58 0.731% 99.786% ( 4400, 6600 ] 13 0.164% 99.950% ( 6600, 9900 ] 4 0.050% 100.000% ** Level 5 read latency histogram (micros): Count: 60 Average: 1065.9833 StdDev: 1225.67 Min: 79 Median: 580.0000 Max: 4705 Percentiles: P50: 580.00 P75: 1471.43 P99: 4705.00 P99.9: 4705.00 P99.99: 4705.00 ------------------------------------------------------ ( 76, 110 ] 9 15.000% 15.000% ### ( 110, 170 ] 8 13.333% 28.333% ### ( 170, 250 ] 5 8.333% 36.667% ## ( 250, 380 ] 2 3.333% 40.000% # ( 380, 580 ] 6 10.000% 50.000% ## ( 580, 870 ] 5 8.333% 58.333% ## ( 870, 1300 ] 8 13.333% 71.667% ### ( 1300, 1900 ] 7 11.667% 83.333% ## ( 1900, 2900 ] 3 5.000% 88.333% # ( 2900, 4400 ] 4 6.667% 95.000% # ( 4400, 6600 ] 3 5.000% 100.000% # ** DB Stats ** Uptime(secs): 26.1 total, 10.2 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 226.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:10.416 H:M:S, 40.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 96.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.500 H:M:S, 73.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 9 num-running-flushes: 1 2024/07/26-04:11:45 ... thread 0: (1000000,7000000) ops and (199031.9,226776.4) ops/second in (5.024321,30.867404) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 3.00 GB 56.6 6.0 0.0 6.0 12.6 6.6 0.0 1.9 133.0 278.0 46.40 40.40 110 0.422 6267K 13K 0.0 0.0 L1 3/3 191.95 MB 0.0 3.8 3.4 0.4 3.8 3.3 0.2 1.1 226.9 224.6 17.16 16.32 3 5.721 3954K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.3 1.5 259.2 259.1 0.73 0.70 1 0.729 191K 90 0.0 0.0 L3 12/0 968.30 MB 1.0 3.4 2.0 1.4 3.3 1.9 1.5 1.7 144.7 144.2 23.79 16.00 16 1.487 3487K 11K 0.0 0.0 L4 175/0 9.74 GB 1.0 2.7 2.2 0.4 2.6 2.2 0.9 1.2 130.3 129.8 20.86 12.78 38 0.549 2713K 9211 0.0 0.0 L5 1080/0 88.77 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1283/12 102.65 GB 0.0 16.0 7.7 8.3 22.5 14.2 8.8 3.4 150.7 211.9 108.94 86.20 168 0.648 16M 72K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.0 7.7 8.3 22.5 14.2 8.7 3.4 150.7 211.9 108.94 86.20 168 0.648 16M 72K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.0 7.7 8.3 16.0 7.6 0.0 0.0 188.5 187.7 87.07 68.79 76 1.146 16M 72K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.6 6.6 0.0 0.0 0.0 308.2 21.87 17.41 92 0.238 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 31.1 total, 30.9 interval Flush(GB): cumulative 6.583, interval 6.583 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.54 GB write, 742.46 MB/s write, 16.03 GB read, 528.03 MB/s read, 108.9 seconds Interval compaction: 22.54 GB write, 747.71 MB/s write, 16.03 GB read, 531.76 MB/s read, 108.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 63, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 63, interval: 74 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2747878 Average: 2.8418 StdDev: 37.57 Min: 0 Median: 1.4903 Max: 8223 Percentiles: P50: 1.49 P75: 1.88 P99: 7.09 P99.9: 116.16 P99.99: 460.74 ------------------------------------------------------ [ 0, 1 ] 516656 18.802% 18.802% #### ( 1, 2 ] 1748558 63.633% 82.435% ############# ( 2, 3 ] 272831 9.929% 92.364% ## ( 3, 4 ] 104313 3.796% 96.160% # ( 4, 6 ] 71538 2.603% 98.763% # ( 6, 10 ] 23883 0.869% 99.632% ( 10, 15 ] 4822 0.175% 99.808% ( 15, 22 ] 552 0.020% 99.828% ( 22, 34 ] 46 0.002% 99.830% ( 34, 51 ] 22 0.001% 99.831% ( 51, 76 ] 43 0.002% 99.832% ( 76, 110 ] 1681 0.061% 99.893% ( 110, 170 ] 1812 0.066% 99.959% ( 170, 250 ] 420 0.015% 99.974% ( 250, 380 ] 317 0.012% 99.986% ( 380, 580 ] 273 0.010% 99.996% ( 580, 870 ] 207 0.008% 100.003% ( 870, 1300 ] 124 0.005% 100.008% ( 1300, 1900 ] 83 0.003% 100.011% ( 1900, 2900 ] 88 0.003% 100.014% ( 2900, 4400 ] 92 0.003% 100.018% ( 4400, 6600 ] 25 0.001% 100.018% ( 6600, 9900 ] 16 0.001% 100.019% ** Level 1 read latency histogram (micros): Count: 825711 Average: 7.3208 StdDev: 117.92 Min: 0 Median: 1.8742 Max: 11791 Percentiles: P50: 1.87 P75: 2.86 P99: 9.82 P99.9: 330.29 P99.99: 892.72 ------------------------------------------------------ [ 0, 1 ] 36111 4.373% 4.373% # ( 1, 2 ] 430943 52.191% 56.564% ########## ( 2, 3 ] 176405 21.364% 77.928% #### ( 3, 4 ] 79007 9.568% 87.496% ## ( 4, 6 ] 78287 9.481% 96.977% ## ( 6, 10 ] 17483 2.117% 99.095% ( 10, 15 ] 5127 0.621% 99.716% ( 15, 22 ] 617 0.075% 99.790% ( 22, 34 ] 37 0.004% 99.795% ( 34, 51 ] 13 0.002% 99.796% ( 51, 76 ] 32 0.004% 99.800% ( 76, 110 ] 191 0.023% 99.823% ( 110, 170 ] 338 0.041% 99.864% ( 170, 250 ] 172 0.021% 99.885% ( 250, 380 ] 198 0.024% 99.909% ( 380, 580 ] 294 0.036% 99.945% ( 580, 870 ] 358 0.043% 99.988% ( 870, 1300 ] 292 0.035% 100.023% ( 1300, 1900 ] 180 0.022% 100.045% ( 1900, 2900 ] 248 0.030% 100.075% ( 2900, 4400 ] 313 0.038% 100.113% ( 4400, 6600 ] 109 0.013% 100.126% ( 6600, 9900 ] 33 0.004% 100.130% ( 9900, 14000 ] 3 0.000% 100.131% ** Level 2 read latency histogram (micros): Count: 47962 Average: 3.9202 StdDev: 69.90 Min: 0 Median: 1.4770 Max: 5859 Percentiles: P50: 1.48 P75: 1.85 P99: 5.81 P99.9: 350.38 P99.99: 4229.39 ------------------------------------------------------ [ 0, 1 ] 8620 17.973% 17.973% #### ( 1, 2 ] 32205 67.147% 85.119% ############# ( 2, 3 ] 4218 8.794% 93.914% ## ( 3, 4 ] 1593 3.321% 97.235% # ( 4, 6 ] 933 1.945% 99.181% ( 6, 10 ] 253 0.528% 99.708% ( 10, 15 ] 37 0.077% 99.785% ( 15, 22 ] 3 0.006% 99.792% ( 76, 110 ] 2 0.004% 99.796% ( 110, 170 ] 20 0.042% 99.837% ( 170, 250 ] 20 0.042% 99.879% ( 250, 380 ] 13 0.027% 99.906% ( 380, 580 ] 11 0.023% 99.929% ( 580, 870 ] 10 0.021% 99.950% ( 870, 1300 ] 5 0.010% 99.960% ( 1300, 1900 ] 4 0.008% 99.969% ( 1900, 2900 ] 4 0.008% 99.977% ( 2900, 4400 ] 7 0.015% 99.992% ( 4400, 6600 ] 4 0.008% 100.000% ** Level 3 read latency histogram (micros): Count: 754648 Average: 9.8563 StdDev: 138.56 Min: 0 Median: 1.9362 Max: 15795 Percentiles: P50: 1.94 P75: 2.94 P99: 10.01 P99.9: 1029.30 P99.99: 1766.45 ------------------------------------------------------ [ 0, 1 ] 17535 2.324% 2.324% ( 1, 2 ] 384313 50.926% 53.250% ########## ( 2, 3 ] 174559 23.131% 76.381% ##### ( 3, 4 ] 81789 10.838% 87.219% ## ( 4, 6 ] 75924 10.061% 97.280% ## ( 6, 10 ] 12975 1.719% 98.999% ( 10, 15 ] 3717 0.493% 99.492% ( 15, 22 ] 424 0.056% 99.548% ( 22, 34 ] 36 0.005% 99.553% ( 34, 51 ] 12 0.002% 99.554% ( 51, 76 ] 11 0.001% 99.556% ( 76, 110 ] 44 0.006% 99.562% ( 110, 170 ] 210 0.028% 99.589% ( 170, 250 ] 289 0.038% 99.628% ( 250, 380 ] 401 0.053% 99.681% ( 380, 580 ] 669 0.089% 99.769% ( 580, 870 ] 749 0.099% 99.869% ( 870, 1300 ] 638 0.085% 99.953% ( 1300, 1900 ] 357 0.047% 100.001% ( 1900, 2900 ] 297 0.039% 100.040% ( 2900, 4400 ] 404 0.054% 100.093% ( 4400, 6600 ] 87 0.012% 100.105% ( 6600, 9900 ] 39 0.005% 100.110% ( 9900, 14000 ] 6 0.001% 100.111% ( 14000, 22000 ] 1 0.000% 100.111% ** Level 4 read latency histogram (micros): Count: 42074 Average: 32.0039 StdDev: 293.28 Min: 0 Median: 1.9289 Max: 10599 Percentiles: P50: 1.93 P75: 2.99 P99: 850.94 P99.9: 4246.19 P99.99: 8937.78 ------------------------------------------------------ [ 0, 1 ] 1266 3.009% 3.009% # ( 1, 2 ] 21285 50.589% 53.598% ########## ( 2, 3 ] 9077 21.574% 75.172% #### ( 3, 4 ] 4944 11.751% 86.923% ## ( 4, 6 ] 3674 8.732% 95.655% ## ( 6, 10 ] 694 1.649% 97.305% ( 10, 15 ] 179 0.425% 97.730% ( 15, 22 ] 25 0.059% 97.790% ( 22, 34 ] 4 0.010% 97.799% ( 34, 51 ] 1 0.002% 97.801% ( 51, 76 ] 6 0.014% 97.816% ( 76, 110 ] 15 0.036% 97.851% ( 110, 170 ] 65 0.154% 98.006% ( 170, 250 ] 78 0.185% 98.191% ( 250, 380 ] 72 0.171% 98.362% ( 380, 580 ] 144 0.342% 98.705% ( 580, 870 ] 133 0.316% 99.021% ( 870, 1300 ] 126 0.299% 99.320% ( 1300, 1900 ] 82 0.195% 99.515% ( 1900, 2900 ] 65 0.154% 99.670% ( 2900, 4400 ] 108 0.257% 99.926% ( 4400, 6600 ] 19 0.045% 99.971% ( 6600, 9900 ] 11 0.026% 99.998% ( 9900, 14000 ] 3 0.007% 100.005% ** Level 5 read latency histogram (micros): Count: 180 Average: 1522.9833 StdDev: 1545.35 Min: 79 Median: 921.6000 Max: 7930 Percentiles: P50: 921.60 P75: 2300.00 P99: 6464.62 P99.9: 7930.00 P99.99: 7930.00 ------------------------------------------------------ ( 76, 110 ] 11 6.111% 6.111% # ( 110, 170 ] 11 6.111% 12.222% # ( 170, 250 ] 10 5.556% 17.778% # ( 250, 380 ] 8 4.444% 22.222% # ( 380, 580 ] 26 14.444% 36.667% ### ( 580, 870 ] 21 11.667% 48.333% ## ( 870, 1300 ] 25 13.889% 62.222% ### ( 1300, 1900 ] 17 9.444% 71.667% ## ( 1900, 2900 ] 15 8.333% 80.000% ## ( 2900, 4400 ] 22 12.222% 92.222% ## ( 4400, 6600 ] 13 7.222% 99.444% # ( 6600, 9900 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 31.1 total, 5.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 221.61 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.579 H:M:S, 40.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 195.88 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.163 H:M:S, 43.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/07/26-04:11:48 ... thread 0: (1000000,8000000) ops and (310453.8,234683.3) ops/second in (3.221091,34.088495) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 4.05 GB 138.4 6.9 0.0 6.9 14.5 7.6 0.0 1.9 133.6 281.3 52.79 46.40 127 0.416 7162K 14K 0.0 0.0 L1 3/3 191.95 MB 0.0 3.8 3.4 0.4 3.8 3.3 0.2 1.1 226.9 224.6 17.16 16.32 3 5.721 3954K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.3 1.5 259.2 259.1 0.73 0.70 1 0.729 191K 90 0.0 0.0 L3 12/0 968.30 MB 1.0 3.4 2.0 1.4 3.3 1.9 1.5 1.7 144.7 144.2 23.79 16.00 16 1.487 3487K 11K 0.0 0.0 L4 175/0 9.74 GB 1.0 2.7 2.2 0.4 2.6 2.2 0.9 1.2 130.3 129.8 20.86 12.78 38 0.549 2713K 9211 0.0 0.0 L5 1080/0 88.77 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1288/16 103.69 GB 0.0 16.9 7.7 9.2 24.4 15.3 8.8 3.2 150.0 217.1 115.33 92.20 185 0.623 17M 73K 0.0 0.0 Int 0/0 0.00 KB 0.0 16.9 7.7 9.2 24.4 15.3 8.7 3.2 150.0 217.1 115.33 92.20 185 0.623 17M 73K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 16.9 7.7 9.2 16.8 7.6 0.0 0.0 191.3 190.4 90.43 72.08 79 1.145 17M 73K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 7.6 7.6 0.0 0.0 0.0 313.8 24.90 20.12 106 0.235 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 34.3 total, 34.1 interval Flush(GB): cumulative 7.628, interval 7.628 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.45 GB write, 729.64 MB/s write, 16.89 GB read, 504.16 MB/s read, 115.3 seconds Interval compaction: 24.45 GB write, 734.31 MB/s write, 16.89 GB read, 507.38 MB/s read, 115.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 11, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 11, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 68, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 11, total-stops: 68, interval: 79 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3137511 Average: 2.7719 StdDev: 35.28 Min: 0 Median: 1.4968 Max: 8223 Percentiles: P50: 1.50 P75: 1.89 P99: 6.96 P99.9: 104.83 P99.99: 362.63 ------------------------------------------------------ [ 0, 1 ] 567377 18.084% 18.084% #### ( 1, 2 ] 2015607 64.242% 82.326% ############# ( 2, 3 ] 317944 10.134% 92.460% ## ( 3, 4 ] 119296 3.802% 96.262% # ( 4, 6 ] 79395 2.531% 98.792% # ( 6, 10 ] 27181 0.866% 99.659% ( 10, 15 ] 5413 0.173% 99.831% ( 15, 22 ] 602 0.019% 99.850% ( 22, 34 ] 46 0.001% 99.852% ( 34, 51 ] 22 0.001% 99.852% ( 51, 76 ] 46 0.001% 99.854% ( 76, 110 ] 1706 0.054% 99.908% ( 110, 170 ] 1840 0.059% 99.967% ( 170, 250 ] 434 0.014% 99.981% ( 250, 380 ] 335 0.011% 99.991% ( 380, 580 ] 280 0.009% 100.000% ( 580, 870 ] 212 0.007% 100.007% ( 870, 1300 ] 128 0.004% 100.011% ( 1300, 1900 ] 86 0.003% 100.014% ( 1900, 2900 ] 88 0.003% 100.017% ( 2900, 4400 ] 93 0.003% 100.020% ( 4400, 6600 ] 25 0.001% 100.021% ( 6600, 9900 ] 16 0.001% 100.021% ** Level 1 read latency histogram (micros): Count: 867928 Average: 7.0952 StdDev: 115.06 Min: 0 Median: 1.8514 Max: 11791 Percentiles: P50: 1.85 P75: 2.82 P99: 9.78 P99.9: 313.78 P99.99: 887.92 ------------------------------------------------------ [ 0, 1 ] 42720 4.922% 4.922% # ( 1, 2 ] 459541 52.947% 57.869% ########### ( 2, 3 ] 180543 20.802% 78.671% #### ( 3, 4 ] 80280 9.250% 87.920% ## ( 4, 6 ] 79031 9.106% 97.026% ## ( 6, 10 ] 18139 2.090% 99.116% ( 10, 15 ] 5190 0.598% 99.714% ( 15, 22 ] 624 0.072% 99.786% ( 22, 34 ] 37 0.004% 99.790% ( 34, 51 ] 13 0.001% 99.791% ( 51, 76 ] 35 0.004% 99.795% ( 76, 110 ] 264 0.030% 99.826% ( 110, 170 ] 360 0.041% 99.867% ( 170, 250 ] 182 0.021% 99.888% ( 250, 380 ] 206 0.024% 99.912% ( 380, 580 ] 303 0.035% 99.947% ( 580, 870 ] 361 0.042% 99.989% ( 870, 1300 ] 293 0.034% 100.022% ( 1300, 1900 ] 180 0.021% 100.043% ( 1900, 2900 ] 248 0.029% 100.072% ( 2900, 4400 ] 313 0.036% 100.108% ( 4400, 6600 ] 109 0.013% 100.120% ( 6600, 9900 ] 33 0.004% 100.124% ( 9900, 14000 ] 3 0.000% 100.124% ** Level 2 read latency histogram (micros): Count: 47962 Average: 3.9202 StdDev: 69.90 Min: 0 Median: 1.4770 Max: 5859 Percentiles: P50: 1.48 P75: 1.85 P99: 5.81 P99.9: 350.38 P99.99: 4229.39 ------------------------------------------------------ [ 0, 1 ] 8620 17.973% 17.973% #### ( 1, 2 ] 32205 67.147% 85.119% ############# ( 2, 3 ] 4218 8.794% 93.914% ## ( 3, 4 ] 1593 3.321% 97.235% # ( 4, 6 ] 933 1.945% 99.181% ( 6, 10 ] 253 0.528% 99.708% ( 10, 15 ] 37 0.077% 99.785% ( 15, 22 ] 3 0.006% 99.792% ( 76, 110 ] 2 0.004% 99.796% ( 110, 170 ] 20 0.042% 99.837% ( 170, 250 ] 20 0.042% 99.879% ( 250, 380 ] 13 0.027% 99.906% ( 380, 580 ] 11 0.023% 99.929% ( 580, 870 ] 10 0.021% 99.950% ( 870, 1300 ] 5 0.010% 99.960% ( 1300, 1900 ] 4 0.008% 99.969% ( 1900, 2900 ] 4 0.008% 99.977% ( 2900, 4400 ] 7 0.015% 99.992% ( 4400, 6600 ] 4 0.008% 100.000% ** Level 3 read latency histogram (micros): Count: 754648 Average: 9.8563 StdDev: 138.56 Min: 0 Median: 1.9362 Max: 15795 Percentiles: P50: 1.94 P75: 2.94 P99: 10.01 P99.9: 1029.30 P99.99: 1766.45 ------------------------------------------------------ [ 0, 1 ] 17535 2.324% 2.324% ( 1, 2 ] 384313 50.926% 53.250% ########## ( 2, 3 ] 174559 23.131% 76.381% ##### ( 3, 4 ] 81789 10.838% 87.219% ## ( 4, 6 ] 75924 10.061% 97.280% ## ( 6, 10 ] 12975 1.719% 98.999% ( 10, 15 ] 3717 0.493% 99.492% ( 15, 22 ] 424 0.056% 99.548% ( 22, 34 ] 36 0.005% 99.553% ( 34, 51 ] 12 0.002% 99.554% ( 51, 76 ] 11 0.001% 99.556% ( 76, 110 ] 44 0.006% 99.562% ( 110, 170 ] 210 0.028% 99.589% ( 170, 250 ] 289 0.038% 99.628% ( 250, 380 ] 401 0.053% 99.681% ( 380, 580 ] 669 0.089% 99.769% ( 580, 870 ] 749 0.099% 99.869% ( 870, 1300 ] 638 0.085% 99.953% ( 1300, 1900 ] 357 0.047% 100.001% ( 1900, 2900 ] 297 0.039% 100.040% ( 2900, 4400 ] 404 0.054% 100.093% ( 4400, 6600 ] 87 0.012% 100.105% ( 6600, 9900 ] 39 0.005% 100.110% ( 9900, 14000 ] 6 0.001% 100.111% ( 14000, 22000 ] 1 0.000% 100.111% ** Level 4 read latency histogram (micros): Count: 42074 Average: 32.0039 StdDev: 293.28 Min: 0 Median: 1.9289 Max: 10599 Percentiles: P50: 1.93 P75: 2.99 P99: 850.94 P99.9: 4246.19 P99.99: 8937.78 ------------------------------------------------------ [ 0, 1 ] 1266 3.009% 3.009% # ( 1, 2 ] 21285 50.589% 53.598% ########## ( 2, 3 ] 9077 21.574% 75.172% #### ( 3, 4 ] 4944 11.751% 86.923% ## ( 4, 6 ] 3674 8.732% 95.655% ## ( 6, 10 ] 694 1.649% 97.305% ( 10, 15 ] 179 0.425% 97.730% ( 15, 22 ] 25 0.059% 97.790% ( 22, 34 ] 4 0.010% 97.799% ( 34, 51 ] 1 0.002% 97.801% ( 51, 76 ] 6 0.014% 97.816% ( 76, 110 ] 15 0.036% 97.851% ( 110, 170 ] 65 0.154% 98.006% ( 170, 250 ] 78 0.185% 98.191% ( 250, 380 ] 72 0.171% 98.362% ( 380, 580 ] 144 0.342% 98.705% ( 580, 870 ] 133 0.316% 99.021% ( 870, 1300 ] 126 0.299% 99.320% ( 1300, 1900 ] 82 0.195% 99.515% ( 1900, 2900 ] 65 0.154% 99.670% ( 2900, 4400 ] 108 0.257% 99.926% ( 4400, 6600 ] 19 0.045% 99.971% ( 6600, 9900 ] 11 0.026% 99.998% ( 9900, 14000 ] 3 0.007% 100.005% ** Level 5 read latency histogram (micros): Count: 180 Average: 1522.9833 StdDev: 1545.35 Min: 79 Median: 921.6000 Max: 7930 Percentiles: P50: 921.60 P75: 2300.00 P99: 6464.62 P99.9: 7930.00 P99.99: 7930.00 ------------------------------------------------------ ( 76, 110 ] 11 6.111% 6.111% # ( 110, 170 ] 11 6.111% 12.222% # ( 170, 250 ] 10 5.556% 17.778% # ( 250, 380 ] 8 4.444% 22.222% # ( 380, 580 ] 26 14.444% 36.667% ### ( 580, 870 ] 21 11.667% 48.333% ## ( 870, 1300 ] 25 13.889% 62.222% ### ( 1300, 1900 ] 17 9.444% 71.667% ## ( 1900, 2900 ] 15 8.333% 80.000% ## ( 2900, 4400 ] 22 12.222% 92.222% ## ( 4400, 6600 ] 13 7.222% 99.444% # ( 6600, 9900 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 34.3 total, 3.2 interval Cumulative writes: 0 writes, 8000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 7.69 GB, 229.49 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.236 H:M:S, 38.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 305.55 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.657 H:M:S, 20.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/07/26-04:11:51 ... thread 0: (1000000,9000000) ops and (293806.0,240050.6) ops/second in (3.403606,37.492101) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/9 4.97 GB 264.3 8.1 0.0 8.1 16.6 8.5 0.0 1.9 137.5 283.1 60.01 53.26 144 0.417 8377K 16K 0.0 0.0 L1 3/3 191.95 MB 0.0 3.8 3.4 0.4 3.8 3.3 0.2 1.1 226.9 224.6 17.16 16.32 3 5.721 3954K 38K 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 3.3 1.5 259.2 259.1 0.73 0.70 1 0.729 191K 90 0.0 0.0 L3 12/0 968.30 MB 1.0 3.4 2.0 1.4 3.3 1.9 1.5 1.7 144.7 144.2 23.79 16.00 16 1.487 3487K 11K 0.0 0.0 L4 175/0 9.74 GB 1.0 2.7 2.2 0.4 2.6 2.2 0.9 1.2 130.3 129.8 20.86 12.78 38 0.549 2713K 9211 0.0 0.0 L5 1080/0 88.77 GB 0.9 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1289/12 104.61 GB 0.0 18.1 7.7 10.4 26.5 16.2 8.8 3.1 150.9 221.7 122.55 99.06 202 0.607 18M 75K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.1 7.7 10.4 26.5 16.2 8.7 3.1 150.9 221.7 122.55 99.06 202 0.607 18M 75K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.1 7.7 10.4 18.0 7.6 0.0 0.0 194.8 194.0 94.94 76.50 83 1.144 18M 75K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 8.6 8.6 0.0 0.0 0.0 317.1 27.62 22.56 119 0.232 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.7 total, 37.5 interval Flush(GB): cumulative 8.551, interval 8.551 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 26.54 GB write, 720.54 MB/s write, 18.06 GB read, 490.39 MB/s read, 122.6 seconds Interval compaction: 26.54 GB write, 724.73 MB/s write, 18.06 GB read, 493.25 MB/s read, 122.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 70, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 14, total-stops: 70, interval: 84 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3603440 Average: 2.7203 StdDev: 33.11 Min: 0 Median: 1.5044 Max: 8223 Percentiles: P50: 1.50 P75: 1.89 P99: 6.89 P99.9: 95.84 P99.99: 287.48 ------------------------------------------------------ [ 0, 1 ] 625312 17.353% 17.353% ### ( 1, 2 ] 2332434 64.728% 82.081% ############# ( 2, 3 ] 375597 10.423% 92.504% ## ( 3, 4 ] 137270 3.809% 96.314% # ( 4, 6 ] 89828 2.493% 98.807% ( 6, 10 ] 31391 0.871% 99.678% ( 10, 15 ] 6186 0.172% 99.850% ( 15, 22 ] 660 0.018% 99.868% ( 22, 34 ] 57 0.002% 99.869% ( 34, 51 ] 25 0.001% 99.870% ( 51, 76 ] 50 0.001% 99.872% ( 76, 110 ] 1759 0.049% 99.920% ( 110, 170 ] 1938 0.054% 99.974% ( 170, 250 ] 468 0.013% 99.987% ( 250, 380 ] 363 0.010% 99.997% ( 380, 580 ] 299 0.008% 100.005% ( 580, 870 ] 229 0.006% 100.012% ( 870, 1300 ] 134 0.004% 100.016% ( 1300, 1900 ] 90 0.002% 100.018% ( 1900, 2900 ] 88 0.002% 100.020% ( 2900, 4400 ] 94 0.003% 100.023% ( 4400, 6600 ] 25 0.001% 100.024% ( 6600, 9900 ] 16 0.000% 100.024% ** Level 1 read latency histogram (micros): Count: 874468 Average: 7.0805 StdDev: 114.70 Min: 0 Median: 1.8486 Max: 11791 Percentiles: P50: 1.85 P75: 2.82 P99: 9.78 P99.9: 318.42 P99.99: 892.75 ------------------------------------------------------ [ 0, 1 ] 43403 4.963% 4.963% # ( 1, 2 ] 464099 53.072% 58.036% ########### ( 2, 3 ] 181330 20.736% 78.772% #### ( 3, 4 ] 80483 9.204% 87.975% ## ( 4, 6 ] 79150 9.051% 97.026% ## ( 6, 10 ] 18242 2.086% 99.112% ( 10, 15 ] 5199 0.595% 99.707% ( 15, 22 ] 624 0.071% 99.778% ( 22, 34 ] 37 0.004% 99.783% ( 34, 51 ] 13 0.001% 99.784% ( 51, 76 ] 35 0.004% 99.788% ( 76, 110 ] 299 0.034% 99.822% ( 110, 170 ] 379 0.043% 99.866% ( 170, 250 ] 190 0.022% 99.887% ( 250, 380 ] 210 0.024% 99.911% ( 380, 580 ] 309 0.035% 99.947% ( 580, 870 ] 363 0.042% 99.988% ( 870, 1300 ] 294 0.034% 100.022% ( 1300, 1900 ] 182 0.021% 100.043% ( 1900, 2900 ] 249 0.028% 100.071% ( 2900, 4400 ] 313 0.036% 100.107% ( 4400, 6600 ] 109 0.012% 100.119% ( 6600, 9900 ] 33 0.004% 100.123% ( 9900, 14000 ] 3 0.000% 100.124% ** Level 2 read latency histogram (micros): Count: 47962 Average: 3.9202 StdDev: 69.90 Min: 0 Median: 1.4770 Max: 5859 Percentiles: P50: 1.48 P75: 1.85 P99: 5.81 P99.9: 350.38 P99.99: 4229.39 ------------------------------------------------------ [ 0, 1 ] 8620 17.973% 17.973% #### ( 1, 2 ] 32205 67.147% 85.119% ############# ( 2, 3 ] 4218 8.794% 93.914% ## ( 3, 4 ] 1593 3.321% 97.235% # ( 4, 6 ] 933 1.945% 99.181% ( 6, 10 ] 253 0.528% 99.708% ( 10, 15 ] 37 0.077% 99.785% ( 15, 22 ] 3 0.006% 99.792% ( 76, 110 ] 2 0.004% 99.796% ( 110, 170 ] 20 0.042% 99.837% ( 170, 250 ] 20 0.042% 99.879% ( 250, 380 ] 13 0.027% 99.906% ( 380, 580 ] 11 0.023% 99.929% ( 580, 870 ] 10 0.021% 99.950% ( 870, 1300 ] 5 0.010% 99.960% ( 1300, 1900 ] 4 0.008% 99.969% ( 1900, 2900 ] 4 0.008% 99.977% ( 2900, 4400 ] 7 0.015% 99.992% ( 4400, 6600 ] 4 0.008% 100.000% ** Level 3 read latency histogram (micros): Count: 754648 Average: 9.8563 StdDev: 138.56 Min: 0 Median: 1.9362 Max: 15795 Percentiles: P50: 1.94 P75: 2.94 P99: 10.01 P99.9: 1029.30 P99.99: 1766.45 ------------------------------------------------------ [ 0, 1 ] 17535 2.324% 2.324% ( 1, 2 ] 384313 50.926% 53.250% ########## ( 2, 3 ] 174559 23.131% 76.381% ##### ( 3, 4 ] 81789 10.838% 87.219% ## ( 4, 6 ] 75924 10.061% 97.280% ## ( 6, 10 ] 12975 1.719% 98.999% ( 10, 15 ] 3717 0.493% 99.492% ( 15, 22 ] 424 0.056% 99.548% ( 22, 34 ] 36 0.005% 99.553% ( 34, 51 ] 12 0.002% 99.554% ( 51, 76 ] 11 0.001% 99.556% ( 76, 110 ] 44 0.006% 99.562% ( 110, 170 ] 210 0.028% 99.589% ( 170, 250 ] 289 0.038% 99.628% ( 250, 380 ] 401 0.053% 99.681% ( 380, 580 ] 669 0.089% 99.769% ( 580, 870 ] 749 0.099% 99.869% ( 870, 1300 ] 638 0.085% 99.953% ( 1300, 1900 ] 357 0.047% 100.001% ( 1900, 2900 ] 297 0.039% 100.040% ( 2900, 4400 ] 404 0.054% 100.093% ( 4400, 6600 ] 87 0.012% 100.105% ( 6600, 9900 ] 39 0.005% 100.110% ( 9900, 14000 ] 6 0.001% 100.111% ( 14000, 22000 ] 1 0.000% 100.111% ** Level 4 read latency histogram (micros): Count: 42074 Average: 32.0039 StdDev: 293.28 Min: 0 Median: 1.9289 Max: 10599 Percentiles: P50: 1.93 P75: 2.99 P99: 850.94 P99.9: 4246.19 P99.99: 8937.78 ------------------------------------------------------ [ 0, 1 ] 1266 3.009% 3.009% # ( 1, 2 ] 21285 50.589% 53.598% ########## ( 2, 3 ] 9077 21.574% 75.172% #### ( 3, 4 ] 4944 11.751% 86.923% ## ( 4, 6 ] 3674 8.732% 95.655% ## ( 6, 10 ] 694 1.649% 97.305% ( 10, 15 ] 179 0.425% 97.730% ( 15, 22 ] 25 0.059% 97.790% ( 22, 34 ] 4 0.010% 97.799% ( 34, 51 ] 1 0.002% 97.801% ( 51, 76 ] 6 0.014% 97.816% ( 76, 110 ] 15 0.036% 97.851% ( 110, 170 ] 65 0.154% 98.006% ( 170, 250 ] 78 0.185% 98.191% ( 250, 380 ] 72 0.171% 98.362% ( 380, 580 ] 144 0.342% 98.705% ( 580, 870 ] 133 0.316% 99.021% ( 870, 1300 ] 126 0.299% 99.320% ( 1300, 1900 ] 82 0.195% 99.515% ( 1900, 2900 ] 65 0.154% 99.670% ( 2900, 4400 ] 108 0.257% 99.926% ( 4400, 6600 ] 19 0.045% 99.971% ( 6600, 9900 ] 11 0.026% 99.998% ( 9900, 14000 ] 3 0.007% 100.005% ** Level 5 read latency histogram (micros): Count: 180 Average: 1522.9833 StdDev: 1545.35 Min: 79 Median: 921.6000 Max: 7930 Percentiles: P50: 921.60 P75: 2300.00 P99: 6464.62 P99.9: 7930.00 P99.99: 7930.00 ------------------------------------------------------ ( 76, 110 ] 11 6.111% 6.111% # ( 110, 170 ] 11 6.111% 12.222% # ( 170, 250 ] 10 5.556% 17.778% # ( 250, 380 ] 8 4.444% 22.222% # ( 380, 580 ] 26 14.444% 36.667% ### ( 580, 870 ] 21 11.667% 48.333% ## ( 870, 1300 ] 25 13.889% 62.222% ### ( 1300, 1900 ] 17 9.444% 71.667% ## ( 1900, 2900 ] 15 8.333% 80.000% ## ( 2900, 4400 ] 22 12.222% 92.222% ## ( 4400, 6600 ] 13 7.222% 99.444% # ( 6600, 9900 ] 1 0.556% 100.000% ** DB Stats ** Uptime(secs): 37.7 total, 3.4 interval Cumulative writes: 0 writes, 9000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 8.65 GB, 234.88 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:14.078 H:M:S, 37.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 289.16 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.842 H:M:S, 24.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] overwrite : 6.145 micros/op 162743 ops/sec 60.168 seconds 9791999 operations; 157.7 MB/s Microseconds per write: Count: 9791999 Average: 6.1446 StdDev: 492.27 Min: 0 Median: 1.7107 Max: 769715 Percentiles: P50: 1.71 P75: 2.62 P99: 8.25 P99.9: 1177.61 P99.99: 2723.05 ------------------------------------------------------ [ 0, 1 ] 1417588 14.477% 14.477% ### ( 1, 2 ] 4894330 49.983% 64.460% ########## ( 2, 3 ] 1654655 16.898% 81.358% ### ( 3, 4 ] 1271089 12.981% 94.339% ### ( 4, 6 ] 410825 4.196% 98.534% # ( 6, 10 ] 80885 0.826% 99.360% ( 10, 15 ] 23470 0.240% 99.600% ( 15, 22 ] 6210 0.063% 99.664% ( 22, 34 ] 1465 0.015% 99.678% ( 34, 51 ] 147 0.002% 99.680% ( 51, 76 ] 41 0.000% 99.680% ( 76, 110 ] 7304 0.075% 99.755% ( 110, 170 ] 2333 0.024% 99.779% ( 170, 250 ] 209 0.002% 99.781% ( 250, 380 ] 95 0.001% 99.782% ( 380, 580 ] 11 0.000% 99.782% ( 580, 870 ] 19 0.000% 99.782% ( 870, 1300 ] 16119 0.165% 99.947% ( 1300, 1900 ] 19 0.000% 99.947% ( 1900, 2900 ] 5110 0.052% 99.999% ( 2900, 4400 ] 33 0.000% 100.000% ( 4400, 6600 ] 6 0.000% 100.000% ( 6600, 9900 ] 4 0.000% 100.000% ( 9900, 14000 ] 2 0.000% 100.000% ( 14000, 22000 ] 4 0.000% 100.000% ( 22000, 33000 ] 3 0.000% 100.000% ( 50000, 75000 ] 1 0.000% 100.000% ( 110000, 170000 ] 2 0.000% 100.000% ( 170000, 250000 ] 16 0.000% 100.000% ( 380000, 570000 ] 2 0.000% 100.000% ( 570000, 860000 ] 2 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 0 rocksdb.bloom.filter.full.positive COUNT : 0 rocksdb.bloom.filter.full.true.positive COUNT : 0 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 0 rocksdb.memtable.miss COUNT : 0 rocksdb.l0.hit COUNT : 0 rocksdb.l1.hit COUNT : 0 rocksdb.l2andup.hit COUNT : 0 rocksdb.compaction.key.drop.new COUNT : 199969 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 9791999 rocksdb.number.keys.read COUNT : 0 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 10105342968 rocksdb.bytes.read COUNT : 0 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 487 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34150310 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 27473069430 rocksdb.compact.write.bytes COUNT : 27289057005 rocksdb.flush.write.bytes COUNT : 10106447172 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 47 rocksdb.number.superversion_acquires COUNT : 0 rocksdb.number.superversion_releases COUNT : 0 rocksdb.number.superversion_cleanups COUNT : 0 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 296 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 10025252864 rocksdb.memtable.garbage.bytes.at.flush COUNT : 4158464 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27561877675 rocksdb.non.last.level.read.count COUNT : 6661215 rocksdb.block.checksum.compute.count COUNT : 6660288 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.micros P50 : 1.345077 P95 : 3.758489 P99 : 6.448100 P100 : 769713.000000 COUNT : 9791999 SUM : 55729013 rocksdb.compaction.times.micros P50 : 945000.000000 P95 : 3355000.000000 P99 : 12173000.000000 P100 : 12398364.000000 COUNT : 87 SUM : 109519697 rocksdb.compaction.times.cpu_micros P50 : 820454.545455 P95 : 2550000.000000 P99 : 11686117.000000 P100 : 11686117.000000 COUNT : 87 SUM : 89817790 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 647.822581 P95 : 4895.000000 P99 : 11314.500000 P100 : 13714.000000 COUNT : 131 SUM : 144328 rocksdb.compaction.outfile.sync.micros P50 : 1053.148148 P95 : 32175.000000 P99 : 85325.000000 P100 : 233290.000000 COUNT : 341 SUM : 2405861 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 103.388889 P95 : 1887.142857 P99 : 3488.750000 P100 : 3989.000000 COUNT : 243 SUM : 86289 rocksdb.table.open.io.micros P50 : 1405.633803 P95 : 8586.346154 P99 : 13019.416667 P100 : 17122.000000 COUNT : 487 SUM : 1062828 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.557346 P95 : 7.476574 P99 : 12.380176 P100 : 15802.000000 COUNT : 6658853 SUM : 43117873 rocksdb.read.block.get.micros P50 : 346.949153 P95 : 3884.782609 P99 : 5926.000000 P100 : 11407.000000 COUNT : 974 SUM : 877086 rocksdb.write.raw.block.micros P50 : 0.513142 P95 : 0.974969 P99 : 2.810664 P100 : 18544.000000 COUNT : 9057370 SUM : 19071840 rocksdb.numfiles.in.singlecompaction P50 : 3.169355 P95 : 5.583333 P99 : 20.250000 P100 : 35.000000 COUNT : 125 SUM : 460 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564738 P95 : 1189.194462 P99 : 2541.925417 P100 : 769538.000000 COUNT : 185739 SUM : 34164530 rocksdb.sst.read.micros P50 : 1.538071 P95 : 4.387078 P99 : 8.993618 P100 : 15795.000000 COUNT : 6661311 SUM : 29729774 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 9791999 SUM : 10105342968 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 213414.634146 P95 : 408500.000000 P99 : 830033.333333 P100 : 924954.000000 COUNT : 131 SUM : 30126626 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 314 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0