[2024-10-17 13:12:03.160907] Starting SPDK v24.01.1-pre git sha1 726a04d70 / DPDK 23.11.0 initialization... [2024-10-17 13:12:03.161042] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1087160 ] Set seed to 1729163523158386 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-10-17 13:12:03.269965] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-10-17 13:12:03.497043] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-10-17 13:12:03.497085] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1087160' to capture a snapshot of events at runtime. [2024-10-17 13:12:03.497096] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1087160 for offline analysis/debug. [2024-10-17 13:12:03.497122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Thu Oct 17 13:12:12 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/10/17-13:12:19 ... thread 0: (1000000,1000000) ops and (129336.3,129336.3) ops/second in (7.731780,7.731780) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 4/4 377.91 MB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 120.3 6.81 2.37 9 0.756 0 0 0.0 0.0 L1 6/6 367.76 MB 0.0 0.9 0.5 0.4 0.9 0.5 0.0 1.8 136.3 136.1 7.13 4.45 4 1.782 986K 880 0.0 0.0 L2 18/16 2.03 GB 1.7 0.0 0.0 0.0 0.0 0.0 0.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 33/11 2.84 GB 1.9 2.1 1.4 0.7 2.1 1.4 0.1 1.5 97.9 96.4 22.03 10.15 15 1.469 880K 0 0.0 0.0 L4 207/17 11.57 GB 1.1 2.4 1.9 0.5 2.4 1.9 0.1 1.3 118.6 117.5 20.80 11.73 19 1.095 1717K 6599 0.0 0.0 L5 1076/0 88.52 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1344/54 105.70 GB 0.0 5.5 3.8 1.6 6.2 4.6 0.4 7.8 98.6 112.0 56.78 28.70 47 1.208 3584K 7479 0.0 0.0 Int 0/0 0.00 KB 0.0 5.5 3.8 1.6 6.2 4.6 0.4 7.8 98.6 112.0 56.78 28.70 47 1.208 3584K 7479 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 5.5 3.8 1.6 5.4 3.8 0.0 0.0 112.0 110.9 49.97 26.33 38 1.315 3584K 7479 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 120.3 6.81 2.37 9 0.756 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.7 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 6.21 GB write, 802.36 MB/s write, 5.46 GB read, 706.08 MB/s read, 56.8 seconds Interval compaction: 6.21 GB write, 822.18 MB/s write, 5.46 GB read, 723.53 MB/s read, 56.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 1, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 32, interval: 33 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 136721 Average: 9.2450 StdDev: 146.54 Min: 1 Median: 1.9259 Max: 13869 Percentiles: P50: 1.93 P75: 2.98 P99: 9.59 P99.9: 2316.08 P99.99: 6035.44 ------------------------------------------------------ [ 0, 1 ] 5022 3.673% 3.673% # ( 1, 2 ] 68409 50.035% 53.709% ########## ( 2, 3 ] 29573 21.630% 75.339% #### ( 3, 4 ] 13543 9.906% 85.244% ## ( 4, 6 ] 16366 11.970% 97.215% ## ( 6, 10 ] 2716 1.987% 99.201% ( 10, 15 ] 583 0.426% 99.628% ( 15, 22 ] 56 0.041% 99.669% ( 22, 34 ] 6 0.004% 99.673% ( 34, 51 ] 2 0.001% 99.675% ( 51, 76 ] 4 0.003% 99.677% ( 76, 110 ] 2 0.001% 99.679% ( 110, 170 ] 5 0.004% 99.683% ( 170, 250 ] 12 0.009% 99.691% ( 250, 380 ] 12 0.009% 99.700% ( 380, 580 ] 36 0.026% 99.726% ( 580, 870 ] 55 0.040% 99.767% ( 870, 1300 ] 68 0.050% 99.816% ( 1300, 1900 ] 76 0.056% 99.872% ( 1900, 2900 ] 92 0.067% 99.939% ( 2900, 4400 ] 50 0.037% 99.976% ( 4400, 6600 ] 26 0.019% 99.995% ( 6600, 9900 ] 4 0.003% 99.998% ( 9900, 14000 ] 3 0.002% 100.000% ** Level 1 read latency histogram (micros): Count: 110495 Average: 4.2984 StdDev: 96.12 Min: 1 Median: 1.9153 Max: 26932 Percentiles: P50: 1.92 P75: 2.94 P99: 8.32 P99.9: 18.50 P99.99: 3058.42 ------------------------------------------------------ [ 0, 1 ] 3699 3.348% 3.348% # ( 1, 2 ] 56318 50.969% 54.316% ########## ( 2, 3 ] 24199 21.901% 76.217% #### ( 3, 4 ] 10799 9.773% 85.990% ## ( 4, 6 ] 13308 12.044% 98.034% ## ( 6, 10 ] 1837 1.663% 99.697% ( 10, 15 ] 214 0.194% 99.890% ( 15, 22 ] 21 0.019% 99.909% ( 22, 34 ] 3 0.003% 99.912% ( 34, 51 ] 1 0.001% 99.913% ( 51, 76 ] 3 0.003% 99.916% ( 76, 110 ] 3 0.003% 99.919% ( 110, 170 ] 3 0.003% 99.921% ( 170, 250 ] 9 0.008% 99.929% ( 250, 380 ] 3 0.003% 99.932% ( 380, 580 ] 7 0.006% 99.938% ( 580, 870 ] 10 0.009% 99.948% ( 870, 1300 ] 20 0.018% 99.966% ( 1300, 1900 ] 12 0.011% 99.976% ( 1900, 2900 ] 14 0.013% 99.989% ( 2900, 4400 ] 9 0.008% 99.997% ( 4400, 6600 ] 2 0.002% 99.999% ( 22000, 33000 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 663384 Average: 20.9158 StdDev: 252.43 Min: 1 Median: 2.0612 Max: 26812 Percentiles: P50: 2.06 P75: 3.18 P99: 13.89 P99.9: 2695.44 P99.99: 3464.54 ------------------------------------------------------ [ 0, 1 ] 15103 2.277% 2.277% ( 1, 2 ] 306584 46.215% 48.492% ######### ( 2, 3 ] 163593 24.660% 73.152% ##### ( 3, 4 ] 66875 10.081% 83.233% ## ( 4, 6 ] 81674 12.312% 95.545% ## ( 6, 10 ] 18461 2.783% 98.328% # ( 10, 15 ] 5738 0.865% 99.193% ( 15, 22 ] 791 0.119% 99.312% ( 22, 34 ] 82 0.012% 99.324% ( 34, 51 ] 25 0.004% 99.328% ( 51, 76 ] 37 0.006% 99.334% ( 76, 110 ] 18 0.003% 99.336% ( 110, 170 ] 16 0.002% 99.339% ( 170, 250 ] 35 0.005% 99.344% ( 250, 380 ] 114 0.017% 99.361% ( 380, 580 ] 257 0.039% 99.400% ( 580, 870 ] 489 0.074% 99.474% ( 870, 1300 ] 795 0.120% 99.593% ( 1300, 1900 ] 1096 0.165% 99.759% ( 1900, 2900 ] 1180 0.178% 99.937% ( 2900, 4400 ] 945 0.142% 100.079% ( 4400, 6600 ] 329 0.050% 100.129% ( 6600, 9900 ] 64 0.010% 100.138% ( 9900, 14000 ] 10 0.002% 100.140% ( 14000, 22000 ] 13 0.002% 100.142% ( 22000, 33000 ] 4 0.001% 100.142% ** Level 3 read latency histogram (micros): Count: 727857 Average: 11.5855 StdDev: 189.97 Min: 1 Median: 2.0336 Max: 41026 Percentiles: P50: 2.03 P75: 3.13 P99: 9.59 P99.9: 1198.44 P99.99: 1857.66 ------------------------------------------------------ [ 0, 1 ] 15597 2.143% 2.143% ( 1, 2 ] 342352 47.036% 49.178% ######### ( 2, 3 ] 178061 24.464% 73.642% ##### ( 3, 4 ] 78053 10.724% 84.366% ## ( 4, 6 ] 92059 12.648% 97.014% ### ( 6, 10 ] 16107 2.213% 99.227% ( 10, 15 ] 3480 0.478% 99.705% ( 15, 22 ] 389 0.053% 99.758% ( 22, 34 ] 40 0.005% 99.764% ( 34, 51 ] 25 0.003% 99.767% ( 51, 76 ] 18 0.002% 99.770% ( 76, 110 ] 5 0.001% 99.770% ( 110, 170 ] 14 0.002% 99.772% ( 170, 250 ] 37 0.005% 99.777% ( 250, 380 ] 46 0.006% 99.784% ( 380, 580 ] 161 0.022% 99.806% ( 580, 870 ] 305 0.042% 99.848% ( 870, 1300 ] 499 0.069% 99.916% ( 1300, 1900 ] 578 0.079% 99.996% ( 1900, 2900 ] 658 0.090% 100.086% ( 2900, 4400 ] 437 0.060% 100.146% ( 4400, 6600 ] 157 0.022% 100.168% ( 6600, 9900 ] 22 0.003% 100.171% ( 9900, 14000 ] 6 0.001% 100.172% ( 14000, 22000 ] 8 0.001% 100.173% ( 22000, 33000 ] 5 0.001% 100.173% ( 33000, 50000 ] 2 0.000% 100.174% ** Level 4 read latency histogram (micros): Count: 246416 Average: 35.1834 StdDev: 335.72 Min: 1 Median: 2.0064 Max: 38983 Percentiles: P50: 2.01 P75: 3.13 P99: 1098.35 P99.9: 3916.83 P99.99: 4789.91 ------------------------------------------------------ [ 0, 1 ] 5754 2.335% 2.335% ( 1, 2 ] 117077 47.512% 49.847% ########## ( 2, 3 ] 58782 23.855% 73.702% ##### ( 3, 4 ] 23811 9.663% 83.365% ## ( 4, 6 ] 29334 11.904% 95.269% ## ( 6, 10 ] 6366 2.583% 97.852% # ( 10, 15 ] 1474 0.598% 98.451% ( 15, 22 ] 156 0.063% 98.514% ( 22, 34 ] 7 0.003% 98.517% ( 34, 51 ] 6 0.002% 98.519% ( 51, 76 ] 11 0.004% 98.524% ( 76, 110 ] 5 0.002% 98.526% ( 110, 170 ] 8 0.003% 98.529% ( 170, 250 ] 59 0.024% 98.553% ( 250, 380 ] 99 0.040% 98.593% ( 380, 580 ] 224 0.091% 98.684% ( 580, 870 ] 432 0.175% 98.859% ( 870, 1300 ] 655 0.266% 99.125% ( 1300, 1900 ] 754 0.306% 99.431% ( 1900, 2900 ] 779 0.316% 99.747% ( 2900, 4400 ] 557 0.226% 99.973% ( 4400, 6600 ] 239 0.097% 100.070% ( 6600, 9900 ] 44 0.018% 100.088% ( 9900, 14000 ] 1 0.000% 100.088% ( 14000, 22000 ] 6 0.002% 100.091% ( 22000, 33000 ] 1 0.000% 100.091% ( 33000, 50000 ] 1 0.000% 100.092% ** Level 5 read latency histogram (micros): Count: 8786 Average: 2471.6523 StdDev: 2197.90 Min: 100 Median: 1862.4748 Max: 57764 Percentiles: P50: 1862.47 P75: 3532.73 P99: 9230.96 P99.9: 25338.50 P99.99: 47510.63 ------------------------------------------------------ ( 76, 110 ] 1 0.011% 0.011% ( 110, 170 ] 12 0.137% 0.148% ( 170, 250 ] 58 0.660% 0.808% ( 250, 380 ] 192 2.185% 2.993% ( 380, 580 ] 484 5.509% 8.502% # ( 580, 870 ] 891 10.141% 18.643% ## ( 870, 1300 ] 1361 15.491% 34.134% ### ( 1300, 1900 ] 1487 16.925% 51.059% ### ( 1900, 2900 ] 1483 16.879% 67.938% ### ( 2900, 4400 ] 1471 16.743% 84.680% ### ( 4400, 6600 ] 1066 12.133% 96.813% ## ( 6600, 9900 ] 241 2.743% 99.556% # ( 9900, 14000 ] 24 0.273% 99.829% ( 14000, 22000 ] 5 0.057% 99.886% ( 22000, 33000 ] 4 0.046% 99.932% ( 33000, 50000 ] 6 0.068% 100.000% ( 50000, 75000 ] 1 0.011% 100.011% ** DB Stats ** Uptime(secs): 7.9 total, 7.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 124.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.902 H:M:S, 49.2 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 127.25 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.902 H:M:S, 50.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/10/17-13:12:26 ... thread 0: (1000000,2000000) ops and (149512.8,138694.6) ops/second in (6.688389,14.420169) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/8 1.05 GB 37.7 0.4 0.0 0.4 2.2 1.8 0.0 1.2 23.7 142.3 15.94 6.95 22 0.724 383K 531 0.0 0.0 L1 2/0 208.90 MB 20.9 1.7 0.9 0.8 1.7 0.9 0.0 1.9 135.0 134.7 12.72 7.92 5 2.545 1743K 2800 0.0 0.0 L2 7/5 536.32 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/12 1.23 GB 0.2 4.5 3.3 1.2 4.5 3.3 0.3 1.3 100.3 99.2 46.08 21.96 19 2.425 1763K 0 0.0 0.0 L4 183/7 10.14 GB 1.0 7.5 5.1 2.4 7.4 5.0 0.5 1.4 116.4 114.9 65.96 36.02 46 1.434 3857K 6926 0.0 0.0 L5 1136/0 93.51 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1353/32 106.65 GB 0.0 14.1 9.3 4.7 15.8 11.0 6.4 8.5 102.3 114.6 140.70 72.84 92 1.529 7749K 10K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.1 9.3 4.7 15.8 11.0 6.4 8.5 102.3 114.6 140.70 72.84 92 1.529 7749K 10K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.1 9.3 4.7 13.9 9.2 0.0 0.0 113.4 112.2 126.90 67.46 71 1.787 7749K 10K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 137.0 13.80 5.39 21 0.657 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.6 total, 14.4 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.75 GB write, 1103.87 MB/s write, 14.05 GB read, 984.85 MB/s read, 140.7 seconds Interval compaction: 15.75 GB write, 1118.49 MB/s write, 14.05 GB read, 997.90 MB/s read, 140.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 53, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 53, interval: 58 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 392808 Average: 10.5694 StdDev: 140.95 Min: 1 Median: 1.9206 Max: 13869 Percentiles: P50: 1.92 P75: 2.94 P99: 10.24 P99.9: 2180.28 P99.99: 4380.22 ------------------------------------------------------ [ 0, 1 ] 14680 3.737% 3.737% # ( 1, 2 ] 197394 50.252% 53.989% ########## ( 2, 3 ] 88143 22.439% 76.428% #### ( 3, 4 ] 36506 9.294% 85.722% ## ( 4, 6 ] 43800 11.150% 96.873% ## ( 6, 10 ] 8270 2.105% 98.978% ( 10, 15 ] 1828 0.465% 99.443% ( 15, 22 ] 169 0.043% 99.486% ( 22, 34 ] 21 0.005% 99.492% ( 34, 51 ] 11 0.003% 99.494% ( 51, 76 ] 21 0.005% 99.500% ( 76, 110 ] 5 0.001% 99.501% ( 110, 170 ] 19 0.005% 99.506% ( 170, 250 ] 50 0.013% 99.519% ( 250, 380 ] 100 0.025% 99.544% ( 380, 580 ] 235 0.060% 99.604% ( 580, 870 ] 370 0.094% 99.698% ( 870, 1300 ] 410 0.104% 99.802% ( 1300, 1900 ] 314 0.080% 99.882% ( 1900, 2900 ] 254 0.065% 99.947% ( 2900, 4400 ] 173 0.044% 99.991% ( 4400, 6600 ] 67 0.017% 100.008% ( 6600, 9900 ] 7 0.002% 100.010% ( 9900, 14000 ] 3 0.001% 100.011% ** Level 1 read latency histogram (micros): Count: 266456 Average: 9.6360 StdDev: 135.59 Min: 1 Median: 1.9772 Max: 26932 Percentiles: P50: 1.98 P75: 3.00 P99: 10.13 P99.9: 1925.86 P99.99: 4073.03 ------------------------------------------------------ [ 0, 1 ] 6122 2.298% 2.298% ( 1, 2 ] 130077 48.817% 51.115% ########## ( 2, 3 ] 63811 23.948% 75.063% ##### ( 3, 4 ] 25642 9.623% 84.686% ## ( 4, 6 ] 32107 12.050% 96.736% ## ( 6, 10 ] 5999 2.251% 98.987% ( 10, 15 ] 1350 0.507% 99.494% ( 15, 22 ] 133 0.050% 99.544% ( 22, 34 ] 11 0.004% 99.548% ( 34, 51 ] 19 0.007% 99.555% ( 51, 76 ] 16 0.006% 99.561% ( 76, 110 ] 7 0.003% 99.564% ( 110, 170 ] 14 0.005% 99.569% ( 170, 250 ] 45 0.017% 99.586% ( 250, 380 ] 57 0.021% 99.607% ( 380, 580 ] 132 0.050% 99.657% ( 580, 870 ] 223 0.084% 99.741% ( 870, 1300 ] 244 0.092% 99.832% ( 1300, 1900 ] 178 0.067% 99.899% ( 1900, 2900 ] 137 0.051% 99.950% ( 2900, 4400 ] 136 0.051% 100.002% ( 4400, 6600 ] 24 0.009% 100.011% ( 6600, 9900 ] 3 0.001% 100.012% ( 22000, 33000 ] 1 0.000% 100.012% ** Level 2 read latency histogram (micros): Count: 766560 Average: 20.3851 StdDev: 246.35 Min: 1 Median: 2.0856 Max: 26812 Percentiles: P50: 2.09 P75: 3.20 P99: 13.92 P99.9: 2767.78 P99.99: 3617.99 ------------------------------------------------------ [ 0, 1 ] 15982 2.085% 2.085% ( 1, 2 ] 350817 45.765% 47.850% ######### ( 2, 3 ] 192519 25.115% 72.965% ##### ( 3, 4 ] 77841 10.155% 83.119% ## ( 4, 6 ] 94973 12.390% 95.509% ## ( 6, 10 ] 21476 2.802% 98.310% # ( 10, 15 ] 6741 0.879% 99.190% ( 15, 22 ] 899 0.117% 99.307% ( 22, 34 ] 97 0.013% 99.320% ( 34, 51 ] 33 0.004% 99.324% ( 51, 76 ] 52 0.007% 99.331% ( 76, 110 ] 22 0.003% 99.334% ( 110, 170 ] 18 0.002% 99.336% ( 170, 250 ] 35 0.005% 99.341% ( 250, 380 ] 131 0.017% 99.358% ( 380, 580 ] 311 0.041% 99.398% ( 580, 870 ] 596 0.078% 99.476% ( 870, 1300 ] 941 0.123% 99.599% ( 1300, 1900 ] 1190 0.155% 99.754% ( 1900, 2900 ] 1290 0.168% 99.922% ( 2900, 4400 ] 1085 0.142% 100.064% ( 4400, 6600 ] 371 0.048% 100.112% ( 6600, 9900 ] 69 0.009% 100.121% ( 9900, 14000 ] 10 0.001% 100.122% ( 14000, 22000 ] 13 0.002% 100.124% ( 22000, 33000 ] 4 0.001% 100.125% ** Level 3 read latency histogram (micros): Count: 1573434 Average: 11.6706 StdDev: 173.57 Min: 1 Median: 2.0899 Max: 41026 Percentiles: P50: 2.09 P75: 3.14 P99: 10.00 P99.9: 1123.29 P99.99: 1773.22 ------------------------------------------------------ [ 0, 1 ] 25785 1.639% 1.639% ( 1, 2 ] 724326 46.035% 47.673% ######### ( 2, 3 ] 407291 25.885% 73.559% ##### ( 3, 4 ] 163100 10.366% 83.925% ## ( 4, 6 ] 198094 12.590% 96.515% ### ( 6, 10 ] 39115 2.486% 99.001% ( 10, 15 ] 10020 0.637% 99.638% ( 15, 22 ] 1143 0.073% 99.710% ( 22, 34 ] 90 0.006% 99.716% ( 34, 51 ] 80 0.005% 99.721% ( 51, 76 ] 109 0.007% 99.728% ( 76, 110 ] 26 0.002% 99.730% ( 110, 170 ] 50 0.003% 99.733% ( 170, 250 ] 111 0.007% 99.740% ( 250, 380 ] 222 0.014% 99.754% ( 380, 580 ] 568 0.036% 99.790% ( 580, 870 ] 977 0.062% 99.852% ( 870, 1300 ] 1281 0.081% 99.934% ( 1300, 1900 ] 1128 0.072% 100.005% ( 1900, 2900 ] 1264 0.080% 100.086% ( 2900, 4400 ] 1075 0.068% 100.154% ( 4400, 6600 ] 346 0.022% 100.176% ( 6600, 9900 ] 43 0.003% 100.179% ( 9900, 14000 ] 9 0.001% 100.179% ( 14000, 22000 ] 10 0.001% 100.180% ( 22000, 33000 ] 5 0.000% 100.180% ( 33000, 50000 ] 2 0.000% 100.180% ** Level 4 read latency histogram (micros): Count: 762659 Average: 26.6299 StdDev: 263.35 Min: 0 Median: 2.0294 Max: 38983 Percentiles: P50: 2.03 P75: 3.13 P99: 686.00 P99.9: 3291.61 P99.99: 4115.28 ------------------------------------------------------ [ 0, 1 ] 15864 2.080% 2.080% ( 1, 2 ] 359975 47.200% 49.280% ######### ( 2, 3 ] 186487 24.452% 73.732% ##### ( 3, 4 ] 74279 9.739% 83.472% ## ( 4, 6 ] 90388 11.852% 95.323% ## ( 6, 10 ] 19844 2.602% 97.925% # ( 10, 15 ] 5123 0.672% 98.597% ( 15, 22 ] 554 0.073% 98.670% ( 22, 34 ] 44 0.006% 98.676% ( 34, 51 ] 46 0.006% 98.682% ( 51, 76 ] 69 0.009% 98.691% ( 76, 110 ] 21 0.003% 98.693% ( 110, 170 ] 52 0.007% 98.700% ( 170, 250 ] 232 0.030% 98.731% ( 250, 380 ] 409 0.054% 98.784% ( 380, 580 ] 997 0.131% 98.915% ( 580, 870 ] 1774 0.233% 99.148% ( 870, 1300 ] 2109 0.277% 99.424% ( 1300, 1900 ] 1751 0.230% 99.654% ( 1900, 2900 ] 1552 0.203% 99.857% ( 2900, 4400 ] 1250 0.164% 100.021% ( 4400, 6600 ] 436 0.057% 100.078% ( 6600, 9900 ] 68 0.009% 100.087% ( 9900, 14000 ] 3 0.000% 100.088% ( 14000, 22000 ] 7 0.001% 100.089% ( 22000, 33000 ] 1 0.000% 100.089% ( 33000, 50000 ] 1 0.000% 100.089% ** Level 5 read latency histogram (micros): Count: 23066 Average: 1817.6745 StdDev: 1737.40 Min: 92 Median: 1245.4000 Max: 57764 Percentiles: P50: 1245.40 P75: 2506.05 P99: 7757.17 P99.9: 12927.01 P99.99: 43464.63 ------------------------------------------------------ ( 76, 110 ] 8 0.035% 0.035% ( 110, 170 ] 152 0.659% 0.694% ( 170, 250 ] 451 1.955% 2.649% ( 250, 380 ] 1069 4.635% 7.283% # ( 380, 580 ] 2285 9.906% 17.190% ## ( 580, 870 ] 3814 16.535% 33.725% ### ( 870, 1300 ] 4300 18.642% 52.367% #### ( 1300, 1900 ] 3446 14.940% 67.307% ### ( 1900, 2900 ] 2928 12.694% 80.001% ### ( 2900, 4400 ] 2824 12.243% 92.244% ## ( 4400, 6600 ] 1457 6.317% 98.561% # ( 6600, 9900 ] 289 1.253% 99.814% ( 9900, 14000 ] 27 0.117% 99.931% ( 14000, 22000 ] 6 0.026% 99.957% ( 22000, 33000 ] 4 0.017% 99.974% ( 33000, 50000 ] 6 0.026% 100.000% ( 50000, 75000 ] 1 0.004% 100.004% ** DB Stats ** Uptime(secs): 14.6 total, 6.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 134.70 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.701 H:M:S, 45.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 147.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.799 H:M:S, 41.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 8 num-running-flushes: 1 2024/10/17-13:12:30 ... thread 0: (1000000,3000000) ops and (248127.3,162598.5) ops/second in (4.030190,18.450359) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/10 1.97 GB 44.1 1.3 0.0 1.3 4.1 2.8 0.0 1.5 54.1 170.0 24.44 13.36 39 0.627 1343K 1680 0.0 0.0 L1 2/2 208.90 MB 0.0 1.7 0.9 0.8 1.7 0.9 0.0 1.9 135.0 134.7 12.72 7.92 5 2.545 1743K 2800 0.0 0.0 L2 2/0 76.96 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 17/1 1.03 GB 0.9 5.9 3.8 2.1 5.8 3.7 0.3 1.5 109.3 108.2 54.88 28.41 24 2.287 2856K 4774 0.0 0.0 L4 186/7 10.05 GB 1.0 9.0 5.7 3.3 8.8 5.6 0.6 1.5 120.5 118.4 76.28 42.55 52 1.467 4687K 10K 0.0 0.0 L5 1144/0 94.18 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1365/20 107.51 GB 0.0 17.8 10.4 7.4 20.4 12.9 7.2 7.4 108.3 123.8 168.33 92.24 120 1.403 10M 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.8 10.4 7.4 20.4 12.9 7.2 7.4 108.3 123.8 168.33 92.24 120 1.403 10M 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.8 10.4 7.4 17.6 10.1 0.0 0.0 121.1 119.6 150.55 84.23 85 1.771 10M 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 159.4 17.78 8.01 35 0.508 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.6 total, 18.5 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.35 GB write, 1117.97 MB/s write, 17.80 GB read, 977.71 MB/s read, 168.3 seconds Interval compaction: 20.35 GB write, 1129.54 MB/s write, 17.80 GB read, 987.83 MB/s read, 168.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 60, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 703235 Average: 8.7821 StdDev: 114.58 Min: 1 Median: 1.8438 Max: 13869 Percentiles: P50: 1.84 P75: 2.79 P99: 10.66 P99.9: 1353.28 P99.99: 2940.94 ------------------------------------------------------ [ 0, 1 ] 35323 5.023% 5.023% # ( 1, 2 ] 374832 53.301% 58.324% ########### ( 2, 3 ] 149369 21.240% 79.564% #### ( 3, 4 ] 57845 8.226% 87.790% ## ( 4, 6 ] 66395 9.441% 97.231% ## ( 6, 10 ] 12094 1.720% 98.951% ( 10, 15 ] 2599 0.370% 99.321% ( 15, 22 ] 257 0.037% 99.357% ( 22, 34 ] 35 0.005% 99.362% ( 34, 51 ] 27 0.004% 99.366% ( 51, 76 ] 29 0.004% 99.370% ( 76, 110 ] 46 0.007% 99.377% ( 110, 170 ] 539 0.077% 99.453% ( 170, 250 ] 676 0.096% 99.549% ( 250, 380 ] 584 0.083% 99.632% ( 380, 580 ] 671 0.095% 99.728% ( 580, 870 ] 628 0.089% 99.817% ( 870, 1300 ] 550 0.078% 99.895% ( 1300, 1900 ] 369 0.052% 99.948% ( 1900, 2900 ] 291 0.041% 99.989% ( 2900, 4400 ] 208 0.030% 100.019% ( 4400, 6600 ] 73 0.010% 100.029% ( 6600, 9900 ] 7 0.001% 100.030% ( 9900, 14000 ] 3 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 367986 Average: 9.1330 StdDev: 127.27 Min: 1 Median: 1.9706 Max: 26932 Percentiles: P50: 1.97 P75: 2.96 P99: 10.79 P99.9: 1699.10 P99.99: 3846.31 ------------------------------------------------------ [ 0, 1 ] 8313 2.259% 2.259% ( 1, 2 ] 181007 49.189% 51.448% ########## ( 2, 3 ] 90159 24.501% 75.948% ##### ( 3, 4 ] 34077 9.260% 85.209% ## ( 4, 6 ] 42153 11.455% 96.664% ## ( 6, 10 ] 8296 2.254% 98.918% ( 10, 15 ] 1913 0.520% 99.438% ( 15, 22 ] 185 0.050% 99.488% ( 22, 34 ] 15 0.004% 99.492% ( 34, 51 ] 25 0.007% 99.499% ( 51, 76 ] 20 0.005% 99.505% ( 76, 110 ] 22 0.006% 99.511% ( 110, 170 ] 100 0.027% 99.538% ( 170, 250 ] 161 0.044% 99.582% ( 250, 380 ] 177 0.048% 99.630% ( 380, 580 ] 224 0.061% 99.690% ( 580, 870 ] 332 0.090% 99.781% ( 870, 1300 ] 298 0.081% 99.862% ( 1300, 1900 ] 212 0.058% 99.919% ( 1900, 2900 ] 158 0.043% 99.962% ( 2900, 4400 ] 162 0.044% 100.006% ( 4400, 6600 ] 31 0.008% 100.015% ( 6600, 9900 ] 3 0.001% 100.015% ( 14000, 22000 ] 1 0.000% 100.016% ( 22000, 33000 ] 1 0.000% 100.016% ** Level 2 read latency histogram (micros): Count: 766560 Average: 20.3851 StdDev: 246.35 Min: 1 Median: 2.0856 Max: 26812 Percentiles: P50: 2.09 P75: 3.20 P99: 13.92 P99.9: 2767.78 P99.99: 3617.99 ------------------------------------------------------ [ 0, 1 ] 15982 2.085% 2.085% ( 1, 2 ] 350817 45.765% 47.850% ######### ( 2, 3 ] 192519 25.115% 72.965% ##### ( 3, 4 ] 77841 10.155% 83.119% ## ( 4, 6 ] 94973 12.390% 95.509% ## ( 6, 10 ] 21476 2.802% 98.310% # ( 10, 15 ] 6741 0.879% 99.190% ( 15, 22 ] 899 0.117% 99.307% ( 22, 34 ] 97 0.013% 99.320% ( 34, 51 ] 33 0.004% 99.324% ( 51, 76 ] 52 0.007% 99.331% ( 76, 110 ] 22 0.003% 99.334% ( 110, 170 ] 18 0.002% 99.336% ( 170, 250 ] 35 0.005% 99.341% ( 250, 380 ] 131 0.017% 99.358% ( 380, 580 ] 311 0.041% 99.398% ( 580, 870 ] 596 0.078% 99.476% ( 870, 1300 ] 941 0.123% 99.599% ( 1300, 1900 ] 1190 0.155% 99.754% ( 1900, 2900 ] 1290 0.168% 99.922% ( 2900, 4400 ] 1085 0.142% 100.064% ( 4400, 6600 ] 371 0.048% 100.112% ( 6600, 9900 ] 69 0.009% 100.121% ( 9900, 14000 ] 10 0.001% 100.122% ( 14000, 22000 ] 13 0.002% 100.124% ( 22000, 33000 ] 4 0.001% 100.125% ** Level 3 read latency histogram (micros): Count: 2003573 Average: 10.6917 StdDev: 161.02 Min: 1 Median: 2.0529 Max: 41026 Percentiles: P50: 2.05 P75: 3.04 P99: 9.96 P99.9: 947.04 P99.99: 1597.89 ------------------------------------------------------ [ 0, 1 ] 32537 1.624% 1.624% ( 1, 2 ] 941738 47.003% 48.627% ######### ( 2, 3 ] 520496 25.978% 74.605% ##### ( 3, 4 ] 199306 9.948% 84.553% ## ( 4, 6 ] 241511 12.054% 96.607% ## ( 6, 10 ] 48494 2.420% 99.027% ( 10, 15 ] 12372 0.617% 99.645% ( 15, 22 ] 1397 0.070% 99.714% ( 22, 34 ] 122 0.006% 99.720% ( 34, 51 ] 120 0.006% 99.726% ( 51, 76 ] 146 0.007% 99.734% ( 76, 110 ] 43 0.002% 99.736% ( 110, 170 ] 226 0.011% 99.747% ( 170, 250 ] 346 0.017% 99.764% ( 250, 380 ] 459 0.023% 99.787% ( 380, 580 ] 788 0.039% 99.827% ( 580, 870 ] 1209 0.060% 99.887% ( 870, 1300 ] 1448 0.072% 99.959% ( 1300, 1900 ] 1238 0.062% 100.021% ( 1900, 2900 ] 1398 0.070% 100.091% ( 2900, 4400 ] 1218 0.061% 100.152% ( 4400, 6600 ] 378 0.019% 100.171% ( 6600, 9900 ] 46 0.002% 100.173% ( 9900, 14000 ] 10 0.000% 100.173% ( 14000, 22000 ] 11 0.001% 100.174% ( 22000, 33000 ] 5 0.000% 100.174% ( 33000, 50000 ] 2 0.000% 100.174% ** Level 4 read latency histogram (micros): Count: 855320 Average: 27.3556 StdDev: 258.90 Min: 0 Median: 2.0307 Max: 38983 Percentiles: P50: 2.03 P75: 3.14 P99: 707.64 P99.9: 3245.03 P99.99: 4097.20 ------------------------------------------------------ [ 0, 1 ] 17343 2.028% 2.028% ( 1, 2 ] 403899 47.222% 49.250% ######### ( 2, 3 ] 208916 24.425% 73.675% ##### ( 3, 4 ] 82297 9.622% 83.297% ## ( 4, 6 ] 99695 11.656% 94.953% ## ( 6, 10 ] 21993 2.571% 97.524% # ( 10, 15 ] 5704 0.667% 98.191% ( 15, 22 ] 607 0.071% 98.262% ( 22, 34 ] 51 0.006% 98.268% ( 34, 51 ] 66 0.008% 98.276% ( 51, 76 ] 83 0.010% 98.285% ( 76, 110 ] 87 0.010% 98.295% ( 110, 170 ] 697 0.081% 98.377% ( 170, 250 ] 1207 0.141% 98.518% ( 250, 380 ] 1257 0.147% 98.665% ( 380, 580 ] 1812 0.212% 98.877% ( 580, 870 ] 2392 0.280% 99.157% ( 870, 1300 ] 2489 0.291% 99.448% ( 1300, 1900 ] 1899 0.222% 99.670% ( 1900, 2900 ] 1659 0.194% 99.864% ( 2900, 4400 ] 1355 0.158% 100.022% ( 4400, 6600 ] 460 0.054% 100.076% ( 6600, 9900 ] 72 0.008% 100.084% ( 9900, 14000 ] 5 0.001% 100.085% ( 14000, 22000 ] 7 0.001% 100.086% ( 22000, 33000 ] 1 0.000% 100.086% ( 33000, 50000 ] 1 0.000% 100.086% ** Level 5 read latency histogram (micros): Count: 45720 Average: 1172.1907 StdDev: 1466.49 Min: 85 Median: 663.5571 Max: 57764 Percentiles: P50: 663.56 P75: 1430.74 P99: 6434.64 P99.9: 9858.94 P99.99: 28677.00 ------------------------------------------------------ ( 76, 110 ] 349 0.763% 0.763% ( 110, 170 ] 3668 8.023% 8.786% ## ( 170, 250 ] 5452 11.925% 20.711% ## ( 250, 380 ] 5250 11.483% 32.194% ## ( 380, 580 ] 6197 13.554% 45.748% ### ( 580, 870 ] 6747 14.757% 60.505% ### ( 870, 1300 ] 5760 12.598% 73.104% ### ( 1300, 1900 ] 3979 8.703% 81.807% ## ( 1900, 2900 ] 3277 7.168% 88.974% # ( 2900, 4400 ] 3154 6.899% 95.873% # ( 4400, 6600 ] 1546 3.381% 99.254% # ( 6600, 9900 ] 299 0.654% 99.908% ( 9900, 14000 ] 28 0.061% 99.969% ( 14000, 22000 ] 7 0.015% 99.985% ( 22000, 33000 ] 4 0.009% 99.993% ( 33000, 50000 ] 6 0.013% 100.007% ( 50000, 75000 ] 1 0.002% 100.009% ** DB Stats ** Uptime(secs): 18.6 total, 4.0 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 158.37 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.984 H:M:S, 37.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 244.20 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.283 H:M:S, 7.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/17-13:12:34 ... thread 0: (1000000,4000000) ops and (291504.3,182808.3) ops/second in (3.430481,21.880840) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/10 2.95 GB 144.8 2.3 0.0 2.3 6.0 3.7 0.0 1.6 73.7 195.2 31.62 19.96 59 0.536 2366K 2648 0.0 0.0 L1 2/2 208.90 MB 0.0 1.7 0.9 0.8 1.7 0.9 0.0 1.9 135.0 134.7 12.72 7.92 5 2.545 1743K 2800 0.0 0.0 L2 2/0 76.96 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 926.95 MB 0.9 5.9 3.8 2.1 5.8 3.7 0.3 1.5 109.3 108.2 54.88 28.41 24 2.287 2856K 4774 0.0 0.0 L4 181/0 9.55 GB 1.0 9.6 5.8 3.7 9.4 5.7 0.6 1.6 123.1 121.1 79.49 45.23 53 1.500 5291K 15K 0.0 0.0 L5 1152/0 94.80 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1371/12 108.49 GB 0.0 19.4 10.5 8.9 22.9 14.0 7.8 6.1 111.0 131.2 178.72 101.51 141 1.268 12M 25K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.4 10.5 8.9 22.9 14.0 7.8 6.1 111.0 131.2 178.72 101.51 141 1.268 12M 25K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.4 10.5 8.9 19.1 10.3 0.0 0.0 125.7 124.3 157.71 90.76 90 1.752 12M 25K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 182.9 21.01 10.75 51 0.412 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 22.1 total, 21.9 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.90 GB write, 1062.27 MB/s write, 19.37 GB read, 898.39 MB/s read, 178.7 seconds Interval compaction: 22.90 GB write, 1071.55 MB/s write, 19.37 GB read, 906.23 MB/s read, 178.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 60, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1009461 Average: 9.8610 StdDev: 101.25 Min: 1 Median: 1.7498 Max: 13869 Percentiles: P50: 1.75 P75: 2.61 P99: 190.59 P99.9: 941.81 P99.99: 1953.16 ------------------------------------------------------ [ 0, 1 ] 87334 8.652% 8.652% ## ( 1, 2 ] 556707 55.149% 63.800% ########### ( 2, 3 ] 185605 18.387% 82.187% #### ( 3, 4 ] 69699 6.905% 89.092% # ( 4, 6 ] 75292 7.459% 96.550% # ( 6, 10 ] 13894 1.376% 97.927% ( 10, 15 ] 3043 0.301% 98.228% ( 15, 22 ] 347 0.034% 98.262% ( 22, 34 ] 52 0.005% 98.268% ( 34, 51 ] 33 0.003% 98.271% ( 51, 76 ] 32 0.003% 98.274% ( 76, 110 ] 482 0.048% 98.322% ( 110, 170 ] 5554 0.550% 98.872% ( 170, 250 ] 5025 0.498% 99.370% ( 250, 380 ] 2323 0.230% 99.600% ( 380, 580 ] 1868 0.185% 99.785% ( 580, 870 ] 1059 0.105% 99.890% ( 870, 1300 ] 620 0.061% 99.951% ( 1300, 1900 ] 376 0.037% 99.989% ( 1900, 2900 ] 302 0.030% 100.018% ( 2900, 4400 ] 212 0.021% 100.039% ( 4400, 6600 ] 73 0.007% 100.047% ( 6600, 9900 ] 8 0.001% 100.047% ( 9900, 14000 ] 3 0.000% 100.048% ** Level 1 read latency histogram (micros): Count: 384577 Average: 9.1536 StdDev: 124.85 Min: 1 Median: 1.9790 Max: 26932 Percentiles: P50: 1.98 P75: 2.98 P99: 11.97 P99.9: 1652.14 P99.99: 3830.95 ------------------------------------------------------ [ 0, 1 ] 8667 2.254% 2.254% ( 1, 2 ] 187562 48.771% 51.025% ########## ( 2, 3 ] 94330 24.528% 75.553% ##### ( 3, 4 ] 36139 9.397% 84.950% ## ( 4, 6 ] 44228 11.500% 96.450% ## ( 6, 10 ] 8988 2.337% 98.787% ( 10, 15 ] 2077 0.540% 99.328% ( 15, 22 ] 250 0.065% 99.393% ( 22, 34 ] 20 0.005% 99.398% ( 34, 51 ] 28 0.007% 99.405% ( 51, 76 ] 20 0.005% 99.410% ( 76, 110 ] 40 0.010% 99.421% ( 110, 170 ] 269 0.070% 99.491% ( 170, 250 ] 293 0.076% 99.567% ( 250, 380 ] 241 0.063% 99.629% ( 380, 580 ] 268 0.070% 99.699% ( 580, 870 ] 347 0.090% 99.789% ( 870, 1300 ] 301 0.078% 99.868% ( 1300, 1900 ] 212 0.055% 99.923% ( 1900, 2900 ] 158 0.041% 99.964% ( 2900, 4400 ] 162 0.042% 100.006% ( 4400, 6600 ] 31 0.008% 100.014% ( 6600, 9900 ] 3 0.001% 100.015% ( 14000, 22000 ] 1 0.000% 100.015% ( 22000, 33000 ] 1 0.000% 100.015% ** Level 2 read latency histogram (micros): Count: 766560 Average: 20.3851 StdDev: 246.35 Min: 1 Median: 2.0856 Max: 26812 Percentiles: P50: 2.09 P75: 3.20 P99: 13.92 P99.9: 2767.78 P99.99: 3617.99 ------------------------------------------------------ [ 0, 1 ] 15982 2.085% 2.085% ( 1, 2 ] 350817 45.765% 47.850% ######### ( 2, 3 ] 192519 25.115% 72.965% ##### ( 3, 4 ] 77841 10.155% 83.119% ## ( 4, 6 ] 94973 12.390% 95.509% ## ( 6, 10 ] 21476 2.802% 98.310% # ( 10, 15 ] 6741 0.879% 99.190% ( 15, 22 ] 899 0.117% 99.307% ( 22, 34 ] 97 0.013% 99.320% ( 34, 51 ] 33 0.004% 99.324% ( 51, 76 ] 52 0.007% 99.331% ( 76, 110 ] 22 0.003% 99.334% ( 110, 170 ] 18 0.002% 99.336% ( 170, 250 ] 35 0.005% 99.341% ( 250, 380 ] 131 0.017% 99.358% ( 380, 580 ] 311 0.041% 99.398% ( 580, 870 ] 596 0.078% 99.476% ( 870, 1300 ] 941 0.123% 99.599% ( 1300, 1900 ] 1190 0.155% 99.754% ( 1900, 2900 ] 1290 0.168% 99.922% ( 2900, 4400 ] 1085 0.142% 100.064% ( 4400, 6600 ] 371 0.048% 100.112% ( 6600, 9900 ] 69 0.009% 100.121% ( 9900, 14000 ] 10 0.001% 100.122% ( 14000, 22000 ] 13 0.002% 100.124% ( 22000, 33000 ] 4 0.001% 100.125% ** Level 3 read latency histogram (micros): Count: 2053452 Average: 10.5969 StdDev: 159.26 Min: 1 Median: 2.0376 Max: 41026 Percentiles: P50: 2.04 P75: 3.01 P99: 9.99 P99.9: 936.43 P99.99: 1596.93 ------------------------------------------------------ [ 0, 1 ] 34329 1.672% 1.672% ( 1, 2 ] 972403 47.355% 49.026% ######### ( 2, 3 ] 531139 25.866% 74.892% ##### ( 3, 4 ] 201650 9.820% 84.712% ## ( 4, 6 ] 243972 11.881% 96.593% ## ( 6, 10 ] 49488 2.410% 99.003% ( 10, 15 ] 12548 0.611% 99.614% ( 15, 22 ] 1413 0.069% 99.683% ( 22, 34 ] 124 0.006% 99.689% ( 34, 51 ] 120 0.006% 99.695% ( 51, 76 ] 146 0.007% 99.702% ( 76, 110 ] 72 0.004% 99.705% ( 110, 170 ] 499 0.024% 99.730% ( 170, 250 ] 601 0.029% 99.759% ( 250, 380 ] 564 0.027% 99.787% ( 380, 580 ] 861 0.042% 99.828% ( 580, 870 ] 1244 0.061% 99.889% ( 870, 1300 ] 1460 0.071% 99.960% ( 1300, 1900 ] 1240 0.060% 100.021% ( 1900, 2900 ] 1398 0.068% 100.089% ( 2900, 4400 ] 1219 0.059% 100.148% ( 4400, 6600 ] 378 0.018% 100.166% ( 6600, 9900 ] 47 0.002% 100.169% ( 9900, 14000 ] 10 0.000% 100.169% ( 14000, 22000 ] 11 0.001% 100.170% ( 22000, 33000 ] 5 0.000% 100.170% ( 33000, 50000 ] 2 0.000% 100.170% ** Level 4 read latency histogram (micros): Count: 862467 Average: 28.9588 StdDev: 258.90 Min: 0 Median: 2.0475 Max: 38983 Percentiles: P50: 2.05 P75: 3.20 P99: 719.83 P99.9: 3237.98 P99.99: 4096.63 ------------------------------------------------------ [ 0, 1 ] 17354 2.012% 2.012% ( 1, 2 ] 403943 46.836% 48.848% ######### ( 2, 3 ] 209137 24.249% 73.097% ##### ( 3, 4 ] 82421 9.556% 82.653% ## ( 4, 6 ] 99834 11.575% 94.228% ## ( 6, 10 ] 22017 2.553% 96.781% # ( 10, 15 ] 5711 0.662% 97.443% ( 15, 22 ] 608 0.070% 97.514% ( 22, 34 ] 51 0.006% 97.520% ( 34, 51 ] 66 0.008% 97.527% ( 51, 76 ] 83 0.010% 97.537% ( 76, 110 ] 310 0.036% 97.573% ( 110, 170 ] 3129 0.363% 97.936% ( 170, 250 ] 3376 0.391% 98.327% ( 250, 380 ] 2116 0.245% 98.573% ( 380, 580 ] 2424 0.281% 98.854% ( 580, 870 ] 2618 0.304% 99.157% ( 870, 1300 ] 2532 0.294% 99.451% ( 1300, 1900 ] 1903 0.221% 99.671% ( 1900, 2900 ] 1666 0.193% 99.865% ( 2900, 4400 ] 1356 0.157% 100.022% ( 4400, 6600 ] 460 0.053% 100.075% ( 6600, 9900 ] 72 0.008% 100.083% ( 9900, 14000 ] 5 0.001% 100.084% ( 14000, 22000 ] 7 0.001% 100.085% ( 22000, 33000 ] 1 0.000% 100.085% ( 33000, 50000 ] 1 0.000% 100.085% ** Level 5 read latency histogram (micros): Count: 82090 Average: 759.6562 StdDev: 1193.82 Min: 82 Median: 315.5237 Max: 57764 Percentiles: P50: 315.52 P75: 792.76 P99: 5918.95 P99.9: 9459.01 P99.99: 20618.29 ------------------------------------------------------ ( 76, 110 ] 1609 1.960% 1.960% ( 110, 170 ] 17402 21.199% 23.159% #### ( 170, 250 ] 16967 20.669% 43.828% #### ( 250, 380 ] 10053 12.246% 56.074% ## ( 380, 580 ] 9654 11.760% 67.834% ## ( 580, 870 ] 8018 9.767% 77.601% ## ( 870, 1300 ] 6038 7.355% 84.957% # ( 1300, 1900 ] 4000 4.873% 89.829% # ( 1900, 2900 ] 3300 4.020% 93.849% # ( 2900, 4400 ] 3160 3.849% 97.699% # ( 4400, 6600 ] 1547 1.885% 99.583% ( 6600, 9900 ] 300 0.365% 99.949% ( 9900, 14000 ] 28 0.034% 99.983% ( 14000, 22000 ] 7 0.009% 99.991% ( 22000, 33000 ] 4 0.005% 99.996% ( 33000, 50000 ] 6 0.007% 100.004% ( 50000, 75000 ] 1 0.001% 100.005% ** DB Stats ** Uptime(secs): 22.1 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 178.35 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.984 H:M:S, 31.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 286.90 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/10/17-13:12:38 ... thread 0: (1000000,5000000) ops and (209255.4,187549.1) ops/second in (4.778849,26.659689) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/6 3.93 GB 270.6 3.5 0.0 3.5 8.2 4.7 0.0 1.7 90.2 212.1 39.79 27.51 80 0.497 3645K 3876 0.0 0.0 L1 2/2 208.90 MB 0.0 1.7 0.9 0.8 1.7 0.9 0.0 1.9 135.0 134.7 12.72 7.92 5 2.545 1743K 2800 0.0 0.0 L2 2/0 76.96 MB 0.8 0.0 0.0 0.0 0.0 0.0 0.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 16/0 926.95 MB 0.9 5.9 3.8 2.1 5.8 3.7 0.3 1.5 109.3 108.2 54.88 28.41 24 2.287 2856K 4774 0.0 0.0 L4 181/0 9.55 GB 1.0 9.6 5.8 3.7 9.4 5.7 0.6 1.6 123.1 121.1 79.49 45.23 53 1.500 5291K 15K 0.0 0.0 L5 1152/0 94.80 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1372/8 109.47 GB 0.0 20.6 10.5 10.1 25.1 15.0 7.8 5.3 112.9 137.6 186.89 109.06 162 1.154 13M 26K 0.0 0.0 Int 0/0 0.00 KB 0.0 20.6 10.5 10.1 25.1 15.0 7.8 5.3 112.9 137.6 186.89 109.06 162 1.154 13M 26K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 20.6 10.5 10.1 20.4 10.3 0.0 0.0 129.7 128.3 162.61 95.53 95 1.712 13M 26K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 199.8 24.28 13.53 67 0.362 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 26.9 total, 26.7 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 25.11 GB write, 957.64 MB/s write, 20.60 GB read, 785.43 MB/s read, 186.9 seconds Interval compaction: 25.11 GB write, 964.50 MB/s write, 20.60 GB read, 791.05 MB/s read, 186.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 7, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 7, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 12, total-stops: 60, interval: 72 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1324785 Average: 12.0779 StdDev: 95.08 Min: 0 Median: 1.6900 Max: 13869 Percentiles: P50: 1.69 P75: 2.50 P99: 234.68 P99.9: 803.53 P99.99: 1566.79 ------------------------------------------------------ [ 0, 1 ] 157161 11.863% 11.863% ## ( 1, 2 ] 732219 55.271% 67.134% ########### ( 2, 3 ] 210341 15.877% 83.011% ### ( 3, 4 ] 79939 6.034% 89.045% # ( 4, 6 ] 82497 6.227% 95.273% # ( 6, 10 ] 15236 1.150% 96.423% ( 10, 15 ] 3415 0.258% 96.680% ( 15, 22 ] 416 0.031% 96.712% ( 22, 34 ] 75 0.006% 96.718% ( 34, 51 ] 35 0.003% 96.720% ( 51, 76 ] 34 0.003% 96.723% ( 76, 110 ] 1480 0.112% 96.834% ( 110, 170 ] 17279 1.304% 98.139% ( 170, 250 ] 14112 1.065% 99.204% ( 250, 380 ] 4720 0.356% 99.560% ( 380, 580 ] 3345 0.252% 99.813% ( 580, 870 ] 1500 0.113% 99.926% ( 870, 1300 ] 676 0.051% 99.977% ( 1300, 1900 ] 388 0.029% 100.006% ( 1900, 2900 ] 325 0.025% 100.031% ( 2900, 4400 ] 222 0.017% 100.048% ( 4400, 6600 ] 73 0.006% 100.053% ( 6600, 9900 ] 8 0.001% 100.054% ( 9900, 14000 ] 3 0.000% 100.054% ** Level 1 read latency histogram (micros): Count: 385326 Average: 9.5225 StdDev: 125.15 Min: 1 Median: 1.9810 Max: 26932 Percentiles: P50: 1.98 P75: 2.98 P99: 13.75 P99.9: 1654.01 P99.99: 3830.25 ------------------------------------------------------ [ 0, 1 ] 8667 2.249% 2.249% ( 1, 2 ] 187562 48.676% 50.925% ########## ( 2, 3 ] 94331 24.481% 75.406% ##### ( 3, 4 ] 36139 9.379% 84.785% ## ( 4, 6 ] 44228 11.478% 96.263% ## ( 6, 10 ] 8988 2.333% 98.596% ( 10, 15 ] 2077 0.539% 99.135% ( 15, 22 ] 250 0.065% 99.200% ( 22, 34 ] 20 0.005% 99.205% ( 34, 51 ] 28 0.007% 99.212% ( 51, 76 ] 20 0.005% 99.217% ( 76, 110 ] 72 0.019% 99.236% ( 110, 170 ] 645 0.167% 99.403% ( 170, 250 ] 528 0.137% 99.540% ( 250, 380 ] 296 0.077% 99.617% ( 380, 580 ] 306 0.079% 99.697% ( 580, 870 ] 357 0.093% 99.789% ( 870, 1300 ] 301 0.078% 99.867% ( 1300, 1900 ] 213 0.055% 99.923% ( 1900, 2900 ] 159 0.041% 99.964% ( 2900, 4400 ] 162 0.042% 100.006% ( 4400, 6600 ] 31 0.008% 100.014% ( 6600, 9900 ] 3 0.001% 100.015% ( 14000, 22000 ] 1 0.000% 100.015% ( 22000, 33000 ] 1 0.000% 100.015% ** Level 2 read latency histogram (micros): Count: 766560 Average: 20.3851 StdDev: 246.35 Min: 1 Median: 2.0856 Max: 26812 Percentiles: P50: 2.09 P75: 3.20 P99: 13.92 P99.9: 2767.78 P99.99: 3617.99 ------------------------------------------------------ [ 0, 1 ] 15982 2.085% 2.085% ( 1, 2 ] 350817 45.765% 47.850% ######### ( 2, 3 ] 192519 25.115% 72.965% ##### ( 3, 4 ] 77841 10.155% 83.119% ## ( 4, 6 ] 94973 12.390% 95.509% ## ( 6, 10 ] 21476 2.802% 98.310% # ( 10, 15 ] 6741 0.879% 99.190% ( 15, 22 ] 899 0.117% 99.307% ( 22, 34 ] 97 0.013% 99.320% ( 34, 51 ] 33 0.004% 99.324% ( 51, 76 ] 52 0.007% 99.331% ( 76, 110 ] 22 0.003% 99.334% ( 110, 170 ] 18 0.002% 99.336% ( 170, 250 ] 35 0.005% 99.341% ( 250, 380 ] 131 0.017% 99.358% ( 380, 580 ] 311 0.041% 99.398% ( 580, 870 ] 596 0.078% 99.476% ( 870, 1300 ] 941 0.123% 99.599% ( 1300, 1900 ] 1190 0.155% 99.754% ( 1900, 2900 ] 1290 0.168% 99.922% ( 2900, 4400 ] 1085 0.142% 100.064% ( 4400, 6600 ] 371 0.048% 100.112% ( 6600, 9900 ] 69 0.009% 100.121% ( 9900, 14000 ] 10 0.001% 100.122% ( 14000, 22000 ] 13 0.002% 100.124% ( 22000, 33000 ] 4 0.001% 100.125% ** Level 3 read latency histogram (micros): Count: 2054544 Average: 10.6958 StdDev: 159.30 Min: 1 Median: 2.0387 Max: 41026 Percentiles: P50: 2.04 P75: 3.02 P99: 10.41 P99.9: 937.15 P99.99: 1597.36 ------------------------------------------------------ [ 0, 1 ] 34329 1.671% 1.671% ( 1, 2 ] 972403 47.329% 49.000% ######### ( 2, 3 ] 531139 25.852% 74.852% ##### ( 3, 4 ] 201650 9.815% 84.667% ## ( 4, 6 ] 243972 11.875% 96.542% ## ( 6, 10 ] 49488 2.409% 98.950% ( 10, 15 ] 12548 0.611% 99.561% ( 15, 22 ] 1413 0.069% 99.630% ( 22, 34 ] 124 0.006% 99.636% ( 34, 51 ] 120 0.006% 99.642% ( 51, 76 ] 146 0.007% 99.649% ( 76, 110 ] 127 0.006% 99.655% ( 110, 170 ] 1000 0.049% 99.704% ( 170, 250 ] 989 0.048% 99.752% ( 250, 380 ] 650 0.032% 99.784% ( 380, 580 ] 910 0.044% 99.828% ( 580, 870 ] 1253 0.061% 99.889% ( 870, 1300 ] 1463 0.071% 99.960% ( 1300, 1900 ] 1240 0.060% 100.020% ( 1900, 2900 ] 1399 0.068% 100.089% ( 2900, 4400 ] 1219 0.059% 100.148% ( 4400, 6600 ] 378 0.018% 100.166% ( 6600, 9900 ] 47 0.002% 100.169% ( 9900, 14000 ] 10 0.000% 100.169% ( 14000, 22000 ] 11 0.001% 100.170% ( 22000, 33000 ] 5 0.000% 100.170% ( 33000, 50000 ] 2 0.000% 100.170% ** Level 4 read latency histogram (micros): Count: 873810 Average: 31.1197 StdDev: 258.34 Min: 0 Median: 2.0744 Max: 38983 Percentiles: P50: 2.07 P75: 3.30 P99: 721.74 P99.9: 3225.43 P99.99: 4095.37 ------------------------------------------------------ [ 0, 1 ] 17354 1.986% 1.986% ( 1, 2 ] 403973 46.231% 48.217% ######### ( 2, 3 ] 209244 23.946% 72.163% ##### ( 3, 4 ] 82488 9.440% 81.603% ## ( 4, 6 ] 99970 11.441% 93.044% ## ( 6, 10 ] 22045 2.523% 95.567% # ( 10, 15 ] 5717 0.654% 96.221% ( 15, 22 ] 610 0.070% 96.291% ( 22, 34 ] 51 0.006% 96.297% ( 34, 51 ] 66 0.008% 96.304% ( 51, 76 ] 83 0.009% 96.314% ( 76, 110 ] 803 0.092% 96.406% ( 110, 170 ] 8469 0.969% 97.375% ( 170, 250 ] 6832 0.782% 98.157% ( 250, 380 ] 2979 0.341% 98.498% ( 380, 580 ] 3016 0.345% 98.843% ( 580, 870 ] 2807 0.321% 99.164% ( 870, 1300 ] 2555 0.292% 99.457% ( 1300, 1900 ] 1907 0.218% 99.675% ( 1900, 2900 ] 1673 0.191% 99.866% ( 2900, 4400 ] 1356 0.155% 100.022% ( 4400, 6600 ] 460 0.053% 100.074% ( 6600, 9900 ] 72 0.008% 100.082% ( 9900, 14000 ] 5 0.001% 100.083% ( 14000, 22000 ] 7 0.001% 100.084% ( 22000, 33000 ] 1 0.000% 100.084% ( 33000, 50000 ] 1 0.000% 100.084% ** Level 5 read latency histogram (micros): Count: 140276 Average: 527.9874 StdDev: 957.37 Min: 82 Median: 216.1402 Max: 57764 Percentiles: P50: 216.14 P75: 461.47 P99: 5090.06 P99.9: 8807.96 P99.99: 13849.53 ------------------------------------------------------ ( 76, 110 ] 4312 3.074% 3.074% # ( 110, 170 ] 45304 32.296% 35.370% ###### ( 170, 250 ] 35582 25.366% 60.736% ##### ( 250, 380 ] 14798 10.549% 71.285% ## ( 380, 580 ] 12793 9.120% 80.405% ## ( 580, 870 ] 8899 6.344% 86.749% # ( 870, 1300 ] 6176 4.403% 91.152% # ( 1300, 1900 ] 4037 2.878% 94.030% # ( 1900, 2900 ] 3323 2.369% 96.399% ( 2900, 4400 ] 3164 2.256% 98.654% ( 4400, 6600 ] 1547 1.103% 99.757% ( 6600, 9900 ] 300 0.214% 99.971% ( 9900, 14000 ] 28 0.020% 99.991% ( 14000, 22000 ] 7 0.005% 99.996% ( 22000, 33000 ] 4 0.003% 99.999% ( 33000, 50000 ] 6 0.004% 100.003% ( 50000, 75000 ] 1 0.001% 100.004% ** DB Stats ** Uptime(secs): 26.9 total, 4.8 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 183.26 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.293 H:M:S, 30.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 205.95 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.310 H:M:S, 27.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/10/17-13:12:47 ... thread 0: (1000000,6000000) ops and (114100.2,169377.1) ops/second in (8.764223,35.423912) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/4 3.55 GB 338.8 5.8 0.0 5.8 11.4 5.6 0.0 2.0 114.4 226.0 51.77 38.81 99 0.523 6011K 15K 0.0 0.0 L1 10/0 1005.15 MB 100.5 3.2 2.2 1.0 3.2 2.2 0.0 1.4 108.9 108.5 29.81 16.20 6 4.969 3297K 12K 0.0 0.0 L2 2/2 257.56 MB 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 22/5 1.23 GB 1.0 6.5 4.1 2.4 6.4 4.0 0.3 1.6 114.3 113.3 58.17 31.39 27 2.155 3472K 6078 0.0 0.0 L4 181/0 9.55 GB 1.0 9.6 5.8 3.7 9.4 5.7 0.6 1.6 123.1 121.1 79.49 45.23 53 1.500 5291K 15K 0.0 0.0 L5 1152/0 94.80 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1380/11 110.37 GB 0.0 25.0 12.1 12.9 30.4 17.5 8.3 5.4 116.8 142.1 219.25 131.62 185 1.185 18M 48K 0.0 0.0 Int 0/0 0.00 KB 0.0 25.0 12.1 12.9 30.4 17.5 8.3 5.4 116.8 142.1 219.25 131.62 185 1.185 18M 48K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 25.0 12.1 12.9 24.8 11.9 0.0 0.0 133.5 132.2 191.82 115.46 103 1.862 18M 48K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 211.3 27.43 16.16 82 0.334 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.6 total, 35.4 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.42 GB write, 874.61 MB/s write, 25.00 GB read, 718.88 MB/s read, 219.2 seconds Interval compaction: 30.42 GB write, 879.32 MB/s write, 25.00 GB read, 722.76 MB/s read, 219.2 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 12, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 12, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 60, pending-compaction-bytes-delays: 5, pending-compaction-bytes-stops: 0, total-delays: 17, total-stops: 60, interval: 77 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2149126 Average: 11.3033 StdDev: 81.13 Min: 0 Median: 1.6224 Max: 13869 Percentiles: P50: 1.62 P75: 2.24 P99: 230.59 P99.9: 670.46 P99.99: 1093.62 ------------------------------------------------------ [ 0, 1 ] 309427 14.398% 14.398% ### ( 1, 2 ] 1229431 57.206% 71.604% ########### ( 2, 3 ] 299383 13.930% 85.534% ### ( 3, 4 ] 107370 4.996% 90.530% # ( 4, 6 ] 104218 4.849% 95.380% # ( 6, 10 ] 20419 0.950% 96.330% ( 10, 15 ] 4306 0.200% 96.530% ( 15, 22 ] 533 0.025% 96.555% ( 22, 34 ] 87 0.004% 96.559% ( 34, 51 ] 40 0.002% 96.561% ( 51, 76 ] 35 0.002% 96.562% ( 76, 110 ] 3057 0.142% 96.705% ( 110, 170 ] 31831 1.481% 98.186% ( 170, 250 ] 23104 1.075% 99.261% ( 250, 380 ] 7664 0.357% 99.617% ( 380, 580 ] 5391 0.251% 99.868% ( 580, 870 ] 2186 0.102% 99.970% ( 870, 1300 ] 827 0.038% 100.009% ( 1300, 1900 ] 414 0.019% 100.028% ( 1900, 2900 ] 345 0.016% 100.044% ( 2900, 4400 ] 231 0.011% 100.055% ( 4400, 6600 ] 76 0.004% 100.058% ( 6600, 9900 ] 8 0.000% 100.058% ( 9900, 14000 ] 3 0.000% 100.059% ** Level 1 read latency histogram (micros): Count: 528313 Average: 8.5356 StdDev: 108.83 Min: 0 Median: 1.9296 Max: 26932 Percentiles: P50: 1.93 P75: 2.89 P99: 14.54 P99.9: 1247.63 P99.99: 3377.15 ------------------------------------------------------ [ 0, 1 ] 12548 2.375% 2.375% ( 1, 2 ] 270673 51.233% 53.609% ########## ( 2, 3 ] 127538 24.141% 77.749% ##### ( 3, 4 ] 45063 8.530% 86.279% ## ( 4, 6 ] 53080 10.047% 96.326% ## ( 6, 10 ] 11662 2.207% 98.533% ( 10, 15 ] 2714 0.514% 99.047% ( 15, 22 ] 309 0.058% 99.105% ( 22, 34 ] 24 0.005% 99.110% ( 34, 51 ] 29 0.005% 99.115% ( 51, 76 ] 20 0.004% 99.119% ( 76, 110 ] 134 0.025% 99.145% ( 110, 170 ] 1247 0.236% 99.381% ( 170, 250 ] 981 0.186% 99.566% ( 250, 380 ] 539 0.102% 99.668% ( 380, 580 ] 499 0.094% 99.763% ( 580, 870 ] 435 0.082% 99.845% ( 870, 1300 ] 331 0.063% 99.908% ( 1300, 1900 ] 221 0.042% 99.950% ( 1900, 2900 ] 162 0.031% 99.980% ( 2900, 4400 ] 164 0.031% 100.011% ( 4400, 6600 ] 31 0.006% 100.017% ( 6600, 9900 ] 3 0.001% 100.018% ( 14000, 22000 ] 1 0.000% 100.018% ( 22000, 33000 ] 1 0.000% 100.018% ** Level 2 read latency histogram (micros): Count: 766560 Average: 20.3851 StdDev: 246.35 Min: 1 Median: 2.0856 Max: 26812 Percentiles: P50: 2.09 P75: 3.20 P99: 13.92 P99.9: 2767.78 P99.99: 3617.99 ------------------------------------------------------ [ 0, 1 ] 15982 2.085% 2.085% ( 1, 2 ] 350817 45.765% 47.850% ######### ( 2, 3 ] 192519 25.115% 72.965% ##### ( 3, 4 ] 77841 10.155% 83.119% ## ( 4, 6 ] 94973 12.390% 95.509% ## ( 6, 10 ] 21476 2.802% 98.310% # ( 10, 15 ] 6741 0.879% 99.190% ( 15, 22 ] 899 0.117% 99.307% ( 22, 34 ] 97 0.013% 99.320% ( 34, 51 ] 33 0.004% 99.324% ( 51, 76 ] 52 0.007% 99.331% ( 76, 110 ] 22 0.003% 99.334% ( 110, 170 ] 18 0.002% 99.336% ( 170, 250 ] 35 0.005% 99.341% ( 250, 380 ] 131 0.017% 99.358% ( 380, 580 ] 311 0.041% 99.398% ( 580, 870 ] 596 0.078% 99.476% ( 870, 1300 ] 941 0.123% 99.599% ( 1300, 1900 ] 1190 0.155% 99.754% ( 1900, 2900 ] 1290 0.168% 99.922% ( 2900, 4400 ] 1085 0.142% 100.064% ( 4400, 6600 ] 371 0.048% 100.112% ( 6600, 9900 ] 69 0.009% 100.121% ( 9900, 14000 ] 10 0.001% 100.122% ( 14000, 22000 ] 13 0.002% 100.124% ( 22000, 33000 ] 4 0.001% 100.125% ** Level 3 read latency histogram (micros): Count: 2185214 Average: 10.4784 StdDev: 154.79 Min: 0 Median: 2.0180 Max: 41026 Percentiles: P50: 2.02 P75: 2.99 P99: 10.98 P99.9: 888.10 P99.99: 1559.44 ------------------------------------------------------ [ 0, 1 ] 37673 1.724% 1.724% ( 1, 2 ] 1044837 47.814% 49.538% ########## ( 2, 3 ] 562331 25.733% 75.271% ##### ( 3, 4 ] 210936 9.653% 84.924% ## ( 4, 6 ] 253011 11.578% 96.503% ## ( 6, 10 ] 52013 2.380% 98.883% ( 10, 15 ] 13129 0.601% 99.484% ( 15, 22 ] 1477 0.068% 99.551% ( 22, 34 ] 135 0.006% 99.557% ( 34, 51 ] 121 0.006% 99.563% ( 51, 76 ] 146 0.007% 99.570% ( 76, 110 ] 227 0.010% 99.580% ( 110, 170 ] 1867 0.085% 99.665% ( 170, 250 ] 1614 0.074% 99.739% ( 250, 380 ] 964 0.044% 99.783% ( 380, 580 ] 1137 0.052% 99.835% ( 580, 870 ] 1348 0.062% 99.897% ( 870, 1300 ] 1492 0.068% 99.965% ( 1300, 1900 ] 1243 0.057% 100.022% ( 1900, 2900 ] 1402 0.064% 100.086% ( 2900, 4400 ] 1219 0.056% 100.142% ( 4400, 6600 ] 378 0.017% 100.160% ( 6600, 9900 ] 47 0.002% 100.162% ( 9900, 14000 ] 10 0.000% 100.162% ( 14000, 22000 ] 11 0.001% 100.163% ( 22000, 33000 ] 5 0.000% 100.163% ( 33000, 50000 ] 2 0.000% 100.163% ** Level 4 read latency histogram (micros): Count: 892617 Average: 35.1920 StdDev: 258.27 Min: 0 Median: 2.1194 Max: 38983 Percentiles: P50: 2.12 P75: 3.47 P99: 745.81 P99.9: 3208.14 P99.99: 4094.20 ------------------------------------------------------ [ 0, 1 ] 17354 1.944% 1.944% ( 1, 2 ] 403974 45.257% 47.201% ######### ( 2, 3 ] 209263 23.444% 70.645% ##### ( 3, 4 ] 82507 9.243% 79.888% ## ( 4, 6 ] 100008 11.204% 91.092% ## ( 6, 10 ] 22049 2.470% 93.563% ( 10, 15 ] 5718 0.641% 94.203% ( 15, 22 ] 611 0.068% 94.272% ( 22, 34 ] 51 0.006% 94.277% ( 34, 51 ] 66 0.007% 94.285% ( 51, 76 ] 83 0.009% 94.294% ( 76, 110 ] 1681 0.188% 94.482% ( 110, 170 ] 16809 1.883% 96.365% ( 170, 250 ] 12192 1.366% 97.731% ( 250, 380 ] 4962 0.556% 98.287% ( 380, 580 ] 4424 0.496% 98.783% ( 580, 870 ] 3391 0.380% 99.163% ( 870, 1300 ] 2688 0.301% 99.464% ( 1300, 1900 ] 1928 0.216% 99.680% ( 1900, 2900 ] 1686 0.189% 99.869% ( 2900, 4400 ] 1360 0.152% 100.021% ( 4400, 6600 ] 460 0.052% 100.073% ( 6600, 9900 ] 72 0.008% 100.081% ( 9900, 14000 ] 5 0.001% 100.081% ( 14000, 22000 ] 7 0.001% 100.082% ( 22000, 33000 ] 1 0.000% 100.082% ( 33000, 50000 ] 1 0.000% 100.082% ** Level 5 read latency histogram (micros): Count: 235306 Average: 406.0854 StdDev: 762.11 Min: 81 Median: 196.9947 Max: 57764 Percentiles: P50: 196.99 P75: 340.28 P99: 4183.40 P99.9: 7751.63 P99.99: 12311.59 ------------------------------------------------------ ( 76, 110 ] 8981 3.817% 3.817% # ( 110, 170 ] 87442 37.161% 40.978% ####### ( 170, 250 ] 62916 26.738% 67.716% ##### ( 250, 380 ] 24683 10.490% 78.205% ## ( 380, 580 ] 19948 8.477% 86.683% ## ( 580, 870 ] 11784 5.008% 91.691% # ( 870, 1300 ] 6916 2.939% 94.630% # ( 1300, 1900 ] 4162 1.769% 96.399% ( 1900, 2900 ] 3395 1.443% 97.842% ( 2900, 4400 ] 3186 1.354% 99.196% ( 4400, 6600 ] 1553 0.660% 99.856% ( 6600, 9900 ] 300 0.127% 99.983% ( 9900, 14000 ] 28 0.012% 99.995% ( 14000, 22000 ] 7 0.003% 99.998% ( 22000, 33000 ] 4 0.002% 100.000% ( 33000, 50000 ] 6 0.003% 100.002% ( 50000, 75000 ] 1 0.000% 100.003% ** DB Stats ** Uptime(secs): 35.6 total, 8.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 165.80 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:13.299 H:M:S, 37.3 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 112.30 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:5.006 H:M:S, 57.1 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/10/17-13:13:07 ... thread 0: (1000000,7000000) ops and (49937.3,126242.1) ops/second in (20.025093,55.449005) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/11 4.60 GB 100.7 6.8 0.0 6.8 13.5 6.7 0.0 2.0 116.3 230.3 60.11 45.87 119 0.505 7098K 16K 0.0 0.0 L1 10/10 1005.15 MB 0.0 3.2 2.2 1.0 3.2 2.2 0.0 1.4 108.9 108.5 29.81 16.20 6 4.969 3297K 12K 0.0 0.0 L3 17/0 965.28 MB 1.0 7.0 4.3 2.7 6.9 4.3 0.3 1.6 118.0 117.0 60.76 33.74 29 2.095 3997K 8734 0.0 0.0 L4 182/0 9.74 GB 1.0 11.5 6.3 5.2 11.3 6.1 0.6 1.8 127.9 125.7 91.98 54.49 61 1.508 7286K 41K 0.0 0.0 L5 1156/0 95.11 GB 1.0 0.0 0.0 0.0 0.0 0.0 6.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1382/21 111.38 GB 0.0 28.5 12.8 15.7 34.9 19.3 7.5 5.2 120.2 147.3 242.66 150.30 215 1.129 21M 78K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.5 12.8 15.7 34.9 19.3 7.5 5.2 120.2 147.3 242.66 150.30 215 1.129 21M 78K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.5 12.8 15.7 28.2 12.5 0.0 0.0 138.2 136.8 211.10 131.14 117 1.804 21M 78K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 217.6 31.56 19.16 98 0.322 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 55.6 total, 55.5 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 34.91 GB write, 642.44 MB/s write, 28.49 GB read, 524.25 MB/s read, 242.7 seconds Interval compaction: 34.91 GB write, 644.66 MB/s write, 28.49 GB read, 526.05 MB/s read, 242.7 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 14, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 14, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 62, pending-compaction-bytes-delays: 14, pending-compaction-bytes-stops: 0, total-delays: 28, total-stops: 62, interval: 90 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2565078 Average: 19.2783 StdDev: 94.31 Min: 0 Median: 1.6662 Max: 32918 Percentiles: P50: 1.67 P75: 2.53 P99: 245.98 P99.9: 765.91 P99.99: 1240.54 ------------------------------------------------------ [ 0, 1 ] 359389 14.011% 14.011% ### ( 1, 2 ] 1385790 54.025% 68.036% ########### ( 2, 3 ] 334538 13.042% 81.078% ### ( 3, 4 ] 123192 4.803% 85.881% # ( 4, 6 ] 121937 4.754% 90.635% # ( 6, 10 ] 22406 0.874% 91.508% ( 10, 15 ] 4724 0.184% 91.692% ( 15, 22 ] 589 0.023% 91.715% ( 22, 34 ] 96 0.004% 91.719% ( 34, 51 ] 44 0.002% 91.721% ( 51, 76 ] 41 0.002% 91.722% ( 76, 110 ] 9950 0.388% 92.110% ( 110, 170 ] 118244 4.610% 96.720% # ( 170, 250 ] 61585 2.401% 99.121% ( 250, 380 ] 10645 0.415% 99.536% ( 380, 580 ] 7262 0.283% 99.819% ( 580, 870 ] 3246 0.127% 99.945% ( 870, 1300 ] 1327 0.052% 99.997% ( 1300, 1900 ] 576 0.022% 100.020% ( 1900, 2900 ] 475 0.019% 100.038% ( 2900, 4400 ] 363 0.014% 100.052% ( 4400, 6600 ] 86 0.003% 100.056% ( 6600, 9900 ] 9 0.000% 100.056% ( 9900, 14000 ] 3 0.000% 100.056% ( 22000, 33000 ] 1 0.000% 100.056% ** Level 1 read latency histogram (micros): Count: 543803 Average: 10.3911 StdDev: 110.38 Min: 0 Median: 1.9377 Max: 26932 Percentiles: P50: 1.94 P75: 2.92 P99: 167.30 P99.9: 1259.17 P99.99: 3402.54 ------------------------------------------------------ [ 0, 1 ] 12796 2.353% 2.353% ( 1, 2 ] 276333 50.815% 53.168% ########## ( 2, 3 ] 129444 23.803% 76.971% ##### ( 3, 4 ] 45575 8.381% 85.352% ## ( 4, 6 ] 53584 9.854% 95.206% ## ( 6, 10 ] 11817 2.173% 97.379% ( 10, 15 ] 2758 0.507% 97.886% ( 15, 22 ] 314 0.058% 97.944% ( 22, 34 ] 24 0.004% 97.948% ( 34, 51 ] 29 0.005% 97.953% ( 51, 76 ] 20 0.004% 97.957% ( 76, 110 ] 555 0.102% 98.059% ( 110, 170 ] 5357 0.985% 99.044% ( 170, 250 ] 2619 0.482% 99.526% ( 250, 380 ] 669 0.123% 99.649% ( 380, 580 ] 564 0.104% 99.753% ( 580, 870 ] 479 0.088% 99.841% ( 870, 1300 ] 356 0.065% 99.906% ( 1300, 1900 ] 229 0.042% 99.948% ( 1900, 2900 ] 170 0.031% 99.980% ( 2900, 4400 ] 169 0.031% 100.011% ( 4400, 6600 ] 32 0.006% 100.017% ( 6600, 9900 ] 3 0.001% 100.017% ( 14000, 22000 ] 1 0.000% 100.017% ( 22000, 33000 ] 1 0.000% 100.017% ** Level 2 read latency histogram (micros): Count: 766560 Average: 20.3851 StdDev: 246.35 Min: 1 Median: 2.0856 Max: 26812 Percentiles: P50: 2.09 P75: 3.20 P99: 13.92 P99.9: 2767.78 P99.99: 3617.99 ------------------------------------------------------ [ 0, 1 ] 15982 2.085% 2.085% ( 1, 2 ] 350817 45.765% 47.850% ######### ( 2, 3 ] 192519 25.115% 72.965% ##### ( 3, 4 ] 77841 10.155% 83.119% ## ( 4, 6 ] 94973 12.390% 95.509% ## ( 6, 10 ] 21476 2.802% 98.310% # ( 10, 15 ] 6741 0.879% 99.190% ( 15, 22 ] 899 0.117% 99.307% ( 22, 34 ] 97 0.013% 99.320% ( 34, 51 ] 33 0.004% 99.324% ( 51, 76 ] 52 0.007% 99.331% ( 76, 110 ] 22 0.003% 99.334% ( 110, 170 ] 18 0.002% 99.336% ( 170, 250 ] 35 0.005% 99.341% ( 250, 380 ] 131 0.017% 99.358% ( 380, 580 ] 311 0.041% 99.398% ( 580, 870 ] 596 0.078% 99.476% ( 870, 1300 ] 941 0.123% 99.599% ( 1300, 1900 ] 1190 0.155% 99.754% ( 1900, 2900 ] 1290 0.168% 99.922% ( 2900, 4400 ] 1085 0.142% 100.064% ( 4400, 6600 ] 371 0.048% 100.112% ( 6600, 9900 ] 69 0.009% 100.121% ( 9900, 14000 ] 10 0.001% 100.122% ( 14000, 22000 ] 13 0.002% 100.124% ( 22000, 33000 ] 4 0.001% 100.125% ** Level 3 read latency histogram (micros): Count: 2332352 Average: 10.3794 StdDev: 150.39 Min: 0 Median: 2.0152 Max: 41026 Percentiles: P50: 2.02 P75: 2.99 P99: 12.35 P99.9: 840.78 P99.99: 1515.75 ------------------------------------------------------ [ 0, 1 ] 40546 1.738% 1.738% ( 1, 2 ] 1116551 47.872% 49.611% ########## ( 2, 3 ] 598280 25.651% 75.262% ##### ( 3, 4 ] 224039 9.606% 84.868% ## ( 4, 6 ] 268933 11.531% 96.398% ## ( 6, 10 ] 54319 2.329% 98.727% ( 10, 15 ] 13507 0.579% 99.306% ( 15, 22 ] 1513 0.065% 99.371% ( 22, 34 ] 139 0.006% 99.377% ( 34, 51 ] 127 0.005% 99.383% ( 51, 76 ] 159 0.007% 99.390% ( 76, 110 ] 505 0.022% 99.411% ( 110, 170 ] 4922 0.211% 99.622% ( 170, 250 ] 2925 0.125% 99.748% ( 250, 380 ] 1090 0.047% 99.794% ( 380, 580 ] 1221 0.052% 99.847% ( 580, 870 ] 1383 0.059% 99.906% ( 870, 1300 ] 1511 0.065% 99.971% ( 1300, 1900 ] 1248 0.054% 100.024% ( 1900, 2900 ] 1409 0.060% 100.085% ( 2900, 4400 ] 1228 0.053% 100.137% ( 4400, 6600 ] 378 0.016% 100.154% ( 6600, 9900 ] 48 0.002% 100.156% ( 9900, 14000 ] 10 0.000% 100.156% ( 14000, 22000 ] 11 0.000% 100.156% ( 22000, 33000 ] 5 0.000% 100.157% ( 33000, 50000 ] 2 0.000% 100.157% ** Level 4 read latency histogram (micros): Count: 1324697 Average: 32.9247 StdDev: 233.69 Min: 0 Median: 2.1777 Max: 38983 Percentiles: P50: 2.18 P75: 3.65 P99: 528.34 P99.9: 2410.48 P99.99: 3160.58 ------------------------------------------------------ [ 0, 1 ] 22561 1.703% 1.703% ( 1, 2 ] 585043 44.164% 45.867% ######### ( 2, 3 ] 308126 23.260% 69.128% ##### ( 3, 4 ] 120025 9.061% 78.188% ## ( 4, 6 ] 145919 11.015% 89.203% ## ( 6, 10 ] 32140 2.426% 91.630% ( 10, 15 ] 8506 0.642% 92.272% ( 15, 22 ] 840 0.063% 92.335% ( 22, 34 ] 78 0.006% 92.341% ( 34, 51 ] 116 0.009% 92.350% ( 51, 76 ] 132 0.010% 92.360% ( 76, 110 ] 4689 0.354% 92.714% ( 110, 170 ] 47980 3.622% 96.336% # ( 170, 250 ] 24796 1.872% 98.207% ( 250, 380 ] 6313 0.477% 98.684% ( 380, 580 ] 5644 0.426% 99.110% ( 580, 870 ] 4224 0.319% 99.429% ( 870, 1300 ] 3142 0.237% 99.666% ( 1300, 1900 ] 2134 0.161% 99.827% ( 1900, 2900 ] 1889 0.143% 99.970% ( 2900, 4400 ] 1540 0.116% 100.086% ( 4400, 6600 ] 494 0.037% 100.123% ( 6600, 9900 ] 79 0.006% 100.129% ( 9900, 14000 ] 6 0.000% 100.130% ( 14000, 22000 ] 8 0.001% 100.130% ( 22000, 33000 ] 8 0.001% 100.131% ( 33000, 50000 ] 1 0.000% 100.131% ** Level 5 read latency histogram (micros): Count: 508347 Average: 283.0344 StdDev: 550.43 Min: 80 Median: 162.4202 Max: 57764 Percentiles: P50: 162.42 P75: 227.59 P99: 3025.56 P99.9: 6377.56 P99.99: 9805.03 ------------------------------------------------------ ( 76, 110 ] 26102 5.135% 5.135% # ( 110, 170 ] 261050 51.353% 56.487% ########## ( 170, 250 ] 130721 25.715% 82.202% ##### ( 250, 380 ] 30570 6.014% 88.216% # ( 380, 580 ] 24016 4.724% 92.940% # ( 580, 870 ] 14137 2.781% 95.721% # ( 870, 1300 ] 8111 1.596% 97.317% ( 1300, 1900 ] 4571 0.899% 98.216% ( 1900, 2900 ] 3697 0.727% 98.943% ( 2900, 4400 ] 3447 0.678% 99.621% ( 4400, 6600 ] 1576 0.310% 99.931% ( 6600, 9900 ] 307 0.060% 99.992% ( 9900, 14000 ] 28 0.006% 99.997% ( 14000, 22000 ] 7 0.001% 99.999% ( 22000, 33000 ] 6 0.001% 100.000% ( 33000, 50000 ] 6 0.001% 100.001% ( 50000, 75000 ] 1 0.000% 100.001% ** DB Stats ** Uptime(secs): 55.6 total, 20.0 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 123.82 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:29.311 H:M:S, 52.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 49.15 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:16.012 H:M:S, 80.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 330.585 micros/op 12091 ops/sec 60.122 seconds 726996 operations; 11.7 MB/s (181999 of 181999 found) Microseconds per read: Count: 726996 Average: 330.5877 StdDev: 1096.13 Min: 2 Median: 210.2549 Max: 158227 Percentiles: P50: 210.25 P75: 278.93 P99: 2401.83 P99.9: 18935.19 P99.99: 39384.96 ------------------------------------------------------ ( 1, 2 ] 2 0.000% 0.000% ( 2, 3 ] 22 0.003% 0.003% ( 3, 4 ] 35 0.005% 0.008% ( 4, 6 ] 80 0.011% 0.019% ( 6, 10 ] 175 0.024% 0.043% ( 10, 15 ] 1591 0.219% 0.262% ( 15, 22 ] 4400 0.605% 0.867% ( 22, 34 ] 6301 0.867% 1.734% ( 34, 51 ] 4677 0.643% 2.377% ( 51, 76 ] 451 0.062% 2.439% ( 76, 110 ] 1010 0.139% 2.578% ( 110, 170 ] 182875 25.155% 27.733% ##### ( 170, 250 ] 321708 44.252% 71.985% ######### ( 250, 380 ] 98488 13.547% 85.532% ### ( 380, 580 ] 54637 7.515% 93.048% ## ( 580, 870 ] 24475 3.367% 96.414% # ( 870, 1300 ] 11690 1.608% 98.022% ( 1300, 1900 ] 5312 0.731% 98.753% ( 1900, 2900 ] 3581 0.493% 99.245% ( 2900, 4400 ] 3053 0.420% 99.665% ( 4400, 6600 ] 954 0.131% 99.797% ( 6600, 9900 ] 175 0.024% 99.821% ( 9900, 14000 ] 168 0.023% 99.844% ( 14000, 22000 ] 663 0.091% 99.935% ( 22000, 33000 ] 368 0.051% 99.986% ( 33000, 50000 ] 86 0.012% 99.997% ( 50000, 75000 ] 12 0.002% 99.999% ( 75000, 110000 ] 3 0.000% 99.999% ( 110000, 170000 ] 4 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 13302574 rocksdb.bloom.filter.full.positive COUNT : 856774 rocksdb.bloom.filter.full.true.positive COUNT : 726626 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 370 rocksdb.memtable.miss COUNT : 726626 rocksdb.l0.hit COUNT : 29452 rocksdb.l1.hit COUNT : 4975 rocksdb.l2andup.hit COUNT : 692199 rocksdb.compaction.key.drop.new COUNT : 300064 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 7019449 rocksdb.number.keys.read COUNT : 726996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 7244071368 rocksdb.bytes.read COUNT : 726996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1816 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33895850 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 31077892427 rocksdb.compact.write.bytes COUNT : 30764268452 rocksdb.flush.write.bytes COUNT : 7200251658 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 42 rocksdb.number.superversion_acquires COUNT : 1405 rocksdb.number.superversion_releases COUNT : 1372 rocksdb.number.superversion_cleanups COUNT : 358 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 386 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 7142183936 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2768896 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 34488990640 rocksdb.non.last.level.read.count COUNT : 8191111 rocksdb.block.checksum.compute.count COUNT : 8393128 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 209.440987 P95 : 747.080668 P99 : 2400.011192 P100 : 158225.000000 COUNT : 726996 SUM : 239665588 rocksdb.db.write.micros P50 : 1.543403 P95 : 4.023955 P99 : 7.208851 P100 : 861780.000000 COUNT : 7019449 SUM : 51397237 rocksdb.compaction.times.micros P50 : 1406410.256410 P95 : 4410000.000000 P99 : 13286000.000000 P100 : 17088802.000000 COUNT : 117 SUM : 211104236 rocksdb.compaction.times.cpu_micros P50 : 857100.000000 P95 : 2475000.000000 P99 : 6313000.000000 P100 : 8279223.000000 COUNT : 117 SUM : 131140081 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 984.666667 P95 : 42350.000000 P99 : 75700.000000 P100 : 99820.000000 COUNT : 98 SUM : 582795 rocksdb.compaction.outfile.sync.micros P50 : 8983.333333 P95 : 151571.428571 P99 : 295716.666667 P100 : 337667.000000 COUNT : 389 SUM : 11651202 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 330.294118 P95 : 4051.250000 P99 : 7117.000000 P100 : 8195.000000 COUNT : 253 SUM : 270547 rocksdb.table.open.io.micros P50 : 11454.890220 P95 : 22153.488372 P99 : 31444.651163 P100 : 150113.000000 COUNT : 1816 SUM : 20280859 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.990762 P95 : 9.784520 P99 : 198.302002 P100 : 43775.000000 COUNT : 7525171 SUM : 115194007 rocksdb.read.block.get.micros P50 : 159.418015 P95 : 589.887324 P99 : 2303.134080 P100 : 57840.000000 COUNT : 866124 SUM : 206661347 rocksdb.write.raw.block.micros P50 : 0.527896 P95 : 1.086976 P99 : 3.389293 P100 : 42649.000000 COUNT : 9195139 SUM : 29067874 rocksdb.numfiles.in.singlecompaction P50 : 3.017241 P95 : 6.114286 P99 : 9.680000 P100 : 21.000000 COUNT : 156 SUM : 563 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.564402 P95 : 1292.281782 P99 : 2698.937926 P100 : 861605.000000 COUNT : 157931 SUM : 33907313 rocksdb.sst.read.micros P50 : 1.980947 P95 : 171.275447 P99 : 518.822002 P100 : 57764.000000 COUNT : 8191150 SUM : 302085141 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 726996 SUM : 726996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 7019449 SUM : 7244071368 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 229393.939394 P95 : 922333.333333 P99 : 1070717.000000 P100 : 1070717.000000 COUNT : 98 SUM : 31555036 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 434 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0