[2024-11-29 00:38:26.953969] Starting SPDK v24.09.1-pre git sha1 b18e1bd62 / DPDK 23.11.0 initialization... [2024-11-29 00:38:26.954110] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1106771 ] Set seed to 1732837106950540 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-29 00:38:27.056087] app.c: 917:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-29 00:38:27.097493] app.c: 610:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-29 00:38:27.097542] app.c: 611:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1106771' to capture a snapshot of events at runtime. [2024-11-29 00:38:27.097553] app.c: 616:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-29 00:38:27.097563] app.c: 617:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-29 00:38:27.097571] app.c: 618:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1106771 for offline analysis/debug. [2024-11-29 00:38:27.097660] reactor.c: 990:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Fri Nov 29 00:38:31 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/29-00:38:38 ... thread 0: (1000000,1000000) ops and (130673.1,130673.1) ops/second in (7.652684,7.652684) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 8/7 755.85 MB 6.3 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 115.8 7.07 2.44 9 0.785 0 0 0.0 0.0 L1 4/4 234.99 MB 0.0 0.4 0.2 0.2 0.4 0.2 0.0 1.7 104.3 104.2 3.91 1.83 2 1.953 413K 226 0.0 0.0 L2 2/0 257.56 MB 2.6 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 46/9 3.64 GB 2.9 3.7 2.5 1.2 3.6 2.5 0.0 1.4 101.7 100.6 36.77 17.45 15 2.451 2232K 932 0.0 0.0 L4 186/17 11.49 GB 1.1 2.3 1.8 0.6 2.3 1.8 0.3 1.3 107.8 106.8 22.20 11.28 15 1.480 1406K 0 0.0 0.0 L5 1100/0 90.49 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1346/37 106.84 GB 0.0 6.4 4.5 1.9 7.1 5.2 0.3 8.9 93.5 104.3 69.94 33.00 41 1.706 4052K 1158 0.0 0.0 Int 0/0 0.00 KB 0.0 6.4 4.5 1.9 7.1 5.2 0.3 8.9 93.5 104.3 69.94 33.00 41 1.706 4052K 1158 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.4 4.5 1.9 6.3 4.4 0.0 0.0 104.0 103.0 62.87 30.56 32 1.965 4052K 1158 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 115.8 7.07 2.44 9 0.785 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.8 total, 7.7 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.12 GB write, 930.56 MB/s write, 6.38 GB read, 834.06 MB/s read, 69.9 seconds Interval compaction: 7.12 GB write, 952.96 MB/s write, 6.38 GB read, 854.13 MB/s read, 69.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 31, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 31, interval: 31 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 158399 Average: 9.1463 StdDev: 111.13 Min: 1 Median: 1.8832 Max: 9198 Percentiles: P50: 1.88 P75: 2.89 P99: 10.99 P99.9: 1570.90 P99.99: 3792.66 ------------------------------------------------------ [ 0, 1 ] 6583 4.156% 4.156% # ( 1, 2 ] 82218 51.906% 56.062% ########## ( 2, 3 ] 33858 21.375% 77.437% #### ( 3, 4 ] 14941 9.433% 86.869% ## ( 4, 6 ] 15550 9.817% 96.686% ## ( 6, 10 ] 3535 2.232% 98.918% ( 10, 15 ] 657 0.415% 99.333% ( 15, 22 ] 75 0.047% 99.380% ( 22, 34 ] 10 0.006% 99.386% ( 34, 51 ] 9 0.006% 99.392% ( 51, 76 ] 2 0.001% 99.393% ( 76, 110 ] 11 0.007% 99.400% ( 110, 170 ] 38 0.024% 99.424% ( 170, 250 ] 58 0.037% 99.461% ( 250, 380 ] 108 0.068% 99.529% ( 380, 580 ] 175 0.110% 99.640% ( 580, 870 ] 177 0.112% 99.751% ( 870, 1300 ] 190 0.120% 99.871% ( 1300, 1900 ] 101 0.064% 99.935% ( 1900, 2900 ] 58 0.037% 99.972% ( 2900, 4400 ] 49 0.031% 100.003% ( 4400, 6600 ] 8 0.005% 100.008% ( 6600, 9900 ] 4 0.003% 100.010% ** Level 1 read latency histogram (micros): Count: 96686 Average: 6.4339 StdDev: 91.95 Min: 1 Median: 1.8678 Max: 6785 Percentiles: P50: 1.87 P75: 2.85 P99: 9.18 P99.9: 1247.73 P99.99: 4188.35 ------------------------------------------------------ [ 0, 1 ] 3098 3.204% 3.204% # ( 1, 2 ] 52136 53.923% 57.127% ########### ( 2, 3 ] 20427 21.127% 78.254% #### ( 3, 4 ] 9063 9.374% 87.628% ## ( 4, 6 ] 9710 10.043% 97.671% ## ( 6, 10 ] 1616 1.671% 99.342% ( 10, 15 ] 341 0.353% 99.695% ( 15, 22 ] 39 0.040% 99.735% ( 22, 34 ] 2 0.002% 99.737% ( 34, 51 ] 1 0.001% 99.738% ( 110, 170 ] 3 0.003% 99.741% ( 170, 250 ] 9 0.009% 99.751% ( 250, 380 ] 13 0.013% 99.764% ( 380, 580 ] 32 0.033% 99.797% ( 580, 870 ] 51 0.053% 99.850% ( 870, 1300 ] 55 0.057% 99.907% ( 1300, 1900 ] 40 0.041% 99.948% ( 1900, 2900 ] 18 0.019% 99.967% ( 2900, 4400 ] 26 0.027% 99.994% ( 4400, 6600 ] 5 0.005% 99.999% ( 6600, 9900 ] 1 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 580753 Average: 13.7454 StdDev: 160.99 Min: 1 Median: 2.0024 Max: 8201 Percentiles: P50: 2.00 P75: 3.08 P99: 12.20 P99.9: 1101.67 P99.99: 1435.32 ------------------------------------------------------ [ 0, 1 ] 13285 2.288% 2.288% ( 1, 2 ] 276751 47.654% 49.941% ########## ( 2, 3 ] 140688 24.225% 74.166% ##### ( 3, 4 ] 60867 10.481% 84.647% ## ( 4, 6 ] 63777 10.982% 95.629% ## ( 6, 10 ] 17957 3.092% 98.721% # ( 10, 15 ] 3682 0.634% 99.355% ( 15, 22 ] 607 0.105% 99.459% ( 22, 34 ] 108 0.019% 99.478% ( 34, 51 ] 37 0.006% 99.484% ( 51, 76 ] 26 0.004% 99.489% ( 76, 110 ] 34 0.006% 99.495% ( 110, 170 ] 79 0.014% 99.508% ( 170, 250 ] 153 0.026% 99.535% ( 250, 380 ] 316 0.054% 99.589% ( 380, 580 ] 550 0.095% 99.684% ( 580, 870 ] 807 0.139% 99.823% ( 870, 1300 ] 832 0.143% 99.966% ( 1300, 1900 ] 616 0.106% 100.072% ( 1900, 2900 ] 481 0.083% 100.155% ( 2900, 4400 ] 443 0.076% 100.231% ( 4400, 6600 ] 119 0.020% 100.252% ( 6600, 9900 ] 15 0.003% 100.254% ** Level 3 read latency histogram (micros): Count: 749826 Average: 13.0266 StdDev: 169.41 Min: 1 Median: 1.9815 Max: 24984 Percentiles: P50: 1.98 P75: 2.99 P99: 9.83 P99.9: 818.72 P99.99: 1131.36 ------------------------------------------------------ [ 0, 1 ] 11787 1.572% 1.572% ( 1, 2 ] 369964 49.340% 50.912% ########## ( 2, 3 ] 183095 24.418% 75.330% ##### ( 3, 4 ] 77544 10.342% 85.672% ## ( 4, 6 ] 81932 10.927% 96.599% ## ( 6, 10 ] 18783 2.505% 99.104% # ( 10, 15 ] 3821 0.510% 99.613% ( 15, 22 ] 472 0.063% 99.676% ( 22, 34 ] 41 0.005% 99.682% ( 34, 51 ] 37 0.005% 99.687% ( 51, 76 ] 62 0.008% 99.695% ( 76, 110 ] 19 0.003% 99.697% ( 110, 170 ] 60 0.008% 99.705% ( 170, 250 ] 92 0.012% 99.718% ( 250, 380 ] 225 0.030% 99.748% ( 380, 580 ] 469 0.063% 99.810% ( 580, 870 ] 819 0.109% 99.919% ( 870, 1300 ] 872 0.116% 100.036% ( 1300, 1900 ] 630 0.084% 100.120% ( 1900, 2900 ] 603 0.080% 100.200% ( 2900, 4400 ] 621 0.083% 100.283% ( 4400, 6600 ] 169 0.023% 100.306% ( 6600, 9900 ] 31 0.004% 100.310% ( 14000, 22000 ] 2 0.000% 100.310% ( 22000, 33000 ] 1 0.000% 100.310% ** Level 4 read latency histogram (micros): Count: 231840 Average: 29.5214 StdDev: 262.74 Min: 1 Median: 1.9880 Max: 9220 Percentiles: P50: 1.99 P75: 3.03 P99: 756.43 P99.9: 3073.82 P99.99: 3731.35 ------------------------------------------------------ [ 0, 1 ] 3733 1.610% 1.610% ( 1, 2 ] 113550 48.978% 50.588% ########## ( 2, 3 ] 55858 24.093% 74.681% ##### ( 3, 4 ] 23673 10.211% 84.892% ## ( 4, 6 ] 24036 10.367% 95.260% ## ( 6, 10 ] 5950 2.566% 97.826% # ( 10, 15 ] 1149 0.496% 98.322% ( 15, 22 ] 128 0.055% 98.377% ( 22, 34 ] 19 0.008% 98.385% ( 34, 51 ] 25 0.011% 98.396% ( 51, 76 ] 26 0.011% 98.407% ( 76, 110 ] 8 0.003% 98.411% ( 110, 170 ] 32 0.014% 98.424% ( 170, 250 ] 119 0.051% 98.476% ( 250, 380 ] 256 0.110% 98.586% ( 380, 580 ] 524 0.226% 98.812% ( 580, 870 ] 716 0.309% 99.121% ( 870, 1300 ] 722 0.311% 99.432% ( 1300, 1900 ] 548 0.236% 99.669% ( 1900, 2900 ] 481 0.207% 99.876% ( 2900, 4400 ] 476 0.205% 100.082% ( 4400, 6600 ] 137 0.059% 100.141% ( 6600, 9900 ] 17 0.007% 100.148% ** Level 5 read latency histogram (micros): Count: 13176 Average: 1696.5304 StdDev: 1518.51 Min: 79 Median: 1155.0969 Max: 27144 Percentiles: P50: 1155.10 P75: 2393.70 P99: 6529.48 P99.9: 9826.73 P99.99: 21364.80 ------------------------------------------------------ ( 76, 110 ] 14 0.106% 0.106% ( 110, 170 ] 105 0.797% 0.903% ( 170, 250 ] 267 2.026% 2.930% ( 250, 380 ] 767 5.821% 8.751% # ( 380, 580 ] 1491 11.316% 20.067% ## ( 580, 870 ] 2370 17.987% 38.054% #### ( 870, 1300 ] 2374 18.018% 56.072% #### ( 1300, 1900 ] 1789 13.578% 69.649% ### ( 1900, 2900 ] 1428 10.838% 80.487% ## ( 2900, 4400 ] 1752 13.297% 93.784% ### ( 4400, 6600 ] 710 5.389% 99.173% # ( 6600, 9900 ] 98 0.744% 99.917% ( 9900, 14000 ] 6 0.046% 99.962% ( 14000, 22000 ] 4 0.030% 99.992% ( 22000, 33000 ] 2 0.015% 100.008% ** DB Stats ** Uptime(secs): 7.8 total, 7.7 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 125.55 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.725 H:M:S, 47.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 128.56 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.725 H:M:S, 48.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/29-00:38:45 ... thread 0: (1000000,2000000) ops and (148367.4,138959.2) ops/second in (6.740027,14.392711) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/9 1.48 GB 44.1 0.7 0.0 0.7 2.5 1.8 0.0 1.4 38.7 144.3 17.89 8.31 24 0.745 703K 844 0.0 0.0 L1 2/2 177.86 MB 0.0 0.9 0.5 0.4 0.9 0.5 0.0 1.7 115.5 115.4 8.28 4.46 3 2.762 972K 1314 0.0 0.0 L2 3/1 195.76 MB 0.7 0.0 0.0 0.0 0.0 0.0 0.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 21/8 1.67 GB 1.0 4.6 2.8 1.8 4.6 2.7 0.1 1.6 105.4 104.4 45.01 22.28 19 2.369 2972K 3231 0.0 0.0 L4 169/0 9.47 GB 1.0 6.9 3.9 3.0 6.8 3.8 0.6 1.7 118.8 116.8 59.38 33.32 40 1.484 3444K 7796 0.0 0.0 L5 1152/0 94.80 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1359/20 107.79 GB 0.0 13.1 7.2 5.9 14.8 8.9 5.4 8.0 103.0 116.2 130.56 68.37 86 1.518 8092K 13K 0.0 0.0 Int 0/0 0.00 KB 0.0 13.1 7.2 5.9 14.8 8.9 5.4 8.0 103.0 116.2 130.56 68.37 86 1.518 8092K 13K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 13.1 7.2 5.9 13.0 7.0 0.0 0.0 115.1 113.7 116.81 62.86 64 1.825 8092K 13K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 137.5 13.75 5.50 22 0.625 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.6 total, 14.4 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.82 GB write, 1040.62 MB/s write, 13.13 GB read, 922.55 MB/s read, 130.6 seconds Interval compaction: 14.82 GB write, 1053.94 MB/s write, 13.13 GB read, 934.36 MB/s read, 130.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 57, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 57, interval: 57 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 488289 Average: 10.2267 StdDev: 159.09 Min: 1 Median: 1.8451 Max: 53224 Percentiles: P50: 1.85 P75: 2.79 P99: 10.75 P99.9: 1508.90 P99.99: 3259.41 ------------------------------------------------------ [ 0, 1 ] 22373 4.582% 4.582% # ( 1, 2 ] 262425 53.744% 58.326% ########### ( 2, 3 ] 102901 21.074% 79.399% #### ( 3, 4 ] 42523 8.709% 88.108% ## ( 4, 6 ] 43439 8.896% 97.004% ## ( 6, 10 ] 9515 1.949% 98.953% ( 10, 15 ] 1525 0.312% 99.265% ( 15, 22 ] 177 0.036% 99.301% ( 22, 34 ] 21 0.004% 99.306% ( 34, 51 ] 20 0.004% 99.310% ( 51, 76 ] 20 0.004% 99.314% ( 76, 110 ] 52 0.011% 99.325% ( 110, 170 ] 218 0.045% 99.369% ( 170, 250 ] 279 0.057% 99.426% ( 250, 380 ] 371 0.076% 99.502% ( 380, 580 ] 586 0.120% 99.622% ( 580, 870 ] 657 0.135% 99.757% ( 870, 1300 ] 596 0.122% 99.879% ( 1300, 1900 ] 295 0.060% 99.939% ( 1900, 2900 ] 205 0.042% 99.981% ( 2900, 4400 ] 176 0.036% 100.017% ( 4400, 6600 ] 52 0.011% 100.028% ( 6600, 9900 ] 11 0.002% 100.030% ( 9900, 14000 ] 2 0.000% 100.031% ( 14000, 22000 ] 1 0.000% 100.031% ( 33000, 50000 ] 1 0.000% 100.031% ( 50000, 75000 ] 1 0.000% 100.031% ** Level 1 read latency histogram (micros): Count: 198081 Average: 10.3493 StdDev: 171.28 Min: 1 Median: 1.9282 Max: 46203 Percentiles: P50: 1.93 P75: 2.91 P99: 10.20 P99.9: 1935.60 P99.99: 4358.70 ------------------------------------------------------ [ 0, 1 ] 4936 2.492% 2.492% ( 1, 2 ] 101379 51.181% 53.672% ########## ( 2, 3 ] 46344 23.396% 77.069% ##### ( 3, 4 ] 18995 9.590% 86.658% ## ( 4, 6 ] 20190 10.193% 96.851% ## ( 6, 10 ] 4227 2.134% 98.985% ( 10, 15 ] 756 0.382% 99.367% ( 15, 22 ] 86 0.043% 99.410% ( 22, 34 ] 6 0.003% 99.413% ( 34, 51 ] 13 0.007% 99.420% ( 51, 76 ] 13 0.007% 99.426% ( 76, 110 ] 16 0.008% 99.435% ( 110, 170 ] 53 0.027% 99.461% ( 170, 250 ] 59 0.030% 99.491% ( 250, 380 ] 91 0.046% 99.537% ( 380, 580 ] 179 0.090% 99.627% ( 580, 870 ] 224 0.113% 99.741% ( 870, 1300 ] 205 0.103% 99.844% ( 1300, 1900 ] 109 0.055% 99.899% ( 1900, 2900 ] 82 0.041% 99.940% ( 2900, 4400 ] 102 0.051% 99.992% ( 4400, 6600 ] 23 0.012% 100.004% ( 6600, 9900 ] 3 0.002% 100.005% ( 9900, 14000 ] 4 0.002% 100.007% ( 33000, 50000 ] 1 0.001% 100.008% ** Level 2 read latency histogram (micros): Count: 646177 Average: 13.3890 StdDev: 169.52 Min: 1 Median: 1.9998 Max: 48543 Percentiles: P50: 2.00 P75: 3.07 P99: 11.99 P99.9: 1130.85 P99.99: 1518.62 ------------------------------------------------------ [ 0, 1 ] 14282 2.210% 2.210% ( 1, 2 ] 308883 47.802% 50.012% ########## ( 2, 3 ] 156744 24.257% 74.269% ##### ( 3, 4 ] 67542 10.453% 84.722% ## ( 4, 6 ] 70870 10.968% 95.689% ## ( 6, 10 ] 19818 3.067% 98.756% # ( 10, 15 ] 3966 0.614% 99.370% ( 15, 22 ] 639 0.099% 99.469% ( 22, 34 ] 110 0.017% 99.486% ( 34, 51 ] 44 0.007% 99.493% ( 51, 76 ] 33 0.005% 99.498% ( 76, 110 ] 36 0.006% 99.503% ( 110, 170 ] 80 0.012% 99.516% ( 170, 250 ] 162 0.025% 99.541% ( 250, 380 ] 333 0.052% 99.592% ( 380, 580 ] 592 0.092% 99.684% ( 580, 870 ] 863 0.134% 99.817% ( 870, 1300 ] 880 0.136% 99.954% ( 1300, 1900 ] 646 0.100% 100.054% ( 1900, 2900 ] 517 0.080% 100.134% ( 2900, 4400 ] 466 0.072% 100.206% ( 4400, 6600 ] 133 0.021% 100.226% ( 6600, 9900 ] 17 0.003% 100.229% ( 33000, 50000 ] 1 0.000% 100.229% ** Level 3 read latency histogram (micros): Count: 1492618 Average: 11.4946 StdDev: 165.50 Min: 1 Median: 1.9769 Max: 33388 Percentiles: P50: 1.98 P75: 2.97 P99: 9.71 P99.9: 719.65 P99.99: 1015.95 ------------------------------------------------------ [ 0, 1 ] 22598 1.514% 1.514% ( 1, 2 ] 740795 49.631% 51.145% ########## ( 2, 3 ] 367757 24.638% 75.783% ##### ( 3, 4 ] 151106 10.124% 85.907% ## ( 4, 6 ] 160135 10.728% 96.635% ## ( 6, 10 ] 38069 2.550% 99.185% # ( 10, 15 ] 6718 0.450% 99.636% ( 15, 22 ] 836 0.056% 99.692% ( 22, 34 ] 73 0.005% 99.696% ( 34, 51 ] 111 0.007% 99.704% ( 51, 76 ] 157 0.011% 99.714% ( 76, 110 ] 49 0.003% 99.718% ( 110, 170 ] 187 0.013% 99.730% ( 170, 250 ] 226 0.015% 99.745% ( 250, 380 ] 515 0.035% 99.780% ( 380, 580 ] 1033 0.069% 99.849% ( 580, 870 ] 1579 0.106% 99.955% ( 870, 1300 ] 1546 0.104% 100.058% ( 1300, 1900 ] 984 0.066% 100.124% ( 1900, 2900 ] 896 0.060% 100.184% ( 2900, 4400 ] 1005 0.067% 100.252% ( 4400, 6600 ] 259 0.017% 100.269% ( 6600, 9900 ] 58 0.004% 100.273% ( 9900, 14000 ] 5 0.000% 100.273% ( 14000, 22000 ] 5 0.000% 100.274% ( 22000, 33000 ] 5 0.000% 100.274% ( 33000, 50000 ] 2 0.000% 100.274% ** Level 4 read latency histogram (micros): Count: 786257 Average: 20.3437 StdDev: 223.61 Min: 1 Median: 1.9818 Max: 41971 Percentiles: P50: 1.98 P75: 3.01 P99: 292.93 P99.9: 1974.24 P99.99: 2761.37 ------------------------------------------------------ [ 0, 1 ] 12741 1.620% 1.620% ( 1, 2 ] 387440 49.277% 50.897% ########## ( 2, 3 ] 188454 23.968% 74.865% ##### ( 3, 4 ] 79941 10.167% 85.033% ## ( 4, 6 ] 83315 10.596% 95.629% ## ( 6, 10 ] 21255 2.703% 98.332% # ( 10, 15 ] 3399 0.432% 98.765% ( 15, 22 ] 435 0.055% 98.820% ( 22, 34 ] 39 0.005% 98.825% ( 34, 51 ] 58 0.007% 98.832% ( 51, 76 ] 92 0.012% 98.844% ( 76, 110 ] 83 0.011% 98.855% ( 110, 170 ] 310 0.039% 98.894% ( 170, 250 ] 562 0.071% 98.966% ( 250, 380 ] 819 0.104% 99.070% ( 380, 580 ] 1511 0.192% 99.262% ( 580, 870 ] 2015 0.256% 99.518% ( 870, 1300 ] 1837 0.234% 99.752% ( 1300, 1900 ] 1098 0.140% 99.892% ( 1900, 2900 ] 899 0.114% 100.006% ( 2900, 4400 ] 948 0.121% 100.126% ( 4400, 6600 ] 277 0.035% 100.162% ( 6600, 9900 ] 39 0.005% 100.167% ( 9900, 14000 ] 5 0.001% 100.167% ( 14000, 22000 ] 4 0.001% 100.168% ( 33000, 50000 ] 3 0.000% 100.168% ** Level 5 read latency histogram (micros): Count: 34738 Average: 1222.7582 StdDev: 1405.68 Min: 78 Median: 779.0331 Max: 49530 Percentiles: P50: 779.03 P75: 1464.74 P99: 6197.43 P99.9: 9590.89 P99.99: 37323.95 ------------------------------------------------------ ( 76, 110 ] 368 1.059% 1.059% ( 110, 170 ] 1877 5.403% 6.463% # ( 170, 250 ] 2260 6.506% 12.969% # ( 250, 380 ] 3186 9.172% 22.140% ## ( 380, 580 ] 5203 14.978% 37.118% ### ( 580, 870 ] 6521 18.772% 55.890% #### ( 870, 1300 ] 5723 16.475% 72.365% ### ( 1300, 1900 ] 3337 9.606% 81.971% ## ( 1900, 2900 ] 2331 6.710% 88.681% # ( 2900, 4400 ] 2740 7.888% 96.569% ## ( 4400, 6600 ] 1035 2.979% 99.548% # ( 6600, 9900 ] 136 0.392% 99.940% ( 9900, 14000 ] 7 0.020% 99.960% ( 14000, 22000 ] 5 0.014% 99.974% ( 22000, 33000 ] 5 0.014% 99.988% ( 33000, 50000 ] 6 0.017% 100.006% ** DB Stats ** Uptime(secs): 14.6 total, 6.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 135.01 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.662 H:M:S, 45.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 146.02 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.937 H:M:S, 43.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/11/29-00:38:51 ... thread 0: (1000000,3000000) ops and (171221.7,148271.9) ops/second in (5.840382,20.233093) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 10/8 1.66 GB 44.0 1.6 0.0 1.6 4.4 2.8 0.0 1.6 58.1 158.7 28.18 14.85 39 0.722 1662K 1917 0.0 0.0 L1 0/0 0.00 KB 0.0 1.8 1.3 0.6 1.8 1.3 0.0 1.4 129.3 129.0 14.62 8.85 4 3.654 1919K 4547 0.0 0.0 L2 1/1 128.77 MB 0.0 0.0 0.0 0.0 0.0 0.0 1.3 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 28/9 1.68 GB 1.1 7.4 3.6 3.8 7.4 3.5 0.3 2.0 117.9 117.0 64.54 35.70 30 2.151 4914K 10K 0.0 0.0 L4 175/14 9.76 GB 0.9 8.7 4.7 4.0 8.6 4.6 0.7 1.8 119.9 117.6 74.69 42.24 54 1.383 4344K 7796 0.0 0.0 L5 1160/0 95.41 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1374/32 108.64 GB 0.0 19.6 9.6 10.0 22.2 12.1 7.2 8.0 110.4 124.7 182.03 101.64 127 1.433 12M 24K 0.0 0.0 Int 0/0 0.00 KB 0.0 19.6 9.6 10.0 22.2 12.1 7.2 8.0 110.4 124.7 182.03 101.64 127 1.433 12M 24K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 19.6 9.6 10.0 19.4 9.4 0.0 0.0 123.6 122.2 162.56 93.49 93 1.748 12M 24K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 145.6 19.47 8.15 34 0.573 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 20.4 total, 20.2 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.16 GB write, 1111.51 MB/s write, 19.63 GB read, 984.29 MB/s read, 182.0 seconds Interval compaction: 22.16 GB write, 1121.63 MB/s write, 19.63 GB read, 993.25 MB/s read, 182.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 73, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 73, interval: 73 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1008169 Average: 8.3129 StdDev: 131.95 Min: 1 Median: 1.8443 Max: 53224 Percentiles: P50: 1.84 P75: 2.79 P99: 9.71 P99.9: 1152.60 P99.99: 2433.94 ------------------------------------------------------ [ 0, 1 ] 45213 4.485% 4.485% # ( 1, 2 ] 543496 53.909% 58.394% ########### ( 2, 3 ] 210725 20.902% 79.296% #### ( 3, 4 ] 88812 8.809% 88.105% ## ( 4, 6 ] 91687 9.094% 97.199% ## ( 6, 10 ] 19567 1.941% 99.140% ( 10, 15 ] 3214 0.319% 99.459% ( 15, 22 ] 364 0.036% 99.495% ( 22, 34 ] 33 0.003% 99.498% ( 34, 51 ] 40 0.004% 99.502% ( 51, 76 ] 33 0.003% 99.506% ( 76, 110 ] 90 0.009% 99.514% ( 110, 170 ] 337 0.033% 99.548% ( 170, 250 ] 433 0.043% 99.591% ( 250, 380 ] 569 0.056% 99.647% ( 380, 580 ] 897 0.089% 99.736% ( 580, 870 ] 1038 0.103% 99.839% ( 870, 1300 ] 934 0.093% 99.932% ( 1300, 1900 ] 427 0.042% 99.974% ( 1900, 2900 ] 300 0.030% 100.004% ( 2900, 4400 ] 265 0.026% 100.030% ( 4400, 6600 ] 76 0.008% 100.038% ( 6600, 9900 ] 23 0.002% 100.040% ( 9900, 14000 ] 5 0.000% 100.041% ( 14000, 22000 ] 4 0.000% 100.041% ( 33000, 50000 ] 1 0.000% 100.041% ( 50000, 75000 ] 1 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 437636 Average: 9.5022 StdDev: 149.01 Min: 1 Median: 1.9599 Max: 46203 Percentiles: P50: 1.96 P75: 2.94 P99: 9.88 P99.9: 1273.04 P99.99: 2925.55 ------------------------------------------------------ [ 0, 1 ] 8025 1.834% 1.834% ( 1, 2 ] 219594 50.177% 52.011% ########## ( 2, 3 ] 106713 24.384% 76.395% ##### ( 3, 4 ] 42739 9.766% 86.161% ## ( 4, 6 ] 46117 10.538% 96.699% ## ( 6, 10 ] 10383 2.373% 99.071% ( 10, 15 ] 1758 0.402% 99.473% ( 15, 22 ] 204 0.047% 99.519% ( 22, 34 ] 17 0.004% 99.523% ( 34, 51 ] 37 0.008% 99.532% ( 51, 76 ] 34 0.008% 99.540% ( 76, 110 ] 32 0.007% 99.547% ( 110, 170 ] 83 0.019% 99.566% ( 170, 250 ] 111 0.025% 99.591% ( 250, 380 ] 182 0.042% 99.633% ( 380, 580 ] 371 0.085% 99.718% ( 580, 870 ] 445 0.102% 99.819% ( 870, 1300 ] 377 0.086% 99.905% ( 1300, 1900 ] 201 0.046% 99.951% ( 1900, 2900 ] 166 0.038% 99.989% ( 2900, 4400 ] 190 0.043% 100.033% ( 4400, 6600 ] 60 0.014% 100.046% ( 6600, 9900 ] 8 0.002% 100.048% ( 9900, 14000 ] 5 0.001% 100.049% ( 14000, 22000 ] 1 0.000% 100.050% ( 33000, 50000 ] 1 0.000% 100.050% ** Level 2 read latency histogram (micros): Count: 646177 Average: 13.3890 StdDev: 169.52 Min: 1 Median: 1.9998 Max: 48543 Percentiles: P50: 2.00 P75: 3.07 P99: 11.99 P99.9: 1130.85 P99.99: 1518.62 ------------------------------------------------------ [ 0, 1 ] 14282 2.210% 2.210% ( 1, 2 ] 308883 47.802% 50.012% ########## ( 2, 3 ] 156744 24.257% 74.269% ##### ( 3, 4 ] 67542 10.453% 84.722% ## ( 4, 6 ] 70870 10.968% 95.689% ## ( 6, 10 ] 19818 3.067% 98.756% # ( 10, 15 ] 3966 0.614% 99.370% ( 15, 22 ] 639 0.099% 99.469% ( 22, 34 ] 110 0.017% 99.486% ( 34, 51 ] 44 0.007% 99.493% ( 51, 76 ] 33 0.005% 99.498% ( 76, 110 ] 36 0.006% 99.503% ( 110, 170 ] 80 0.012% 99.516% ( 170, 250 ] 162 0.025% 99.541% ( 250, 380 ] 333 0.052% 99.592% ( 380, 580 ] 592 0.092% 99.684% ( 580, 870 ] 863 0.134% 99.817% ( 870, 1300 ] 880 0.136% 99.954% ( 1300, 1900 ] 646 0.100% 100.054% ( 1900, 2900 ] 517 0.080% 100.134% ( 2900, 4400 ] 466 0.072% 100.206% ( 4400, 6600 ] 133 0.021% 100.226% ( 6600, 9900 ] 17 0.003% 100.229% ( 33000, 50000 ] 1 0.000% 100.229% ** Level 3 read latency histogram (micros): Count: 2126060 Average: 10.5291 StdDev: 154.09 Min: 1 Median: 1.9870 Max: 33388 Percentiles: P50: 1.99 P75: 2.98 P99: 9.63 P99.9: 617.05 P99.99: 897.44 ------------------------------------------------------ [ 0, 1 ] 30047 1.413% 1.413% ( 1, 2 ] 1046598 49.227% 50.640% ########## ( 2, 3 ] 530001 24.929% 75.569% ##### ( 3, 4 ] 217217 10.217% 85.786% ## ( 4, 6 ] 233082 10.963% 96.749% ## ( 6, 10 ] 52738 2.481% 99.230% ( 10, 15 ] 9413 0.443% 99.672% ( 15, 22 ] 1124 0.053% 99.725% ( 22, 34 ] 106 0.005% 99.730% ( 34, 51 ] 161 0.008% 99.738% ( 51, 76 ] 227 0.011% 99.749% ( 76, 110 ] 93 0.004% 99.753% ( 110, 170 ] 315 0.015% 99.768% ( 170, 250 ] 399 0.019% 99.787% ( 250, 380 ] 736 0.035% 99.821% ( 380, 580 ] 1416 0.067% 99.888% ( 580, 870 ] 2050 0.096% 99.984% ( 870, 1300 ] 1965 0.092% 100.077% ( 1300, 1900 ] 1205 0.057% 100.133% ( 1900, 2900 ] 1066 0.050% 100.183% ( 2900, 4400 ] 1232 0.058% 100.241% ( 4400, 6600 ] 351 0.017% 100.258% ( 6600, 9900 ] 79 0.004% 100.262% ( 9900, 14000 ] 6 0.000% 100.262% ( 14000, 22000 ] 7 0.000% 100.262% ( 22000, 33000 ] 5 0.000% 100.262% ( 33000, 50000 ] 2 0.000% 100.263% ** Level 4 read latency histogram (micros): Count: 1074237 Average: 21.7158 StdDev: 232.86 Min: 1 Median: 1.9966 Max: 41971 Percentiles: P50: 2.00 P75: 3.07 P99: 378.41 P99.9: 1996.43 P99.99: 2774.86 ------------------------------------------------------ [ 0, 1 ] 16942 1.577% 1.577% ( 1, 2 ] 521957 48.589% 50.166% ########## ( 2, 3 ] 258965 24.107% 74.273% ##### ( 3, 4 ] 110573 10.293% 84.566% ## ( 4, 6 ] 116915 10.884% 95.449% ## ( 6, 10 ] 29655 2.761% 98.210% # ( 10, 15 ] 4819 0.449% 98.658% ( 15, 22 ] 611 0.057% 98.715% ( 22, 34 ] 51 0.005% 98.720% ( 34, 51 ] 95 0.009% 98.729% ( 51, 76 ] 137 0.013% 98.742% ( 76, 110 ] 133 0.012% 98.754% ( 110, 170 ] 532 0.050% 98.804% ( 170, 250 ] 873 0.081% 98.885% ( 250, 380 ] 1253 0.117% 99.002% ( 380, 580 ] 2270 0.211% 99.213% ( 580, 870 ] 2963 0.276% 99.489% ( 870, 1300 ] 2754 0.256% 99.745% ( 1300, 1900 ] 1546 0.144% 99.889% ( 1900, 2900 ] 1242 0.116% 100.005% ( 2900, 4400 ] 1323 0.123% 100.128% ( 4400, 6600 ] 454 0.042% 100.170% ( 6600, 9900 ] 84 0.008% 100.178% ( 9900, 14000 ] 8 0.001% 100.179% ( 14000, 22000 ] 6 0.001% 100.179% ( 22000, 33000 ] 1 0.000% 100.179% ( 33000, 50000 ] 3 0.000% 100.179% ** Level 5 read latency histogram (micros): Count: 52554 Average: 1137.1391 StdDev: 1326.71 Min: 74 Median: 734.3914 Max: 49530 Percentiles: P50: 734.39 P75: 1292.93 P99: 6115.01 P99.9: 9653.70 P99.99: 32687.84 ------------------------------------------------------ ( 51, 76 ] 1 0.002% 0.002% ( 76, 110 ] 683 1.300% 1.302% ( 110, 170 ] 3271 6.224% 7.526% # ( 170, 250 ] 3712 7.063% 14.589% # ( 250, 380 ] 5021 9.554% 24.143% ## ( 380, 580 ] 8205 15.613% 39.755% ### ( 580, 870 ] 10113 19.243% 58.998% #### ( 870, 1300 ] 8550 16.269% 75.267% ### ( 1300, 1900 ] 4710 8.962% 84.230% ## ( 1900, 2900 ] 3166 6.024% 90.254% # ( 2900, 4400 ] 3562 6.778% 97.032% # ( 4400, 6600 ] 1327 2.525% 99.557% # ( 6600, 9900 ] 195 0.371% 99.928% ( 9900, 14000 ] 17 0.032% 99.960% ( 14000, 22000 ] 7 0.013% 99.973% ( 22000, 33000 ] 9 0.017% 99.990% ( 33000, 50000 ] 6 0.011% 100.002% ** DB Stats ** Uptime(secs): 20.4 total, 5.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 144.60 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.598 H:M:S, 42.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 168.51 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:1.936 H:M:S, 33.2 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/29-00:38:56 ... thread 0: (1000000,4000000) ops and (221334.1,161608.7) ops/second in (4.518056,24.751149) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/9 2.64 GB 69.2 3.3 0.0 3.3 7.1 3.7 0.0 1.9 84.4 179.7 40.27 24.71 58 0.694 3453K 6063 0.0 0.0 L1 0/0 0.00 KB 0.0 1.8 1.3 0.6 1.8 1.3 0.0 1.4 129.3 129.0 14.62 8.85 4 3.654 1919K 4547 0.0 0.0 L3 17/0 926.21 MB 0.9 7.8 3.7 4.0 7.7 3.7 0.3 2.1 119.4 118.5 66.68 37.32 31 2.151 5138K 10K 0.0 0.0 L4 178/3 9.95 GB 1.0 11.6 5.6 6.0 11.4 5.4 0.7 2.0 125.4 123.0 94.90 55.99 68 1.396 6875K 26K 0.0 0.0 L5 1168/16 96.08 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1376/28 109.57 GB 0.0 24.6 10.6 13.9 28.0 14.1 6.6 7.5 116.2 132.6 216.46 126.87 161 1.344 17M 46K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.6 10.6 13.9 28.0 14.1 6.6 7.5 116.2 132.6 216.46 126.87 161 1.344 17M 46K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.6 10.6 13.9 24.3 10.3 0.0 0.0 130.5 128.9 192.75 115.94 112 1.721 17M 46K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 162.0 23.71 10.94 49 0.484 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 24.9 total, 24.8 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 28.02 GB write, 1150.76 MB/s write, 24.56 GB read, 1008.62 MB/s read, 216.5 seconds Interval compaction: 28.02 GB write, 1159.33 MB/s write, 24.56 GB read, 1016.13 MB/s read, 216.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 81, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 81, interval: 81 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1300530 Average: 9.2799 StdDev: 127.45 Min: 1 Median: 1.8304 Max: 53224 Percentiles: P50: 1.83 P75: 2.77 P99: 12.57 P99.9: 1146.33 P99.99: 2284.28 ------------------------------------------------------ [ 0, 1 ] 62675 4.819% 4.819% # ( 1, 2 ] 707641 54.412% 59.231% ########### ( 2, 3 ] 267796 20.591% 79.822% #### ( 3, 4 ] 111151 8.547% 88.369% ## ( 4, 6 ] 112897 8.681% 97.050% ## ( 6, 10 ] 23391 1.799% 98.848% ( 10, 15 ] 3845 0.296% 99.144% ( 15, 22 ] 456 0.035% 99.179% ( 22, 34 ] 38 0.003% 99.182% ( 34, 51 ] 45 0.003% 99.185% ( 51, 76 ] 37 0.003% 99.188% ( 76, 110 ] 173 0.013% 99.201% ( 110, 170 ] 1013 0.078% 99.279% ( 170, 250 ] 1530 0.118% 99.397% ( 250, 380 ] 1754 0.135% 99.532% ( 380, 580 ] 2031 0.156% 99.688% ( 580, 870 ] 1914 0.147% 99.835% ( 870, 1300 ] 1311 0.101% 99.936% ( 1300, 1900 ] 554 0.043% 99.979% ( 1900, 2900 ] 385 0.030% 100.008% ( 2900, 4400 ] 327 0.025% 100.033% ( 4400, 6600 ] 88 0.007% 100.040% ( 6600, 9900 ] 23 0.002% 100.042% ( 9900, 14000 ] 5 0.000% 100.042% ( 14000, 22000 ] 5 0.000% 100.043% ( 33000, 50000 ] 1 0.000% 100.043% ( 50000, 75000 ] 1 0.000% 100.043% ** Level 1 read latency histogram (micros): Count: 437706 Average: 9.6273 StdDev: 149.80 Min: 1 Median: 1.9601 Max: 46203 Percentiles: P50: 1.96 P75: 2.94 P99: 9.91 P99.9: 1285.66 P99.99: 2955.90 ------------------------------------------------------ [ 0, 1 ] 8025 1.833% 1.833% ( 1, 2 ] 219594 50.169% 52.003% ########## ( 2, 3 ] 106713 24.380% 76.383% ##### ( 3, 4 ] 42739 9.764% 86.147% ## ( 4, 6 ] 46117 10.536% 96.683% ## ( 6, 10 ] 10383 2.372% 99.055% ( 10, 15 ] 1758 0.402% 99.457% ( 15, 22 ] 204 0.047% 99.504% ( 22, 34 ] 17 0.004% 99.507% ( 34, 51 ] 37 0.008% 99.516% ( 51, 76 ] 34 0.008% 99.524% ( 76, 110 ] 34 0.008% 99.531% ( 110, 170 ] 94 0.021% 99.553% ( 170, 250 ] 119 0.027% 99.580% ( 250, 380 ] 195 0.045% 99.625% ( 380, 580 ] 380 0.087% 99.711% ( 580, 870 ] 457 0.104% 99.816% ( 870, 1300 ] 381 0.087% 99.903% ( 1300, 1900 ] 203 0.046% 99.949% ( 1900, 2900 ] 171 0.039% 99.988% ( 2900, 4400 ] 194 0.044% 100.033% ( 4400, 6600 ] 60 0.014% 100.046% ( 6600, 9900 ] 8 0.002% 100.048% ( 9900, 14000 ] 5 0.001% 100.049% ( 14000, 22000 ] 1 0.000% 100.050% ( 33000, 50000 ] 1 0.000% 100.050% ** Level 2 read latency histogram (micros): Count: 646177 Average: 13.3890 StdDev: 169.52 Min: 1 Median: 1.9998 Max: 48543 Percentiles: P50: 2.00 P75: 3.07 P99: 11.99 P99.9: 1130.85 P99.99: 1518.62 ------------------------------------------------------ [ 0, 1 ] 14282 2.210% 2.210% ( 1, 2 ] 308883 47.802% 50.012% ########## ( 2, 3 ] 156744 24.257% 74.269% ##### ( 3, 4 ] 67542 10.453% 84.722% ## ( 4, 6 ] 70870 10.968% 95.689% ## ( 6, 10 ] 19818 3.067% 98.756% # ( 10, 15 ] 3966 0.614% 99.370% ( 15, 22 ] 639 0.099% 99.469% ( 22, 34 ] 110 0.017% 99.486% ( 34, 51 ] 44 0.007% 99.493% ( 51, 76 ] 33 0.005% 99.498% ( 76, 110 ] 36 0.006% 99.503% ( 110, 170 ] 80 0.012% 99.516% ( 170, 250 ] 162 0.025% 99.541% ( 250, 380 ] 333 0.052% 99.592% ( 380, 580 ] 592 0.092% 99.684% ( 580, 870 ] 863 0.134% 99.817% ( 870, 1300 ] 880 0.136% 99.954% ( 1300, 1900 ] 646 0.100% 100.054% ( 1900, 2900 ] 517 0.080% 100.134% ( 2900, 4400 ] 466 0.072% 100.206% ( 4400, 6600 ] 133 0.021% 100.226% ( 6600, 9900 ] 17 0.003% 100.229% ( 33000, 50000 ] 1 0.000% 100.229% ** Level 3 read latency histogram (micros): Count: 2395168 Average: 10.1163 StdDev: 149.09 Min: 1 Median: 1.9827 Max: 33388 Percentiles: P50: 1.98 P75: 2.97 P99: 9.61 P99.9: 604.42 P99.99: 888.93 ------------------------------------------------------ [ 0, 1 ] 34435 1.438% 1.438% ( 1, 2 ] 1183666 49.419% 50.857% ########## ( 2, 3 ] 596644 24.910% 75.767% ##### ( 3, 4 ] 243234 10.155% 85.922% ## ( 4, 6 ] 260525 10.877% 96.799% ## ( 6, 10 ] 58347 2.436% 99.235% ( 10, 15 ] 10389 0.434% 99.669% ( 15, 22 ] 1242 0.052% 99.721% ( 22, 34 ] 110 0.005% 99.725% ( 34, 51 ] 178 0.007% 99.733% ( 51, 76 ] 254 0.011% 99.743% ( 76, 110 ] 108 0.005% 99.748% ( 110, 170 ] 394 0.016% 99.764% ( 170, 250 ] 533 0.022% 99.787% ( 250, 380 ] 914 0.038% 99.825% ( 380, 580 ] 1610 0.067% 99.892% ( 580, 870 ] 2254 0.094% 99.986% ( 870, 1300 ] 2078 0.087% 100.073% ( 1300, 1900 ] 1272 0.053% 100.126% ( 1900, 2900 ] 1116 0.047% 100.173% ( 2900, 4400 ] 1300 0.054% 100.227% ( 4400, 6600 ] 365 0.015% 100.242% ( 6600, 9900 ] 83 0.003% 100.246% ( 9900, 14000 ] 9 0.000% 100.246% ( 14000, 22000 ] 7 0.000% 100.246% ( 22000, 33000 ] 5 0.000% 100.246% ( 33000, 50000 ] 2 0.000% 100.247% ** Level 4 read latency histogram (micros): Count: 1572774 Average: 18.7770 StdDev: 207.17 Min: 1 Median: 1.9813 Max: 41971 Percentiles: P50: 1.98 P75: 2.99 P99: 233.09 P99.9: 1580.49 P99.99: 2198.27 ------------------------------------------------------ [ 0, 1 ] 24609 1.565% 1.565% ( 1, 2 ] 776313 49.359% 50.924% ########## ( 2, 3 ] 381140 24.234% 75.158% ##### ( 3, 4 ] 156869 9.974% 85.132% ## ( 4, 6 ] 164407 10.453% 95.585% ## ( 6, 10 ] 42796 2.721% 98.306% # ( 10, 15 ] 6826 0.434% 98.740% ( 15, 22 ] 860 0.055% 98.795% ( 22, 34 ] 71 0.005% 98.799% ( 34, 51 ] 136 0.009% 98.808% ( 51, 76 ] 183 0.012% 98.820% ( 76, 110 ] 232 0.015% 98.834% ( 110, 170 ] 1166 0.074% 98.909% ( 170, 250 ] 1825 0.116% 99.025% ( 250, 380 ] 2266 0.144% 99.169% ( 380, 580 ] 3307 0.210% 99.379% ( 580, 870 ] 3918 0.249% 99.628% ( 870, 1300 ] 3426 0.218% 99.846% ( 1300, 1900 ] 1823 0.116% 99.962% ( 1900, 2900 ] 1491 0.095% 100.057% ( 2900, 4400 ] 1576 0.100% 100.157% ( 4400, 6600 ] 507 0.032% 100.189% ( 6600, 9900 ] 92 0.006% 100.195% ( 9900, 14000 ] 11 0.001% 100.196% ( 14000, 22000 ] 6 0.000% 100.196% ( 22000, 33000 ] 1 0.000% 100.196% ( 33000, 50000 ] 3 0.000% 100.196% ** Level 5 read latency histogram (micros): Count: 165391 Average: 444.0620 StdDev: 942.88 Min: 1 Median: 4.4085 Max: 49530 Percentiles: P50: 4.41 P75: 539.17 P99: 4357.02 P99.9: 6555.48 P99.99: 8483.98 ------------------------------------------------------ [ 0, 1 ] 2145 1.297% 1.297% ( 1, 2 ] 49764 30.089% 31.386% ###### ( 2, 3 ] 20998 12.696% 44.082% ### ( 3, 4 ] 8431 5.098% 49.179% # ( 4, 6 ] 6654 4.023% 53.202% # ( 6, 10 ] 2133 1.290% 54.492% ( 10, 15 ] 208 0.126% 54.618% ( 15, 22 ] 26 0.016% 54.634% ( 22, 34 ] 4 0.002% 54.636% ( 34, 51 ] 1 0.001% 54.637% ( 51, 76 ] 4 0.002% 54.639% ( 76, 110 ] 1166 0.705% 55.344% ( 110, 170 ] 5948 3.596% 58.940% # ( 170, 250 ] 7494 4.531% 63.471% # ( 250, 380 ] 9162 5.540% 69.011% # ( 380, 580 ] 12448 7.526% 76.537% ## ( 580, 870 ] 13637 8.245% 84.783% ## ( 870, 1300 ] 10529 6.366% 91.149% # ( 1300, 1900 ] 5433 3.285% 94.434% # ( 1900, 2900 ] 3692 2.232% 96.666% ( 2900, 4400 ] 3976 2.404% 99.070% ( 4400, 6600 ] 1403 0.848% 99.918% ( 6600, 9900 ] 211 0.128% 100.046% ( 9900, 14000 ] 17 0.010% 100.056% ( 14000, 22000 ] 10 0.006% 100.062% ( 22000, 33000 ] 9 0.005% 100.068% ( 33000, 50000 ] 6 0.004% 100.071% ** DB Stats ** Uptime(secs): 24.9 total, 4.5 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 157.86 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.321 H:M:S, 37.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 217.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.723 H:M:S, 16.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/11/29-00:38:59 ... thread 0: (1000000,5000000) ops and (278756.7,176438.4) ops/second in (3.587358,28.338507) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/9 3.62 GB 169.9 4.3 0.0 4.3 9.0 4.7 0.0 1.9 92.6 194.4 47.60 31.41 78 0.610 4476K 7078 0.0 0.0 L1 0/0 0.00 KB 0.0 1.8 1.3 0.6 1.8 1.3 0.0 1.4 129.3 129.0 14.62 8.85 4 3.654 1919K 4547 0.0 0.0 L3 17/0 926.21 MB 0.9 7.8 3.7 4.0 7.7 3.7 0.3 2.1 119.4 118.5 66.68 37.32 31 2.151 5138K 10K 0.0 0.0 L4 175/0 9.74 GB 1.0 11.6 5.6 6.0 11.4 5.4 0.7 2.0 125.4 123.0 94.90 55.99 68 1.396 6875K 26K 0.0 0.0 L5 1174/0 96.14 GB 1.0 1.5 0.2 1.3 1.4 0.1 5.6 6.6 227.4 205.5 6.74 6.05 3 2.248 662K 49K 0.0 0.0 Sum 1383/9 110.40 GB 0.0 27.0 10.8 16.2 31.3 15.1 6.6 6.6 120.1 139.2 230.53 139.62 184 1.253 19M 97K 0.0 0.0 Int 0/0 0.00 KB 0.0 27.0 10.8 16.2 31.3 15.1 6.6 6.6 120.1 139.2 230.53 139.62 184 1.253 19M 97K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 27.0 10.8 16.2 26.6 10.4 0.0 0.0 136.1 133.9 203.51 125.89 119 1.710 19M 97K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 179.5 27.03 13.74 65 0.416 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 28.5 total, 28.3 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 31.35 GB write, 1125.26 MB/s write, 27.05 GB read, 970.88 MB/s read, 230.5 seconds Interval compaction: 31.35 GB write, 1132.58 MB/s write, 27.05 GB read, 977.20 MB/s read, 230.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 81, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 81, interval: 81 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1658236 Average: 9.4621 StdDev: 117.07 Min: 0 Median: 1.7883 Max: 53224 Percentiles: P50: 1.79 P75: 2.69 P99: 146.04 P99.9: 1004.74 P99.99: 1771.46 ------------------------------------------------------ [ 0, 1 ] 110570 6.668% 6.668% # ( 1, 2 ] 911469 54.966% 61.634% ########### ( 2, 3 ] 323548 19.512% 81.146% #### ( 3, 4 ] 131430 7.926% 89.072% ## ( 4, 6 ] 128747 7.764% 96.836% ## ( 6, 10 ] 26726 1.612% 98.447% ( 10, 15 ] 4442 0.268% 98.715% ( 15, 22 ] 592 0.036% 98.751% ( 22, 34 ] 54 0.003% 98.754% ( 34, 51 ] 53 0.003% 98.757% ( 51, 76 ] 47 0.003% 98.760% ( 76, 110 ] 1075 0.065% 98.825% ( 110, 170 ] 4831 0.291% 99.116% ( 170, 250 ] 3808 0.230% 99.346% ( 250, 380 ] 3048 0.184% 99.530% ( 380, 580 ] 3175 0.191% 99.721% ( 580, 870 ] 2495 0.150% 99.872% ( 870, 1300 ] 1496 0.090% 99.962% ( 1300, 1900 ] 592 0.036% 99.998% ( 1900, 2900 ] 415 0.025% 100.023% ( 2900, 4400 ] 339 0.020% 100.043% ( 4400, 6600 ] 88 0.005% 100.048% ( 6600, 9900 ] 24 0.001% 100.050% ( 9900, 14000 ] 6 0.000% 100.050% ( 14000, 22000 ] 5 0.000% 100.051% ( 33000, 50000 ] 1 0.000% 100.051% ( 50000, 75000 ] 1 0.000% 100.051% ** Level 1 read latency histogram (micros): Count: 437830 Average: 9.7083 StdDev: 149.90 Min: 1 Median: 1.9604 Max: 46203 Percentiles: P50: 1.96 P75: 2.94 P99: 9.95 P99.9: 1285.63 P99.99: 2955.80 ------------------------------------------------------ [ 0, 1 ] 8025 1.833% 1.833% ( 1, 2 ] 219594 50.155% 51.988% ########## ( 2, 3 ] 106713 24.373% 76.361% ##### ( 3, 4 ] 42739 9.762% 86.123% ## ( 4, 6 ] 46117 10.533% 96.656% ## ( 6, 10 ] 10383 2.371% 99.027% ( 10, 15 ] 1758 0.402% 99.429% ( 15, 22 ] 204 0.047% 99.475% ( 22, 34 ] 17 0.004% 99.479% ( 34, 51 ] 37 0.008% 99.488% ( 51, 76 ] 34 0.008% 99.495% ( 76, 110 ] 40 0.009% 99.505% ( 110, 170 ] 136 0.031% 99.536% ( 170, 250 ] 144 0.033% 99.569% ( 250, 380 ] 212 0.048% 99.617% ( 380, 580 ] 402 0.092% 99.709% ( 580, 870 ] 466 0.106% 99.815% ( 870, 1300 ] 384 0.088% 99.903% ( 1300, 1900 ] 203 0.046% 99.949% ( 1900, 2900 ] 171 0.039% 99.988% ( 2900, 4400 ] 194 0.044% 100.033% ( 4400, 6600 ] 60 0.014% 100.046% ( 6600, 9900 ] 8 0.002% 100.048% ( 9900, 14000 ] 5 0.001% 100.049% ( 14000, 22000 ] 1 0.000% 100.050% ( 33000, 50000 ] 1 0.000% 100.050% ** Level 2 read latency histogram (micros): Count: 646177 Average: 13.3890 StdDev: 169.52 Min: 1 Median: 1.9998 Max: 48543 Percentiles: P50: 2.00 P75: 3.07 P99: 11.99 P99.9: 1130.85 P99.99: 1518.62 ------------------------------------------------------ [ 0, 1 ] 14282 2.210% 2.210% ( 1, 2 ] 308883 47.802% 50.012% ########## ( 2, 3 ] 156744 24.257% 74.269% ##### ( 3, 4 ] 67542 10.453% 84.722% ## ( 4, 6 ] 70870 10.968% 95.689% ## ( 6, 10 ] 19818 3.067% 98.756% # ( 10, 15 ] 3966 0.614% 99.370% ( 15, 22 ] 639 0.099% 99.469% ( 22, 34 ] 110 0.017% 99.486% ( 34, 51 ] 44 0.007% 99.493% ( 51, 76 ] 33 0.005% 99.498% ( 76, 110 ] 36 0.006% 99.503% ( 110, 170 ] 80 0.012% 99.516% ( 170, 250 ] 162 0.025% 99.541% ( 250, 380 ] 333 0.052% 99.592% ( 380, 580 ] 592 0.092% 99.684% ( 580, 870 ] 863 0.134% 99.817% ( 870, 1300 ] 880 0.136% 99.954% ( 1300, 1900 ] 646 0.100% 100.054% ( 1900, 2900 ] 517 0.080% 100.134% ( 2900, 4400 ] 466 0.072% 100.206% ( 4400, 6600 ] 133 0.021% 100.226% ( 6600, 9900 ] 17 0.003% 100.229% ( 33000, 50000 ] 1 0.000% 100.229% ** Level 3 read latency histogram (micros): Count: 2395947 Average: 10.1996 StdDev: 149.22 Min: 1 Median: 1.9830 Max: 33388 Percentiles: P50: 1.98 P75: 2.97 P99: 9.67 P99.9: 611.47 P99.99: 892.68 ------------------------------------------------------ [ 0, 1 ] 34435 1.437% 1.437% ( 1, 2 ] 1183666 49.403% 50.840% ########## ( 2, 3 ] 596644 24.902% 75.742% ##### ( 3, 4 ] 243234 10.152% 85.894% ## ( 4, 6 ] 260525 10.874% 96.768% ## ( 6, 10 ] 58347 2.435% 99.203% ( 10, 15 ] 10389 0.434% 99.637% ( 15, 22 ] 1242 0.052% 99.688% ( 22, 34 ] 110 0.005% 99.693% ( 34, 51 ] 178 0.007% 99.700% ( 51, 76 ] 255 0.011% 99.711% ( 76, 110 ] 184 0.008% 99.719% ( 110, 170 ] 660 0.028% 99.746% ( 170, 250 ] 729 0.030% 99.777% ( 250, 380 ] 1021 0.043% 99.819% ( 380, 580 ] 1683 0.070% 99.890% ( 580, 870 ] 2295 0.096% 99.985% ( 870, 1300 ] 2093 0.087% 100.073% ( 1300, 1900 ] 1272 0.053% 100.126% ( 1900, 2900 ] 1118 0.047% 100.172% ( 2900, 4400 ] 1302 0.054% 100.227% ( 4400, 6600 ] 365 0.015% 100.242% ( 6600, 9900 ] 83 0.003% 100.246% ( 9900, 14000 ] 9 0.000% 100.246% ( 14000, 22000 ] 7 0.000% 100.246% ( 22000, 33000 ] 5 0.000% 100.246% ( 33000, 50000 ] 2 0.000% 100.246% ** Level 4 read latency histogram (micros): Count: 1682864 Average: 18.7698 StdDev: 201.94 Min: 1 Median: 1.9766 Max: 41971 Percentiles: P50: 1.98 P75: 2.99 P99: 278.23 P99.9: 1551.12 P99.99: 2191.03 ------------------------------------------------------ [ 0, 1 ] 27581 1.639% 1.639% ( 1, 2 ] 833381 49.522% 51.161% ########## ( 2, 3 ] 405767 24.112% 75.272% ##### ( 3, 4 ] 165831 9.854% 85.126% ## ( 4, 6 ] 171862 10.212% 95.339% ## ( 6, 10 ] 45223 2.687% 98.026% # ( 10, 15 ] 7137 0.424% 98.450% ( 15, 22 ] 894 0.053% 98.503% ( 22, 34 ] 75 0.004% 98.508% ( 34, 51 ] 137 0.008% 98.516% ( 51, 76 ] 185 0.011% 98.527% ( 76, 110 ] 856 0.051% 98.578% ( 110, 170 ] 3293 0.196% 98.773% ( 170, 250 ] 3133 0.186% 98.960% ( 250, 380 ] 3133 0.186% 99.146% ( 380, 580 ] 4067 0.242% 99.387% ( 580, 870 ] 4304 0.256% 99.643% ( 870, 1300 ] 3547 0.211% 99.854% ( 1300, 1900 ] 1852 0.110% 99.964% ( 1900, 2900 ] 1504 0.089% 100.053% ( 2900, 4400 ] 1585 0.094% 100.148% ( 4400, 6600 ] 507 0.030% 100.178% ( 6600, 9900 ] 92 0.005% 100.183% ( 9900, 14000 ] 13 0.001% 100.184% ( 14000, 22000 ] 6 0.000% 100.184% ( 22000, 33000 ] 1 0.000% 100.184% ( 33000, 50000 ] 3 0.000% 100.185% ** Level 5 read latency histogram (micros): Count: 332499 Average: 250.7730 StdDev: 704.20 Min: 1 Median: 2.6912 Max: 49530 Percentiles: P50: 2.69 P75: 188.61 P99: 3687.84 P99.9: 6107.90 P99.99: 6576.14 ------------------------------------------------------ [ 0, 1 ] 6428 1.933% 1.933% ( 1, 2 ] 124245 37.367% 39.300% ####### ( 2, 3 ] 51470 15.480% 54.780% ### ( 3, 4 ] 19480 5.859% 60.639% # ( 4, 6 ] 15907 4.784% 65.423% # ( 6, 10 ] 5294 1.592% 67.015% ( 10, 15 ] 546 0.164% 67.179% ( 15, 22 ] 76 0.023% 67.202% ( 22, 34 ] 7 0.002% 67.204% ( 34, 51 ] 2 0.001% 67.205% ( 51, 76 ] 9 0.003% 67.207% ( 76, 110 ] 4595 1.382% 68.589% ( 110, 170 ] 17932 5.393% 73.982% # ( 170, 250 ] 14544 4.374% 78.357% # ( 250, 380 ] 13710 4.123% 82.480% # ( 380, 580 ] 16436 4.943% 87.423% # ( 580, 870 ] 15743 4.735% 92.158% # ( 870, 1300 ] 11290 3.395% 95.553% # ( 1300, 1900 ] 5595 1.683% 97.236% ( 1900, 2900 ] 3762 1.131% 98.368% ( 2900, 4400 ] 4004 1.204% 99.572% ( 4400, 6600 ] 1406 0.423% 99.995% ( 6600, 9900 ] 213 0.064% 100.059% ( 9900, 14000 ] 18 0.005% 100.064% ( 14000, 22000 ] 14 0.004% 100.068% ( 22000, 33000 ] 9 0.003% 100.071% ( 33000, 50000 ] 6 0.002% 100.073% ** DB Stats ** Uptime(secs): 28.5 total, 3.6 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 172.51 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:9.321 H:M:S, 32.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 274.35 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/11/29-00:39:06 ... thread 0: (1000000,6000000) ops and (146905.2,170718.3) ops/second in (6.807109,35.145616) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/12 4.61 GB 138.5 5.5 0.0 5.5 11.2 5.7 0.0 2.0 101.9 207.1 55.61 38.90 99 0.562 5755K 8293 0.0 0.0 L1 0/0 0.00 KB 0.0 1.8 1.3 0.6 1.8 1.3 0.0 1.4 129.3 129.0 14.62 8.85 4 3.654 1919K 4547 0.0 0.0 L3 17/0 926.21 MB 0.9 7.8 3.7 4.0 7.7 3.7 0.3 2.1 119.4 118.5 66.68 37.32 31 2.151 5138K 10K 0.0 0.0 L4 175/0 9.74 GB 1.0 11.6 5.6 6.0 11.4 5.4 0.7 2.0 125.4 123.0 94.90 55.99 68 1.396 6875K 26K 0.0 0.0 L5 1174/0 96.14 GB 1.0 1.5 0.2 1.3 1.4 0.1 5.6 6.6 227.4 205.5 6.74 6.05 3 2.248 662K 49K 0.0 0.0 Sum 1384/12 111.39 GB 0.0 28.3 10.8 17.4 33.6 16.1 6.6 5.9 121.4 144.1 238.54 147.12 205 1.164 20M 98K 0.0 0.0 Int 0/0 0.00 KB 0.0 28.3 10.8 17.4 33.6 16.1 6.6 5.9 121.4 144.1 238.54 147.12 205 1.164 20M 98K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 28.3 10.8 17.4 27.8 10.4 0.0 0.0 139.0 136.8 208.32 130.61 124 1.680 20M 98K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 193.9 30.22 16.51 81 0.373 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 35.3 total, 35.1 interval Flush(GB): cumulative 5.721, interval 5.721 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 33.56 GB write, 972.62 MB/s write, 28.28 GB read, 819.49 MB/s read, 238.5 seconds Interval compaction: 33.56 GB write, 977.72 MB/s write, 28.28 GB read, 823.79 MB/s read, 238.5 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 10, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 10, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 81, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 10, total-stops: 81, interval: 91 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2306277 Average: 10.1243 StdDev: 103.07 Min: 0 Median: 1.7053 Max: 53224 Percentiles: P50: 1.71 P75: 2.51 P99: 189.43 P99.9: 796.16 P99.99: 1224.22 ------------------------------------------------------ [ 0, 1 ] 251522 10.906% 10.906% ## ( 1, 2 ] 1278308 55.427% 66.333% ########### ( 2, 3 ] 388690 16.854% 83.187% ### ( 3, 4 ] 155605 6.747% 89.934% # ( 4, 6 ] 142133 6.163% 96.097% # ( 6, 10 ] 30265 1.312% 97.409% ( 10, 15 ] 5130 0.222% 97.632% ( 15, 22 ] 742 0.032% 97.664% ( 22, 34 ] 88 0.004% 97.667% ( 34, 51 ] 54 0.002% 97.670% ( 51, 76 ] 53 0.002% 97.672% ( 76, 110 ] 6339 0.275% 97.947% ( 110, 170 ] 21788 0.945% 98.892% ( 170, 250 ] 10280 0.446% 99.337% ( 250, 380 ] 5577 0.242% 99.579% ( 380, 580 ] 5092 0.221% 99.800% ( 580, 870 ] 3092 0.134% 99.934% ( 870, 1300 ] 1564 0.068% 100.002% ( 1300, 1900 ] 606 0.026% 100.028% ( 1900, 2900 ] 432 0.019% 100.047% ( 2900, 4400 ] 345 0.015% 100.062% ( 4400, 6600 ] 88 0.004% 100.066% ( 6600, 9900 ] 24 0.001% 100.067% ( 9900, 14000 ] 6 0.000% 100.067% ( 14000, 22000 ] 5 0.000% 100.067% ( 33000, 50000 ] 1 0.000% 100.067% ( 50000, 75000 ] 1 0.000% 100.067% ** Level 1 read latency histogram (micros): Count: 438132 Average: 9.8355 StdDev: 149.95 Min: 1 Median: 1.9611 Max: 46203 Percentiles: P50: 1.96 P75: 2.95 P99: 10.51 P99.9: 1285.29 P99.99: 2955.57 ------------------------------------------------------ [ 0, 1 ] 8025 1.832% 1.832% ( 1, 2 ] 219594 50.121% 51.952% ########## ( 2, 3 ] 106713 24.356% 76.309% ##### ( 3, 4 ] 42739 9.755% 86.063% ## ( 4, 6 ] 46117 10.526% 96.589% ## ( 6, 10 ] 10383 2.370% 98.959% ( 10, 15 ] 1758 0.401% 99.360% ( 15, 22 ] 204 0.047% 99.407% ( 22, 34 ] 17 0.004% 99.411% ( 34, 51 ] 37 0.008% 99.419% ( 51, 76 ] 34 0.008% 99.427% ( 76, 110 ] 75 0.017% 99.444% ( 110, 170 ] 296 0.068% 99.512% ( 170, 250 ] 201 0.046% 99.557% ( 250, 380 ] 234 0.053% 99.611% ( 380, 580 ] 424 0.097% 99.708% ( 580, 870 ] 472 0.108% 99.815% ( 870, 1300 ] 384 0.088% 99.903% ( 1300, 1900 ] 203 0.046% 99.949% ( 1900, 2900 ] 171 0.039% 99.988% ( 2900, 4400 ] 194 0.044% 100.033% ( 4400, 6600 ] 60 0.014% 100.046% ( 6600, 9900 ] 8 0.002% 100.048% ( 9900, 14000 ] 5 0.001% 100.049% ( 14000, 22000 ] 1 0.000% 100.050% ( 33000, 50000 ] 1 0.000% 100.050% ** Level 2 read latency histogram (micros): Count: 646177 Average: 13.3890 StdDev: 169.52 Min: 1 Median: 1.9998 Max: 48543 Percentiles: P50: 2.00 P75: 3.07 P99: 11.99 P99.9: 1130.85 P99.99: 1518.62 ------------------------------------------------------ [ 0, 1 ] 14282 2.210% 2.210% ( 1, 2 ] 308883 47.802% 50.012% ########## ( 2, 3 ] 156744 24.257% 74.269% ##### ( 3, 4 ] 67542 10.453% 84.722% ## ( 4, 6 ] 70870 10.968% 95.689% ## ( 6, 10 ] 19818 3.067% 98.756% # ( 10, 15 ] 3966 0.614% 99.370% ( 15, 22 ] 639 0.099% 99.469% ( 22, 34 ] 110 0.017% 99.486% ( 34, 51 ] 44 0.007% 99.493% ( 51, 76 ] 33 0.005% 99.498% ( 76, 110 ] 36 0.006% 99.503% ( 110, 170 ] 80 0.012% 99.516% ( 170, 250 ] 162 0.025% 99.541% ( 250, 380 ] 333 0.052% 99.592% ( 380, 580 ] 592 0.092% 99.684% ( 580, 870 ] 863 0.134% 99.817% ( 870, 1300 ] 880 0.136% 99.954% ( 1300, 1900 ] 646 0.100% 100.054% ( 1900, 2900 ] 517 0.080% 100.134% ( 2900, 4400 ] 466 0.072% 100.206% ( 4400, 6600 ] 133 0.021% 100.226% ( 6600, 9900 ] 17 0.003% 100.229% ( 33000, 50000 ] 1 0.000% 100.229% ** Level 3 read latency histogram (micros): Count: 2397944 Average: 10.3444 StdDev: 149.28 Min: 1 Median: 1.9838 Max: 33388 Percentiles: P50: 1.98 P75: 2.97 P99: 9.80 P99.9: 615.48 P99.99: 893.24 ------------------------------------------------------ [ 0, 1 ] 34435 1.436% 1.436% ( 1, 2 ] 1183666 49.362% 50.798% ########## ( 2, 3 ] 596644 24.881% 75.679% ##### ( 3, 4 ] 243234 10.143% 85.823% ## ( 4, 6 ] 260525 10.865% 96.687% ## ( 6, 10 ] 58347 2.433% 99.120% ( 10, 15 ] 10389 0.433% 99.554% ( 15, 22 ] 1242 0.052% 99.605% ( 22, 34 ] 110 0.005% 99.610% ( 34, 51 ] 178 0.007% 99.617% ( 51, 76 ] 255 0.011% 99.628% ( 76, 110 ] 536 0.022% 99.650% ( 110, 170 ] 1644 0.069% 99.719% ( 170, 250 ] 1093 0.046% 99.765% ( 250, 380 ] 1171 0.049% 99.813% ( 380, 580 ] 1792 0.075% 99.888% ( 580, 870 ] 2330 0.097% 99.985% ( 870, 1300 ] 2095 0.087% 100.073% ( 1300, 1900 ] 1273 0.053% 100.126% ( 1900, 2900 ] 1118 0.047% 100.172% ( 2900, 4400 ] 1302 0.054% 100.227% ( 4400, 6600 ] 365 0.015% 100.242% ( 6600, 9900 ] 83 0.003% 100.245% ( 9900, 14000 ] 9 0.000% 100.246% ( 14000, 22000 ] 7 0.000% 100.246% ( 22000, 33000 ] 5 0.000% 100.246% ( 33000, 50000 ] 2 0.000% 100.246% ** Level 4 read latency histogram (micros): Count: 1699027 Average: 20.3389 StdDev: 201.97 Min: 1 Median: 1.9863 Max: 41971 Percentiles: P50: 1.99 P75: 3.05 P99: 335.07 P99.9: 1548.19 P99.99: 2191.37 ------------------------------------------------------ [ 0, 1 ] 27581 1.623% 1.623% ( 1, 2 ] 833381 49.050% 50.674% ########## ( 2, 3 ] 405767 23.882% 74.556% ##### ( 3, 4 ] 165831 9.760% 84.316% ## ( 4, 6 ] 171862 10.115% 94.432% ## ( 6, 10 ] 45223 2.662% 97.094% # ( 10, 15 ] 7137 0.420% 97.514% ( 15, 22 ] 894 0.053% 97.566% ( 22, 34 ] 75 0.004% 97.571% ( 34, 51 ] 137 0.008% 97.579% ( 51, 76 ] 189 0.011% 97.590% ( 76, 110 ] 3550 0.209% 97.799% ( 110, 170 ] 11500 0.677% 98.476% ( 170, 250 ] 6132 0.361% 98.837% ( 250, 380 ] 4245 0.250% 99.086% ( 380, 580 ] 4927 0.290% 99.376% ( 580, 870 ] 4534 0.267% 99.643% ( 870, 1300 ] 3594 0.212% 99.855% ( 1300, 1900 ] 1859 0.109% 99.964% ( 1900, 2900 ] 1507 0.089% 100.053% ( 2900, 4400 ] 1585 0.093% 100.146% ( 4400, 6600 ] 507 0.030% 100.176% ( 6600, 9900 ] 92 0.005% 100.181% ( 9900, 14000 ] 13 0.001% 100.182% ( 14000, 22000 ] 6 0.000% 100.183% ( 22000, 33000 ] 1 0.000% 100.183% ( 33000, 50000 ] 3 0.000% 100.183% ** Level 5 read latency histogram (micros): Count: 422369 Average: 236.5492 StdDev: 628.21 Min: 1 Median: 5.1115 Max: 49530 Percentiles: P50: 5.11 P75: 196.43 P99: 3348.58 P99.9: 5953.19 P99.99: 6547.99 ------------------------------------------------------ [ 0, 1 ] 6429 1.522% 1.522% ( 1, 2 ] 124333 29.437% 30.959% ###### ( 2, 3 ] 51752 12.253% 43.212% ## ( 3, 4 ] 19681 4.660% 47.872% # ( 4, 6 ] 16176 3.830% 51.701% # ( 6, 10 ] 5324 1.261% 52.962% ( 10, 15 ] 561 0.133% 53.095% ( 15, 22 ] 77 0.018% 53.113% ( 22, 34 ] 7 0.002% 53.115% ( 34, 51 ] 2 0.000% 53.115% ( 51, 76 ] 21 0.005% 53.120% ( 76, 110 ] 19371 4.586% 57.706% # ( 110, 170 ] 62831 14.876% 72.582% ### ( 170, 250 ] 30909 7.318% 79.900% # ( 250, 380 ] 20095 4.758% 84.658% # ( 380, 580 ] 21268 5.035% 89.693% # ( 580, 870 ] 17164 4.064% 93.757% # ( 870, 1300 ] 11532 2.730% 96.487% # ( 1300, 1900 ] 5627 1.332% 97.820% ( 1900, 2900 ] 3787 0.897% 98.716% ( 2900, 4400 ] 4007 0.949% 99.665% ( 4400, 6600 ] 1406 0.333% 99.998% ( 6600, 9900 ] 213 0.050% 100.048% ( 9900, 14000 ] 18 0.004% 100.053% ( 14000, 22000 ] 14 0.003% 100.056% ( 22000, 33000 ] 9 0.002% 100.058% ( 33000, 50000 ] 6 0.001% 100.059% ** DB Stats ** Uptime(secs): 35.3 total, 6.8 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 167.13 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:12.570 H:M:S, 35.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 144.58 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.249 H:M:S, 47.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/29-00:39:29 ... thread 0: (1000000,7000000) ops and (44291.6,121268.3) ops/second in (22.577645,57.723261) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 3.86 GB 6.3 7.8 0.0 7.8 14.5 6.7 0.0 2.2 118.2 219.3 67.68 50.41 119 0.569 8121K 19K 0.0 0.0 L1 22/22 1.71 GB 0.0 3.6 3.0 0.6 3.5 3.0 0.0 1.2 103.3 102.8 35.34 19.04 5 7.068 3705K 14K 0.0 0.0 L3 17/0 926.21 MB 0.9 7.8 3.7 4.0 7.7 3.7 0.3 2.1 119.4 118.5 66.68 37.32 31 2.151 5138K 10K 0.0 0.0 L4 175/0 9.74 GB 1.0 11.6 5.6 6.0 11.4 5.4 0.7 2.0 125.4 123.0 94.90 55.99 68 1.396 6875K 26K 0.0 0.0 L5 1174/0 96.14 GB 1.0 1.5 0.2 1.3 1.4 0.1 5.6 6.6 227.4 205.5 6.74 6.05 3 2.248 662K 49K 0.0 0.0 Sum 1402/35 112.35 GB 0.0 32.3 12.6 19.7 38.5 18.8 6.6 5.7 121.8 145.3 271.34 168.81 226 1.201 24M 120K 0.0 0.0 Int 0/0 0.00 KB 0.0 32.3 12.6 19.7 38.5 18.8 6.6 5.7 121.8 145.3 271.34 168.81 226 1.201 24M 120K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 32.3 12.6 19.7 31.8 12.1 0.0 0.0 138.9 136.9 237.95 149.54 129 1.845 24M 120K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 6.7 6.7 0.0 0.0 0.0 205.6 33.39 19.27 97 0.344 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 57.9 total, 57.7 interval Flush(GB): cumulative 6.706, interval 6.706 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 38.51 GB write, 681.03 MB/s write, 32.27 GB read, 570.58 MB/s read, 271.3 seconds Interval compaction: 38.51 GB write, 683.21 MB/s write, 32.27 GB read, 572.41 MB/s read, 271.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 81, pending-compaction-bytes-delays: 6, pending-compaction-bytes-stops: 0, total-delays: 22, total-stops: 81, interval: 103 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 3050651 Average: 15.6588 StdDev: 97.84 Min: 0 Median: 1.7041 Max: 53224 Percentiles: P50: 1.70 P75: 2.63 P99: 226.48 P99.9: 730.23 P99.99: 1101.70 ------------------------------------------------------ [ 0, 1 ] 394304 12.925% 12.925% ### ( 1, 2 ] 1606276 52.654% 65.579% ########### ( 2, 3 ] 453947 14.880% 80.459% ### ( 3, 4 ] 188560 6.181% 86.640% # ( 4, 6 ] 158660 5.201% 91.841% # ( 6, 10 ] 34006 1.115% 92.956% ( 10, 15 ] 5891 0.193% 93.149% ( 15, 22 ] 911 0.030% 93.179% ( 22, 34 ] 123 0.004% 93.183% ( 34, 51 ] 54 0.002% 93.184% ( 51, 76 ] 140 0.005% 93.189% ( 76, 110 ] 43338 1.421% 94.610% ( 110, 170 ] 114358 3.749% 98.358% # ( 170, 250 ] 27728 0.909% 99.267% ( 250, 380 ] 9575 0.314% 99.581% ( 380, 580 ] 7740 0.254% 99.835% ( 580, 870 ] 3842 0.126% 99.961% ( 870, 1300 ] 1659 0.054% 100.015% ( 1300, 1900 ] 639 0.021% 100.036% ( 1900, 2900 ] 469 0.015% 100.051% ( 2900, 4400 ] 399 0.013% 100.065% ( 4400, 6600 ] 89 0.003% 100.067% ( 6600, 9900 ] 25 0.001% 100.068% ( 9900, 14000 ] 6 0.000% 100.068% ( 14000, 22000 ] 5 0.000% 100.069% ( 33000, 50000 ] 1 0.000% 100.069% ( 50000, 75000 ] 1 0.000% 100.069% ** Level 1 read latency histogram (micros): Count: 500146 Average: 10.5213 StdDev: 141.44 Min: 0 Median: 2.0521 Max: 46203 Percentiles: P50: 2.05 P75: 3.11 P99: 133.30 P99.9: 1223.44 P99.99: 2915.27 ------------------------------------------------------ [ 0, 1 ] 9256 1.851% 1.851% ( 1, 2 ] 234257 46.838% 48.688% ######### ( 2, 3 ] 125860 25.165% 73.853% ##### ( 3, 4 ] 52179 10.433% 84.286% ## ( 4, 6 ] 56953 11.387% 95.673% ## ( 6, 10 ] 11475 2.294% 97.967% ( 10, 15 ] 2051 0.410% 98.377% ( 15, 22 ] 395 0.079% 98.456% ( 22, 34 ] 27 0.005% 98.462% ( 34, 51 ] 37 0.007% 98.469% ( 51, 76 ] 35 0.007% 98.476% ( 76, 110 ] 1253 0.251% 98.727% ( 110, 170 ] 3521 0.704% 99.431% ( 170, 250 ] 719 0.144% 99.575% ( 250, 380 ] 332 0.066% 99.641% ( 380, 580 ] 481 0.096% 99.737% ( 580, 870 ] 492 0.098% 99.835% ( 870, 1300 ] 394 0.079% 99.914% ( 1300, 1900 ] 205 0.041% 99.955% ( 1900, 2900 ] 173 0.035% 99.990% ( 2900, 4400 ] 195 0.039% 100.029% ( 4400, 6600 ] 60 0.012% 100.041% ( 6600, 9900 ] 8 0.002% 100.042% ( 9900, 14000 ] 5 0.001% 100.043% ( 14000, 22000 ] 1 0.000% 100.044% ( 33000, 50000 ] 1 0.000% 100.044% ** Level 2 read latency histogram (micros): Count: 646177 Average: 13.3890 StdDev: 169.52 Min: 1 Median: 1.9998 Max: 48543 Percentiles: P50: 2.00 P75: 3.07 P99: 11.99 P99.9: 1130.85 P99.99: 1518.62 ------------------------------------------------------ [ 0, 1 ] 14282 2.210% 2.210% ( 1, 2 ] 308883 47.802% 50.012% ########## ( 2, 3 ] 156744 24.257% 74.269% ##### ( 3, 4 ] 67542 10.453% 84.722% ## ( 4, 6 ] 70870 10.968% 95.689% ## ( 6, 10 ] 19818 3.067% 98.756% # ( 10, 15 ] 3966 0.614% 99.370% ( 15, 22 ] 639 0.099% 99.469% ( 22, 34 ] 110 0.017% 99.486% ( 34, 51 ] 44 0.007% 99.493% ( 51, 76 ] 33 0.005% 99.498% ( 76, 110 ] 36 0.006% 99.503% ( 110, 170 ] 80 0.012% 99.516% ( 170, 250 ] 162 0.025% 99.541% ( 250, 380 ] 333 0.052% 99.592% ( 380, 580 ] 592 0.092% 99.684% ( 580, 870 ] 863 0.134% 99.817% ( 870, 1300 ] 880 0.136% 99.954% ( 1300, 1900 ] 646 0.100% 100.054% ( 1900, 2900 ] 517 0.080% 100.134% ( 2900, 4400 ] 466 0.072% 100.206% ( 4400, 6600 ] 133 0.021% 100.226% ( 6600, 9900 ] 17 0.003% 100.229% ( 33000, 50000 ] 1 0.000% 100.229% ** Level 3 read latency histogram (micros): Count: 2406400 Average: 10.8242 StdDev: 149.30 Min: 1 Median: 1.9874 Max: 33388 Percentiles: P50: 1.99 P75: 2.98 P99: 12.64 P99.9: 618.17 P99.99: 893.86 ------------------------------------------------------ [ 0, 1 ] 34435 1.431% 1.431% ( 1, 2 ] 1183666 49.188% 50.619% ########## ( 2, 3 ] 596644 24.794% 75.413% ##### ( 3, 4 ] 243234 10.108% 85.521% ## ( 4, 6 ] 260525 10.826% 96.347% ## ( 6, 10 ] 58347 2.425% 98.772% ( 10, 15 ] 10389 0.432% 99.204% ( 15, 22 ] 1242 0.052% 99.255% ( 22, 34 ] 110 0.005% 99.260% ( 34, 51 ] 178 0.007% 99.267% ( 51, 76 ] 258 0.011% 99.278% ( 76, 110 ] 2476 0.103% 99.381% ( 110, 170 ] 6864 0.285% 99.666% ( 170, 250 ] 2031 0.084% 99.751% ( 250, 380 ] 1360 0.057% 99.807% ( 380, 580 ] 1924 0.080% 99.887% ( 580, 870 ] 2360 0.098% 99.985% ( 870, 1300 ] 2097 0.087% 100.072% ( 1300, 1900 ] 1274 0.053% 100.125% ( 1900, 2900 ] 1119 0.047% 100.172% ( 2900, 4400 ] 1302 0.054% 100.226% ( 4400, 6600 ] 365 0.015% 100.241% ( 6600, 9900 ] 83 0.003% 100.244% ( 9900, 14000 ] 9 0.000% 100.245% ( 14000, 22000 ] 7 0.000% 100.245% ( 22000, 33000 ] 5 0.000% 100.245% ( 33000, 50000 ] 2 0.000% 100.245% ** Level 4 read latency histogram (micros): Count: 1765885 Average: 25.1560 StdDev: 200.28 Min: 1 Median: 2.0542 Max: 41971 Percentiles: P50: 2.05 P75: 3.35 P99: 364.05 P99.9: 1533.49 P99.99: 2194.08 ------------------------------------------------------ [ 0, 1 ] 27581 1.562% 1.562% ( 1, 2 ] 833381 47.193% 48.755% ######### ( 2, 3 ] 405767 22.978% 71.733% ##### ( 3, 4 ] 165831 9.391% 81.124% ## ( 4, 6 ] 171862 9.732% 90.857% ## ( 6, 10 ] 45223 2.561% 93.417% # ( 10, 15 ] 7137 0.404% 93.822% ( 15, 22 ] 894 0.051% 93.872% ( 22, 34 ] 75 0.004% 93.876% ( 34, 51 ] 137 0.008% 93.884% ( 51, 76 ] 208 0.012% 93.896% ( 76, 110 ] 18972 1.074% 94.970% ( 110, 170 ] 52842 2.992% 97.963% # ( 170, 250 ] 13240 0.750% 98.713% ( 250, 380 ] 5786 0.328% 99.040% ( 380, 580 ] 6004 0.340% 99.380% ( 580, 870 ] 4818 0.273% 99.653% ( 870, 1300 ] 3633 0.206% 99.859% ( 1300, 1900 ] 1871 0.106% 99.965% ( 1900, 2900 ] 1518 0.086% 100.051% ( 2900, 4400 ] 1586 0.090% 100.140% ( 4400, 6600 ] 508 0.029% 100.169% ( 6600, 9900 ] 93 0.005% 100.175% ( 9900, 14000 ] 13 0.001% 100.175% ( 14000, 22000 ] 6 0.000% 100.176% ( 22000, 33000 ] 1 0.000% 100.176% ( 33000, 50000 ] 3 0.000% 100.176% ** Level 5 read latency histogram (micros): Count: 794679 Average: 194.5437 StdDev: 463.41 Min: 1 Median: 123.6158 Max: 49530 Percentiles: P50: 123.62 P75: 164.44 P99: 2245.52 P99.9: 5359.00 P99.99: 6477.31 ------------------------------------------------------ [ 0, 1 ] 6429 0.809% 0.809% ( 1, 2 ] 124354 15.648% 16.457% ### ( 2, 3 ] 51808 6.519% 22.977% # ( 3, 4 ] 19714 2.481% 25.457% ( 4, 6 ] 16214 2.040% 27.498% ( 6, 10 ] 5328 0.670% 28.168% ( 10, 15 ] 561 0.071% 28.239% ( 15, 22 ] 77 0.010% 28.249% ( 22, 34 ] 7 0.001% 28.249% ( 34, 51 ] 2 0.000% 28.250% ( 51, 76 ] 129 0.016% 28.266% ( 76, 110 ] 106461 13.397% 41.663% ### ( 110, 170 ] 291965 36.740% 78.403% ####### ( 170, 250 ] 70501 8.872% 87.274% ## ( 250, 380 ] 28689 3.610% 90.884% # ( 380, 580 ] 27139 3.415% 94.299% # ( 580, 870 ] 18578 2.338% 96.637% ( 870, 1300 ] 11764 1.480% 98.118% ( 1300, 1900 ] 5684 0.715% 98.833% ( 1900, 2900 ] 3847 0.484% 99.317% ( 2900, 4400 ] 4021 0.506% 99.823% ( 4400, 6600 ] 1407 0.177% 100.000% ( 6600, 9900 ] 213 0.027% 100.027% ( 9900, 14000 ] 18 0.002% 100.029% ( 14000, 22000 ] 14 0.002% 100.031% ( 22000, 33000 ] 9 0.001% 100.032% ( 33000, 50000 ] 6 0.001% 100.033% ** DB Stats ** Uptime(secs): 57.9 total, 22.6 interval Cumulative writes: 0 writes, 7000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 6.73 GB, 118.96 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:30.975 H:M:S, 53.5 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 43.59 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:18.405 H:M:S, 81.5 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 0 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 316.637 micros/op 12613 ops/sec 60.173 seconds 758996 operations; 12.2 MB/s (187999 of 187999 found) Microseconds per read: Count: 758996 Average: 316.6389 StdDev: 897.68 Min: 2 Median: 184.2443 Max: 98790 Percentiles: P50: 184.24 P75: 249.92 P99: 2700.34 P99.9: 13791.56 P99.99: 31853.88 ------------------------------------------------------ ( 1, 2 ] 10 0.001% 0.001% ( 2, 3 ] 27 0.004% 0.005% ( 3, 4 ] 44 0.006% 0.011% ( 4, 6 ] 80 0.011% 0.021% ( 6, 10 ] 288 0.038% 0.059% ( 10, 15 ] 2346 0.309% 0.368% ( 15, 22 ] 3217 0.424% 0.792% ( 22, 34 ] 6291 0.829% 1.621% ( 34, 51 ] 2198 0.290% 1.911% ( 51, 76 ] 294 0.039% 1.949% ( 76, 110 ] 15809 2.083% 4.032% ( 110, 170 ] 307737 40.545% 44.577% ######## ( 170, 250 ] 231149 30.455% 75.032% ###### ( 250, 380 ] 83515 11.003% 86.035% ## ( 380, 580 ] 45227 5.959% 91.994% # ( 580, 870 ] 27176 3.581% 95.575% # ( 870, 1300 ] 15560 2.050% 97.625% ( 1300, 1900 ] 7047 0.928% 98.553% ( 1900, 2900 ] 4237 0.558% 99.111% ( 2900, 4400 ] 3823 0.504% 99.615% ( 4400, 6600 ] 1305 0.172% 99.787% ( 6600, 9900 ] 409 0.054% 99.841% ( 9900, 14000 ] 472 0.062% 99.903% ( 14000, 22000 ] 531 0.070% 99.973% ( 22000, 33000 ] 143 0.019% 99.992% ( 33000, 50000 ] 41 0.005% 99.997% ( 50000, 75000 ] 17 0.002% 100.000% ( 75000, 110000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 12504154 rocksdb.bloom.filter.full.positive COUNT : 880120 rocksdb.bloom.filter.full.true.positive COUNT : 758607 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 389 rocksdb.memtable.miss COUNT : 758607 rocksdb.l0.hit COUNT : 28787 rocksdb.l1.hit COUNT : 6898 rocksdb.l2andup.hit COUNT : 722922 rocksdb.compaction.key.drop.new COUNT : 493614 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 7010193 rocksdb.number.keys.read COUNT : 758996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 7234519176 rocksdb.bytes.read COUNT : 758996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1845 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 33321813 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 35424709405 rocksdb.compact.write.bytes COUNT : 34913750085 rocksdb.flush.write.bytes COUNT : 7200280145 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 26 rocksdb.number.superversion_acquires COUNT : 1483 rocksdb.number.superversion_releases COUNT : 1430 rocksdb.number.superversion_cleanups COUNT : 367 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 443 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 7142185984 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2737152 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 38966336757 rocksdb.non.last.level.read.count COUNT : 9274468 rocksdb.block.checksum.compute.count COUNT : 9469463 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 182.778954 P95 : 822.686014 P99 : 2699.442476 P100 : 98789.000000 COUNT : 758996 SUM : 239651779 rocksdb.db.write.micros P50 : 1.574695 P95 : 4.336349 P99 : 8.189037 P100 : 949219.000000 COUNT : 7010193 SUM : 51235507 rocksdb.compaction.times.micros P50 : 1498958.333333 P95 : 4174000.000000 P99 : 6372400.000000 P100 : 20722239.000000 COUNT : 129 SUM : 237946070 rocksdb.compaction.times.cpu_micros P50 : 892162.162162 P95 : 2610000.000000 P99 : 6181000.000000 P100 : 10189893.000000 COUNT : 129 SUM : 149541601 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 988.250000 P95 : 67916.666667 P99 : 172400.000000 P100 : 200680.000000 COUNT : 97 SUM : 1114505 rocksdb.compaction.outfile.sync.micros P50 : 13819.117647 P95 : 247000.000000 P99 : 442700.000000 P100 : 764181.000000 COUNT : 435 SUM : 22896479 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 321.500000 P95 : 4034.375000 P99 : 6165.500000 P100 : 6956.000000 COUNT : 258 SUM : 251550 rocksdb.table.open.io.micros P50 : 8347.674419 P95 : 19311.004785 P99 : 23952.500000 P100 : 44604.000000 COUNT : 1845 SUM : 15340294 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 4.106797 P95 : 9.570867 P99 : 153.376840 P100 : 48546.000000 COUNT : 8578494 SUM : 109303167 rocksdb.read.block.get.micros P50 : 144.639549 P95 : 720.593392 P99 : 2435.762675 P100 : 53228.000000 COUNT : 889135 SUM : 209903384 rocksdb.write.raw.block.micros P50 : 0.527722 P95 : 1.077413 P99 : 3.547557 P100 : 63797.000000 COUNT : 10200272 SUM : 31983326 rocksdb.numfiles.in.singlecompaction P50 : 2.767442 P95 : 5.969231 P99 : 9.634286 P100 : 35.000000 COUNT : 164 SUM : 579 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567576 P95 : 1243.612454 P99 : 2650.872637 P100 : 949054.000000 COUNT : 143431 SUM : 33336094 rocksdb.sst.read.micros P50 : 1.967129 P95 : 149.880204 P99 : 524.533089 P100 : 53224.000000 COUNT : 9274527 SUM : 296807982 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 758996 SUM : 758996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 7010193 SUM : 7234519176 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 230625.000000 P95 : 964428.571429 P99 : 1152885.714286 P100 : 1178539.000000 COUNT : 97 SUM : 33391700 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 445 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0