[2024-11-19 22:47:04.502385] Starting SPDK v25.01-pre git sha1 f22e807f1 / DPDK 24.11.0-rc2 initialization... [2024-11-19 22:47:04.502660] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2473154 ] Set seed to 1732052824495678 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-11-19 22:47:04.675097] pci_dpdk.c: 37:dpdk_pci_init: *NOTICE*: In-development DPDK 24.11.0-rc2 is used. There is no support for it in SPDK. Enabled only for validation. [2024-11-19 22:47:04.725580] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-11-19 22:47:04.749061] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-11-19 22:47:04.749100] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 2473154' to capture a snapshot of events at runtime. [2024-11-19 22:47:04.749112] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-11-19 22:47:04.749121] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-11-19 22:47:04.749132] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid2473154 for offline analysis/debug. [2024-11-19 22:47:04.749711] reactor.c:1005:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Tue Nov 19 22:47:09 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/11/19-22:47:16 ... thread 0: (1000000,1000000) ops and (127661.8,127661.8) ops/second in (7.833195,7.833195) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 566.85 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 116.4 7.04 2.31 9 0.782 0 0 0.0 0.0 L1 4/4 197.99 MB 0.0 0.3 0.3 0.0 0.3 0.3 0.0 1.0 123.7 123.6 2.33 1.25 1 2.329 292K 318 0.0 0.0 L2 5/1 476.19 MB 3.5 0.1 0.1 0.0 0.1 0.1 0.0 1.0 119.3 119.3 0.75 0.41 1 0.753 91K 0 0.0 0.0 L3 64/11 4.29 GB 3.5 4.9 3.1 1.8 4.8 3.0 0.0 1.6 104.4 103.6 47.62 22.98 24 1.984 2862K 2534 0.0 0.0 L4 169/12 10.97 GB 1.1 1.6 1.3 0.3 1.6 1.3 0.2 1.2 106.8 106.2 15.54 7.67 11 1.413 354K 0 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1348/32 106.90 GB 0.0 6.8 4.8 2.1 7.6 5.5 0.2 9.5 95.6 106.2 73.28 34.62 46 1.593 3600K 2852 0.0 0.0 Int 0/0 0.00 KB 0.0 6.8 4.8 2.1 7.6 5.5 0.2 9.5 95.6 106.2 73.28 34.62 46 1.593 3600K 2852 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.8 4.8 2.1 6.8 4.7 0.0 0.0 105.8 105.1 66.24 32.31 37 1.790 3600K 2852 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 116.4 7.04 2.31 9 0.782 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.0 total, 7.8 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.60 GB write, 973.44 MB/s write, 6.84 GB read, 876.59 MB/s read, 73.3 seconds Interval compaction: 7.60 GB write, 993.29 MB/s write, 6.84 GB read, 894.46 MB/s read, 73.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 32, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 32, interval: 32 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 103625 Average: 8.9684 StdDev: 114.29 Min: 1 Median: 1.8419 Max: 7551 Percentiles: P50: 1.84 P75: 2.78 P99: 9.76 P99.9: 1869.37 P99.99: 4381.25 ------------------------------------------------------ [ 0, 1 ] 4301 4.151% 4.151% # ( 1, 2 ] 56435 54.461% 58.611% ########### ( 2, 3 ] 21725 20.965% 79.576% #### ( 3, 4 ] 9391 9.062% 88.639% ## ( 4, 6 ] 8903 8.592% 97.230% ## ( 6, 10 ] 1950 1.882% 99.112% ( 10, 15 ] 371 0.358% 99.470% ( 15, 22 ] 33 0.032% 99.502% ( 22, 34 ] 1 0.001% 99.503% ( 34, 51 ] 2 0.002% 99.505% ( 51, 76 ] 4 0.004% 99.509% ( 110, 170 ] 8 0.008% 99.517% ( 170, 250 ] 20 0.019% 99.536% ( 250, 380 ] 35 0.034% 99.570% ( 380, 580 ] 69 0.067% 99.636% ( 580, 870 ] 103 0.099% 99.736% ( 870, 1300 ] 103 0.099% 99.835% ( 1300, 1900 ] 71 0.069% 99.903% ( 1900, 2900 ] 61 0.059% 99.962% ( 2900, 4400 ] 29 0.028% 99.990% ( 4400, 6600 ] 9 0.009% 99.999% ( 6600, 9900 ] 2 0.002% 100.001% ** Level 1 read latency histogram (micros): Count: 45567 Average: 7.5775 StdDev: 100.08 Min: 1 Median: 1.9331 Max: 5213 Percentiles: P50: 1.93 P75: 2.93 P99: 9.66 P99.9: 1293.02 P99.99: 4262.64 ------------------------------------------------------ [ 0, 1 ] 993 2.179% 2.179% ( 1, 2 ] 23352 51.248% 53.427% ########## ( 2, 3 ] 10591 23.243% 76.670% ##### ( 3, 4 ] 4621 10.141% 86.811% ## ( 4, 6 ] 4703 10.321% 97.132% ## ( 6, 10 ] 932 2.045% 99.177% ( 10, 15 ] 182 0.399% 99.576% ( 15, 22 ] 12 0.026% 99.603% ( 22, 34 ] 3 0.007% 99.609% ( 34, 51 ] 1 0.002% 99.612% ( 51, 76 ] 4 0.009% 99.620% ( 170, 250 ] 10 0.022% 99.642% ( 250, 380 ] 14 0.031% 99.673% ( 380, 580 ] 27 0.059% 99.732% ( 580, 870 ] 43 0.094% 99.827% ( 870, 1300 ] 35 0.077% 99.903% ( 1300, 1900 ] 11 0.024% 99.928% ( 1900, 2900 ] 14 0.031% 99.958% ( 2900, 4400 ] 17 0.037% 99.996% ( 4400, 6600 ] 3 0.007% 100.002% ** Level 2 read latency histogram (micros): Count: 727173 Average: 12.4623 StdDev: 153.00 Min: 1 Median: 1.9788 Max: 8609 Percentiles: P50: 1.98 P75: 3.02 P99: 10.92 P99.9: 1085.94 P99.99: 1524.56 ------------------------------------------------------ [ 0, 1 ] 17968 2.471% 2.471% ( 1, 2 ] 353113 48.560% 51.031% ########## ( 2, 3 ] 172889 23.775% 74.806% ##### ( 3, 4 ] 77355 10.638% 85.444% ## ( 4, 6 ] 76570 10.530% 95.974% ## ( 6, 10 ] 21238 2.921% 98.894% # ( 10, 15 ] 4176 0.574% 99.469% ( 15, 22 ] 660 0.091% 99.559% ( 22, 34 ] 116 0.016% 99.575% ( 34, 51 ] 50 0.007% 99.582% ( 51, 76 ] 48 0.007% 99.589% ( 76, 110 ] 27 0.004% 99.593% ( 110, 170 ] 63 0.009% 99.601% ( 170, 250 ] 152 0.021% 99.622% ( 250, 380 ] 289 0.040% 99.662% ( 380, 580 ] 528 0.073% 99.734% ( 580, 870 ] 786 0.108% 99.843% ( 870, 1300 ] 832 0.114% 99.957% ( 1300, 1900 ] 642 0.088% 100.045% ( 1900, 2900 ] 636 0.087% 100.133% ( 2900, 4400 ] 526 0.072% 100.205% ( 4400, 6600 ] 124 0.017% 100.222% ( 6600, 9900 ] 10 0.001% 100.223% ** Level 3 read latency histogram (micros): Count: 879481 Average: 11.4306 StdDev: 140.62 Min: 1 Median: 1.9727 Max: 11368 Percentiles: P50: 1.97 P75: 2.97 P99: 9.94 P99.9: 994.90 P99.99: 1325.39 ------------------------------------------------------ [ 0, 1 ] 15079 1.715% 1.715% ( 1, 2 ] 436599 49.643% 51.357% ########## ( 2, 3 ] 214198 24.355% 75.712% ##### ( 3, 4 ] 92787 10.550% 86.263% ## ( 4, 6 ] 90218 10.258% 96.521% ## ( 6, 10 ] 22118 2.515% 99.036% # ( 10, 15 ] 4327 0.492% 99.528% ( 15, 22 ] 558 0.063% 99.591% ( 22, 34 ] 47 0.005% 99.596% ( 34, 51 ] 54 0.006% 99.602% ( 51, 76 ] 60 0.007% 99.609% ( 76, 110 ] 24 0.003% 99.612% ( 110, 170 ] 69 0.008% 99.620% ( 170, 250 ] 168 0.019% 99.639% ( 250, 380 ] 312 0.035% 99.674% ( 380, 580 ] 639 0.073% 99.747% ( 580, 870 ] 1034 0.118% 99.865% ( 870, 1300 ] 1069 0.122% 99.986% ( 1300, 1900 ] 781 0.089% 100.075% ( 1900, 2900 ] 664 0.075% 100.151% ( 2900, 4400 ] 461 0.052% 100.203% ( 4400, 6600 ] 116 0.013% 100.216% ( 6600, 9900 ] 14 0.002% 100.218% ( 9900, 14000 ] 3 0.000% 100.218% ** Level 4 read latency histogram (micros): Count: 138177 Average: 34.9781 StdDev: 271.75 Min: 1 Median: 1.9427 Max: 10483 Percentiles: P50: 1.94 P75: 2.95 P99: 1099.35 P99.9: 3722.86 P99.99: 4542.51 ------------------------------------------------------ [ 0, 1 ] 2538 1.837% 1.837% ( 1, 2 ] 70594 51.090% 52.926% ########## ( 2, 3 ] 32048 23.193% 76.120% ##### ( 3, 4 ] 13657 9.884% 86.003% ## ( 4, 6 ] 12574 9.100% 95.103% ## ( 6, 10 ] 2919 2.113% 97.216% ( 10, 15 ] 523 0.379% 97.594% ( 15, 22 ] 57 0.041% 97.636% ( 22, 34 ] 3 0.002% 97.638% ( 34, 51 ] 7 0.005% 97.643% ( 51, 76 ] 11 0.008% 97.651% ( 76, 110 ] 10 0.007% 97.658% ( 110, 170 ] 47 0.034% 97.692% ( 170, 250 ] 112 0.081% 97.773% ( 250, 380 ] 227 0.164% 97.937% ( 380, 580 ] 453 0.328% 98.265% ( 580, 870 ] 676 0.489% 98.754% ( 870, 1300 ] 636 0.460% 99.215% ( 1300, 1900 ] 437 0.316% 99.531% ( 1900, 2900 ] 365 0.264% 99.795% ( 2900, 4400 ] 264 0.191% 99.986% ( 4400, 6600 ] 80 0.058% 100.044% ( 6600, 9900 ] 10 0.007% 100.051% ( 9900, 14000 ] 1 0.001% 100.052% ** Level 5 read latency histogram (micros): Count: 15229 Average: 1517.2136 StdDev: 1323.00 Min: 90 Median: 1055.0586 Max: 12815 Percentiles: P50: 1055.06 P75: 2033.04 P99: 6330.06 P99.9: 9313.05 P99.99: 9878.43 ------------------------------------------------------ ( 76, 110 ] 10 0.066% 0.066% ( 110, 170 ] 153 1.005% 1.070% ( 170, 250 ] 362 2.377% 3.447% ( 250, 380 ] 937 6.153% 9.600% # ( 380, 580 ] 2000 13.133% 22.733% ### ( 580, 870 ] 2904 19.069% 41.802% #### ( 870, 1300 ] 2901 19.049% 60.851% #### ( 1300, 1900 ] 1921 12.614% 73.465% ### ( 1900, 2900 ] 1757 11.537% 85.002% ## ( 2900, 4400 ] 1622 10.651% 95.653% ## ( 4400, 6600 ] 581 3.815% 99.468% # ( 6600, 9900 ] 80 0.525% 99.993% ( 9900, 14000 ] 4 0.026% 100.020% ** DB Stats ** Uptime(secs): 8.0 total, 7.8 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 123.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:3.905 H:M:S, 48.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 125.60 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:3.905 H:M:S, 49.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/11/19-22:47:23 ... thread 0: (1000000,2000000) ops and (148318.5,137217.1) ops/second in (6.742249,14.575444) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 9/4 1.23 GB 63.0 0.6 0.0 0.6 2.5 1.8 0.0 1.3 36.4 145.7 17.29 7.85 24 0.721 639K 697 0.0 0.0 L1 9/9 574.51 MB 0.0 0.8 0.7 0.2 0.8 0.6 0.0 1.3 118.3 118.1 7.30 3.95 2 3.652 877K 1650 0.0 0.0 L2 1/0 59.25 MB 0.6 0.1 0.1 0.0 0.1 0.1 0.0 1.0 119.3 119.3 0.75 0.41 1 0.753 91K 0 0.0 0.0 L3 18/3 1.18 GB 1.0 5.7 3.4 2.3 5.7 3.4 0.0 1.6 108.2 107.4 53.95 26.92 27 1.998 3744K 8925 0.0 0.0 L4 163/4 9.74 GB 1.0 7.3 4.4 2.9 7.2 4.3 0.6 1.6 122.8 120.4 61.10 34.27 51 1.198 3485K 0 0.0 0.0 L5 1156/0 95.04 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.6 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1356/20 107.81 GB 0.0 14.6 8.6 6.0 16.2 10.3 5.2 8.8 106.3 118.4 140.40 73.39 105 1.337 8838K 11K 0.0 0.0 Int 0/0 0.00 KB 0.0 14.6 8.6 6.0 16.2 10.3 5.2 8.8 106.3 118.4 140.40 73.39 105 1.337 8838K 11K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 14.6 8.6 6.0 14.4 8.4 0.0 0.0 117.9 116.5 126.54 68.02 83 1.525 8838K 11K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 136.4 13.85 5.38 22 0.630 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.7 total, 14.6 interval Flush(GB): cumulative 1.845, interval 1.845 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 16.24 GB write, 1128.22 MB/s write, 14.57 GB read, 1012.70 MB/s read, 140.4 seconds Interval compaction: 16.24 GB write, 1140.58 MB/s write, 14.57 GB read, 1023.80 MB/s read, 140.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 59, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 397175 Average: 10.3945 StdDev: 126.29 Min: 1 Median: 1.8321 Max: 9934 Percentiles: P50: 1.83 P75: 2.75 P99: 11.35 P99.9: 1758.48 P99.99: 3725.31 ------------------------------------------------------ [ 0, 1 ] 18288 4.605% 4.605% # ( 1, 2 ] 216676 54.554% 59.159% ########### ( 2, 3 ] 83747 21.086% 80.244% #### ( 3, 4 ] 34121 8.591% 88.835% ## ( 4, 6 ] 32432 8.166% 97.001% ## ( 6, 10 ] 7568 1.905% 98.907% ( 10, 15 ] 1379 0.347% 99.254% ( 15, 22 ] 170 0.043% 99.297% ( 22, 34 ] 7 0.002% 99.298% ( 34, 51 ] 14 0.004% 99.302% ( 51, 76 ] 16 0.004% 99.306% ( 76, 110 ] 32 0.008% 99.314% ( 110, 170 ] 128 0.032% 99.346% ( 170, 250 ] 207 0.052% 99.398% ( 250, 380 ] 293 0.074% 99.472% ( 380, 580 ] 404 0.102% 99.574% ( 580, 870 ] 572 0.144% 99.718% ( 870, 1300 ] 490 0.123% 99.841% ( 1300, 1900 ] 306 0.077% 99.918% ( 1900, 2900 ] 200 0.050% 99.969% ( 2900, 4400 ] 155 0.039% 100.008% ( 4400, 6600 ] 40 0.010% 100.018% ( 6600, 9900 ] 7 0.002% 100.019% ( 9900, 14000 ] 1 0.000% 100.020% ** Level 1 read latency histogram (micros): Count: 142462 Average: 10.9116 StdDev: 135.66 Min: 1 Median: 1.9292 Max: 8756 Percentiles: P50: 1.93 P75: 2.92 P99: 12.82 P99.9: 2140.38 P99.99: 5375.38 ------------------------------------------------------ [ 0, 1 ] 2979 2.091% 2.091% ( 1, 2 ] 73449 51.557% 53.648% ########## ( 2, 3 ] 33177 23.288% 76.936% ##### ( 3, 4 ] 13498 9.475% 86.411% ## ( 4, 6 ] 14014 9.837% 96.248% ## ( 6, 10 ] 3578 2.512% 98.760% # ( 10, 15 ] 607 0.426% 99.186% ( 15, 22 ] 58 0.041% 99.226% ( 22, 34 ] 6 0.004% 99.231% ( 34, 51 ] 8 0.006% 99.236% ( 51, 76 ] 6 0.004% 99.240% ( 76, 110 ] 17 0.012% 99.252% ( 110, 170 ] 66 0.046% 99.299% ( 170, 250 ] 99 0.069% 99.368% ( 250, 380 ] 124 0.087% 99.455% ( 380, 580 ] 171 0.120% 99.575% ( 580, 870 ] 204 0.143% 99.719% ( 870, 1300 ] 171 0.120% 99.839% ( 1300, 1900 ] 76 0.053% 99.892% ( 1900, 2900 ] 48 0.034% 99.926% ( 2900, 4400 ] 82 0.058% 99.983% ( 4400, 6600 ] 22 0.015% 99.999% ( 6600, 9900 ] 2 0.001% 100.000% ** Level 2 read latency histogram (micros): Count: 792699 Average: 12.3453 StdDev: 152.66 Min: 1 Median: 1.9773 Max: 8822 Percentiles: P50: 1.98 P75: 3.01 P99: 10.92 P99.9: 1135.28 P99.99: 1621.84 ------------------------------------------------------ [ 0, 1 ] 19112 2.411% 2.411% ( 1, 2 ] 385984 48.692% 51.103% ########## ( 2, 3 ] 188684 23.803% 74.906% ##### ( 3, 4 ] 83811 10.573% 85.479% ## ( 4, 6 ] 83302 10.509% 95.988% ## ( 6, 10 ] 23055 2.908% 98.896% # ( 10, 15 ] 4485 0.566% 99.462% ( 15, 22 ] 691 0.087% 99.549% ( 22, 34 ] 118 0.015% 99.564% ( 34, 51 ] 53 0.007% 99.571% ( 51, 76 ] 57 0.007% 99.578% ( 76, 110 ] 32 0.004% 99.582% ( 110, 170 ] 75 0.009% 99.591% ( 170, 250 ] 162 0.020% 99.612% ( 250, 380 ] 314 0.040% 99.651% ( 380, 580 ] 568 0.072% 99.723% ( 580, 870 ] 853 0.108% 99.831% ( 870, 1300 ] 892 0.113% 99.943% ( 1300, 1900 ] 693 0.087% 100.031% ( 1900, 2900 ] 671 0.085% 100.115% ( 2900, 4400 ] 565 0.071% 100.186% ( 4400, 6600 ] 135 0.017% 100.203% ( 6600, 9900 ] 13 0.002% 100.205% ** Level 3 read latency histogram (micros): Count: 1678226 Average: 10.6744 StdDev: 139.20 Min: 0 Median: 1.9615 Max: 11368 Percentiles: P50: 1.96 P75: 2.96 P99: 9.80 P99.9: 930.33 P99.99: 1287.97 ------------------------------------------------------ [ 0, 1 ] 29210 1.741% 1.741% ( 1, 2 ] 842307 50.190% 51.931% ########## ( 2, 3 ] 404664 24.113% 76.043% ##### ( 3, 4 ] 172655 10.288% 86.331% ## ( 4, 6 ] 172687 10.290% 96.621% ## ( 6, 10 ] 42021 2.504% 99.125% # ( 10, 15 ] 7543 0.449% 99.575% ( 15, 22 ] 929 0.055% 99.630% ( 22, 34 ] 75 0.004% 99.634% ( 34, 51 ] 113 0.007% 99.641% ( 51, 76 ] 142 0.008% 99.650% ( 76, 110 ] 45 0.003% 99.652% ( 110, 170 ] 137 0.008% 99.660% ( 170, 250 ] 270 0.016% 99.677% ( 250, 380 ] 566 0.034% 99.710% ( 380, 580 ] 1135 0.068% 99.778% ( 580, 870 ] 1795 0.107% 99.885% ( 870, 1300 ] 1816 0.108% 99.993% ( 1300, 1900 ] 1217 0.073% 100.066% ( 1900, 2900 ] 973 0.058% 100.124% ( 2900, 4400 ] 846 0.050% 100.174% ( 4400, 6600 ] 277 0.017% 100.190% ( 6600, 9900 ] 46 0.003% 100.193% ( 9900, 14000 ] 4 0.000% 100.193% ** Level 4 read latency histogram (micros): Count: 779282 Average: 17.6294 StdDev: 183.36 Min: 1 Median: 1.9562 Max: 10483 Percentiles: P50: 1.96 P75: 2.97 P99: 241.81 P99.9: 1845.66 P99.99: 2730.24 ------------------------------------------------------ [ 0, 1 ] 14423 1.851% 1.851% ( 1, 2 ] 392386 50.352% 52.203% ########## ( 2, 3 ] 183138 23.501% 75.704% ##### ( 3, 4 ] 77991 10.008% 85.712% ## ( 4, 6 ] 78287 10.046% 95.758% ## ( 6, 10 ] 20446 2.624% 98.382% # ( 10, 15 ] 3299 0.423% 98.805% ( 15, 22 ] 399 0.051% 98.856% ( 22, 34 ] 32 0.004% 98.860% ( 34, 51 ] 65 0.008% 98.869% ( 51, 76 ] 88 0.011% 98.880% ( 76, 110 ] 78 0.010% 98.890% ( 110, 170 ] 333 0.043% 98.933% ( 170, 250 ] 584 0.075% 99.008% ( 250, 380 ] 830 0.107% 99.114% ( 380, 580 ] 1375 0.176% 99.291% ( 580, 870 ] 1958 0.251% 99.542% ( 870, 1300 ] 1834 0.235% 99.777% ( 1300, 1900 ] 1052 0.135% 99.912% ( 1900, 2900 ] 730 0.094% 100.006% ( 2900, 4400 ] 648 0.083% 100.089% ( 4400, 6600 ] 211 0.027% 100.116% ( 6600, 9900 ] 38 0.005% 100.121% ( 9900, 14000 ] 1 0.000% 100.121% ** Level 5 read latency histogram (micros): Count: 36477 Average: 1192.9345 StdDev: 1186.55 Min: 79 Median: 800.4677 Max: 12815 Percentiles: P50: 800.47 P75: 1460.04 P99: 6055.45 P99.9: 9087.33 P99.99: 9861.16 ------------------------------------------------------ ( 76, 110 ] 264 0.724% 0.724% ( 110, 170 ] 1582 4.337% 5.061% # ( 170, 250 ] 2215 6.072% 11.133% # ( 250, 380 ] 3273 8.973% 20.106% ## ( 380, 580 ] 5500 15.078% 35.184% ### ( 580, 870 ] 7109 19.489% 54.673% #### ( 870, 1300 ] 6434 17.639% 72.311% #### ( 1300, 1900 ] 3677 10.080% 82.392% ## ( 1900, 2900 ] 2837 7.778% 90.169% ## ( 2900, 4400 ] 2544 6.974% 97.143% # ( 4400, 6600 ] 900 2.467% 99.611% ( 6600, 9900 ] 140 0.384% 99.995% ( 9900, 14000 ] 5 0.014% 100.008% ** DB Stats ** Uptime(secs): 14.7 total, 6.7 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 133.56 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.698 H:M:S, 45.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 145.97 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.793 H:M:S, 41.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 4 num-running-flushes: 1 2024/11/19-22:47:27 ... thread 0: (1000000,3000000) ops and (287605.9,166182.7) ops/second in (3.476980,18.052424) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 16/8 2.21 GB 138.5 1.4 0.0 1.4 4.2 2.8 0.0 1.5 58.8 181.6 23.58 13.56 43 0.548 1407K 1426 0.0 0.0 L1 9/9 574.51 MB 0.0 0.8 0.7 0.2 0.8 0.6 0.0 1.3 118.3 118.1 7.30 3.95 2 3.652 877K 1650 0.0 0.0 L2 1/0 59.25 MB 0.6 0.1 0.1 0.0 0.1 0.1 0.0 1.0 119.3 119.3 0.75 0.41 1 0.753 91K 0 0.0 0.0 L3 15/0 963.59 MB 1.0 5.7 3.4 2.3 5.7 3.4 0.0 1.6 108.2 107.4 53.95 26.92 27 1.998 3744K 8925 0.0 0.0 L4 162/0 9.66 GB 1.0 7.8 4.7 3.1 7.6 4.5 0.6 1.6 125.8 123.4 63.22 36.26 54 1.171 3734K 0 0.0 0.0 L5 1160/0 95.35 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1363/17 108.78 GB 0.0 15.8 8.8 6.9 18.4 11.5 5.5 6.5 108.4 126.5 148.81 81.09 127 1.172 9855K 12K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.8 8.8 6.9 18.4 11.5 5.5 6.5 108.4 126.5 148.81 81.09 127 1.172 9855K 12K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.8 8.8 6.9 15.6 8.6 0.0 0.0 122.5 121.0 131.70 72.93 89 1.480 9855K 12K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 169.3 17.12 8.16 38 0.450 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 18.2 total, 18.1 interval Flush(GB): cumulative 2.830, interval 2.830 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 18.39 GB write, 1033.82 MB/s write, 15.75 GB read, 885.69 MB/s read, 148.8 seconds Interval compaction: 18.39 GB write, 1042.96 MB/s write, 15.75 GB read, 893.52 MB/s read, 148.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 59, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 704355 Average: 9.2024 StdDev: 99.77 Min: 1 Median: 1.6913 Max: 9934 Percentiles: P50: 1.69 P75: 2.44 P99: 150.34 P99.9: 1131.02 P99.99: 2381.35 ------------------------------------------------------ [ 0, 1 ] 76637 10.880% 10.880% ## ( 1, 2 ] 398573 56.587% 67.467% ########### ( 2, 3 ] 121517 17.252% 84.720% ### ( 3, 4 ] 46199 6.559% 91.279% # ( 4, 6 ] 39633 5.627% 96.906% # ( 6, 10 ] 9712 1.379% 98.284% ( 10, 15 ] 1832 0.260% 98.544% ( 15, 22 ] 250 0.035% 98.580% ( 22, 34 ] 19 0.003% 98.583% ( 34, 51 ] 19 0.003% 98.585% ( 51, 76 ] 22 0.003% 98.588% ( 76, 110 ] 759 0.108% 98.696% ( 110, 170 ] 3184 0.452% 99.148% ( 170, 250 ] 1965 0.279% 99.427% ( 250, 380 ] 1100 0.156% 99.583% ( 380, 580 ] 1081 0.153% 99.737% ( 580, 870 ] 817 0.116% 99.853% ( 870, 1300 ] 548 0.078% 99.931% ( 1300, 1900 ] 317 0.045% 99.976% ( 1900, 2900 ] 211 0.030% 100.006% ( 2900, 4400 ] 160 0.023% 100.028% ( 4400, 6600 ] 40 0.006% 100.034% ( 6600, 9900 ] 7 0.001% 100.035% ( 9900, 14000 ] 1 0.000% 100.035% ** Level 1 read latency histogram (micros): Count: 199054 Average: 9.7285 StdDev: 116.77 Min: 1 Median: 1.8872 Max: 8756 Percentiles: P50: 1.89 P75: 2.84 P99: 94.55 P99.9: 1553.43 P99.99: 4609.46 ------------------------------------------------------ [ 0, 1 ] 6452 3.241% 3.241% # ( 1, 2 ] 104907 52.703% 55.944% ########### ( 2, 3 ] 45195 22.705% 78.649% ##### ( 3, 4 ] 17269 8.676% 87.325% ## ( 4, 6 ] 17383 8.733% 96.057% ## ( 6, 10 ] 4832 2.427% 98.485% ( 10, 15 ] 816 0.410% 98.895% ( 15, 22 ] 109 0.055% 98.950% ( 22, 34 ] 13 0.007% 98.956% ( 34, 51 ] 8 0.004% 98.960% ( 51, 76 ] 8 0.004% 98.964% ( 76, 110 ] 131 0.066% 99.030% ( 110, 170 ] 461 0.232% 99.262% ( 170, 250 ] 313 0.157% 99.419% ( 250, 380 ] 233 0.117% 99.536% ( 380, 580 ] 267 0.134% 99.670% ( 580, 870 ] 245 0.123% 99.793% ( 870, 1300 ] 180 0.090% 99.883% ( 1300, 1900 ] 78 0.039% 99.923% ( 1900, 2900 ] 50 0.025% 99.948% ( 2900, 4400 ] 82 0.041% 99.989% ( 4400, 6600 ] 22 0.011% 100.000% ( 6600, 9900 ] 2 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 792892 Average: 12.3931 StdDev: 152.70 Min: 1 Median: 1.9776 Max: 8822 Percentiles: P50: 1.98 P75: 3.01 P99: 11.13 P99.9: 1135.67 P99.99: 1622.69 ------------------------------------------------------ [ 0, 1 ] 19112 2.410% 2.410% ( 1, 2 ] 385984 48.681% 51.091% ########## ( 2, 3 ] 188684 23.797% 74.888% ##### ( 3, 4 ] 83811 10.570% 85.458% ## ( 4, 6 ] 83302 10.506% 95.964% ## ( 6, 10 ] 23055 2.908% 98.872% # ( 10, 15 ] 4485 0.566% 99.438% ( 15, 22 ] 691 0.087% 99.525% ( 22, 34 ] 118 0.015% 99.540% ( 34, 51 ] 53 0.007% 99.546% ( 51, 76 ] 57 0.007% 99.554% ( 76, 110 ] 64 0.008% 99.562% ( 110, 170 ] 156 0.020% 99.581% ( 170, 250 ] 202 0.025% 99.607% ( 250, 380 ] 335 0.042% 99.649% ( 380, 580 ] 582 0.073% 99.722% ( 580, 870 ] 857 0.108% 99.830% ( 870, 1300 ] 892 0.112% 99.943% ( 1300, 1900 ] 693 0.087% 100.030% ( 1900, 2900 ] 672 0.085% 100.115% ( 2900, 4400 ] 565 0.071% 100.186% ( 4400, 6600 ] 135 0.017% 100.203% ( 6600, 9900 ] 13 0.002% 100.205% ** Level 3 read latency histogram (micros): Count: 1717521 Average: 10.5939 StdDev: 137.74 Min: 0 Median: 1.9576 Max: 11368 Percentiles: P50: 1.96 P75: 2.95 P99: 9.85 P99.9: 917.18 P99.99: 1282.79 ------------------------------------------------------ [ 0, 1 ] 30446 1.773% 1.773% ( 1, 2 ] 865025 50.365% 52.137% ########## ( 2, 3 ] 413211 24.059% 76.196% ##### ( 3, 4 ] 175492 10.218% 86.414% ## ( 4, 6 ] 175399 10.212% 96.626% ## ( 6, 10 ] 42400 2.469% 99.095% ( 10, 15 ] 7608 0.443% 99.538% ( 15, 22 ] 937 0.055% 99.592% ( 22, 34 ] 76 0.004% 99.597% ( 34, 51 ] 113 0.007% 99.603% ( 51, 76 ] 142 0.008% 99.612% ( 76, 110 ] 137 0.008% 99.620% ( 110, 170 ] 494 0.029% 99.648% ( 170, 250 ] 445 0.026% 99.674% ( 250, 380 ] 647 0.038% 99.712% ( 380, 580 ] 1201 0.070% 99.782% ( 580, 870 ] 1831 0.107% 99.888% ( 870, 1300 ] 1818 0.106% 99.994% ( 1300, 1900 ] 1217 0.071% 100.065% ( 1900, 2900 ] 975 0.057% 100.122% ( 2900, 4400 ] 846 0.049% 100.171% ( 4400, 6600 ] 277 0.016% 100.187% ( 6600, 9900 ] 46 0.003% 100.190% ( 9900, 14000 ] 4 0.000% 100.190% ** Level 4 read latency histogram (micros): Count: 818564 Average: 18.6846 StdDev: 180.76 Min: 1 Median: 1.9574 Max: 10483 Percentiles: P50: 1.96 P75: 2.98 P99: 344.55 P99.9: 1826.94 P99.99: 2718.25 ------------------------------------------------------ [ 0, 1 ] 15567 1.902% 1.902% ( 1, 2 ] 411233 50.238% 52.140% ########## ( 2, 3 ] 190510 23.274% 75.414% ##### ( 3, 4 ] 80440 9.827% 85.241% ## ( 4, 6 ] 80575 9.843% 95.084% ## ( 6, 10 ] 21207 2.591% 97.675% # ( 10, 15 ] 3370 0.412% 98.087% ( 15, 22 ] 407 0.050% 98.136% ( 22, 34 ] 33 0.004% 98.140% ( 34, 51 ] 66 0.008% 98.148% ( 51, 76 ] 89 0.011% 98.159% ( 76, 110 ] 867 0.106% 98.265% ( 110, 170 ] 2953 0.361% 98.626% ( 170, 250 ] 1934 0.236% 98.862% ( 250, 380 ] 1550 0.189% 99.052% ( 380, 580 ] 1940 0.237% 99.289% ( 580, 870 ] 2187 0.267% 99.556% ( 870, 1300 ] 1883 0.230% 99.786% ( 1300, 1900 ] 1064 0.130% 99.916% ( 1900, 2900 ] 742 0.091% 100.006% ( 2900, 4400 ] 649 0.079% 100.086% ( 4400, 6600 ] 211 0.026% 100.112% ( 6600, 9900 ] 38 0.005% 100.116% ( 9900, 14000 ] 1 0.000% 100.116% ** Level 5 read latency histogram (micros): Count: 75596 Average: 695.2901 StdDev: 964.34 Min: 76 Median: 325.8049 Max: 12815 Percentiles: P50: 325.80 P75: 805.82 P99: 5091.85 P99.9: 8094.50 P99.99: 9698.24 ------------------------------------------------------ ( 51, 76 ] 1 0.001% 0.001% ( 76, 110 ] 5001 6.615% 6.617% # ( 110, 170 ] 17751 23.481% 30.098% ##### ( 170, 250 ] 10601 14.023% 44.121% ### ( 250, 380 ] 7622 10.083% 54.204% ## ( 380, 580 ] 9078 12.009% 66.212% ## ( 580, 870 ] 8532 11.286% 77.499% ## ( 870, 1300 ] 6783 8.973% 86.472% ## ( 1300, 1900 ] 3737 4.943% 91.415% # ( 1900, 2900 ] 2903 3.840% 95.255% # ( 2900, 4400 ] 2549 3.372% 98.627% # ( 4400, 6600 ] 900 1.191% 99.817% ( 6600, 9900 ] 140 0.185% 100.003% ( 9900, 14000 ] 5 0.007% 100.009% ** DB Stats ** Uptime(secs): 18.2 total, 3.5 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 162.10 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.698 H:M:S, 36.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 283.06 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 0 2024/11/19-22:47:30 ... thread 0: (1000000,4000000) ops and (292644.2,186310.4) ops/second in (3.417119,21.469543) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 15/4 2.52 GB 232.9 2.3 0.0 2.3 6.1 3.8 0.0 1.6 79.0 205.7 30.31 19.83 62 0.489 2430K 2404 0.0 0.0 L1 11/0 1.17 GB 119.9 2.0 1.3 0.8 2.0 1.3 0.0 1.6 136.5 136.0 15.15 9.77 3 5.050 2100K 6799 0.0 0.0 L2 1/0 59.25 MB 0.6 0.1 0.1 0.0 0.1 0.1 0.0 1.0 119.3 119.3 0.75 0.41 1 0.753 91K 0 0.0 0.0 L3 15/0 963.59 MB 1.0 5.7 3.4 2.3 5.7 3.4 0.0 1.6 108.2 107.4 53.95 26.92 27 1.998 3744K 8925 0.0 0.0 L4 162/0 9.66 GB 1.0 7.8 4.7 3.1 7.6 4.5 0.6 1.6 125.8 123.4 63.22 36.26 54 1.171 3734K 0 0.0 0.0 L5 1160/0 95.35 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1364/4 109.70 GB 0.0 17.9 9.5 8.5 21.5 13.0 5.5 5.7 112.3 134.5 163.39 93.18 147 1.111 12M 18K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.9 9.5 8.5 21.5 13.0 5.5 5.7 112.3 134.5 163.39 93.18 147 1.111 12M 18K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.9 9.5 8.5 17.7 9.2 0.0 0.0 127.9 126.5 143.40 82.53 94 1.526 12M 18K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 192.3 19.98 10.65 53 0.377 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 21.6 total, 21.5 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 21.47 GB write, 1016.16 MB/s write, 17.91 GB read, 848.04 MB/s read, 163.4 seconds Interval compaction: 21.47 GB write, 1023.72 MB/s write, 17.91 GB read, 854.35 MB/s read, 163.4 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 59, interval: 59 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 990652 Average: 7.8812 StdDev: 85.84 Min: 0 Median: 1.6026 Max: 9934 Percentiles: P50: 1.60 P75: 2.15 P99: 138.96 P99.9: 861.68 P99.99: 1849.09 ------------------------------------------------------ [ 0, 1 ] 154002 15.546% 15.546% ### ( 1, 2 ] 566443 57.179% 72.724% ########### ( 2, 3 ] 146174 14.755% 87.480% ### ( 3, 4 ] 53461 5.397% 92.876% # ( 4, 6 ] 43939 4.435% 97.312% # ( 6, 10 ] 10903 1.101% 98.412% ( 10, 15 ] 2138 0.216% 98.628% ( 15, 22 ] 298 0.030% 98.658% ( 22, 34 ] 22 0.002% 98.660% ( 34, 51 ] 19 0.002% 98.662% ( 51, 76 ] 25 0.003% 98.665% ( 76, 110 ] 1127 0.114% 98.778% ( 110, 170 ] 4549 0.459% 99.238% ( 170, 250 ] 2795 0.282% 99.520% ( 250, 380 ] 1478 0.149% 99.669% ( 380, 580 ] 1387 0.140% 99.809% ( 580, 870 ] 929 0.094% 99.903% ( 870, 1300 ] 573 0.058% 99.961% ( 1300, 1900 ] 319 0.032% 99.993% ( 1900, 2900 ] 215 0.022% 100.015% ( 2900, 4400 ] 161 0.016% 100.031% ( 4400, 6600 ] 40 0.004% 100.035% ( 6600, 9900 ] 7 0.001% 100.036% ( 9900, 14000 ] 1 0.000% 100.036% ** Level 1 read latency histogram (micros): Count: 221318 Average: 9.5407 StdDev: 111.69 Min: 0 Median: 1.8668 Max: 8756 Percentiles: P50: 1.87 P75: 2.80 P99: 123.64 P99.9: 1401.35 P99.99: 4397.59 ------------------------------------------------------ [ 0, 1 ] 8070 3.646% 3.646% # ( 1, 2 ] 118354 53.477% 57.123% ########### ( 2, 3 ] 49400 22.321% 79.444% #### ( 3, 4 ] 18328 8.281% 87.725% ## ( 4, 6 ] 18284 8.261% 95.987% ## ( 6, 10 ] 5275 2.383% 98.370% ( 10, 15 ] 867 0.392% 98.762% ( 15, 22 ] 119 0.054% 98.816% ( 22, 34 ] 14 0.006% 98.822% ( 34, 51 ] 8 0.004% 98.826% ( 51, 76 ] 8 0.004% 98.829% ( 76, 110 ] 225 0.102% 98.931% ( 110, 170 ] 672 0.304% 99.235% ( 170, 250 ] 404 0.183% 99.417% ( 250, 380 ] 295 0.133% 99.550% ( 380, 580 ] 313 0.141% 99.692% ( 580, 870 ] 261 0.118% 99.810% ( 870, 1300 ] 186 0.084% 99.894% ( 1300, 1900 ] 81 0.037% 99.930% ( 1900, 2900 ] 50 0.023% 99.953% ( 2900, 4400 ] 82 0.037% 99.990% ( 4400, 6600 ] 22 0.010% 100.000% ( 6600, 9900 ] 2 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 793124 Average: 12.4405 StdDev: 152.71 Min: 1 Median: 1.9779 Max: 8822 Percentiles: P50: 1.98 P75: 3.01 P99: 11.39 P99.9: 1135.56 P99.99: 1622.67 ------------------------------------------------------ [ 0, 1 ] 19112 2.410% 2.410% ( 1, 2 ] 385984 48.666% 51.076% ########## ( 2, 3 ] 188684 23.790% 74.866% ##### ( 3, 4 ] 83811 10.567% 85.433% ## ( 4, 6 ] 83302 10.503% 95.936% ## ( 6, 10 ] 23055 2.907% 98.843% # ( 10, 15 ] 4485 0.565% 99.409% ( 15, 22 ] 691 0.087% 99.496% ( 22, 34 ] 118 0.015% 99.511% ( 34, 51 ] 53 0.007% 99.517% ( 51, 76 ] 57 0.007% 99.524% ( 76, 110 ] 121 0.015% 99.540% ( 110, 170 ] 254 0.032% 99.572% ( 170, 250 ] 249 0.031% 99.603% ( 250, 380 ] 350 0.044% 99.647% ( 380, 580 ] 595 0.075% 99.722% ( 580, 870 ] 859 0.108% 99.831% ( 870, 1300 ] 892 0.112% 99.943% ( 1300, 1900 ] 693 0.087% 100.030% ( 1900, 2900 ] 672 0.085% 100.115% ( 2900, 4400 ] 565 0.071% 100.186% ( 4400, 6600 ] 135 0.017% 100.203% ( 6600, 9900 ] 13 0.002% 100.205% ** Level 3 read latency histogram (micros): Count: 1718443 Average: 10.6952 StdDev: 137.81 Min: 0 Median: 1.9581 Max: 11368 Percentiles: P50: 1.96 P75: 2.95 P99: 9.93 P99.9: 917.41 P99.99: 1283.02 ------------------------------------------------------ [ 0, 1 ] 30446 1.772% 1.772% ( 1, 2 ] 865025 50.338% 52.109% ########## ( 2, 3 ] 413211 24.046% 76.155% ##### ( 3, 4 ] 175492 10.212% 86.367% ## ( 4, 6 ] 175399 10.207% 96.574% ## ( 6, 10 ] 42400 2.467% 99.042% ( 10, 15 ] 7608 0.443% 99.484% ( 15, 22 ] 937 0.055% 99.539% ( 22, 34 ] 76 0.004% 99.543% ( 34, 51 ] 113 0.007% 99.550% ( 51, 76 ] 142 0.008% 99.558% ( 76, 110 ] 284 0.017% 99.575% ( 110, 170 ] 909 0.053% 99.628% ( 170, 250 ] 625 0.036% 99.664% ( 250, 380 ] 733 0.043% 99.707% ( 380, 580 ] 1273 0.074% 99.781% ( 580, 870 ] 1851 0.108% 99.888% ( 870, 1300 ] 1819 0.106% 99.994% ( 1300, 1900 ] 1218 0.071% 100.065% ( 1900, 2900 ] 975 0.057% 100.122% ( 2900, 4400 ] 846 0.049% 100.171% ( 4400, 6600 ] 277 0.016% 100.187% ( 6600, 9900 ] 46 0.003% 100.190% ( 9900, 14000 ] 4 0.000% 100.190% ** Level 4 read latency histogram (micros): Count: 826170 Average: 20.3002 StdDev: 181.30 Min: 1 Median: 1.9665 Max: 10483 Percentiles: P50: 1.97 P75: 3.03 P99: 402.89 P99.9: 1824.20 P99.99: 2717.72 ------------------------------------------------------ [ 0, 1 ] 15567 1.884% 1.884% ( 1, 2 ] 411279 49.781% 51.666% ########## ( 2, 3 ] 190611 23.072% 74.737% ##### ( 3, 4 ] 80526 9.747% 84.484% ## ( 4, 6 ] 80668 9.764% 94.248% ## ( 6, 10 ] 21215 2.568% 96.816% # ( 10, 15 ] 3374 0.408% 97.225% ( 15, 22 ] 407 0.049% 97.274% ( 22, 34 ] 34 0.004% 97.278% ( 34, 51 ] 66 0.008% 97.286% ( 51, 76 ] 91 0.011% 97.297% ( 76, 110 ] 2080 0.252% 97.549% ( 110, 170 ] 6268 0.759% 98.307% ( 170, 250 ] 3271 0.396% 98.703% ( 250, 380 ] 2164 0.262% 98.965% ( 380, 580 ] 2510 0.304% 99.269% ( 580, 870 ] 2362 0.286% 99.555% ( 870, 1300 ] 1916 0.232% 99.787% ( 1300, 1900 ] 1070 0.130% 99.916% ( 1900, 2900 ] 744 0.090% 100.006% ( 2900, 4400 ] 649 0.079% 100.085% ( 4400, 6600 ] 211 0.026% 100.111% ( 6600, 9900 ] 38 0.005% 100.115% ( 9900, 14000 ] 1 0.000% 100.115% ** Level 5 read latency histogram (micros): Count: 119691 Average: 513.5306 StdDev: 807.55 Min: 74 Median: 211.0885 Max: 12815 Percentiles: P50: 211.09 P75: 530.86 P99: 4305.42 P99.9: 6984.43 P99.99: 9523.59 ------------------------------------------------------ ( 51, 76 ] 7 0.006% 0.006% ( 76, 110 ] 12431 10.386% 10.392% ## ( 110, 170 ] 37744 31.535% 41.926% ###### ( 170, 250 ] 18815 15.720% 57.646% ### ( 250, 380 ] 11523 9.627% 67.273% ## ( 380, 580 ] 12261 10.244% 77.517% ## ( 580, 870 ] 9651 8.063% 85.580% ## ( 870, 1300 ] 6993 5.843% 91.423% # ( 1300, 1900 ] 3762 3.143% 94.566% # ( 1900, 2900 ] 2916 2.436% 97.002% ( 2900, 4400 ] 2552 2.132% 99.134% ( 4400, 6600 ] 900 0.752% 99.886% ( 6600, 9900 ] 140 0.117% 100.003% ( 9900, 14000 ] 5 0.004% 100.008% ** DB Stats ** Uptime(secs): 21.6 total, 3.4 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 181.99 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.698 H:M:S, 31.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 288.03 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/11/19-22:47:34 ... thread 0: (1000000,5000000) ops and (284162.7,200090.8) ops/second in (3.519111,24.988654) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/4 3.50 GB 333.6 3.3 0.0 3.3 8.1 4.7 0.0 1.7 91.3 221.4 37.27 26.30 82 0.454 3454K 3397 0.0 0.0 L1 11/0 1.17 GB 119.9 2.0 1.3 0.8 2.0 1.3 0.0 1.6 136.5 136.0 15.15 9.77 3 5.050 2100K 6799 0.0 0.0 L2 1/0 59.25 MB 0.6 0.1 0.1 0.0 0.1 0.1 0.0 1.0 119.3 119.3 0.75 0.41 1 0.753 91K 0 0.0 0.0 L3 15/0 963.59 MB 1.0 5.7 3.4 2.3 5.7 3.4 0.0 1.6 108.2 107.4 53.95 26.92 27 1.998 3744K 8925 0.0 0.0 L4 162/0 9.66 GB 1.0 7.8 4.7 3.1 7.6 4.5 0.6 1.6 125.8 123.4 63.22 36.26 54 1.171 3734K 0 0.0 0.0 L5 1160/0 95.35 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1368/4 110.68 GB 0.0 18.9 9.5 9.4 23.4 14.0 5.5 4.9 113.6 140.9 170.34 99.66 167 1.020 13M 19K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.9 9.5 9.4 23.4 14.0 5.5 4.9 113.6 140.9 170.34 99.66 167 1.020 13M 19K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.9 9.5 9.4 18.7 9.2 0.0 0.0 131.4 130.0 147.26 86.31 98 1.503 13M 19K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 210.2 23.08 13.35 69 0.334 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 25.2 total, 25.0 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 23.43 GB write, 954.09 MB/s write, 18.90 GB read, 769.46 MB/s read, 170.3 seconds Interval compaction: 23.43 GB write, 960.19 MB/s write, 18.90 GB read, 774.38 MB/s read, 170.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 1, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 1, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 59, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 1, total-stops: 59, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1263673 Average: 7.1346 StdDev: 77.22 Min: 0 Median: 1.5453 Max: 9934 Percentiles: P50: 1.55 P75: 1.98 P99: 133.35 P99.9: 765.11 P99.99: 1658.58 ------------------------------------------------------ [ 0, 1 ] 238764 18.894% 18.894% #### ( 1, 2 ] 720860 57.045% 75.939% ########### ( 2, 3 ] 165460 13.094% 89.033% ### ( 3, 4 ] 60014 4.749% 93.782% # ( 4, 6 ] 47513 3.760% 97.542% # ( 6, 10 ] 11740 0.929% 98.471% ( 10, 15 ] 2360 0.187% 98.658% ( 15, 22 ] 319 0.025% 98.683% ( 22, 34 ] 25 0.002% 98.685% ( 34, 51 ] 22 0.002% 98.687% ( 51, 76 ] 42 0.003% 98.690% ( 76, 110 ] 1567 0.124% 98.814% ( 110, 170 ] 6038 0.478% 99.292% ( 170, 250 ] 3640 0.288% 99.580% ( 250, 380 ] 1801 0.143% 99.722% ( 380, 580 ] 1599 0.127% 99.849% ( 580, 870 ] 1011 0.080% 99.929% ( 870, 1300 ] 578 0.046% 99.975% ( 1300, 1900 ] 324 0.026% 100.000% ( 1900, 2900 ] 218 0.017% 100.018% ( 2900, 4400 ] 162 0.013% 100.030% ( 4400, 6600 ] 40 0.003% 100.034% ( 6600, 9900 ] 7 0.001% 100.034% ( 9900, 14000 ] 1 0.000% 100.034% ** Level 1 read latency histogram (micros): Count: 222623 Average: 10.0859 StdDev: 112.05 Min: 0 Median: 1.8718 Max: 8756 Percentiles: P50: 1.87 P75: 2.82 P99: 152.00 P99.9: 1391.68 P99.99: 4395.20 ------------------------------------------------------ [ 0, 1 ] 8072 3.626% 3.626% # ( 1, 2 ] 118426 53.196% 56.822% ########### ( 2, 3 ] 49645 22.300% 79.122% #### ( 3, 4 ] 18468 8.296% 87.417% ## ( 4, 6 ] 18416 8.272% 95.690% ## ( 6, 10 ] 5301 2.381% 98.071% ( 10, 15 ] 872 0.392% 98.462% ( 15, 22 ] 120 0.054% 98.516% ( 22, 34 ] 14 0.006% 98.523% ( 34, 51 ] 8 0.004% 98.526% ( 51, 76 ] 8 0.004% 98.530% ( 76, 110 ] 351 0.158% 98.687% ( 110, 170 ] 994 0.446% 99.134% ( 170, 250 ] 524 0.235% 99.369% ( 250, 380 ] 342 0.154% 99.523% ( 380, 580 ] 361 0.162% 99.685% ( 580, 870 ] 279 0.125% 99.810% ( 870, 1300 ] 187 0.084% 99.894% ( 1300, 1900 ] 81 0.036% 99.931% ( 1900, 2900 ] 50 0.022% 99.953% ( 2900, 4400 ] 82 0.037% 99.990% ( 4400, 6600 ] 22 0.010% 100.000% ( 6600, 9900 ] 2 0.001% 100.001% ** Level 2 read latency histogram (micros): Count: 793356 Average: 12.4905 StdDev: 152.73 Min: 1 Median: 1.9782 Max: 8822 Percentiles: P50: 1.98 P75: 3.01 P99: 11.64 P99.9: 1135.63 P99.99: 1622.65 ------------------------------------------------------ [ 0, 1 ] 19112 2.409% 2.409% ( 1, 2 ] 385984 48.652% 51.061% ########## ( 2, 3 ] 188684 23.783% 74.844% ##### ( 3, 4 ] 83811 10.564% 85.408% ## ( 4, 6 ] 83302 10.500% 95.908% ## ( 6, 10 ] 23055 2.906% 98.814% # ( 10, 15 ] 4485 0.565% 99.379% ( 15, 22 ] 691 0.087% 99.467% ( 22, 34 ] 118 0.015% 99.481% ( 34, 51 ] 53 0.007% 99.488% ( 51, 76 ] 58 0.007% 99.495% ( 76, 110 ] 170 0.021% 99.517% ( 110, 170 ] 366 0.046% 99.563% ( 170, 250 ] 280 0.035% 99.598% ( 250, 380 ] 369 0.047% 99.645% ( 380, 580 ] 611 0.077% 99.722% ( 580, 870 ] 862 0.109% 99.830% ( 870, 1300 ] 893 0.113% 99.943% ( 1300, 1900 ] 693 0.087% 100.030% ( 1900, 2900 ] 672 0.085% 100.115% ( 2900, 4400 ] 565 0.071% 100.186% ( 4400, 6600 ] 135 0.017% 100.203% ( 6600, 9900 ] 13 0.002% 100.205% ** Level 3 read latency histogram (micros): Count: 1719414 Average: 10.7930 StdDev: 137.86 Min: 0 Median: 1.9587 Max: 11368 Percentiles: P50: 1.96 P75: 2.95 P99: 10.16 P99.9: 917.60 P99.99: 1283.01 ------------------------------------------------------ [ 0, 1 ] 30446 1.771% 1.771% ( 1, 2 ] 865025 50.309% 52.080% ########## ( 2, 3 ] 413211 24.032% 76.112% ##### ( 3, 4 ] 175492 10.207% 86.319% ## ( 4, 6 ] 175399 10.201% 96.520% ## ( 6, 10 ] 42400 2.466% 98.986% ( 10, 15 ] 7608 0.442% 99.428% ( 15, 22 ] 937 0.054% 99.483% ( 22, 34 ] 76 0.004% 99.487% ( 34, 51 ] 113 0.007% 99.494% ( 51, 76 ] 143 0.008% 99.502% ( 76, 110 ] 485 0.028% 99.530% ( 110, 170 ] 1380 0.080% 99.610% ( 170, 250 ] 781 0.045% 99.656% ( 250, 380 ] 797 0.046% 99.702% ( 380, 580 ] 1329 0.077% 99.779% ( 580, 870 ] 1871 0.109% 99.888% ( 870, 1300 ] 1821 0.106% 99.994% ( 1300, 1900 ] 1218 0.071% 100.065% ( 1900, 2900 ] 975 0.057% 100.122% ( 2900, 4400 ] 846 0.049% 100.171% ( 4400, 6600 ] 277 0.016% 100.187% ( 6600, 9900 ] 46 0.003% 100.190% ( 9900, 14000 ] 4 0.000% 100.190% ** Level 4 read latency histogram (micros): Count: 834642 Average: 21.9675 StdDev: 181.75 Min: 1 Median: 1.9768 Max: 10483 Percentiles: P50: 1.98 P75: 3.11 P99: 437.15 P99.9: 1825.97 P99.99: 2720.34 ------------------------------------------------------ [ 0, 1 ] 15567 1.865% 1.865% ( 1, 2 ] 411290 49.277% 51.143% ########## ( 2, 3 ] 190638 22.841% 73.983% ##### ( 3, 4 ] 80547 9.650% 83.634% ## ( 4, 6 ] 80684 9.667% 93.301% ## ( 6, 10 ] 21219 2.542% 95.843% # ( 10, 15 ] 3374 0.404% 96.247% ( 15, 22 ] 407 0.049% 96.296% ( 22, 34 ] 34 0.004% 96.300% ( 34, 51 ] 66 0.008% 96.308% ( 51, 76 ] 92 0.011% 96.319% ( 76, 110 ] 3748 0.449% 96.768% ( 110, 170 ] 10364 1.242% 98.010% ( 170, 250 ] 4672 0.560% 98.569% ( 250, 380 ] 2742 0.329% 98.898% ( 380, 580 ] 2980 0.357% 99.255% ( 580, 870 ] 2505 0.300% 99.555% ( 870, 1300 ] 1936 0.232% 99.787% ( 1300, 1900 ] 1075 0.129% 99.916% ( 1900, 2900 ] 754 0.090% 100.006% ( 2900, 4400 ] 650 0.078% 100.084% ( 4400, 6600 ] 211 0.025% 100.109% ( 6600, 9900 ] 38 0.005% 100.114% ( 9900, 14000 ] 1 0.000% 100.114% ** Level 5 read latency histogram (micros): Count: 167988 Average: 418.9772 StdDev: 701.43 Min: 74 Median: 171.6949 Max: 12815 Percentiles: P50: 171.69 P75: 393.43 P99: 4020.81 P99.9: 6516.92 P99.99: 9362.60 ------------------------------------------------------ ( 51, 76 ] 12 0.007% 0.007% ( 76, 110 ] 22093 13.152% 13.159% ### ( 110, 170 ] 61323 36.504% 49.663% ####### ( 170, 250 ] 26716 15.904% 65.567% ### ( 250, 380 ] 14829 8.827% 74.394% ## ( 380, 580 ] 15165 9.027% 83.421% ## ( 580, 870 ] 10449 6.220% 89.642% # ( 870, 1300 ] 7093 4.222% 93.864% # ( 1300, 1900 ] 3780 2.250% 96.114% ( 1900, 2900 ] 2939 1.750% 97.864% ( 2900, 4400 ] 2555 1.521% 99.384% ( 4400, 6600 ] 900 0.536% 99.920% ( 6600, 9900 ] 140 0.083% 100.004% ( 9900, 14000 ] 5 0.003% 100.007% ** DB Stats ** Uptime(secs): 25.2 total, 3.5 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 195.66 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.794 H:M:S, 27.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 279.67 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.096 H:M:S, 2.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 252.757 micros/op 15800 ops/sec 60.187 seconds 950996 operations; 15.3 MB/s (226999 of 226999 found) Microseconds per read: Count: 950996 Average: 252.7593 StdDev: 702.10 Min: 2 Median: 173.9554 Max: 74644 Percentiles: P50: 173.96 P75: 234.20 P99: 1521.25 P99.9: 11533.01 P99.99: 28161.82 ------------------------------------------------------ ( 1, 2 ] 7 0.001% 0.001% ( 2, 3 ] 44 0.005% 0.005% ( 3, 4 ] 45 0.005% 0.010% ( 4, 6 ] 109 0.011% 0.022% ( 6, 10 ] 344 0.036% 0.058% ( 10, 15 ] 3062 0.322% 0.380% ( 15, 22 ] 4907 0.516% 0.896% ( 22, 34 ] 8961 0.942% 1.838% ( 34, 51 ] 2857 0.300% 2.138% ( 51, 76 ] 383 0.040% 2.179% ( 76, 110 ] 18585 1.954% 4.133% ( 110, 170 ] 420585 44.226% 48.359% ######### ( 170, 250 ] 315700 33.197% 81.555% ####### ( 250, 380 ] 99273 10.439% 91.994% ## ( 380, 580 ] 39324 4.135% 96.129% # ( 580, 870 ] 17094 1.797% 97.927% ( 870, 1300 ] 8675 0.912% 98.839% ( 1300, 1900 ] 4152 0.437% 99.276% ( 1900, 2900 ] 2731 0.287% 99.563% ( 2900, 4400 ] 2077 0.218% 99.781% ( 4400, 6600 ] 695 0.073% 99.854% ( 6600, 9900 ] 249 0.026% 99.880% ( 9900, 14000 ] 467 0.049% 99.930% ( 14000, 22000 ] 506 0.053% 99.983% ( 22000, 33000 ] 123 0.013% 99.996% ( 33000, 50000 ] 32 0.003% 99.999% ( 50000, 75000 ] 9 0.001% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 18643846 rocksdb.bloom.filter.full.positive COUNT : 1132359 rocksdb.bloom.filter.full.true.positive COUNT : 950566 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 430 rocksdb.memtable.miss COUNT : 950566 rocksdb.l0.hit COUNT : 33907 rocksdb.l1.hit COUNT : 10400 rocksdb.l2andup.hit COUNT : 906259 rocksdb.compaction.key.drop.new COUNT : 258071 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5397475 rocksdb.number.keys.read COUNT : 950996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5570194200 rocksdb.bytes.read COUNT : 950996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1666 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 39440993 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 23063097424 rocksdb.compact.write.bytes COUNT : 22804352434 rocksdb.flush.write.bytes COUNT : 5548948372 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 28 rocksdb.number.superversion_acquires COUNT : 1128 rocksdb.number.superversion_releases COUNT : 1096 rocksdb.number.superversion_cleanups COUNT : 283 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 293 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5504088064 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2027520 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 27730554989 rocksdb.non.last.level.read.count COUNT : 6558566 rocksdb.block.checksum.compute.count COUNT : 6732888 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 172.384769 P95 : 524.483844 P99 : 1519.895016 P100 : 74643.000000 COUNT : 950996 SUM : 239562205 rocksdb.db.write.micros P50 : 1.549659 P95 : 4.597302 P99 : 9.696091 P100 : 925972.000000 COUNT : 5397475 SUM : 53250311 rocksdb.compaction.times.micros P50 : 1270000.000000 P95 : 2800000.000000 P99 : 6500000.000000 P100 : 7846200.000000 COUNT : 100 SUM : 149120999 rocksdb.compaction.times.cpu_micros P50 : 828478.260870 P95 : 1637500.000000 P99 : 2900000.000000 P100 : 5822514.000000 COUNT : 100 SUM : 88138259 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 827.352941 P95 : 218000.000000 P99 : 416216.000000 P100 : 416216.000000 COUNT : 76 SUM : 1806588 rocksdb.compaction.outfile.sync.micros P50 : 68382.352941 P95 : 241741.935484 P99 : 356080.000000 P100 : 566296.000000 COUNT : 284 SUM : 23655180 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 754.000000 P95 : 4047.058824 P99 : 6160.000000 P100 : 6692.000000 COUNT : 200 SUM : 243293 rocksdb.table.open.io.micros P50 : 8734.090909 P95 : 19123.720930 P99 : 21603.348837 P100 : 24716.000000 COUNT : 1666 SUM : 14509743 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.978945 P95 : 10.538577 P99 : 162.076262 P100 : 11371.000000 COUNT : 5587275 SUM : 80717528 rocksdb.read.block.get.micros P50 : 137.241341 P95 : 395.652961 P99 : 1357.388021 P100 : 13349.000000 COUNT : 1143958 SUM : 203874015 rocksdb.write.raw.block.micros P50 : 0.519965 P95 : 0.987934 P99 : 3.648196 P100 : 16560.000000 COUNT : 6867478 SUM : 19931728 rocksdb.numfiles.in.singlecompaction P50 : 2.393939 P95 : 3.917949 P99 : 13.800000 P100 : 28.000000 COUNT : 124 SUM : 395 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.580252 P95 : 2058.142041 P99 : 2733.007867 P100 : 925795.000000 COUNT : 156552 SUM : 39458894 rocksdb.sst.read.micros P50 : 2.094312 P95 : 162.314972 P99 : 482.576581 P100 : 12815.000000 COUNT : 6558605 SUM : 267879075 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 950996 SUM : 950996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5397475 SUM : 5570194200 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 224285.714286 P95 : 984666.666667 P99 : 1156933.333333 P100 : 1174940.000000 COUNT : 76 SUM : 24522416 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 301 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0