[2024-12-15 23:41:14.712877] Starting SPDK v25.01-pre git sha1 e01cb43b8 / DPDK 24.03.0 initialization... [2024-12-15 23:41:14.713015] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=lib.power:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1709917 ] Set seed to 1734302474709391 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-15 23:41:14.827446] app.c: 919:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-15 23:41:14.933152] app.c: 612:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-15 23:41:14.933198] app.c: 613:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1709917' to capture a snapshot of events at runtime. [2024-12-15 23:41:14.933213] app.c: 618:app_setup_trace: *NOTICE*: 'spdk_trace' without parameters will also work if this is the only [2024-12-15 23:41:14.933224] app.c: 619:app_setup_trace: *NOTICE*: SPDK application currently running. [2024-12-15 23:41:14.933232] app.c: 620:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1709917 for offline analysis/debug. [2024-12-15 23:41:14.934657] reactor.c: 995:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sun Dec 15 23:41:23 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/15-23:41:27 ... thread 0: (1000000,1000000) ops and (231553.8,231553.8) ops/second in (4.318650,4.318650) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/13 2.86 GB 31.5 0.3 0.0 0.3 1.2 0.9 0.0 1.4 62.0 235.6 5.08 3.62 13 0.391 319K 366 0.0 0.0 L1 12/12 1.46 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/0 972.97 MB 1.0 0.2 0.1 0.1 0.2 0.1 0.0 1.8 151.4 149.6 1.57 1.06 1 1.565 130K 0 0.0 0.0 L4 175/0 9.75 GB 1.0 1.1 0.7 0.4 1.0 0.6 0.0 1.6 140.8 138.4 7.65 5.07 8 0.956 316K 0 0.0 0.0 L5 1112/0 91.41 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1332/25 106.43 GB 0.0 1.6 0.8 0.8 2.4 1.6 1.0 2.8 114.0 174.1 14.30 9.75 22 0.650 767K 366 0.0 0.0 Int 0/0 0.00 KB 0.0 1.6 0.8 0.8 2.4 1.6 1.0 2.8 114.0 174.1 14.30 9.75 22 0.650 767K 366 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 1.6 0.8 0.8 1.6 0.8 0.0 0.0 156.3 154.2 10.43 7.30 10 1.043 767K 366 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.9 0.9 0.0 0.0 0.0 227.9 3.87 2.45 12 0.323 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 4.5 total, 4.3 interval Flush(GB): cumulative 0.861, interval 0.861 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 2.43 GB write, 551.52 MB/s write, 1.59 GB read, 360.92 MB/s read, 14.3 seconds Interval compaction: 2.43 GB write, 576.27 MB/s write, 1.59 GB read, 377.12 MB/s read, 14.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 349057 Average: 6.0188 StdDev: 92.79 Min: 1 Median: 1.6635 Max: 22498 Percentiles: P50: 1.66 P75: 2.22 P99: 9.08 P99.9: 938.15 P99.99: 2264.59 ------------------------------------------------------ [ 0, 1 ] 30833 8.833% 8.833% ## ( 1, 2 ] 216569 62.044% 70.877% ############ ( 2, 3 ] 66785 19.133% 90.010% #### ( 3, 4 ] 13913 3.986% 93.996% # ( 4, 6 ] 13624 3.903% 97.899% # ( 6, 10 ] 4991 1.430% 99.329% ( 10, 15 ] 928 0.266% 99.595% ( 15, 22 ] 123 0.035% 99.630% ( 22, 34 ] 11 0.003% 99.633% ( 34, 51 ] 3 0.001% 99.634% ( 51, 76 ] 2 0.001% 99.635% ( 76, 110 ] 18 0.005% 99.640% ( 110, 170 ] 151 0.043% 99.683% ( 170, 250 ] 187 0.054% 99.737% ( 250, 380 ] 167 0.048% 99.785% ( 380, 580 ] 184 0.053% 99.837% ( 580, 870 ] 194 0.056% 99.893% ( 870, 1300 ] 170 0.049% 99.942% ( 1300, 1900 ] 135 0.039% 99.980% ( 1900, 2900 ] 99 0.028% 100.009% ( 2900, 4400 ] 50 0.014% 100.023% ( 4400, 6600 ] 10 0.003% 100.026% ( 6600, 9900 ] 6 0.002% 100.028% ( 22000, 33000 ] 1 0.000% 100.028% ** Level 1 read latency histogram (micros): Count: 186 Average: 1926.2151 StdDev: 3083.13 Min: 95 Median: 467.5000 Max: 21354 Percentiles: P50: 467.50 P75: 2150.00 P99: 14560.00 P99.9: 21256.00 P99.99: 21354.00 ------------------------------------------------------ ( 76, 110 ] 5 2.688% 2.688% # ( 110, 170 ] 20 10.753% 13.441% ## ( 170, 250 ] 32 17.204% 30.645% ### ( 250, 380 ] 29 15.591% 46.237% ### ( 380, 580 ] 16 8.602% 54.839% ## ( 580, 870 ] 15 8.065% 62.903% ## ( 870, 1300 ] 15 8.065% 70.968% ## ( 1300, 1900 ] 6 3.226% 74.194% # ( 1900, 2900 ] 6 3.226% 77.419% # ( 2900, 4400 ] 7 3.763% 81.183% # ( 4400, 6600 ] 17 9.140% 90.323% ## ( 6600, 9900 ] 16 8.602% 98.925% ## ( 14000, 22000 ] 2 1.075% 100.000% ** Level 2 read latency histogram (micros): Count: 32708 Average: 7.8685 StdDev: 116.35 Min: 1 Median: 1.7572 Max: 6971 Percentiles: P50: 1.76 P75: 2.58 P99: 9.93 P99.9: 1794.06 P99.99: 5351.06 ------------------------------------------------------ [ 0, 1 ] 1950 5.962% 5.962% # ( 1, 2 ] 19023 58.160% 64.122% ############ ( 2, 3 ] 6117 18.702% 82.824% #### ( 3, 4 ] 2181 6.668% 89.492% # ( 4, 6 ] 2381 7.280% 96.771% # ( 6, 10 ] 742 2.269% 99.040% ( 10, 15 ] 176 0.538% 99.578% ( 15, 22 ] 17 0.052% 99.630% ( 22, 34 ] 2 0.006% 99.636% ( 51, 76 ] 1 0.003% 99.639% ( 110, 170 ] 4 0.012% 99.651% ( 170, 250 ] 5 0.015% 99.667% ( 250, 380 ] 12 0.037% 99.703% ( 380, 580 ] 13 0.040% 99.743% ( 580, 870 ] 22 0.067% 99.810% ( 870, 1300 ] 12 0.037% 99.847% ( 1300, 1900 ] 21 0.064% 99.911% ( 1900, 2900 ] 16 0.049% 99.960% ( 2900, 4400 ] 8 0.024% 99.985% ( 4400, 6600 ] 4 0.012% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 78263 Average: 7.0577 StdDev: 101.39 Min: 0 Median: 1.8258 Max: 6641 Percentiles: P50: 1.83 P75: 2.67 P99: 9.05 P99.9: 1023.79 P99.99: 2073.90 ------------------------------------------------------ [ 0, 1 ] 2698 3.447% 3.447% # ( 1, 2 ] 44120 56.374% 59.821% ########### ( 2, 3 ] 17840 22.795% 82.616% ##### ( 3, 4 ] 5927 7.573% 90.189% ## ( 4, 6 ] 5997 7.663% 97.852% ## ( 6, 10 ] 1180 1.508% 99.360% ( 10, 15 ] 224 0.286% 99.646% ( 15, 22 ] 32 0.041% 99.687% ( 22, 34 ] 3 0.004% 99.691% ( 34, 51 ] 2 0.003% 99.693% ( 76, 110 ] 2 0.003% 99.696% ( 110, 170 ] 19 0.024% 99.720% ( 170, 250 ] 31 0.040% 99.760% ( 250, 380 ] 26 0.033% 99.793% ( 380, 580 ] 31 0.040% 99.833% ( 580, 870 ] 37 0.047% 99.880% ( 870, 1300 ] 44 0.056% 99.936% ( 1300, 1900 ] 38 0.049% 99.985% ( 1900, 2900 ] 24 0.031% 100.015% ( 2900, 4400 ] 20 0.026% 100.041% ( 4400, 6600 ] 8 0.010% 100.051% ( 6600, 9900 ] 1 0.001% 100.052% ** Level 4 read latency histogram (micros): Count: 50680 Average: 41.4740 StdDev: 288.37 Min: 1 Median: 1.8785 Max: 6859 Percentiles: P50: 1.88 P75: 2.86 P99: 1265.52 P99.9: 3851.26 P99.99: 5023.23 ------------------------------------------------------ [ 0, 1 ] 1863 3.676% 3.676% # ( 1, 2 ] 26723 52.729% 56.405% ########### ( 2, 3 ] 10995 21.695% 78.100% #### ( 3, 4 ] 3924 7.743% 85.843% ## ( 4, 6 ] 3849 7.595% 93.437% ## ( 6, 10 ] 1130 2.230% 95.667% ( 10, 15 ] 283 0.558% 96.225% ( 15, 22 ] 29 0.057% 96.283% ( 22, 34 ] 3 0.006% 96.288% ( 51, 76 ] 1 0.002% 96.290% ( 76, 110 ] 15 0.030% 96.320% ( 110, 170 ] 173 0.341% 96.661% ( 170, 250 ] 220 0.434% 97.096% ( 250, 380 ] 239 0.472% 97.567% ( 380, 580 ] 280 0.552% 98.120% ( 580, 870 ] 242 0.478% 98.597% ( 870, 1300 ] 222 0.438% 99.035% ( 1300, 1900 ] 184 0.363% 99.398% ( 1900, 2900 ] 189 0.373% 99.771% ( 2900, 4400 ] 103 0.203% 99.974% ( 4400, 6600 ] 28 0.055% 100.030% ( 6600, 9900 ] 5 0.010% 100.039% ** Level 5 read latency histogram (micros): Count: 12007 Average: 1009.9771 StdDev: 1243.79 Min: 77 Median: 496.7888 Max: 10145 Percentiles: P50: 496.79 P75: 1215.38 P99: 6041.33 P99.9: 8831.67 P99.99: 9880.52 ------------------------------------------------------ ( 76, 110 ] 225 1.874% 1.874% ( 110, 170 ] 1527 12.718% 14.591% ### ( 170, 250 ] 1706 14.208% 28.800% ### ( 250, 380 ] 1589 13.234% 42.034% ### ( 380, 580 ] 1639 13.650% 55.684% ### ( 580, 870 ] 1407 11.718% 67.402% ## ( 870, 1300 ] 1137 9.469% 76.872% ## ( 1300, 1900 ] 760 6.330% 83.201% # ( 1900, 2900 ] 859 7.154% 90.356% # ( 2900, 4400 ] 789 6.571% 96.927% # ( 4400, 6600 ] 335 2.790% 99.717% # ( 6600, 9900 ] 34 0.283% 100.000% ( 9900, 14000 ] 1 0.008% 100.008% ** DB Stats ** Uptime(secs): 4.5 total, 4.3 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 218.02 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.762 H:M:S, 16.9 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 227.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.762 H:M:S, 17.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-23:41:31 ... thread 0: (1000000,2000000) ops and (295424.8,259618.7) ops/second in (3.384956,7.703606) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/13 3.84 GB 138.4 1.4 0.0 1.4 3.2 1.8 0.0 1.7 111.5 263.5 12.43 10.38 33 0.377 1407K 1429 0.0 0.0 L1 12/12 1.46 GB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 L3 19/0 972.97 MB 1.0 0.2 0.1 0.1 0.2 0.1 0.0 1.8 151.4 149.6 1.57 1.06 1 1.565 130K 0 0.0 0.0 L4 175/0 9.75 GB 1.0 1.1 0.7 0.4 1.0 0.6 0.0 1.6 140.8 138.4 7.65 5.07 8 0.956 316K 0 0.0 0.0 L5 1112/0 91.41 GB 0.9 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1336/25 107.41 GB 0.0 2.6 0.8 1.8 4.5 2.6 1.0 2.4 124.8 211.0 21.64 16.51 42 0.515 1854K 1429 0.0 0.0 Int 0/0 0.00 KB 0.0 2.6 0.8 1.8 4.5 2.6 1.0 2.4 124.8 211.0 21.64 16.51 42 0.515 1854K 1429 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 2.6 0.8 1.8 2.6 0.8 0.0 0.0 186.1 184.5 14.51 11.30 14 1.037 1854K 1429 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 265.0 7.13 5.22 28 0.255 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 7.9 total, 7.7 interval Flush(GB): cumulative 1.846, interval 1.846 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 4.46 GB write, 578.24 MB/s write, 2.64 GB read, 341.84 MB/s read, 21.6 seconds Interval compaction: 4.46 GB write, 592.79 MB/s write, 2.64 GB read, 350.44 MB/s read, 21.6 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 6, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 6, interval: 6 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 673881 Average: 8.7387 StdDev: 77.19 Min: 0 Median: 1.6230 Max: 22498 Percentiles: P50: 1.62 P75: 2.17 P99: 200.75 P99.9: 607.20 P99.99: 1019.18 ------------------------------------------------------ [ 0, 1 ] 88794 13.177% 13.177% ### ( 1, 2 ] 398288 59.104% 72.280% ############ ( 2, 3 ] 108942 16.166% 88.446% ### ( 3, 4 ] 29207 4.334% 92.781% # ( 4, 6 ] 24664 3.660% 96.441% # ( 6, 10 ] 7703 1.143% 97.584% ( 10, 15 ] 1614 0.240% 97.823% ( 15, 22 ] 334 0.050% 97.873% ( 22, 34 ] 76 0.011% 97.884% ( 34, 51 ] 10 0.001% 97.886% ( 51, 76 ] 4 0.001% 97.886% ( 76, 110 ] 519 0.077% 97.963% ( 110, 170 ] 5239 0.777% 98.741% ( 170, 250 ] 4551 0.675% 99.416% ( 250, 380 ] 1846 0.274% 99.690% ( 380, 580 ] 1363 0.202% 99.892% ( 580, 870 ] 577 0.086% 99.978% ( 870, 1300 ] 241 0.036% 100.014% ( 1300, 1900 ] 144 0.021% 100.035% ( 1900, 2900 ] 104 0.015% 100.050% ( 2900, 4400 ] 53 0.008% 100.058% ( 4400, 6600 ] 10 0.001% 100.060% ( 6600, 9900 ] 6 0.001% 100.061% ( 22000, 33000 ] 1 0.000% 100.061% ** Level 1 read latency histogram (micros): Count: 937 Average: 573.7439 StdDev: 1535.92 Min: 91 Median: 206.8379 Max: 21354 Percentiles: P50: 206.84 P75: 350.85 P99: 8379.94 P99.9: 18252.00 P99.99: 21354.00 ------------------------------------------------------ ( 76, 110 ] 37 3.949% 3.949% # ( 110, 170 ] 315 33.618% 37.567% ####### ( 170, 250 ] 253 27.001% 64.568% ##### ( 250, 380 ] 126 13.447% 78.015% ### ( 380, 580 ] 88 9.392% 87.407% ## ( 580, 870 ] 42 4.482% 91.889% # ( 870, 1300 ] 22 2.348% 94.237% ( 1300, 1900 ] 6 0.640% 94.877% ( 1900, 2900 ] 6 0.640% 95.518% ( 2900, 4400 ] 7 0.747% 96.265% ( 4400, 6600 ] 17 1.814% 98.079% ( 6600, 9900 ] 16 1.708% 99.787% ( 14000, 22000 ] 2 0.213% 100.000% ** Level 2 read latency histogram (micros): Count: 32708 Average: 7.8685 StdDev: 116.35 Min: 1 Median: 1.7572 Max: 6971 Percentiles: P50: 1.76 P75: 2.58 P99: 9.93 P99.9: 1794.06 P99.99: 5351.06 ------------------------------------------------------ [ 0, 1 ] 1950 5.962% 5.962% # ( 1, 2 ] 19023 58.160% 64.122% ############ ( 2, 3 ] 6117 18.702% 82.824% #### ( 3, 4 ] 2181 6.668% 89.492% # ( 4, 6 ] 2381 7.280% 96.771% # ( 6, 10 ] 742 2.269% 99.040% ( 10, 15 ] 176 0.538% 99.578% ( 15, 22 ] 17 0.052% 99.630% ( 22, 34 ] 2 0.006% 99.636% ( 51, 76 ] 1 0.003% 99.639% ( 110, 170 ] 4 0.012% 99.651% ( 170, 250 ] 5 0.015% 99.667% ( 250, 380 ] 12 0.037% 99.703% ( 380, 580 ] 13 0.040% 99.743% ( 580, 870 ] 22 0.067% 99.810% ( 870, 1300 ] 12 0.037% 99.847% ( 1300, 1900 ] 21 0.064% 99.911% ( 1900, 2900 ] 16 0.049% 99.960% ( 2900, 4400 ] 8 0.024% 99.985% ( 4400, 6600 ] 4 0.012% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 78839 Average: 8.6385 StdDev: 103.32 Min: 0 Median: 1.8323 Max: 6641 Percentiles: P50: 1.83 P75: 2.69 P99: 111.10 P99.9: 1018.16 P99.99: 2071.50 ------------------------------------------------------ [ 0, 1 ] 2698 3.422% 3.422% # ( 1, 2 ] 44120 55.962% 59.384% ########### ( 2, 3 ] 17840 22.628% 82.013% ##### ( 3, 4 ] 5927 7.518% 89.531% ## ( 4, 6 ] 5997 7.607% 97.137% ## ( 6, 10 ] 1180 1.497% 98.634% ( 10, 15 ] 224 0.284% 98.918% ( 15, 22 ] 32 0.041% 98.959% ( 22, 34 ] 3 0.004% 98.962% ( 34, 51 ] 2 0.003% 98.965% ( 76, 110 ] 23 0.029% 98.994% ( 110, 170 ] 252 0.320% 99.314% ( 170, 250 ] 226 0.287% 99.600% ( 250, 380 ] 85 0.108% 99.708% ( 380, 580 ] 81 0.103% 99.811% ( 580, 870 ] 55 0.070% 99.881% ( 870, 1300 ] 44 0.056% 99.937% ( 1300, 1900 ] 38 0.048% 99.985% ( 1900, 2900 ] 24 0.030% 100.015% ( 2900, 4400 ] 20 0.025% 100.041% ( 4400, 6600 ] 8 0.010% 100.051% ( 6600, 9900 ] 1 0.001% 100.052% ** Level 4 read latency histogram (micros): Count: 55552 Average: 56.4082 StdDev: 283.69 Min: 1 Median: 1.9693 Max: 6859 Percentiles: P50: 1.97 P75: 3.49 P99: 1187.04 P99.9: 3792.11 P99.99: 4984.95 ------------------------------------------------------ [ 0, 1 ] 1863 3.354% 3.354% # ( 1, 2 ] 26733 48.122% 51.476% ########## ( 2, 3 ] 11100 19.981% 71.457% #### ( 3, 4 ] 4014 7.226% 78.683% # ( 4, 6 ] 3986 7.175% 85.858% # ( 6, 10 ] 1142 2.056% 87.914% ( 10, 15 ] 292 0.526% 88.440% ( 15, 22 ] 29 0.052% 88.492% ( 22, 34 ] 3 0.005% 88.497% ( 51, 76 ] 1 0.002% 88.499% ( 76, 110 ] 179 0.322% 88.821% ( 110, 170 ] 2010 3.618% 92.440% # ( 170, 250 ] 1665 2.997% 95.437% # ( 250, 380 ] 763 1.373% 96.810% ( 380, 580 ] 669 1.204% 98.014% ( 580, 870 ] 372 0.670% 98.684% ( 870, 1300 ] 238 0.428% 99.113% ( 1300, 1900 ] 185 0.333% 99.446% ( 1900, 2900 ] 190 0.342% 99.788% ( 2900, 4400 ] 105 0.189% 99.977% ( 4400, 6600 ] 28 0.050% 100.027% ( 6600, 9900 ] 5 0.009% 100.036% ** Level 5 read latency histogram (micros): Count: 51355 Average: 411.6519 StdDev: 699.85 Min: 77 Median: 206.3353 Max: 10145 Percentiles: P50: 206.34 P75: 354.93 P99: 4127.26 P99.9: 6486.03 P99.99: 9401.55 ------------------------------------------------------ ( 76, 110 ] 1863 3.628% 3.628% # ( 110, 170 ] 17340 33.765% 37.393% ####### ( 170, 250 ] 14255 27.758% 65.150% ###### ( 250, 380 ] 6267 12.203% 77.354% ## ( 380, 580 ] 4915 9.571% 86.924% ## ( 580, 870 ] 2568 5.000% 91.925% # ( 870, 1300 ] 1312 2.555% 94.480% # ( 1300, 1900 ] 789 1.536% 96.016% ( 1900, 2900 ] 882 1.717% 97.733% ( 2900, 4400 ] 795 1.548% 99.281% ( 4400, 6600 ] 335 0.652% 99.934% ( 6600, 9900 ] 34 0.066% 100.000% ( 9900, 14000 ] 1 0.002% 100.002% ** DB Stats ** Uptime(secs): 7.9 total, 3.4 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 249.19 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:0.762 H:M:S, 9.6 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 290.76 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.000 H:M:S, 0.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/15-23:42:08 ... thread 0: (1000000,3000000) ops and (26944.1,66938.2) ops/second in (37.113852,44.817458) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 13/6 2.70 GB 125.9 2.3 0.0 2.3 5.0 2.7 0.0 1.9 117.7 253.9 20.33 16.60 49 0.415 2430K 2456 0.0 0.0 L1 5/0 535.20 MB 53.5 3.5 2.0 1.5 3.4 2.0 0.0 1.7 92.2 91.1 38.44 18.33 1 38.441 3598K 40K 0.0 0.0 L3 28/10 1.82 GB 1.1 2.7 1.4 1.3 2.7 1.4 1.6 1.9 132.8 131.8 20.79 13.36 11 1.890 1806K 397 0.0 0.0 L4 175/24 9.75 GB 0.9 4.3 2.7 1.6 4.2 2.6 0.0 1.6 131.8 129.9 33.29 20.82 29 1.148 2777K 2269 0.0 0.0 L5 1136/0 93.38 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1357/40 108.18 GB 0.0 12.8 6.0 6.7 15.4 8.6 4.6 5.7 115.9 139.4 112.86 69.11 90 1.254 10M 45K 0.0 0.0 Int 0/0 0.00 KB 0.0 12.8 6.0 6.7 15.4 8.6 4.6 5.7 115.9 139.4 112.86 69.11 90 1.254 10M 45K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.8 6.0 6.7 12.7 5.9 0.0 0.0 128.7 127.5 101.67 61.43 50 2.033 10M 45K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.7 2.7 0.0 0.0 0.0 247.7 11.19 7.68 40 0.280 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 45.0 total, 44.8 interval Flush(GB): cumulative 2.707, interval 2.707 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 15.36 GB write, 349.50 MB/s write, 12.78 GB read, 290.69 MB/s read, 112.9 seconds Interval compaction: 15.36 GB write, 351.01 MB/s write, 12.78 GB read, 291.95 MB/s read, 112.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 20, pending-compaction-bytes-delays: 31, pending-compaction-bytes-stops: 0, total-delays: 31, total-stops: 20, interval: 51 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1555044 Average: 27.6931 StdDev: 139.90 Min: 0 Median: 1.7129 Max: 30285 Percentiles: P50: 1.71 P75: 2.79 P99: 321.32 P99.9: 1208.26 P99.99: 2358.83 ------------------------------------------------------ [ 0, 1 ] 223304 14.360% 14.360% ### ( 1, 2 ] 777367 49.990% 64.350% ########## ( 2, 3 ] 210160 13.515% 77.865% ### ( 3, 4 ] 71736 4.613% 82.478% # ( 4, 6 ] 63382 4.076% 86.554% # ( 6, 10 ] 17171 1.104% 87.658% ( 10, 15 ] 3509 0.226% 87.884% ( 15, 22 ] 559 0.036% 87.920% ( 22, 34 ] 91 0.006% 87.925% ( 34, 51 ] 10 0.001% 87.926% ( 51, 76 ] 7 0.000% 87.927% ( 76, 110 ] 14596 0.939% 88.865% ( 110, 170 ] 104762 6.737% 95.602% # ( 170, 250 ] 47842 3.077% 98.679% # ( 250, 380 ] 9110 0.586% 99.264% ( 380, 580 ] 5825 0.375% 99.639% ( 580, 870 ] 2830 0.182% 99.821% ( 870, 1300 ] 1561 0.100% 99.921% ( 1300, 1900 ] 838 0.054% 99.975% ( 1900, 2900 ] 498 0.032% 100.007% ( 2900, 4400 ] 463 0.030% 100.037% ( 4400, 6600 ] 115 0.007% 100.045% ( 6600, 9900 ] 20 0.001% 100.046% ( 9900, 14000 ] 2 0.000% 100.046% ( 14000, 22000 ] 5 0.000% 100.046% ( 22000, 33000 ] 9 0.001% 100.047% ** Level 1 read latency histogram (micros): Count: 1012014 Average: 9.3624 StdDev: 132.53 Min: 0 Median: 1.9862 Max: 23844 Percentiles: P50: 1.99 P75: 3.06 P99: 124.82 P99.9: 577.78 P99.99: 1083.70 ------------------------------------------------------ [ 0, 1 ] 59899 5.919% 5.919% # ( 1, 2 ] 452355 44.698% 50.617% ######### ( 2, 3 ] 241169 23.831% 74.448% ##### ( 3, 4 ] 100100 9.891% 84.339% ## ( 4, 6 ] 114303 11.295% 95.634% ## ( 6, 10 ] 25842 2.554% 98.187% # ( 10, 15 ] 4596 0.454% 98.641% ( 15, 22 ] 1079 0.107% 98.748% ( 22, 34 ] 56 0.006% 98.753% ( 34, 51 ] 74 0.007% 98.761% ( 51, 76 ] 65 0.006% 98.767% ( 76, 110 ] 739 0.073% 98.840% ( 110, 170 ] 6544 0.647% 99.487% ( 170, 250 ] 2890 0.286% 99.772% ( 250, 380 ] 665 0.066% 99.838% ( 380, 580 ] 633 0.063% 99.901% ( 580, 870 ] 625 0.062% 99.962% ( 870, 1300 ] 561 0.055% 100.018% ( 1300, 1900 ] 316 0.031% 100.049% ( 1900, 2900 ] 265 0.026% 100.075% ( 2900, 4400 ] 334 0.033% 100.108% ( 4400, 6600 ] 104 0.010% 100.119% ( 6600, 9900 ] 35 0.003% 100.122% ( 9900, 14000 ] 8 0.001% 100.123% ( 14000, 22000 ] 9 0.001% 100.124% ( 22000, 33000 ] 2 0.000% 100.124% ** Level 2 read latency histogram (micros): Count: 32708 Average: 7.8685 StdDev: 116.35 Min: 1 Median: 1.7572 Max: 6971 Percentiles: P50: 1.76 P75: 2.58 P99: 9.93 P99.9: 1794.06 P99.99: 5351.06 ------------------------------------------------------ [ 0, 1 ] 1950 5.962% 5.962% # ( 1, 2 ] 19023 58.160% 64.122% ############ ( 2, 3 ] 6117 18.702% 82.824% #### ( 3, 4 ] 2181 6.668% 89.492% # ( 4, 6 ] 2381 7.280% 96.771% # ( 6, 10 ] 742 2.269% 99.040% ( 10, 15 ] 176 0.538% 99.578% ( 15, 22 ] 17 0.052% 99.630% ( 22, 34 ] 2 0.006% 99.636% ( 51, 76 ] 1 0.003% 99.639% ( 110, 170 ] 4 0.012% 99.651% ( 170, 250 ] 5 0.015% 99.667% ( 250, 380 ] 12 0.037% 99.703% ( 380, 580 ] 13 0.040% 99.743% ( 580, 870 ] 22 0.067% 99.810% ( 870, 1300 ] 12 0.037% 99.847% ( 1300, 1900 ] 21 0.064% 99.911% ( 1900, 2900 ] 16 0.049% 99.960% ( 2900, 4400 ] 8 0.024% 99.985% ( 4400, 6600 ] 4 0.012% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 731420 Average: 10.3963 StdDev: 144.72 Min: 0 Median: 2.1791 Max: 26700 Percentiles: P50: 2.18 P75: 3.19 P99: 132.86 P99.9: 807.75 P99.99: 1331.09 ------------------------------------------------------ [ 0, 1 ] 8534 1.167% 1.167% ( 1, 2 ] 320576 43.829% 44.996% ######### ( 2, 3 ] 204410 27.947% 72.943% ###### ( 3, 4 ] 78384 10.717% 83.660% ## ( 4, 6 ] 88690 12.126% 95.785% ## ( 6, 10 ] 17560 2.401% 98.186% ( 10, 15 ] 3158 0.432% 98.618% ( 15, 22 ] 349 0.048% 98.666% ( 22, 34 ] 39 0.005% 98.671% ( 34, 51 ] 78 0.011% 98.682% ( 51, 76 ] 67 0.009% 98.691% ( 76, 110 ] 463 0.063% 98.754% ( 110, 170 ] 4722 0.646% 99.400% ( 170, 250 ] 2251 0.308% 99.708% ( 250, 380 ] 480 0.066% 99.773% ( 380, 580 ] 510 0.070% 99.843% ( 580, 870 ] 533 0.073% 99.916% ( 870, 1300 ] 528 0.072% 99.988% ( 1300, 1900 ] 306 0.042% 100.030% ( 1900, 2900 ] 242 0.033% 100.063% ( 2900, 4400 ] 293 0.040% 100.103% ( 4400, 6600 ] 79 0.011% 100.114% ( 6600, 9900 ] 14 0.002% 100.116% ( 9900, 14000 ] 5 0.001% 100.116% ( 14000, 22000 ] 8 0.001% 100.117% ( 22000, 33000 ] 4 0.001% 100.118% ** Level 4 read latency histogram (micros): Count: 594732 Average: 36.6117 StdDev: 221.94 Min: 1 Median: 2.3619 Max: 31687 Percentiles: P50: 2.36 P75: 3.96 P99: 485.13 P99.9: 1898.71 P99.99: 2832.74 ------------------------------------------------------ [ 0, 1 ] 6629 1.115% 1.115% ( 1, 2 ] 236882 39.830% 40.945% ######## ( 2, 3 ] 148827 25.024% 65.969% ##### ( 3, 4 ] 56037 9.422% 75.391% ## ( 4, 6 ] 59413 9.990% 85.381% ## ( 6, 10 ] 14161 2.381% 87.762% ( 10, 15 ] 2596 0.436% 88.199% ( 15, 22 ] 300 0.050% 88.249% ( 22, 34 ] 33 0.006% 88.255% ( 34, 51 ] 55 0.009% 88.264% ( 51, 76 ] 51 0.009% 88.272% ( 76, 110 ] 4050 0.681% 88.953% ( 110, 170 ] 37830 6.361% 95.314% # ( 170, 250 ] 17161 2.886% 98.200% # ( 250, 380 ] 3384 0.569% 98.769% ( 380, 580 ] 2621 0.441% 99.209% ( 580, 870 ] 1880 0.316% 99.526% ( 870, 1300 ] 1427 0.240% 99.765% ( 1300, 1900 ] 804 0.135% 99.901% ( 1900, 2900 ] 572 0.096% 99.997% ( 2900, 4400 ] 548 0.092% 100.089% ( 4400, 6600 ] 159 0.027% 100.116% ( 6600, 9900 ] 29 0.005% 100.121% ( 9900, 14000 ] 15 0.003% 100.123% ( 14000, 22000 ] 10 0.002% 100.125% ( 22000, 33000 ] 2 0.000% 100.125% ** Level 5 read latency histogram (micros): Count: 540114 Average: 221.0180 StdDev: 375.53 Min: 77 Median: 156.2611 Max: 32050 Percentiles: P50: 156.26 P75: 207.26 P99: 1695.73 P99.9: 5181.85 P99.99: 8757.21 ------------------------------------------------------ ( 76, 110 ] 33129 6.134% 6.134% # ( 110, 170 ] 307292 56.894% 63.028% ########### ( 170, 250 ] 138854 25.708% 88.736% ##### ( 250, 380 ] 24642 4.562% 93.298% # ( 380, 580 ] 15946 2.952% 96.251% # ( 580, 870 ] 8244 1.526% 97.777% ( 870, 1300 ] 4895 0.906% 98.683% ( 1300, 1900 ] 2594 0.480% 99.164% ( 1900, 2900 ] 1902 0.352% 99.516% ( 2900, 4400 ] 1836 0.340% 99.856% ( 4400, 6600 ] 675 0.125% 99.981% ( 6600, 9900 ] 78 0.014% 99.995% ( 9900, 14000 ] 8 0.001% 99.996% ( 14000, 22000 ] 12 0.002% 99.999% ( 22000, 33000 ] 9 0.002% 100.000% ** DB Stats ** Uptime(secs): 45.0 total, 37.1 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 65.59 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:33.306 H:M:S, 74.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 26.52 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:32.544 H:M:S, 87.7 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/15-23:42:12 ... thread 0: (1000000,4000000) ops and (237499.7,81586.1) ops/second in (4.210531,49.027989) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/10 3.75 GB 207.6 3.3 0.0 3.3 7.0 3.7 0.0 1.9 117.7 253.0 28.37 23.30 68 0.417 3390K 3695 0.0 0.0 L1 5/0 535.20 MB 53.5 3.5 2.0 1.5 3.4 2.0 0.0 1.7 92.2 91.1 38.44 18.33 1 38.441 3598K 40K 0.0 0.0 L3 16/0 945.84 MB 0.9 2.7 1.4 1.3 2.7 1.4 1.6 1.9 132.8 131.8 20.79 13.36 11 1.890 1806K 397 0.0 0.0 L4 176/0 9.62 GB 1.0 6.4 3.5 2.8 6.3 3.4 0.0 1.8 134.8 132.6 48.32 30.78 40 1.208 3835K 2269 0.0 0.0 L5 1148/0 94.37 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1364/10 109.18 GB 0.0 15.8 6.9 8.8 19.4 10.5 5.6 5.2 118.9 145.9 135.92 85.77 120 1.133 12M 46K 0.0 0.0 Int 0/0 0.00 KB 0.0 15.8 6.9 8.8 19.4 10.5 5.6 5.2 118.9 145.9 135.92 85.77 120 1.133 12M 46K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 15.8 6.9 8.8 15.6 6.8 0.0 0.0 134.0 132.6 120.56 75.05 64 1.884 12M 46K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 250.2 15.36 10.72 56 0.274 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 49.2 total, 49.0 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 19.36 GB write, 402.81 MB/s write, 15.78 GB read, 328.19 MB/s read, 135.9 seconds Interval compaction: 19.36 GB write, 404.40 MB/s write, 15.78 GB read, 329.49 MB/s read, 135.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 31, pending-compaction-bytes-stops: 0, total-delays: 36, total-stops: 29, interval: 65 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1858978 Average: 26.6255 StdDev: 136.15 Min: 0 Median: 1.6863 Max: 30285 Percentiles: P50: 1.69 P75: 2.67 P99: 340.65 P99.9: 1175.61 P99.99: 2173.24 ------------------------------------------------------ [ 0, 1 ] 274620 14.773% 14.773% ### ( 1, 2 ] 954219 51.330% 66.103% ########## ( 2, 3 ] 245605 13.212% 79.315% ### ( 3, 4 ] 82129 4.418% 83.733% # ( 4, 6 ] 71251 3.833% 87.566% # ( 6, 10 ] 18937 1.019% 88.584% ( 10, 15 ] 3871 0.208% 88.792% ( 15, 22 ] 629 0.034% 88.826% ( 22, 34 ] 98 0.005% 88.832% ( 34, 51 ] 11 0.001% 88.832% ( 51, 76 ] 9 0.000% 88.833% ( 76, 110 ] 15189 0.817% 89.650% ( 110, 170 ] 111401 5.993% 95.642% # ( 170, 250 ] 54188 2.915% 98.557% # ( 250, 380 ] 11806 0.635% 99.192% ( 380, 580 ] 7873 0.424% 99.616% ( 580, 870 ] 3890 0.209% 99.825% ( 870, 1300 ] 1960 0.105% 99.930% ( 1300, 1900 ] 956 0.051% 99.982% ( 1900, 2900 ] 553 0.030% 100.012% ( 2900, 4400 ] 501 0.027% 100.039% ( 4400, 6600 ] 135 0.007% 100.046% ( 6600, 9900 ] 25 0.001% 100.047% ( 9900, 14000 ] 2 0.000% 100.047% ( 14000, 22000 ] 6 0.000% 100.048% ( 22000, 33000 ] 9 0.000% 100.048% ** Level 1 read latency histogram (micros): Count: 1043276 Average: 9.3143 StdDev: 131.00 Min: 0 Median: 1.9810 Max: 23844 Percentiles: P50: 1.98 P75: 3.02 P99: 126.35 P99.9: 587.75 P99.99: 1090.38 ------------------------------------------------------ [ 0, 1 ] 60887 5.836% 5.836% # ( 1, 2 ] 469695 45.021% 50.857% ######### ( 2, 3 ] 249532 23.918% 74.775% ##### ( 3, 4 ] 101768 9.755% 84.530% ## ( 4, 6 ] 115903 11.110% 95.640% ## ( 6, 10 ] 26513 2.541% 98.181% # ( 10, 15 ] 4667 0.447% 98.628% ( 15, 22 ] 1090 0.104% 98.733% ( 22, 34 ] 56 0.005% 98.738% ( 34, 51 ] 74 0.007% 98.745% ( 51, 76 ] 65 0.006% 98.751% ( 76, 110 ] 757 0.073% 98.824% ( 110, 170 ] 6738 0.646% 99.470% ( 170, 250 ] 3058 0.293% 99.763% ( 250, 380 ] 733 0.070% 99.833% ( 380, 580 ] 679 0.065% 99.898% ( 580, 870 ] 663 0.064% 99.962% ( 870, 1300 ] 573 0.055% 100.017% ( 1300, 1900 ] 321 0.031% 100.048% ( 1900, 2900 ] 265 0.025% 100.073% ( 2900, 4400 ] 334 0.032% 100.105% ( 4400, 6600 ] 104 0.010% 100.115% ( 6600, 9900 ] 36 0.003% 100.118% ( 9900, 14000 ] 8 0.001% 100.119% ( 14000, 22000 ] 9 0.001% 100.120% ( 22000, 33000 ] 2 0.000% 100.120% ** Level 2 read latency histogram (micros): Count: 32708 Average: 7.8685 StdDev: 116.35 Min: 1 Median: 1.7572 Max: 6971 Percentiles: P50: 1.76 P75: 2.58 P99: 9.93 P99.9: 1794.06 P99.99: 5351.06 ------------------------------------------------------ [ 0, 1 ] 1950 5.962% 5.962% # ( 1, 2 ] 19023 58.160% 64.122% ############ ( 2, 3 ] 6117 18.702% 82.824% #### ( 3, 4 ] 2181 6.668% 89.492% # ( 4, 6 ] 2381 7.280% 96.771% # ( 6, 10 ] 742 2.269% 99.040% ( 10, 15 ] 176 0.538% 99.578% ( 15, 22 ] 17 0.052% 99.630% ( 22, 34 ] 2 0.006% 99.636% ( 51, 76 ] 1 0.003% 99.639% ( 110, 170 ] 4 0.012% 99.651% ( 170, 250 ] 5 0.015% 99.667% ( 250, 380 ] 12 0.037% 99.703% ( 380, 580 ] 13 0.040% 99.743% ( 580, 870 ] 22 0.067% 99.810% ( 870, 1300 ] 12 0.037% 99.847% ( 1300, 1900 ] 21 0.064% 99.911% ( 1900, 2900 ] 16 0.049% 99.960% ( 2900, 4400 ] 8 0.024% 99.985% ( 4400, 6600 ] 4 0.012% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 820953 Average: 9.8676 StdDev: 137.95 Min: 0 Median: 2.1641 Max: 26700 Percentiles: P50: 2.16 P75: 3.14 P99: 126.27 P99.9: 758.76 P99.99: 1269.10 ------------------------------------------------------ [ 0, 1 ] 9611 1.171% 1.171% ( 1, 2 ] 363028 44.220% 45.391% ######### ( 2, 3 ] 230639 28.094% 73.485% ###### ( 3, 4 ] 86502 10.537% 84.022% ## ( 4, 6 ] 97723 11.904% 95.925% ## ( 6, 10 ] 19384 2.361% 98.287% ( 10, 15 ] 3482 0.424% 98.711% ( 15, 22 ] 380 0.046% 98.757% ( 22, 34 ] 42 0.005% 98.762% ( 34, 51 ] 86 0.010% 98.773% ( 51, 76 ] 76 0.009% 98.782% ( 76, 110 ] 479 0.058% 98.840% ( 110, 170 ] 4835 0.589% 99.429% ( 170, 250 ] 2394 0.292% 99.721% ( 250, 380 ] 552 0.067% 99.788% ( 380, 580 ] 564 0.069% 99.857% ( 580, 870 ] 576 0.070% 99.927% ( 870, 1300 ] 558 0.068% 99.995% ( 1300, 1900 ] 320 0.039% 100.034% ( 1900, 2900 ] 252 0.031% 100.065% ( 2900, 4400 ] 296 0.036% 100.101% ( 4400, 6600 ] 83 0.010% 100.111% ( 6600, 9900 ] 14 0.002% 100.112% ( 9900, 14000 ] 5 0.001% 100.113% ( 14000, 22000 ] 8 0.001% 100.114% ( 22000, 33000 ] 4 0.000% 100.115% ** Level 4 read latency histogram (micros): Count: 751379 Average: 32.1238 StdDev: 204.84 Min: 1 Median: 2.2852 Max: 31687 Percentiles: P50: 2.29 P75: 3.74 P99: 432.98 P99.9: 1728.01 P99.99: 2608.86 ------------------------------------------------------ [ 0, 1 ] 9168 1.220% 1.220% ( 1, 2 ] 311835 41.502% 42.722% ######## ( 2, 3 ] 191771 25.523% 68.244% ##### ( 3, 4 ] 68649 9.136% 77.381% ## ( 4, 6 ] 72826 9.692% 87.073% ## ( 6, 10 ] 18062 2.404% 89.477% ( 10, 15 ] 3189 0.424% 89.901% ( 15, 22 ] 364 0.048% 89.950% ( 22, 34 ] 41 0.005% 89.955% ( 34, 51 ] 66 0.009% 89.964% ( 51, 76 ] 65 0.009% 89.973% ( 76, 110 ] 4237 0.564% 90.537% ( 110, 170 ] 39729 5.287% 95.824% # ( 170, 250 ] 18854 2.509% 98.333% # ( 250, 380 ] 4157 0.553% 98.887% ( 380, 580 ] 3217 0.428% 99.315% ( 580, 870 ] 2203 0.293% 99.608% ( 870, 1300 ] 1579 0.210% 99.818% ( 1300, 1900 ] 863 0.115% 99.933% ( 1900, 2900 ] 605 0.081% 100.013% ( 2900, 4400 ] 582 0.077% 100.091% ( 4400, 6600 ] 173 0.023% 100.114% ( 6600, 9900 ] 30 0.004% 100.118% ( 9900, 14000 ] 15 0.002% 100.120% ( 14000, 22000 ] 11 0.001% 100.121% ( 22000, 33000 ] 2 0.000% 100.122% ** Level 5 read latency histogram (micros): Count: 579096 Average: 225.2904 StdDev: 374.10 Min: 77 Median: 157.7387 Max: 32050 Percentiles: P50: 157.74 P75: 212.00 P99: 1672.41 P99.9: 5137.20 P99.99: 8789.98 ------------------------------------------------------ ( 76, 110 ] 34324 5.927% 5.927% # ( 110, 170 ] 320776 55.393% 61.320% ########### ( 170, 250 ] 150916 26.061% 87.380% ##### ( 250, 380 ] 29835 5.152% 92.532% # ( 380, 580 ] 19875 3.432% 95.964% # ( 580, 870 ] 10252 1.770% 97.735% ( 870, 1300 ] 5604 0.968% 98.702% ( 1300, 1900 ] 2776 0.479% 99.182% ( 1900, 2900 ] 1995 0.345% 99.526% ( 2900, 4400 ] 1928 0.333% 99.859% ( 4400, 6600 ] 704 0.122% 99.981% ( 6600, 9900 ] 80 0.014% 99.995% ( 9900, 14000 ] 10 0.002% 99.996% ( 14000, 22000 ] 14 0.002% 99.999% ( 22000, 33000 ] 9 0.002% 100.000% ** DB Stats ** Uptime(secs): 49.2 total, 4.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 79.98 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:34.022 H:M:S, 69.1 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 233.75 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.716 H:M:S, 17.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 2024/12/15-23:42:23 ... thread 0: (1000000,5000000) ops and (90875.3,83288.8) ops/second in (11.004094,60.032083) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 17/10 4.72 GB 307.3 5.8 0.0 5.8 10.5 4.7 0.0 2.2 143.5 260.6 41.27 35.50 89 0.464 6011K 15K 0.0 0.0 L1 5/0 535.20 MB 53.5 3.5 2.0 1.5 3.4 2.0 0.0 1.7 92.2 91.1 38.44 18.33 1 38.441 3598K 40K 0.0 0.0 L3 16/0 945.84 MB 0.9 2.7 1.4 1.3 2.7 1.4 1.6 1.9 132.8 131.8 20.79 13.36 11 1.890 1806K 397 0.0 0.0 L4 176/0 9.62 GB 1.0 6.4 3.5 2.8 6.3 3.4 0.0 1.8 134.8 132.6 48.32 30.78 40 1.208 3835K 2269 0.0 0.0 L5 1148/0 94.37 GB 1.0 0.0 0.0 0.0 0.0 0.0 3.9 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1362/10 110.15 GB 0.0 18.3 6.9 11.4 22.9 11.5 5.6 4.8 125.9 157.3 148.82 97.98 141 1.055 15M 58K 0.0 0.0 Int 0/0 0.00 KB 0.0 18.3 6.9 11.4 22.9 11.5 5.6 4.8 125.9 157.3 148.82 97.98 141 1.055 15M 58K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 18.3 6.9 11.4 18.1 6.7 0.0 0.0 143.9 142.5 130.24 84.56 69 1.888 15M 58K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 261.1 18.58 13.42 72 0.258 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 60.2 total, 60.0 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 22.86 GB write, 388.62 MB/s write, 18.30 GB read, 311.09 MB/s read, 148.8 seconds Interval compaction: 22.86 GB write, 389.87 MB/s write, 18.30 GB read, 312.10 MB/s read, 148.8 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 16, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 16, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 29, pending-compaction-bytes-delays: 31, pending-compaction-bytes-stops: 0, total-delays: 47, total-stops: 29, interval: 76 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2582617 Average: 25.2089 StdDev: 121.26 Min: 0 Median: 1.6121 Max: 30285 Percentiles: P50: 1.61 P75: 2.44 P99: 320.80 P99.9: 953.14 P99.99: 1716.51 ------------------------------------------------------ [ 0, 1 ] 471925 18.273% 18.273% #### ( 1, 2 ] 1338619 51.832% 70.105% ########## ( 2, 3 ] 287618 11.137% 81.242% ## ( 3, 4 ] 96137 3.722% 84.964% # ( 4, 6 ] 79345 3.072% 88.036% # ( 6, 10 ] 20446 0.792% 88.828% ( 10, 15 ] 4446 0.172% 89.000% ( 15, 22 ] 709 0.027% 89.028% ( 22, 34 ] 106 0.004% 89.032% ( 34, 51 ] 15 0.001% 89.032% ( 51, 76 ] 16 0.001% 89.033% ( 76, 110 ] 18313 0.709% 89.742% ( 110, 170 ] 150575 5.830% 95.572% # ( 170, 250 ] 79488 3.078% 98.650% # ( 250, 380 ] 16587 0.642% 99.293% ( 380, 580 ] 10655 0.413% 99.705% ( 580, 870 ] 4640 0.180% 99.885% ( 870, 1300 ] 2045 0.079% 99.964% ( 1300, 1900 ] 972 0.038% 100.002% ( 1900, 2900 ] 587 0.023% 100.024% ( 2900, 4400 ] 527 0.020% 100.045% ( 4400, 6600 ] 136 0.005% 100.050% ( 6600, 9900 ] 25 0.001% 100.051% ( 9900, 14000 ] 2 0.000% 100.051% ( 14000, 22000 ] 6 0.000% 100.051% ( 22000, 33000 ] 9 0.000% 100.052% ** Level 1 read latency histogram (micros): Count: 1045347 Average: 9.6690 StdDev: 131.22 Min: 0 Median: 1.9832 Max: 23844 Percentiles: P50: 1.98 P75: 3.04 P99: 138.90 P99.9: 600.39 P99.99: 1092.45 ------------------------------------------------------ [ 0, 1 ] 60887 5.825% 5.825% # ( 1, 2 ] 469695 44.932% 50.757% ######### ( 2, 3 ] 249532 23.871% 74.627% ##### ( 3, 4 ] 101768 9.735% 84.363% ## ( 4, 6 ] 115903 11.088% 95.450% ## ( 6, 10 ] 26513 2.536% 97.986% # ( 10, 15 ] 4667 0.446% 98.433% ( 15, 22 ] 1090 0.104% 98.537% ( 22, 34 ] 56 0.005% 98.542% ( 34, 51 ] 74 0.007% 98.550% ( 51, 76 ] 65 0.006% 98.556% ( 76, 110 ] 875 0.084% 98.639% ( 110, 170 ] 7825 0.749% 99.388% ( 170, 250 ] 3680 0.352% 99.740% ( 250, 380 ] 870 0.083% 99.823% ( 380, 580 ] 753 0.072% 99.895% ( 580, 870 ] 692 0.066% 99.962% ( 870, 1300 ] 575 0.055% 100.017% ( 1300, 1900 ] 322 0.031% 100.047% ( 1900, 2900 ] 265 0.025% 100.073% ( 2900, 4400 ] 335 0.032% 100.105% ( 4400, 6600 ] 104 0.010% 100.115% ( 6600, 9900 ] 36 0.003% 100.118% ( 9900, 14000 ] 8 0.001% 100.119% ( 14000, 22000 ] 9 0.001% 100.120% ( 22000, 33000 ] 2 0.000% 100.120% ** Level 2 read latency histogram (micros): Count: 32708 Average: 7.8685 StdDev: 116.35 Min: 1 Median: 1.7572 Max: 6971 Percentiles: P50: 1.76 P75: 2.58 P99: 9.93 P99.9: 1794.06 P99.99: 5351.06 ------------------------------------------------------ [ 0, 1 ] 1950 5.962% 5.962% # ( 1, 2 ] 19023 58.160% 64.122% ############ ( 2, 3 ] 6117 18.702% 82.824% #### ( 3, 4 ] 2181 6.668% 89.492% # ( 4, 6 ] 2381 7.280% 96.771% # ( 6, 10 ] 742 2.269% 99.040% ( 10, 15 ] 176 0.538% 99.578% ( 15, 22 ] 17 0.052% 99.630% ( 22, 34 ] 2 0.006% 99.636% ( 51, 76 ] 1 0.003% 99.639% ( 110, 170 ] 4 0.012% 99.651% ( 170, 250 ] 5 0.015% 99.667% ( 250, 380 ] 12 0.037% 99.703% ( 380, 580 ] 13 0.040% 99.743% ( 580, 870 ] 22 0.067% 99.810% ( 870, 1300 ] 12 0.037% 99.847% ( 1300, 1900 ] 21 0.064% 99.911% ( 1900, 2900 ] 16 0.049% 99.960% ( 2900, 4400 ] 8 0.024% 99.985% ( 4400, 6600 ] 4 0.012% 99.997% ( 6600, 9900 ] 1 0.003% 100.000% ** Level 3 read latency histogram (micros): Count: 822501 Average: 10.2049 StdDev: 138.13 Min: 0 Median: 2.1674 Max: 26700 Percentiles: P50: 2.17 P75: 3.16 P99: 139.33 P99.9: 763.25 P99.99: 1269.81 ------------------------------------------------------ [ 0, 1 ] 9611 1.169% 1.169% ( 1, 2 ] 363028 44.137% 45.306% ######### ( 2, 3 ] 230639 28.041% 73.347% ###### ( 3, 4 ] 86502 10.517% 83.864% ## ( 4, 6 ] 97723 11.881% 95.745% ## ( 6, 10 ] 19384 2.357% 98.102% ( 10, 15 ] 3482 0.423% 98.525% ( 15, 22 ] 380 0.046% 98.571% ( 22, 34 ] 42 0.005% 98.576% ( 34, 51 ] 86 0.010% 98.587% ( 51, 76 ] 76 0.009% 98.596% ( 76, 110 ] 565 0.069% 98.665% ( 110, 170 ] 5642 0.686% 99.351% ( 170, 250 ] 2865 0.348% 99.699% ( 250, 380 ] 649 0.079% 99.778% ( 380, 580 ] 626 0.076% 99.854% ( 580, 870 ] 599 0.073% 99.927% ( 870, 1300 ] 559 0.068% 99.995% ( 1300, 1900 ] 320 0.039% 100.034% ( 1900, 2900 ] 253 0.031% 100.064% ( 2900, 4400 ] 296 0.036% 100.100% ( 4400, 6600 ] 83 0.010% 100.111% ( 6600, 9900 ] 14 0.002% 100.112% ( 9900, 14000 ] 5 0.001% 100.113% ( 14000, 22000 ] 8 0.001% 100.114% ( 22000, 33000 ] 4 0.000% 100.114% ** Level 4 read latency histogram (micros): Count: 774699 Average: 36.2644 StdDev: 203.93 Min: 1 Median: 2.3440 Max: 31687 Percentiles: P50: 2.34 P75: 3.98 P99: 462.17 P99.9: 1714.53 P99.99: 2606.46 ------------------------------------------------------ [ 0, 1 ] 9168 1.183% 1.183% ( 1, 2 ] 311969 40.270% 41.453% ######## ( 2, 3 ] 192486 24.847% 66.300% ##### ( 3, 4 ] 69124 8.923% 75.222% ## ( 4, 6 ] 73384 9.473% 84.695% ## ( 6, 10 ] 18122 2.339% 87.034% ( 10, 15 ] 3204 0.414% 87.448% ( 15, 22 ] 367 0.047% 87.495% ( 22, 34 ] 43 0.006% 87.501% ( 34, 51 ] 66 0.009% 87.509% ( 51, 76 ] 65 0.008% 87.518% ( 76, 110 ] 5372 0.693% 88.211% ( 110, 170 ] 51152 6.603% 94.814% # ( 170, 250 ] 25343 3.271% 98.085% # ( 250, 380 ] 5437 0.702% 98.787% ( 380, 580 ] 4016 0.518% 99.305% ( 580, 870 ] 2404 0.310% 99.616% ( 870, 1300 ] 1604 0.207% 99.823% ( 1300, 1900 ] 866 0.112% 99.935% ( 1900, 2900 ] 608 0.078% 100.013% ( 2900, 4400 ] 582 0.075% 100.088% ( 4400, 6600 ] 173 0.022% 100.110% ( 6600, 9900 ] 30 0.004% 100.114% ( 9900, 14000 ] 15 0.002% 100.116% ( 14000, 22000 ] 11 0.001% 100.118% ( 22000, 33000 ] 2 0.000% 100.118% ** Level 5 read latency histogram (micros): Count: 726932 Average: 217.2555 StdDev: 337.54 Min: 77 Median: 158.2786 Max: 32050 Percentiles: P50: 158.28 P75: 212.27 P99: 1367.46 P99.9: 4672.09 P99.99: 8138.91 ------------------------------------------------------ ( 76, 110 ] 42107 5.792% 5.792% # ( 110, 170 ] 399381 54.941% 60.733% ########### ( 170, 250 ] 196295 27.003% 87.736% ##### ( 250, 380 ] 38741 5.329% 93.066% # ( 380, 580 ] 25323 3.484% 96.549% # ( 580, 870 ] 11733 1.614% 98.163% ( 870, 1300 ] 5768 0.793% 98.957% ( 1300, 1900 ] 2799 0.385% 99.342% ( 1900, 2900 ] 2040 0.281% 99.622% ( 2900, 4400 ] 1931 0.266% 99.888% ( 4400, 6600 ] 704 0.097% 99.985% ( 6600, 9900 ] 80 0.011% 99.996% ( 9900, 14000 ] 10 0.001% 99.997% ( 14000, 22000 ] 14 0.002% 99.999% ( 22000, 33000 ] 9 0.001% 100.000% ** DB Stats ** Uptime(secs): 60.2 total, 11.0 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 81.71 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:41.398 H:M:S, 68.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 89.44 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:7.376 H:M:S, 67.0 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 277.543 micros/op 14377 ops/sec 60.300 seconds 866996 operations; 13.9 MB/s (220999 of 220999 found) Microseconds per read: Count: 866996 Average: 277.5456 StdDev: 631.96 Min: 3 Median: 207.8875 Max: 80007 Percentiles: P50: 207.89 P75: 249.23 P99: 1344.49 P99.9: 9104.32 P99.99: 26098.86 ------------------------------------------------------ ( 2, 3 ] 3 0.000% 0.000% ( 3, 4 ] 24 0.003% 0.003% ( 4, 6 ] 67 0.008% 0.011% ( 6, 10 ] 214 0.025% 0.036% ( 10, 15 ] 1504 0.173% 0.209% ( 15, 22 ] 2971 0.343% 0.552% ( 22, 34 ] 8056 0.929% 1.481% ( 34, 51 ] 2352 0.271% 1.752% ( 51, 76 ] 339 0.039% 1.791% ( 76, 110 ] 1253 0.145% 1.936% ( 110, 170 ] 218101 25.156% 27.092% ##### ( 170, 250 ] 419376 48.371% 75.463% ########## ( 250, 380 ] 115080 13.273% 88.736% ### ( 380, 580 ] 58729 6.774% 95.510% # ( 580, 870 ] 21565 2.487% 97.997% ( 870, 1300 ] 8444 0.974% 98.971% ( 1300, 1900 ] 3345 0.386% 99.357% ( 1900, 2900 ] 1958 0.226% 99.583% ( 2900, 4400 ] 1598 0.184% 99.767% ( 4400, 6600 ] 744 0.086% 99.853% ( 6600, 9900 ] 535 0.062% 99.915% ( 9900, 14000 ] 350 0.040% 99.955% ( 14000, 22000 ] 270 0.031% 99.986% ( 22000, 33000 ] 84 0.010% 99.996% ( 33000, 50000 ] 30 0.003% 100.000% ( 50000, 75000 ] 3 0.000% 100.000% ( 75000, 110000 ] 1 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 14982581 rocksdb.bloom.filter.full.positive COUNT : 1011888 rocksdb.bloom.filter.full.true.positive COUNT : 866647 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 349 rocksdb.memtable.miss COUNT : 866647 rocksdb.l0.hit COUNT : 36058 rocksdb.l1.hit COUNT : 10275 rocksdb.l2andup.hit COUNT : 820314 rocksdb.compaction.key.drop.new COUNT : 192918 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 5080558 rocksdb.number.keys.read COUNT : 866996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 5243135856 rocksdb.bytes.read COUNT : 866996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1607 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 41398330 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 21317461352 rocksdb.compact.write.bytes COUNT : 21111736801 rocksdb.flush.write.bytes COUNT : 5152630726 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 32 rocksdb.number.superversion_acquires COUNT : 949 rocksdb.number.superversion_releases COUNT : 910 rocksdb.number.superversion_cleanups COUNT : 236 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 78 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 5110941696 rocksdb.memtable.garbage.bytes.at.flush COUNT : 1863680 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 25493691932 rocksdb.non.last.level.read.count COUNT : 6016121 rocksdb.block.checksum.compute.count COUNT : 6186846 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 207.035994 P95 : 564.251034 P99 : 1342.402395 P100 : 80006.000000 COUNT : 866996 SUM : 239810534 rocksdb.db.write.micros P50 : 1.517274 P95 : 4.449686 P99 : 9.765369 P100 : 454235.000000 COUNT : 5080558 SUM : 53965586 rocksdb.compaction.times.micros P50 : 1132894.736842 P95 : 3285000.000000 P99 : 37960000.000000 P100 : 38440794.000000 COUNT : 69 SUM : 130244449 rocksdb.compaction.times.cpu_micros P50 : 855166.666667 P95 : 1855000.000000 P99 : 16480000.000000 P100 : 18330347.000000 COUNT : 69 SUM : 84555849 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 914.791667 P95 : 8085.000000 P99 : 12503.500000 P100 : 13996.000000 COUNT : 73 SUM : 122578 rocksdb.compaction.outfile.sync.micros P50 : 11708.823529 P95 : 105826.923077 P99 : 169057.142857 P100 : 196427.000000 COUNT : 211 SUM : 5663533 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 231.333333 P95 : 2690.000000 P99 : 7887.000000 P100 : 15860.000000 COUNT : 161 SUM : 117103 rocksdb.table.open.io.micros P50 : 7080.857143 P95 : 15446.913580 P99 : 21795.555556 P100 : 49322.000000 COUNT : 1607 SUM : 11860609 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.861526 P95 : 10.981579 P99 : 225.712055 P100 : 31695.000000 COUNT : 5163782 SUM : 78836265 rocksdb.read.block.get.micros P50 : 158.418333 P95 : 460.882309 P99 : 1239.162055 P100 : 32063.000000 COUNT : 1021655 SUM : 208568436 rocksdb.write.raw.block.micros P50 : 0.527604 P95 : 1.070061 P99 : 3.489853 P100 : 44969.000000 COUNT : 6371370 SUM : 16642088 rocksdb.numfiles.in.singlecompaction P50 : 3.022727 P95 : 4.733333 P99 : 15.140000 P100 : 17.000000 COUNT : 98 SUM : 343 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567527 P95 : 1963.592233 P99 : 2726.257237 P100 : 454066.000000 COUNT : 214061 SUM : 41417726 rocksdb.sst.read.micros P50 : 1.973787 P95 : 210.666224 P99 : 507.100077 P100 : 32050.000000 COUNT : 6016539 SUM : 270785854 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 866996 SUM : 866996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 5080558 SUM : 5243135856 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 219491.525424 P95 : 549416.666667 P99 : 789433.333333 P100 : 791845.000000 COUNT : 73 SUM : 18764857 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 244 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0