[2024-12-07 19:24:17.965781] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... [2024-12-07 19:24:17.965880] [ DPDK EAL parameters: rocksdb --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid1764028 ] Set seed to 1733595857963405 because --seed was 0 EAL: No free 2048 kB hugepages reported on node 1 [2024-12-07 19:24:18.071100] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 [2024-12-07 19:24:18.273263] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0x80 specified. [2024-12-07 19:24:18.273307] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s rocksdb -p 1764028' to capture a snapshot of events at runtime. [2024-12-07 19:24:18.273318] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/rocksdb_trace.pid1764028 for offline analysis/debug. [2024-12-07 19:24:18.273362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 RocksDB: version 8.1.1 Date: Sat Dec 7 19:24:26 2024 CPU: 96 * Intel(R) Xeon(R) Gold 6252 CPU @ 2.10GHz CPUCache: 36608 KB 2024/12/07-19:24:34 ... thread 0: (1000000,1000000) ops and (123681.2,123681.2) ops/second in (8.085300,8.085300) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 6/4 566.86 MB 18.9 0.0 0.0 0.0 0.8 0.8 0.0 1.0 0.0 108.7 7.53 2.50 9 0.837 0 0 0.0 0.0 L1 3/3 160.65 MB 0.0 0.3 0.3 0.1 0.3 0.3 0.0 1.3 103.8 103.8 3.16 1.82 2 1.582 333K 212 0.0 0.0 L2 3/0 233.70 MB 2.3 0.2 0.1 0.1 0.2 0.1 0.0 3.1 130.7 130.5 1.45 0.88 1 1.451 192K 350 0.0 0.0 L3 46/10 3.96 GB 3.1 4.1 2.7 1.4 4.0 2.6 0.1 1.5 95.1 94.0 43.75 21.05 15 2.917 2557K 3503 0.0 0.0 L4 185/14 11.52 GB 1.1 2.3 1.7 0.6 2.2 1.7 0.3 1.3 104.4 103.1 22.21 11.57 17 1.307 1657K 0 0.0 0.0 L5 1100/0 90.43 GB 0.9 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1343/31 106.84 GB 0.0 6.8 4.7 2.1 7.6 5.4 0.4 9.5 89.6 99.1 78.11 37.81 44 1.775 4741K 4065 0.0 0.0 Int 0/0 0.00 KB 0.0 6.8 4.7 2.1 7.6 5.4 0.4 9.5 89.6 99.1 78.11 37.81 44 1.775 4741K 4065 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 6.8 4.7 2.1 6.8 4.6 0.0 0.0 99.1 98.1 70.58 35.31 35 2.017 4741K 4065 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.8 0.8 0.0 0.0 0.0 108.7 7.53 2.50 9 0.837 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 8.3 total, 8.1 interval Flush(GB): cumulative 0.800, interval 0.800 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 7.56 GB write, 936.30 MB/s write, 6.83 GB read, 846.54 MB/s read, 78.1 seconds Interval compaction: 7.56 GB write, 957.11 MB/s write, 6.83 GB read, 865.35 MB/s read, 78.1 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 21, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 21, interval: 21 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 99313 Average: 10.1743 StdDev: 240.70 Min: 1 Median: 1.9092 Max: 40521 Percentiles: P50: 1.91 P75: 2.90 P99: 9.22 P99.9: 2403.67 P99.99: 6316.74 ------------------------------------------------------ [ 0, 1 ] 4009 4.037% 4.037% # ( 1, 2 ] 50206 50.553% 54.590% ########## ( 2, 3 ] 22442 22.597% 77.187% ##### ( 3, 4 ] 9312 9.376% 86.564% ## ( 4, 6 ] 10907 10.982% 97.546% ## ( 6, 10 ] 1791 1.803% 99.350% ( 10, 15 ] 299 0.301% 99.651% ( 15, 22 ] 45 0.045% 99.696% ( 22, 34 ] 3 0.003% 99.699% ( 51, 76 ] 1 0.001% 99.700% ( 76, 110 ] 1 0.001% 99.701% ( 170, 250 ] 5 0.005% 99.706% ( 250, 380 ] 12 0.012% 99.718% ( 380, 580 ] 11 0.011% 99.729% ( 580, 870 ] 25 0.025% 99.754% ( 870, 1300 ] 51 0.051% 99.806% ( 1300, 1900 ] 68 0.068% 99.874% ( 1900, 2900 ] 51 0.051% 99.925% ( 2900, 4400 ] 51 0.051% 99.977% ( 4400, 6600 ] 15 0.015% 99.992% ( 6600, 9900 ] 2 0.002% 99.994% ( 9900, 14000 ] 1 0.001% 99.995% ( 14000, 22000 ] 2 0.002% 99.997% ( 22000, 33000 ] 2 0.002% 99.999% ( 33000, 50000 ] 1 0.001% 100.000% ** Level 1 read latency histogram (micros): Count: 46632 Average: 6.7672 StdDev: 112.17 Min: 1 Median: 1.9406 Max: 13778 Percentiles: P50: 1.94 P75: 2.96 P99: 9.57 P99.9: 1401.04 P99.99: 4585.24 ------------------------------------------------------ [ 0, 1 ] 1482 3.178% 3.178% # ( 1, 2 ] 23212 49.777% 52.955% ########## ( 2, 3 ] 10730 23.010% 75.965% ##### ( 3, 4 ] 4529 9.712% 85.677% ## ( 4, 6 ] 5397 11.574% 97.251% ## ( 6, 10 ] 914 1.960% 99.211% ( 10, 15 ] 226 0.485% 99.695% ( 15, 22 ] 28 0.060% 99.756% ( 22, 34 ] 3 0.006% 99.762% ( 51, 76 ] 2 0.004% 99.766% ( 110, 170 ] 4 0.009% 99.775% ( 170, 250 ] 2 0.004% 99.779% ( 250, 380 ] 2 0.004% 99.783% ( 380, 580 ] 12 0.026% 99.809% ( 580, 870 ] 18 0.039% 99.848% ( 870, 1300 ] 21 0.045% 99.893% ( 1300, 1900 ] 20 0.043% 99.936% ( 1900, 2900 ] 14 0.030% 99.966% ( 2900, 4400 ] 11 0.024% 99.989% ( 4400, 6600 ] 4 0.009% 99.998% ( 9900, 14000 ] 1 0.002% 100.000% ** Level 2 read latency histogram (micros): Count: 595869 Average: 20.1858 StdDev: 299.82 Min: 1 Median: 2.0133 Max: 42005 Percentiles: P50: 2.01 P75: 3.11 P99: 13.54 P99.9: 2305.80 P99.99: 2830.02 ------------------------------------------------------ [ 0, 1 ] 16782 2.816% 2.816% # ( 1, 2 ] 279233 46.861% 49.678% ######### ( 2, 3 ] 144039 24.173% 73.851% ##### ( 3, 4 ] 59939 10.059% 83.910% ## ( 4, 6 ] 69073 11.592% 95.502% ## ( 6, 10 ] 16834 2.825% 98.327% # ( 10, 15 ] 5665 0.951% 99.278% ( 15, 22 ] 888 0.149% 99.427% ( 22, 34 ] 86 0.014% 99.441% ( 34, 51 ] 16 0.003% 99.444% ( 51, 76 ] 30 0.005% 99.449% ( 76, 110 ] 6 0.001% 99.450% ( 110, 170 ] 16 0.003% 99.453% ( 170, 250 ] 23 0.004% 99.456% ( 250, 380 ] 88 0.015% 99.471% ( 380, 580 ] 221 0.037% 99.508% ( 580, 870 ] 391 0.066% 99.574% ( 870, 1300 ] 627 0.105% 99.679% ( 1300, 1900 ] 901 0.151% 99.830% ( 1900, 2900 ] 1023 0.172% 100.002% ( 2900, 4400 ] 697 0.117% 100.119% ( 4400, 6600 ] 238 0.040% 100.159% ( 6600, 9900 ] 52 0.009% 100.168% ( 9900, 14000 ] 18 0.003% 100.171% ( 14000, 22000 ] 22 0.004% 100.174% ( 22000, 33000 ] 19 0.003% 100.178% ( 33000, 50000 ] 4 0.001% 100.178% ** Level 3 read latency histogram (micros): Count: 770455 Average: 13.0430 StdDev: 211.64 Min: 1 Median: 1.9916 Max: 31570 Percentiles: P50: 1.99 P75: 2.99 P99: 10.00 P99.9: 1395.89 P99.99: 2015.07 ------------------------------------------------------ [ 0, 1 ] 17610 2.286% 2.286% ( 1, 2 ] 370726 48.118% 50.403% ########## ( 2, 3 ] 191649 24.875% 75.278% ##### ( 3, 4 ] 76623 9.945% 85.223% ## ( 4, 6 ] 88314 11.463% 96.686% ## ( 6, 10 ] 17833 2.315% 99.001% ( 10, 15 ] 4755 0.617% 99.618% ( 15, 22 ] 535 0.069% 99.687% ( 22, 34 ] 40 0.005% 99.692% ( 34, 51 ] 26 0.003% 99.696% ( 51, 76 ] 28 0.004% 99.699% ( 76, 110 ] 12 0.002% 99.701% ( 110, 170 ] 25 0.003% 99.704% ( 170, 250 ] 54 0.007% 99.711% ( 250, 380 ] 99 0.013% 99.724% ( 380, 580 ] 216 0.028% 99.752% ( 580, 870 ] 409 0.053% 99.805% ( 870, 1300 ] 617 0.080% 99.885% ( 1300, 1900 ] 723 0.094% 99.979% ( 1900, 2900 ] 747 0.097% 100.076% ( 2900, 4400 ] 545 0.071% 100.147% ( 4400, 6600 ] 168 0.022% 100.169% ( 6600, 9900 ] 33 0.004% 100.173% ( 9900, 14000 ] 12 0.002% 100.174% ( 14000, 22000 ] 19 0.002% 100.177% ( 22000, 33000 ] 9 0.001% 100.178% ** Level 4 read latency histogram (micros): Count: 236893 Average: 39.8325 StdDev: 553.89 Min: 1 Median: 2.0159 Max: 67564 Percentiles: P50: 2.02 P75: 3.11 P99: 1002.89 P99.9: 4029.68 P99.99: 5031.53 ------------------------------------------------------ [ 0, 1 ] 5198 2.194% 2.194% ( 1, 2 ] 112333 47.419% 49.614% ######### ( 2, 3 ] 57658 24.339% 73.953% ##### ( 3, 4 ] 23553 9.942% 83.895% ## ( 4, 6 ] 26590 11.224% 95.120% ## ( 6, 10 ] 6113 2.580% 97.700% # ( 10, 15 ] 1950 0.823% 98.523% ( 15, 22 ] 177 0.075% 98.598% ( 22, 34 ] 13 0.005% 98.604% ( 34, 51 ] 8 0.003% 98.607% ( 51, 76 ] 12 0.005% 98.612% ( 76, 110 ] 12 0.005% 98.617% ( 110, 170 ] 11 0.005% 98.622% ( 170, 250 ] 52 0.022% 98.644% ( 250, 380 ] 94 0.040% 98.683% ( 380, 580 ] 196 0.083% 98.766% ( 580, 870 ] 381 0.161% 98.927% ( 870, 1300 ] 560 0.236% 99.163% ( 1300, 1900 ] 640 0.270% 99.433% ( 1900, 2900 ] 657 0.277% 99.711% ( 2900, 4400 ] 595 0.251% 99.962% ( 4400, 6600 ] 231 0.098% 100.060% ( 6600, 9900 ] 44 0.019% 100.078% ( 9900, 14000 ] 3 0.001% 100.079% ( 14000, 22000 ] 18 0.008% 100.087% ( 22000, 33000 ] 18 0.008% 100.095% ( 33000, 50000 ] 10 0.004% 100.099% ( 50000, 75000 ] 4 0.002% 100.100% ** Level 5 read latency histogram (micros): Count: 9226 Average: 2560.4481 StdDev: 3184.77 Min: 91 Median: 1870.3985 Max: 76748 Percentiles: P50: 1870.40 P75: 3464.75 P99: 9665.78 P99.9: 48511.29 P99.99: 76748.00 ------------------------------------------------------ ( 76, 110 ] 2 0.022% 0.022% ( 110, 170 ] 20 0.217% 0.238% ( 170, 250 ] 66 0.715% 0.954% ( 250, 380 ] 188 2.038% 2.992% ( 380, 580 ] 474 5.138% 8.129% # ( 580, 870 ] 947 10.264% 18.394% ## ( 870, 1300 ] 1413 15.315% 33.709% ### ( 1300, 1900 ] 1581 17.136% 50.845% ### ( 1900, 2900 ] 1602 17.364% 68.209% ### ( 2900, 4400 ] 1664 18.036% 86.245% #### ( 4400, 6600 ] 977 10.590% 96.835% ## ( 6600, 9900 ] 215 2.330% 99.165% ( 9900, 14000 ] 19 0.206% 99.371% ( 14000, 22000 ] 13 0.141% 99.512% ( 22000, 33000 ] 23 0.249% 99.762% ( 33000, 50000 ] 14 0.152% 99.913% ( 50000, 75000 ] 7 0.076% 99.989% ( 75000, 110000 ] 1 0.011% 100.000% ** DB Stats ** Uptime(secs): 8.3 total, 8.1 interval Cumulative writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.96 GB, 119.05 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:4.190 H:M:S, 50.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 121.68 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:4.190 H:M:S, 51.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 10 num-running-flushes: 1 2024/12/07-19:24:41 ... thread 0: (1000000,2000000) ops and (153528.6,136998.1) ops/second in (6.513443,14.598743) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 12/8 1.17 GB 31.5 0.4 0.0 0.4 2.2 1.8 0.0 1.2 22.6 131.5 16.76 7.30 23 0.729 383K 565 0.0 0.0 L1 2/2 135.52 MB 0.0 0.8 0.6 0.2 0.8 0.6 0.0 1.4 105.1 104.9 8.25 4.50 3 2.750 880K 1376 0.0 0.0 L2 3/3 351.82 MB 0.0 0.2 0.1 0.1 0.2 0.1 0.4 3.1 130.7 130.5 1.45 0.88 1 1.451 192K 350 0.0 0.0 L3 31/19 2.01 GB 0.7 4.8 2.8 2.0 4.7 2.8 0.2 1.7 100.9 99.8 48.64 24.52 18 2.702 2732K 3503 0.0 0.0 L4 165/0 9.66 GB 1.0 6.7 3.9 2.8 6.6 3.8 0.3 1.7 107.6 105.8 63.83 34.39 37 1.725 3458K 865 0.0 0.0 L5 1148/0 94.43 GB 1.0 0.0 0.0 0.0 0.0 0.0 4.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1361/32 107.74 GB 0.0 12.9 7.4 5.5 14.5 9.1 4.9 8.1 95.1 107.0 138.92 71.60 82 1.694 7648K 6659 0.0 0.0 Int 0/0 0.00 KB 0.0 12.9 7.4 5.5 14.5 9.1 4.9 8.1 95.1 107.0 138.92 71.60 82 1.694 7648K 6659 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 12.9 7.4 5.5 12.7 7.3 0.0 0.0 105.6 104.3 125.06 66.12 60 2.084 7648K 6659 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 1.8 1.8 0.0 0.0 0.0 131.8 13.87 5.48 22 0.630 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 14.8 total, 14.6 interval Flush(GB): cumulative 1.784, interval 1.784 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 14.52 GB write, 1005.99 MB/s write, 12.90 GB read, 893.62 MB/s read, 138.9 seconds Interval compaction: 14.52 GB write, 1018.37 MB/s write, 12.90 GB read, 904.62 MB/s read, 138.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 41, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 41, interval: 41 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 389228 Average: 10.0662 StdDev: 241.50 Min: 1 Median: 1.8954 Max: 55730 Percentiles: P50: 1.90 P75: 2.87 P99: 9.88 P99.9: 1603.87 P99.99: 3847.09 ------------------------------------------------------ [ 0, 1 ] 15485 3.978% 3.978% # ( 1, 2 ] 200058 51.399% 55.377% ########## ( 2, 3 ] 88253 22.674% 78.051% ##### ( 3, 4 ] 34617 8.894% 86.945% ## ( 4, 6 ] 39806 10.227% 97.172% ## ( 6, 10 ] 7341 1.886% 99.058% ( 10, 15 ] 1761 0.452% 99.510% ( 15, 22 ] 202 0.052% 99.562% ( 22, 34 ] 17 0.004% 99.566% ( 34, 51 ] 12 0.003% 99.569% ( 51, 76 ] 15 0.004% 99.573% ( 76, 110 ] 3 0.001% 99.574% ( 110, 170 ] 23 0.006% 99.580% ( 170, 250 ] 82 0.021% 99.601% ( 250, 380 ] 155 0.040% 99.641% ( 380, 580 ] 239 0.061% 99.702% ( 580, 870 ] 324 0.083% 99.785% ( 870, 1300 ] 347 0.089% 99.875% ( 1300, 1900 ] 197 0.051% 99.925% ( 1900, 2900 ] 159 0.041% 99.966% ( 2900, 4400 ] 149 0.038% 100.004% ( 4400, 6600 ] 34 0.009% 100.013% ( 6600, 9900 ] 6 0.002% 100.015% ( 9900, 14000 ] 6 0.002% 100.016% ( 14000, 22000 ] 5 0.001% 100.017% ( 22000, 33000 ] 7 0.002% 100.019% ( 33000, 50000 ] 5 0.001% 100.021% ( 50000, 75000 ] 1 0.000% 100.021% ** Level 1 read latency histogram (micros): Count: 165119 Average: 9.7797 StdDev: 123.23 Min: 1 Median: 1.9687 Max: 13778 Percentiles: P50: 1.97 P75: 2.94 P99: 12.27 P99.9: 1771.11 P99.99: 4083.31 ------------------------------------------------------ [ 0, 1 ] 3501 2.120% 2.120% ( 1, 2 ] 81611 49.426% 51.546% ########## ( 2, 3 ] 41049 24.860% 76.406% ##### ( 3, 4 ] 15402 9.328% 85.734% ## ( 4, 6 ] 17870 10.822% 96.556% ## ( 6, 10 ] 3607 2.184% 98.741% ( 10, 15 ] 942 0.570% 99.311% ( 15, 22 ] 133 0.081% 99.392% ( 22, 34 ] 14 0.008% 99.400% ( 34, 51 ] 5 0.003% 99.403% ( 51, 76 ] 12 0.007% 99.411% ( 110, 170 ] 18 0.011% 99.422% ( 170, 250 ] 47 0.028% 99.450% ( 250, 380 ] 115 0.070% 99.520% ( 380, 580 ] 180 0.109% 99.629% ( 580, 870 ] 207 0.125% 99.754% ( 870, 1300 ] 171 0.104% 99.858% ( 1300, 1900 ] 89 0.054% 99.912% ( 1900, 2900 ] 79 0.048% 99.959% ( 2900, 4400 ] 64 0.039% 99.998% ( 4400, 6600 ] 18 0.011% 100.009% ( 6600, 9900 ] 1 0.001% 100.010% ( 9900, 14000 ] 1 0.001% 100.010% ** Level 2 read latency histogram (micros): Count: 676702 Average: 19.6044 StdDev: 301.79 Min: 1 Median: 2.0286 Max: 42005 Percentiles: P50: 2.03 P75: 3.13 P99: 13.58 P99.9: 2329.39 P99.99: 2910.55 ------------------------------------------------------ [ 0, 1 ] 18030 2.664% 2.664% # ( 1, 2 ] 315603 46.638% 49.303% ######### ( 2, 3 ] 165183 24.410% 73.713% ##### ( 3, 4 ] 68189 10.077% 83.789% ## ( 4, 6 ] 79035 11.679% 95.469% ## ( 6, 10 ] 19276 2.849% 98.317% # ( 10, 15 ] 6455 0.954% 99.271% ( 15, 22 ] 972 0.144% 99.415% ( 22, 34 ] 100 0.015% 99.430% ( 34, 51 ] 27 0.004% 99.434% ( 51, 76 ] 44 0.007% 99.440% ( 76, 110 ] 9 0.001% 99.442% ( 110, 170 ] 19 0.003% 99.444% ( 170, 250 ] 30 0.004% 99.449% ( 250, 380 ] 121 0.018% 99.467% ( 380, 580 ] 284 0.042% 99.509% ( 580, 870 ] 502 0.074% 99.583% ( 870, 1300 ] 731 0.108% 99.691% ( 1300, 1900 ] 961 0.142% 99.833% ( 1900, 2900 ] 1058 0.156% 99.989% ( 2900, 4400 ] 758 0.112% 100.101% ( 4400, 6600 ] 256 0.038% 100.139% ( 6600, 9900 ] 58 0.009% 100.148% ( 9900, 14000 ] 18 0.003% 100.150% ( 14000, 22000 ] 25 0.004% 100.154% ( 22000, 33000 ] 22 0.003% 100.157% ( 33000, 50000 ] 6 0.001% 100.158% ** Level 3 read latency histogram (micros): Count: 1469489 Average: 11.3056 StdDev: 201.35 Min: 1 Median: 2.0008 Max: 41619 Percentiles: P50: 2.00 P75: 2.98 P99: 10.57 P99.9: 999.29 P99.99: 1555.69 ------------------------------------------------------ [ 0, 1 ] 28246 1.922% 1.922% ( 1, 2 ] 706198 48.057% 49.980% ########## ( 2, 3 ] 373944 25.447% 75.427% ##### ( 3, 4 ] 143894 9.792% 85.219% ## ( 4, 6 ] 165353 11.252% 96.471% ## ( 6, 10 ] 36018 2.451% 98.922% ( 10, 15 ] 9951 0.677% 99.600% ( 15, 22 ] 1129 0.077% 99.676% ( 22, 34 ] 80 0.005% 99.682% ( 34, 51 ] 81 0.006% 99.687% ( 51, 76 ] 115 0.008% 99.695% ( 76, 110 ] 30 0.002% 99.697% ( 110, 170 ] 79 0.005% 99.703% ( 170, 250 ] 200 0.014% 99.716% ( 250, 380 ] 410 0.028% 99.744% ( 380, 580 ] 744 0.051% 99.795% ( 580, 870 ] 1182 0.080% 99.875% ( 870, 1300 ] 1219 0.083% 99.958% ( 1300, 1900 ] 1103 0.075% 100.033% ( 1900, 2900 ] 1006 0.068% 100.102% ( 2900, 4400 ] 738 0.050% 100.152% ( 4400, 6600 ] 223 0.015% 100.167% ( 6600, 9900 ] 44 0.003% 100.170% ( 9900, 14000 ] 17 0.001% 100.171% ( 14000, 22000 ] 27 0.002% 100.173% ( 22000, 33000 ] 17 0.001% 100.174% ( 33000, 50000 ] 6 0.000% 100.175% ** Level 4 read latency histogram (micros): Count: 718518 Average: 27.2237 StdDev: 448.68 Min: 1 Median: 2.0263 Max: 67564 Percentiles: P50: 2.03 P75: 3.09 P99: 367.78 P99.9: 2968.55 P99.99: 3902.14 ------------------------------------------------------ [ 0, 1 ] 14605 2.033% 2.033% ( 1, 2 ] 339971 47.316% 49.348% ######### ( 2, 3 ] 178143 24.793% 74.141% ##### ( 3, 4 ] 70695 9.839% 83.980% ## ( 4, 6 ] 81549 11.350% 95.330% ## ( 6, 10 ] 19143 2.664% 97.994% # ( 10, 15 ] 5681 0.791% 98.785% ( 15, 22 ] 579 0.081% 98.865% ( 22, 34 ] 45 0.006% 98.872% ( 34, 51 ] 39 0.005% 98.877% ( 51, 76 ] 65 0.009% 98.886% ( 76, 110 ] 26 0.004% 98.890% ( 110, 170 ] 76 0.011% 98.900% ( 170, 250 ] 242 0.034% 98.934% ( 250, 380 ] 523 0.073% 99.007% ( 380, 580 ] 1025 0.143% 99.149% ( 580, 870 ] 1502 0.209% 99.359% ( 870, 1300 ] 1490 0.207% 99.566% ( 1300, 1900 ] 1228 0.171% 99.737% ( 1900, 2900 ] 1125 0.157% 99.893% ( 2900, 4400 ] 1039 0.145% 100.038% ( 4400, 6600 ] 379 0.053% 100.091% ( 6600, 9900 ] 68 0.009% 100.100% ( 9900, 14000 ] 9 0.001% 100.101% ( 14000, 22000 ] 34 0.005% 100.106% ( 22000, 33000 ] 44 0.006% 100.112% ( 33000, 50000 ] 26 0.004% 100.116% ( 50000, 75000 ] 5 0.001% 100.117% ** Level 5 read latency histogram (micros): Count: 26091 Average: 1660.8010 StdDev: 2526.53 Min: 91 Median: 1029.4491 Max: 76748 Percentiles: P50: 1029.45 P75: 2032.84 P99: 8057.13 P99.9: 40881.77 P99.99: 70530.28 ------------------------------------------------------ ( 76, 110 ] 19 0.073% 0.073% ( 110, 170 ] 277 1.062% 1.134% ( 170, 250 ] 779 2.986% 4.120% # ( 250, 380 ] 1914 7.336% 11.456% # ( 380, 580 ] 3564 13.660% 25.116% ### ( 580, 870 ] 4766 18.267% 43.383% #### ( 870, 1300 ] 4656 17.845% 61.228% #### ( 1300, 1900 ] 3231 12.384% 73.612% ## ( 1900, 2900 ] 2727 10.452% 84.063% ## ( 2900, 4400 ] 2572 9.858% 93.921% ## ( 4400, 6600 ] 1220 4.676% 98.597% # ( 6600, 9900 ] 238 0.912% 99.509% ( 9900, 14000 ] 25 0.096% 99.605% ( 14000, 22000 ] 22 0.084% 99.690% ( 22000, 33000 ] 41 0.157% 99.847% ( 33000, 50000 ] 30 0.115% 99.962% ( 50000, 75000 ] 9 0.034% 99.996% ( 75000, 110000 ] 1 0.004% 100.000% ** DB Stats ** Uptime(secs): 14.8 total, 6.5 interval Cumulative writes: 0 writes, 2000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 1.92 GB, 133.18 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:6.856 H:M:S, 46.4 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 151.10 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:2.665 H:M:S, 40.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/12/07-19:24:46 ... thread 0: (1000000,3000000) ops and (210025.4,154958.1) ops/second in (4.761328,19.360071) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 11/11 1.54 GB 0.0 1.4 0.0 1.4 4.1 2.8 0.0 1.5 53.0 161.3 26.16 14.24 42 0.623 1407K 1528 0.0 0.0 L1 4/4 277.94 MB 0.0 1.6 1.2 0.4 1.6 1.2 0.0 1.3 133.0 132.7 12.27 8.06 4 3.068 1656K 3375 0.0 0.0 L2 3/2 386.31 MB 1.3 0.2 0.1 0.1 0.2 0.1 0.9 3.1 130.7 130.5 1.45 0.88 1 1.451 192K 350 0.0 0.0 L3 25/9 1.38 GB 0.9 6.7 3.3 3.4 6.6 3.2 0.2 2.0 113.5 112.5 60.45 33.62 22 2.748 4064K 8188 0.0 0.0 L4 169/2 9.64 GB 1.0 8.1 4.6 3.5 7.9 4.4 0.7 1.7 110.6 108.6 74.63 41.24 47 1.588 4118K 865 0.0 0.0 L5 1160/0 95.47 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1372/28 108.68 GB 0.0 17.9 9.1 8.8 20.5 11.7 6.9 7.4 104.7 119.7 174.96 98.04 116 1.508 11M 14K 0.0 0.0 Int 0/0 0.00 KB 0.0 17.9 9.1 8.8 20.5 11.7 6.9 7.4 104.7 119.7 174.96 98.04 116 1.508 11M 14K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 17.9 9.1 8.8 17.7 8.9 0.0 0.0 117.1 115.8 156.43 89.75 79 1.980 11M 14K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 2.8 2.8 0.0 0.0 0.0 153.0 18.53 8.29 37 0.501 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 19.5 total, 19.4 interval Flush(GB): cumulative 2.768, interval 2.768 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 20.45 GB write, 1071.69 MB/s write, 17.89 GB read, 937.73 MB/s read, 175.0 seconds Interval compaction: 20.45 GB write, 1081.64 MB/s write, 17.89 GB read, 946.43 MB/s read, 175.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 49, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 49, interval: 49 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 718868 Average: 8.9812 StdDev: 192.69 Min: 1 Median: 1.8566 Max: 55730 Percentiles: P50: 1.86 P75: 2.79 P99: 9.88 P99.9: 1209.38 P99.99: 2771.94 ------------------------------------------------------ [ 0, 1 ] 31882 4.435% 4.435% # ( 1, 2 ] 382374 53.191% 57.626% ########### ( 2, 3 ] 158642 22.068% 79.694% #### ( 3, 4 ] 59987 8.345% 88.039% ## ( 4, 6 ] 67033 9.325% 97.364% ## ( 6, 10 ] 12136 1.688% 99.052% ( 10, 15 ] 2732 0.380% 99.432% ( 15, 22 ] 288 0.040% 99.472% ( 22, 34 ] 18 0.003% 99.475% ( 34, 51 ] 20 0.003% 99.478% ( 51, 76 ] 30 0.004% 99.482% ( 76, 110 ] 11 0.002% 99.483% ( 110, 170 ] 137 0.019% 99.502% ( 170, 250 ] 392 0.055% 99.557% ( 250, 380 ] 566 0.079% 99.636% ( 380, 580 ] 716 0.100% 99.735% ( 580, 870 ] 726 0.101% 99.836% ( 870, 1300 ] 583 0.081% 99.917% ( 1300, 1900 ] 307 0.043% 99.960% ( 1900, 2900 ] 249 0.035% 99.995% ( 2900, 4400 ] 187 0.026% 100.021% ( 4400, 6600 ] 45 0.006% 100.027% ( 6600, 9900 ] 6 0.001% 100.028% ( 9900, 14000 ] 10 0.001% 100.029% ( 14000, 22000 ] 7 0.001% 100.030% ( 22000, 33000 ] 8 0.001% 100.031% ( 33000, 50000 ] 5 0.001% 100.032% ( 50000, 75000 ] 1 0.000% 100.032% ** Level 1 read latency histogram (micros): Count: 306408 Average: 9.2478 StdDev: 186.13 Min: 1 Median: 1.9530 Max: 64993 Percentiles: P50: 1.95 P75: 2.91 P99: 11.08 P99.9: 1401.34 P99.99: 3993.52 ------------------------------------------------------ [ 0, 1 ] 6426 2.097% 2.097% ( 1, 2 ] 154017 50.265% 52.363% ########## ( 2, 3 ] 76255 24.887% 77.249% ##### ( 3, 4 ] 27744 9.055% 86.304% ## ( 4, 6 ] 31701 10.346% 96.650% ## ( 6, 10 ] 6845 2.234% 98.884% ( 10, 15 ] 1653 0.539% 99.423% ( 15, 22 ] 183 0.060% 99.483% ( 22, 34 ] 17 0.006% 99.489% ( 34, 51 ] 18 0.006% 99.494% ( 51, 76 ] 29 0.009% 99.504% ( 76, 110 ] 1 0.000% 99.504% ( 110, 170 ] 39 0.013% 99.517% ( 170, 250 ] 111 0.036% 99.553% ( 250, 380 ] 208 0.068% 99.621% ( 380, 580 ] 285 0.093% 99.714% ( 580, 870 ] 314 0.102% 99.817% ( 870, 1300 ] 236 0.077% 99.894% ( 1300, 1900 ] 116 0.038% 99.931% ( 1900, 2900 ] 105 0.034% 99.966% ( 2900, 4400 ] 102 0.033% 99.999% ( 4400, 6600 ] 38 0.012% 100.011% ( 6600, 9900 ] 6 0.002% 100.013% ( 9900, 14000 ] 2 0.001% 100.014% ( 14000, 22000 ] 4 0.001% 100.015% ( 22000, 33000 ] 1 0.000% 100.016% ( 50000, 75000 ] 1 0.000% 100.016% ** Level 2 read latency histogram (micros): Count: 676702 Average: 19.6044 StdDev: 301.79 Min: 1 Median: 2.0286 Max: 42005 Percentiles: P50: 2.03 P75: 3.13 P99: 13.58 P99.9: 2329.39 P99.99: 2910.55 ------------------------------------------------------ [ 0, 1 ] 18030 2.664% 2.664% # ( 1, 2 ] 315603 46.638% 49.303% ######### ( 2, 3 ] 165183 24.410% 73.713% ##### ( 3, 4 ] 68189 10.077% 83.789% ## ( 4, 6 ] 79035 11.679% 95.469% ## ( 6, 10 ] 19276 2.849% 98.317% # ( 10, 15 ] 6455 0.954% 99.271% ( 15, 22 ] 972 0.144% 99.415% ( 22, 34 ] 100 0.015% 99.430% ( 34, 51 ] 27 0.004% 99.434% ( 51, 76 ] 44 0.007% 99.440% ( 76, 110 ] 9 0.001% 99.442% ( 110, 170 ] 19 0.003% 99.444% ( 170, 250 ] 30 0.004% 99.449% ( 250, 380 ] 121 0.018% 99.467% ( 380, 580 ] 284 0.042% 99.509% ( 580, 870 ] 502 0.074% 99.583% ( 870, 1300 ] 731 0.108% 99.691% ( 1300, 1900 ] 961 0.142% 99.833% ( 1900, 2900 ] 1058 0.156% 99.989% ( 2900, 4400 ] 758 0.112% 100.101% ( 4400, 6600 ] 256 0.038% 100.139% ( 6600, 9900 ] 58 0.009% 100.148% ( 9900, 14000 ] 18 0.003% 100.150% ( 14000, 22000 ] 25 0.004% 100.154% ( 22000, 33000 ] 22 0.003% 100.157% ( 33000, 50000 ] 6 0.001% 100.158% ** Level 3 read latency histogram (micros): Count: 1977298 Average: 10.4336 StdDev: 196.40 Min: 1 Median: 1.9915 Max: 68972 Percentiles: P50: 1.99 P75: 2.97 P99: 10.31 P99.9: 842.72 P99.99: 1382.57 ------------------------------------------------------ [ 0, 1 ] 36841 1.863% 1.863% ( 1, 2 ] 959974 48.550% 50.413% ########## ( 2, 3 ] 503398 25.459% 75.872% ##### ( 3, 4 ] 190364 9.627% 85.499% ## ( 4, 6 ] 218078 11.029% 96.528% ## ( 6, 10 ] 48092 2.432% 98.961% ( 10, 15 ] 12749 0.645% 99.605% ( 15, 22 ] 1355 0.069% 99.674% ( 22, 34 ] 91 0.005% 99.679% ( 34, 51 ] 103 0.005% 99.684% ( 51, 76 ] 165 0.008% 99.692% ( 76, 110 ] 44 0.002% 99.694% ( 110, 170 ] 168 0.008% 99.703% ( 170, 250 ] 439 0.022% 99.725% ( 250, 380 ] 809 0.041% 99.766% ( 380, 580 ] 1203 0.061% 99.827% ( 580, 870 ] 1598 0.081% 99.908% ( 870, 1300 ] 1460 0.074% 99.981% ( 1300, 1900 ] 1230 0.062% 100.044% ( 1900, 2900 ] 1104 0.056% 100.099% ( 2900, 4400 ] 861 0.044% 100.143% ( 4400, 6600 ] 273 0.014% 100.157% ( 6600, 9900 ] 54 0.003% 100.160% ( 9900, 14000 ] 22 0.001% 100.161% ( 14000, 22000 ] 32 0.002% 100.162% ( 22000, 33000 ] 21 0.001% 100.163% ( 33000, 50000 ] 7 0.000% 100.164% ( 50000, 75000 ] 1 0.000% 100.164% ** Level 4 read latency histogram (micros): Count: 936330 Average: 26.4335 StdDev: 416.66 Min: 1 Median: 2.0341 Max: 67564 Percentiles: P50: 2.03 P75: 3.11 P99: 428.16 P99.9: 2822.54 P99.99: 3780.90 ------------------------------------------------------ [ 0, 1 ] 18900 2.019% 2.019% ( 1, 2 ] 441373 47.139% 49.157% ######### ( 2, 3 ] 231416 24.715% 73.872% ##### ( 3, 4 ] 92051 9.831% 83.703% ## ( 4, 6 ] 107136 11.442% 95.146% ## ( 6, 10 ] 25013 2.671% 97.817% # ( 10, 15 ] 7525 0.804% 98.621% ( 15, 22 ] 732 0.078% 98.699% ( 22, 34 ] 58 0.006% 98.705% ( 34, 51 ] 47 0.005% 98.710% ( 51, 76 ] 79 0.008% 98.718% ( 76, 110 ] 45 0.005% 98.723% ( 110, 170 ] 248 0.026% 98.750% ( 170, 250 ] 714 0.076% 98.826% ( 250, 380 ] 1191 0.127% 98.953% ( 380, 580 ] 1822 0.195% 99.148% ( 580, 870 ] 2316 0.247% 99.395% ( 870, 1300 ] 2037 0.218% 99.613% ( 1300, 1900 ] 1460 0.156% 99.769% ( 1900, 2900 ] 1334 0.142% 99.911% ( 2900, 4400 ] 1259 0.134% 100.045% ( 4400, 6600 ] 473 0.051% 100.096% ( 6600, 9900 ] 91 0.010% 100.106% ( 9900, 14000 ] 14 0.001% 100.107% ( 14000, 22000 ] 42 0.004% 100.112% ( 22000, 33000 ] 48 0.005% 100.117% ( 33000, 50000 ] 28 0.003% 100.120% ( 50000, 75000 ] 5 0.001% 100.120% ** Level 5 read latency histogram (micros): Count: 43666 Average: 1316.1042 StdDev: 2187.96 Min: 87 Median: 766.9714 Max: 76748 Percentiles: P50: 766.97 P75: 1499.06 P99: 6576.73 P99.9: 33189.27 P99.99: 68525.77 ------------------------------------------------------ ( 76, 110 ] 78 0.179% 0.179% ( 110, 170 ] 1243 2.847% 3.025% # ( 170, 250 ] 2930 6.710% 9.735% # ( 250, 380 ] 4966 11.373% 21.108% ## ( 380, 580 ] 7326 16.777% 37.885% ### ( 580, 870 ] 8205 18.790% 56.676% #### ( 870, 1300 ] 6698 15.339% 72.015% ### ( 1300, 1900 ] 3929 8.998% 81.013% ## ( 1900, 2900 ] 3443 7.885% 88.898% ## ( 2900, 4400 ] 3040 6.962% 95.859% # ( 4400, 6600 ] 1386 3.174% 99.034% # ( 6600, 9900 ] 265 0.607% 99.640% ( 9900, 14000 ] 29 0.066% 99.707% ( 14000, 22000 ] 40 0.092% 99.798% ( 22000, 33000 ] 44 0.101% 99.899% ( 33000, 50000 ] 30 0.069% 99.968% ( 50000, 75000 ] 13 0.030% 99.998% ( 75000, 110000 ] 1 0.002% 100.000% ** DB Stats ** Uptime(secs): 19.5 total, 4.8 interval Cumulative writes: 0 writes, 3000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 2.88 GB, 151.09 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:7.780 H:M:S, 39.8 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 206.71 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.924 H:M:S, 19.4 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 5 num-running-flushes: 1 2024/12/07-19:24:50 ... thread 0: (1000000,4000000) ops and (239625.8,169972.3) ops/second in (4.173174,23.533245) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 14/7 2.52 GB 125.9 2.3 0.0 2.3 6.1 3.8 0.0 1.6 69.3 180.5 34.53 21.28 61 0.566 2430K 2484 0.0 0.0 L1 4/4 277.94 MB 0.0 1.6 1.2 0.4 1.6 1.2 0.0 1.3 133.0 132.7 12.27 8.06 4 3.068 1656K 3375 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 3.1 130.7 130.5 1.45 0.88 1 1.451 192K 350 0.0 0.0 L3 18/2 1.06 GB 0.9 7.8 3.6 4.1 7.7 3.6 0.2 2.1 118.9 118.0 66.80 38.80 25 2.672 5166K 13K 0.0 0.0 L4 175/9 9.98 GB 1.0 9.3 5.1 4.2 9.1 4.9 0.8 1.8 114.6 112.3 82.87 47.24 56 1.480 4780K 865 0.0 0.0 L5 1164/0 95.78 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.4 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1375/22 109.62 GB 0.0 21.1 10.1 11.1 24.6 13.6 7.3 6.6 109.4 127.5 197.92 116.25 147 1.346 14M 20K 0.0 0.0 Int 0/0 0.00 KB 0.0 21.1 10.1 11.1 24.6 13.6 7.3 6.6 109.4 127.5 197.92 116.25 147 1.346 14M 20K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 21.1 10.1 11.1 20.9 9.8 0.0 0.0 123.5 122.1 175.29 105.03 95 1.845 14M 20K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 3.8 3.8 0.0 0.0 0.0 169.9 22.62 11.21 52 0.435 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 23.7 total, 23.5 interval Flush(GB): cumulative 3.753, interval 3.753 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 24.65 GB write, 1064.31 MB/s write, 21.15 GB read, 913.12 MB/s read, 197.9 seconds Interval compaction: 24.65 GB write, 1072.44 MB/s write, 21.15 GB read, 920.09 MB/s read, 197.9 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 0, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 0, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 0, total-stops: 55, interval: 55 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1102896 Average: 9.4691 StdDev: 175.42 Min: 1 Median: 1.8088 Max: 55730 Percentiles: P50: 1.81 P75: 2.69 P99: 13.69 P99.9: 1102.02 P99.99: 2296.72 ------------------------------------------------------ [ 0, 1 ] 60810 5.514% 5.514% # ( 1, 2 ] 606639 55.004% 60.518% ########### ( 2, 3 ] 230839 20.930% 81.448% #### ( 3, 4 ] 83684 7.588% 89.036% ## ( 4, 6 ] 90473 8.203% 97.239% ## ( 6, 10 ] 16732 1.517% 98.756% ( 10, 15 ] 3646 0.331% 99.087% ( 15, 22 ] 382 0.035% 99.121% ( 22, 34 ] 26 0.002% 99.124% ( 34, 51 ] 23 0.002% 99.126% ( 51, 76 ] 36 0.003% 99.129% ( 76, 110 ] 76 0.007% 99.136% ( 110, 170 ] 1299 0.118% 99.254% ( 170, 250 ] 1829 0.166% 99.420% ( 250, 380 ] 1705 0.155% 99.574% ( 380, 580 ] 1675 0.152% 99.726% ( 580, 870 ] 1420 0.129% 99.855% ( 870, 1300 ] 925 0.084% 99.939% ( 1300, 1900 ] 435 0.039% 99.978% ( 1900, 2900 ] 332 0.030% 100.008% ( 2900, 4400 ] 254 0.023% 100.031% ( 4400, 6600 ] 64 0.006% 100.037% ( 6600, 9900 ] 8 0.001% 100.038% ( 9900, 14000 ] 12 0.001% 100.039% ( 14000, 22000 ] 9 0.001% 100.040% ( 22000, 33000 ] 11 0.001% 100.041% ( 33000, 50000 ] 6 0.001% 100.041% ( 50000, 75000 ] 1 0.000% 100.041% ** Level 1 read latency histogram (micros): Count: 343798 Average: 8.9384 StdDev: 177.23 Min: 1 Median: 1.9346 Max: 64993 Percentiles: P50: 1.93 P75: 2.88 P99: 11.48 P99.9: 1278.08 P99.99: 3967.94 ------------------------------------------------------ [ 0, 1 ] 7837 2.280% 2.280% ( 1, 2 ] 175546 51.061% 53.340% ########## ( 2, 3 ] 84911 24.698% 78.038% ##### ( 3, 4 ] 30065 8.745% 86.783% ## ( 4, 6 ] 33879 9.854% 96.638% ## ( 6, 10 ] 7583 2.206% 98.843% ( 10, 15 ] 1827 0.531% 99.375% ( 15, 22 ] 191 0.056% 99.430% ( 22, 34 ] 18 0.005% 99.435% ( 34, 51 ] 18 0.005% 99.441% ( 51, 76 ] 29 0.008% 99.449% ( 76, 110 ] 5 0.001% 99.451% ( 110, 170 ] 134 0.039% 99.490% ( 170, 250 ] 213 0.062% 99.551% ( 250, 380 ] 276 0.080% 99.632% ( 380, 580 ] 335 0.097% 99.729% ( 580, 870 ] 349 0.102% 99.831% ( 870, 1300 ] 251 0.073% 99.904% ( 1300, 1900 ] 118 0.034% 99.938% ( 1900, 2900 ] 106 0.031% 99.969% ( 2900, 4400 ] 102 0.030% 99.999% ( 4400, 6600 ] 39 0.011% 100.010% ( 6600, 9900 ] 7 0.002% 100.012% ( 9900, 14000 ] 2 0.001% 100.013% ( 14000, 22000 ] 4 0.001% 100.014% ( 22000, 33000 ] 1 0.000% 100.014% ( 50000, 75000 ] 1 0.000% 100.014% ** Level 2 read latency histogram (micros): Count: 676702 Average: 19.6044 StdDev: 301.79 Min: 1 Median: 2.0286 Max: 42005 Percentiles: P50: 2.03 P75: 3.13 P99: 13.58 P99.9: 2329.39 P99.99: 2910.55 ------------------------------------------------------ [ 0, 1 ] 18030 2.664% 2.664% # ( 1, 2 ] 315603 46.638% 49.303% ######### ( 2, 3 ] 165183 24.410% 73.713% ##### ( 3, 4 ] 68189 10.077% 83.789% ## ( 4, 6 ] 79035 11.679% 95.469% ## ( 6, 10 ] 19276 2.849% 98.317% # ( 10, 15 ] 6455 0.954% 99.271% ( 15, 22 ] 972 0.144% 99.415% ( 22, 34 ] 100 0.015% 99.430% ( 34, 51 ] 27 0.004% 99.434% ( 51, 76 ] 44 0.007% 99.440% ( 76, 110 ] 9 0.001% 99.442% ( 110, 170 ] 19 0.003% 99.444% ( 170, 250 ] 30 0.004% 99.449% ( 250, 380 ] 121 0.018% 99.467% ( 380, 580 ] 284 0.042% 99.509% ( 580, 870 ] 502 0.074% 99.583% ( 870, 1300 ] 731 0.108% 99.691% ( 1300, 1900 ] 961 0.142% 99.833% ( 1900, 2900 ] 1058 0.156% 99.989% ( 2900, 4400 ] 758 0.112% 100.101% ( 4400, 6600 ] 256 0.038% 100.139% ( 6600, 9900 ] 58 0.009% 100.148% ( 9900, 14000 ] 18 0.003% 100.150% ( 14000, 22000 ] 25 0.004% 100.154% ( 22000, 33000 ] 22 0.003% 100.157% ( 33000, 50000 ] 6 0.001% 100.158% ** Level 3 read latency histogram (micros): Count: 2216683 Average: 9.9418 StdDev: 188.55 Min: 1 Median: 1.9808 Max: 68972 Percentiles: P50: 1.98 P75: 2.95 P99: 10.14 P99.9: 806.48 P99.99: 1337.87 ------------------------------------------------------ [ 0, 1 ] 42484 1.917% 1.917% ( 1, 2 ] 1086710 49.024% 50.941% ########## ( 2, 3 ] 561960 25.351% 76.292% ##### ( 3, 4 ] 210472 9.495% 85.787% ## ( 4, 6 ] 240051 10.829% 96.616% ## ( 6, 10 ] 52461 2.367% 98.983% ( 10, 15 ] 13530 0.610% 99.593% ( 15, 22 ] 1424 0.064% 99.658% ( 22, 34 ] 104 0.005% 99.662% ( 34, 51 ] 124 0.006% 99.668% ( 51, 76 ] 189 0.009% 99.676% ( 76, 110 ] 60 0.003% 99.679% ( 110, 170 ] 354 0.016% 99.695% ( 170, 250 ] 710 0.032% 99.727% ( 250, 380 ] 1019 0.046% 99.773% ( 380, 580 ] 1432 0.065% 99.838% ( 580, 870 ] 1770 0.080% 99.917% ( 870, 1300 ] 1528 0.069% 99.986% ( 1300, 1900 ] 1257 0.057% 100.043% ( 1900, 2900 ] 1131 0.051% 100.094% ( 2900, 4400 ] 881 0.040% 100.134% ( 4400, 6600 ] 277 0.012% 100.146% ( 6600, 9900 ] 55 0.002% 100.149% ( 9900, 14000 ] 22 0.001% 100.150% ( 14000, 22000 ] 33 0.001% 100.151% ( 22000, 33000 ] 23 0.001% 100.152% ( 33000, 50000 ] 7 0.000% 100.153% ( 50000, 75000 ] 1 0.000% 100.153% ** Level 4 read latency histogram (micros): Count: 1164178 Average: 25.1867 StdDev: 402.39 Min: 1 Median: 2.0238 Max: 67564 Percentiles: P50: 2.02 P75: 3.09 P99: 390.42 P99.9: 2564.69 P99.99: 3520.61 ------------------------------------------------------ [ 0, 1 ] 23661 2.032% 2.032% ( 1, 2 ] 551605 47.382% 49.414% ######### ( 2, 3 ] 287283 24.677% 74.091% ##### ( 3, 4 ] 112903 9.698% 83.789% ## ( 4, 6 ] 130744 11.231% 95.019% ## ( 6, 10 ] 30548 2.624% 97.643% # ( 10, 15 ] 9102 0.782% 98.425% ( 15, 22 ] 905 0.078% 98.503% ( 22, 34 ] 81 0.007% 98.510% ( 34, 51 ] 92 0.008% 98.518% ( 51, 76 ] 112 0.010% 98.528% ( 76, 110 ] 133 0.011% 98.539% ( 110, 170 ] 1114 0.096% 98.635% ( 170, 250 ] 1903 0.163% 98.798% ( 250, 380 ] 2206 0.189% 98.988% ( 380, 580 ] 2768 0.238% 99.225% ( 580, 870 ] 2936 0.252% 99.478% ( 870, 1300 ] 2378 0.204% 99.682% ( 1300, 1900 ] 1584 0.136% 99.818% ( 1900, 2900 ] 1438 0.124% 99.941% ( 2900, 4400 ] 1367 0.117% 100.059% ( 4400, 6600 ] 497 0.043% 100.102% ( 6600, 9900 ] 103 0.009% 100.110% ( 9900, 14000 ] 23 0.002% 100.112% ( 14000, 22000 ] 56 0.005% 100.117% ( 22000, 33000 ] 68 0.006% 100.123% ( 33000, 50000 ] 30 0.003% 100.126% ( 50000, 75000 ] 5 0.000% 100.126% ** Level 5 read latency histogram (micros): Count: 69510 Average: 991.3431 StdDev: 1848.65 Min: 85 Median: 534.4714 Max: 76748 Percentiles: P50: 534.47 P75: 1070.71 P99: 6223.97 P99.9: 27815.19 P99.99: 61632.69 ------------------------------------------------------ ( 76, 110 ] 536 0.771% 0.771% ( 110, 170 ] 6301 9.065% 9.836% ## ( 170, 250 ] 9336 13.431% 23.267% ### ( 250, 380 ] 9669 13.910% 37.177% ### ( 380, 580 ] 11540 16.602% 53.779% ### ( 580, 870 ] 11022 15.857% 69.636% ### ( 870, 1300 ] 7988 11.492% 81.128% ## ( 1300, 1900 ] 4338 6.241% 87.369% # ( 1900, 2900 ] 3652 5.254% 92.623% # ( 2900, 4400 ] 3244 4.667% 97.290% # ( 4400, 6600 ] 1434 2.063% 99.353% ( 6600, 9900 ] 274 0.394% 99.747% ( 9900, 14000 ] 33 0.047% 99.794% ( 14000, 22000 ] 46 0.066% 99.860% ( 22000, 33000 ] 52 0.075% 99.935% ( 33000, 50000 ] 32 0.046% 99.981% ( 50000, 75000 ] 13 0.019% 100.000% ( 75000, 110000 ] 1 0.001% 100.001% ** DB Stats ** Uptime(secs): 23.7 total, 4.2 interval Cumulative writes: 0 writes, 4000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 3.84 GB, 166.00 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.236 H:M:S, 34.7 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 235.84 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.456 H:M:S, 10.9 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 3 num-running-flushes: 1 2024/12/07-19:24:54 ... thread 0: (1000000,5000000) ops and (240677.2,180582.4) ops/second in (4.154943,27.688188) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 18/7 3.50 GB 226.6 3.4 0.0 3.4 8.1 4.7 0.0 1.7 82.5 197.9 42.00 28.16 81 0.519 3518K 3600 0.0 0.0 L1 4/4 277.94 MB 0.0 1.6 1.2 0.4 1.6 1.2 0.0 1.3 133.0 132.7 12.27 8.06 4 3.068 1656K 3375 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 3.1 130.7 130.5 1.45 0.88 1 1.451 192K 350 0.0 0.0 L3 16/0 938.96 MB 0.9 7.8 3.6 4.1 7.7 3.6 0.2 2.1 118.9 118.0 66.80 38.80 25 2.672 5166K 13K 0.0 0.0 L4 172/0 9.76 GB 1.0 9.9 5.3 4.6 9.7 5.1 0.8 1.8 116.3 114.1 86.76 50.15 58 1.496 5284K 865 0.0 0.0 L5 1168/0 96.14 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1378/11 110.59 GB 0.0 22.8 10.2 12.6 27.3 14.7 7.7 5.8 111.5 133.4 209.28 126.03 169 1.238 15M 21K 0.0 0.0 Int 0/0 0.00 KB 0.0 22.8 10.2 12.6 27.3 14.7 7.7 5.8 111.5 133.4 209.28 126.03 169 1.238 15M 21K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 22.8 10.2 12.6 22.5 9.9 0.0 0.0 127.2 125.7 183.36 112.04 101 1.815 15M 21K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 4.7 4.7 0.0 0.0 0.0 187.1 25.92 14.00 68 0.381 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 27.9 total, 27.7 interval Flush(GB): cumulative 4.737, interval 4.737 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 27.25 GB write, 1001.38 MB/s write, 22.78 GB read, 836.98 MB/s read, 209.3 seconds Interval compaction: 27.25 GB write, 1007.88 MB/s write, 22.78 GB read, 842.41 MB/s read, 209.3 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 5, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 5, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 5, total-stops: 55, interval: 60 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 1404161 Average: 11.6126 StdDev: 159.21 Min: 1 Median: 1.7394 Max: 55730 Percentiles: P50: 1.74 P75: 2.58 P99: 228.30 P99.9: 933.09 P99.99: 1810.90 ------------------------------------------------------ [ 0, 1 ] 124208 8.846% 8.846% ## ( 1, 2 ] 781559 55.660% 64.506% ########### ( 2, 3 ] 255789 18.217% 82.722% #### ( 3, 4 ] 91323 6.504% 89.226% # ( 4, 6 ] 96086 6.843% 96.069% # ( 6, 10 ] 17642 1.256% 97.326% ( 10, 15 ] 3812 0.271% 97.597% ( 15, 22 ] 409 0.029% 97.626% ( 22, 34 ] 31 0.002% 97.628% ( 34, 51 ] 24 0.002% 97.630% ( 51, 76 ] 36 0.003% 97.633% ( 76, 110 ] 910 0.065% 97.697% ( 110, 170 ] 10914 0.777% 98.475% ( 170, 250 ] 10122 0.721% 99.196% ( 250, 380 ] 4350 0.310% 99.505% ( 380, 580 ] 3352 0.239% 99.744% ( 580, 870 ] 2039 0.145% 99.889% ( 870, 1300 ] 1028 0.073% 99.962% ( 1300, 1900 ] 454 0.032% 99.995% ( 1900, 2900 ] 337 0.024% 100.019% ( 2900, 4400 ] 263 0.019% 100.038% ( 4400, 6600 ] 64 0.005% 100.042% ( 6600, 9900 ] 8 0.001% 100.043% ( 9900, 14000 ] 12 0.001% 100.044% ( 14000, 22000 ] 9 0.001% 100.044% ( 22000, 33000 ] 11 0.001% 100.045% ( 33000, 50000 ] 6 0.000% 100.045% ( 50000, 75000 ] 1 0.000% 100.045% ** Level 1 read latency histogram (micros): Count: 344218 Average: 9.1967 StdDev: 177.34 Min: 1 Median: 1.9358 Max: 64993 Percentiles: P50: 1.94 P75: 2.88 P99: 12.61 P99.9: 1279.32 P99.99: 3967.33 ------------------------------------------------------ [ 0, 1 ] 7837 2.277% 2.277% ( 1, 2 ] 175546 50.998% 53.275% ########## ( 2, 3 ] 84911 24.668% 77.943% ##### ( 3, 4 ] 30065 8.734% 86.677% ## ( 4, 6 ] 33879 9.842% 96.520% ## ( 6, 10 ] 7583 2.203% 98.723% ( 10, 15 ] 1827 0.531% 99.253% ( 15, 22 ] 191 0.055% 99.309% ( 22, 34 ] 18 0.005% 99.314% ( 34, 51 ] 18 0.005% 99.319% ( 51, 76 ] 29 0.008% 99.328% ( 76, 110 ] 23 0.007% 99.334% ( 110, 170 ] 298 0.087% 99.421% ( 170, 250 ] 359 0.104% 99.525% ( 250, 380 ] 327 0.095% 99.620% ( 380, 580 ] 361 0.105% 99.725% ( 580, 870 ] 360 0.105% 99.830% ( 870, 1300 ] 254 0.074% 99.904% ( 1300, 1900 ] 119 0.035% 99.938% ( 1900, 2900 ] 106 0.031% 99.969% ( 2900, 4400 ] 102 0.030% 99.999% ( 4400, 6600 ] 39 0.011% 100.010% ( 6600, 9900 ] 7 0.002% 100.012% ( 9900, 14000 ] 2 0.001% 100.012% ( 14000, 22000 ] 4 0.001% 100.014% ( 22000, 33000 ] 1 0.000% 100.014% ( 50000, 75000 ] 1 0.000% 100.014% ** Level 2 read latency histogram (micros): Count: 676702 Average: 19.6044 StdDev: 301.79 Min: 1 Median: 2.0286 Max: 42005 Percentiles: P50: 2.03 P75: 3.13 P99: 13.58 P99.9: 2329.39 P99.99: 2910.55 ------------------------------------------------------ [ 0, 1 ] 18030 2.664% 2.664% # ( 1, 2 ] 315603 46.638% 49.303% ######### ( 2, 3 ] 165183 24.410% 73.713% ##### ( 3, 4 ] 68189 10.077% 83.789% ## ( 4, 6 ] 79035 11.679% 95.469% ## ( 6, 10 ] 19276 2.849% 98.317% # ( 10, 15 ] 6455 0.954% 99.271% ( 15, 22 ] 972 0.144% 99.415% ( 22, 34 ] 100 0.015% 99.430% ( 34, 51 ] 27 0.004% 99.434% ( 51, 76 ] 44 0.007% 99.440% ( 76, 110 ] 9 0.001% 99.442% ( 110, 170 ] 19 0.003% 99.444% ( 170, 250 ] 30 0.004% 99.449% ( 250, 380 ] 121 0.018% 99.467% ( 380, 580 ] 284 0.042% 99.509% ( 580, 870 ] 502 0.074% 99.583% ( 870, 1300 ] 731 0.108% 99.691% ( 1300, 1900 ] 961 0.142% 99.833% ( 1900, 2900 ] 1058 0.156% 99.989% ( 2900, 4400 ] 758 0.112% 100.101% ( 4400, 6600 ] 256 0.038% 100.139% ( 6600, 9900 ] 58 0.009% 100.148% ( 9900, 14000 ] 18 0.003% 100.150% ( 14000, 22000 ] 25 0.004% 100.154% ( 22000, 33000 ] 22 0.003% 100.157% ( 33000, 50000 ] 6 0.001% 100.158% ** Level 3 read latency histogram (micros): Count: 2246332 Average: 9.9645 StdDev: 187.40 Min: 1 Median: 1.9772 Max: 68972 Percentiles: P50: 1.98 P75: 2.95 P99: 10.51 P99.9: 803.32 P99.99: 1335.50 ------------------------------------------------------ [ 0, 1 ] 43993 1.958% 1.958% ( 1, 2 ] 1104300 49.160% 51.119% ########## ( 2, 3 ] 567593 25.268% 76.386% ##### ( 3, 4 ] 212131 9.443% 85.830% ## ( 4, 6 ] 241660 10.758% 96.588% ## ( 6, 10 ] 52801 2.351% 98.938% ( 10, 15 ] 13613 0.606% 99.544% ( 15, 22 ] 1435 0.064% 99.608% ( 22, 34 ] 104 0.005% 99.613% ( 34, 51 ] 124 0.006% 99.618% ( 51, 76 ] 189 0.008% 99.627% ( 76, 110 ] 89 0.004% 99.631% ( 110, 170 ] 879 0.039% 99.670% ( 170, 250 ] 1098 0.049% 99.719% ( 250, 380 ] 1161 0.052% 99.770% ( 380, 580 ] 1528 0.068% 99.838% ( 580, 870 ] 1802 0.080% 99.918% ( 870, 1300 ] 1533 0.068% 99.987% ( 1300, 1900 ] 1257 0.056% 100.043% ( 1900, 2900 ] 1133 0.050% 100.093% ( 2900, 4400 ] 881 0.039% 100.132% ( 4400, 6600 ] 277 0.012% 100.145% ( 6600, 9900 ] 55 0.002% 100.147% ( 9900, 14000 ] 22 0.001% 100.148% ( 14000, 22000 ] 33 0.001% 100.150% ( 22000, 33000 ] 23 0.001% 100.151% ( 33000, 50000 ] 7 0.000% 100.151% ( 50000, 75000 ] 1 0.000% 100.151% ** Level 4 read latency histogram (micros): Count: 1206449 Average: 25.8598 StdDev: 395.82 Min: 1 Median: 2.0181 Max: 67564 Percentiles: P50: 2.02 P75: 3.11 P99: 413.50 P99.9: 2533.53 P99.99: 3510.69 ------------------------------------------------------ [ 0, 1 ] 25352 2.101% 2.101% ( 1, 2 ] 572561 47.458% 49.560% ######### ( 2, 3 ] 294137 24.380% 73.940% ##### ( 3, 4 ] 114833 9.518% 83.458% ## ( 4, 6 ] 132703 10.999% 94.458% ## ( 6, 10 ] 31225 2.588% 97.046% # ( 10, 15 ] 9223 0.764% 97.811% ( 15, 22 ] 929 0.077% 97.888% ( 22, 34 ] 81 0.007% 97.894% ( 34, 51 ] 94 0.008% 97.902% ( 51, 76 ] 112 0.009% 97.911% ( 76, 110 ] 431 0.036% 97.947% ( 110, 170 ] 4467 0.370% 98.317% ( 170, 250 ] 4588 0.380% 98.698% ( 250, 380 ] 3087 0.256% 98.953% ( 380, 580 ] 3352 0.278% 99.231% ( 580, 870 ] 3157 0.262% 99.493% ( 870, 1300 ] 2409 0.200% 99.693% ( 1300, 1900 ] 1588 0.132% 99.824% ( 1900, 2900 ] 1442 0.120% 99.944% ( 2900, 4400 ] 1369 0.113% 100.057% ( 4400, 6600 ] 497 0.041% 100.098% ( 6600, 9900 ] 103 0.009% 100.107% ( 9900, 14000 ] 23 0.002% 100.109% ( 14000, 22000 ] 56 0.005% 100.114% ( 22000, 33000 ] 68 0.006% 100.119% ( 33000, 50000 ] 30 0.002% 100.122% ( 50000, 75000 ] 5 0.000% 100.122% ** Level 5 read latency histogram (micros): Count: 116087 Average: 681.6414 StdDev: 1482.52 Min: 82 Median: 293.0991 Max: 76748 Percentiles: P50: 293.10 P75: 687.81 P99: 5509.40 P99.9: 18680.52 P99.99: 52675.58 ------------------------------------------------------ ( 76, 110 ] 2245 1.934% 1.934% ( 110, 170 ] 25923 22.331% 24.265% #### ( 170, 250 ] 25060 21.587% 45.852% #### ( 250, 380 ] 14525 12.512% 58.364% ### ( 380, 580 ] 14783 12.734% 71.098% ### ( 580, 870 ] 12183 10.495% 81.593% ## ( 870, 1300 ] 8203 7.066% 88.659% # ( 1300, 1900 ] 4362 3.758% 92.417% # ( 1900, 2900 ] 3670 3.161% 95.578% # ( 2900, 4400 ] 3249 2.799% 98.377% # ( 4400, 6600 ] 1434 1.235% 99.612% ( 6600, 9900 ] 274 0.236% 99.848% ( 9900, 14000 ] 33 0.028% 99.877% ( 14000, 22000 ] 46 0.040% 99.916% ( 22000, 33000 ] 52 0.045% 99.961% ( 33000, 50000 ] 32 0.028% 99.989% ( 50000, 75000 ] 13 0.011% 100.000% ( 75000, 110000 ] 1 0.001% 100.001% ** DB Stats ** Uptime(secs): 27.9 total, 4.2 interval Cumulative writes: 0 writes, 5000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 4.81 GB, 176.57 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:8.927 H:M:S, 32.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 236.87 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:0.691 H:M:S, 16.6 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 1 num-running-flushes: 1 2024/12/07-19:25:04 ... thread 0: (1000000,6000000) ops and (103410.2,160606.4) ops/second in (9.670229,37.358417) seconds ** Compaction Stats [default] ** Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ L0 19/11 4.42 GB 295.1 5.4 0.0 5.4 11.1 5.6 0.0 2.0 105.1 214.7 52.75 38.32 100 0.528 5627K 11K 0.0 0.0 L1 4/4 277.94 MB 0.0 1.6 1.2 0.4 1.6 1.2 0.0 1.3 133.0 132.7 12.27 8.06 4 3.068 1656K 3375 0.0 0.0 L2 0/0 0.00 KB 0.0 0.2 0.1 0.1 0.2 0.1 0.9 3.1 130.7 130.5 1.45 0.88 1 1.451 192K 350 0.0 0.0 L3 16/0 938.96 MB 0.9 7.8 3.6 4.1 7.7 3.6 0.2 2.1 118.9 118.0 66.80 38.80 25 2.672 5166K 13K 0.0 0.0 L4 172/0 9.76 GB 1.0 9.9 5.3 4.6 9.7 5.1 0.8 1.8 116.3 114.1 86.76 50.15 58 1.496 5284K 865 0.0 0.0 L5 1168/0 96.14 GB 1.0 0.0 0.0 0.0 0.0 0.0 5.7 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 Sum 1379/15 111.51 GB 0.0 24.8 10.2 14.6 30.2 15.6 7.7 5.3 115.5 140.5 220.03 136.20 188 1.170 17M 29K 0.0 0.0 Int 0/0 0.00 KB 0.0 24.8 10.2 14.6 30.2 15.6 7.7 5.3 115.5 140.5 220.03 136.20 188 1.170 17M 29K 0.0 0.0 ** Compaction Stats [default] ** Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Low 0/0 0.00 KB 0.0 24.8 10.2 14.6 24.5 9.9 0.0 0.0 132.9 131.5 191.13 119.67 105 1.820 17M 29K 0.0 0.0 High 0/0 0.00 KB 0.0 0.0 0.0 0.0 5.7 5.7 0.0 0.0 0.0 200.5 28.91 16.53 83 0.348 0 0 0.0 0.0 Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 Uptime(secs): 37.5 total, 37.4 interval Flush(GB): cumulative 5.660, interval 5.660 AddFile(GB): cumulative 0.000, interval 0.000 AddFile(Total Files): cumulative 0, interval 0 AddFile(L0 Files): cumulative 0, interval 0 AddFile(Keys): cumulative 0, interval 0 Cumulative compaction: 30.20 GB write, 823.73 MB/s write, 24.81 GB read, 676.72 MB/s read, 220.0 seconds Interval compaction: 30.20 GB write, 827.69 MB/s write, 24.81 GB read, 679.98 MB/s read, 220.0 seconds Write Stall (count): cf-l0-file-count-limit-delays-with-ongoing-compaction: 15, cf-l0-file-count-limit-stops-with-ongoing-compaction: 0, l0-file-count-limit-delays: 15, l0-file-count-limit-stops: 0, memtable-limit-delays: 0, memtable-limit-stops: 55, pending-compaction-bytes-delays: 0, pending-compaction-bytes-stops: 0, total-delays: 15, total-stops: 55, interval: 70 total count ** File Read Latency Histogram By Level [default] ** ** Level 0 read latency histogram (micros): Count: 2033222 Average: 14.6293 StdDev: 138.06 Min: 0 Median: 1.6522 Max: 55730 Percentiles: P50: 1.65 P75: 2.40 P99: 245.82 P99.9: 802.49 P99.99: 1341.89 ------------------------------------------------------ [ 0, 1 ] 284025 13.969% 13.969% ### ( 1, 2 ] 1123183 55.242% 69.211% ########### ( 2, 3 ] 293646 14.442% 83.653% ### ( 3, 4 ] 104702 5.150% 88.803% # ( 4, 6 ] 106018 5.214% 94.017% # ( 6, 10 ] 19265 0.948% 94.964% ( 10, 15 ] 4289 0.211% 95.175% ( 15, 22 ] 486 0.024% 95.199% ( 22, 34 ] 37 0.002% 95.201% ( 34, 51 ] 25 0.001% 95.202% ( 51, 76 ] 42 0.002% 95.204% ( 76, 110 ] 3925 0.193% 95.398% ( 110, 170 ] 44327 2.180% 97.578% ( 170, 250 ] 30516 1.501% 99.079% ( 250, 380 ] 8550 0.421% 99.499% ( 380, 580 ] 5977 0.294% 99.793% ( 580, 870 ] 2836 0.139% 99.932% ( 870, 1300 ] 1137 0.056% 99.988% ( 1300, 1900 ] 468 0.023% 100.011% ( 1900, 2900 ] 357 0.018% 100.029% ( 2900, 4400 ] 283 0.014% 100.043% ( 4400, 6600 ] 66 0.003% 100.046% ( 6600, 9900 ] 8 0.000% 100.047% ( 9900, 14000 ] 12 0.001% 100.047% ( 14000, 22000 ] 9 0.000% 100.048% ( 22000, 33000 ] 11 0.001% 100.048% ( 33000, 50000 ] 6 0.000% 100.048% ( 50000, 75000 ] 1 0.000% 100.048% ** Level 1 read latency histogram (micros): Count: 362291 Average: 9.5477 StdDev: 173.35 Min: 1 Median: 1.9745 Max: 64993 Percentiles: P50: 1.97 P75: 2.96 P99: 20.79 P99.9: 1253.80 P99.99: 3940.75 ------------------------------------------------------ [ 0, 1 ] 7863 2.170% 2.170% ( 1, 2 ] 177811 49.080% 51.250% ########## ( 2, 3 ] 89463 24.694% 75.944% ##### ( 3, 4 ] 34381 9.490% 85.434% ## ( 4, 6 ] 38346 10.584% 96.018% ## ( 6, 10 ] 8413 2.322% 98.340% ( 10, 15 ] 2120 0.585% 98.925% ( 15, 22 ] 328 0.091% 99.016% ( 22, 34 ] 52 0.014% 99.030% ( 34, 51 ] 18 0.005% 99.035% ( 51, 76 ] 29 0.008% 99.043% ( 76, 110 ] 69 0.019% 99.062% ( 110, 170 ] 900 0.248% 99.310% ( 170, 250 ] 735 0.203% 99.513% ( 250, 380 ] 389 0.107% 99.621% ( 380, 580 ] 415 0.115% 99.735% ( 580, 870 ] 370 0.102% 99.837% ( 870, 1300 ] 254 0.070% 99.908% ( 1300, 1900 ] 120 0.033% 99.941% ( 1900, 2900 ] 108 0.030% 99.970% ( 2900, 4400 ] 102 0.028% 99.999% ( 4400, 6600 ] 39 0.011% 100.009% ( 6600, 9900 ] 7 0.002% 100.011% ( 9900, 14000 ] 2 0.001% 100.012% ( 14000, 22000 ] 4 0.001% 100.013% ( 22000, 33000 ] 1 0.000% 100.013% ( 50000, 75000 ] 1 0.000% 100.014% ** Level 2 read latency histogram (micros): Count: 676702 Average: 19.6044 StdDev: 301.79 Min: 1 Median: 2.0286 Max: 42005 Percentiles: P50: 2.03 P75: 3.13 P99: 13.58 P99.9: 2329.39 P99.99: 2910.55 ------------------------------------------------------ [ 0, 1 ] 18030 2.664% 2.664% # ( 1, 2 ] 315603 46.638% 49.303% ######### ( 2, 3 ] 165183 24.410% 73.713% ##### ( 3, 4 ] 68189 10.077% 83.789% ## ( 4, 6 ] 79035 11.679% 95.469% ## ( 6, 10 ] 19276 2.849% 98.317% # ( 10, 15 ] 6455 0.954% 99.271% ( 15, 22 ] 972 0.144% 99.415% ( 22, 34 ] 100 0.015% 99.430% ( 34, 51 ] 27 0.004% 99.434% ( 51, 76 ] 44 0.007% 99.440% ( 76, 110 ] 9 0.001% 99.442% ( 110, 170 ] 19 0.003% 99.444% ( 170, 250 ] 30 0.004% 99.449% ( 250, 380 ] 121 0.018% 99.467% ( 380, 580 ] 284 0.042% 99.509% ( 580, 870 ] 502 0.074% 99.583% ( 870, 1300 ] 731 0.108% 99.691% ( 1300, 1900 ] 961 0.142% 99.833% ( 1900, 2900 ] 1058 0.156% 99.989% ( 2900, 4400 ] 758 0.112% 100.101% ( 4400, 6600 ] 256 0.038% 100.139% ( 6600, 9900 ] 58 0.009% 100.148% ( 9900, 14000 ] 18 0.003% 100.150% ( 14000, 22000 ] 25 0.004% 100.154% ( 22000, 33000 ] 22 0.003% 100.157% ( 33000, 50000 ] 6 0.001% 100.158% ** Level 3 read latency histogram (micros): Count: 2249991 Average: 10.2554 StdDev: 187.45 Min: 1 Median: 1.9789 Max: 68972 Percentiles: P50: 1.98 P75: 2.95 P99: 11.84 P99.9: 806.38 P99.99: 1336.75 ------------------------------------------------------ [ 0, 1 ] 43993 1.955% 1.955% ( 1, 2 ] 1104301 49.080% 51.035% ########## ( 2, 3 ] 567594 25.227% 76.262% ##### ( 3, 4 ] 212131 9.428% 85.690% ## ( 4, 6 ] 241664 10.741% 96.431% ## ( 6, 10 ] 52801 2.347% 98.777% ( 10, 15 ] 13613 0.605% 99.382% ( 15, 22 ] 1435 0.064% 99.446% ( 22, 34 ] 104 0.005% 99.451% ( 34, 51 ] 124 0.006% 99.456% ( 51, 76 ] 189 0.008% 99.465% ( 76, 110 ] 265 0.012% 99.477% ( 110, 170 ] 2809 0.125% 99.601% ( 170, 250 ] 2237 0.099% 99.701% ( 250, 380 ] 1383 0.061% 99.762% ( 380, 580 ] 1664 0.074% 99.836% ( 580, 870 ] 1837 0.082% 99.918% ( 870, 1300 ] 1545 0.069% 99.987% ( 1300, 1900 ] 1257 0.056% 100.042% ( 1900, 2900 ] 1136 0.050% 100.093% ( 2900, 4400 ] 881 0.039% 100.132% ( 4400, 6600 ] 277 0.012% 100.144% ( 6600, 9900 ] 55 0.002% 100.147% ( 9900, 14000 ] 22 0.001% 100.148% ( 14000, 22000 ] 33 0.001% 100.149% ( 22000, 33000 ] 23 0.001% 100.150% ( 33000, 50000 ] 7 0.000% 100.151% ( 50000, 75000 ] 1 0.000% 100.151% ** Level 4 read latency histogram (micros): Count: 1228805 Average: 28.6264 StdDev: 393.04 Min: 1 Median: 2.0558 Max: 67564 Percentiles: P50: 2.06 P75: 3.25 P99: 449.15 P99.9: 2520.56 P99.99: 3508.45 ------------------------------------------------------ [ 0, 1 ] 25353 2.063% 2.063% ( 1, 2 ] 572626 46.600% 48.663% ######### ( 2, 3 ] 294443 23.962% 72.625% ##### ( 3, 4 ] 115104 9.367% 81.992% ## ( 4, 6 ] 133292 10.847% 92.840% ## ( 6, 10 ] 31296 2.547% 95.386% # ( 10, 15 ] 9240 0.752% 96.138% ( 15, 22 ] 929 0.076% 96.214% ( 22, 34 ] 81 0.007% 96.221% ( 34, 51 ] 94 0.008% 96.228% ( 51, 76 ] 112 0.009% 96.237% ( 76, 110 ] 1419 0.115% 96.353% ( 110, 170 ] 15490 1.261% 97.613% ( 170, 250 ] 11188 0.910% 98.524% ( 250, 380 ] 4402 0.358% 98.882% ( 380, 580 ] 4191 0.341% 99.223% ( 580, 870 ] 3392 0.276% 99.499% ( 870, 1300 ] 2434 0.198% 99.697% ( 1300, 1900 ] 1592 0.130% 99.827% ( 1900, 2900 ] 1449 0.118% 99.945% ( 2900, 4400 ] 1371 0.112% 100.056% ( 4400, 6600 ] 497 0.040% 100.097% ( 6600, 9900 ] 103 0.008% 100.105% ( 9900, 14000 ] 23 0.002% 100.107% ( 14000, 22000 ] 56 0.005% 100.112% ( 22000, 33000 ] 68 0.006% 100.117% ( 33000, 50000 ] 30 0.002% 100.120% ( 50000, 75000 ] 5 0.000% 100.120% ** Level 5 read latency histogram (micros): Count: 237825 Average: 429.6309 StdDev: 1067.43 Min: 80 Median: 197.1903 Max: 76748 Percentiles: P50: 197.19 P75: 353.39 P99: 4171.84 P99.9: 9143.35 P99.99: 43740.55 ------------------------------------------------------ ( 76, 110 ] 7774 3.269% 3.269% # ( 110, 170 ] 89582 37.667% 40.936% ######## ( 170, 250 ] 63424 26.668% 67.604% ##### ( 250, 380 ] 22115 9.299% 76.903% ## ( 380, 580 ] 19754 8.306% 85.209% ## ( 580, 870 ] 13560 5.702% 90.911% # ( 870, 1300 ] 8389 3.527% 94.438% # ( 1300, 1900 ] 4389 1.845% 96.284% ( 1900, 2900 ] 3699 1.555% 97.839% ( 2900, 4400 ] 3256 1.369% 99.208% ( 4400, 6600 ] 1434 0.603% 99.811% ( 6600, 9900 ] 274 0.115% 99.926% ( 9900, 14000 ] 33 0.014% 99.940% ( 14000, 22000 ] 46 0.019% 99.960% ( 22000, 33000 ] 52 0.022% 99.981% ( 33000, 50000 ] 32 0.013% 99.995% ( 50000, 75000 ] 13 0.005% 100.000% ( 75000, 110000 ] 1 0.000% 100.001% ** DB Stats ** Uptime(secs): 37.5 total, 9.7 interval Cumulative writes: 0 writes, 6000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 5.77 GB, 157.30 MB/s Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Cumulative stall: 00:00:15.002 H:M:S, 40.0 percent Interval writes: 0 writes, 1000K keys, 0 commit groups, 0.0 writes per commit group, ingest: 984.19 MB, 101.78 MB/s Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s Interval stall: 00:00:6.075 H:M:S, 62.8 percent Write Stall (count): write-buffer-manager-limit-stops: 0, num-running-compactions: 2 num-running-flushes: 1 using bdev Nvme0n1 Initializing RocksDB Options from the specified file Initializing RocksDB Options from command-line flags Integrated BlobDB: blob cache disabled Keys: 16 bytes each (+ 0 bytes user-defined timestamp) Values: 1000 bytes each (1000 bytes after compression) Entries: 100000000 Prefix: 0 bytes Keys per prefix: 0 RawSize: 96893.3 MB (estimated) FileSize: 96893.3 MB (estimated) Write rate: 0 bytes/second Read rate: 0 ops/second Compression: NoCompression Compression sampling rate: 0 Memtablerep: SkipListFactory Perf Level: 1 ------------------------------------------------ DB path: [/mnt/rocksdb] readwhilewriting : 348.134 micros/op 11475 ops/sec 60.128 seconds 689996 operations; 11.1 MB/s (167999 of 167999 found) Microseconds per read: Count: 689996 Average: 348.1375 StdDev: 1324.41 Min: 2 Median: 215.8454 Max: 300670 Percentiles: P50: 215.85 P75: 302.99 P99: 2398.33 P99.9: 19746.37 P99.99: 45395.90 ------------------------------------------------------ ( 1, 2 ] 2 0.000% 0.000% ( 2, 3 ] 25 0.004% 0.004% ( 3, 4 ] 26 0.004% 0.008% ( 4, 6 ] 77 0.011% 0.019% ( 6, 10 ] 241 0.035% 0.054% ( 10, 15 ] 1676 0.243% 0.297% ( 15, 22 ] 1987 0.288% 0.585% ( 22, 34 ] 5483 0.795% 1.379% ( 34, 51 ] 2068 0.300% 1.679% ( 51, 76 ] 263 0.038% 1.717% ( 76, 110 ] 1247 0.181% 1.898% ( 110, 170 ] 155572 22.547% 24.445% ##### ( 170, 250 ] 307697 44.594% 69.039% ######### ( 250, 380 ] 100913 14.625% 83.664% ### ( 380, 580 ] 60074 8.706% 92.370% ## ( 580, 870 ] 26467 3.836% 96.206% # ( 870, 1300 ] 12312 1.784% 97.990% ( 1300, 1900 ] 5191 0.752% 98.743% ( 1900, 2900 ] 3562 0.516% 99.259% ( 2900, 4400 ] 2644 0.383% 99.642% ( 4400, 6600 ] 887 0.129% 99.771% ( 6600, 9900 ] 181 0.026% 99.797% ( 9900, 14000 ] 173 0.025% 99.822% ( 14000, 22000 ] 749 0.109% 99.931% ( 22000, 33000 ] 340 0.049% 99.980% ( 33000, 50000 ] 96 0.014% 99.994% ( 50000, 75000 ] 29 0.004% 99.998% ( 75000, 110000 ] 5 0.001% 99.999% ( 110000, 170000 ] 5 0.001% 99.999% ( 170000, 250000 ] 1 0.000% 100.000% ( 250000, 380000 ] 3 0.000% 100.000% STATISTICS: rocksdb.block.cache.miss COUNT : 0 rocksdb.block.cache.hit COUNT : 0 rocksdb.block.cache.add COUNT : 0 rocksdb.block.cache.add.failures COUNT : 0 rocksdb.block.cache.index.miss COUNT : 0 rocksdb.block.cache.index.hit COUNT : 0 rocksdb.block.cache.index.add COUNT : 0 rocksdb.block.cache.index.bytes.insert COUNT : 0 rocksdb.block.cache.filter.miss COUNT : 0 rocksdb.block.cache.filter.hit COUNT : 0 rocksdb.block.cache.filter.add COUNT : 0 rocksdb.block.cache.filter.bytes.insert COUNT : 0 rocksdb.block.cache.data.miss COUNT : 0 rocksdb.block.cache.data.hit COUNT : 0 rocksdb.block.cache.data.add COUNT : 0 rocksdb.block.cache.data.bytes.insert COUNT : 0 rocksdb.block.cache.bytes.read COUNT : 0 rocksdb.block.cache.bytes.write COUNT : 0 rocksdb.bloom.filter.useful COUNT : 12912389 rocksdb.bloom.filter.full.positive COUNT : 815003 rocksdb.bloom.filter.full.true.positive COUNT : 689672 rocksdb.persistent.cache.hit COUNT : 0 rocksdb.persistent.cache.miss COUNT : 0 rocksdb.sim.block.cache.hit COUNT : 0 rocksdb.sim.block.cache.miss COUNT : 0 rocksdb.memtable.hit COUNT : 324 rocksdb.memtable.miss COUNT : 689672 rocksdb.l0.hit COUNT : 30120 rocksdb.l1.hit COUNT : 1861 rocksdb.l2andup.hit COUNT : 657691 rocksdb.compaction.key.drop.new COUNT : 297006 rocksdb.compaction.key.drop.obsolete COUNT : 0 rocksdb.compaction.key.drop.range_del COUNT : 0 rocksdb.compaction.key.drop.user COUNT : 0 rocksdb.compaction.range_del.drop.obsolete COUNT : 0 rocksdb.compaction.optimized.del.drop.obsolete COUNT : 0 rocksdb.compaction.cancelled COUNT : 0 rocksdb.number.keys.written COUNT : 6810806 rocksdb.number.keys.read COUNT : 689996 rocksdb.number.keys.updated COUNT : 0 rocksdb.bytes.written COUNT : 7028751792 rocksdb.bytes.read COUNT : 689996000 rocksdb.number.db.seek COUNT : 0 rocksdb.number.db.next COUNT : 0 rocksdb.number.db.prev COUNT : 0 rocksdb.number.db.seek.found COUNT : 0 rocksdb.number.db.next.found COUNT : 0 rocksdb.number.db.prev.found COUNT : 0 rocksdb.db.iter.bytes.read COUNT : 0 rocksdb.no.file.opens COUNT : 1756 rocksdb.no.file.errors COUNT : 0 rocksdb.stall.micros COUNT : 34105963 rocksdb.db.mutex.wait.micros COUNT : 0 rocksdb.number.multiget.get COUNT : 0 rocksdb.number.multiget.keys.read COUNT : 0 rocksdb.number.multiget.bytes.read COUNT : 0 rocksdb.number.merge.failures COUNT : 0 rocksdb.bloom.filter.prefix.checked COUNT : 0 rocksdb.bloom.filter.prefix.useful COUNT : 0 rocksdb.number.reseeks.iteration COUNT : 0 rocksdb.getupdatessince.calls COUNT : 0 rocksdb.wal.synced COUNT : 0 rocksdb.wal.bytes COUNT : 0 rocksdb.write.self COUNT : 0 rocksdb.write.other COUNT : 0 rocksdb.write.wal COUNT : 0 rocksdb.compact.read.bytes COUNT : 30480790712 rocksdb.compact.write.bytes COUNT : 30174944248 rocksdb.flush.write.bytes COUNT : 7002165848 rocksdb.compact.read.marked.bytes COUNT : 0 rocksdb.compact.read.periodic.bytes COUNT : 0 rocksdb.compact.read.ttl.bytes COUNT : 0 rocksdb.compact.write.marked.bytes COUNT : 0 rocksdb.compact.write.periodic.bytes COUNT : 0 rocksdb.compact.write.ttl.bytes COUNT : 0 rocksdb.number.direct.load.table.properties COUNT : 31 rocksdb.number.superversion_acquires COUNT : 1356 rocksdb.number.superversion_releases COUNT : 1313 rocksdb.number.superversion_cleanups COUNT : 339 rocksdb.number.block.compressed COUNT : 0 rocksdb.number.block.decompressed COUNT : 0 rocksdb.number.block.not_compressed COUNT : 0 rocksdb.merge.operation.time.nanos COUNT : 0 rocksdb.filter.operation.time.nanos COUNT : 0 rocksdb.row.cache.hit COUNT : 0 rocksdb.row.cache.miss COUNT : 0 rocksdb.read.amp.estimate.useful.bytes COUNT : 0 rocksdb.read.amp.total.read.bytes COUNT : 0 rocksdb.number.rate_limiter.drains COUNT : 0 rocksdb.number.iter.skip COUNT : 0 rocksdb.blobdb.num.put COUNT : 0 rocksdb.blobdb.num.write COUNT : 0 rocksdb.blobdb.num.get COUNT : 0 rocksdb.blobdb.num.multiget COUNT : 0 rocksdb.blobdb.num.seek COUNT : 0 rocksdb.blobdb.num.next COUNT : 0 rocksdb.blobdb.num.prev COUNT : 0 rocksdb.blobdb.num.keys.written COUNT : 0 rocksdb.blobdb.num.keys.read COUNT : 0 rocksdb.blobdb.bytes.written COUNT : 0 rocksdb.blobdb.bytes.read COUNT : 0 rocksdb.blobdb.write.inlined COUNT : 0 rocksdb.blobdb.write.inlined.ttl COUNT : 0 rocksdb.blobdb.write.blob COUNT : 0 rocksdb.blobdb.write.blob.ttl COUNT : 0 rocksdb.blobdb.blob.file.bytes.written COUNT : 0 rocksdb.blobdb.blob.file.bytes.read COUNT : 0 rocksdb.blobdb.blob.file.synced COUNT : 0 rocksdb.blobdb.blob.index.expired.count COUNT : 0 rocksdb.blobdb.blob.index.expired.size COUNT : 0 rocksdb.blobdb.blob.index.evicted.count COUNT : 0 rocksdb.blobdb.blob.index.evicted.size COUNT : 0 rocksdb.blobdb.gc.num.files COUNT : 0 rocksdb.blobdb.gc.num.new.files COUNT : 0 rocksdb.blobdb.gc.failures COUNT : 0 rocksdb.blobdb.gc.num.keys.relocated COUNT : 0 rocksdb.blobdb.gc.bytes.relocated COUNT : 0 rocksdb.blobdb.fifo.num.files.evicted COUNT : 0 rocksdb.blobdb.fifo.num.keys.evicted COUNT : 0 rocksdb.blobdb.fifo.bytes.evicted COUNT : 0 rocksdb.txn.overhead.mutex.prepare COUNT : 0 rocksdb.txn.overhead.mutex.old.commit.map COUNT : 0 rocksdb.txn.overhead.duplicate.key COUNT : 0 rocksdb.txn.overhead.mutex.snapshot COUNT : 0 rocksdb.txn.get.tryagain COUNT : 0 rocksdb.number.multiget.keys.found COUNT : 0 rocksdb.num.iterator.created COUNT : 0 rocksdb.num.iterator.deleted COUNT : 0 rocksdb.block.cache.compression.dict.miss COUNT : 0 rocksdb.block.cache.compression.dict.hit COUNT : 0 rocksdb.block.cache.compression.dict.add COUNT : 0 rocksdb.block.cache.compression.dict.bytes.insert COUNT : 0 rocksdb.block.cache.add.redundant COUNT : 0 rocksdb.block.cache.index.add.redundant COUNT : 0 rocksdb.block.cache.filter.add.redundant COUNT : 0 rocksdb.block.cache.data.add.redundant COUNT : 0 rocksdb.block.cache.compression.dict.add.redundant COUNT : 0 rocksdb.files.marked.trash COUNT : 0 rocksdb.files.deleted.immediately COUNT : 246 rocksdb.error.handler.bg.errro.count COUNT : 0 rocksdb.error.handler.bg.io.errro.count COUNT : 0 rocksdb.error.handler.bg.retryable.io.errro.count COUNT : 0 rocksdb.error.handler.autoresume.count COUNT : 0 rocksdb.error.handler.autoresume.retry.total.count COUNT : 0 rocksdb.error.handler.autoresume.success.count COUNT : 0 rocksdb.memtable.payload.bytes.at.flush COUNT : 6945599488 rocksdb.memtable.garbage.bytes.at.flush COUNT : 2607104 rocksdb.secondary.cache.hits COUNT : 0 rocksdb.verify_checksum.read.bytes COUNT : 0 rocksdb.backup.read.bytes COUNT : 0 rocksdb.backup.write.bytes COUNT : 0 rocksdb.remote.compact.read.bytes COUNT : 0 rocksdb.remote.compact.write.bytes COUNT : 0 rocksdb.hot.file.read.bytes COUNT : 0 rocksdb.warm.file.read.bytes COUNT : 0 rocksdb.cold.file.read.bytes COUNT : 0 rocksdb.hot.file.read.count COUNT : 0 rocksdb.warm.file.read.count COUNT : 0 rocksdb.cold.file.read.count COUNT : 0 rocksdb.last.level.read.bytes COUNT : 0 rocksdb.last.level.read.count COUNT : 0 rocksdb.non.last.level.read.bytes COUNT : 33493406573 rocksdb.non.last.level.read.count COUNT : 7949495 rocksdb.block.checksum.compute.count COUNT : 8207900 rocksdb.multiget.coroutine.count COUNT : 0 rocksdb.blobdb.cache.miss COUNT : 0 rocksdb.blobdb.cache.hit COUNT : 0 rocksdb.blobdb.cache.add COUNT : 0 rocksdb.blobdb.cache.add.failures COUNT : 0 rocksdb.blobdb.cache.bytes.read COUNT : 0 rocksdb.blobdb.cache.bytes.write COUNT : 0 rocksdb.read.async.micros COUNT : 0 rocksdb.async.read.error.count COUNT : 0 rocksdb.secondary.cache.filter.hits COUNT : 0 rocksdb.secondary.cache.index.hits COUNT : 0 rocksdb.secondary.cache.data.hits COUNT : 0 rocksdb.table.open.prefetch.tail.miss COUNT : 0 rocksdb.table.open.prefetch.tail.hit COUNT : 0 rocksdb.db.get.micros P50 : 215.054799 P95 : 777.845056 P99 : 2396.499017 P100 : 300667.000000 COUNT : 689996 SUM : 239547572 rocksdb.db.write.micros P50 : 1.558642 P95 : 4.314599 P99 : 8.507222 P100 : 1044395.000000 COUNT : 6810806 SUM : 51359458 rocksdb.compaction.times.micros P50 : 1506250.000000 P95 : 4030769.230769 P99 : 6390000.000000 P100 : 7474868.000000 COUNT : 110 SUM : 199054089 rocksdb.compaction.times.cpu_micros P50 : 988648.648649 P95 : 2800000.000000 P99 : 4265000.000000 P100 : 4819919.000000 COUNT : 110 SUM : 127467339 rocksdb.subcompaction.setup.times.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.sync.micros P50 : 1003.095238 P95 : 53750.000000 P99 : 172400.000000 P100 : 233342.000000 COUNT : 97 SUM : 968466 rocksdb.compaction.outfile.sync.micros P50 : 12930.434783 P95 : 216736.842105 P99 : 354325.000000 P100 : 658820.000000 COUNT : 358 SUM : 17169266 rocksdb.wal.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.manifest.file.sync.micros P50 : 268.571429 P95 : 4300.000000 P99 : 8404.000000 P100 : 21898.000000 COUNT : 236 SUM : 251459 rocksdb.table.open.io.micros P50 : 11641.312741 P95 : 21631.007752 P99 : 32425.306122 P100 : 244871.000000 COUNT : 1756 SUM : 20511120 rocksdb.db.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.block.compaction.micros P50 : 3.958131 P95 : 9.837951 P99 : 201.558620 P100 : 68980.000000 COUNT : 7381913 SUM : 115308644 rocksdb.read.block.get.micros P50 : 163.618505 P95 : 625.730135 P99 : 2300.007386 P100 : 76876.000000 COUNT : 824217 SUM : 206766093 rocksdb.write.raw.block.micros P50 : 0.525321 P95 : 0.998110 P99 : 3.528967 P100 : 76839.000000 COUNT : 9004561 SUM : 31450841 rocksdb.numfiles.in.singlecompaction P50 : 2.911765 P95 : 5.529412 P99 : 11.000000 P100 : 11.000000 COUNT : 140 SUM : 482 rocksdb.db.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.write.stall P50 : 0.567704 P95 : 1210.868665 P99 : 2589.833720 P100 : 1044235.000000 COUNT : 162218 SUM : 34121412 rocksdb.sst.read.micros P50 : 1.953103 P95 : 178.941837 P99 : 518.892474 P100 : 76748.000000 COUNT : 7949520 SUM : 302882665 rocksdb.num.subcompactions.scheduled P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.per.read P50 : 1000.000000 P95 : 1000.000000 P99 : 1000.000000 P100 : 1000.000000 COUNT : 689996 SUM : 689996000 rocksdb.bytes.per.write P50 : 1032.000000 P95 : 1032.000000 P99 : 1032.000000 P100 : 1032.000000 COUNT : 6810806 SUM : 7028751792 rocksdb.bytes.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.compressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.bytes.decompressed P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.compression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.decompression.times.nanos P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.read.num.merge_operands P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.key.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.value.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.get.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.multiget.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.seek.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.next.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.prev.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.write.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.read.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.blob.file.sync.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.compression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.blobdb.decompression.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.db.flush.micros P50 : 226231.884058 P95 : 1006200.000000 P99 : 1269630.000000 P100 : 1269630.000000 COUNT : 97 SUM : 31762165 rocksdb.sst.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.index.and.filter.blocks.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.sst.read.per.level P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.error.handler.autoresume.retry.count P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.poll.wait.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.prefetched.bytes.discarded P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 381 SUM : 0 rocksdb.multiget.io.batch.size P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.num.level.read.per.multiget P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.async.prefetch.abort.micros P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0 rocksdb.table.open.prefetch.tail.read.bytes P50 : 0.000000 P95 : 0.000000 P99 : 0.000000 P100 : 0.000000 COUNT : 0 SUM : 0